![Page 1: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/1.jpg)
1
What Are Outcomes and Why Should I Want to Assess Them?Dr. Jim Wilson, AVP Academic Affairs Wilmington University
Dana Santoro, Data Analyst – Institutional ResearchWilmington University
![Page 2: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/2.jpg)
2
Class of 2011
What Berlin wall? They never “rolled down” a car window They have grown up with bottled water Wal-mart has always been a larger retailer than Sears and has
always employed more workers than GM High definition televisions have always been available China has always been more interested in making money than
in re-education They never saw Johnny Carson live on television Food packaging has always included nutritional labeling
Courtesy of Beloit College Public Affairs
![Page 3: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/3.jpg)
3
Things Have Changed!
Higher Education Research Institute (HERI) UCLA
40yr Trends Presentation
![Page 4: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/4.jpg)
4
Things Have Changed!
Item 1970 1995 Today
Postage Stamp $0.06 $0.32 $0.39
Bread $0.24 $1.40 $1.39
Milk $1.32 $2.59 $4.29
Gas $0.40 $1.35 $2.60
Car $2,500.00 $12,800.00 $27,800.00
Income $6,933.00 $19,717.00 $43,200.00
House $40,000.00 $111,000.00 $264,000.00
![Page 5: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/5.jpg)
5
Education: Costs
Wilmington University Tuition30 credits, Undergraduate
1971
Full year tuition: $1,500
TodayFull year tuition: $8,400 (New Castle, UG)
![Page 6: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/6.jpg)
6
Education: Some Changes
Courtesy of Beloit College Public Affairs
Today Student-centered learning The “Net Generation” Distance Learning, Online databases
1967 Teacher-centered learning Classroom, Books, Library card catalogs Al Gore was only 20 years old
![Page 7: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/7.jpg)
7
Education: Student Learning
A new “paradigm for higher education”(Suskie, 2006.)
Learning CenteredAssessment feedback helps faculty understand
What is and is not working effectively How to improve the curriculum as well as teaching and
learning strategies
![Page 8: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/8.jpg)
8
Wilmington University Mission
![Page 9: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/9.jpg)
9
What is Assessment of Student Learning?
“Good assessment must begin in the classroom and end there.” (Wolvord & Anderson, 1998, p. 149)
![Page 10: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/10.jpg)
10
What is Assessment of Student Learning?
“Systematically gathering, analyzing, and interpreting evidence to determine how well student learning matches our expectations.” (Suskie, 2006, p.3.)
![Page 11: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/11.jpg)
11
What is Assessment of Student Learning?
“Assessment is first and foremost a tool for faculty members to use as they do their very best to teach their students well.” (Middle States, 2003)
![Page 12: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/12.jpg)
12
Assessment Is A Friend Who…
Honestly tells us how we are doing Helps to clarify what we are doing and why Helps us to make informed decisions Improves student learning Helps us to improve Brags about how well we are doing
![Page 13: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/13.jpg)
13
Assessment Could Be a Foe!
Federal requirements Regional Accreditation Legislators Parents and Community groups Students Professional organizations
![Page 14: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/14.jpg)
14
SummaryWhat is Assessment of Student Learning?
Process of gathering & evaluating informationQuantitative and qualitativeFrom multiple sources
To enhance student learning
![Page 15: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/15.jpg)
15
Student Outcomes Assessment Framework
![Page 16: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/16.jpg)
16
Three Assessment Areas
Student Learning
Teaching Effectiveness
Student satisfaction with their academic experience
![Page 17: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/17.jpg)
17
Graduation Competencies
Division / Program Mission
Professional Standards --------
Benchmarks
PROGRAM COMPETENCIES
CECRAMRubrics, Test Embedded Questions, Clinical Evaluations
Data Collection, Analysis, Reporting, Decisions,Actions
Benchmarks Benchmarks
License & Certification Exams
Major Field Exams
• IDEA Results• Faculty Evaluations• GPA Reports
• Enrollment Data •ACT Survey Results
Assessment of Student Satisfaction
Course Work
Assessment of Teaching Effectiveness
Wilmington UniversityACADEMIC AFFAIRS ASSESSMENT PLAN
COLLEGE MISSION
College Outcomes
Assessment of Student Learning Outcomes
![Page 18: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/18.jpg)
18
Program Improvement Cycle
![Page 19: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/19.jpg)
19
Language of Assessment
Direct evidenceDirect evidence of student learning indicates
whether or not a student has a command of specific content
Examples: Homework assignments, research papers, rubrics
CECRAM (Course-Embedded Criterion-Referenced Assessment Measures)
![Page 20: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/20.jpg)
20
Indirect EvidenceIndirect evidence of student learning is
correlational – data exists which indicates that students are probably learning.
Examples: Course grades, time spent on service learning or homework
Language of Assessment
![Page 21: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/21.jpg)
21
Formative assessmentOngoing assessment that is intended to improve an
individual student’s performance.Purpose: to improve course content, provide
feedback to faculty.
Language of Assessment
![Page 22: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/22.jpg)
22
Summative assessmentProvides a true gauge of “outcomes” of student
learning.Data is typically gathered near the end of program
completionExamples: course-embedded project/test/portfolio,
clinical evaluations, standardized exams
Language of Assessment
![Page 23: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/23.jpg)
23
WU Language
“Good enough”The process is accurate and truthful (Suskie, 2004, p. 302)
“Closing the loop”Outcomes data has been analyzed and appropriate
changes have been made.
![Page 24: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/24.jpg)
24
Elements of Assessing Learning
1. Articulated expectation of student learning at various levels.
2. A plan that describes student learning assessment activities.
3. Evidence that student learning assessment information is used.
4. Documented use of student learning assessment as a part of institutional assessment.
![Page 25: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/25.jpg)
25
Background Information
Academic Affairs Assessment Plan adopted in 2003
Plan called for evaluation in 2006
![Page 26: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/26.jpg)
26
MSCHE Outcomes Assessment Guidelines
Assessment should be:UsefulCost-effective, simpleReasonably accurate and
truthfulOrganized, systematized and
sustained.
Suskie, L. (2005)
![Page 27: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/27.jpg)
27
Major Changes Related to Outcomes Assessment
Five Year Data Collection and Implementation Cycle
Revision of Graduation Competencies Representative Sampling Formal Reporting Cycle
Five Year Program Review
![Page 28: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/28.jpg)
28
How to maintain momentum?
A 5 year cycle will be utilized
Year 1 – Implement findings from program
review
Year 2 – Data collection
Year 3 – Reflection, take appropriate action and
collect “other kinds” of data
Year 4 – Data collection
Year 5 – Program Review Report
![Page 29: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/29.jpg)
29
What are Examples?(of closing the loop)
Program: B.S., Finance Weakness: Undergraduate Finance majors were
missing some important finance skills Source: ETS Major Field Exam Action
Adjust the content of FIN 305 Add a new requirement, FIN 306
Competency Disciplined Inquiry Finance program competencies
![Page 30: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/30.jpg)
30
What are Examples?(of closing the loop)
Program: All UG Education programs Weakness: Students were unclear of required skills Source: Portfolio review Actions:
Curriculum changes Provide candidates with exemplars Ensure understanding of required skills
Competency Disciplined inquiry
![Page 31: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/31.jpg)
*Standardized exams 31
Program: M.S., Community Counseling Weakness: Appraisal Techniques
Source: CECRAM, CPCE*, NCE* & surveys
Response: Integration of assessment with diagnosis and treatment planning. Psychopathology course will precede the appraisal course
What are Examples?(of closing the loop)
![Page 32: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/32.jpg)
32
Program: B.S., Nursing Weakness: Student teaching projects - measurable
objectives were not reliably clear Source: CECRAM Actions:
Add content and a teaching video to NUR 425 – Community Health Practitioner
Added teaching content to NUR 330 Revised curriculum and developed a new course:
NUR 323 - Nurse as Teacher
What are Examples?(of closing the loop)
![Page 33: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/33.jpg)
33
What is outcomes assessment of What is outcomes assessment of student learning?student learning?
Why should I support the assessment Why should I support the assessment process?process?
Conclusion
![Page 34: What Are Outcomes and Why Should I Want to Assess Them?](https://reader035.vdocument.in/reader035/viewer/2022062723/56813fd2550346895daab55f/html5/thumbnails/34.jpg)
34
References Caffo, Betty, (2003). Striving for Excellence. Faculty Senate
Presentation, Wilmington College. Middle States Commission on Higher Education. (2006).
Characteristics of excellence in higher education. Philadelphia: Author.
Suskie, L. (2004). Assessing student learning: A common sense guide. Bolton, MA: Anker.
Walvoord, B.E., and Anderson, V.J. (1998). Effective grading: A tool for learning and assessment. San Francisco, CA: Jossey-Bass.