assessment in student support areas...january 27, 2016. niloa transparency framework. linking...
TRANSCRIPT
![Page 1: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/1.jpg)
Assessment in Student
Support Areas
Lauren Thomas,
Susana Luzuriaga,
Office of Institutional Research
January 27, 2016
![Page 2: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/2.jpg)
NILOA Transparency Framework
![Page 3: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/3.jpg)
Linking Assessment to Mission
“Whatever the mission or emphasis of the institution, its
student affairs program needs to be developed to support
and complement it” (Hirt, 2009; NASPA, 1989).
It is imperative that student affairs professionals develop programs,
services, and experiences that contribute to student learning
experiences that are valued at their institution and, moreover, that
are empirically verified as adding value to the student experience at
their institution. Some activities of student affairs professionals and
some things that are measured in student affairs assessments are
not aligned with the institution’s mission or goals. As a check
against these tendencies, any student affairs assessment should
start from the following question: How does this program or
experience contribute to the institution’s mission or goals, and what
evidence can be gathered to demonstrate this?
![Page 4: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/4.jpg)
Mission StatementThe University of Cincinnati serves the people of Ohio, the nation, and the world as a
premier, public, urban research university dedicated to undergraduate, graduate, and
professional education, experience-based learning, and research.
We are committed to excellence and diversity in our students, faculty, staff, and all of
our activities. We provide an inclusive environment where innovation and freedom of
intellectual inquiry flourish.
Through scholarship, service, partnership, and leadership, we create opportunity,
develop educated and engaged citizens, enhance the economy and enrich our
University, city, state and global community.
University of Cincinnati
![Page 5: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/5.jpg)
University of Cincinnati
![Page 6: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/6.jpg)
Why Don’t We Assess?
• Survey Fatigue
• Busy-ness
• Need for Training
• Unclear Goals
• Lack of Feedback
• Communicating Results
![Page 7: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/7.jpg)
What is the Research
Question?BAD -> How many students
participated in X event?
GOOD -> What did students learn
by participating in X event?
Number of recreational opportunities
on campus
Who uses recreational facilities, and
what are students gaining from
participating?
Students survey to assess if they were
satisfied with their tutoring
Assessing student performance after
tutoring
Key takeaway – Must have empirical evidence to
be confident that programs, activities, and
experiences actually do contribute to student
learning
![Page 8: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/8.jpg)
University Surveys Planning Calendar
https://share.uc.edu/uc/InstRes/Lists/UPC/AllItems.aspx
*Requires central login and password*
![Page 9: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/9.jpg)
What Data is Available?
• National Survey of Student Engagement (odd years)
• Student Satisfaction Inventory (even years)
• EBI/Skyfactor Resident Assessment (2013, 2016)
• Multi-Institutional Study of Leadership (2015)
![Page 10: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/10.jpg)
What is the NSSE?
• Undergraduate survey measuring quality of academic
experience
• Student participation
• Institutional resources and organization
• Conducted on 1,600+ campuses since 2000
• Allows longitudinal, benchmark, and freshman-to-senior
comparisons
![Page 11: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/11.jpg)
Why NSSE?
Grades, persistence, student satisfaction,
gains across a range of desired outcomes,
and engagement go hand in hand
![Page 12: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/12.jpg)
Findings from George Kuh’s Analysis
![Page 13: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/13.jpg)
Findings from George Kuh’s Analysis
![Page 14: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/14.jpg)
Findings from George Kuh’s Analysis
![Page 15: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/15.jpg)
![Page 16: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/16.jpg)
High-Impact Activities
First-Year Seminars and Experiences Common Intellectual Experiences Learning Communities Writing-Intensive Courses Collaborative Assignments and Projects “Science as Science Is Done”; Undergraduate Research Diversity/Global Learning Service Learning, Community-Based Learning Internships Capstone Courses and Projects
![Page 17: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/17.jpg)
Engagement Indicators
Higher Order Learning
Reflective & Integrative Learning
Learning Strategies
Quantitative Reasoning
Collaborative Learning
Discussions with Diverse Others
Student-Faculty Interaction
Effective Teaching Practices
Quality of Interactions
Supportive Environment
![Page 18: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/18.jpg)
• Boston University
• Bowling Green State University
• Georgia Institute of Technology
• Indiana University – Bloomington
• Indiana University – Purdue
University Indianapolis
• North Carolina State University
• Ohio University
• Syracuse University
• University of Akron
• University of Alabama at
Birmingham
• University of Houston
• University of Illinois at Chicago
• University of Memphis
• University of South Florida
• University of Texas at Arlington
• University of Texas at San Antonio
• University of Toledo
• Wayne State University
Comparison Group
![Page 19: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/19.jpg)
National Survey of Student Engagement
2015
![Page 20: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/20.jpg)
National Survey of Student Engagement
2015
![Page 21: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/21.jpg)
National Survey of Student Engagement
![Page 22: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/22.jpg)
What is the SSI?
• Undergraduate survey measuring importance of and
satisfaction with university experience
• Conducted on 2,700 campuses with more than 5.5
million responses
• Allows longitudinal and benchmark comparisons;
provides ethnicity and gender comparisons
![Page 23: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/23.jpg)
Student Satisfaction Inventory Scales
Student Centeredness
Campus Life
Concern for the Individual
Service Excellence
Responsiveness to Diverse Populations
Campus Climate
Instructional Effectiveness
Recruitment and Financial Aid
Campus Support Services
Academic Advising
Registration Effectiveness
Safety and Security
![Page 24: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/24.jpg)
SSI: Campus Life
![Page 25: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/25.jpg)
SSI: Campus Life, 2014
![Page 26: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/26.jpg)
SSI: Responsiveness to Diverse
Populations
![Page 27: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/27.jpg)
EBI/Skyfactor Resident Assessment
• Provides insight into student learning and satisfaction
along 19 factors
• Identifies factors as “issue,” “needs work,” or “good”
based on 7 point scale
![Page 28: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/28.jpg)
EBI/Skyfactor Resident Assessment
Diverse Interactions
Self-Knowledge and Skills
Personal Competence
Empathy
Residents are Tolerant
![Page 29: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/29.jpg)
EBI/Skyfactor Resident Assessment
2013
• Low ratings for Personal Growth and Time Management
indicate potential for targeted programming
• Students report that fellow residents are tolerant of other
genders, races, sexual orientations, religious beliefs, and
political views
• Respect for space, privacy, property, and time is an
issue
![Page 30: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/30.jpg)
Multi-Institutional Study of Leadership
• Based on the “input-environment-outcome” college
impact model and the Social Change Model of
Leadership Development
• Conducted at 250+ institutions since 2006
![Page 31: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/31.jpg)
Multi-Institutional Study of Leadership
Self-Awareness
Creating Value for the Community
Creating a Shared Vision
Consciousness of Others
Ethical Leadership
![Page 32: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/32.jpg)
Multi-Institutional Study of Leadership
2015
![Page 33: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/33.jpg)
Multi-Institutional Study of Leadership
2015
![Page 34: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/34.jpg)
Resources for Assessment in Student
Support Areas• The Role of Student Affairs in Student Learning Assessment
(Schuh & Gansemer-Topf)
• What Matters to Student Success: The Promise of High-
Impact Practices (PPT) by George Kuh
• NASPA’s Assessment, Evaluation & Research Knowledge
Communities
• National Institute for Learning Outcomes Assessment
(NILOA)
![Page 35: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/35.jpg)
Resources for Assessment in Student
Support Areas
• ACPA’s Commission for Assessment and Evaluation
• Council for the Advancement of Standards in Higher
Education (CAS)
• Southwestern Ohio Council for Higher Education
(SOCHE) – Conference on April 15, 2016
• Graduate Certificate in Assessment and Evaluation at
UC
![Page 36: Assessment in Student Support Areas...January 27, 2016. NILOA Transparency Framework. Linking Assessment to Mission “Whatever the mission or emphasis of the institution, its student](https://reader033.vdocument.in/reader033/viewer/2022050116/5f4cb7c609b5fa18f7094a2c/html5/thumbnails/36.jpg)
Questions?
Lauren Thomas
Senior Research Associate, Office of
Institutional Research
Susana Luzuriaga
Director, Office of Institutional Research