leadership for meaningful assessment presented at the neasc annual conference boston december 9,...
TRANSCRIPT
![Page 1: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/1.jpg)
Leadership for Meaningful Assessment
Presented at the
NEASC Annual ConferenceBoston
December 9, 2015
By
Trudy W. BantaProfessor of Higher Education
andSenior Advisor to the Chancellor forAcademic Planning and Evaluation
Indiana University-Purdue University Indianapolis301 University Boulevard, Suite 4049
Indianapolis, Indiana 46202tbanta@ iupui.edu
http://www.planning.iupui.edu
![Page 2: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/2.jpg)
Outcomes AssessmentProcess of providing credible evidence of
• resources
• implementation processes
• outcomes
To IMPROVE effectiveness of
• instruction
• programs
• services in higher education
© TWBANTA-IUPUI
![Page 3: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/3.jpg)
Organizational Levels for Assessment
© TWBANTA-IUPUI
National
Regional
State
Campus
College
Discipline
Classroom
Student
![Page 4: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/4.jpg)
Interviews with Leaders
#1. Articulate vision to improve learning in strategic plans
Use data to document improvement and to recognize people in
• Annual reports
• Budget hearings
• Program reviews
© TWBANTA-IUPUI
![Page 5: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/5.jpg)
Interviews with Leaders
Encourage collaboration to use data in decision-making
• Administrators (academic and non-academic
• Faculty
• Student Affairs professionals
© TWBANTA-IUPUI
![Page 6: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/6.jpg)
Interviews with Leaders
Offer support and incentives
• Professional development
• Central data resources
• Rewards for faculty and staff
© TWBANTA-IUPUI
![Page 7: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/7.jpg)
Interviews with Leaders
Communicate
• Listen and learn
• Disseminate methods, findings
• Publicize responsive improvements
© TWBANTA-IUPUI
![Page 8: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/8.jpg)
Stan Ikenberry2015
1. Use evidence of learning to improve graduation rates
2. Inventory assessment activity and strengthen what works
3. Move from compliance to use of evidence to improve
© TWBANTA-IUPUI
![Page 9: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/9.jpg)
Wabash Center of Inquiry2011
1. Audit information sources
2. Set aside resources for response to findings
3. Communicate findings, discuss broadly
4. Identify 1 or 2 outcomes for improvement
5. Engage students in interpreting findings and suggesting responses
© TWBANTA-IUPUI
![Page 10: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/10.jpg)
What is your most pressing question about leadership for
outcomes assessment?
© TWBANTA-IUPUI
![Page 11: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/11.jpg)
Principles of Effective Practice~ Phases of Assessment ~
* Planning
* Implementing
* Improving & Sustaining
© TWBANTA-IUPUI
![Page 12: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/12.jpg)
Planning Effective Assessment
• Engage stakeholders
• Establish purpose
• Develop a written plan
• Time assessment appropriately
© TWBANTA-IUPUI
![Page 13: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/13.jpg)
Encouraging Faculty Interest
What works in . . .
● changing the curriculum?
● teaching core skills?
● capturing student interest - -
and retention?
● using technology in instruction?
© TWBANTA-IUPUI
![Page 14: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/14.jpg)
© TWBANTA-IUPUI
Some Evaluative Questions
If we undertake a new approach:
• Is instruction more effective?
• Are students learning more?
• Are students more satisfied?
•Are faculty more satisfied?
•Do outcomes justify costs?
![Page 15: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/15.jpg)
Connect Assessment to Processes Faculty Value
• Strategic planning
• Program review
• Curriculum revision
• Scholarship of Teaching & Learning
• Faculty development
• Promotion & tenure
© TWBANTA-IUPUI
![Page 16: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/16.jpg)
Engage Students
● Stress importance in
▪ recruiting
▪orientation
● Ask students to collect data
▪ questionnaires
▪ focus groups
● Ask students to interpret data
● Disseminate USE of findings widely
© TWBANTA-IUPUI
![Page 17: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/17.jpg)
Engage Student Affairs Staff
• To enhance student learning
• To improve programs/services
• To capture expertise
© TWBANTA-IUPUI
![Page 18: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/18.jpg)
Engage Employers
• In developing learning outcomes
• In collecting data from students, graduates
• In supervising internships
• In evaluating papers, projects, presentations
© TWBANTA-IUPUI
![Page 19: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/19.jpg)
Implementing Effective Assessment
• Provide leadership
• Select/design data collection
• Provide resources
• Educate faculty & staff
• Assess resources and processes too
• Share findings
© TWBANTA-IUPUI
![Page 20: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/20.jpg)
Leadership for Assessment
*President, Provost, Trustees
*Campus Coordinator
*Unit Experts
© TWBANTA-IUPUI
![Page 21: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/21.jpg)
© TWBANTA-IUPUI
Select or DesignAssessment Methods
1. Match with goals
2. Use multiple methods
3. Combine direct and indirect measures
4. Combine qualitative and quantitative measures
5. Consider pre - post design to assess gains
6. Use built-in points of contact with students
![Page 22: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/22.jpg)
An Impossible Dream:
Using standardized test scores
to compare institutions
▪ 1990
▪ 2007
© TWBANTA-IUPUI
![Page 23: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/23.jpg)
2007
Voluntary System of Accountability
~ Assessment of Learning ~
defined as
critical thinking, written communication, analytic reasoning
© TWBANTA-IUPUI
![Page 24: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/24.jpg)
VSA Recommendations(over my objections)
Collegiate Assessment of Academic Proficiency (CAAP)
Measuring Academic Proficiency & Progress (MAPP) (now Proficiency Profile)
Collegiate Learning Assessment (CLA)
(College BASE)
© TWBANTA-IUPUI
![Page 25: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/25.jpg)
In TN We Learned
1) No test measured 30% of gen ed skills
2) Tests of generic skills measure primarily prior learning
3) Reliability of value added = .1
4) Test scores give few clues to guide improvement actions
5) Hard to motivate students to take these tests
© TWBANTA-IUPUI
![Page 26: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/26.jpg)
An Inconvenient Truth
.9 = correlation between CLA and SAT/ACT
means at the institutional level
thus
81% of the variance in institutions’ scores is due to students’ prior learning
© TWBANTA-IUPUI
![Page 27: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/27.jpg)
© TWBANTA-IUPUI
Sources of Variance in K-12 Student Achievement
• 20% in-school factors
(10% teachers)
• 60% out-of-school factors
• 20% unknown factors
D. Goldhaber (2002)
![Page 28: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/28.jpg)
© TWBANTA-IUPUI
American Educational Research Association
Do not usevalue-added models
based onstudents’ standardized test scores
to judgeteachers, schools, or teacher
preparation programs.
November 2015
![Page 29: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/29.jpg)
Employing currently available
standardized tests of generic skills
to compare the quality of institutions
is not a valid use of those tests.
© TWBANTA-IUPUI
![Page 30: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/30.jpg)
© TWBANTA-IUPUI
Start with Measures You Have
• Assignments in courses
• Course exams
• Work performance
• Records of progress through the curriculum
![Page 31: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/31.jpg)
To assess ethical behavior
Defining Issues Test
(James Rest 1979, 86, 93)
Measure of Moral Reasoning
(Choose course when facing moral dilemma)
See Mental Measurements Yearbook
© TWBANTA-IUPUI
![Page 32: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/32.jpg)
The Mental Measurements Yearbook
-- Buros Institute -- University of Nebraska –
Lincoln
http://buros.org/mental-measurements-yearbook
![Page 33: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/33.jpg)
© TWBANTA-IUPUI
Student Electronic Portfolio
• Students take responsibility for demonstrating core skills
• Unique individual skills and achievements can be emphasized
• Multi-media opportunities extend possibilities
• Metacognitive thinking is enhanced through reflection on contents
- Sharon J. Hamilton
IUPUI
![Page 34: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/34.jpg)
VALUE Rubricshttp://www.aacu.org/value/rubrics/index.cfm
• Critical thinking
• Written communication
• Oral communication
• Information literacy
• Teamwork
• Intercultural knowledge
• Ethical reasoning
![Page 35: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/35.jpg)
Assess
*Resources – faculty, students, facilities
*Processes – curriculum, teaching
*Outcomes – learning,
program effectiveness
© TWBANTA-IUPUI
![Page 36: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/36.jpg)
Sharing Findings
*Dashboard
*Highlights
*Full report
▪ Written, posted to website
▪ Delivered in person
© TWBANTA-IUPUI
![Page 37: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/37.jpg)
Improving & Sustaining Assessment
• Obtain credible evidence
• Ensure findings are used
• Reexamine the assessment process
© TWBANTA-IUPUI
![Page 38: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/38.jpg)
~ Credible Evidence ~
1. Are we measuring something important?
2. Are findings consistent over time?
3. Are artifact raters able to agree?
4. Do findings provide direction for action?
© TWBANTA-IUPUI
![Page 39: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/39.jpg)
Build Follow-Up Into Your Plans
1. Identify sources of support for responsive improvements
Are there committed administrators?
2. Speculate about findings and potential responses
3. Plan for collaborators to meet
© TWBANTA-IUPUI
![Page 40: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/40.jpg)
Plan for Follow-Up4. Develop communications plan to
encourage broad dialogue about findings
5. Engage students in analysis and responding to findings
6. Use conversations to identify 1 or 2 outcomes for improvement
-Wabash National Study
Blaich & Wise
© TWBANTA-IUPUI
![Page 41: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/41.jpg)
Leadership for Meaningful Assessment:
Dartmouth’s Story
Alicia Betsinger, PhDNew England Association of Schools and Colleges (NEASC)
Annual Conference December 9-11, 2015
![Page 42: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/42.jpg)
Arts & Sciences
• Teagle Foundation Grant (2010-2012): Faculty Development at the Next Level: Departments and Academic Programs
– Embedding faculty development and learning-centered practices into departmental structures. At both Dartmouth and Brown, teaching and learning centers will work with a small group of departments to develop and implement department-wide student learning outcomes. Each institution will draw on the expertise and influence of their teaching and learning centers. The institutions' project leaders and faculty participants will work together to discuss assessment data, share information, and report on projects.
• Neuroscience• Astronomy• Linguistics
![Page 43: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/43.jpg)
New Leadership
• President (July 2013)
• Executive Vice President (September 2013)
• Associate Provost of Institutional Research (April 2014)
• Provost (July 2014)
• Dartmouth Center for the Advancement of Learning (DCAL) Director (January 2015)
• Postdoctoral Fellow, Assessment and Evaluation (August 2015)
![Page 44: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/44.jpg)
NEASC Interim Report
•College-Wide Inquiry: Gateway Initiative• School Level Inquiry
• General Education: First-year writing & Advising 360: Coordinated advising system serving students through first six terms
• Graduate and Professional Schools
• Departmental Level Inquiry: • Teagle Grant Departments• Classics
• Student-and-Course Level Inquiry• Biology/Chemistry• Mathematics
• Learning Assessment within Faculty of Arts & Sciences
![Page 45: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/45.jpg)
Arts & Sciences: Next Steps
• Phase One:• Faculty Assessment Committee:
• Representation from all undergraduate divisions: Arts & Humanities, Interdisciplinary Programs, Sciences, and Social Sciences.
• Two-year membership
• Define what we are trying to learn about learning at Dartmouth
• Identify existing faculty efforts, identifying their essential aspects and features
• Identify existing resources for inquiry into student learning
![Page 46: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/46.jpg)
Arts & Sciences: Next Steps (cont.)
• Phase Two: Articulate five-year strategy for broadly engaging Arts & Sciences in sustained inquiry into student learning in three key areas:
• The major: courses, curriculum, departments/programs• General Education: distributives, writing requirement, and
language requirement at the course, curriculum, and institution levels; and
• Graduate programs: courses, curriculum, programs
![Page 47: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/47.jpg)
Final ThoughtsLeadership comes in many forms
Impacts of leadership transitions vary
Willingness to engage in the tough
discussions are impeded or facilitated
by those in leadership positions
![Page 48: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/48.jpg)
Activity
Scenario 1: You are a new President/Provost and your accreditation report is due in a year. What specific actions do you take to support the work?
Scenario 2: You are the new Accreditation Liaison Officer (ALO) and your accreditation report is due in a year. What specific actions do you take to gain the support needed to submit a successful report?
![Page 49: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/49.jpg)
Leadership for Meaningful
Assessment:The BHCC
Perspective
Dr. Maria PuenteDean Lori A. CatallozziBunker Hill Community
College
New England Association of Schools and Colleges (NEASC)
Annual Meeting December 9, 2015
![Page 50: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/50.jpg)
Assessment can only be meaningful to us if it is:
Mission-centric Outcomes-based Broad and inclusive Reflective, active and continuous
Making Assessment Institutionally Meaningful: The BHCC Experience
![Page 51: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/51.jpg)
Our College has had meaningful assessment experiences because the leadership:• values a mission-driven approach• emphasizes and supports a culture of
evidence• creates opportunities and structures for
sustaining broad-based, inclusive participation
• engages the campus community in cycles of collaborative reflection, planning & action
Leading an Institutionally Meaningful Assessment Process: The BHCC Experience
![Page 52: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/52.jpg)
Our Mission Statement:Bunker Hill Community College serves as an educational and economic asset for the Commonwealth of Massachusetts by offering associate degrees and certificate programs that prepare students for further education and fulfilling careers. Our students reflect our diverse local and global community, and the College integrates the strengths of many cultures, age groups, lifestyles and learning styles into the life of the institution. The College provides inclusive and affordable access to higher education, supports the success of all students, and forges vibrant partnerships and pathways with educational institutions, community organizations, and local businesses and industries.
The BHCC Experience: Assessment as Mission-Centric
![Page 53: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/53.jpg)
The phrase “…supports the success of all students…” speaks to one of our institutional values, Inclusiveness and Equity.
But how do we know if these values are really being practiced? How can we assess equity in a meaningful way?• Success of Pell Students vs. Non-Pell Students• Success of Students of Color vs. Success of White
Students• Why these measures? Narrowing of achievement
gaps is an indicator of progress towards greater inclusiveness & equity
The BHCC Experience: An Example of Assessment as Mission-Centric
![Page 54: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/54.jpg)
Outcomes can be both quantitative and qualitativeStudent Learning Outcomes Assessment Program
(SLOAP) – an example of outcomes-based assessment• Faculty-driven initiative intended to promote a
College-wide culture of assessment; Focus on projects that help close the feedback loop
SLOAP’s Writing Across the Curriculum initiative: Long-running, college-wide initiative that allows faculty to assess students’ writing and critical thinking abilities across disciplines• Fall 2010 & Fall 2011 projects to improve critical
thinking of students
The BHCC Experience: Assessment as Outcomes-Based
![Page 55: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/55.jpg)
The goal: Inquiry-based, evidence-informed decision-making across all programs and initiatives at all levels of the institution
Learning Communities Developmental Education Reforms Civic and Community Engagement Learn & Earn Life Map Annual Unit Planning & Program Review
The BHCC Experience: Assessment as Broad & Inclusive
![Page 56: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/56.jpg)
How assessment of major initiatives & programs informs our strategic planning• Expansion of SLOAP projects and framework • Scale-up of developmental education acceleration• Engagement of faculty in professional development
that fosters proven pedagogical practices • Expansion of high impact practices for students in
the 30-60 credit range• Integration of culturally inclusive curricula and
practice
The BHCC Experience: Assessment as Reflective, Active &
Continuous
![Page 57: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/57.jpg)
• Learning Community impact on six key indicators of student success
• College-wide increases in fall-to-fall retention, overall course completion, developmental education and gateway course completion
• Narrowing and closure of racial/ethnic disparities in achievement
• Successful course completion and retention of Pell grant students
The BHCC Experience: Gains & Achievements
![Page 58: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/58.jpg)
• Implement outcomes-based General Education Program
• Integrate LifeMap across the curriculum• Integrate high impact practices at 3o credit mark• Increase percentage of students who graduate
within four years• Increase percentage of students who earn a degree
before transfer• Continue to focus on closing achievement gaps
The BHCC Experience: Goals for 2015-2020
![Page 59: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/59.jpg)
Each table will focus on one of four data handouts and should be prepared to briefly report out.
Questions for table discussion: 1. What does the data tell you? Are there overall
trends? Disparities? 2. What conclusions can you draw from the
data?3. What additional research questions does the
data raise?
Activity: Data Jigsaw
![Page 60: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/60.jpg)
2004 2005 2006 2007 2008 2009 2010 20110%
10%
20%
30%
40%
50%
60%
Persistence: Year-to-Year
My College
Same Entry Year
ATD Network
Student Cohort
Figure 1. Year-to-Year Persistence of Students in the ATD Network for the 2004-2011 Cohorts (BHCC denoted as “My College”).
Source: 2014 Achieving the Dream Benchmarking for Success Report
![Page 61: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/61.jpg)
Figure 2. Fall-to-fall Retention at BHCC by Race and Pell Status, 2007-2013. Source: BHCC Office of Institutional Effectiveness
![Page 62: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/62.jpg)
Figure 3. Successful Course Completion of BHCC Students by Race/Ethnicity, Fall 2007 – Fall 2013 Source: BHCC Office of Institutional Effectiveness
![Page 63: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/63.jpg)
88%
69%82%
59%16.7
28.7
13.9
21.8
15.3
26.7
12.9
19.4
87%
67%82%
57%
Learning Community Seminars (n = 2652)Comparison (n = 887)
Learning Community Clusters (n = 1407)Comparison (n = 662)
Figure 4. Learning Community Retention & Credits Earned Using Matched-Pair Analysis 2008-2012Source: DVP-PRAXIS LTD and OMG Center for Collaborative Learning, 2013
Term-to-Term Year-to-Year
Within First Year At End of Second Year
Within First Year At End of Second Year
Term-to-Term Year-to-Year
RetentionCredits Earned
![Page 64: Leadership for Meaningful Assessment Presented at the NEASC Annual Conference Boston December 9, 2015 By Trudy W. Banta Professor of Higher Education and](https://reader036.vdocument.in/reader036/viewer/2022062409/5697bfbd1a28abf838ca1fa2/html5/thumbnails/64.jpg)
How has leadership for assessment influenced the outcomes assessment process at your institution?
Given what you have heard today, do you have any new questions about outcomes assessment?