developing the self-study document using integrated assessment briefs
DESCRIPTION
Developing the Self-Study Document Using Integrated Assessment Briefs Millersville University of Pennsylvania. Presented by: Dr. Thomas Burns, Associate Provost Dr. Lisa Shibley, Assistant Vice President Dr. Helena Tuleya-Payne, Chair and Professor, Psychology. Background - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Developing the Self-Study Document Using Integrated Assessment Briefs](https://reader035.vdocument.in/reader035/viewer/2022070419/56815c3f550346895dca3ed5/html5/thumbnails/1.jpg)
Developing the Self-Study Document Using Integrated Assessment Briefs
Millersville University of Pennsylvania
Presented by: Dr. Thomas Burns, Associate ProvostDr. Lisa Shibley, Assistant Vice PresidentDr. Helena Tuleya-Payne, Chair and Professor, Psychology
![Page 2: Developing the Self-Study Document Using Integrated Assessment Briefs](https://reader035.vdocument.in/reader035/viewer/2022070419/56815c3f550346895dca3ed5/html5/thumbnails/2.jpg)
• Background
• Process and Timeline
• The Assessment Brief Template
• Sample Briefs
• What we wish we had known….
• Integration into the University’s assessment and planning processes
• Questions?
Session Overview
![Page 3: Developing the Self-Study Document Using Integrated Assessment Briefs](https://reader035.vdocument.in/reader035/viewer/2022070419/56815c3f550346895dca3ed5/html5/thumbnails/3.jpg)
About Millersville Pennsylvania State System of Higher Education
• Located in Southeastern Pennsylvania
• A comprehensive, public masters level
• More than 55 baccalaureate degree programs and over 25 master’s degree programs
• Faculty Collective Bargaining Agreement
• Over 8700 students enrolled (headcount)
• About 87% undergraduates
• 51 credits required for general education
![Page 4: Developing the Self-Study Document Using Integrated Assessment Briefs](https://reader035.vdocument.in/reader035/viewer/2022070419/56815c3f550346895dca3ed5/html5/thumbnails/4.jpg)
• Site Visit—Spring 2010• Began planning in summer 2007• A data rich environment• Perceived, growing culture of assessment• Unique planning process
Background
![Page 5: Developing the Self-Study Document Using Integrated Assessment Briefs](https://reader035.vdocument.in/reader035/viewer/2022070419/56815c3f550346895dca3ed5/html5/thumbnails/5.jpg)
Structure
Provost & Cabinet Coordinating Team
Steering Committee
10 Working Groups on Standards
Group1 Communication & Morale Working
![Page 6: Developing the Self-Study Document Using Integrated Assessment Briefs](https://reader035.vdocument.in/reader035/viewer/2022070419/56815c3f550346895dca3ed5/html5/thumbnails/6.jpg)
Self-Study Phases
Spring 2008• Establish
Working Groups
• Develop Research Questions
Fall 2008• Develop
Research Protocols
• Assess, Review Data
March 2009• Submit
Assessment Briefs
May 2009• Submit
Reports on Standards
June to August 2009• Write 1st
self-study draft
![Page 7: Developing the Self-Study Document Using Integrated Assessment Briefs](https://reader035.vdocument.in/reader035/viewer/2022070419/56815c3f550346895dca3ed5/html5/thumbnails/7.jpg)
•Provided justification that linked research question to: • Tell Millersville’s Story (Self- Study Outcomes)• Fundamental Elements• University Mission Statement
•Established data needs• Existing Information• New Information
•Identified Timeline
Research Questions
Spring 2008• Establish Working Groups• Develop Research Questions
![Page 8: Developing the Self-Study Document Using Integrated Assessment Briefs](https://reader035.vdocument.in/reader035/viewer/2022070419/56815c3f550346895dca3ed5/html5/thumbnails/8.jpg)
• Designed Protocols• Encouraged to use existing evidence• Coached in new information sources
• Interviews, focus groups, surveys• Clarifying findings from existing information
Conducting the Research
Fall 2008• Develop Research
Protocols• Assess, Review
Data
March 2009• Submit
Assessment Briefs
![Page 9: Developing the Self-Study Document Using Integrated Assessment Briefs](https://reader035.vdocument.in/reader035/viewer/2022070419/56815c3f550346895dca3ed5/html5/thumbnails/9.jpg)
• Connect back to justification: • Tell Millersville’s Story (Self- Study Outcomes)**• MSCHE Standards and Fundamental Elements• University Mission Statement**
• Clarify data used• Source• Sample
• Provide results
• Develop conclusions**
Developing Assessment Briefs
Fall 2008• Develop Research
Protocols• Assess, Review
Data
March 2009• Submit
Assessment Briefs
![Page 10: Developing the Self-Study Document Using Integrated Assessment Briefs](https://reader035.vdocument.in/reader035/viewer/2022070419/56815c3f550346895dca3ed5/html5/thumbnails/10.jpg)
Working Group Reports
May 2009• Submit Reports on
Standards
• Matrix to organize information from Briefs• Connected information data to conclusions
to fundamental elements by Standard• Used more than one research question to
fundamental element• Report on Standard
• Used narrative from assessment brief to identify major findings for Standard
![Page 11: Developing the Self-Study Document Using Integrated Assessment Briefs](https://reader035.vdocument.in/reader035/viewer/2022070419/56815c3f550346895dca3ed5/html5/thumbnails/11.jpg)
Writing the Self Study
June to August 2009• Write 1st self-study
draft
• Coordinating Team used Matrices and Reports to identify information for the chapters.
• Assessment Briefs• Integral to developing self-study chapters• Provided data for Tables, Figures• Served as Appendices
![Page 12: Developing the Self-Study Document Using Integrated Assessment Briefs](https://reader035.vdocument.in/reader035/viewer/2022070419/56815c3f550346895dca3ed5/html5/thumbnails/12.jpg)
Writing the Self Study
June to August 2009• Write 1st self-study
draft
• Copy editor to identify style guide
• Sought to write document in one voice narrative
• Used “writing circle” concept
![Page 13: Developing the Self-Study Document Using Integrated Assessment Briefs](https://reader035.vdocument.in/reader035/viewer/2022070419/56815c3f550346895dca3ed5/html5/thumbnails/13.jpg)
• Coordinating Team Brief
• Sample Discussed with Steering Committee
• Steering Committee members reviewed Assessment Briefs and provided comments
• Exemplar Briefs
Sample Briefs
![Page 14: Developing the Self-Study Document Using Integrated Assessment Briefs](https://reader035.vdocument.in/reader035/viewer/2022070419/56815c3f550346895dca3ed5/html5/thumbnails/14.jpg)
• Link to Strategic Directions early on
• Strengthen implications sections within Assessment Briefs
What we wish we had known…..
![Page 15: Developing the Self-Study Document Using Integrated Assessment Briefs](https://reader035.vdocument.in/reader035/viewer/2022070419/56815c3f550346895dca3ed5/html5/thumbnails/15.jpg)
• Faculty Senate Academic Outcomes Assessment Committee (AOAC)– Assessment Briefs on General Education Competencies
• Special Analyses (triangulation of data)– Wabash National Study of Liberal Arts Education– NSSE / FSSE / BCSSE / HERI Faculty Data
• University Planning Council – Report on Progress towards achieving Strategic Directions
Use in Assessment & Planning
![Page 16: Developing the Self-Study Document Using Integrated Assessment Briefs](https://reader035.vdocument.in/reader035/viewer/2022070419/56815c3f550346895dca3ed5/html5/thumbnails/16.jpg)
Questions?
Contact Dr. Lisa R ShibleyAssistant Vice President, Institutional Assessment and PlanningMillersville University of [email protected]