Download - Economic Development Lunch presentation
![Page 1: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/1.jpg)
Academic Auditor Training 2020-21
Office of Academic Affairs
1
![Page 2: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/2.jpg)
Purpose and Timeline
Session 1 of 3
2
![Page 3: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/3.jpg)
What is the Academic Audit?
FACULTY-driven peer feedback
Improve teaching and learning processes
STUDENT SUCCESS
WORKFORCE DEVELOPMENT
3
![Page 4: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/4.jpg)
The Academic Audit is used for…
Institutional Effectiveness/SACSCOC
Quality Assurance Funding (QAF)
Continuous Quality Improvement4
![Page 5: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/5.jpg)
Quality Assurance Funding: 2020-25 Cycle Standards
O “Institutions may earn an additional 5.45 percent over operating budgets based on performance on metrics particular to their sector and aligned to the Tennessee Higher Education Master Plan.”
5
![Page 6: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/6.jpg)
QAF: 2020-25 Cycle Standards
O January 2020, THEC approves 2020-25 Tennessee Higher Education Master Plan
O High quality credentials for sustainable careers.
O Emphasizes examining learning outcomes
O
6
![Page 7: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/7.jpg)
QAF: 2020-25 Cycle Standards
O “Learning outcomes must ensure that all students have the tools necessary for success including low-income students and students of color who remain underrepresented in public higher education in Tennessee.”
7
![Page 8: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/8.jpg)
QAF: 2020-25 Cycle Standards
8
![Page 9: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/9.jpg)
QAF: 2020-25 Cycle StandardsMajor ThemesO Increase Points Associated with
Accreditation
O Focus on Student Equity
O Further Emphasis on Quality
O Workforce Alignment9
![Page 10: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/10.jpg)
Academic Audit Timeline
1. Self Study process – 3 August 2020 – 29 January 2021
2. Written Self Study Report – 29 January 2021
3. Audit Team Virtual Site Visit – 15 March – 16 April 2021
4. Auditor Team Written Report - 7 May 2021
10
![Page 11: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/11.jpg)
The Academic Auditor Team
O Three to two trained members O Experienced team leaderO In-Discipline member O Functions as a Peer Review Team to provide
O Recognition of highly effective practicesO Support of noteworthy endeavorsO Suggestions for improvement
11
![Page 12: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/12.jpg)
Conflicts of interest [Guide p 5]
O Prior interactions between institution
and auditor are anticipated
O Avoid excessive bias either
O Favorably or
O Unfavorably
12
![Page 13: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/13.jpg)
TimelineO Today - trainingO February – March
1. Confer with Team2. Review Self-study3. Prepare for the Site Visit
O March- April: Site Visit _________O By May 7th: Write and submit report
13
![Page 14: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/14.jpg)
1. Confer with team membersO Discuss plans for the virtual site visit
O MS Teams, team meeting
O Plan virtual site visit schedule
O Decide on assigned Focal Areas
O Develop questions/prompts
O Review NEW QAF Rubric criteria
14
![Page 15: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/15.jpg)
2. Review the Self Study
O Read/review entire report, appendices and web links
O Focus on your assigned focal areas
O Develop questions/prompts for each stakeholder group
O Identify possible “CARs”
O Review NEW QAF Rubric criteria
15
![Page 16: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/16.jpg)
The Self Study ReportTable of Contents
1. Introduction2. Overall Quality Assurance3. Quality Assurance by Focal Area4. Potential Initiatives5. Matrix of Improvement Initiatives6. Follow-up report (if previous visit)
7. Appendix16
![Page 17: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/17.jpg)
3. Prepare for the Virtual Site Visit
O Make virtual arrangements with assistance from TBR Central Office and Campus Coordinator
O Stakeholder group questions/prompts
O Discuss/merge possible “CARs”
O Review NEW QAF Rubric criteria*
* Only for programs using the Academic Audit for Quality Assurance Funding
17
![Page 18: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/18.jpg)
Academic Auditor Team VIRTUAL Visit Schedule
Session Attendees Time
Opening Session All 8:30 am
Meeting #1 Faculty 9:00 – 10:00 am
Meeting #2 Students 10:15 – 11: 15 am
Meeting #3 Stakeholders 11:30 – 12:30 pm
Work Time Audit Team only 1:30 – 3:30 pm
Exit Session All 3:30 – 4:00 pm
18
![Page 19: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/19.jpg)
Prelude to the Virtual Site Visit
1. Discuss key issues
2. Review virtual visit schedule, logistics
3. Clarify roles – who asks, who notates...
19
![Page 20: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/20.jpg)
During the Virtual Site VisitConversations
O Provide clear, short, open-ended prompts about processes and experiences (‘how’ more than ‘what’)
O Listen for understanding O Follow-up to “clarify and verify”O Be aware of the timeO Take notes (share this task)
20
![Page 21: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/21.jpg)
Session One Ends
21
![Page 22: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/22.jpg)
Quality PhilosophyContinuous
ImprovementSession 2 of 3
22
![Page 23: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/23.jpg)
Why: Institutional Effectiveness - SACSCOC
O 7.1 Institutional Planning and Effectiveness –
O Effective institutions demonstrate a commitment to principles of continuous improvements, based on a systematic and documented process of assessing institutional performance with respect to mission in all aspects of the institution. An institutional planning and effectiveness process involves all programs, services, and constituencies; is linked to the decision-making process at all levels; and provides a sound basis for budgetary decisions and resource allocations.
The Principles of Accreditation: Foundations for Quality Enhancement Resource Manual 2018
![Page 24: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/24.jpg)
Why: Institutional Effectiveness - SACSCOC
O 7.2 Quality Enhancement Plan–
O The Quality Enhancement Plan (QEP) is an integral component of the reaffirmation of accreditation process and is derived from an institution’s ongoing comprehensive planning and evaluation processes. It reflects and affirms a commitment to enhance overall institutional quality and effectiveness by focusing on an issue the institution considers important to improving student learning outcomes and/or student success.
The Principles of Accreditation: Foundations for Quality Enhancement Resource Manual 2018
![Page 25: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/25.jpg)
Why: Student Success- SACSCOC
Section 8: Student Achievement
Student learning and student success are at the core of the mission of all institutions of higher learning. Effective institutions focus on the design and improvement of educational experiences to enhance student learning and support student learning outcomes for its educational programs. To meet the goals of educational programs, an institution provides appropriate academic and student services to support student success.
The Principles of Accreditation: Foundations for Quality Enhancement Resource Manual 2018
![Page 26: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/26.jpg)
Why: Student Success- SACSCOC
Section 8: Student Achievement
1. An institution needs to be able to document its success with respect to student achievement. In doing so, it may use a broad range of criteria to include, as appropriate: enrollment data; retention, graduation, or course completion; job placement rates; state licensing examinations; student portfolios; or other means of demonstrating achievement of goals.
The Principles of Accreditation: Foundations for Quality Enhancement Resource Manual 2018
![Page 27: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/27.jpg)
Why: Student Success- SACSCOC
Section 8: Student Achievement
1. Note the three related obligations of the institution in order to meet this standard: student achievement goals (target levels of performance) must be identified; data for student achievement must be presented and evaluated (outcomes); and both the goals and the outcomes must be published. For purposes of this standard, “multiple measures” refers to several distinct outcomes, not multiple ways of measuring the same outcome. Being published means in a way accessible to the public—not published only behind an internal firewall.
The Principles of Accreditation: Foundations for Quality Enhancement Resource Manual 2018
![Page 28: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/28.jpg)
Why: Quality Assurance Funding (QAF)
O Accepted by THEC since 2005 as a means of program
evaluation for non-accreditable degree and certificate
programs for Quality Assurance Funding
O QAF Academic Audit Rubric is completed by the Academic
Auditor Team and results in a score that is computed into the
QAF formula
O This Rubric was revised for the 2021-2025 cycle
![Page 29: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/29.jpg)
Some measures more important than others
![Page 30: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/30.jpg)
Dynamic Measures
![Page 31: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/31.jpg)
A family of measures
![Page 32: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/32.jpg)
A Strategic System of measures
![Page 33: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/33.jpg)
Objective: We’ll know it when we see it?
![Page 34: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/34.jpg)
Objective: Measure everything!
![Page 35: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/35.jpg)
Objective: Win Games– Call the next trained play
![Page 36: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/36.jpg)
Objective: Simple?
![Page 37: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/37.jpg)
Objective: Performance Measures
![Page 38: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/38.jpg)
Defining PerformanceO Profitability/Budgetability
O Effectiveness
O Innovation
O Efficiency
Sink 1985
![Page 39: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/39.jpg)
Defining Performance
O Productivity
O Quality of Work Life
O Quality
Sink 1985
![Page 40: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/40.jpg)
Transcendent QualityO I know it when I see it
Gavin 1987
![Page 41: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/41.jpg)
Product Based Quality
O Feature differences
$x, 9.9 APR50k MPG
$3x, 13.9 APR.000000005 MPGGavin 1987
![Page 42: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/42.jpg)
User-based Quality
O Fitness for use
Gavin 1987
![Page 43: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/43.jpg)
Manufacturing Based Quality
OMeets specifications
Gavin 1987
![Page 44: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/44.jpg)
Value Based QualityOCost/Benefit Analysis
Gavin 1987
![Page 45: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/45.jpg)
Quality = Defined by the Customer
PROCESS
CUSTOMER
SUPPLIER
OUTPUTS INPUTS
TranscendentProduct Based
User Based Manufacturing BasedValue Based
![Page 46: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/46.jpg)
Quality CheckpointsO Who is the Customer?
O What have we done to meet or exceed customer expectations?
O What must we do to meet or exceed customer expectations?
O How do we know these future actions meet or exceed customer expectations?
![Page 47: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/47.jpg)
Underlying Quality Principles or
How do You know Quality when you see it?
1. Define quality in terms of OUTCOMES
2. Focus on PROCESS
3. Work COLLABORATIVELY
4. Base decisions on EVIDENCE
5. Strive for COHERENCE
6. Learn from BEST PRACTICE
7. Make CONTINUOUS IMPROVEMENT a priority
![Page 48: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/48.jpg)
Session Two Ends
48
![Page 49: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/49.jpg)
Evaluation and the ReportSession 3 of 3
49
![Page 50: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/50.jpg)
To Finalize during the Site Visit Work Time
“CARs”O Onsite Evaluation Checklist
O Commendations
O Affirmations
O Recommendations
50
This Photo by Unknow n Author is licensed under CC BY-SA
![Page 51: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/51.jpg)
CommendationsProcesses, practices, initiatives, and
commitments that are particularly praiseworthy
and merit recognition of a superior process and
practice
51
![Page 52: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/52.jpg)
Affirmations
Processes, practices, or plans that warrant the
auditor team’s support and encouragement cited
in Matrix of Improvement Initiatives that the audit
team especially advocates (sometimes all)
52
![Page 53: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/53.jpg)
RecommendationsDescriptive NOT Prescriptive value-
added opportunities for improvement not cited in the Matrix of Improvement
Initiatives
53
![Page 54: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/54.jpg)
To Present at the Exit Session
O Onsite Evaluation Checklist (signed by auditor team) O Commendations O AffirmationsO Recommendations
O QAF Rubric – ONLY IF REQUIRED AND ONLY IF READY 54
![Page 55: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/55.jpg)
Exit Session: Auditor Team Presentation
O 15 - 20 minutes in length
O To program faculty, administrators, and
guests
O Orally & in writing CARs
O Written QAF Rubric – Only if ready
O Not a time for discussion, explanation or
disputation 55
![Page 56: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/56.jpg)
THEC RubricOnly required if your program is undergoing the academic
audit for Quality Assurance Funding purpose
O QAF Academic Audit Rubric O QAF programs only
OUndergraduateOGraduate
56
![Page 57: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/57.jpg)
The Academic Auditor Team Evaluation for QAF Rubric
ONot Applicable
ONot Evident
OEmerging
OEstablished
OHighly Developed 57
![Page 58: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/58.jpg)
The Academic Auditor Team Evaluation for QAF Rubric
O Not EvidentO Program does not address the criterion in the
Self Study documents. O Program responses to questions during the
site visit do not demonstrate that criterion has been addressed or that a plan is in process to address the criterion.
58
![Page 59: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/59.jpg)
The Academic Auditor Team Evaluation for QAF Rubric
O EmergingO Program indicates the criterion as an area that
has only recently been addressed.O Program has a planning process in place to
address this criterion or is in initial stages of plan implementation.
59
![Page 60: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/60.jpg)
The Academic Auditor Team Evaluation for QAF Rubric
O EstablishedO Program demonstrates that its plans, activities
and assessments of the criterion are in place in an appropriate, reasonable and well-organized manner.
O Program faculty are aware of and participate in continuous improvement processes related to the criterion.
60
![Page 61: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/61.jpg)
The Academic Auditor Team Evaluation for QAF Rubric
O Highly DevelopedO Program thoroughly exhibits that its plans, activities
and assessments of the criterion are fully articulated and richly incorporated into the culture of the program. This includes the active engagement of all FACULTY (full and part-time) as well as students and other stakeholders as pertinent to the criterion.
O Program demonstrates the use of results of assessments regarding the criterion for ongoing improvement of performance in that criterion.
61
![Page 62: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/62.jpg)
O QAF Rubric Criteria – Focal Areas
1. Learning Outcomes
2. Curriculum and Co- Curriculum
3. Teaching and Learning
4. Student Learning Assessment
62
![Page 63: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/63.jpg)
QAF RUBRIC CRITERIA Undergraduate
5. Support
6. Academic Audit Process
7. Follow-up of Previous Audit
63
![Page 64: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/64.jpg)
Post-Site VisitWrite and Submit Report
O Complete final written report of the Auditor Team
O Provide contributions as agreed upon with team
O Explain Recommendations
O Discuss areas for growth from QAF Rubric
O Proofread final report
O Submit to TBR by deadline: Friday, 7 May 2021
64
![Page 65: Economic Development Lunch presentation](https://reader033.vdocument.in/reader033/viewer/2022061101/629a9a19bc47b270c01e128f/html5/thumbnails/65.jpg)
for more information…
https://www.tbr.edu/academics/academic-audit
Office of Academic AffairsTennessee Board of Regents
65