academic program review chair’s workshop john e. sawyer, ph.d. associate provost institutional...
TRANSCRIPT
Academic Program Review Chair’s Workshop
John E. Sawyer, Ph.D.Associate Provost
Institutional Research and Effectiveness
Campus Resources
2
Measuring Progress Towards Strategic Goals and Continuous Improvement via Collaboration and the
APR Process
College & Department
Strategic Goals
IR
BI
HECCTAL
OEA
The Center for Teaching &Assessment of Learning (CTAL)
Office of Educational Assessment
Which APR requirements can CTAL can help you with?• Information about student quality, diversity, and achievements.• Description of the undergraduate and graduate student learning
outcomes (including clear statements of expected student learning outcomes in the areas of knowledge, skills, and competencies), assessment plans, and utilization of assessment results.
• Evidence of curricular improvements based on student learning outcomes and changes in the discipline or field of study.
• A statement of the purposes, development and planning for undergraduate and graduate education.
• Description of the undergraduate and graduate curriculum.
CTAL Can Assist…• Curricular Mapping
– Enables a better understanding of how you can build on what your students already know
– Minimizes gaps and repetition in the school wide curriculum– Leads to increased mastery by encouraging subjects to be
revisited from different perspectives
• A course map can help administrators: – Assist with curriculum planning. – Identify courses that directly support program outcomes. – Inform decisions related to resource allocation. – Demonstrate the relevance of a course to the college/school or
institution.
IRE Can Assist…
http://www.udel.edu/IR/apr/index.html
Student Success & Outcomes
http://www.udel.edu/IR/UDEW/index.html
Student Success & Outcomes
http://www.udel.edu/IR/reports/cplans.html
Faculty Scholarly ProductivityAcademic Analytics Productivity Radar
Source: © 2013 Academic Analytics UD Internal Use Only
Academic Benchmarking
https://www.udel.edu/IR/reports/benchmarking/index.html
What is the Delaware Cost Study?• The National Study of Instructional Costs and Productivity (Delaware
Cost Study) is a national benchmarking project and data sharing consortium among four year colleges and universities, with approximately 200 institutions participating annually.
• Since 1996, nearly 600 institutions have participated, and over the past two decades, the Cost Study has matured to become the “tool of choice” for comparative analysis of faculty teaching loads, direct instructional costs, and separately budgeted scholarly activity, all within academic disciplines.
• Currently, the Cost Study is used major data and state agencies including:– Association of American Universities Data Exchange (AAUDE)– Southern Universities Group (SUG)– University of North Carolina (UNC) System– Pennsylvania State System of Higher Education (PaSSHE)– University of Missouri System– University of Nebraska System– Connecticut State University System (CSUS)– City University of New York System (CUNY)
Benchmarking - Institutional Reports
Benchmarking - Academic Program Reviews
Delaware Cost Study Sample Institutional Report
UD College + DisciplineUD College
CodeCIP Discipline
Degrees Awarded
UD Total FTE Faculty
UDUD as Pct of Peer
AvgPeer Avg UD
UD as Pct of Peer
Avg Peer Avg
Peer 25th Percentile
Peer 50th Percentile
Peer 75th Percentile
UD UD as Pct of Peer
Avg Peer Avg
Peer 25th Percentile
Peer 50th Percentile
Peer 75th Percentile
#RVHInst.
A&S Ethnic, Cultural Minority, Gender, and Group Studies 15 A&S 05.02Ethnic, Cultural BM 22.3 12.6 85% 14.9 $ 7,113 98% $ 7,247 $ 5,416 $ 7,771 $ 8,158 $ - 0% $ 2,782 $ 90 $ 786 $ 4,720 14
A&S Communication and Media Studies 15 A&S 09.01Communication BM 43.5 15.7 91% 17.2 $ 4,745 99% $ 4,797 $ 3,891 $ 5,085 $ 5,504 $ 1,996 17% $ 12,036 $ 1,996 $ 5,725 $ 16,413 23
A&S Linguistic, Comparative, and Related Language Studies and Se15 A&S 16.01Linguistic, BMD 72.3 15.1 110% 13.7 $ 4,394 82% $ 5,382 $ 4,272 $ 5,181 $ 7,133 $ 561 7% $ 7,602 $ 226 $ 1,034 $ 6,259 23
A&S Classics and Classical Languages, Literatures, and Linguisti 15 A&S 16.12Classics and BMD 18.9 14.8 86% 17.3 $ 13,318 211% $ 6,314 $ 3,541 $ 5,781 $ 8,574 $ 142,168 6539% $ 2,174 $ 128 $ 1,429 $ 2,043 9
A&S Rhetoric and Composition/Writing Studies 15 A&S 23.01Rhetoric and BMD 105.4 13 98% 13.2 $ 6,526 108% $ 6,017 $ 4,490 $ 5,703 $ 7,527 $ 47 2% $ 2,695 $ 627 $ 1,854 $ 4,068 27
A&S Biology, General 15 A&S 26.01Biology, General BMD 54.0 20.2 109% 18.6 $ 5,686 93% $ 6,107 $ 4,792 $ 5,992 $ 7,551 $ 78,301 49% $ 158,441 $ 89,247 $152,983 $181,447 21
A&S Mathematics 15 A&S 27.01Mathematics BMD 79.2 20.6 102% 20.1 $ 4,473 92% $ 4,872 $ 3,951 $ 4,639 $ 5,784 $ 13,161 33% $ 40,359 $ 16,838 $ 41,027 $ 60,606 28
A&S Philosophy 15 A&S 38.01Philosophy BMD 23.3 12.7 73% 17.4 $ 6,475 122% $ 5,309 $ 3,896 $ 5,244 $ 6,250 $ - 0% $ 1,588 $ - $ 337 $ 2,306 27
A&S Chemistry 15 A&S 40.05Chemistry BMD 59.3 18.5 99% 18.7 $ 6,664 93% $ 7,134 $ 5,948 $ 7,025 $ 8,305 $ 183,946 74% $ 249,016 $182,548 $252,387 $297,140 27
A&S Geological and Earth Sciences/Geosciences 15 A&S 40.06Geological and BMD 19.7 11.8 90% 13.1 $ 10,593 113% $ 9,333 $ 6,647 $ 8,245 $ 11,755 $ 67,170 40% $ 167,126 $ 93,968 $151,718 $243,607 22
A&S Physics 15 A&S 40.08 Physics BMD 46.5 12.7 93% 13.7 $ 8,724 102% $ 8,558 $ 6,991 $ 8,204 $ 10,594 $ 93,094 36% $ 255,703 $143,085 $246,230 $359,760 28 A&S Psychology, General 15 A&S 42.01
Psychology, BMD 49.6 18.6 88% 21.2 $ 5,052 101% $ 5,008 $ 3,947 $ 4,859 $ 5,770 $ 80,018 73% $ 109,702 $ 41,405 $ 76,091 $163,910 28
A&S Anthropology 15 A&S 45.02Anthropology BM 14.9 15.6 97% 16.1 $ 5,387 108% $ 4,969 $ 4,159 $ 5,062 $ 5,659 $ 122,056 377% $ 32,351 $ 5,451 $ 19,866 $ 63,444 21
A&S Geography and Cartography 15 A&S 45.07Geography and BMD 18.0 18.2 111% 16.4 $ 6,244 100% $ 6,216 $ 4,872 $ 6,092 $ 7,383 $ 102,742 116% $ 88,753 $ 40,565 $ 92,921 $117,482 18
A&S Political Science and Government 15 A&S 45.10Political Science BMD 13.8 18.9 106% 17.9 $ 5,113 91% $ 5,640 $ 4,022 $ 5,373 $ 7,027 $ - 0% $ 8,944 $ 2,709 $ 6,758 $ 13,971 25
A&S Sociology 15 A&S 45.11 Sociology BMD 18.5 25 124% 20.1 $ 4,815 106% $ 4,543 $ 3,422 $ 3,938 $ 5,731 $ 6,314 35% $ 18,113 $ 5,272 $ 15,066 $ 29,959 27 A&S History 15 A&S 54.01 History BMD 39.5 15.3 90% 17 $ 4,862 94% $ 5,167 $ 4,119 $ 4,966 $ 6,111 $ - 0% $ 3,481 $ 889 $ 2,851 $ 4,431 28
FTE STUDENTS TAUGHT PER FTE INSTRUCTIONAL FACULTY
INSTRUCTIONAL EXPENDITURES PER FTE STUDENT RESEARCH & PUBLIC SERVICE EXPENDITURES PER T/TT FACULTY
Benchmarking College and Unit Improvement
What parts of the APR can we address?
2. A statement of the purposes, development and planning for undergraduate education .• Statistical data on course enrollments, class size, and number
of majors and number of minors.• Information about student quality, diversity and achievements.• Description of the undergraduate student learning outcomes,
assessment plans, and utilization of assessment results.(CTAL) • Estimation of revenue generated by tuition.
http://provost.udel.edu/content/academic-program-review#SelfStudyGuidelines
What parts of the APR can we address? cont’d
2. A statement of the purposes, development and planning for graduate education.• Statistical data: size of graduate program(s) including: number
and diversity of students in masters and doctoral programs, and number of funded students, source of funding and comparison of funding to (aspirational) peer programs.
• Time-to-degree completion and degree completion statistics for the graduate program.
• Quality of graduate students as defined by numerical indicators.• Description of graduate student learning outcomes, assessment
plans and utilization of assessment results.(CTAL)
4. Staffing of the unit. • Breakdown of FTE faculty, professionals and salaried staff by
rank, function, workload, race, age, and gender.• Information concerning the use of non-faculty instructors (if any)
in the unit, either teaching assistants or supplemental contract holders.
• Demographic data to set the unit into a University-wide context.
Take Away:Resources on Campus are Available!
• Center for Teaching and Assessment of Learning supports programs as they pursue APR by helping faculty design their evaluations of program quality to ascertain how well students are obtaining the programmatic student learning outcomes.
• Institutional Research and Effectiveness (including IR, Business Intelligence (UDEW) supports departmental Academic Program Review by providing department-specific trend information related to student enrollment, student success and outcomes, personnel, instructional costs and productivity, and faculty scholarly productivity.
• The Delaware Cost Study is a useful tool for providing comparative analysis of faculty teaching loads, direct instructional costs, and separately budgeted scholarly activity, all within academic disciplines.