delaware cost study: uses and best practices john barnshaw, ph.d. director, higher education...

23
Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia [email protected] Tom Eleuterio, M.S. Research Analyst, Higher Education Consortia [email protected]

Upload: noah-wilkerson

Post on 03-Jan-2016

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Delaware Cost Study: Uses and Best Practices

John Barnshaw, Ph.D.Director, Higher Education Consortia

[email protected]

Tom Eleuterio, M.S.Research Analyst, Higher Education Consortia

[email protected]

Page 2: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

What is the Delaware Cost Study?• The

National Study of Instructional Costs and Productivity (Delaware Cost Study) is a benchmarking project and data sharing consortia among four-year colleges and universities with over 200 institutions participating annually.

• Since 1996, over 600 institutions have participated, and over the past two decades, the Delaware Cost Study has become the “tool of choice” for comparative analysis of faculty teaching loads, direct instructional costs, and separately budgeted scholarly activity, within academic disciplines.

• Currently, the Cost Study is used major data and state agencies including:– Association of American Universities Data Exchange (AAUDE)– Southern Universities Group (SUG)– University of North Carolina (UNC) System– Pennsylvania State System of Higher Education (PaSSHE)– University of Missouri System– University of Nebraska System– Connecticut State University System (CSUS)– City University of New York (CUNY) System

Page 3: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Delaware Cost Study – Strengths and Limitations• Strengths

– Ideal tool for benchmarking instructional costs, research, and public service expenditures at the academic discipline level

– Most systematic and rigorous conceptualization based on CIP levels

– Assists institutional data and unit alignment– Assists in identifying cost distortions– Ideal for program reviews and accreditation – Ideal for establishing new program or department projections– Higher Education Consortia is a useful intermediary partner

• Limitations– Not a “whole cost” benchmarking tool for expenditure or

tuition– Not a perfect 1:1 Program/Department/Academic Budget Unit

match– Not a tool for performance funding

Page 4: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Growing the Delaware Cost Study

2005 2006 2007 2008 2009 2010 2011 2012 20130

50

100

150

200

250

196188

201 196

174

197188

176

220

Institutional Participation, 2005 – 2013

Institutional Participation Participation Trendline

Page 5: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

2013 Delaware Cost Study (n=218)

All-Time Delaware Cost Study (n=600)

Carnegie Classification (n=1,608)

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

12.420.5

41.7

48.648.5

40.57.35.7

4.931.7 25.312.9

Delaware Cost Study Participation by Carnegie Classifica-tion Relative to Carnegie Classification Overall

Baccalaureate Master's Doctoral Research Intensive

Delaware Cost Study Representation

Page 6: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

2013

Delaw

are

Cost S

tudy

Pub

lic (n

=152)

Carne

gie

Class

ifica

tion

Public

(n=58

5)

2013

Delaw

are

Cost S

tudy

Priv

ate

(n=66

)

Carne

gie

Class

ifica

tion

Priva

te (n

=1,02

3)0%

30%

60%

90%

6.6 23.4 25.852.145.4

46.3 56.037.2

5.95.1

10.6 4.842.1 25.1 7.6 5.9

Delaware Cost Study Participation and Carnegie Classi-fication by Institutional Control

Baccalaureate Master's Doctoral Research Intensive

Delaware Cost Study Representation by Institutional

Control

Page 7: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Why do institutions participate in the Delaware Cost Study?

Psyc

holo

gy

Engl

ish

Mathe

mat

ics

Biolo

gy

Histor

y

Chem

istry

Polit

ical

Scien

ce

Comm

unica

tion

Music

Phys

ics$0

$50

$100

$150

$200

$250

$300

$350

$400

$450

$500

Quartile Bands for Direct Instructional Expenditure/Student Credit Hour by Ten Most Frequent Classification of Instructional Program (CIP) Codes

• According to the National Center for Education Statistics, 76 – 82 percent of the variation in cost is located at the academic disciplinary level.

Page 8: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Delaware Cost Study Data Uses

Academic/Accreditation Program ReviewFaculty Hiring/DisparityChair Key Performance IndicatorsDeans DashboardSenior Budgeting/President/Provost Planning/ProjectionsIdentifying Cost Distortions in Budgeting Formulas Developing New Programs/DepartmentsGrants and Research Expenditure BenchmarkingExternal Audit/System Review ToolStudent/Faculty Recruitment/Retention ToolGeneral Unit and Institutional Improvement

Page 9: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Assessing Student Credit Hour Production and Direct Instructional

Expenditure Direct Instructional Expenditure per FTE Faculty as Percentage of Carnegie Classification

Student Credit Hours per FTE Faculty as Percentage of Carnegie Classification

Low Moderate High

Low Theater Physics, Chemical Engineering

Moderate Criminal Justice, Political Science

Biology, Music Chemistry

High Communication, English, History, Psychology, Sociology

Mathematics

Page 10: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Benchmarking Instructional Activity – Psychology

2008 2009 2010 2011 20120%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0

10

20

30

40

50

60

70

80

90

100

90

62

79 7984

038 21 21

1610

0 0 0 00 0 0 0 0

77 76 76

6260

5 6 7

15

9

1518 17 18

22

0 0 0 0 0

Undergraduate Student Credit Hour Share by Faculty Rank relative to Carnegie Classification

T/TT Faculty Regular Faculty Supplemental Faculty Teaching AssistantCarnegie T/TT Carnegie ORF Carnegie Supplemental Carnegie TA

Page 11: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Select Comparators - AAU Comparator Data with Carnegie Classification

0.000

50.000

100.000

150.000

200.000

250.000

R&PS Expenditure/ FTE T/ TT($1000s)

R Expenditure/ FTE T/ TT($1000s)

DI Expenditure/ SCH ($) % UG Degree

Mathematics Department by % UG Degree and Expenditure Data

University AAU Carnegie RVH

Page 12: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Delaware Cost Study – Consortium Participation (Same Department)

Institution Type Program

Total SCH for T/TT FTE Faculty as % of Norm

DIE/SCH ($) as % of Norm

R&PS ($) forT/TT FTE Faculty as % of Norm

Research Very High

BMD 67.10% 173.33% 284.36%

Research High BMD 102.78% 122.78% 41.87%

Doctoral Research BMD 90.68% 100.00% 119.56%

Master’s Large BM 97.88% 103.38% 810.92%

Master’s Medium B 102.12% 81.76% 0.00%

Baccalaureate Arts & Sciences

B 121.92% 121.08% ------------

Baccalaureate Diverse

B 107.76% 106.63% ------------

Page 13: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Delaware Cost Study – Consortium Participation (Same Department)

Baccalaureate Arts & Sciences

Baccalaureate Diverse

Master's Medium

Master's Large

Doctoral Research

Research High

Research Very High

0.00 100.00 200.00 300.00 400.00 500.00 600.00 700.00 800.00 900.00

0.00

0.00

0.00

810.92

119.56

41.87

284.36

121.08

106.63

81.76

103.38

100.00

122.78

173.33

121.92

107.76

102.12

97.88

90.68

102.78

67.10

Norm Percentages relative to Total SCH/T/TT Faculty, DIE/SCH ($), R&PS ($)

Total SCH for T/TT FTE Faculty as % of Norm

DIE/SCH ($) as % of Norm R&PS ($) forT/TT FTE Faculty as % of Norm

Page 14: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

2014 – 2015 Data Collection Cycle

• August 15, 2014 Invitation to Participate (Enrollment/Cycle Opens)

• October/November 2014 Work with Systems/New Member Institution

($1,000 “Early Bird” Ends October 31)

• December/January 2014 Work with Members in Data Collection Process

• January 30, 2015 Submission of Data (Enrollment Closes)

($1,250 Participation Fee Ends)

• Spring 2015 Verify and Validate Data Submissions

• June 30, 2015 Assemble Final Cost Study Data Set

• July 31, 2015 Secure Site Data Release (Cycle Closes)

Page 15: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Future Directions: Higher Education Consortia

• Over the past year, the Higher Education Consortia has worked with four-year colleges, universities, and systems to facilitate unit and institutional improvement on a limited basis. These services are now available to all institutions and systems.

• Data Alignment

• Statistical Solutions (Data Mining, OLS, HLM, SEM, PSM, MCS, Survival)

• Academic Program Review

• Internal and External Benchmarking

• Enrollment Management/Modeling

• Institutional Effectiveness Workshops/In-Service Solutions

• Special Projects

Page 16: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Addressing Your Questions and Comments

• What questions do you have at this time?

Page 17: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Peer Ratio Access – Institutional Login• Once you have logged institutionally, click on “Peer Analysis” and

then “Peer Ratio Data.”

Page 18: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Peer Ratio Access – Institutional Login• Once you have selected “Peer Ratio Data,” select ten or more

institutions, the results will be generated in a manner that can be viewed and/or downloaded into Microsoft Excel. Additional instruction are on the right of the page.

Page 19: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Take Away: The Delaware Cost Study is a resource.

• The Delaware Cost Study is a useful tool for providing comparative analysis of faculty teaching loads, direct instructional costs, and separately budgeted scholarly activity, all within academic disciplines.

• Delaware Cost Study is useful for data alignment, system integration, unit improvement, and institutional effectiveness.

• A failure to monitor these variables may lead to expenditure distortion in planning and budget models (ABB, RCM, PBB, ZBB).

• Cost Study data (courses taught, research and public service expenditures) may be useful for Academic Program Reviews (APR).

• Cost Study data may be useful for proposing, planning and developing new departmental programs.

Page 20: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

What types of data are collected in the Cost Study?• Table 1 - Presents the proportional distribution of student credit hours and

organized class sections according to the type of faculty teaching them for each course level.

• Table 2 - Presents the proportional distribution of student credit hours and organized class sections taught according to course level for regular faculty.

• Table 3 - Summarizes the fall term faculty workload using the average student credit hours, average organized class sections, and average FTE students taught per FTE instructional faculty for each faculty type.

• Table 4 - Summarizes direct instructional costs per student credit hour and per FTE student taught using the total student credit hours generated during the academic year and the fiscal year expenditure data. Personnel cost as percent of the total direct instructional cost is also presented. Other cost indicators, expenditures from separately budgeted research and public service, are given per FTE tenured/tenure-track faculty.

Page 21: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Delaware Cost Study Sample Institutional Report - Table 4

Page 22: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

Five Most Common Considerations on Delaware Cost Study

• Dual Listed Courses: Parse out the SCH and OCS based on how students registered (POSC 410/610- Undergrad v. Grad).

• Cross Listed Courses: Assign SCH to the department funding the instructor’s salary (POSC220/WOMS220).

• Team Taught Courses: Assign SCH based on workload for each instructor.

• Joint Appointments: Split FTE and SCH based on funding split (40% POSC v. 60% ECON).

• Online Courses: Report if funded by instructional budget, count their SCH and OCS in same discrete way as if taught in-person.

Page 23: Delaware Cost Study: Uses and Best Practices John Barnshaw, Ph.D. Director, Higher Education Consortia barnshaw@udel.edu Tom Eleuterio, M.S. Research Analyst,

• Separately Budgeted FTE: Portion of the total FTE that is funded by external or separately budgeted funds for purposes other than teaching (Research, Service, Administration).

• Supplemental Faculty: if no FTE assigned, recommend using their teaching credit hours divided by 12 (e.g. 2 three-credit courses = 6/12 = 0.5 FTE.

• Teaching Assistants: Gather FTE of TAs from your HR data, then use Supplemental Faculty instructions to assign FTE for those TAs teaching credit-bearing courses where they are instructor of record. Then subtract these credit-bearing FTE from the total TA FTE to determine the non-credit bearing TA FTE.

Data Checklist: Special Considerations