accessing and using the delaware secure server to develop customized peer analysis at your...

39
Accessing and Using Accessing and Using the Delaware Secure the Delaware Secure Server to Develop Server to Develop Customized Peer Customized Peer Analysis at Your Analysis at Your Institution Institution Karen DeMonte and Allison Walters University of Delaware

Upload: rita-naylor

Post on 31-Mar-2015

213 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Accessing and Using the Accessing and Using the Delaware Secure Server to Delaware Secure Server to Develop Customized Peer Develop Customized Peer

Analysis at Your Analysis at Your InstitutionInstitution

Karen DeMonte and Allison Walters

University of Delaware

Page 2: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Data needed:

• Teaching load data (student credit hours and number of sections taught) for a fall term by faculty category.

• Academic year student credit hours taught, fiscal year instructional expenditures and research and public service expenditure.

• For non-participants, instructions for completing the survey is available on-line at www.udel.edu/ir/cost

Page 3: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Survey Instrument Part A:

Page 4: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Survey Instrument Part B:

Page 5: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Entering your institution’s user

name and password takes

you to the secure Cost site.

Entering your institution’s user

name and password takes

you to the secure Cost site.

Page 6: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Peer analysis:Options Available

Using national norms

OR

Customized peer analysis

Page 7: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

NATIONAL NORMS

The 'norms' reported are the refined means that were calculated for each indicator variable in the tables – available to ALL participants…

Faculty workload and unit costs are provided in the following reports that are available to download as EXCEL files from the secured web site:

• Norms by institutions’ Carnegie Classification• Norms by the highest degree offered in the

discipline• Norms by the undergraduate/graduate program

mix

Page 8: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

CUSTOMIZED PEER ANALYSIS

Users’ need for analysis goes beyond the standard norms…

• Select a subset of institutions within a Carnegie class. Users can also limit peers according to a finer breakdown of Carnegie class, e.g., Research High Activity or Research Very High vs. the standard Research combined classification.

• Select institutions that cut across Carnegie classifications in order to parallel the institution’s existing primary peer groups with regards to other institutional characteristics.

Page 9: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

AND…

• Select a constant set of peers that reflects the majority of the institution’s programs.

• Select institutions at the discipline level. This results in having a different set of peers for each discipline or reasonable discipline groupings, e.g. humanities, social sciences, physical science.

Page 10: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Three Ways of Conducting a Customized Peer Analysis:

1. Download EXCEL files of refined norms and institutional ratios previously requested from the University of Delaware.

2. User produced customized peer data sets to download into EXCEL and import into SPSS or SAS to calculate non-refined means.

3. Purchase Excel Macro to calculate refined means.

Page 11: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

UD Requested Peer Analysis

Page 12: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Download EXCEL files of norms and peer ratio data:

Participants have the opportunity to request up to 5 peer analyses at no cost* from the University of Delaware. Results are posted within 2 weeks in the secured site and they include:

1. Table of norms (refined means) in formats that are similar to those of the standard peer norms

2. Peer ratio data given in EXCEL files which include the data points from which the norms are calculated

* $250 for each additional analysis

Page 13: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Select ‘Peer Analysis’…

Select ‘Peer Analysis’…

Page 14: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

…and then click to view the peer

group.

…and then click to view the peer

group.

Page 15: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of
Page 16: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

…select the table or ratio …

…select the table or ratio …

Page 17: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

…and download the file into

EXCEL.

…and download the file into

EXCEL.

Page 18: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

User Produced Peer Analysis

Page 19: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

User produces customized Peer Ratio Data Sets from the Secured Site:

• It allows users to do an unlimited number of peer analyses

• Used by participants who feel the need to choose different sets of peers at the discipline level

• Data are given in EXCEL files and are designed to be easily read by the user’s SPSS or SAS programs to calculate refined means

• Download as often and as many as you want at no charge

Page 20: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Select ‘Peer Ratio Data’…

Select ‘Peer Ratio Data’…

Page 21: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Highlight your peer institutions and submit the

request.

Highlight your peer institutions and submit the

request.

Page 22: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Select the ratio table to view or

download…

Select the ratio table to view or

download…

Page 23: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

And view your results.

And view your results.

Page 24: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Music Department requests a peer

analysis…but which schools to include?

Page 25: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Find institutions that reported data

for a particular discipline.

Find institutions that reported data

for a particular discipline.

Select by discipline or

CIP...

Select by discipline or

CIP...

Page 26: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

…and review the list of institutions that submitted data.

…and review the list of institutions that submitted data.

Page 27: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Music Department Peers

1. Department Chair selects peers using listing for CIP 50.09 – Music

2. Download data into Excel spreadsheet

3. Run simple SPSS syntax to…• select music CIP codes • calculate simple mean for FTE student per

FTE faculty by faculty type for peers and UD

4. Create charts of UD data and Peer data

Page 28: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Again, highlight your peer

institutions and submit the request.

Again, highlight your peer

institutions and submit the request.

Page 29: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Begin downloading the

ratio tables.

Begin downloading the

ratio tables.Refer to the Column

Definitions for help on deciphering your data.

Refer to the Column Definitions for help on deciphering your data.

Page 30: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Refer to Column Definitions of ratio

tables.

Refer to Column Definitions of ratio

tables.

Page 31: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Work with your data in Excel or…

Work with your data in Excel or…

Page 32: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Import it into SPSS.Import it into SPSS.

Hint: Before importing your Excel data, change the sheet name and the

column headings.

Hint: Before importing your Excel data, change the sheet name and the

column headings.

Page 33: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

SPSS Data FileSPSS Data File

Page 34: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

SPSS Output File of unrefined meansSPSS Output File of unrefined means

Page 35: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Excel Chart based on SPSS outputExcel Chart based on SPSS output

Page 36: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

*****************************

Macro to Calculate Refined Means

*****************************Users calculate unlimited peer analyses with refined means

* one-time fee of $250

Page 37: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Macro to Calculate Refined Means:

• Refined mean is the average of the data points after eliminating the outliers.

• Use in conjunction with the data that you downloaded from the "peer ratio data".

• The macro calculates for each CIP…• simple mean

• number of observations used in the calculation

• standard deviation

• refined mean

Page 38: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Sample Output:

Page 39: Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution Karen DeMonte and Allison Walters University of

Accessing and Using the Delaware Secure Server to Develop Customized Peer Analysis at Your Institution

Karen DeMonte [email protected] Walters [email protected]

Office of Institutional Research and Planning University of Delaware325 Hullihen HallNewark, DE  19716-0172Phone:  (302)831-2021