draft of the conceptual framework for evaluation & assessment of the
DESCRIPTION
Draft of the Conceptual Framework for Evaluation & Assessment of the National Science Foundation (NSF) Alliance for Graduate Education & the Professoriate (AGEP) Program Developed by Yolanda S. George, AAAS Education & Human Resources Programs and - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Draft of the Conceptual Framework for Evaluation & Assessment of the](https://reader036.vdocument.in/reader036/viewer/2022070504/568167a1550346895ddcee9f/html5/thumbnails/1.jpg)
Draft of the Conceptual Framework for Evaluation & Assessment of the
National Science Foundation (NSF)Alliance for Graduate Education & the Professoriate
(AGEP) Program
Developed byYolanda S. George, AAAS Education & Human Resources
Programs and Patricia Campbell, Campbell-Kibler Associates, Inc.
With input from the AGEP Community
![Page 2: Draft of the Conceptual Framework for Evaluation & Assessment of the](https://reader036.vdocument.in/reader036/viewer/2022070504/568167a1550346895ddcee9f/html5/thumbnails/2.jpg)
Help AGEP awardees to build a comprehensive evaluation and
assessment infrastructure to examine their graduate education enterprise in terms of creating a diverse S&E PhD
workforce.
The primary goal of the AGEP Program evaluation capacity building project is to:
![Page 3: Draft of the Conceptual Framework for Evaluation & Assessment of the](https://reader036.vdocument.in/reader036/viewer/2022070504/568167a1550346895ddcee9f/html5/thumbnails/3.jpg)
Recruitment and talent spotting strategies. Admissions and selection processes.Financial aid, particularly as it affects new graduate student enrollment and retention.Academic preparation & support programs, particularly during the early course-taking years.Advising, mentoring, and retention. Workforce preparation.PhD career counseling and employment placement.
The evaluation framework and model for change are focused on graduate student affairs, including:
![Page 4: Draft of the Conceptual Framework for Evaluation & Assessment of the](https://reader036.vdocument.in/reader036/viewer/2022070504/568167a1550346895ddcee9f/html5/thumbnails/4.jpg)
Graduate School and Academic Deans Provosts and Other AdministratorsS&E Department ChairsS&E Departmental Admissions and Selection CommitteesS&E Departmental Graduate Program Directors or AdvisorsS&E Faculty
Key Administrators Using Evaluation & Assessment to Make informed Decisions
![Page 5: Draft of the Conceptual Framework for Evaluation & Assessment of the](https://reader036.vdocument.in/reader036/viewer/2022070504/568167a1550346895ddcee9f/html5/thumbnails/5.jpg)
Race/EthnicityGender CitizenshipS&E Departments
Collection And Use Of Disaggregated Data
![Page 6: Draft of the Conceptual Framework for Evaluation & Assessment of the](https://reader036.vdocument.in/reader036/viewer/2022070504/568167a1550346895ddcee9f/html5/thumbnails/6.jpg)
UM applicants & admitsNew or first time UM enrollees;Overall UM enrollment;UM students advancing to doctoral candidacy;UM students completing degrees (Master’s or PhD).Post PhD Employment
Quantitative data should be used to examine patterns and trends in number and percentage of:
![Page 7: Draft of the Conceptual Framework for Evaluation & Assessment of the](https://reader036.vdocument.in/reader036/viewer/2022070504/568167a1550346895ddcee9f/html5/thumbnails/7.jpg)
Number and percentage of S&E departments involved Number of S&E faculty involved Number of S&E faculty involved in graduate student recruitment.S&E departmental practices related to graduate student admissions and selection.S&E departmental practices related to academic preparation, advising and workforce mentoringS&E departmental practices related to faculty evaluation and incentives.Family leave policies and practices within the graduate school or departments. As related to graduate students.Data collection practices, particularly use of disaggregated data, at the in decision-making.
Indicators of Infrastructure Changes in Graduate Programs
![Page 8: Draft of the Conceptual Framework for Evaluation & Assessment of the](https://reader036.vdocument.in/reader036/viewer/2022070504/568167a1550346895ddcee9f/html5/thumbnails/8.jpg)
The quality of the implementation including participants’ and/or external reviewers’ perceptions about the intended objectives of a workshop or program component. Time-on-taskThe effectiveness of the interventions or to what extent did the intervention achieve its intended objectives.
Also, data and information need to be collected on
![Page 9: Draft of the Conceptual Framework for Evaluation & Assessment of the](https://reader036.vdocument.in/reader036/viewer/2022070504/568167a1550346895ddcee9f/html5/thumbnails/9.jpg)
Quantitative and qualitative studies about policies, practices, and programs in the Graduate School & S&E departments should be used to determine
What is working and not workingWhat works for whom.
![Page 10: Draft of the Conceptual Framework for Evaluation & Assessment of the](https://reader036.vdocument.in/reader036/viewer/2022070504/568167a1550346895ddcee9f/html5/thumbnails/10.jpg)
Using the meeting to begin to reflect on infrastructure changes in graduate schoolsHow building a comprehensive evaluation and assessment infrastructure How to better work with institutional researchers, other campus research units, external evaluator How to involve S & E departments
![Page 11: Draft of the Conceptual Framework for Evaluation & Assessment of the](https://reader036.vdocument.in/reader036/viewer/2022070504/568167a1550346895ddcee9f/html5/thumbnails/11.jpg)
AGEP Program Director will review Expectations NSF HRD Evaluation Office & Performance AssessmentLessons Learned by Some AGEP Institutions
Strand 1 --Building a data collection infrastructure related to graduate students
and their progression to the PhD.
![Page 12: Draft of the Conceptual Framework for Evaluation & Assessment of the](https://reader036.vdocument.in/reader036/viewer/2022070504/568167a1550346895ddcee9f/html5/thumbnails/12.jpg)
CGS PhD Completion Project Working with STEM departments and faculty to ensure retention in PhD programs, particularly during the first years of graduate school Strategies for helping students to be successful on qualifying exams Strategies to reduce time to degree
Strand 2Retention & Progress to the PhD
![Page 13: Draft of the Conceptual Framework for Evaluation & Assessment of the](https://reader036.vdocument.in/reader036/viewer/2022070504/568167a1550346895ddcee9f/html5/thumbnails/13.jpg)
Strand 3
Assessing recruitment and departmental admissions/selections efforts.
![Page 14: Draft of the Conceptual Framework for Evaluation & Assessment of the](https://reader036.vdocument.in/reader036/viewer/2022070504/568167a1550346895ddcee9f/html5/thumbnails/14.jpg)
Other Agenda ElementsFoundation & Discipline PerspectivesNSF DirectorUsing WebCASPARUpdate on AGEP Data CollectionNSF Director
![Page 15: Draft of the Conceptual Framework for Evaluation & Assessment of the](https://reader036.vdocument.in/reader036/viewer/2022070504/568167a1550346895ddcee9f/html5/thumbnails/15.jpg)
This is a community effort.
The framework is evolving
This is not an easy journey, neither is it one that can be completed quickly
In Summary