new york state report cards program report cards fiscal year 10/11 presented by: rosemary matt nys...
TRANSCRIPT
New York State Report Cards
Program Report Cards
Fiscal Year 10/11
Presented by:
Rosemary Matt
NYS Director of Accountability
Evaluated in TWO Methods
NYS Benchmarks Quartile Ranked
Educational Gain = 46%
Post Test Rate = 65%
Follow Up Outcomes = 69%
Educational Gain (Weighted)
Post Test Rate
Follow Up Outcomes
NYS Quartile Ranking
Quartile 1 0 - .99 Unacceptable
Quartile 2 1 – 1.99 Needs Improvement
Quartile 3 2 – 2.99 Proficient
Quartile 4 3 – 4.00 Highly Proficient
Quartile Rank
Unacceptable – Missed one or more benchmark & in the 1st quartile
Needs Improvement– Missed one or more benchmark & in the 2nd, 3rd, or 4th
quartile
Proficient– Has met all the benchmarks (any quartile)
Highly Proficient– Has met all the benchmarks & in quartile 4
An overview of the program:
Data from Program Evaluation Report:
NYS Benchmark Summary:
NYS Benchmarks:
•Education Gain = 46%
•Post Test Rate = 65 %
•Follow-up Outcomes = 69%
NYS Benchmark Summary:
NYS Benchmarks:
•Education Gain = 46%
•Post Test Rate = 65 %
•Follow-up Outcomes = 69%
Post Test Rate:
Post Test Rate is also Quartile Ranked
Post Test Rate:
NYS Benchmark Summary:
NYS Benchmarks:
•Education Gain = 46%
•Post Test Rate = 65 %
•Follow-up Outcomes = 69%
Where have you seen them before:
Follow Up Outcomes:
Raw numbers used to calculate Program Performance in Percent
# students achieving goal
# students exiting with goal= 86.5%
Weighted Academic Gain:
Goal Setting:
0 5 10
Response Rate:
0 10
Quartile Rank Summary:
Note: Quartile Rank includes
Weighted Educational Gain
Overall Performance:
Quartiles
Quartile 1 0 - .99 Unacceptable
Quartile 2 1 – 1.99 Needs Improvement
Quartile 3 2 – 2.99 Proficient
Quartile 4 3 – 4.00 Highly Proficient
Overall Performance:
Quartile 1 Quartile 2 Quartile 3 Quartile 4
0 1 2 3 4
1.35
Rubric for FY10/11:
•Educational Gain (40%)
•Follow Up Outcomes (20%)
•Post Test Rate (20%)
•Employment & GED Goal Setting (10%)
•Response Rate (10%)
Total Score – Calculations for FY10/11
Maximum rating points to be earned:– Weighted Academic Gain 40– Follow-up Measures 20– Post Test Rate 20– Goal setting 10– Response Rate 10
– Maximum Total 100
NRS Changes
Change Effective July 1, 2012
OVAE has accepted major change to NRS Guidelines
All proposed changes begin July 1, 2012
ASISTS will make changes in data system to begin July 1, 2012
1st Major Change
Let’s compare
Current System:Students are assessed at IntakeDetermination is made:
Is student employed __yes __noIs student available for work?__yes __no
If YES, then assign the goal of “Obtain Employment” (70% Target)If NO – then student status is coded as “Not in the workforce”
Changes to System:Students are assessed at IntakeDetermination is made:
Is student employed __yes __noIs student available for work?__yes __no
If YES, then ASISTS will automatically assign the goal of “Obtain a Job” to all students in this cohortIf NO – then student status is coded as “Not in the workforce”
Current System:Students are assessed at IntakeDetermination is made:
Is student employed __yes __no
If YES – is student enrolled in literacy to Retain his/her employment?
If YES – code student with goal of “Retain Employment”
Changes to System:Students are assessed at IntakeDetermination is made:
Is student employed __yes __no
If YES, then ASISTS will automatically assign the goal of “Retain Employment” to all students in this cohort. Program must conduct Follow Up Survey on each student 3 Quarters after student exits the program.
Let’s compare
2nd Major Change
Current System:Students are assessed at IntakeDetermination is made:
Does student have the goal of attaining a High School Equivalency Diploma __yes __no
If YES, then assign the goal of “Obtain GED”
Changes to System:Students are assessed at IntakeDetermination is made:
Programs must report the total number of enrolled students who take all the GED tests during the year and the number who pass them to calculate a pass rate.
All GED test data will now be recorded in ASISTS and a pass rate will be calculated for each program.
Let’s compare
3rd Major Change
Let’s compare
Current System:Students are assessed at IntakeDetermination is made:
Does student have the goal of attaining a High School Equivalency Diploma __yes __no
If YES, then assign the goal of “Obtain GED” Second Question – Does the student also have the goal of entering Postsecondary Education or Training? If YES, assign goal (50% target)
Changes to System:Students are assessed at IntakeDetermination is made:All learners who have a GED, a secondary credential, or are enrolled in a class specifically designed for transitioning to postsecondary education (e.g., bridge program, college readiness), as the cohort for which “Entry into Postsecondary Education” must be tracked. Students included in the cohort are those who passed the GED tests or earned a secondary credential while enrolled in adult education, enter with these credentials, or are enrolled in a class specifically designed for transitioning to postsecondary education.
Additional Change
Entry into Postsecondary Education or Training can
occur any time from the time of exit until the end of the following program year.
2 Minor Changes
Students’ Highest Educational Level or Degree Attained
&Teacher Experience and
Certification
.
