![Page 1: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/1.jpg)
New York State Report Cards
Program Report Cards
Fiscal Year 10/11
Presented by:
Rosemary Matt
NYS Director of Accountability
![Page 2: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/2.jpg)
Evaluated in TWO Methods
NYS Benchmarks Quartile Ranked
Educational Gain = 46%
Post Test Rate = 65%
Follow Up Outcomes = 69%
Educational Gain (Weighted)
Post Test Rate
Follow Up Outcomes
![Page 3: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/3.jpg)
NYS Quartile Ranking
Quartile 1 0 - .99 Unacceptable
Quartile 2 1 – 1.99 Needs Improvement
Quartile 3 2 – 2.99 Proficient
Quartile 4 3 – 4.00 Highly Proficient
![Page 4: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/4.jpg)
Quartile Rank
Unacceptable – Missed one or more benchmark & in the 1st quartile
Needs Improvement– Missed one or more benchmark & in the 2nd, 3rd, or 4th
quartile
Proficient– Has met all the benchmarks (any quartile)
Highly Proficient– Has met all the benchmarks & in quartile 4
![Page 5: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/5.jpg)
An overview of the program:
![Page 6: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/6.jpg)
Data from Program Evaluation Report:
![Page 7: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/7.jpg)
NYS Benchmark Summary:
NYS Benchmarks:
•Education Gain = 46%
•Post Test Rate = 65 %
•Follow-up Outcomes = 69%
![Page 8: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/8.jpg)
NYS Benchmark Summary:
NYS Benchmarks:
•Education Gain = 46%
•Post Test Rate = 65 %
•Follow-up Outcomes = 69%
![Page 9: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/9.jpg)
Post Test Rate:
Post Test Rate is also Quartile Ranked
![Page 10: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/10.jpg)
Post Test Rate:
![Page 11: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/11.jpg)
NYS Benchmark Summary:
NYS Benchmarks:
•Education Gain = 46%
•Post Test Rate = 65 %
•Follow-up Outcomes = 69%
![Page 12: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/12.jpg)
Where have you seen them before:
![Page 13: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/13.jpg)
Follow Up Outcomes:
Raw numbers used to calculate Program Performance in Percent
# students achieving goal
# students exiting with goal= 86.5%
![Page 14: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/14.jpg)
Weighted Academic Gain:
![Page 15: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/15.jpg)
Goal Setting:
0 5 10
![Page 16: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/16.jpg)
Response Rate:
0 10
![Page 17: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/17.jpg)
Quartile Rank Summary:
Note: Quartile Rank includes
Weighted Educational Gain
![Page 18: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/18.jpg)
Overall Performance:
Quartiles
Quartile 1 0 - .99 Unacceptable
Quartile 2 1 – 1.99 Needs Improvement
Quartile 3 2 – 2.99 Proficient
Quartile 4 3 – 4.00 Highly Proficient
![Page 19: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/19.jpg)
Overall Performance:
Quartile 1 Quartile 2 Quartile 3 Quartile 4
0 1 2 3 4
1.35
![Page 20: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/20.jpg)
Rubric for FY10/11:
•Educational Gain (40%)
•Follow Up Outcomes (20%)
•Post Test Rate (20%)
•Employment & GED Goal Setting (10%)
•Response Rate (10%)
![Page 21: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/21.jpg)
Total Score – Calculations for FY10/11
Maximum rating points to be earned:– Weighted Academic Gain 40– Follow-up Measures 20– Post Test Rate 20– Goal setting 10– Response Rate 10
– Maximum Total 100
![Page 22: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/22.jpg)
NRS Changes
![Page 23: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/23.jpg)
Change Effective July 1, 2012
OVAE has accepted major change to NRS Guidelines
All proposed changes begin July 1, 2012
ASISTS will make changes in data system to begin July 1, 2012
![Page 24: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/24.jpg)
1st Major Change
![Page 25: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/25.jpg)
Let’s compare
Current System:Students are assessed at IntakeDetermination is made:
Is student employed __yes __noIs student available for work?__yes __no
If YES, then assign the goal of “Obtain Employment” (70% Target)If NO – then student status is coded as “Not in the workforce”
Changes to System:Students are assessed at IntakeDetermination is made:
Is student employed __yes __noIs student available for work?__yes __no
If YES, then ASISTS will automatically assign the goal of “Obtain a Job” to all students in this cohortIf NO – then student status is coded as “Not in the workforce”
![Page 26: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/26.jpg)
Current System:Students are assessed at IntakeDetermination is made:
Is student employed __yes __no
If YES – is student enrolled in literacy to Retain his/her employment?
If YES – code student with goal of “Retain Employment”
Changes to System:Students are assessed at IntakeDetermination is made:
Is student employed __yes __no
If YES, then ASISTS will automatically assign the goal of “Retain Employment” to all students in this cohort. Program must conduct Follow Up Survey on each student 3 Quarters after student exits the program.
Let’s compare
![Page 27: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/27.jpg)
2nd Major Change
![Page 28: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/28.jpg)
Current System:Students are assessed at IntakeDetermination is made:
Does student have the goal of attaining a High School Equivalency Diploma __yes __no
If YES, then assign the goal of “Obtain GED”
Changes to System:Students are assessed at IntakeDetermination is made:
Programs must report the total number of enrolled students who take all the GED tests during the year and the number who pass them to calculate a pass rate.
All GED test data will now be recorded in ASISTS and a pass rate will be calculated for each program.
Let’s compare
![Page 29: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/29.jpg)
![Page 30: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/30.jpg)
3rd Major Change
![Page 31: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/31.jpg)
Let’s compare
Current System:Students are assessed at IntakeDetermination is made:
Does student have the goal of attaining a High School Equivalency Diploma __yes __no
If YES, then assign the goal of “Obtain GED” Second Question – Does the student also have the goal of entering Postsecondary Education or Training? If YES, assign goal (50% target)
Changes to System:Students are assessed at IntakeDetermination is made:All learners who have a GED, a secondary credential, or are enrolled in a class specifically designed for transitioning to postsecondary education (e.g., bridge program, college readiness), as the cohort for which “Entry into Postsecondary Education” must be tracked. Students included in the cohort are those who passed the GED tests or earned a secondary credential while enrolled in adult education, enter with these credentials, or are enrolled in a class specifically designed for transitioning to postsecondary education.
![Page 32: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/32.jpg)
Additional Change
Entry into Postsecondary Education or Training can
occur any time from the time of exit until the end of the following program year.
![Page 33: New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability](https://reader038.vdocument.in/reader038/viewer/2022110206/56649cf15503460f949c0c89/html5/thumbnails/33.jpg)
2 Minor Changes
Students’ Highest Educational Level or Degree Attained
&Teacher Experience and
Certification
.