new york state report cards program report cards fiscal year 10/11 presented by: rosemary matt nys...

New York State Report Cards

Program Report Cards

Fiscal Year 10/11

Presented by:

Rosemary Matt

NYS Director of Accountability

Evaluated in TWO Methods

NYS Benchmarks Quartile Ranked

Educational Gain = 46%

Post Test Rate = 65%

Follow Up Outcomes = 69%

Educational Gain (Weighted)

Post Test Rate

Follow Up Outcomes

NYS Quartile Ranking

Quartile 1 0 - .99 Unacceptable

Quartile 2 1 – 1.99 Needs Improvement

Quartile 3 2 – 2.99 Proficient

Quartile 4 3 – 4.00 Highly Proficient

Quartile Rank

Unacceptable – Missed one or more benchmark & in the 1st quartile

Needs Improvement– Missed one or more benchmark & in the 2nd, 3rd, or 4th

quartile

Proficient– Has met all the benchmarks (any quartile)

Highly Proficient– Has met all the benchmarks & in quartile 4

An overview of the program:

Data from Program Evaluation Report:

NYS Benchmark Summary:

NYS Benchmarks:

•Education Gain = 46%

•Post Test Rate = 65 %

•Follow-up Outcomes = 69%

NYS Benchmark Summary:

NYS Benchmarks:

•Education Gain = 46%

•Post Test Rate = 65 %

•Follow-up Outcomes = 69%

Post Test Rate:

Post Test Rate is also Quartile Ranked

Post Test Rate:

NYS Benchmark Summary:

NYS Benchmarks:

•Education Gain = 46%

•Post Test Rate = 65 %

•Follow-up Outcomes = 69%

Where have you seen them before:

Follow Up Outcomes:

Raw numbers used to calculate Program Performance in Percent

# students achieving goal

# students exiting with goal= 86.5%

Weighted Academic Gain:

Goal Setting:

0 5 10

Response Rate:

0 10

Quartile Rank Summary:

Note: Quartile Rank includes

Weighted Educational Gain

Overall Performance:

Quartiles

Quartile 1 0 - .99 Unacceptable

Quartile 2 1 – 1.99 Needs Improvement

Quartile 3 2 – 2.99 Proficient

Quartile 4 3 – 4.00 Highly Proficient

Overall Performance:

Quartile 1 Quartile 2 Quartile 3 Quartile 4

0 1 2 3 4

1.35

Rubric for FY10/11:

•Educational Gain (40%)

•Follow Up Outcomes (20%)

•Post Test Rate (20%)

•Employment & GED Goal Setting (10%)

•Response Rate (10%)

Total Score – Calculations for FY10/11

Maximum rating points to be earned:– Weighted Academic Gain 40– Follow-up Measures 20– Post Test Rate 20– Goal setting 10– Response Rate 10

– Maximum Total 100

NRS Changes

Change Effective July 1, 2012

OVAE has accepted major change to NRS Guidelines

All proposed changes begin July 1, 2012

ASISTS will make changes in data system to begin July 1, 2012

1st Major Change

Let’s compare

Current System:Students are assessed at IntakeDetermination is made:

Is student employed __yes __noIs student available for work?__yes __no

If YES, then assign the goal of “Obtain Employment” (70% Target)If NO – then student status is coded as “Not in the workforce”

Changes to System:Students are assessed at IntakeDetermination is made:

Is student employed __yes __noIs student available for work?__yes __no

If YES, then ASISTS will automatically assign the goal of “Obtain a Job” to all students in this cohortIf NO – then student status is coded as “Not in the workforce”

Current System:Students are assessed at IntakeDetermination is made:

Is student employed __yes __no

If YES – is student enrolled in literacy to Retain his/her employment?

If YES – code student with goal of “Retain Employment”

Changes to System:Students are assessed at IntakeDetermination is made:

Is student employed __yes __no

If YES, then ASISTS will automatically assign the goal of “Retain Employment” to all students in this cohort. Program must conduct Follow Up Survey on each student 3 Quarters after student exits the program.

Let’s compare

2nd Major Change

Current System:Students are assessed at IntakeDetermination is made:

Does student have the goal of attaining a High School Equivalency Diploma __yes __no

If YES, then assign the goal of “Obtain GED”

Changes to System:Students are assessed at IntakeDetermination is made:

Programs must report the total number of enrolled students who take all the GED tests during the year and the number who pass them to calculate a pass rate.

All GED test data will now be recorded in ASISTS and a pass rate will be calculated for each program.

Let’s compare

3rd Major Change

Let’s compare

Current System:Students are assessed at IntakeDetermination is made:

Does student have the goal of attaining a High School Equivalency Diploma __yes __no

If YES, then assign the goal of “Obtain GED” Second Question – Does the student also have the goal of entering Postsecondary Education or Training? If YES, assign goal (50% target)

Changes to System:Students are assessed at IntakeDetermination is made:All learners who have a GED, a secondary credential, or are enrolled in a class specifically designed for transitioning to postsecondary education (e.g., bridge program, college readiness), as the cohort for which “Entry into Postsecondary Education” must be tracked. Students included in the cohort are those who passed the GED tests or earned a secondary credential while enrolled in adult education, enter with these credentials, or are enrolled in a class specifically designed for transitioning to postsecondary education.

Additional Change

Entry into Postsecondary Education or Training can

occur any time from the time of exit until the end of the following program year.

2 Minor Changes

Students’ Highest Educational Level or Degree Attained

&Teacher Experience and

Certification

.

Contact Information:

Rosemary Matt

NYS Director of Accountability

Email:

Rosemary.Matt@cayuga-cc.edu