welcome to the common measures webinar
Post on 30-Jan-2016
27 Views
Preview:
DESCRIPTION
TRANSCRIPT
WelcomeWelcometo the Common Measures to the Common Measures
WebinarWebinarPress *6 to mute your telephone
Please do not put your phone on HOLD
In the ‘chat’ box, please enter and send us your MWA or organization name,
email address, and the names of everyone participating at your location.
Thanks!! We’ll get started soon!
AGENDAAGENDA
Webinar HousekeepingIntroductions
Common Measures TEGL 17-05DLEG-BWP PI 05-41
Performance MeasuresVAPIS
MIS Changes
TEGL 17-05
Establishing Common Establishing Common MeasuresMeasures
• Effort led by OMB as part of President’s Management Agenda– Linking performance to budget– Supporting effective programs– Comparing similar programs across
agencies
• Includes six federal departments
The Common MeasuresThe Common Measures
Adult Measures
–Entered Employment
–Employment Retention
–Average Earnings*
* Average Earnings become effective PY 2006; for PY 2005, the measure is an Earnings Change.
The Common MeasuresThe Common Measures
Youth Measures
–Placement in Employment or Education
–Attainment of a Degree or Certificate
–Literacy or Numeracy Gains
Common Measures Common Measures BenefitsBenefits
Focus on the core purposes of the workforce system
Break down barriers to integrationResolve questions regarding
consistency and reliability of dataReduce confusion
PY 2005 AccountabilityPY 2005 Accountability
Accountable for specific Common Measures
–Entered Employment Rate (WIA, W-P, VETS, Trade)
–Employment Retention Rate (WIA, W-P, VETS, Trade)
PY 2005 AccountabilityPY 2005 Accountability
Accountable for specific WIA statutory performance measures
– Adult, DW, and OY Average Earnings Gain/Replacement (WIA, W-P, VETS, Trade)
– Adult and DW Employment and Credential
– OY Entered Employment, Retention, Earnings, Credential
– YY Retention, Skill Attainment, Diploma Attainment
– Customer Satisfaction (Participants and Employers)
PY 2005 AccountabilityPY 2005 Accountability
Accountable for reporting on specific Common Measures
– Youth Attainment of Degree/ Certificate
– Youth Placement in Employment/ Education
PY 2005 AccountabilityPY 2005 Accountability
• Reporting recommended for Youth Literacy/Numeracy– Required beginning in PY 2006
• WIA performance accountability for PY 2005 still consists of the “17” measures– With some changed definitions
Program ReportingProgram Reporting
In general, individuals who are eligible for a program and receive any service should be reported in
participant counts
Youth Program Design Youth Program Design Implication #1Implication #1
Long-Term ParticipationLong-Term Participation
Common Measure outcomes are unlikely to be met unless youth participate for extended periods
Youth Program Design Youth Program Design Implication #2Implication #2
Network of ServicesNetwork of Services Since long-term participation is needed to
achieve outcomes, now more than ever, WIA youth must have access to a network of services, not a single
program or provider
Youth Program Design Youth Program Design Implication #3Implication #3AssessmentAssessment
• Youth friendly assessments
• Tell youth why they are being tested and how the test will be used
• Do not retest too soon
• Consider other assessments
• Remove the high-stake test pressure
QUESTIONSQUESTIONS
DLEG BWP – PI 05-41
DefinitionDefinition
of aof a
““Participant”Participant”
Required Required
DataData
to Recordto Record
ParticipantParticipant
CountsCounts
Services Services
ThatThat
CommenceCommence
ParticipationParticipation
Definition Definition
of anof an
““Exiter”Exiter”
ServicesServices
ThatThat
Extend theExtend the
Exit DateExit Date
ServicesServicesThat Do NotThat Do NotCommenceCommence
ParticipationParticipationoror
Extend ExitExtend Exit
QUESTIONSQUESTIONS
Performance MeasuresPerformance Measures
Adult Common MeasuresAdult Common Measures
Entered Employment Rate
Employment Retention Rate
Average Earnings
Programs CoveredPrograms Covered
WIA Adult
WIA Dislocated Worker
Trade Act
Wagner-Peyser
VETS
Entered Employment RateEntered Employment Rate
Definition: For those not employed at participation, the percentage employed in the 1st quarter after exit
Entered Employment RateEntered Employment Rate
• Calculation: Of those not employed at participation…
Number employed in 1st quarter after exit
Number who exit during the quarter
Highlights of Adult Entered Highlights of Adult Entered Employment RateEmployment Rate
Excludes Adults employed at participation
Employment at participation is based on information collected from the individual
Highlights of Adult Entered Highlights of Adult Entered Employment RateEmployment Rate
Those who received a notice of termination or the employer has filed a WARN or similar notice are considered not employed
Transitioning Service Members (expected to retire within 12 months) are considered not employed
Employment Retention RateEmployment Retention RateDefinition: For those employed in the 1st
quarter after exit, the percentage employed in the 2nd and 3rd quarter after exit
• Calculation: Of those employed in the first quarter after exit…
Number employed in the 2nd and 3rd quarter after exit
Number who exit during the quarter
Highlights of Adult Highlights of Adult Employment Retention RateEmployment Retention Rate
Includes all those employed in the 1st quarter after exit regardless of employment status at participation
Positive outcome requires employment in two post-exit quarters (does not have to be with the same employer)
PY 2006 Average EarningsPY 2006 Average Earnings
Definition: For those employed in the 1st, 2nd, and 3rd quarter after exit, average six-month earnings in the 2nd and 3rd quarter after exit
PY 2006 Average EarningsPY 2006 Average Earnings
• Calculation:
Of those employed in the 1st, 2nd and 3rd quarters after exit…
Earning from the 2nd and 3rd quarter after exit
Number who exit during the quarter
Highlights of Adult Average Highlights of Adult Average EarningsEarnings
Includes those employed in 1st, 2nd, and 3rd quarter after exit
Only allowable data source is wage records
Highlights of Adult Average Highlights of Adult Average EarningsEarnings
Those whose employment was determined based on supplemental data are excluded from the earnings measure
WIA programs will use the current Adult Earnings Change measure for PY 2005
QUESTIONSQUESTIONS
Youth Common MeasuresYouth Common Measures
• Placement in Employment or Education
• Attainment of Degree or Certificate
• Literacy/Numeracy Gains
Program CoveredProgram Covered
WIA Youth
Placement in Employment Placement in Employment or Educationor Education
Definition: Of those not in post-secondary education, employment, or the military at participation, the percentage in employment, the military or enrolled in post-secondary education and/or advance training/occupational skills training in the 1st quarter after exit.
Placement in Employment Placement in Employment or Educationor Education
Calculation: Of those not employed, in the military, or in post-secondary education at participation…
Number of youth employed, in the military, or enrolled in post-secondary education and/or advanced training or occupational skills training in the 1st quarter after exit
Number of exiters
Highlights of Youth Placement Highlights of Youth Placement in Employment or Educationin Employment or Education Excludes youth in employment, the
military, or post-secondary education at participation
Employment, military, and education status at participation is based on information collected from the individual
Employment and military status in the 1st quarter after exit is based on wage records (supplemental data allowed)
Highlights of Youth Highlights of Youth Placement in Employment or Placement in Employment or
EducationEducation Education status in the 1st quarter
after exit is based on administrative records
Youth in secondary school at exit are included, consistent with ETA’s vision to ensure youth successfully complete their secondary education
Defining Specific TermsDefining Specific Terms
Post-Secondary Education
A program at an accredited degree-granting institution
leading to an academic degree.
Defining Specific TermsDefining Specific Terms
Advanced
Training/Occupational
Skills Training
Attainment of Degree or Attainment of Degree or CertificateCertificate
Definition: Of those enrolled in education at or during participation, the percentage who attained a diploma, GED, or certificate by the end of the 3rd quarter after exit.
Attainment of Degree or Attainment of Degree or CertificateCertificate
• Calculation:
Of those enrolled in education at participation or any time during the program…
Number or youth who attained a diploma, GED, or certificate by the end of the 3rd quarter after exit
Number of exiters
Highlights of Youth Highlights of Youth Attainment of Degree or Attainment of Degree or
CertificateCertificateYouth in secondary school at
exit are included, which is consistent with ETA’s vision to
ensure youth successfully complete their secondary
education
Highlights of Youth Highlights of Youth Attainment of Degree or Attainment of Degree or
CertificateCertificate Diplomas, GEDs, or certificates can be
obtained during participation or at any point by the end of the 3rd quarter after exit
Work readiness certificates will not be accepted for this measure
Defining Specific TermsDefining Specific Terms
Education
Participation in secondary or post-secondary school, adult education programs, or any other organized
program of study leading to a degree or certificate
Defining Specific TermsDefining Specific Terms
Diploma
Any credential accepted by the State educational agency as equivalent to a HS diploma;
also includes post-secondary degrees
Defining Specific TermsDefining Specific Terms
Certificate
Awarded in recognition of an individual’s attainment of technical
or occupational skills.
Does not include work readiness certificates or certificates awarded by local boards.
Literacy/Numeracy GainsLiteracy/Numeracy Gains
Definition: Of those out-of-school youth who are basic skills deficient, the percentage who increase one or more education functioning levels within one year of participation.
Literacy/Numeracy GainsLiteracy/Numeracy Gains
Calculation:
Of those out-of-school youth who are basic skills deficient…
Number of Youth participants who increase one or more educational functioning levels
Number of youth who completed a year of participation (based on date of 1st youth service)
Number of youth who exit before completing a year of participation
Highlights of Literacy & Highlights of Literacy & Numeracy GainsNumeracy Gains
Only common measure that is not exit-based
Excludes in-school youth and out-of-school youth who are not basic skills deficient
Includes individuals with learning disabilities
Highlights of Literacy Highlights of Literacy /Numeracy Gains/Numeracy Gains
A positive outcome means the youth must advance one or more ABE or ESL functioning levels
Gains can occur in literacy or numeracyEducational levels are consistent with
Department of Education’s National Reporting System (NRS)
Reporting begins July 1, 2006
About the AssessmentsAbout the Assessments
The same standardized assessment
must be used for
pre- and post-testing
About the AssessmentsAbout the Assessments
If a youth continues to be basic skills deficient after the first 12 months of participation, they
should continue to receive training in literacy and/or numeracy skills
About the AssessmentsAbout the Assessments
All out-of-school youth must be assessed in
basic reading, writing, and
math
About the AssessmentsAbout the Assessments
Pre-testing must occur within 60 days of the first youth program
service; can use pre-test from up to six months prior to date of first
youth service
About the AssessmentsAbout the Assessments
Must use one of the assessment tools listed in Attachment C of
TEGL 17-05
About the AssessmentsAbout the Assessments
Youth should be post-tested by the end of one year of
participation and compared to pre-test results obtained during
the initial assessment
About the AssessmentsAbout the Assessments
Youth should be post-tested and included in the measure at the
completion of the 2nd year if they complete two years in the
program
Exclusions from Common Exclusions from Common MeasuresMeasures
A participant in any of the following categories, may be excluded– Institutionalized– Health/Medical or Family care– Deceased– Reserve Forces Called to Active Duty– Relocated to a Mandated Program– Invalid or Missing Social Security Number
WIA Program AccountabilityWIA Program Accountability
• MWAs will continue to be held accountable for all current (17) WIA performance measures
• WIA Adult performance measures will utilize the Adult Common Measures definitions
QUESTIONSQUESTIONS
VALUE ADDED PERFORMANCEIMPROVEMENT SYSTEM
V A P I SV A P I S
VAPISVAPIS• Provides adjusted performance data
for the State and local areas.
• Predicts local area performance.
• Provides data to support identification of local area strengths and weaknesses, leading to system improvements.
Programs IncludedPrograms Included
WIA Adult
WIA Dislocated Worker
Wagner-Peyser
Common MeasuresCommon Measures
Entered Employment Rate
Employment Retention Rate
Average Earnings
Quarterly VAPIS Report by Quarterly VAPIS Report by Program MeasureProgram Measure
• Actual and Adjusted performance results.
• Prediction of future performance results.
• Measure of Value Added by local area.
QUESTIONSQUESTIONS
Common TerminologyCommon Terminology
Participant = Enrollment = Registrant
Activity = Service = Transaction
Participant CountsParticipant Counts
For new participants inWagner-Peyser,
the system will create a new participant in WIA.
Participant CountsParticipant Counts
For new participants in WIA,
the system will create a new participant in Wagner-Peyser.
Participant CountsParticipant Counts
For new participants in Trade,
the system will create a new participant in Wager-Peyser and
WIA.
Wagner-Peyser ChangesWagner-Peyser Changes
The activity “Assigned to Case Management”
will now require amanual End Date entry.
Wagner-Peyser ChangesWagner-Peyser Changes
• Exit information will be available for User Input
• All records will now have an Exit Date
WIA ChangesWIA Changes
The pre-registration screen will be altered to capture
Employment Status, Education Status,
UI Claim Data and Migrant Worker
WIA ChangesWIA Changes
A new section for Youth Assessment data will be added
to the system
WIA ChangesWIA Changes
A temporary Exit Date will be added for User input
Estimated Activity End DatesEstimated Activity End Dates
All activities that have Manual End Dates will have the Estimated End
Date pre-filled by the system
ReportsReports
A new report will be created to list those individuals who are
approaching the 90-day Exit limit.
Conversion of DataConversion of Data
All WIA pre-registration, pending Trade and
Wagner-Peyser records that are 91-days old or more will
be Exited
Conversion of DataConversion of Data
All other records will be checked to determine if they
can be considered a concurrent participation
Conversion of DataConversion of Data
All records 90-days old or less will have a new display page
showing concurrent participation and other
information pertaining to when the record will be Exited
Open Record Display Open Record Display Information 1Information 1
Latest Reg. Latest Reg. Date:Date:
01/01/200601/01/2006 Has Has Activities:Activities:
YY Latest Act End Latest Act End Date:Date:
03/04/200603/04/2006
Wagner-Wagner-Peyser?:Peyser?:
YY WIAWIA YY TAA?TAA? NN
Latest Gap Latest Gap Date:Date:
06/07/200606/07/2006 Latest Latest Future Svc:Future Svc:
---------- When Exit Will When Exit Will Occur: Occur:
06/08/200606/08/2006
Open Record Display Open Record Display Information 2Information 2
Latest Reg. Latest Reg. Date:Date:
01/01/200601/01/2006 Has Has Activities:Activities:
YY Latest Act End Latest Act End Date:Date:
03/04/200603/04/2006
Wagner-Wagner-Peyser?:Peyser?:
YY WIAWIA YY TAA?TAA? NN
Latest Gap Latest Gap Date:Date:
Latest Latest Future Future Svc:Svc:
-------- When Exit Will When Exit Will Occur: Occur:
06/05/200606/05/2006
Open Record Display Open Record Display Information 3Information 3
Latest Reg. Latest Reg. Date:Date:
01/01/200601/01/2006 Has Has Activities:Activities:
YY Latest Act End Latest Act End Date:Date:
Wagner-Wagner-Peyser?:Peyser?:
YY WIAWIA YY TAA?TAA? NN
Latest Gap Latest Gap Date:Date:
Latest Latest Future Svc:Future Svc:
---------- When Exit Will When Exit Will Occur: Occur:
Exited Record Display Exited Record Display InformationInformation
Latest Reg. Latest Reg. Date:Date:
01/01/200601/01/2006 Has Has Activities:Activities:
YY Latest Act End Latest Act End Date:Date:
03/04/200603/04/2006
Wagner-Wagner-Peyser?:Peyser?:
YY WIAWIA YY TAA?TAA? NN
Latest Gap Latest Gap Date:Date:
Latest Latest Future Future Svc:Svc:
Exit Date: Exit Date: 03/04/200603/04/2006
Exit from the SystemExit from the System
The system will
now Exit all
Records
Exit from the SystemExit from the System
The Exit will occur 90-days after the latest Activity has Ended
and there are no GAPs or Future Services planned.
Exit from the SystemExit from the System
For concurrently enrolled
participants, all records will have
the same Exit Date.
Exit from the SystemExit from the System
For concurrently enrolled participants, if an Exclusionary Exit
reason is recorded in any of the programs, that reason will be used
for all of the programs.
QuestionsQuestions
www.michigan.gov/bwptrainingwww.michigan.gov/bwptraining
For More Information For More Information and Q & A’sand Q & A’sPlease VisitPlease Visit
www. Michigan.gov/b
wptraining
Common Common MeasuresMeasures
top related