welcome to salt lake city icesa’s 64th annual conference september 2000 wia & wris:...

Welcome to Salt Lake City

ICESA’s 64th Annual ConferenceSeptember 2000

WIA & WRIS:Florida’s Experienceto date...

Presentation Topics

Brief FETPIP Overview

W.I.A. Customer Types & Categories

W.I.A. Performance Measures

Florida’s Negotiated Goals & Results to date

Timing of Florida UI data availability & reports

W.R.I.S. Usage & Results

Review of electronic resources on CD

Florida Education & Training Placement Florida Education & Training Placement Information Program (F.E.T.P.I.P)Information Program (F.E.T.P.I.P)

Florida Education & Training Placement Florida Education & Training Placement Information Program (F.E.T.P.I.P)Information Program (F.E.T.P.I.P)

Is an interagency data Is an interagency data consumer reporting consumer reporting system, administered system, administered through the State through the State Department of EducationDepartment of Education

It was designed & It was designed & developed to follow-up all developed to follow-up all participants from Florida’s participants from Florida’s education and vocational education and vocational training programstraining programs

Cooperating AgenciesCooperating AgenciesCooperating AgenciesCooperating AgenciesU.S. Govt. Agencies Postal Service Dept. of Defense Office of

Personnel Mgt.

Florida State Depts. of Education Labor Corrections Families & Children Management Services Board of Regents

Data Items Data Items CollectedCollected

Employment Industry, Occupation, Florida Earnings Federal Employment, Military Service

Florida Postsecondary Education School,College, or University w/program

Public Assistance in Florida TANF, Foodstamps

Corrections Incarcerations, Releases

FETPIP RECORD MATCHING FETPIP RECORD MATCHING

Quarterly record matches with Florida’s Quarterly record matches with Florida’s Wage Records for the W.I.A., Welfare Wage Records for the W.I.A., Welfare Reform, Dept.’s of Corrections, Children Reform, Dept.’s of Corrections, Children & Families, Blind Services, Voc.Rehab, & Families, Blind Services, Voc.Rehab, others…others…

Annual record linkages with 11 external Annual record linkages with 11 external automated databases performed automated databases performed annually for 300+ different follow-up annually for 300+ different follow-up files.files.

MAJOR USES OF FETPIP DATAMAJOR USES OF FETPIP DATA

Placement & AccountabilityPlacement & Accountability Community College Performance Budgeting & Community College Performance Budgeting &

AccountabilityAccountability Occupational Forecasting ConferenceOccupational Forecasting Conference Performance Based Program Budgeting Performance Based Program Budgeting Federal Vocational ReportingFederal Vocational Reporting University System Program ReviewsUniversity System Program Reviews Corrections Performance Based FundingCorrections Performance Based Funding Return on Investment & Program Audit ReviewsReturn on Investment & Program Audit Reviews Career Counseling and Guidance InformationCareer Counseling and Guidance Information

W.I.A. Performance MeasuresW.I.A. Performance Measures

Internet & Electronic Internet & Electronic MediaMedia

Articulation ReportsArticulation Reports OIS ScreensOIS Screens Ad Hoc ReportsAd Hoc Reports PresentationsPresentations

Dissemination of DataDissemination of DataDissemination of DataDissemination of Data

Annual PublicationsAnnual Publications Performance & Performance &

Accountability Accountability ReportsReports

Employer Opinion Employer Opinion SurveySurvey

Federal Performance Initiatives

• WIA requires, and Perkins III urges use of wage and administrative records.

WIA Customer Groups

• Adults

• Youths 19-21 years old

• Dislocated Workers

• Youths 14-18 years old

Adults

• All “exiters” aged 18 or more who received core services, intensive services or training services funded by adult programs

• Excludes those who receive services that are self-service or informational

Dislocated Workers

• All “exiters” who received core services, intensive services or training services funded by the dislocated worker program

• Excludes those who receive services that are self-service or informational

Youths 19-21 Years Old

• Exiters aged 19 or more on the last service date

• Received Services from the youth program

Youths 14-18 Years Old

• Were between the ages of 14 to 18 on their registration date

• Received services from the youth program

WIA Core Indicators• 1 Adult Entered Employment Rate• 2. Adult Employment Retention Rate at 6 months• 3. Adult Average Earnings Change in 6 months• 4. Adult Employment & Credential Rate• 5. Dislocated Worker Entered Employment Rate• 6. Dislocated Worker Employment Retention Rate• 7. Dislocated Worker Earnings Replacement Rate• 8. Dislocated Worker Employment & Credential Rate• 9. Older Youth (19-21) Entered Employment Rate• 10. Older Youth (19-21) Employment Retention Rate• 11. Older Youth (19-21) Average Earnings Change• 12. Older Youth (19-21) Credential Rate

Note: Indicators in black are determinable from UI records, those listed in italics are not or not entirely....

WIA Core Indicators cont’d

• 13. Younger Youth (14-18) Skill Attainment Rate• 14. Younger Youth Diploma or Equivalent Attainment• 15. Younger Youth Retention Rate• 16. Participant Satisfaction• 17. Employer Satisfaction

Entered Employment Rate (Adults and Dislocated Workers only)

Of those who are not employed at registration:

Number of customers who have entered employment by the end of the 1st quarter after exit

the number of individuals who exit during the quarter

*Employment at registration is based on information collected from the registrant, not on UI wage records.

**Dislocated Workers are unemployed by definition; therefore, all are included.

Employment Retention at 6 months(Adults and Dislocated Workers only)

Of those who are employed in the 1st quarter after exit:

Number of individuals who are employed in third quarter after exit

number of adults who exit during the quarter

* Employment in the 1st and 3rd quarters following exit does not have to be with the same employer

Average Earnings Change in 6 months(Adults only)

Of those who are employed in the first quarter after exit:

Total post-program earnings (earnings in quarter 2 + quarter 3 after exit) minus pre-program earnings (earnings in quarter 2 + quarter 3 prior to registration)

Number of individuals who exit during the quarter

* UI wage records will be the only data source for this measure. Individuals with pre or post-program supplementary employment data should be excluded.

Earnings Replacement Rate(Dislocated Workers only)

Of those who are employed in the 1st quarter after exit:

Total post-program earnings (earnings in quarter 2 + quarter 3 after exit)

Pre-dislocation earnings

(earnings in quarter 2 + quarter 3 prior to dislocation)

* UI wage records will be the only data source for this measure.

** If there is no date of dislocation or if the date of dislocation is after registration, use the 2nd & 3rd quarters prior to registration.

Employment and Credential Rate(Adults and dislocated workers only)

Of individuals who received training services:

Number of individuals who were employed in the 1st quarter after exit and received a credential by the end of the 3rd quarter after exit

Number of individuals who exited services during the quarter

* Credentials can be obtained while a person is still participating in services and up to 3 quarters following exit.

Older Youth Entered Employment Rate

Of those who are not employed at registration AND who are not enrolled in post-secondary or advanced training in the 1st quarter after exit:

Number of older youth who have entered employment by the end of the 1st quarter after exit

Number of older youth who exit during the quarter

* Employment at registration is based on information collected from the registrant, not on UI wage records

** Individuals in both employment and post-secondary or advanced training in the first quarter after exit will be included in the denominator

Older Youth Employment Retention

Of those who are employed in the 1st quarter after exit and who are not enrolled in post-secondary education or advanced training in the 3rd quarter after exit:

Number of older youth who are employed in the third quarter after exit


* Employment in the 1st and 3rd quarters following exit does not have to be with the same employer

Older Youth Average Earnings Change

Of those who are employed in the 1st quarter after exit and who are not enrolled in post-secondary education or advanced training in the third quarter after exit:

Total post-program earnings (earnings in quarter 2 + quarter 3 after exit) minus pre-program earnings (earnings in quarter 2 + quarter 3 prior to registration)

number of individuals who exit during the quarter

* UI wage records will be the only data source for this measure. Individuals with pre or post-program supplementary employment data should be excluded.

Older Youth Credential Rate

Number of older youth who are in employment, post-secondary education, or advanced training in the 1st quarter after exit and received a credential by the end of the third quarter after exit


* All older youth exiters will be included in this measure

** Credentials can be obtained while a person is still participating in services.

Younger Youth Skill Attainment Rate

Of all in-school and any out-of-school youth assessed to be in need of basic skills, work readiness skills, and/or occupational skills:

Total number of basic skills goals attained by younger youth plus the number of work readiness skills goals attained by younger youth plus the number of occupational skills goals attained by younger youth

The total number of basic skills goals + the number of work readiness skills goals + the number of occupational skills goals set.

*All youth must have a minimum of one goal set per year and a maximum of three goals per year.

Younger Youth Diploma or Equivalent Attainment

Of those who register without a diploma or equivalent:

Number of younger youth who attained secondary school diploma or equivalent by the end of the 1st quarter after exit

Number of younger youth who exit during the quarter

(except those still in secondary school at exit)

Younger Youth Retention Rate

Number of younger youth found in one of the following categories in the third quarter following exit:

- post secondary education

- advanced training

- employment

- military service

- qualified apprenticeships

divided by:

the number of younger youth who exit during the quarter (except those still in secondary school at exit)

Participant Satisfaction

• The weighted average of participant ratings on each of the three questions regarding overall satisfaction are reported on a 0 - 100 point scale. The score is a weighted average, not a percentage.

• 500 completed participant surveys must be obtained each year for calculation of the indicator.

• Responses are obtained using a uniform telephone methodology.

• Participants should be contacted within 60 days of the exit date or the date that an exit has been determined.

Participant Satisfaction Questions

• Utilizing a scale of 1 to 10, where “1” means “Very Dissatisfied” and “10” means “Very Satisfied,” What is your overall satisfaction with the services provided?

• Considering all of the expectations you may have had about the services, to what extent have the services met your expectations? “1” now means “Falls Short of Your Expectations” and “10” means “Exceeds Your Expectations.”

• Now think of the ideal program for people in your circumstance. How well do you think the services you received compare with the ideal set of services? “1” now means “Not very Close to the Ideal” and “10” means “Very Close to the Ideal.”

Employer Satisfaction• The weighted average of employer ratings on each of the

three questions regarding overall satisfaction are reported on a 0 - 100 point scale. The score is a weighted average, not a percentage.

• 500 completed participant surveys must be obtained each year for calculation of the indicator.

• Responses are obtained using a uniform telephone methodology.

• Employers should be contacted within 60 days of the completion of service or 30-60 days after a job order has been listed where no referrals have been made.

Employer Satisfaction Questions

• Utilizing a scale of 1 to 10, where “1” means “Very Dissatisfied” and “10” means “Very Satisfied,” What is your overall satisfaction with the service(s) provided?

• Considering all of the expectations you may have had about the services, to what extent have the service(s) met your expectations? “1” now means “Falls Short of Your Expectations” and “10” means “Exceeds Your Expectations.”

• Now think of the ideal service(s) for people in your circumstance. How well do you think the service(s) you received compare with the ideal set of service(s)? “1” now means “Not very Close to the Ideal” and “10” means “Very Close to the Ideal.”

Negotiated vs Actual Florida Performance Levels (984,991,992)

Adults

Negotiated Actual

• Entered Employment Rate 64.3% 65.94%

• Retention rate 78.11% 80.54%

• Earnings Gain $3,755 $4,367

• Employment & Cred. Rate 40.0% ---


Dislocated Workers

Negotiated Actual

• Entered Employment Rate 60% 73.15%

• Retention Rate 75% 84.71%

• Earnings Replacement 80% 169.59%

• Employment & Cred. Rate 35% ---


Youth 19-21

Negotiated Actual

• Entered Employment Rate 65.63% 68.11%

• Retention Rate 75.00% 80.32%

• Earnings Gain $3,452 $3,916

• Credential Rate 15.00% ---

Youth 14-18 Years Old Negotiated Florida Performance Levels

• Skill Attainment Rate = 65%

• Diploma or Equivalent Rate = 20%

• Retention Rate = 5%

Florida UI Data Availability

UI Qtr to be Matched UI File Available

Jan – Mar 1999 1st week of Aug 1999

Apr – Jun 1999 1st week of Nov 1999

Jul – Sep 1999 1st week of Feb 2000

Oct – Dec 1999 1st week of May 2000

Jan – Mar 2000 1st week of Aug 2000

Apr – Jun 2000 1st week of Nov 2000

Florida WIA “File Types”

• New participant files for obtaining pre- registration UI quarters (batched by reg. Qtr)

• Participant Exit Files- used for record linkages

• Outcome files with pre-registration UI qtrs & post program UI quarters per “Exit” quarter

“Exit” identification strategies...

Hard Exits vs. Soft Exits

Hard Exit - a participant who has a date of case closure, completion or known exit from WIA-funded or non-WIA funded partner service within the quarter.

Soft Exit - a participant who does not receive any WIA-funded or non-WIA funded partner service for 90 days and is not scheduled for future services except follow-up services. By default, the last date of service is the exit date.

Florida’s Schedule for 1st “True” WIA QTRExit File Delivery, Match Schedule and Reports

for 1st Quarter PY99 of WIA

Exit Quarter Jul –Sep 99

Measure Oct – Dec 99Post Program Quarter 1

UI Available May-00

Measure Jan – Mar00

Post Program Quarter 2

UI Available Aug-00

Measure Apr – Jun00

Post Program Quarter 3

UI Available Nov-00

Interim Entered EmploymentRate Report

Jun 15, 2000

Final Data Reports Dec 15, 2000

Suggestions...

• “Clean up” prior records before transition or as soon as possible…• Have WIA performance measure baseline data on former JTPA

participants for regional and statewide users, know where you are at when setting goals and prior to negotiations…

• Implement System design changes as soon as possible with proper training...

•

• Hard Exits & Soft Exits

• Develop new means and systems for capturing educational enrollments and credentials following services...!• Develop reports from WIA client systems for

timelier information for management- WIA measurement occurs s l o w l y…

• Use client system reports for monitoring reporting quality and “reasonableness”, spotting & reporting data anomolies early, building incentives for on-time, right the first time reporting.

1. Escarosa2. Oklaloosa, Walton3. Chipola4. Gulf Coast5. Big Bend6. North Florida7. Florida Crown8. First Crown9. Alachua, Bradford10. Citrus, Levy, Marion11. Flagler, Volusia12. Central Florida13. Brevard14. Pinellas15. Hillsborough16. Pasco-Hernando17. Polk18. Suncoast19. Heartland20. Indian River, Martin, St. Lucie, Okeechobee21. Palm Beach22. Broward23. Dade, Monroe24. Charlotte, Collier, Glades, Hendry, Lee

LEGEND:+ Meeting negotiated performance+ Not meeting negotiated performance

Florida Workforce Development Regions

Entered Employment Performance MeasureBased on 1998-4th , 1999-1st & 1999 –2nd quarter Exiters

Dislocated Workers

Adult

Older Youth

StatewideActual Performances: 65.94%Negotiated Performances: 64.30%



*The State of Florida is currently exceeding Negotiated Entered Employment Performance for all Customer Groups


Florida Workforce Development RegionsRetention Performance Measure

Based on 1998-4th , 1999-1st & 1999 –2nd quarter Exiters

Older Youth


Dislocated Workers

Adult




*The State of Florida is currently exceeding Negotiated Entered Employment Performance for all Customer Groups

Florida Workforce Development RegionsEarnings Performance Measure

Based on 1998-4th , 1999-1st & 1999 –2nd quarter Exiters


*The State of Florida is currently exceeding Negotiated Retention Performance for all Customer Groups

StatewideActual Performance: $4,367Negotiated Performances: $3,755


StatewideActual Performances: $3,916Negotiated Performances: $3,452

Adult

Dislocated Workers

Older Youth



other various state level WIA contacts ...

• Florida: Mike Switzer - (850) 922-9047

Antonio Carter - (850) 487-0900

• Indiana: Nina Babich - (317) 232-7381

• Kentucky: William Gaunce - (502) 564-5360

• Nevada: Liv Jones - (702) 486-6511 Val Hopkins - (775) 684-4076

• Oklahoma: Glen Roberts - (405) 557-5329

• Pennsylvania: Mary Ann Regan (717) 787-3266

• Tennessee: Carol Groppel - (615) 253-1330

• Texas: Robert Milne - (512) 936-3300 Shu-Ching Chen - (512) 936-3300

• Utah: Rick Little - (801) 526-9719

• Vermont: Ted Kinerson - (802) 828-4166

Visit our homepage at...

www.firn.edu/doe/fetpip/fetpip/fmain.htm Duane Whitfield 325 W. Gaines St Rm 844 Tallahassee, Fl 32303-0400 (850) 487-0900 [email protected]

welcome to salt lake city icesa’s 64th annual conference september 2000 wia & wris:...

Documents

training services

core services

intensive services

blind services

employment rate2

employment rate6

entered employment rate10

performance measuresfloridas