cheryl gibbs beth macrae july 27, 2011 office of postsecondary education international and foreign...
TRANSCRIPT
Cheryl GibbsBeth MacRae
July 27, 2011
Office of Postsecondary EducationInternational and Foreign Language Education
Fellow Pre and Post Language Evaluation • The importance of the language evaluation• Results of feedback from Centers• Challenges and solutions• IRIS Enhancements
FLAS Tracking Survey• Why now?• What will the survey cover?• Challenges and concerns• FLAS tracking survey – tentative plan
Carry-Over Funds
Results of the language evaluations will show:• Effectiveness of the FLAS program• Future budget justifications
First year and still a learning process….
FLAS Language Advisory Group• Ray Clifford, Meg Malone & Scott McGinnis
Most Centers currently:
• Use instructors familiar with administering OPI or
ACTFL tests and/or trained as evaluators
• Use instructors of the target language
• Administer the tests through the Center
• Hold the student responsible for identifying the
evaluator
Same vs. different instructors?Same instructor = standardization of testing
Students and language evaluators forget about the post evaluation during the academic yearFLAS Coordinators send reminder one month prior
to final report due date
The test does not fit the clientelePotential future revisions
FLAS fellows tend to be less motivated to participate in the evaluation process after completing the study programCenters can require students sign an agreement
Limited English language skills of the instructor overseasAvailable domestic backup
Not all summer programs are completed by September 1 when reports are due
IFLE will change the date to October 1
Format is challenging because it only tests oral proficiency.IFLE will consider other evaluations in the future
Can IFLE provide the instructors with a standard rubric for determining the language markers? No, it would allow potential predetermination of the
student’s ability.
Can IFLE consider the option of offering a small stipend or compensation to the evaluators?Unfortunately, this is not an option at this time.
FLAS competition import
Guides and FLAS instructor business process document
Language evaluation results
FLAS instructors now have one account
The Congress believed –• That a mechanism for determining program
IMPACT was long overdue.
• All grantees shall administer a survey to determine— Post graduate employment Education Training
• That the federal INVESTMENT has been substantial.FY 2000 – 2002: $56,669,000FY 2003 – 2005: $84,193,000FY 2006 – 2009: $117,903,000
• That thousands of fellows have been trained.FY 2000 – 2002: 4,696FY 2003 – 2005: 6,037FY 2006 – 2009: 8,210
• And that the INTEGRITY and VALUE of the program could best be validated after students had graduated from their area studies and language training programs.
The FLAS tracking survey will solicit the following:1. FLAS Recipient (Alum) Information
• Gender• Age• Race/ethnicity• Citizenship• Location (state, country)
2. Postgraduate employment, education, & training• Employment status• Sector• Year (first) degree with FLAS support is obtained• Additional degree(s) or training obtained & when
3. Foreign language and area studies training• Relevance of area studies training to job
requirements and responsibilities• Frequency for using/applying language skills and
area studies expertise• Usefulness of language and area studies training
These are examples of data elements. The goal is to construct questions that will collect data that can be compared to other national data sets to demonstrate the difference in outcomes between FLAS fellows and non FLAS fellows.
1. Updated email addresses2. Centers’ access to data3. Privacy issues4. Center specific questions5. Security concerns, Survey Monkey vs. Qualtrix6. Alternate format besides email7. ED vs. Center administered survey and effect on
response rate8. IRIS capabilities for administering the survey
1. Select FLAS Tracking Advisory Committee2. Convene FLAS Tracking Advisory Committee3. Send survey to Centers for final comment4. Submit survey for approval5. Request updated email addresses 6. Survey first cohort: AY 2010 and Summer 2011 7. Publish data on program outcomes8. Provide data to Centers
Academic Year to Summer
Summer to next Academic Year with approval from program officer• Only after attempting to use and share summer
funds• Email request must be approved by program
officer
Thank You!