casas etest pdf

49
CASAS eTesting: Myths to Avoid, Truths to Tell Aven Magana, Data Manager Liz Ambra, Assessment Coordinator Mike Hathaway, Casas Certified Technology Trainer

Upload: mike-hathaway

Post on 07-Aug-2015

85 views

Category:

Education


0 download

TRANSCRIPT

CASAS eTesting:Myths to Avoid, Truths to Tell

Aven Magana, Data Manager Liz Ambra, Assessment Coordinator Mike Hathaway, Casas Certified Technology Trainer

MythA traditional or legendary story, usually concerning some being or hero or event, with or without a determinable basis of fact or a natural explanation

TruthA fact or belief that is accepted as true

ESL students lack computer skills

Myth

Students interact with technology every day. We simply need to connect the dots

Truth

Resources to conduct eTesting are too costly

Myth

All forms of testing have costs. Staff savings can easily pay for computer labs

Truth

Before eTest 08-09 $21,120 After eTest 13-14 $927 Savings $20,193

Truth

Casas eTesting results are not accurate enough for placement

Myth

After placing 465 students only 16 (3.4%) changed levels

Truth

It is impossible to handle testing for a large number of students

Myth

It absolutely is possible. ACE tested and placed 465 students in 12 hours

Truth

Test security is compromised if you are eTesting

Myth

Do you know exactly where every test booklet is?• All proctors are trained • 1-2 proctors per testing room • Proctors start each student’s

testing session with personal id number

Truth

Only ESL teachers can properly evaluate and place students

Myth

Trained staff, using eTest scores, can effectively place students

Truth

Instructors are teaching the proper levels. The test is wrong

Myth

• Curriculum is now aligned • All classes are using the same

books • Teachers are projecting iPads and

laptops in class

Consequently, duplicating costs dropped from $19,786 to $6,545 a savings of $13,241

Truth

Student process

Student pre-registers for eTest

Student arrives on campus

Student fills in eTest demo-graphics form

ESL eTest Registration Form(ID#)

First Name

Middle Name

Last Name

Zip Code

Gender Male Female

Date of Birth Month Day Year

Highest Level of Education (Circle One)

No Formal Education 1 2 3

4 5 6 7 8 9

10 11 12 13 14 15

16 17 18 19 or more

Highest Diploma / Degree Earned (Circle One)

None GED Certificate High School Diploma

Technical / Certificate A.A. / A.S. Degree 4 yr. College Graduate

Graduate Studies Other Diploma / Degree

Native Language (Circle One)

English Spanish Vietnamese

Chinese Hmong Cambodian

Tagalog Korean Lao

Russian Farsi Other

Ethnicity (Circle One) Hispanic or Latino Not Hispanic or Latino

Race (Circle One)

White Asian Black or African American

Filipino Alaska Native American Indian

Native Hawaiian / Pacific Islander

You Must Bring This Form With You On Testing Day

ESL eTest Registration Form(ID#)

Program Info (Circle One)

Basic Skills (ABE) ESL ESL / Citizenship

Citizenship High School Diploma HSE

Parent Education Career / Tech Ed Workforce Readiness

Personal Status (Circle all that Apply)

TANFTemporary Assistance for Needy

Families

Other Public Assistance WIA IBWorkforce Investment Act Adult

Program

Rehabilitation Enrolled in high school/K12 Dislocated Worker

Veteran Physically Disabled Learning Disabled

Displaced Homemaker Single Parent None

Labor Force Status

Employed Unemployed Not Employed / Not seeking work

Retired

Primary Goal

Improve basic skills Improve English skills H.S. Diploma / GED Get a job

Retain job Enter college or training Work-based project Family goal

U.S. Citizenship Military Personal goal Other

Secondary Goal Goal

Improve basic skills Improve English skills H.S. Diploma / GED Get a job

Retain job Enter college or training Work-based project Family goal

U.S. Citizenship Military Personal goal Other Attainable Goal

None

Office Use Only (do not fill in)

Listening Test Score Reading Test Score Course Code

Course Title

Registered By

You Must Bring This Form With You On Testing Day

132567898

Student data is entered from demographic form

Student takes locator and placement eTest

Student score is written on form by proctor

ESL eTest Registration Form(ID#)

Program Info (Circle One)

Basic Skills (ABE) ESL ESL / Citizenship

Citizenship High School Diploma HSE

Parent Education Career / Tech Ed Workforce Readiness

Personal Status (Circle all that Apply)

TANFTemporary Assistance for Needy

Families

Other Public Assistance WIA IBWorkforce Investment Act Adult

Program

Rehabilitation Enrolled in high school/K12 Dislocated Worker

Veteran Physically Disabled Learning Disabled

Displaced Homemaker Single Parent None

Labor Force Status

Employed Unemployed Not Employed / Not seeking work

Retired

Primary Goal

Improve basic skills Improve English skills H.S. Diploma / GED Get a job

Retain job Enter college or training Work-based project Family goal

U.S. Citizenship Military Personal goal Other

Secondary Goal Goal

Improve basic skills Improve English skills H.S. Diploma / GED Get a job

Retain job Enter college or training Work-based project Family goal

U.S. Citizenship Military Personal goal Other Attainable Goal

None

Office Use Only (do not fill in)

Listening Test Score Reading Test Score Course Code

Course Title

Registered By

You Must Bring This Form With You On Testing Day

196

Student is placed into class using eTest score & skill level descriptors

ESL eTest Registration Form(ID#)

Program Info (Circle One)

Basic Skills (ABE) ESL ESL / Citizenship

Citizenship High School Diploma HSE

Parent Education Career / Tech Ed Workforce Readiness

Personal Status (Circle all that Apply)

TANFTemporary Assistance for Needy

Families

Other Public Assistance WIA IBWorkforce Investment Act Adult

Program

Rehabilitation Enrolled in high school/K12 Dislocated Worker

Veteran Physically Disabled Learning Disabled

Displaced Homemaker Single Parent None

Labor Force Status

Employed Unemployed Not Employed / Not seeking work

Retired

Primary Goal

Improve basic skills Improve English skills H.S. Diploma / GED Get a job

Retain job Enter college or training Work-based project Family goal

U.S. Citizenship Military Personal goal Other

Secondary Goal Goal

Improve basic skills Improve English skills H.S. Diploma / GED Get a job

Retain job Enter college or training Work-based project Family goal

U.S. Citizenship Military Personal goal Other Attainable Goal

None

Office Use Only (do not fill in)

Listening Test Score Reading Test Score Course Code

Course Title

Registered By

You Must Bring This Form With You On Testing Day

196 130567Beg Low Thursday PM

Robbie Hansen

How we got here

This all started because• California State Budget Cuts

• Most staff members were excluded from process

• Testing was inefficient & expensive

• Students were not progressing

• Data was not used

A school-wide student needs-assessment was performed

We found students needed• Electronic testing • Aligned curriculum • Switch from 4 to 2 day course • Aligned calendar • Focus on listening skills

How we manage it

Know your technology prior to test dayA little knowledge avoids a lot of panic

Know your hardwareStaff Competency vs Training

Computer Setup

Headphones

Silverlight Hardware Compatibility (No Chrome Books, iPads)

Know your testing plan

• Labs available for testing

• Course and staff setup

• Modality

• Testing series

• Testing time frames

Know your student capacity• Budget determines number of

sections offered

• Returning students determine which sections are offered

• Test to fill section at the start

• Test to fill gaps throughout year

• Attendance data determines test size

Know your staff

• Assign staff based on personal strengths

• Translators available

Lessons Learned

We learned from the moment they arrive until they are placed in a class, every movement must be planned• Mapped campus

• Assign staff members to different areas

• Clearly mark rooms and steps

• Staff actively assists keeping it all moving

• Stations Monitor

We learned charging fees increases participation

• Fees = Follow Through

• Processing 3 students for every 1 that actually tested

We learned to evaluate and adjust process after every test

We learned data needs to determine actions

• No student import

• Student id’s key to consistent data entry and tracking

• Bubble form vs current form

• School data team

We learned paper before computer

• One form follows student

• Staff registers students into class after e-Test day using demographics form

Which led to

• Increased instructor “buy in”

• Increased revenue

• Increased student engagement

We increased our persistence rate2009 2013

Beg Low 36% 90%

Beg High 56% 84%

Int Low 65% 93%

Int High 50% 89%

Adv Low 38% 86%

We increased learning gains2009 2013

Beg Low 29% 66%

Beg High 48% 53%

Int Low 41% 59%

Int High 29% 39%

We continue to “fine tune” our process

Now you have our tools

!Go For It

`