casas presentation
TRANSCRIPT
8/2/2019 CASAS Presentation
http://slidepdf.com/reader/full/casas-presentation 1/11
Comprehensive Adult Student
Assessment System (CASAS)Life & Work Series
Reading & Listening
Floyd, Kurdi, & Modica
8/2/2019 CASAS Presentation
http://slidepdf.com/reader/full/casas-presentation 2/11
Description: Test Purpose● Standardized - Criterion-Referenced - Discrete-Point -
Formative & Summative - Objective - Indirect -● Can be used as: Placement - Progress - Achievement Test
● Test-Takers Include:
● Assesses:○ Reading & Listening Skills
● Uses:○ For teachers/administrators to identify the literacy needs pre-
and post-instruction of learners.○ Monitoring the student progress throughout literacy levels.○ Can be used for course placement into a specific level or
baseline for benchmarking
English as a Second Language Adult Basic Education
English Language Learners Adult Secondary Education
Vocational ESL General Education Development
8/2/2019 CASAS Presentation
http://slidepdf.com/reader/full/casas-presentation 3/11
Description: Test Content
● CASAS assessments consist of a pre-test, course
instruction and post-test● No strict timing, but about an hour for each assessment● Test can be paper/pencil or computer based● Selected response items are multiple choice
● On Reading tests, test takers read short passages, graphs,maps, charts, signs, pictures etc. and answer multiplechoice questions
● On Listening tests, test takers listen to a short dialogue or discussion and might see multiple pictures that corresdpond
to multiple choice answers
8/2/2019 CASAS Presentation
http://slidepdf.com/reader/full/casas-presentation 4/11
Description: Scoring/Rating Procedure● How is the test scored?
○ eTests are scored via computer
○ Paper-and-pencil tests scored manually ● What rating procedure takes place?
○ The number of correct items is converted to a scaled score whichdetermines placement.
● Reporting/Interpreting results:○ Teachers/administrators have the option to use TOPSpro assessment
software that tracks student progress over the course and throughouttheir level progression.
○ Item tasks assess certain competency abilities and there is a scoringrubric that shows strengths and weaknesses of these competencies of
the learner.○ With eTests, immediate feedback to learner and teacher/administrator
is given pertaining to level and/or placement. Manual scoringimmediate for T/A, & they report results to student.
8/2/2019 CASAS Presentation
http://slidepdf.com/reader/full/casas-presentation 5/11
Life & Work Reading Form 83-obtained from Olsen, 2011
8/2/2019 CASAS Presentation
http://slidepdf.com/reader/full/casas-presentation 6/11
Evaluation: Reliability Evidence
● Test administration reliability
● Parallel forms reliability
● Internal consistency reliability (KR-20)
8/2/2019 CASAS Presentation
http://slidepdf.com/reader/full/casas-presentation 7/11
Descriptive statistics for each series are presented—Reading Life Skills
Descriptive Statistics for the Life Skills Reading SeriesNote: These numbers were run based on data from 1996 through 2000.
The initial item analyses were run for all items with sample sizes larger than 300
Form # N# of Items
Mean RawScore
StandardDeviation
MeanP-Value
Mean PointBiserial KR-20
27 18,369 30 23.38 6.93 .779 .850 .931
28 12,264 30 24.51 6.28 .817 .875 .925
31 28,996 24 16.96 6.20 .706 .598 .919
32 17,259 24 15.23 6.49 .635 .594 .918
32X 2,447 27 15.84 6.86 .587 .534 .902
33 29,500 32 18.68 8.04 .584 .535 .918
34 27,673 32 19.78 7.70 .618 .519 .911
34 X 27,721 35 22.22 7.05 .635 .614 .885
35 27,605 38 20.93 8.11 .551 .458 .897
36 21,101 38 21.05 7.74 .554 .441 .886
37 7,363 40 17.22 9.06 .431 .466 .908
38 4,876 40 18.52 9.19 .463 .474 .912
8/2/2019 CASAS Presentation
http://slidepdf.com/reader/full/casas-presentation 8/11
Form # N# of
Items
RawScoreMean
StandardDeviation
Mean P-Value
MeanPoint
Biserial KR-20
51 8,915 34 19.99 8.80 .588 .544 .927
52 5,716 34 20.78 8.16 .611 .519 .916
53 5,655 30 16.69 7.26 .556 .501 .896
54 4,324 30 16.44 6.66 .548 .458 .870
55 3,273 25 13.18 5.76 .527 .474 .855
56 2,616 25 13.68 5.52 .547 .453 .838
Note: The 51L and 52L tests appear in both the ECS and Life Skills series *Note: These numbers were run based on data from 1996 through 2000. Initial item analyses were run for all items with samplesizes larger than 300
Descriptive statistics for each series arepresented--
Listening Life Skills
8/2/2019 CASAS Presentation
http://slidepdf.com/reader/full/casas-presentation 9/11
Evaluation: Validity Evidence
● Criterion-related validity
● Construct validity
● Content-related validity
8/2/2019 CASAS Presentation
http://slidepdf.com/reader/full/casas-presentation 10/11
Critique
● All discuss our critiques
8/2/2019 CASAS Presentation
http://slidepdf.com/reader/full/casas-presentation 11/11
Sample Test Item: LWS Reading Skills