Increase the Reliability of the Administration of the MI-Access P/SI Assessments

Angela DalhoeMichigan Department of Education

Assessment for Students with Disabilities Program

Today’s Focus

Help those charged with training Primary Assessment Administrators (PAAs) and Shadow Assessment Administrators (SAAs) learn ways to effectively conduct training for the administration of the Participation and Supported Independence Assessments.

Tools to Assist in Training

Coordinator and Assessment Administrator Manual (CAAM)

Online Learning

Released Items

Item Analysis

EGLCEs and EHSCEs

2007/2008 CAAM Manual

The manual is located online at www.michigan.gov/mi-access

You may want to include portions of the manual in your group or individual training. Picture Card Presentation P/SI Rubric

Picture Card Presentation

Correct presentation of picture cards will assist in obtaining valid results on P/SI Selected Response Items.

An explanation of picture card presentation is provided in the CAAM in Appendix D (a copy is in your binder)

Selecting 1 Word from a Set of 4

Presented with all 4 words visually accessible at one time

Student can select correct word OR Assessed using a “yes/no” response by

presenting each word beginning with an unrelated and moving to a related

Selecting 2 Words from a Set of 4

Presented with all 4 words visually accessible at one time.

Student can select correct words

Selecting 2 Words from a Set of 4

Assessed using a “yes/no” response

Presenting 2 sets of 2 words (one related and one unrelated in each set).

Selecting 3 Words from a Set of 6

Presented with all 6 words visually accessible at one time

Assessed using a “yes/no” response by presenting 3 sets of 2 words (one related and one unrelated in each set).

Scoring Rubric

Knowledge of the scoring rubric is very important for increasing the reliability of the P/SI Assessments. The PAA and SAA work together prior to the

assessment to determine the student’s anticipated response mode.

The PAA and the SAA score the student simultaneously and independently.

Flow Charts for P and SI are located in Appendix E and F in the CAAM (a copy is available in your binder).

Scoring Rubric- Participation

Score Point Definition

3Responds correctly with no assessmentadministrator assistance

2Responds correctly after assessment administrator provides verbal/physical cues

1Responds correctly after assessment administrator provides modeling, short of hand-over-hand assistance

Condition Codes - All condition codes result in no points.A Incorrect responseB Resists/refusesC Assessment administrator provides hand-over-hand assistance

and/or step-by-step directions

Scoring Rubric – Supported Independence

Score Point Definition

2Responds correctly with no assessment administrator assistance

1Responds correctly after assessment administrator provides verbal/physical cues

Condition Codes - All condition codes result in no points.A Incorrect responseB Resists/refusesC Assessment administrator provides hand-over-hand assistance

and/or step-by-step directions

Online Learning

The MI-Access Participation and Supported Independence Scoring Rubrics Online Learning is located at www.mighigan.gov/mi-access under the Professional Development Opportunities section. The online learning is still labeled “pilot” There are 7 modules

Released Items

Released items are useful for PAA and SAA to discuss item formats and practice item administration.

Released item booklets are available online. There is a booklet for each population and

subject and at each level: FI – Grades 3,4,5,6,7,8, and 11 P/SI – Grades 3-5, 6-8, 11

Item Analysis

Item analysis documents allow the PAA and the SAA to observe how released items were scored by both assessment administrators.

Can be used at a district and/or building level to discuss issues of consistency. Differences in item format Differences in standards/strands

EGLCEs and EHSCEs

Becoming familiar with the EGLCEs and EHSCEs will make the PAA and the SAA more likely to consistently recognize the scoring focus when they observe a student and score an assessment item.

www.michigan.gov/mi-access Updated documents are posted on at this site and

available for download

Select EGLCEs or EHSCEs

Questions?