interim assessments office of superintendent of public instruction 1
DESCRIPTION
Interim Assessment Blocks (IABs) Focus on smaller sets of targets Provide more detailed information for instructional purposes. Currently available only as fixed forms Yield overall more specific information for each block/target set. 9/29/2015 OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION 3TRANSCRIPT
Interim Assessments
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
1
Interim Comprehensive Assessments (ICAs)
•Include the same item types and formats, including performance tasks, as the summative assessments
•Use the same blueprints as the summative assessments and assess the same standards.
•Yield results on the same vertical scale yield overall scale scores, overall performance level designations, and claim-level information
•Fixed forms and will become adaptive when item counts are adequate
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
2
Interim Assessment Blocks (IABs)• Focus on smaller sets of targets
•Provide more detailed information for instructional purposes.
•Currently available only as fixed forms
•Yield overall more specific information for each block/target set.
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
3
Assessment Viewing Application The Assessment Viewing Application (AVA)
◦ Provides access to the interim assessments and items for professional development . ◦ AVA is available to users with a TIDE account
Available this fall in the AVA app on the WCAP portal
http://wa.portal.airast.org/test-administrators/
OSPI content specialists are developing guidance for proper use of the information gained through viewing the items in the interims, and plan to have that available in the fall of 2015.
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
4
New!
Current Interim Assessments• Fully accessible• Available for both ELA and Mathematics• Fixed form online tests, to become adaptive as item
bank allows• Current set of IABs available – next few slides• Blocks with an asterisk are not available for the 2015-16 school
year.
5
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
6
Grade 3-5Read Literary TextsRead Informational TextsEdit/ReviseBrief WritesListen/InterpretResearchNarrative Performance Task * Gr4-5 only in 2015-16
Informational Performance Task * N/A in 15-16
Opinion Performance Task * Gr3 only in 2015-16
English Language Arts IABs
9/29/2015
7
Grade 6-8Read Literary TextsRead Informational TextsEdit/ReviseBrief WritesListen/InterpretResearchNarrative Performance Task*Explanatory Performance Task*Argument Performance Task
English Language Arts IABs
* Not available in 2015-16
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
High SchoolRead Literary TextsRead Informational TextsEdit/ReviseBrief WritesListen/InterpretResearchExplanatory Performance Task*Argument Performance Task
Math Interim Assessment Blocks for 2015–16
Grade 3 Grade 4 Grade 5 Grade 6Fractions Fractions Fractions Expressions/EquationsMeasurement/Data Numbers Base 10 Measurement/Data GeometryOperations/Algebraic Thinking
Operations/Algebraic Thinking
Numbers Base 10 Ratio/Proportions
Performance Task Performance Task Performance Task Performance Task
Grade 7 Grade 8 Grade 11Expressions/Equations Expressions/Equations Linear FunctionsNumber Systems Functions Quadratic FunctionsRatio/Proportions Geometry GeometryPerformance Task Performance Task Performance Task
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
8
Interim Assessments: Scoring Training (THSS)
Scoring◦ Interim assessments will have various item types, most of which will be machine scored
◦ Hand scoring will be a local (school/classroom) responsibility ◦ Rubrics and training are provided online as part of the THSS system and also under the THSS Materials tab in TIDE
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
9
Scoring Materials Found in the Teacher Hand Scoring System (THSS) is available within the WA Portal.
Each item has an Exemplar tab and Training Guide tab to use with training.◦ Calibration – most important aspect!◦ Exemplars include a “Prep Set” to walk teachers through scored, student responses and a “Check Set”
to test consistency in scoring each item.◦ Training Guide includes: Background information for the teacher (i.e. the passage/stimuli students read,
the item, rubric, informational notes for teacher understanding).
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
10
Training Guide - ELA◦ Cover page: Instructions by claim◦ Stimulus (passage or prompts) or sources◦ Item stem◦ Rubric(s)◦ Condition code document◦ Claim and target chart
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
11
◦ Prep Set◦ ~10 student response papers◦ Ordered 2, 1, 0◦ Includes metadata, item stem, student response,
and scoring comments Check Set◦ ~10 student response papers◦ Randomly ordered◦ Include metadata, item stem, and student
response◦ Key to Check Set Scores
◦ Included scores and scoring comments
Exemplars - ELA
Training Guide - Mathematics◦ Cover page◦ Stimulus for Performance Task◦ Metadata table◦ Item stem◦ Dependent item stem (if applicable)◦ Rubric and exemplar response◦ Condition code document
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
13
Exemplars - Mathematics◦ Prep Set
◦ ~5-10 student response papers◦ Ordered full credit, partial credit, no credit◦ Includes metadata, item stem, student response(s) to dependent item(s) (if
applicable), student response, and scoring comments ◦ Check Set
◦ ~5-10 student response papers◦ Randomly ordered◦ Includes metadata, item stem, student response(s) to dependent item(s) (if
applicable), student response◦ Key to Check Set Scores
◦ Included scores and scoring comments
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
14
IAB Reporting•Individual student scores are available for each block.
•Reporting for each block is based on three classifications related to the overall scale score cut point between levels 2 and 3: “Below Standard,” “At/Near Standard,” and “Above Standard.”
•Each IAB can be administered unlimited times to a classroom.
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
15
ICA Reporting•ICA reporting is the same as for the summative assessment:
• Overall scale score achievement level per content area/subject. • Claim score reporting is based on the overall scale score for levels 1-4 with
the cut point between levels 2 and 3. • ICAs can be administered unlimited times to a classroom.
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
16
Interim Assessments Interim Assessment Blocks (IABs) for ELA
◦ The non-PT ELA blocks have 5-9 questions.◦ Each ELA block contains a different amount of hand scored items:
◦ Listening, Research and Edit/Revise blocks are all machine scored◦ Brief Write blocks are all hand scored◦ Reading Lit and Reading Info blocks have1-2 hand scored items per block
◦ All PT blocks have three questions and a full write. ◦ Two Research items and the Full Write are hand scored. ◦ One Research item is machine scored.
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
17
What will hand scoring look like within an ELA block?
Reading Literary Text (1-2 items 2pt rubric)
Reading Informational Text (1-2 items 2pt rubric)
Brief Writes (all items, 2pt rubric)
Performance Tasks◦ 1 Full Write (10 pt rubric)
◦ 4 pts for Organization◦ 4 pts for Elaboration◦ 2 pts for Conventions
◦ 2 Research questions (2 pt rubrics)
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
18
Interim Assessment Blocks: ELAELA Block # of items Response type Estimated Time*
Reading Lit 13-15Mostly machine scored, a few hand scored
45 min -1 hour
Reading Info 14-16Mostly machine scored, a few hand scored
45 min -1 hour
Brief Write 6 brief writing tasks All hand scored 45 min -1 hour
Edit/Revise 13-16 All machine scored 30 min
Listening 14-16 All machine scored 30 min
Research 17-18 All machine scored 30 min
All Performance Tasks 3 items and 1 full write Mostly hand-scored
1-2 hours, including 30 minutes for the classroom activity.
*Estimated time is based on 1-2 minutes to answer a MC question and up to 5 to answer a constructed response. Plus time to read stimulus/sources.
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
19
IABs 2015–16: Math, Grades 3–5Math Blocks # of items Response type Estimated Time*
Grade 3 FractionsMeasurement & DataOperations & Alg. Thinking
13–16 All machine scored 30–45 min
Grade 4 FractionsNumbers Base 10Operations & Alg. Thinking
Grade 5 FractionsMeasurement & DataNumbers Base 10
Grades 3, 4, & 5Performance Task 6 Mostly hand scored
1 ½ hour, including 30 minutes for the classroom activity.
*Estimated times for the non-PT blocks are based on 1–2 minutes to answer a Claim 1 question and 2–6 minutes to answer a Claim 2, 3, or 4 question.
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
20
IABs 2015–16: Math, Grades 6–8Math Blocks # of items Response type Estimated Time*
Grade 6Expressions & EquationsGeometryRatios & Proportional Relations
13–16 All machine scored 30–45 minGrade 7
Expressions & EquationsNumber SystemRatios & Proportional Relations
Grade 8 Expressions & EquationsFunctionsGeometry
Grades 6, 7, & 8Performance Task 6 Mostly hand scored
1 ½ hour, including 30 minutes for the classroom activity.
*Estimated times for non-PT blocks are based on 1–2 minutes to answer a Claim 1 question and 2–6 minutes to answer a Claim 2, 3, or 4 question.
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
21
IABs 2015–16: Math, High School
Math Blocks # of items Response type Estimated Time*Algebra & Functions
Linear FunctionsQuadratics
13–16 All machine scored 30 min–45 min
GeometryRight Triangle Ratios 13–16 All machine scored 30 min–45 min
High SchoolPerformance Task 6 Mostly hand scored
2 hours, including 30 minutes for the classroom activity.
*Estimated times for the non-PT blocks are based on 1–2 minutes to answer a Claim 1 question and 2–6 minutes to answer a Claim 2, 3, or 4 question.
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
22