ILEARN Blueprints & Specifications

Grades 3-5

ELA

Purpose Who determines what will be assessed?

What standards will be assessed?

How will content be assessed?

What makes ILEARN different?

What resources are available now for

educators?

• Provide answers to these questions

A new test for Indiana…

Guiding Principles

Student-centered Accessible Transparent

Indiana-aligned Evidence-based Technically sound

Quality assessment is a deliberative and

collaborative process involving Indiana educators.

ILEARN Development

The Foundation for ILEARN

Indiana Academic Standards

Blueprints

.

Item Specifications

Item Acceptance Review

Item Development

.

Data Review

Scoring .

Standard Setting

• Built from the ground up

• Indiana Academic Standards are the

foundation of instruction and ILEARN

• To assess the knowledge and skills

students should achieve

Which standards will be assessed?Indiana Academic Standards

Specifications

• Blueprints define the standards that will be assessed

• Educator Committees used the Indiana Academic Standards to:

develop key evidence statements

recommend a framework for reporting results

categorize and rate the level of priority

Blueprints

Specifications

Standards grouped into Reporting Categories Grades 3- 5 ELA Blueprints

Speaking & Listening

Foundational Skills

Overall ELA Scale

Score

Reporting Category One

Key Ideas and Textual Support/Vocabulary

Reporting Category Two

Structural Elements and Organization/ Synthesis and Connection of Ideas/ Media

Literacy

Reporting Category Three

Writing

ILEARN Blueprints provide more detail

ISTEP+ Blueprints ILEARN Blueprints

• 4 Reporting Categories ● 3 Reporting Categories

Blueprints define what will be assessed

Standards

grouped into

categories

Standards within the

reporting category

Minimum and

maximum number of

items assessed for

that standard

Minimum and maximum

percent weight of each

standard on the

assessment as a whole

Total number of items

assessed for the

Reporting Category

How can Blueprints be used in the Classroom?

4.RN.2.2

4.RL.4.1

0 – 1

items

1 – 3

items

• Use the blueprints to prioritize instructional

content:

• Scope and Sequence

• Classroom Assessments

• Use standards as a

basis for lesson

planning

How will content be assessed?

Outlines specifics of the Blueprint

Defines limits

Developing the Item Specifications

IAS

Blueprints

Specifications

• Educators created new Item

Specs for standards specific to

Indiana

• Items Specs used from two

licensed banks that align to

Indiana Academic Standards

How is each standard assessed?Indiana

Academic

Standard

Content

Limits

Construct-

Relevant

Vocabulary

DOK

Item Types

Item Types

Selected Response (SR) Machine Scored Constructed

Response (MSCR)

Hand Scored Constructed

Response (HS)

• Multiple Choice

• Multi-Select

• Table Match

• Evidence Based Selected

Response

• Editing Task Choice

• Hot Text

• Graphic Response or Grid

Item

• Natural Language

• Editing Task

• Short Answer (2 pt.

rubric)

• Writing Prompt or

Performance Task Essay

(6 pt. rubric)

What is a Performance Task?

Multiple

Texts

3-4 Related

Parts

Final Performance

Task (the Essay, or

Writing Prompt)

Educator Involvement: Handscoring

• IDOE will involve educators to the extent possible. • Approximately 3-4 educators from each corporation

• Full-time commitment to a 3-week scoring window each spring (following ILEARN administration).

• More details coming soon!

Educators

Compensated at

the state rate

ALL participation is

remote

(training, scoring

PGPs available to

all educators

How is each standard assessed?

Evidence

Statements

Sample

Item

Accessibility and Accommodations Includes:

Literacy

Considerations

Auditory

Considerations

Linguistic

Considerations

Accessibility Framework

Universals Features

Universal features are available to all students as they access instructional or assessment content.

Designated Features

Designated features are those tools that are available for use by any student for whom the need has been indicated by an educator (or team of educators) who are familiar with the student’s characteristics and needs.

Accommodations

An accommodation is a change in the standardized testing materials or procedures that enables students with a disability or with limited English proficiency to participate in an assessment in a way that measures abilities.

• English Dictionary (Writing) New

• Headphones or noise buffers to

block out distractions

• Low-tech assistive writing

instrument

• Preferential seating

• Scratch/blank paper, including

lined or graph paper

• Small group

• Thesaurus (Writing) New

Non-Embedded

• Color Contrast

• *Translation Glossaries (for pre-

selected construct-irrelevant term

in Spanish, Burmese, Arabic,

Mandarin, Vietnamese for all

mathematics, social studies, and

science New

• Masking

• Mouse pointer (size and color)

New

• Print size (zoom in and out) New

• *Translation-Spanish (Stacked)

for Mathematics, Science and

Grade 5 Social Studies New

Embedded/Online

• America Sign Language (ASL)

videos for media items New

• Braille transcript for audio

items New

• Closed caption for online audio

items New

• Refreshable Braille New

• Permissive mode to use

assistive technology devices

New

• Print on Demand New

• Streamline format New

• Text to speech (except for

reading comprehension)

Embedded/Online

• Assistive technology to

magnify/enlarge

• Color Overlay

• Sound amplification system

• Special furniture or equipment for

viewing test

• Special lighting conditions

• Time of day for testing altered

Non-Embedded

Universal Features: Available to ALL students

Designated Features: Available to ANY student with a need determined

by educators Accommodations: Available to students with an

IEP, 504 Plan or Nonpublic Service Plan

*Intended for English Learners (EL)

ILEARN Accessibility Framework

Accommodations: Available to students with an

ILP (English Learners)

Text to speech (except for items

testing comprehension)

• Answer Eliminator

• Calculator for calculator

allowed items (Mathematics

Grades 6-8)

• Dictionary (Writing) New

• English Glossary for pre-

selected construct-irrelevant

terms (all content areas) New

• Notepad New

• Highlighter

• Line Reader

• Mark for Review

• Mathematics Tools (e.g. ruler)

• Thesaurus (Writing) New

• Tutorial New

• Writing Tools (e.g. rich text,

spell check) New

• Zoom

• Extra time

• Read aloud to self

• Test individually

• Approved bilingual word-to-

word dictionary

• Alternative indication of response

• Braille Booklet

• Computer or other Assistive Technology (AT)

• Extra time

• Calculator for calculator allowed items

(Mathematics Grades 6-8) New

• Hundreds Chart (Mathematics Grades 3-8) New

• Interpreter for sign language

• Large Print Booklet

• Multiplication Table (Grades 6-8) New

• Paper Booklet

• Paper Booklet (Spanish Translation) New

• Read aloud to self

• Read aloud script for paper booklet

• Scribe

• Test individually

Embedded/OnlineNon-Embedded

Non-Embedded

Embedded/Online

How can the Blueprints and Item Specs be used in the classroom?

Indiana Academic Standards

Identify the Indiana Academic Standard you want students to master.

Blueprints

Identify the priority or weight of each standard.

Item Specifications

Use the Item specifications to guide formal test construction in the classroom

Focus on the evidence statements to measure mastery.

Assessment measuring

progress towards

mastering the

Standard

Implementing Improvements

Computer Adaptive

• Math and ELA

• Unique student experience that always meets the blueprint

• Adapts on difficulty, not across grade levels unless content aligns at multiple grade levels

Additional Student Supports and

Accommodations

• Translations

• Glossaries

• Embedded Dictionary/Thesaurus

• Spell Check

• Rich Text Tools

• Accessible Calculator

• Intuitive Graphing Interfaces

• American Sign Language

Improved Testing Times

• Single testing window at the end of the year

• Decreased test length (average 2 hours shorter total at each grade level)

• Untimed sessions

Improved Reporting Structures

• Individual student results in 12 days*

• Final results by July 1*

• More detailed student reports for computer adaptive tests

• Revised cut scores and proficiency levels (by educator committee)

Technology Setup and Requirements**

• Small IT and bandwidth footprint

• No local caching

• Secure Browser is the only required software

• Includes diagnostic tools

• “Sessionless” testing; no test tickets or seal codes

• Testing managed from examiner/teacher device

*These times will begin in 2020 due to setting cut scores in Summer 2019. Final reporting will be available Aug 15 for 2019.

**Full system requirements will be available in the Indiana Portal. Session management policy and procedures will be available by Oct 1, 2018.

Information about ILEARNwww.doe.in.gov/assessment/ilearn-educators

Blueprints and Item Specificationswww.doe.in.gov/assessment/ilearn-test-design

Released Items Repository www.doe.in.gov/assessment/ilearn-sample-items-and-scoring

--------------------------------------------------------------------------------------

Contact InformationE/LA Grades 3-5

Jennifer Whitticker @ jwhitticker@doe.in.gov

The Office of Student Assessment

INassessments@doe.in.gov or 317-232-9050

#IDOEILEARNFollow us!Questions