![Page 1: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/1.jpg)
@EducateIN
Interpreting and Responding to Summative Scores for the
Classroom Teacher
![Page 2: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/2.jpg)
Welcome & Introductions
2
![Page 3: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/3.jpg)
@EducateIN
Dr. Charity Flores
Director of Assessment
Stephanie Thompson
Assessment Specialist (I AM)
Kelly Connelly
Senior Assessment Program Specialist (ILEARN)
Indiana Department of Education Staff
3
![Page 4: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/4.jpg)
Getting to Know the Facilitators and Participants
4
![Page 5: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/5.jpg)
@EducateIN
Dr. Elizabeth Greninger Professional Development Lead
Antoinette Melvin Assessment Training Lead
George Ligon, IV Assessment Training Lead
edCount Facilitators
5
![Page 6: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/6.jpg)
@EducateIN
Adobe Connect Webinar Platform
@EducateIN
6
![Page 7: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/7.jpg)
@EducateIN
We’d like to hear more about you!
In a moment, you will see a poll box appear on your screen.
Please tell us your name, where you are from, and the position you hold.
Getting to Know the Indiana Educators
7
![Page 8: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/8.jpg)
Presentation: Interpreting and Responding to Summative Scores for the Classroom Teacher
8
![Page 9: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/9.jpg)
Review of the webinar objectives
9
![Page 10: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/10.jpg)
@EducateIN
• Indiana educators will• understand the purposes and appropriate uses of
summative data at the classroom level.
• learn about the structure and components of the ILEARN Individual Student Report (ISR) and class-level reports, and they will be able to make interpretations about the data within the ILEARN reports.
• gain strategies for communicating with parents, students, and colleagues about the results.
Webinar Objectives
10
![Page 11: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/11.jpg)
@EducateIN
• Overview of Research
• Overview of ILEARN ISR and Class-level Reports
• Analytical and Evaluative Approaches for Reviewing ILEARN Data
• Structures and Strategies for the Practical Use of ILEARN Data
• Key Takeaways and Resources
Webinar Topics
11
![Page 12: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/12.jpg)
Purpose and uses of summative data
12
![Page 13: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/13.jpg)
@EducateIN
“Traditionally, summative assessment refers to the assessment of learning, which is typically gathered at the end of the unit of study …. Assessment data provides a basis for evidence-based monitoring of
student learning progress and may help guide students and teachers as they strive to achieve
learning goals…”
Purposes and Uses of Summative Data
- Louis Nadelson, “Are They Using the Data? Teacher Perceptions of, Practices with, and
Preparation to Use Assessment Data” (52 – 54)
13
![Page 14: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/14.jpg)
@EducateIN
Purposes of Summative Assessment Scores
14
![Page 15: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/15.jpg)
@EducateIN
Uses of Summative Assessment Scores
15
![Page 16: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/16.jpg)
@EducateIN
The research tells us that summative data:
Is useful at many
levels, from the state to
the corporation, to the
school
Can support evaluation
and validation of
curriculum and
instructional practices
Fulfills federal
requirements
Provides evidence of
student learning and
progress
In combination with
other sources of data
(e.g., formative) leads
to informed
instructional decisions
to impact student
learning and progress.
Can be evaluated in
the context of
professional learning
groups to guide
practice
16
![Page 17: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/17.jpg)
The Power and Limitations of the Data
17
![Page 18: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/18.jpg)
@EducateIN
Common Uses of Assessment Scores
What are our goals for student learning in this lesson, unit,
class, course, or year?
Curriculum
Assessment InstructionAdapted from National Research Council. (2001). Knowing what students know: The science and design of educational assessment.Committee on the Foundations of Assessment. Pellegrino, J., Chudowsky, N., and Glaser, R., editors. Board on Testing and Assessment, Center for Education, Division of Behavioral and Social Sciences and Education. Washington DC: National Academy Press.
• Standards define
expectations for student
learning.
• Curricula and assessments
are interpretations of the
standards.
• Evaluation and
accountability rely on the
meaning of scores.
• Without clear alignment
among standards,
curricula, and assessment
the model falls apart.
18
![Page 19: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/19.jpg)
@EducateIN
Low Stakes for
Students and
EducatorsUses for informing instruction
now or for next time:
• guide next steps in
instruction
• evaluate instruction
• evaluate curriculum
Stakes Related to Assessment Scores
High Stakes
for Educators
Uses for evaluating
individuals or groups and
accountability:
• evaluate teachers
• evaluate schools or
corporations
• evaluate programs or
services
(Forte, 2018)
High Stakes for
Individual Students
Uses for understanding what
students know:
• evaluate learning for
calculating grades
• determine eligibility for
program entry or exit
• diagnose learning
difficulties
19
![Page 20: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/20.jpg)
@EducateIN
Common Misconceptions about Summative Data
A summative assessment for students with significant cognitive
disabilities does not provide relevant information.
I can use my ILEARN scores to determine whether or not to place
students in accelerated coursework.
Reaching “proficiency” means we are done. (i.e., we no longer need
to work on growth)
My summative data doesn’t match what my interim data is telling
me, so summative data is irrelevant. (What standards is your interim
assessment measuring? What are its parameters of measurement –
proficiency or growth?
We can turn a scale score into a letter grade to go in the gradebook.
20
![Page 21: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/21.jpg)
@EducateIN
• Assessment literacy includes three big ideas: What someone knows about assessment, what someone believes about assessment, and what someone does with assessment.
• An assessment literate individual:• Understands the types and purposes of
assessment;
• Believes that assessment is an essential part of teaching and learning;
• Utilizes data to drive informed decision-making for the success of every child.
Assessment Literacy
21
![Page 22: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/22.jpg)
@EducateIN
What are some of the more common uses of summative assessment data
in your school or corporation?
Summative Assessment Uses
22
![Page 23: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/23.jpg)
Overview of the ILEARN ISR and class-level reports
23
![Page 24: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/24.jpg)
@EducateIN
Purpose of ILEARN
• Measures student growth and achievement according to Indiana
Academic Standards.
• ILEARN is online, computer-adaptive, and aligned to the Indiana
Academic Standards.
• Serves as a summative accountability assessment for Indiana
students and assesses:o English/Language Arts (Grades 3-8)
o Mathematics (Grades 3-8)
o Science (Grades 4 and 6)
o Social Studies (Grade 5)
o Biology (High School)
o U.S. Government – Optional (High School)
• Provides valuable data that school and teachers can use to
inform teaching practice.
24
![Page 25: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/25.jpg)
@EducateIN
Five Guiding Principles
25
![Page 26: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/26.jpg)
Overview of the ILEARN ISR
26
![Page 27: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/27.jpg)
@EducateIN
The ILEARN ISR
The ILEARN Individual Student Report (ISR) provides useful information about students’ growth and proficiency, including:
• Scores,
• Proficiency levels, and
• Comparison groups
27
![Page 28: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/28.jpg)
@EducateIN
• Basic Information and
Overall Performance
• Student's Scale Score and
Performance Level
• Average Scale Score and
Comparison Groups
• Reporting Category
• Content Specific Information
Understanding the Components of the ILEARN ISR
28
![Page 29: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/29.jpg)
@EducateIN
Content-
specific
measure
Indicates if the
student is
meeting college
and career
ready
standards
Determined by
the student’s
scale score
Basic
Information
Standardize
student
score
Basic Information and Overall Performance
29
![Page 30: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/30.jpg)
@EducateIN
Test Scores
• How is information from students’ responses to each item combined with information gained from other items?
• How are these combinations determined and do they represent the measurement target in a comprehensive and balanced manner?
Total score = 2?
(Forte, 2018)
30
![Page 31: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/31.jpg)
@EducateIN
Types of Test Scores
Raw Score
Scale Score
Percentile Rank
Performance Level
Percent Correct Score
(National Council on Measurement in Education, 2016)
• the number of items
correctly answered
• the percent of total
possible score
points a test taker
obtained
• derived from raw
score and equating
process
31
![Page 32: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/32.jpg)
@EducateIN
Items may have different values.
A raw score is the sum of the individual item scores.
(Forte, 2018)
Raw Scores
32
![Page 33: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/33.jpg)
@EducateIN
Common Uses of Assessment Scores
(Forte, 2018)
33
• Test equating traditionally refers to the statistical process
of determining comparable scores on different forms of an
exam.
• Equating models are used to create a score scale, which
accounts for differences in difficulty and reliability across
items on the test.
• Score scales help to address variations in item
characteristics and yield scores that can be interpreted in
comparable ways across students, sites, test forms,
formats, and time.
• The scale scores that result allow for comparison of one
examinee to others and can hold their meaning over time.
(Brennan, 2006)
![Page 34: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/34.jpg)
“Scale scores may aid
interpretation by
indicating how a given
score compares with
those of other test
takers, by enhancing
the comparability of
scores obtained
through different forms
of a test, and by
helping to prevent
confusion with other
scores.”
(AERA, NCME, APA, 2014, p. 95) 34
![Page 35: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/35.jpg)
@EducateIN
For ILEARN, a scale score
is used where students’ raw
scores are placed on an
alternative scale to account
for any slight variations in
difficulty between test forms.
Basic Information and Overall Performance
35
![Page 36: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/36.jpg)
@EducateIN
Graphic of
student
proficiency,
including 4
proficiency
levels
A scale score
that falls in the
red area is
below
proficiency
A scale score
that falls in the
yellow area is
approaching
proficiency
A scale score
that falls in the
blue area is
above
proficiency
A scale
score that
falls in the
green area
is at
proficiency
A detailed
description
of a
student’s
proficiency
Student's Scale Score and Proficiency Level
36
ILEARN Range PLDs
ILEARN Policy PLDs
![Page 37: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/37.jpg)
@EducateIN
Average Scale Score and Comparison Groups
37
![Page 38: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/38.jpg)
@EducateIN
In a few words, describe how you have used scale scores with other assessment reports. How might
you use scale scores with ILEARN?
How do you use scale scores?
38
![Page 39: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/39.jpg)
@EducateIN 39
Test Performance Reported in Performance
Levels
(Forte, 2018)
![Page 40: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/40.jpg)
@EducateIN
Reporting Category
40
![Page 41: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/41.jpg)
@EducateIN
The domains for
a content area
are separated
into reporting
categories
shown on the
left.
Reporting Category - Domains
41
![Page 42: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/42.jpg)
@EducateIN
Student’s
performance
Reporting Category - Performance
42
![Page 43: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/43.jpg)
@EducateIN
The white bar within the
graphic shows the
performance expectation by
domain.
The green rectangle reflects
the error of measure.
The black bar shows the
student's score on each
reporting category.
The blue delta/triangle
indicates the student is
performing above
expectations for the
particular domain.
The light green partially
filled box indicates the
student is performing at
or near expectations for
a particular domain.
The orange stop sign
means the student is
performing below
expectations for a
particular domain.
Reporting Category - Performance
43
![Page 44: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/44.jpg)
@EducateIN
The reporting
category
descriptions give
an interpretation of
results and
suggested next
steps to support
the student in that
domain.
Reporting Category - Description
44
![Page 45: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/45.jpg)
@EducateIN
Content Area Specific Information
45
The content area specific information is information
which is unique to the particular subject of the test.
![Page 46: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/46.jpg)
@EducateIN
How might you use the reporting categories in talking with parents about their child’s performance?
How do you use reporting categories?
46
![Page 47: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/47.jpg)
Overview of the ILEARN Class Level Report
47
![Page 48: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/48.jpg)
@EducateIN
Overall Performance of My Students
48
![Page 49: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/49.jpg)
@EducateIN
Overall Performance of My Students
The Name
column, names
each level of
review from
state to
classroom.
Additional class
sections can be
found here for
comparison.
49
![Page 50: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/50.jpg)
@EducateIN
Overall Performance of My Students
The middle section shows
the numerical values for
overall student
performance at each
level, including the
number of students
tested, the average scale
score, and the percent of
proficient students at each
level.
50
![Page 51: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/51.jpg)
@EducateIN
Overall Performance of My Students
The far right graphic
shows the number of
students at each
proficiency level.
The inner graphic shows
student proficiency by
percent.
• The right side shows
two proficiency level
graphics.
51
![Page 52: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/52.jpg)
@EducateIN
This is the class level
reporting category
report. The reporting
category
demonstrates how
students performed
across domains within
a content area.
The Name column
names each level of
review from state to
classroom.
Additional class
sections can be found
here for comparison.
The domains for a
content area are
separated into reporting
categories shown here.
The colored graphic to the far
right indicates students’
performance level for each
domain. Blue indicates students
performing above expectations
for a domain; green indicates
students that are performing at
or near expectations; and
orange indicates students that
are performing below
expectations.
Class Level Reporting Category Report
52
![Page 53: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/53.jpg)
@EducateIN
The Name
column names
each level of
review from
state to
classroom.
The legend for
interpreting
student
performance by
standard.
Average scale
score at each
level.
Each individual
standard.
Student
performance
for each
standard.
Standard Level Reporting
53
![Page 54: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/54.jpg)
@EducateIN
This section
shows the basic
information and
overall
performance of
each individual
student.
Overall Performance of My Students
54
![Page 55: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/55.jpg)
@EducateIN
Share a thought or two about ways the ILEARN ISR and class-level
reports can support your teaching practice?
How can you use the ILEARN ISR and class level reports?
55
![Page 56: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/56.jpg)
Analytical and evaluative approaches for reviewing ILEARN data
56
![Page 57: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/57.jpg)
@EducateIN
The CARS Approach
REFLECTCOLLECT ASSESS STRATEGIZE
57
![Page 58: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/58.jpg)
@EducateIN
Collect
Students
•Sources: ILEARN ISR, classroom-level reports
•Focus on the facts: What do the numbers say?
•How will the data will need to be aggregated and disaggregated?
Curriculum and Instruction
•Sources: lesson plans, planning calendar, curriculum map
•How many standards appear in the report? In what percentage?
•How much time was spent addressing these standards/topics?
•What documented instructional strategies did you use?
58
![Page 59: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/59.jpg)
@EducateIN
Assess
Students
•Areas of growth?
•Gaps to be considered?
•Comparison to classroom data?
• Identification of contributing factors?
Curriculum and Instruction
•What stands out?
•Any ineffective concepts?
•Effectiveness of interventions?
59
![Page 60: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/60.jpg)
@EducateIN
Reflect
Students
•What student supports can be provided?
•What demographic, social, emotional, and/or cognitive considerations need to be made?
•How will I analyze strengths and obstacles?
Curriculum and Instruction
•What other information needs to be gathered?
•What changes in instruction and/or curriculum have occurred since the previous assessment results?
60
![Page 61: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/61.jpg)
@EducateIN
Strategize
Students
Growth plan
• ILEARN ISR, diagnostic assessments, formative assessments
•Critical areas for growth and achievement goals
•Who will monitor the students’ performances? When and how often?
Communication with parents
•How will information be provided?
•What opportunities are there for collaboration?
Curriculum and Instruction
Action Plan•What instruction needs to change?•Researched-based instructional strategies?•Student learning connection with specific strategies?•Who will be responsible? Will they need training?
61
![Page 62: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/62.jpg)
Structures and strategies for the practical use of ILEARN data
62
![Page 63: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/63.jpg)
@EducateIN
How Can Teachers Use the New ILEARN Student Reports?
STUDENT
PROGRESS
Formative
Assessment
Classwork
State
Assessment
Report
Cards
Attendance
Homework
63
![Page 64: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/64.jpg)
@EducateIN
Common Uses of Assessment Scores• What worked?
• Target student support• Educator support
Planning
Practice• Revisions vs. recreating• Share the wealth• Celebrate success
64
![Page 65: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/65.jpg)
@EducateIN
ILEARN Individual Student Report Guide
65
![Page 66: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/66.jpg)
@EducateIN 66
CARS in Action: Streamlining an Action Plan
![Page 67: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/67.jpg)
@EducateIN 67
CARS in Action: Streamlining an Action Plan
![Page 68: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/68.jpg)
Key takeaways
68
![Page 69: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/69.jpg)
@EducateIN
As a result of today’s webinar, what action steps
do you plan to take?
Key Takeaways
What are your key takeaways
from today’s presentation?
69
![Page 70: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/70.jpg)
@EducateIN
Key Takeaways
• Communication with parents and students
• Assessment of teaching practice and student growth
ILEARN ISR
• Supported by CARS and CARS in action
• Facilitate effective data interpretation and action planning
Intentional Approach
….= RESULTSCollegial discussion
70
• Communication with parents and students
• Assessment of teaching practice and student growth
ILEARN ISR
• Supported by CARS process
• Facilitate effective data interpretation and action planning
Intentional Approach
….= RESULTSCollegial discussion
![Page 71: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/71.jpg)
Question and Answer Session
71
![Page 72: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/72.jpg)
Webinar Wrap-Up
72
![Page 73: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/73.jpg)
Resources and ReferencesSee supplemental documents.
73
![Page 74: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/74.jpg)
@EducateIN
For access to the materials from this webinar, please visit IDOE's "ILEARN Sample Items and Scoring" page:
https://www.doe.in.gov/assessment/ilearn-sample-items-and-scoring
For access to additional materials related to ILEARN, please visit the Indiana Assessment Portal "Educator Resources" page: https://ilearn.portal.airast.org/resources/educator-resources/
For access to the online training module for the Online Reporting System, please visit:
https://s3.amazonaws.com/air-org/indiana/Media/Online+Reporting+System+FINAL_Audio_Comp
ressed_SUBT_compress.mp4
74
Additional ILEARN Materials
![Page 75: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/75.jpg)
@EducateIN 75
Upcoming Webinars
![Page 77: Interpreting and Responding to Summative Scores for the ......items on the test. • Score scales help to address variations in item characteristics and yield scores that can be interpreted](https://reader033.vdocument.in/reader033/viewer/2022041517/5e2be64857da6a37b929e003/html5/thumbnails/77.jpg)
@EducateIN
Thank You!
77
Please take a minute to complete our participant satisfaction feedback
survey!
This Photo by Unknown Author is
licensed under CC BY-SA