innovative approaches to alternate assessment ... - confex

Innovative Approaches to Alternate Assessment Design:

Tennessee Grade 2 Alternate Assessment

CCSSO 2017 National Conference on Student Assessment

Dr. Nakia Towns, Assistant Commissioner, Data & Research Division

Our Vision

Districts and schools in Tennessee will exemplify excellence and equity such that all students are equipped with the knowledge and skills to successfully embark upon their chosen path in life.

2

Our Priorities

3

Our Big Goals

4

Grade 2 Design

Optional Administration – This assessment offered to districts at no additional cost and only at the district’s option

Designed to help ensure that our youngest students are strengthening foundational literacy and math skills

This assessment is part of an overarching strategy to improve early grades instruction and student learning– Kindergarten Entry Inventory Screener – Voluntary Pre-K Program Criteria & Funding– Read to Be Ready Coaching Network– Read to Be Ready Summer Camps – Pre-K/K Student Growth Portfolios for Teacher Evaluation– Third Grade Individual Value-Added Data for Teacher Evaluation

Grade 2 Assessment Overview

6

Criterion-referenced assessment versus norm-referenced. – Designed to replace the SAT-10, which was optional for

grades K – 2 from 2011-2016 in Tennessee. Designed to only assess Tennessee Academic

Standards.– Will provide teachers, leaders, parents, and community

members information on how our students are performing at the end of second grade on Tennessee-specific standards.

– Provides information on progress in advance of third grade, before the first year for student and school accountability.

Grade 2 Assessment Overview

7

July 2016 – Item Review

September 2016 – Gen Ed Field Test and Passage Review

October 2016 – Alternate Field Test

April – May 2017 – Operational Administration

Summer 2017 – Standard Setting

Fall 2017 – Individual, School, and District Score Reports

Grade 2 Assessment Design Timeline

8

98 of 144 districts administered the Grade 2 assessment this spring, driven by positive feedback from the fall field test:

– 96% of educators agreed or strongly agreed that the items on the ELA field test align with the TN state standards.

– 92% of educators agreed or strongly agreed that the items on the Mathematics field test align with the TN state standards.

– Educators “felt the test length and rigor was a good fit for second graders.” And “thought the amount and quality of questions was very appropriate for second grade.”

Grade 2 Assessment: Initial Reception from the Field

9

Grade 2 Mathematics Blueprint

10

Subdomain Number of Points

Percent of Test

Computation with Whole Numbers 17 29

Number Relationships and Patterns 14 24

Measurement Concepts 13 22

Data and Geometric Concepts 9 15–16

Problem Solving 5–6 9–10

Total 58–59 100

Administered in two (2) subparts, 40 and 42 minutes long.

The mathematics test will focus approximately: – 70% of the assessment items on major work of the grade

and– 30% of the items on supporting and additional work.

Student mastery of fluency, ability to problem solve, and understanding of the grade level standards will be assessed.

Students will be assessed on their ability to connect topics across the grade level domains.

Grade 2 Mathematics Overview

11

Non-Contextual Fluency 1-point item; aligned to a single standard Fill-in-the-blank format Multiple-select format

Multiple Choice 1-point item; aligned to a single standard

Grade 2 Mathematics Item Types

12

Multi-part 2-point item; aligned to a single standard Contains multiple parts

Integrated 5–6 point item; aligned to two or more standards Contains multiple parts

Grade 2 Mathematics Item Types

13

Grade 2 Mathematics:Integrated Item

14

Grade 2 ELA Blueprint

15

Literature Subtest

42 Total Items Points %

Reading 15 30

Writing 5 10

Foundational Literacy(Phonics and Word Recognition, Vocabulary Acquisition, Word Composition, and Sentence Composition)

20 40

Listening 10 20

Total 50 100

Informational Text Subtest44 Total Items Points %

Reading 15 28

Writing 5 9

Foundational Literacy(Phonics and Word Recognition, Vocabulary Acquisition, Word Composition, and Sentence Composition)

19 35

Listening 10 19

Fluency 5 9

Total 54 100

Administered in four (4) subparts, each 40 – 42 minutes long.

The integrated format will assess students based upon questions derived from both literary passages and informational text in order to determine their mastery of the standards in the following areas: Reading Comprehension Foundational Literacy Skills Language Conventions/Grammar/Spelling Writing Listening Foundational Literacy Fluency

Grade 2 ELA Overview

16

Reading Comprehension 1-point multiple-choice items Passage-based items

Foundational Literacy Phonics and Word Recognition

– 2-point multiple-select items– Based on words from the passage

Vocabulary Acquisition– 1-point multiple-choice items– Based on words from the passage

Grade 2 ELA Item Types

17

Foundational Literacy (continued)Word Composition and Sentence Composition 1-point multiple-choice items Based on sentences about the passage

Writing 5-point writing prompt Prompt is based on ideas in a short reading passage

that is read to students Requires students to write a response that is at least

three or four sentences to answer two passage-related questions


18

Holistic Writing Rubric

19

Holistic Writing Rubric

20

Listening Sentence-based

– 1-point multiple-choice items– Graphic answer choices– Sentences and questions read to students

Passage-based– 1-point multiple-choice items– Some have graphic answer choices– Some have text answer choices– Passages, questions, and text answer choices read to

students


21

Fluency 5-point item scored using a rubric

– Students have two minutes to read 20 sentences Students read as many sentences as possible in the

time allowed, identifying each as true or not true


22

Oral Reading Fluency is typically assessed in situations where students “read aloud from a passage while their reading errors (i.e., miscues) and reading rate are recorded” (Price et al., 2012, p. 2). – Does not connect decoding skills to a measure of

comprehension– It requires substantial one-on-one time per student – It does not address the “need to pay closer consideration to

oral reading’s often ignored counterpart, silent reading” (Price et al., 2012, p. 2).

Beyond Oral Reading Fluency

23

Grade 2 ELA Fluency Item

24

The Foundational Literacy Fluency item is a measure of fluency that connects students’ basic decoding skills with their comprehension at the sentence level.‒ Students’ reading fluency and comprehension will be assessed

through the use of yes or no responses to independently read sentences containing second grade vocabulary.

‒ The number of sentences that students answer correctly will be translated into a 0–5 score.

Examples:

- A fish can swim. - It is dark at night.

- A hen is a plant. - A rock is very soft.

Grade 2 Alternate Design

The new alternate assessment for second grade replacesthe historical TCAP-Alt portfolio assessment.

Tennessee educators participated in the item review and their input was a critical part of the assessment design to ensure quality, rigor, and accessibility.

The Grade 2 Alternate was designed using a similar process as MSAA and TCAP-Alt:– Developing Alternate Assessment Targets (AATs) from

the grade level standards,– Developing Underlying Concepts (UCs) from the AATs– Developing item families consisting of four “tiers” of

“levels” from the AATs and UCs

Grade 2 Alternate Assessment Design Overview

26

The assessment begins with Tier 1 items and progress with Tier 2, Tier 3, and Tier 4 items before reverting back to Tier 3 items, then Tier 2 items, and ending with Tier 1 items, as shown below.

Operational assessment consists of a single form and with a range of 6-10 items per tier.


27

Paper and pencil test delivered in three pieces: (1) test item booklet, (2) student response cards, and (3) answer sheet to record answers.– ELA and math only– 30-35 multiple choice questions for each content area– Includes constructed response items in ELA – Answer cards on perforated paper– Teacher completes the answer sheet– Assessment may be administered over multiple days,

multiple times as needed for the student If the district chooses to administer the Grade 2

GenEd assessment, students in second grade who qualify for the alternate must be assessed as well.


28

The table below details Spring 2017 Grade 2 TCAP-Alt operational test design for ELA and Mathematics.

Spring 2018 updates to include additional field test positions and reduced MC operational points (33/32)

Grade 2 Alternate Assessment Test Design

29

#Passages # Items

Content Area

Literature Informa-tional Text

MultipleChoice

Constructed Response

Total Total # Points**

ELA 2 2 32 2 34 38Math -- -- 35 -- 35 35

* Literature and Informational Text passages have 6–7 items each. **Multiple-choice (MC) items are valued at 1 point. Constructed-response

(CR) items are valued at 3 points.

Con-tent Category Academic

Standard Tier 4 Tier 3 Tier 2 Tier 1

ELA Reading: Literature

2.RL.7Use information gained from the illustrations and words in a print or digital text to demonstrate understanding of its characters, setting, or plot.

Use illustrations to answer questions about the characters, setting, key events, or problem/solution in a story.

Use illustrations to answer questions about the characters, setting, key events, or problem/solution in a story.

Use illustrations to identify a character’s traits or feelings, a setting or plot

Use illustrations to identify a character’s traits or a setting.

ELAReading: Informa-

tional Text

2.RI.1Ask and answer such questions as who, what, where, when, why, and how to demonstrate understanding of key details in a text.

Answer why or how questions about key details in a passage.

Answer who, what, where, and when questions about key details in a passage.

Identify important people, an event, or a key detail in a passage.

Identify important people or an event in a passage.

Grade 2 Alternate Assessment –Item Sampling

30

Grade 2 Alternate Assessment Content Emphasis

31

ELA Strand Grade 2Reading Literature 37%Reading Informational Text 26%Reading Foundational 10%Vocabulary 10%Writing 16%

Mathematics Domain Grade 2Operations and Algebraic Thinking 25%Number and Operations Base Ten 45%Number and Operations Fractions --Measurement and Data 30%Geometry --

Grade 2 Assessment designed to focus deeply on early numeracy and literacy skills

Grade 2 Alternate Assessment built off same premise, utilizing design principles established in MSAA – tiered items and aligned to standards.

Tennessee is eliminating portfolio models for all TCAP-ALT assessments in grades 2 – 11.

Grade 2 and Grade 2 Alternate Assessments are part of an overarching strategy to improve K-3 results and ensure equity for all students.

Conclusion

32

Districts and schools in Tennessee will exemplify excellence and equity such that all students are

equipped with the knowledge and skills to successfully embark on their chosen path in life.

Excellence | Optimism | Judgment | Courage | Teamwork

innovative approaches to alternate assessment ... - confex

Documents