![Page 1: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/1.jpg)
How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers
![Page 2: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/2.jpg)
Agenda
• Multiple Choice Scoring• Short Constructed-Response Scoring• Extended Constructed-Response Scoring• Item Distribution• Scoring Logistics• Training Materials
– Item (Question)– Scoring Guide & Rubric– Anchor Sets– Scoring Sheets– Practice Sets
• NAEP Questions Tool
![Page 3: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/3.jpg)
The Goal of Scoring
Our goal is to make consistent and accurate judgments about what students know and can
do based on their given responses, while maintaining the highest standards of
measurement precision.
Eunice Greer, Senior Research ScientistNational Center for Education Statistics
![Page 4: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/4.jpg)
Multiple Choice Items
• Only one correct response• Scanned and scored electronically• Inexpensive to score
![Page 5: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/5.jpg)
Short Constructed-Response Items
2 Score Category• Correct• Incorrect
3 Score Category• Complete• Partial• Unacceptable or
incorrect
![Page 6: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/6.jpg)
Extended Constructed-Response Items
4 Score Category• Complete• Essential• Partial• Incorrect
5 Score Category• Extended• Satisfactory• Partial• Minimal• Incorrect
![Page 7: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/7.jpg)
Item Type Distribution: Mathematics
![Page 8: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/8.jpg)
Item Type Distribution: Reading
![Page 9: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/9.jpg)
History of Scoring
![Page 10: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/10.jpg)
Scoring Sites
![Page 11: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/11.jpg)
Training Materials – Cover Page
![Page 12: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/12.jpg)
Training Materials - Question
![Page 13: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/13.jpg)
Training Materials – Scoring Guide & Rubric
![Page 14: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/14.jpg)
Training Materials – Anchor Set
14
![Page 15: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/15.jpg)
Training Materials – Anchor Set
15
![Page 16: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/16.jpg)
Training Materials – Scoring Form
Potential scorers use this form to record practice scores.
To qualify to score this item, the potential scorer must score 90% correctly.
![Page 17: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/17.jpg)
Training Materials – Practice Sets
17
![Page 18: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/18.jpg)
Training Materials – Practice Sets
![Page 19: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/19.jpg)
Using the NAEP Questions Tool to Locate Additional Test Items
![Page 20: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/20.jpg)
The NAEP Questions Tool
![Page 21: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/21.jpg)
The NAEP Questions Tool
![Page 22: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/22.jpg)
The NAEP Questions Tool
![Page 23: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/23.jpg)
The NAEP Questions Tool
![Page 24: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/24.jpg)
The NAEP Questions Tool
![Page 25: How NAEP Constructed-Response Items Are Scored: A Turnkey Workshop for Teachers](https://reader036.vdocument.in/reader036/viewer/2022070412/56814948550346895db69580/html5/thumbnails/25.jpg)
Questions?