Slide 1

How Do My Students Compare? Exploring National Assessment Tools Crystal Walcott Indiana University Purdue University Columbus Doris J. Mohr University of Southern Indiana Peter Kloosterman Indiana University - Bloomington

Slide 2

http://nces.ed.gov/nationsreportcard/ NAEP National Assessment of Educational Progress

Slide 3

NAEP Programs Main NAEP results are representative of the entire US population Main NAEP results are representative of the entire US population State NAEP same items and testing format, reports achievement for fourth and eighth grade students on a state-by- state basis State NAEP same items and testing format, reports achievement for fourth and eighth grade students on a state-by- state basis Long-Term Trend uses different items, national sample, and testing schedule. Long-Term Trend uses different items, national sample, and testing schedule.

Slide 4

NAEP Content Strands in Mathematics Number sense, properties, and operations Number sense, properties, and operations Measurement Measurement Geometry and spatial sense Geometry and spatial sense Data analysis, statistics, and probability Data analysis, statistics, and probability Algebra and functions Algebra and functions

Slide 5

NAEP Item Formats Multiple choice format Multiple choice format 4 th grade four choices 8 th & 12 th grades five choices Short constructed-response Short constructed-response Two types 1. Students write answer in space provided. 2. Multiple questions or a brief rationale. Extended constructed-response Extended constructed-response Scored with focused, holistic rubrics

Slide 6

Reporting Results: Scale Score and Achievement Levels Scale scores Scale scores Range from 0 to 500 Available by content strand Available by demographic characteristics Designed to get a sense of performance of the nation as a whole, not performance of individual students Achievement levels Achievement levels Basic, proficient, and advanced Setting of achievement levels is controversial (proficient level is very ambitious)

Slide 7

Questionnaires Student Questionnaire Student Questionnaire All students complete two five-minute questionnaires before the cognitive items and one five-minute questionnaire after completing the items #1 focuses on demographics #2 focuses on mathematics background & courses #3 focuses on how hard the students tried and the difficulty of the assessment Teacher Questionnaire Teacher Questionnaire School Administrator Questionnaire School Administrator Questionnaire

Slide 8

NAEP Online Tools

Slide 9

http://nces.ed.gov/nationsreportcard/ Nations Report Card Homepage

Slide 10

http://nces.ed.gov/nationsreportcard/about/naeptools.asp Learn More About the Tools Available Online

Slide 11

Main NAEP Question Tool

Slide 12

Accessing the Questions Click on Questions Tool from the tools and applications page..

Slide 13

Accessing the Questions Or click on Sample Questions from the left navigation bar on the homepage

Slide 14

NAEP Questions Tool

Slide 15

http://nces.ed.gov/nationsreportcard/itmrlsx/landing.aspx

Slide 16

Main NAEP Mathematics Questions Search http://nces.ed.gov/nationsreportcard/itmrlsx/search.aspx?subject=mathematics

Slide 17

Main NAEP Mathematics Questions Search http://nces.ed.gov/nationsreportcard/itmrlsx/search.aspx?subject=mathematics

Slide 18

Main NAEP Mathematics Questions Search http://nces.ed.gov/nationsreportcard/itmrlsx/search.aspx?subject=mathematics

Slide 19

Main NAEP Mathematics Questions Search http://nces.ed.gov/nationsreportcard/itmrlsx/search.aspx?subject=mathematics

Slide 20

Main NAEP Mathematics Search Results http://nces.ed.gov/nationsreportcard/itmrlsx/search.aspx?subject=mathematics

Slide 21

Item Preview http://nces.ed.gov/nationsreportcard/itmrlsx/search.aspx?subject=mathematics

Slide 22

View Question Detail

Slide 23

Show Additional Materials

Slide 24

Key/Scoring Guide

Slide 25

Sample Responses

Slide 26

National Performance Summary

Slide 27

National More Data

Slide 28

Jurisdiction Data

Slide 29

Adding Items to Workspace

Slide 30

Slide 31

Slide 32

Using Workspace

Slide 33

Workspace Document

Slide 34

Example of Multiple-choice item

Slide 35

Example of Extended Constructed Response Item

Slide 36

Long-term Trend Item Tool

Slide 37

Long-term Trend Item Search http://nces.ed.gov/nationsreportcard/itmrlsx/landing.aspx

Slide 38

Long-term Trend Item Search http://nces.ed.gov/nationsreportcard/itmrlsx/search.aspx?subject=long-term_trend_mathematics

Slide 39

Long-term Trend MC Items From Age 9 Assessment From Age 13 Assessment From Age 17 Assessment

Slide 40

Long-term Trend SCR Item From Age 9 Assessment From Age 13 Assessment From Age 17 Assessment

Slide 41

Long-term Trend Question Detail & Workspace

Slide 42

NAEP Online Data Explorer

Slide 43

http://nces.ed.gov/nationsreportcard/about/naeptools.asp Learn More About the Tools Available Online

Slide 44

http://nces.ed.gov/nationsreportcard/naepdata NAEP Data Explorers

Slide 45

http://nces.ed.gov/nationsreportcard/naepdata/dataset.aspx Main NAEP Data Explorer

Slide 46

Data Explorer Results

Slide 47

NCES Kids Zone

Slide 48

http://nces.ed.gov/nceskids/index.asp

Slide 49

NCES Kids Zone Tools

Slide 50

NCES Kids Zone Graph

Slide 51

Slide 52

NCES Kids Zone Graph Example

Slide 53

NCES Kids Zone Dare to Compare

Slide 54

Slide 55

Slide 56

Slide 57

NCES Kids Zone Grab Bag

Slide 58

NCES Kids Zone Chances

Slide 59

Slide 60

Send your email address to walcottc@iupuc.edu to receive an electronic copy of this presentation.walcottc@iupuc.edu