:kdw duh vrph lvvxhv dvvrfldwhg dvvhvvphqwv lq … · +rz pxfk grhv wkh edoo frvw" kwws...
TRANSCRIPT
![Page 1: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/1.jpg)
Mark Ellis, Ph.D., NBCTProfessor, CSU Fullerton
College of Education@ellismathed
ellismathed.weebly.com
![Page 2: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/2.jpg)
1. What are (some) issues associated with large-scale standardized assessments in mathematics?2. What is the “Smarter Balanced Assessment” (SBA) System?3. How does the SBA interact with concerns about (in)equity in mathematics education?
![Page 3: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/3.jpg)
Monitor student progressInform instructional decisionsEvaluate student achievementEvaluate programs
NCTM, 1995
Monitor student progressInform instructional decisionsEvaluate student achievementEvaluate programs
NCTM, 1995
![Page 4: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/4.jpg)
There are pre-existing, fixed differences in student (mathematical) ability that are both meaningful and measurable…and unevenly distributed among different populations.
![Page 5: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/5.jpg)
“Whether they know why 76 is right depends… “If why means because 53=50+3, 23=20+3 and 50+20=70, 3+3=6, they do not. Nor would most of them by any sort of teaching whatever.”
(E. L. Thorndike, Psychology of Arithmetic, 1923)
23+53
![Page 6: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/6.jpg)
“[The] increase in the school population has given us a wider sampling of the general public and hence has in all probability lowered the level of ability…”Raleigh Schorling, NCTM President in The First Yearbook of NCTM (1926, p. 102)
![Page 7: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/7.jpg)
“Ethnology shows that racial progress has been closely paralleled by the ability to deal with mathematical concepts and relations. Child psychology shows the same for individual development.” (Terman, Genius and Stupidity, 1906)
![Page 8: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/8.jpg)
![Page 9: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/9.jpg)
Classify children more accurately on the basis of native ability. Necessity of pupils progressing along each of the so-called tracks. “We may refer to these as classes for the ‘gifted,’ ‘bright,’ ‘average,’ ‘slow,’ and ‘special’ pupils.”
(Terman et al., Intelligence Tests and School Reorganization, 1922)
![Page 10: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/10.jpg)
More problems than any pupil can solve in the time given Each skill measured One individual compared with another
(Brown & Coffman, How to Teach Arithmetic, 1914)
![Page 11: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/11.jpg)
Make sense of mathematics Mathematical reasoning matters All students are capable Equitable access and support
![Page 12: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/12.jpg)
“The process of sorting students by their achievement level has the consequence of exposing minority and poor students to lower quality teachers and less-resourced classmates.”(Kalogrides & Loeb, 2013)
![Page 13: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/13.jpg)
![Page 14: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/14.jpg)
Digital Library
![Page 15: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/15.jpg)
Intirim Assessment Options
Interim Comprehensive Assessment (ICA)
Interim Assessment Blocks
(IAB)
![Page 16: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/16.jpg)
* Dependent on item availability.http://www.smarterbalanced.org/wordpress/wp-content/uploads/2014/06/Interim-Assessment-Statement-Purpose-FINALmerged.pdf
![Page 17: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/17.jpg)
Video from Riverside Unified School District
![Page 18: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/18.jpg)
Element SmarterBalanced CSTContinuous Scale gr 3-11 YES NOAchievement Level Descriptions (ALDs) YES NOAdaptive YES NO
(static form)Forced Response Items YES YESConstructed Response (incl Performance Tasks) YES NO
![Page 19: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/19.jpg)
![Page 20: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/20.jpg)
Guessing Game• Think of a number from 1 to 100.• For each of my guesses, tell me whether your number is larger or smaller (or equivalent!).
After each guess and response,• How was my next guess determined? Why??• How did the probability of guessing the number correctly change?
![Page 21: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/21.jpg)
http://www.rasch.org/memo69.pdf
![Page 22: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/22.jpg)
http://www.smarterbalanced.org/wordpress/wp-content/uploads/2011/12/Mathematics-Content-Specifications_July-2015.pdf
![Page 23: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/23.jpg)
Based on EVIDENCE, not “features” Test Content Internal Structure Response Processes (Co)Relations to other variables Consequences of Testing
![Page 24: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/24.jpg)
ClaimsGrades
3–5Grades
6–8 Grade 11Claim 1. Concepts and Procedures 54% 54% 56%Claim 2. Problem Solving Claim 4. Modeling and Data Analysis 24% 24% 23%Claim 3. Communicating Reasoning 22% 22% 21%
![Page 25: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/25.jpg)
![Page 26: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/26.jpg)
TARGET SAMPLING MATHEMATICS GRADE 6Stimuli Items
Claim Content Category Assessment Targets Standards DOK CAT PT CAT PT Total Items Item Types
1. Concepts and Procedures
Priority Cluster E. Apply and extend previous understandings of arithmetic to algebraic expressions. 6.EE.16.EE.26.EE.36.EE.41
0 0
6 0 14
MS, EQ, DD
F. Reason about and solve one-variable equations and inequalities. 6.EE.56.EE.66.EE.76.EE.81,2 MC, MS, DD, EQ, MA
A. Understand ratio concepts and use ratio reasoning to solve problems. 6.RP.16.RP.26.RP.3 1,2 4 MS, EQ,TI, G, MAG. Represent and analyze quantitative relationships between dependent and independent variables.
6.EE.9 3 2 MC, MS, EQ, MA, TI
B. Apply and extend previous understandings of multiplication and division to divide fractions by fractions.6.NS.1 1,2 MC, DD, EQ
D. Apply and extend previous understandings of numbers to the system of rational numbers. 6.NS.56.NS.66.NS.76.NS.81,2 2 MC, MS, EQ, MA, DD, G, HS
Supporting Cluster C. Compute fluently with multi-digit numbers and find common factors and multiples. 6.NS.26.NS.36.NS.4 1,2
0 0 5 0 5
EQ
H. Solve real-world and mathematical problems involving area, surface area, and volume. 6.G.16.G.26.G.36.G.4
1,2 EQ, G
I. Develop understanding of statistical variability. 6.SP.16.SP.26.SP.3 2 MC, MA
J. Summarize and describe distributions. 6.SP.46.SP.5 1,2 MC, MS, EQ, DD, HS, MS
![Page 27: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/27.jpg)
http://www.smarterbalanced.org/wordpress/wp-content/uploads/2011/12/Smarter-Balanced-CCSS-Eligible-Content-Final-Report.pdf
![Page 28: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/28.jpg)
A bat and a ball cost $1.10 in total. The bat costs $1.00 more than the ball. How much does the ball cost?
http://upfrontanalytics.com/SITE/wp-content/uploads/2015/04/System-1-vs-System-2.jpg
![Page 29: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/29.jpg)
http://sbac.portal.airast.org/wp-content/uploads/2013/08/G6_Practice-Test-Scoring-Guide-5.14.14-Final.pdf
• What DOK?• What content domains?
![Page 30: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/30.jpg)
Last 12 weeks (grades 3–8) and 7 weeks (grade 11) of instructional year No Time Limit Variety of item types
• Selected response• Short constructed response• Extended constructed response• Technology enhanced
A small number of items will require hand-scoring by “professionally trained scorers.”30
![Page 31: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/31.jpg)
31http://www.doe.k12.de.us/cms/lib09/DE01922744/Centricity/domain/111/assessment/7d%20SUMMATIVE%20ASSESSMENTS%20.pptx
![Page 32: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/32.jpg)
Roll cursor over shadowed words –glossary pops up
![Page 33: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/33.jpg)
Teacher-Led Classroom Activity Individually administered, computer-generated task One per content area – for math, each PT has a set of 4-6 questions Hand-scored by trained scorers using rubrics.
33
![Page 34: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/34.jpg)
chicken, dog, horse, rat
![Page 35: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/35.jpg)
Count the number of beats in 20 seconds.How many beats per minute?
![Page 36: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/36.jpg)
![Page 37: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/37.jpg)
![Page 38: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/38.jpg)
Trends that appeared for mathematics items: 1. Human agreement was highest for the Use and Apply item type. 2. Human agreement was higher when the rubric contained an exhaustive list of correct responses. 3. Human agreement was higher when precise scoring rules were given for each score point.
http://www.smarterbalanced.org/wordpress/wp-content/uploads/2014/09/Pilot-Test-Automated-Scoring-Research-Studies.pdf
![Page 39: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/39.jpg)
KCRA News Story about SBAC Scoring
![Page 40: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/40.jpg)
![Page 41: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/41.jpg)
![Page 42: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/42.jpg)
![Page 43: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/43.jpg)
Note the choice of language.There are no judgements or claims of potential.
![Page 44: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/44.jpg)
Achievement Level Descriptors• Grade level and Domain specific indicators• See pp. 1-61 of the Math ALD document
Example Grade 6, Ratio and Proportion
![Page 45: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/45.jpg)
“At the high school level, a score at or above Level 3 in 11th grade is meant to suggest conditional evidence of readiness for entry-level, transferable, credit-bearing college courses, assuming the successful completion of senior year coursework” (Darling-Hammond et. al., 2015, p. 12)
![Page 46: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/46.jpg)
http://www.ode.state.or.us/wma/teachlearn/testing/oaks/oaks_reports_userguide.pdf
![Page 47: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/47.jpg)
http://newsroom.ocde.us/2015/09/09/orange-county-students-outpace-the-rest-of-california-on-new-standards-aligned-assessments/
![Page 48: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/48.jpg)
http://www.usatoday.com/story/news/2015/10/28/naep-math-scores-down/74696238/
![Page 49: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/49.jpg)
79 percent of NAEP items in 4th grade math assessed content included in the CCSS at grade 4 or below. But by domain:
• Measurement 95%• Number and Operations 90%• Geometry 68%• Algebra 62%• Data and Statistics 47%
http://www.air.org/news/press-release/new-study-examines-alignment-between-naep-and-common-core-state-standards-4th-8th
![Page 50: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/50.jpg)
![Page 51: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/51.jpg)
http://www.cde.ca.gov/ta/tg/ca/documents/eapstudy.pdf
≥2718 “Exceeded Standard”≥2628 “Met Standard”
![Page 52: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/52.jpg)
“The Smarter Balanced assessments were not designed or validated for purposes such as assessing whether students should be promoted to the next grade or whether a student has demonstrated the competencies needed to graduate from high school.” (Darling-Hammond, et. al., 2015, p. 13)
![Page 53: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/53.jpg)
“In the last year of the STAR tests, more than half of all students met the math standards and just over 56 percent met English standards. In addition, the achievement gap appeared to be narrowing over time.”“In SBAC math, scores were lower and the gaps wider: 69 percent of Asians, 49 percent of whites, 21 percent of Latinos and 16 percent of African-Americans met or exceeded standards.”
http://www.mercurynews.com/california/ci_28782503/califs-test-scores-reveal-yawning-achievement-gap
![Page 54: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/54.jpg)
Standardization amidst variation• Reduces “diversity” to a set of “accommodations”• Ignores issues of access… to well-prepared teachers to well-written curriculum materials to out-of-classroom resources
Lack of expert knowledge of hand-scorers• Reduces content to bullets on a rubric• Devalues student thinking/reasoning
Time spent on test prep and testing
![Page 55: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/55.jpg)
Monitor student progress Inform instructional decisions Evaluate student achievement Evaluate programs
NCTM, 1995
![Page 56: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/56.jpg)
1. How is the Smarter Balanced Assessment system being used to inform: • Your instructional decisions and practices?• Your department’s/team’s decisions and practices?• Your school’s structures/strategies?• Your district’s policies and practices?2. Is it worth the time??
![Page 57: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/57.jpg)
“Ability grouping in the school's classrooms is fluid and temporary”“Any students who master concepts can move upward between groups and student clusters might look different from subject to subject and unit to unit.”
http://www.deseretnews.com/article/865578403/Sorting-kids-at-school-the-return-of-ability-grouping.html?pg=all
![Page 58: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/58.jpg)
58
Recognize mathematics “learning” (and failure) as a product of our unique historical practices.Demand and lead efforts to reevaluate the design and use of assessment.Expect students can learn to make sense of mathematics and change our teaching and/or schooling practices when this is not happening.
Interrupt, Resist, Redefine Practices
![Page 59: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/59.jpg)
![Page 60: :KDW DUH VRPH LVVXHV DVVRFLDWHG DVVHVVPHQWV LQ … · +rz pxfk grhv wkh edoo frvw" kwws xsiurqwdqdo\wlfv frp 6,7( zs frqwhqw xsordgv 6\vwhp yv 6\vwhp msj. kwws vedf sruwdo dludvw](https://reader036.vdocument.in/reader036/viewer/2022071217/604b499d979c24163f74b55c/html5/thumbnails/60.jpg)
Darling-Hammond, L., Haertel, E., & Pellegrino, J. (2015, March). Making Good Use of New Assessments: Interpreting and Using Scores from the Smarter Balanced Assessment Consortium. Retrieved from http://education.vermont.gov/documents/EDU-WhitePaper-Making_Good_Use-of_New_Assessments.pdf Kalogrides, D., & Loeb, S. (2013). Different teachers, different peers: The magnitude of student sorting within schools. Educational Researcher, 42(6), 304-316. National Council of Teachers of Mathematics. (1995). Assessment Standards for School Mathematics. Reston, Va.: NCTM, 1995. Webb, N. (1997; 2006). Criteria for alignment of expectations and assessments on mathematics and science education Monograph number 6. Washington, DC: CCSSO.