![Page 1: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/1.jpg)
Value Added in CPS
![Page 2: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/2.jpg)
What is value added?
• A measure of the contribution of schooling to student performance
• Uses statistical techniques to isolate the impact of schooling from other factors
• Focuses on how much students improve from one year to the next
![Page 3: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/3.jpg)
Demographic adjustments
• Value added makes adjustments for demographics of schools and classrooms
• Adjustments determined by relationships between growth, student characteristics
• Adjustments measure partial differences in growth across groups district-wide
![Page 4: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/4.jpg)
Some schools with low percent meet/exceed are high value-added schools in which students grow
![Page 5: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/5.jpg)
Value added in many domains
• Annual state assessments– Focus on year-to-year student improvement
• Short-term assessments– Focus on short-term student improvement– Potentially faster turnaround
• High school assessments– Explore/PLAN/ACT, for example– Focus on improvement in high school
![Page 6: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/6.jpg)
Value added in CPS
• Based on ISAT for grades 3 through 8• Analyzes students’ ISAT scores,
demographics, and schools attended• Schools and classrooms where students
improve more (relative to similar students) identified as high value added
• Extra ISAT points gained by students at a school/classroom on average relative to observably similar students across district
![Page 7: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/7.jpg)
Alternative understanding
• Average student gain on ISAT relative to district average, with adjustments for:– Shape of the test scale (Prior ISAT score)– Grade level– Gender, mobility, free/reduced-price lunch,
race/ethnicity, disability, language proficiency, homelessness, other-subject pretest
– Enrollment in multiple schools or classrooms
![Page 8: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/8.jpg)
Regression model (in English)
Posttest Pretest
Post-on-Pre Link
StudentCharacteristics
School andClassroom
Effects
UnobservedFactors
= x
+ + +
ValueAdded
![Page 9: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/9.jpg)
Student characteristics
• Gender
• Race/ethnicity
• Free or reduced-price lunch
• Language proficiency (by Access score)
• Disability (by disability type)
• Mobility
• Homelessness
• Other-subject pretest
![Page 10: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/10.jpg)
Why include student characteristics?
• One goal of value-added analysis is to be as fair as possible
• We want to remove the effect of factors that were not caused by the school during the specific period we are evaluating
![Page 11: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/11.jpg)
Examples
Curriculum
Classroom teacher
School culture
Math pull-out program at school
Structure of lessons in school
Safety at the school
Value added reflects theimpact of these factors
Examples
Student motivation
English Language Learner Status
At home support
Household financial resources
Learning disability
Prior knowledge
These factors need to be measured and isolated
Related to the schoolNot related to the
school
What do we want to evaluate?
![Page 12: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/12.jpg)
Controlling for other factors
• Students bring different resources to the classroom.
• These factors can affect growth, so we want to remove the effects of these non-school factors.
Examples
Student motivation
English Language Learner Status
At home support
Household financial resources
Learning disability
Prior knowledge
These factors need to be measured and isolated
Not related to the school
![Page 13: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/13.jpg)
Controlling for other factors
• In order to include a characteristic in the model, we must have data on that characteristic for all students.
• Some characteristics are harder to measure and collect than others.
• The data that we do have available can tell us something about the effect of data we would like to have.
![Page 14: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/14.jpg)
Controlling for other factors
• For example, we can use free or reduced-price lunch as a substitute for our ideal data about household finances in our calculations.
What we want
• Household financial resources
What we have
• Free or reduced-price lunch
Related data
![Page 15: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/15.jpg)
Adjustments are based on real data
• Why is it important that VARC uses student test scores to calculate adjustment factors?– We do not have a preconceived notion of which
student subgroups will grow faster than others
– We want to be as fair as possible when evaluating school performance
– Student subgroups perform differently on each subject area from year-to-year
– We want our adjustments to apply specifically to the situation we are evaluating
![Page 16: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/16.jpg)
Multiple regression
• Measures effects of each variable on posttest controlling for all other variables– Effect of pretest on posttest controls for
student characteristics, schools– Effects of student characteristics on posttest
control for pretest, schools– Effects of schools (value added) on posttest
control for pretest, student characteristics
• All effects measured simultaneously
![Page 17: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/17.jpg)
Dosage
• Accounts for students changing schools and classrooms
• Students enrolled in a school or classroom for a fraction of a year get a fractional “dose” of the school’s or classroom’s effect
• Apportions student growth among schools and classrooms enrolled in the same year
![Page 18: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/18.jpg)
Pretest measurement error
• Pretest measures student attainment in previous year with measurement error– Models that ignore this will bias in favor of
high-attainment schools and classrooms
• Measurement error is accounted for in VA model to correctly account for pretest– Using approaches in Fuller (1987)– Ensures against bias
![Page 19: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/19.jpg)
Models that correct for measurement error avoid biasing in favor of schools and classrooms with high initial scores
![Page 20: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/20.jpg)
Value added model
• All of these features ensure that value added reflects the results of schooling on student achievement
• Value added uses the data available to measure the impact of schools and classrooms as accurately, fairly, and realistically as possible
![Page 21: Value Added in CPS. What is value added? A measure of the contribution of schooling to student performance Uses statistical techniques to isolate the](https://reader036.vdocument.in/reader036/viewer/2022062618/551484e2550346b0158b59ff/html5/thumbnails/21.jpg)
Work in progress
• Classroom-level value added– Measures student growth within classrooms
• Differential effects value added– Measures growth among students of a
particular group (ELL, disability, etc.) in a school or classroom
• Value added from other assessments– Scantron (short-term)– Explore/PLAN/ACT (high school)