pisa and the oecd test for schools international benchmarking for schools and school districts...
TRANSCRIPT
![Page 1: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/1.jpg)
PISA AND THE OECD TEST FOR SCHOOLSInternational benchmarking for schools and school districts
Atlanta, October 2, 2014
Tue HalgreenDirectorate for Education and SkillsOECD
![Page 2: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/2.jpg)
THE GLOBAL CONTEXT
![Page 3: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/3.jpg)
3 The structure of the PISA assessment
2000 2003 2006 2009 2012
Reading Reading Reading Reading Reading
Mathematics Mathematics Mathematics Mathematics Mathematics
Science Science Science Science Science
Problem Solving
Digital Reading
Problem Solving, Financial literacy,
Digital Math, Digital reading
![Page 4: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/4.jpg)
Helen the CyclistHelen has just got a new bike. It has a speedometer which sits on the handlebar. The speedometer can tell Helen the distance she travels and her average speed for a trip.
Helen rode 6 km to her aunt’s house. Her speedometer showed that she had averaged 18 km/h for the whole trip.
PISA 2012 Sample Question
Which one of the following statements is correct?
A.It took Helen 20 minutes to get to her aunt’s house.
B.It took Helen 30 minutes to get to her aunt’s house.
C.It took Helen 3 hours to get to her aunt’s house.
D.It is not possible to tell how long it took Helen to get to her aunt’s house.
![Page 5: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/5.jpg)
Percent of 15-year-olds who scored Level 3 or Above
PISA 2012 Sample Question
![Page 6: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/6.jpg)
Fig I.2.133
High mathematics performance
Low mathematics performance
… Shanghai-China is above this level (613)
Mean performance in mathematics – PISA 2012
…12 countries perform below this line
![Page 7: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/7.jpg)
Low mathematics performance
Fig I.2.134
High mathematics performance
Performance and equity: a tradeoff ?
High impact of socio-economic
condition on student outcomes
Low impact of socio-economic condition on outcomes
![Page 8: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/8.jpg)
Percentage of top performers in mathematics in 2003 and 2012
Fig I.2.238
![Page 9: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/9.jpg)
What makes schools andschool systems
successful?
9
![Page 10: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/10.jpg)
Cumulative expenditure per student (6 to 15) and maths performance in PISA 2012
Cumulative expenditure per student below USD 50 000
Cumulative expenditure per student above USD 50 000
Fig IV.1.8
![Page 11: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/11.jpg)
1111 Align the resources with the challenges
Greater equityLess equity
Adjusted by per capita GDP
Countries with better performance in mathematics tend to allocate educational resources more equitably
Source: PISA 2012
![Page 12: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/12.jpg)
1212 Adequate resources to address disadvantage
Disadvantaged schools reported more teacher shortage
Advantaged schools reported more teacher shortage
A shortage of qualified teachers is more of concern in disadvantaged schools
![Page 13: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/13.jpg)
Among high-income countries high-performers pay teachers more
Per capita GDP less than USD 20 000
Per capita GDP over USD 20 000
Fig IV.1.10
![Page 14: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/14.jpg)
Countries that grant schools autonomy over curricula and assessments tend to perform better in mathematics
Fig IV.1.15
![Page 15: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/15.jpg)
Schools with more autonomy perform better than schools with less autonomy in systems with more accountability arrangements
Score points
School autonomy for curriculum and assessment x system's level of posting achievement data publicly
Fig IV.1.16
![Page 16: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/16.jpg)
HOW MUCH DO YOU KNOW ABOUT HOW YOUR SCHOOL / DISTRICT
COMPARES INTERNATIONALLY?
![Page 17: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/17.jpg)
OECD TEST FOR SCHOOLS (BASED ON PISA)
![Page 18: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/18.jpg)
OECD Test for Schools (based on PISA)Overview
Based on international PISA test of 15-year olds. All results are comparable to international PISA scales
Can be used by schools, networks of schools and districts
Goes beyond testing whether students can reproduce what they were taught to assess students’ capacity to extrapolate from what they know and creatively apply their knowledge in novel situations
Provides information on students’ engagement and the learning environment at the school
![Page 19: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/19.jpg)
OECD Test for Schools (based on PISA)What does the assessment look like?
• Experience for students similar to that of the main PISA tests: 3h 15min
• Three assessment domains: reading, math, science
• Student sample size per school: 75 (some schools may test over 100 students)
• A comprehensive (150 pages) school report for each participating school
![Page 20: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/20.jpg)
![Page 21: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/21.jpg)
OECD Test for Schools (based on PISA)Timeline
Pilot
126 schools across US, UK, Canada
Roll out
285 schools in the US
2nd round
Open for sign up
Global Learning Network
Future plans
Computer-based delivery
New item formats
International availability
![Page 22: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/22.jpg)
OECD Test for Schools (based on PISA)2013-2014 School Year Participation
• 285 schools tested between November 2013 and April 2014, representing:– 27 states– 119 school districts
![Page 23: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/23.jpg)
OECD Test for Schools (based on PISA)2013-2014 School Year Participation
285 schools participated
22
3343
27 > 20 schools
10-19 schools
1-9 schools
![Page 24: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/24.jpg)
OECD Test for Schools (based on PISA)School performance
Per
form
ance
on
PIS
A s
cale
Mathematics
PISA 2012
10% above
10% above
25 % above
25 % above
50% above/below
50% above/below
25% below
25% below
10% below
10% below
Schools in the United States
Schools in Shanghai-
China
OECD Test for Schools
OECD TFS2013/14
![Page 25: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/25.jpg)
Socioeconomic status (ESCS)
Per
form
ance
on
PIS
A s
cale
OECD Test for Schools (based on PISA)Performance and socio-economic status
Schools that participated in OECD TfS 2013-2014
Schools that participated in the US in PISA 2012
Schools above the diagonal line perform better than what would be expected given the socio-economic status of their students
Mathematics
![Page 26: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/26.jpg)
OECD Test for Schools (based on PISA)Measuring socio-economic background
• ESCS is an international measure of students’ socio-economic and cultural status, based on the parents’ educational level parents’ occupational status home possessions including cultural and
educational resources
![Page 27: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/27.jpg)
Socioeconomic status (ESCS)
% o
f s
tud
en
ts e
lig
ible
fo
r fr
ee
/re
du
ce
d l
un
ch
pri
ce
s Schools that participated in OECD TfS 2013-2014
OECD Test for Schools (based on PISA)Measures of socio-economic status
![Page 28: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/28.jpg)
Socioeconomic status (ESCS)
Per
form
ance
on
PIS
A s
cale
OECD Test for Schools (based on PISA)Comparison with schools in Mexico
Schools that participated in OECD TfS 2013-2014
Schools that participated in Mexico in PISA 2012
Mathematics
![Page 29: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/29.jpg)
Socioeconomic status (ESCS)
Per
form
ance
on
PIS
A s
cale
OECD Test for Schools (based on PISA)Comparison with schools in Shanghai-China
Schools that participated in OECD TfS 2013-2014
Schools that participated in Shanghai-China in PISA 2012
Mathematics
![Page 30: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/30.jpg)
OECD Test for Schools (based on PISA)Timeline
Pilot
126 schools across US, UK, Canada
Roll out
285 schools in the US
2nd round
Open for sign up
Future plans
Computer-based delivery
New item formats
International availability
![Page 31: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/31.jpg)
OECD Test for Schools (based on PISA)International availability
• Spain: Pilot study carried out in 2013 Spanish version to be made available to other
Spanish-speaking countries.
• United Kingdom: • Available from this school year (2014/15)
• Growing interest from other countries
![Page 32: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/32.jpg)
UNDERSTANDING YOUR RESULTS FROM THE
OECD TEST FOR SCHOOLS
![Page 33: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/33.jpg)
OECD Test for Schools (based on PISA)School report
• 150 page eBook:
1. Introduction: Understanding Your School’s Results2. What Students at Your School Know and Can Do in
Reading, Mathematics and Science3. Student Engagement and the Learning Environment at
Your School in an International Perspective4. Your School Compared with Similar Schools in Your
Country5. Your School’s Results in an International Context
School nameSchool DistrictStateUnited States
How your school compares internationally
OECD Test for Schools2014 - 2015
![Page 34: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/34.jpg)
Proficiency levels
![Page 35: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/35.jpg)
![Page 36: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/36.jpg)
OECD Test for Schools (based on PISA)Overview of results (from the pilot)
What does the same mean mean? 543 and 543
Reading
Level 1 and be`low Level 2 Level 3 Level 4 Level 5 Level 6
![Page 37: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/37.jpg)
Six reader profiles
![Page 38: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/38.jpg)
![Page 39: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/39.jpg)
![Page 40: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/40.jpg)
Quality of teacher-student relations
![Page 41: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/41.jpg)
Disciplinary climate and student performancce
![Page 42: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/42.jpg)
Motivation of students to learn science
![Page 43: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/43.jpg)
Instrumental motivation and performance at your school
![Page 44: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/44.jpg)
OECD Test for SchoolsSchool Reports
![Page 45: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/45.jpg)
HOW TO PARTICIPATE
![Page 46: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/46.jpg)
OECD Test for Schools (based on PISA)2014-2015 School Year Testing
• Testing to begin on October 15, 2014
• CTB accredited service provider
• New version of school report eBook: Newest international evidence andcomparison data, 42 updated figures School name
School DistrictStateUnited States
How your school compares internationally
OECD Test for Schools2014 - 2015
![Page 47: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/47.jpg)
OECD Test for Schools (based on PISA)Sign up
ctb.com/OECDTestforSchools
![Page 48: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/48.jpg)
![Page 49: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/49.jpg)
OECD Test for Schools (based on PISA)Implementation Toolit
1. Leading your OECD Test Program2. Interpreting Your School Results3. Case Studies4. Additional Resources
![Page 50: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/50.jpg)
OECD Test for Schools (based on PISA)Leading Your OECD Test Program
• Communicate the VISION and PURPOSE of the program
• Practice effective collaboration and coordination between the district office and individual schools
• Promote trust and safety for participants• Provide appropriate time and resources for your team• Include teachers in every step• Establish the team and assign clear roles and
responsibilities• Focus on the schedule, as well as student and parent
buy-in
![Page 51: PISA AND THE OECD TEST FOR SCHOOLS International benchmarking for schools and school districts Atlanta, October 2, 2014 Tue Halgreen Directorate for Education](https://reader035.vdocument.in/reader035/viewer/2022062315/56649ea45503460f94ba8bae/html5/thumbnails/51.jpg)
OECD Test for Schools (based on PISA)
Thank you!