introduction to cem and the baseline tests
DESCRIPTION
Introduction to CEM and the Baseline Tests. Dr Robert Clark. Who / What is CEM ?. Centre for Evaluation & Monitoring Not for Profit Organisation Part of Durham University Close links to School of Education Established 1985 Nursery / Reception Post-16 - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/1.jpg)
Introduction to CEM and the Baseline Tests
Dr Robert Clark
![Page 2: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/2.jpg)
Who / What is CEM ?
![Page 3: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/3.jpg)
Centre for Evaluation & Monitoring• Not for Profit Organisation• Part of Durham University• Close links to School of Education• Established 1985• Nursery / Reception Post-16• Monitoring Systems, Research and Evaluation Projects• UK & International• Over 1/3 Secondary & Post-16 Establishments• Informed by Evidence from Research
![Page 4: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/4.jpg)
CEM Provides• Information Systems from Nursery to Post-16
Student Guidance & Chances Performance Monitoring
• Evaluation & Research Projects• Entrance Testing• Support – Phone, email, documentation• Training• INSET• Roadshows• Conferences (including exhibitions)
![Page 5: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/5.jpg)
The Systems
![Page 6: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/6.jpg)
The Systems
Year 7Year 8
Year 9MidYIS Computer Adaptive Baseline Test
Year 10Year 11 Yellis
Computer Adaptive Baseline Test
Year 12Year 13 Alis
GCSE Computer Adaptive Baseline Test
GCSE
A / AS / Btec / IB etc
INSIGHT Combines curriculum tests with developed ability
KS3
![Page 7: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/7.jpg)
Typical TimelineMeasure BaselineSTART:
Autumn Term
Feedback
Reports
Collect and Send Results
Value-Added
Feedback
August
END:
September
The baseline score is measured as early as possible and the information sent to CEM
The institution then receives feedback from CEM: baseline test results and predictions
The public examination results are sent to CEM when received by the institution
The value added data is available from September via the Institution’s website at CEM
Typical Timeline
Early Testing & Predictions
Testing is available from June at end of previous academic year
e.g. Y6 / Y9 / Y11
![Page 8: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/8.jpg)
Basic Principles:
• Measure Student’s ability Intake Profiles IPR - Strengths and Weaknesses
• Project future performance from national trends Predictions
• Record Final Grade
• Compare actual performance to Projected Performance Value-Added Reports
![Page 9: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/9.jpg)
Starting Up
![Page 10: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/10.jpg)
Pre-16• Complete and return registration form
Paper for new schools Online through secure website for renewals
• Organise Baseline Testing Available from 1st June (early testing) through to 30th April Upload pupil list via secure website Set up web links to test (or download LAN version) Test students (can be done over extended period)
• Download Feedback Available within 2 hours of a student completing the test Feedback updated as more students complete test
![Page 11: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/11.jpg)
Secure Website - Secondary : Pre-16
![Page 12: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/12.jpg)
Secondary : Pre-16 – Adaptive Test Instructions
Download Instructions
Upload Pupil Details
Link to tests
![Page 13: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/13.jpg)
Secondary : Pre-16 – INSIGHT Test Instructions
Download Instructions
Upload Pupil Details
Link to tests
![Page 14: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/14.jpg)
Post-16• Complete and return registration form
Paper for new schools Online through secure website for renewals
• Organise Baseline Testing Available from 1st June (early testing) through to 30th April Student list NOT used – do not need to upload Set up web links to test (or download LAN version) Test students (can be done over extended period)
• Upload ‘Registration Spreadsheet’ Names, gender, dob, average GCSE score, post-16 course
choices etc Upload via secure website once students confirmed on course
(mid September ?)• Download Feedback
Early Predictions available from adaptive test within 2 hours Formal feedback including IPRS, GCSE predictions and
chances graphs available once Registration Spreadsheet processed & ‘Testing Complete’ clicked
![Page 15: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/15.jpg)
Secure Website - Post-16
Quick linksto reports
Date last generated
![Page 16: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/16.jpg)
Post-16 : Adaptive Test Instructions
Use this web link
![Page 17: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/17.jpg)
Baseline Assessments of Developed Ability
![Page 18: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/18.jpg)
Baseline Assessment
• Year 7 (8)• Year 9• Year 10 (11)• Year 12 (13+)
Computer Adaptive Baseline Test
Vocab Maths Non Verbal
![Page 19: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/19.jpg)
What is an Adaptive test ?
• All questions allocated to groups of different difficulty• All students in a year group get common difficulty starting question• If answer correct, next question harder• If answer wrong, next question easier• Test looks at all answers in a section and homes in on questions of a
suitable difficulty for student
Try it yourself at www.intuproject.org/demos
![Page 20: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/20.jpg)
X
![Page 21: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/21.jpg)
Standardisation
• Test scores are standardised; Mean = 100, SD = 15
Standardised Score
National Percentage
Comment
>130 Top 2.5% Traditional classification of ‘mentally gifted’
>120 Top 10%
>100 Top 50%
<80 Bottom 10%
<70 Bottom 2.5% Potential special educational needs ??
![Page 22: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/22.jpg)
The Computer Adaptive Baseline Test:
• Adaptive components common to MidYIS, Yellis, and Alis are:– Vocabulary– Maths
• Non- adaptive sections:– Non-verbal (MidYIS, Yellis, Alis)– Skills (MidYIS only)
• Assessments are ‘curriculum free’: i.e. students are not taught prior to the test
• Measure of acquired ability• There is no preparation for the test
![Page 23: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/23.jpg)
Difficult vocabulary
![Page 24: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/24.jpg)
Difficult maths
x/4 + 2
![Page 25: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/25.jpg)
Non-Verbal: Cross-sections
![Page 26: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/26.jpg)
Non-Verbal: Blocks
3
![Page 27: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/27.jpg)
PicturesNon-Verbal: Pictures
![Page 28: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/28.jpg)
Skills: Proof Reading
![Page 29: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/29.jpg)
Skills: Perceptual Speed and Accuracy
![Page 30: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/30.jpg)
Alis - Patterns
![Page 31: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/31.jpg)
Alis – Logical Reasoning
![Page 32: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/32.jpg)
Additionally for INSIGHT:Developed Ability
• Vocabulary
• Non verbal, Skills
• Attitudinal measures
Curriculum-based assessments covering:
Maths - Number & Algebra- Handling Data- Space, Shape & Measurement
Science - Biology, Chemistry, Physics, - Attitudes to Science
Reading - Speed Reading- Text Comprehension- Passage Comprehension
INSIGHT
![Page 33: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/33.jpg)
INSIGHT - Maths
7
![Page 34: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/34.jpg)
INSIGHT - Maths
![Page 35: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/35.jpg)
Plus Attitude to Science: Perception of Science, Relevance to Self, Environmental Actions, Enjoyment of Science
INSIGHT - Science
![Page 36: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/36.jpg)
INSIGHT – Reading(Text Comprehension)
![Page 37: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/37.jpg)
INSIGHT – Reading(Passage Comprehension)
![Page 38: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/38.jpg)
INSIGHT – Reading(Speed Reading)
![Page 39: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/39.jpg)
INSIGHT – Developed Ability
![Page 40: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/40.jpg)
Measuring AbilityKey Stage Data
or Baseline Test ?
![Page 41: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/41.jpg)
Key Stage Baselines – KS2; GCSEStrengths WeaknessesRelated to curriculum Dependent on teaching effectiveness (prior Value-
Added) as well as student ability
Automatically available Open to manipulation
In Depth Not all students have KS data
Linked to student learning experience
Reliability of KS measure
Consistency of KS score (i.e. GCSE & Btec First etc)
Independent Baseline Test – CEM Adaptive Test
![Page 42: Introduction to CEM and the Baseline Tests](https://reader038.vdocument.in/reader038/viewer/2022103007/568161c2550346895dd1a829/html5/thumbnails/42.jpg)
Thank YouRobert Clark – [email protected]