parcc update june 6, 2014. parcc update today’s presentation: parcc field test lessons learned...
TRANSCRIPT
PARCC Update
June 6, 2014
PARCC Update
Today’s Presentation: PARCC Field Test Lessons Learned from the Field Test PARCC Resources
2
Introduction to PARCC
The Partnership for Assessment of Readiness for College and Careers:•A consortium of states developing common, high-quality English language arts (ELA) and math tests for grades 3–11
o Computer-based and linked to what students need to know for college and careers
•Two summative assessment components:o Performance-Based Assessment (PBA)o End-of-Year Assessment (EOY)
3
PARCC Field Testing:Schools in 14 States & DC
4
• Over 1 million students
• Nearly 16,000 schools
• 2 grades per school
PARCC Field Testing in New York
• 230 Schools in 75 Districts agreed to participate in the PARCC Field Test in Spring 2014.
• 60% of the field tests were administered online; 40% on paper.
• Field tests were administered in ELA and Math in Grades 3-11.
5
• Opportunity for a number of important research studies.
• Not designed to yield individual student, school, or district results.
• No stakes for schools, teachers, or students.
The field tests are designed to generate data to evaluate the quality of the test questions.
Purpose of Field Tests
6
Field testing the performance-based assessment, which features writing in English Language Arts (ELA) and multi-step, real-world problems in math
MARCH
24
APRIL
11
MAY
5
JUNE
6
Field testing the end-of-year assessment, which features reading comprehension in ELA and conceptual understanding in math
7
Field Testing Windows
Field Test Benefits
• Students become familiar with new item types and the test delivery platform
• Teachers provide feedback to PARCC on “how it went”
• Technology Coordinators evaluate their schools’ technology systems
• Administrators evaluate overall readiness• Test Developers measure the reliability of the
test questions
8
Test Management System
9
Managing Computer-Based Testing
10
Managing Test Sessions
11
Managing Test Sessions
12
The Test Environment
13
The Test Environment - ELA
14
The Test Environment - Math
15
The Test Environment - Math
16
Reviewing Answers
17
Types of Accessibility Features and Accommodations
Features for All Students
Accessibility Features*
Identified in advance
Accommodations**
18
Accessibility Features for All Students Assigned the Computer-Based Test Mode
Accessibility Features for All Students Assigned the Computer-Based Test Mode
Audio Amplification
Blank/Scratch Paper (provided by test administrator)
Eliminate Answer Choices
Flag Items for Review
General Administration Directions Clarified (by test administrator)
General Administration Directions Read Aloud and Repeated (by test administrator)
Text Highlighter Tool
Headphones or Noise Buffers
Line Reader
Magnification/Enlargement Device
Pop-Up Glossary
Redirect Student to Test (by test administrator)
Writing Tools
19
Feedback on the PARCC Field Testfrom New York
PARCC Field Test Studies
21
Field Test Feedback
• PARCC Surveys Test Coordinators Technology Coordinators Test Administrators Students
• NYSED Feedback Sessions Gathering feedback from participating districts
and schools on the field test and technology readiness
• New York feedback is shared with PARCC & Pearson
22
How Will PARCC Use Feedback?
• PARCC staff, Working Groups and Pearson are analyzing feedback
• PARCC will use feedback in summer planning meetings to identify lessons learned and issues to fix for next year
• Feedback will be used to inform decisions on the following:
Technology platform alterations Administrative portal set-up Test administration policies and procedures Direct edits to the test administration manuals and
supporting documents
23
Field Test Feedback
• Overall, across PARCC and in New York, the computer-based field test went smooth with isolated reports of technology challenges.
• Almost all schools in New York that started the computer-based field test were able to complete the test.
• A majority of students responding to the survey after the PBA field test indicated that they would prefer to take the test online.
24
Districts & Schools are saying…
• The test delivery platform worked. There were glitches, but not at every school or for every student.
• Time needed to prepare upfront was significant.
• More staff need to be present to support test administration.
• The field needs clearer documentation, resources, and training.
• Students need practice with the math equation editor.
25
Performance-Based AssessmentStudent Reported Problems - ELA
26
Performance-Based Assessment Student Reported Problems - Math
27
Advice for Preparing for Computer-Based Testing
• Preparation is the key to success.
• Computer-based testing requires a significant time commitment from network and technology staff.
• Teachers and students need to use the technology and tools all year long to be comfortable and prepared for CBT.
28
Communication is Critical
29
• Grades 2-8• Reading, Writing, Math• Some computer adaptive subtests• Designed to pinpoint students’
learning needs
Diagnostic Assessments Mid-Year/Interim Assessments
• Grades 3-11• ELA/Literacy and Math• Paper-based shifting to computer
based• Built from released PBA tasks• Can be used for assessment at
individual, classroom, school levels
K-1 Formative Tasks Speaking & Listening Tools
• Grades K-1• Reading and math• Instructionally embedded
performance tasks
• Grades K-12 • Performance-based activities• Spontaneous oral response to oral
prompt; share findings of research in an oral presentation
30
What’s Coming from PARCC
Resources
Available Resources
http://parcc.pearson.com
32
The PARCC Training Management System is where all the training modules will be located. Go to https://PARCC.pearson.com/TMS to access all training available.
PARCC Training Management System
33
PARCC Practice Tests
Spring 2014 Release• Grades 3–11 Performance-
Based Assessment tests for ELA
• Grades 3–8 End-of-Year tests for mathematics
• Algebra I, Geometry, and Algebra II End-of-Year tests for mathematics
Fall 2014 Release• Grades 3–11 End-of-Year
tests for ELA
• Grades 3–8 Performance-Based tests for mathematics
• Algebra I, Geometry, and Algebra II Performance-Based tests for mathematics
34
http://practice.parcc.testnav.com/
• PARCC Field Test Information http://www.parcconline.org/field-test
• PearsonAccess http://parcc.pearson.com
• Field Test Training Modules http://parcc.tms.pearson.com
• Test Specifications and Blueprints http://www.parcconline.org/assessment-blueprints-test-specs
• PARCC Online Sample Items http://practice.parcc.testnav.com
• PARCC Accessibility Features and Accommodations Manual http://www.parcconline.org/parcc-accessibility-features-and-
accommodations-manual • Model Content Frameworks
www.parcconline.org/parcc-model-content-frameworks
PARCC Resources
35
Jennifer SattemPARCC Field Test Lead for NY