![Page 1: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/1.jpg)
December 10, 2010Elaine Wood, Science Assessment Specialist
Upcoming Science Assessments:
the 2011 HSPE and the 2012 Biology End-of-Course Exam
![Page 2: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/2.jpg)
Science Assessment OfficeElaine Wood—Secondary Specialist
Kara Monroe—Elementary [email protected]
Troi Williams—Administrative [email protected]
![Page 3: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/3.jpg)
TopicsGrade 5 & 8 Measurements of
Student ProgressNew StandardsStandard Setting
High School Update2011 High School Proficiency Exam 2012 Biology End-of-Course ExamStudent Performance
Resources available
![Page 4: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/4.jpg)
Measurements of Student Progress
Assessing new standards in 2011
![Page 5: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/5.jpg)
From WASL to Measurements of Student Progress
Embedded pilot items bring the item total to 40.The K-12 Science Learning Standards will be assessed for the first time in 2011.
Grade 8 2009WASL
2010MSP
2011MSP
Multiple Choice 28 30 26-29
Completion NA pilot only 1-4
Short Answer 7 5 5
Extended Response 2 0 0
% Points from MC/CP 56% 75% 75%
![Page 6: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/6.jpg)
Operational ScoringOperational ScoringOperational RangefindingOperational
Rangefinding
Operational TestingOperational Testing Data ReviewData Review Pilot ScoringPilot Scoring
Pilot RangefindingPilot RangefindingScenario & Item
Pilot TestingScenario & Item
Pilot Testing
Science Assessment Development Cycle
Science Assessment Development Cycle
Scenario & Items Reviewed for
Content & Bias/Sensitivity by
Committees
Scenario & Items Reviewed for
Content & Bias/Sensitivity by
Committees
Scenario & Items Reviewed for
Content by OSPI
Scenario & Items Reviewed for
Content by OSPI
Scenario & Item Writing
Scenario & Item Writing
Develop Item and Test
Specifications
Develop Item and Test
Specifications
![Page 7: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/7.jpg)
Standard Setting
for Science MSP in 2011
![Page 8: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/8.jpg)
Science Standard Setting Plan
Date EventJune 2009 New Science standards approvedMay 2010 Spring 2010 MSP; New items pilotedAug 2010 Test Map meeting
Sept 2010 Performance Level Descriptors (PLDs) developedOct 2010 Spring 2011 tests built
![Page 9: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/9.jpg)
Science Standard Setting Plan
Date EventJune 2009 New Science standards approvedMay 2010 Spring 2010 MSP; New items pilotedAug 2010 Test Map meeting
Sept 2010 Performance Level Descriptors (PLDs) developedOct 2010 Spring 2011 tests built
Feb/Mar 2011 Teachers from across state trained on how to use PLDs to participate in Contrasting Groups Study (CGS)
Mar/Apr 2011 NTAC and SBE formally approve standard setting planApril 2011 Teachers participate in CGS by providing ratings of studentsMay 2011 Spring 2011 MSP administered
![Page 10: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/10.jpg)
Science Standard Setting Plan
Date EventJune 2009 New Science standards approvedMay 2010 Spring 2010 MSP; New items pilotedAug 2010 Test Map meeting
Sept 2010 Performance Level Descriptors (PLDs) developedOct 2010 Spring 2011 tests built
Feb/Mar 2011 Teachers from across state trained on how to use PLDs to participate in Contrasting Groups Study (CGS)
Mar/Apr 2011 NTAC and SBE formally approve standard setting planApril 2011 Teachers participate in CGS by providing ratings of studentsMay 2011 Spring 2011 MSP administeredAug 2011 Standard Setting events:
--Grade level panels (use “Bookmark process”, start with teacher ratings)
--“Policy panel” recommendations--NTAC certifies the planned process was followed
Aug 2011 SBE Sets Achievement Standards (Reviews all recommendations)
![Page 11: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/11.jpg)
“Contrasting Groups” method affords broader involvement in standard setting
Everyone in the state who teaches science in grades 5 and 8 is invited to help set the performance standards.
•Performance Level Descriptors (PLDs) are developed for “Basic” and “Proficient”
•Web-based training on PLDs is provided to participating teachers
•In April, participating teachers judge each of their students as being “Basic or below” or “At or above Proficient”
•Two distributions of scores are produced: Scores obtained by students rated as “Basic”, and scores for “Proficient”
•Where the two distributions merge represents the separation point between “Basic” and “Proficient.”
![Page 12: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/12.jpg)
Students rated as “Basic or below” using criteria in PLD for Basic
Students judged to be at or below "Basic"
Points on MSP (simulated)0 2 10 6 84 12 14 16 18 20 22 23 24 26 30 3228 34 40 36 38
Raw score points
Number of
students
![Page 13: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/13.jpg)
Students rated as “Proficient or above” using criteria in PLD for Proficient
Students judged to be "Proficient" or above
Points on MSP (simulated)0 2 10 6 84 12 14 16 18 20 22 23 24 26 30 3228 34 40 36 38
Raw score points
Number of
students
![Page 14: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/14.jpg)
Students judged to be at or below "Basic"
Students judged to be "Proficient" or above
Points on MSP (simulated)0 2 10 6 84 12 14 16 18 20 22 23 24 26 30 3228 34 40 36 38
Intersection indicates a region for where “Basic” separates from “Proficient”
Raw score points
Number of
students
![Page 15: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/15.jpg)
Upcoming Events – Grade 5 & 8
Scenario and Item Writing – Feb. 14-18, 2011Content Review – April 4-8, 2011
PLD Training – Available via Moodle, Feb. 1, 2011Learn to use evidence to evaluate 5th or 8th grade
students’ proficiencyTakes 3 hours; 3 free clock hours are availableTo sign up, go to link and create an account
http://moodle.ospi.k12.wa.us/course/view.php?id=19
Contrasting Groups Study – Available via EDS, April 11-29After completing the PLD Training, 5th or 8th grade
teachers can predict their students’ performance on the MSP
5th and 8th grade science teachers can gain access to the EDS application by contacting a District Assessment Coordinator
Standard Setting – August 1-4, 2011
![Page 16: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/16.jpg)
High School Proficiency Exam
A graduation requirement for sophomores in 2011
![Page 17: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/17.jpg)
From WASL to High School Proficiency Exam to End of Course
High School 2009WASL
2010HSPE
2011HSPE
2012 EOC
Multiple Choice/Completion 28 35 35 ?
Short Answer 11 5 5 ?
Extended Response 3 0 0 ?
% Points from MC 45% 78% 78% ?
Embedded pilot items bring the item total to 45.Completion items will be piloted in 2011 and will be operational in 2012.The K-12 Science Learning Standards will be assessed beginning in 2012.
![Page 18: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/18.jpg)
Implementation TimelineHSPE for 2011 will assess the 2005 GLEs
April 12, 2011
Biology EOC in 2012 will be administered to any student enrolled in a course credited as high school level biologyK-12 Science Learning StandardsOnline participation will be voluntary
Goal: 50% Online in 2012
First retake opportunity for biology EOC is likely to be January/February 2013
Possible additional science EOCs? TBD by LegislatureSuperintendent to make recommendation
![Page 19: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/19.jpg)
Science Graduation Requirement: Classes of 2013 and BeyondUnder current rules, the students in the classes of
2013 and beyond can meet the science graduation requirement by:
Passing the science HSPE in spring 2011 and/or summer 20119th graders are not eligible to take science HSPE
Passing the biology EOCBegins in spring 2012; scores available August 2012
Meeting comparison scores on the SAT 2 or ACTScores set during the 2012-13 school year
Passing a science Collection of EvidenceBecomes available in the 2011-12 school year
![Page 20: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/20.jpg)
Operational ScoringOperational ScoringOperational RangefindingOperational
Rangefinding
Operational TestingOperational Testing Data ReviewData Review Pilot ScoringPilot Scoring
Pilot RangefindingPilot RangefindingScenario & Item
Pilot TestingScenario & Item
Pilot Testing
Science Assessment Development Cycle
Science Assessment Development Cycle
Scenario & Items Reviewed for
Content & Bias/Sensitivity by
Committees
Scenario & Items Reviewed for
Content & Bias/Sensitivity by
Committees
Scenario & Items Reviewed for
Content by OSPI
Scenario & Items Reviewed for
Content by OSPI
Scenario & Item Writing
Scenario & Item Writing
Develop Item and Test
Specifications
Develop Item and Test
Specifications
![Page 21: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/21.jpg)
Upcoming Events – High SchoolScenario and Item Writing
Feb. 21-25, 2011
June 20-24, 2011
Content Review March 28 – April 1, 2011
Aug. 15-19, 2011
Test Map – Spring 2011PLD Development – September 2011PLD Training – Winter 2011/12Standard Setting – August 2012
![Page 22: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/22.jpg)
Patterns in Student Performance
High School WASL and HSPE
![Page 23: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/23.jpg)
Strengths Areas to Improve Writing conclusions
52% to 58% earn full points
Identifying variables in investigations72% to 88% correct
Writing constructed response items related to investigations or solving human problems.
Explaining energy transfers or transformations in a system
Addressing persistent misconceptions
![Page 24: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/24.jpg)
Resources Available
From the OSPI website www.k12.wa.us
![Page 25: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/25.jpg)
OSPI Science Assessment Webpage
www.k12.wa.us
www.k12.wa.us/science
www.k12.wa.us/Science/Assessments.aspxSelect Science
Assessment from
Assessment Drop-down
Select Assessm
ents
![Page 26: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/26.jpg)
Science Assessment ResourcesTest and Item Specifications—more
information about:Grade 5 & 8:
Types of scenariosTest mapItem specificationsVocabulary listsCognitive complexity
High School:Item specifications for 2005 GLEsVocabulary lists
NOTE: Test and Item Specifications for EOC coming late fall 2011
![Page 27: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/27.jpg)
www.k12.wa.us/Science/Assessments.aspx
Grade 5 & 8 Test and Item Specs
www.k12.wa.us/Science/TestItemSpec.aspx
Select Test and
Item Specificati
ons
Select a
Grade
![Page 28: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/28.jpg)
www.k12.wa.us/Science/Assessments.aspx
2011 HSPE Test and Item Specs
www.k12.wa.us/Science/TestItemSpec.aspx
Select Test and
Item Specificati
ons
Select GLEs with MSP and HSPE Evidences of Learning Science Item Specifications
![Page 29: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/29.jpg)
Science Assessment ResourcesUpdates for 2011—each grade level
contains:General information on the 2011 testSample itemsScoring information, including rubrics
![Page 30: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/30.jpg)
Updates for 2011
www.k12.wa.us/Science/Assessments.aspx
http://www.k12.wa.us/Science/EducatorResources.aspx
Select a
Grade
Select Educato
r Resourc
es
![Page 31: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/31.jpg)
Science Assessment ResourcesTeacher Resource tool:
Types of scenariosGeneric questionsItem specifications (2005 GLEs)Cognitive complexity
Note that all tests posted here assess the 2005 GLEs.
![Page 32: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/32.jpg)
Teacher Resource Tool
www.k12.wa.us/Science/Assessments.aspx
Select a Grade and a Year
Select Science
Select Teacher
Resource Tool
www.k12.wa.us/TeacherResourceTool2009-10/default.aspx
![Page 33: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/33.jpg)
Teacher Resource Tool
Type of scenario
Generic question,
rolls over to item
specification
Percent correct or
mean score
![Page 34: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/34.jpg)
Additional ResourcesPowerful Classroom Assessments (PCAs)—
Teaching materials developed from WASL released itemsNew PCAs will be developed in future for K-12 Science Learning
StandardsEach PCA includes:
Sample itemsScoring information, including rubrics
Item Analysis from the Assessment OverviewWebsite
https://eds.ospi.k12.wa.us/WASLTestItems/
Summary of performance on released WASL items by school, district and state
![Page 35: Upcoming Science Assessments: the 2011 HSPE and the 2012 Biology End-of-Course Exam](https://reader035.vdocument.in/reader035/viewer/2022062809/5681593c550346895dc67ab5/html5/thumbnails/35.jpg)
Thank you.