oregon’s science achievement level descriptors and standards
DESCRIPTION
OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS. Policy Definitions, Achievement Level Descriptors, Science Achievement Standards (Cut Scores) for General Education and for Alternate Assessment. Recommending Adoption of Science Achievement Standards and Level Descriptors. Overview - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/1.jpg)
Policy Definitions, Achievement Level Descriptors, Science Achievement Standards (Cut Scores)
for General Education and for Alternate Assessment
1
![Page 2: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/2.jpg)
Overview Kathleen Vanderwall, OAIS
External Evaluation Mary Seburn, Educational Policy Improvement Center
Implementing 2009 Content Standards for Instructional Improvement
Monument School District, Rachel Aazzerah North Clackamas School District, Meagan Sternberg
2
![Page 3: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/3.jpg)
3
![Page 4: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/4.jpg)
Policy Definitions are general statements that describe rigor across grade levels and content areas and provide an overarching definition for each achievement level. They are used for all subjects.
Achievement Level Descriptors (ALDs) explain a student’s knowledge and skills at a specific Achievement Level by grade group and subject and are a key element in the establishment of cut scores.
ODE focused the Achievement Standards Verification panelists’ attention by using outside references with data on national and international benchmarks.
4
![Page 5: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/5.jpg)
Specify the knowledge, skills and abilities a student needs to know in order to be classified as:
• Does Not Yet Meet• Nearly Meets• Meets• Exceeds
5
![Page 6: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/6.jpg)
Scores on Oregon’s scale. Describe what students should be able to do in each achievement level.
Participants actively discuss their expectations of the “target student” in each achievement level using a booklet of 70 Oregon test items ordered from easiest to most difficult.
6
![Page 7: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/7.jpg)
May-September 2010 Moving Science Forward Professional Development
2009, 2010 October Statewide In-Service- new standards and assessments presentations September 2009-present Science Monthly Updates,
AA Updates, Superintendents Pipeline February 2011 Draft 2009 Test Specifications and
Blueprint Documents posted to web January-May 2011 Announcements regarding
reporting, assessments, scoring guides and Science Standard Verification
August-September 2011 Survey October 2011 – May 2012 Communication Strategy
7
![Page 8: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/8.jpg)
General Policy Definitions (adopted March 2010)
Science Policy Definitions(provide consistency across grades-approved by Science Panel January 2011)
Science Achievement Level Descriptors for grade 5, 8, HS
(adopted May 2011)
Final Achievement Level Descriptors and Achievement Standards linked to outside references will be available to inform partners.
8
![Page 9: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/9.jpg)
Dr. Mary Seburn Director Research, Design and Analytics DivisionEducational Policy Improvement Center
9
![Page 10: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/10.jpg)
• Modified Bookmarking method • Comparative data from NAEP, PISA, OUS, other states• Nearly Meets, Meets, and Exceeds • Grades 5, 8, and high school Science• 24 stakeholders • Three days
• Recommended increased achievement standards for all grade levels• Except for “Nearly Meets”; current standards confirmed
10
![Page 11: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/11.jpg)
11
Note: No changes were recommended to the Nearly Meets Achievement Standard.
![Page 12: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/12.jpg)
12
The Educational Policy Improvement Center (EPIC) •Documented evidence of technical adequacy
• Procedural validity, as observed• Standards for Educational and Psychological Testing• NCLB Peer Review• Best practice
•Materials review•Observations•Interviews •Evaluations
![Page 13: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/13.jpg)
Twenty-one evaluation elements total, all met:
13
Panelist Selection Panelist and Facilitator
Training Methodology Process Documentation
![Page 14: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/14.jpg)
“The training materials were helpful.”
“I am confident I understand my role in the standards verification process.”
“The training clearly identified the goals for the standards verification procedure.”
14
![Page 15: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/15.jpg)
“I understood how to place my bookmarks.”
“Overall, I am satisfied with my group's final bookmarks.”
“I am confident that the bookmark procedure used produced valid Achievement Standards.”
“The bookmark procedure was well described.”
15
![Page 16: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/16.jpg)
16
• “Steps in the process were very good, group and individual work time allowed for flexibility and allowed us to come to consensus.”
• “I would love to do this again. I can’t think of anything they could do better. Very successful.”
• “I really believe in the process, it is difficult, but it’s why democracy works.”
![Page 17: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/17.jpg)
Rachel Aazzerah7-12 Science/Math TeacherProfessional Learning Community Leader/Data Driven Decision Making Coordinator
Monument School District
17
![Page 18: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/18.jpg)
Interaction and Change Life Science (6.2L.2)
Explain how individual organisms and populations in an ecosystem interact and how changes in populations are related to organisms.
18
![Page 19: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/19.jpg)
Interaction and Change Earth and Space Science (7.2E.3)
Evaluate natural processes and human activities that affect global environmental change and suggest and evaluate possible solutions to problems.
19
![Page 20: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/20.jpg)
Structure and Function Life Science (H.1L.3)
Explain and apply laws of heredity and their relationship to the structure and function of DNA.
20
![Page 21: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/21.jpg)
Meagan SternbergK-12 Science Instructional Coach North Clackamas School District
21
![Page 22: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/22.jpg)
North Clackamas School District is in the middle of reviewing and realigning science courses with a focus on making sure students are exposed to Engineering Design content, practices and work samples at each grade level.
This is challenging in some science courses. However, we feel it is critical work with the
new focus on Engineering and Technology at the national level.
22
![Page 23: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/23.jpg)
Happy Valley and Rock Creek Middle Schools have an elective called “Engineer It!”.
At HVMS, almost all students take this class.
23
![Page 24: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/24.jpg)
Raising the Science Achievement Standards increases the rigor and importance of teaching and learning science in Oregon schools.
24
![Page 25: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/25.jpg)
State Board adoption of recommended achievement standards and achievement level descriptors
Peer Review Submission- December 2011
25
![Page 26: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/26.jpg)
Thank you!
Questions?
26
![Page 27: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/27.jpg)
Dianna Carrizales-Engelmann
Brad Lenhardt
Office of Student Learning and Partnerships
Daniel Farley
University of Oregon
27
![Page 28: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/28.jpg)
28
![Page 29: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/29.jpg)
Population District Uses Diploma Options
Post-Secondary Implications
Students with the most significant cognitive disabilities
AYP reporting (up to 1%) and district achievement reporting
•Extended Diploma
•Modified Diploma
Supported living facilities to post-secondary education and vocational careers
29
![Page 30: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/30.jpg)
General Assessment Alternate Assessment
Population All students Students with IEPs
Participation ‘10
~296,090 ~5,776
Decision Default decision IEP team decision
Development Based on grade level content
Based on grade level content reduced in depth, breadth, and complexity
Administration
Primarily Online Paper and pencil, individually administered
Assessment areas
Reading, Writing*, Mathematics, Science
Reading, Writing*, Mathematics, Science
Stakes Used to demonstrate Essential skills towards a regular diploma
Can be used to demonstrate Essential Skills in Reading toward the Modified Diploma or can lead to the Extended Diploma 30
![Page 31: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/31.jpg)
General Assessment
Alternate Assessment
Participation (2010)
123,036 1736
Achievement Standards
RIT scores Scaled Scores
ALDs Developed by staff approved by expert panelists
Developed by staff approved by expert panelists
Standard Setting process
Verification of staff- recommended cutscores
Panel-recommended cutscores based on knowledge of population and assessment
31
![Page 32: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/32.jpg)
![Page 33: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/33.jpg)
![Page 34: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/34.jpg)
University of Oregon Behavioral Research and Teaching Dr. Gerald Tindal
Bookmarking process 13 educators representing 9 counties SPED and content expertise 3 rounds Review of impact data Recommendations: Both increases and decreases
related to refinements to the new content standards
34
![Page 35: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/35.jpg)
Achievement Level
CurrentScience Cut Scores
ProposedScience Cut Scores
Change to Cut Score(+/- Resulting from
Recommended Minus Current Cut Score)
Grade 5 Grade 8 HS Grade 5 Grade 8 HS Grade 5 Grade 8 HSNearly Meets 100 89 91 100 95 98 0 +6 +7
Meets 108 96 107 107 101 103 -1 +5 -4Exceed
s 116 114 114 114 113 109 -2 -1 -5
35
![Page 36: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/36.jpg)
Cut Scores Impact Data
GradeNearly Meets Meets Exceeds
Does Not Yet Meet
Nearly Meets Meets Exceeds
Meets /Exceeds 2011
Meets /Exceeds 2010
5 100 107 114 28% 11% 37% 23% 60% 58.10%8 95 101 113 20% 12% 53% 15% 68% 80.20%
HS 98 103 109 36% 21% 31% 12% 43% 33.60%
36
![Page 37: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/37.jpg)
Does Not Yet Meet Nearly Meets Meets Exceeds
Science Policy Definitions(Apply to all grade groups)
Performance indicates that the student has a limited understanding of specific academic concepts linked to grade-level content that has been reduced in depth, breadth, and complexity.Demonstration of Science Knowledge and Skill in familiar situations with significant limitations.
Performance indicates an inconsistent understanding of specific academic concepts linked to grade-level content that has been reduced in depth, breadth and complexity.Demonstration of Science Knowledge and Skill in familiar situations with some success.
Performance indicates an understanding of specific academic concepts linked to grade-level content that has been reduced in depth, breadth, and complexity.Demonstration of Science Knowledge and Skill in familiar situations with success.
Performance indicates a consistent understanding of the academic concepts linked to grade-level content that has been reduced in depth, breadth, and complexity.Demonstration of Science Knowledge and Skill in familiar situations with consistent success and in unfamiliar situations with some success.
37
![Page 38: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/38.jpg)
Rigor of process Appropriateness of panelists Quality of personnel/oversight Thoroughness of training Validity of assessment Panelist Confidence Assessment data
38
![Page 39: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/39.jpg)
Thank you!
Questions?
39
![Page 40: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/40.jpg)
Does Not yet Meet: Students do not demonstrate mastery of grade-level knowledge and skills required for proficiency.
Nearly Meets: Students demonstrate partial mastery of grade-level knowledge and skills required for proficiency.
Meets: Students demonstrate mastery of grade-level knowledge and skills required for proficiency.
Exceeds: Students demonstrate mastery of grade-level knowledge and skills exceeding the requirement for proficiency.
40
![Page 41: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/41.jpg)
Does Not Yet Meet: Students demonstrate limited mastery of science, scientific inquiry and engineering design knowledge and skills, through the application of basic concepts with occasional success.
Nearly Meets: Students demonstrate partial mastery of science, scientific inquiry and engineering design knowledge and skills, through the application of basic concepts with regular success.
Meets: Students demonstrate mastery of science, scientific inquiry and engineering design knowledge and skills, through the interpretation and application of grade-level concepts with consistent success.
Exceeds: Students demonstrate mastery of science, scientific inquiry and engineering design knowledge and skills, through the interpretation and application of advanced concepts with consistent success.
41
![Page 42: OREGON’S SCIENCE ACHIEVEMENT LEVEL DESCRIPTORS AND STANDARDS](https://reader036.vdocument.in/reader036/viewer/2022062808/568153f2550346895dc1f38b/html5/thumbnails/42.jpg)
Proficient: Proficient: A student who is proficient has solid academic performance.
Mastery: Mastery: A student who has mastered a subject is able to clearly explain aspects of the subject to fellow students.
42