necap science pilot test administration workshop grades 4, 8 & 11 april 30; may 1, 3, 4 nh...
TRANSCRIPT
NECAP Science Pilot Test Administration Workshop
Grades 4, 8 & 11
April 30; May 1, 3, 4
NH Department of Educationand
Measured Progress
NH DOE Contact Information
Tim Kurtz, Director of [email protected]
Jan McLaughlin, Science Curriculum & [email protected]
Gaye Fedorchak, Alternative [email protected]
Lisa Kaim, Assistant for Math and [email protected]
NH Department of Education, 101 Pleasant Street, Concord, NH 03301-3860
Elliot Scharff: NECAP Science Program Manager
Phone - 1-603-749-9102 ext. 2126
E-mail - [email protected]
Jennifer Varney: NECAP Science Program Assistant
Phone - 1-603-749-9102 ext. 2115
E-mail - [email protected]
NECAP Service Center1-877-632-7774
Measured Progress NECAP Science Team
Measured Progress NECAP Team
Harold Stephens: NECAP Program DirectorPhone - 1-603-749-9102 ext. 2235E-mail - [email protected]
Amanda Smith: NECAP Program Manager
Phone - 1-603-749-9102 ext. 2259
E-mail - [email protected]
Joshua Evans: NECAP Program Manager
Phone - 1-603-749-9102 ext. 2244
E-mail - [email protected]
Mellicent Friddell: NECAP Program Assistant
Phone - 1-603-749-9102 ext. 2355
E-mail - [email protected]
Tina Haley: NECAP Program Assistant
Phone - 1-603-749-9102 ext. 2427
E-mail - [email protected]
NECAP Service Center1-877-632-7774
The purpose of this workshop is to ensure that
• everyone understands the administration procedures for the tests and knows where to find support materials and information.
• the NECAP tests are administered in a comparable way in all locations across the three states.
• quality control procedures are followed for returning materials.
Important Dates (page i)
April 30 - May 4: Test Materials and Student ID Labels shipped to schools
May 14 - 24:Test Administration Window
May 25: UPS pickup of test materials for return to Measured
Progress. (Materials need to be ready at 8 a.m.)
The New England Common Assessment Program (NECAP) (page 1)
Background Collaboration among New Hampshire, Rhode Island,
and Vermont to create a common program Allows states to combine experience, increase
capacity, and share costs Allows development of a customized science
assessment program, which includes an inquiry task component
The New England Common Assessment Program (NECAP) (page 1)
Purpose of the Pilot Test Field testing of all items Try out testing procedures Opportunity for all schools to become familiar with
science testing, including the inquiry task, prior to the May 2008 operational assessment.
The New England Common Assessment Program (NECAP) (page 1)
Structure of the Science Pilot Test Students in every school in all three states will take the test.
Each student completes one session of multiple-choice and constructed-response questions and one session of questions tied to an Inquiry Task.
Differences between Pilot Test and Operational Test: Total testing time Number of sessions Make-up tests Testing window Reporting
Where do NECAP Science Assessment Targets come from?
Statements of Enduring Knowledge
Unifying Themes/Big IdeasScientific Inquiry
Nature of ScienceSystems and EnergyModels and ScalesPatterns of ChangeForm and Function
Domains: Life Science (LS)
Physical Science (PS)Earth and Space Science (ESS)
New Hampshire NECAP Information
•The NECAP Science Assessment is based on the Science Assessment Targets as designated in the NH Frameworks for Science Literacy K-12.
•The designated state (NECAP) assessment targets are the expectations in BOLD boxes in the Science Grade Span Expectations (GSEs).
•We use the same “statements of enduring knowledge” to organize our frameworks as the NECAP documents.
New Hampshire NECAP Information
NECAP Resources on the NH Science Pagewww.ed.state.nh.us
Programs and Services S Science in NH Schools
NH Science Framework New Hampshire Framework for Science Literacy K-12 (includes all Science Grade Span Expectations)
NH Science Grade Span Expectations (includes NECAP targets) K-12 Science Process Skills (includes inquiry targets)
K-12 Earth Space Science K-12 Life Science K-12 Physical Science
New Hampshire NECAP Information
More NECAP Resources on the NH Science Page:
www.ed.state.nh.us Programs and Services S Science in NH Schools
NH NECAP Inquiry Task InformationPlanning Guide for Investigations Planning Guide for Non-Investigations Sample Investigation Inquiry Task at Grade 4 Sample Non-Investigation Inquiry Task at Grade 8 Sample Non-Investigation Inquiry Task at Grade 11 Released Inquiry Performance Tasks
NH NECAP Science Information
NH NECAP Science Assessment Information (includes all assessment targets)
Number of Targets by Domain and Grade Span
Content Framework for NECAP Science Assessment
Science Domains by Enduring Knowledge StatementsScience Domains by Enduring Knowledge Statements Assessment TargetsAssessment TargetsGrade 4Grade 4 Grade 8Grade 8 Grade 11Grade 11
LS 1 - Survival of organisms 1-4 1-4 1-2
LS 2 - Matter & energy of ecosystems 5-6 5-7 3-5
LS 3 - Organisms change over time 7 8-9 6-9
LS 4 - Humans are similar and different 8-9 10-12 9-10
PS 1 - Properties and structure of matter 1-3 1-5 1-4
PS 2 - Energy 4-6 6-7 5-7
PS 3 - Forces and motion 7-8 8 8-10
ESS 1 - Earth and earth materials 1-6 1-5 1-4
ESS 2 - Solar System 6-8
ESS 3 - Universe and galaxies 5-8
New Hampshire NECAP Information
Eligible NECAP Targets for the Inquiry Task at each grade tested can be found in the Science Process Skills (SPS) GSE in the last
row in SPS1 labeled: NECAP Science Assessment Targets for Inquiry (INQ) May be subject of performance component
Resources and Information about the Science Frameworks and NH Information about the NECAP Science Assessment can be found at
www.ed.state.nh.us Programs and Services S Science in NH Schools
Science Reference Sheets can be found at the link below www.ed.state.nh.us
Programs and Services N NECAP
Item Types
Multiple Choice (MC) 1 PointAnswer Key
Constructed Response (4-CR) 4 pointsRubric: 0-4 points
Inquiry Task 16-18 points assessed with a mix of 2- and 3-point SA
Grade 4 Science Pilot Test Design:Session 1: 50 Minutes* Session 2: 95 Minutes**
29 Multiple Choice (1 pt each)
2 Constructed Response (4 pts each)
Making Your Predictions
Setting Up and Conducting Your Investigation
Organizing and Presenting Your Data
Analyzing and Using Your Results
A New Investigation
8 short-answer questions
**For Session 2, students should complete the Inquiry Task and all questions within 95 minutes.
*For Session 1, students are allowed an additional 45 minutes without an accommodation.
Grade 8 Science Pilot Test Design:
Session 1: 50 Minutes* Session 2: 95 Minutes**
29 Multiple Choice (1 pt each)
2 Constructed Response (4 pts each)
Making Your Predictions
Setting Up and Conducting the Investigation and Collecting
Data
Organizing and Presenting Your Data
Analyzing and Using Your Results
*For Session 1, students are allowed an additional 45 minutes without an accommodation.
8 short-answer questions
**For Session 2, students should complete the Inquiry Task and all questions within 95 minutes.
Grade 11 Science Pilot Test Design:Session 1: 50 Minutes* Session 2: 80 Minutes**
29 Multiple Choice (1 pt each)
2 Constructed Response (4 pts each)
Prediction
Analyzing and Using Data
Organizing and Presenting Data
Using Evidence and Applying What You Learned
*For Session 1, students are allowed an additional 45 minutes without an accommodation.
8 short-answer questions
**For Session 2, students should complete the Inquiry Task and all questions within 80 minutes.
Inquiry Task Design: Pilot Test
Grade 4 & 8 INVESTIGATION
Introduction Prompt with Content Question
Make a predictions (gr. 4) or hypothesis (gr. 8) and explain.
Conduct Investigation with a partner ~ Collect and display data
Summarize results
Develop and evaluate explanations with content
Propose new question (gr. 4) that could be investigatedor investigation (gr. 8)
Inquiry Task Design: Pilot Test
Grade 11 NON–INVESTIGATION
Introduction prompt with content question
Review results from an investigation Develop and evaluate explanations
Formulate questions and hypothesize
Plan/Critique Investigation
Construct or analyze alternative explanation
Link to Enduring Knowledge concept
The New England Common Assessment Program (NECAP)
Science Assessment Changes of Note:• For the pilot ONLY, session 1 will be 1 domain per student.
Every school will have all domains present.• Student Test Booklet and Student Answer Booklet are
separate documents for Grades 4, 8, and 11.• Districts/schools may decide if students can use a calculator
on the assessment (not recommended at grade 4.)• A science reference sheet will be provided for each student
in grades 8 and 11. (There are different sheets at grade 8 and 11.) The reference sheets are available now on the NH Science web page.
Setting up the Inquiry Task
Questions
School Test Coordinator’s Responsibilities (page 2)
Primary responsibilities: serve as the school’s contact person with Measured
Progress coordinate all test-related activities prepare test administrators to administer NECAP
according to directions in the Test Administrator Manual oversee the inventory, distribution, collection, and return
of ALL test materials ensure test security and compliance with test
administration procedures
Test Security (page 3)
Test Security relies on the professional integrity of everyone in our schools across all three states. No student should be advantaged or disadvantaged based on how or where the test is administered.
All test items and responses to those items in the NECAP are secure and may not be copied or duplicated in any way or kept by the school after testing is completed.
Using secure test material to prepare students in any way for this test administration is a violation of test security and testing procedure.
Breaches in Test Security (page 3)
Any concern about breaches in test security must be reported immediately to the test coordinator and/or principal.
The test coordinator/principal is then responsible for reporting breaches to the district superintendent and the state department of education.
Getting Ready
• Select each school’s Test Coordinator• Communicate test plan to staff• Ensure test security is in place• Schedule testing• Plan logistics around testing—especially for the Inquiry Task
Preparation for Test Administration Manuals Read the Principal/Test Coordinator and Test
Administrator Manuals
Student Participation and Accommodations The Accommodations and Procedures: Administrators
Training Guide covers these topics: Who should be tested Determining how students will participate using
accommodations Documenting and bubbling in accommodation codes
BEFORE TESTING (page 4)
Who should be tested for the pilot? (page 4)
As many students as possible, including:
• Students with disabilities
• English language learners
• Students attending career and technical centers
EXCEPTIONS for the pilot test ONLY:
• Students who would normally participate in alternate assessment
• ELL students enrolled in U.S. schools less than one year
• Students absent for entire testing window
• Students experiencing extraordinary personal circumstances
Classroom Environment
• Check to ensure there are enough materials for the Inquiry Task.
• Materials are packed by “type”, not by kit.• Ensure that students have enough room to place materials on
the 11” x 17” Placemat.• Identify plan for setting up materials for the Inquiry Task.• Identify process for grouping students (see Appendix 6 of the
Principal/Test Coordinator Manual).
Preparing for the Inquiry Task ~ Grades 4 and 8 Only
Appendix 6: Guidelines for Grouping Students in Session 2 ~ Grades 4 & 8 only
Part 1 – Making your prediction
Students will make predictions and record them on their own Prediction Sheet.
Part 2 – Setting up and conducting your investigation and collecting data
Students will work in collaborative groups.
All students must record data on their Data Sheets for use in Parts 3 and 4 ( and Part 5 for grade 4).
Parts 3 and 4 (and Part 5 for grade 4) – Organizing and presenting your data, and analyzing and using your results
Students will work alone with data collected from Parts 1 and 2 and record all their answers in their own Student Answer Booklet.
Accommodations for the Pilot
• Who is eligible for testing accommodations?
ALL students
• Accommodations do not change what we expect students to know and be able to do.
• Test accommodations are based on individual student needs and classroom assessment practice; they are not for the use of an entire classroom or category of students.
• They should not give students unfair advantages; rather they are meant to remove barriers that may exist due to a student’s learning style or disability.
Appendix 5:Table of Standard Test Accommodations
(Page A-6)
Accommodations for the Pilot
• Accommodations, Guidelines, and Procedures: Administrator Training Guide – Still available on state DOE website under NECAP, but not yet updated for Science. Everything listed there is still available.
• For the Science Pilot, Use the Table of Standard Test Accommodations found in Appendix 5 of the Test Coordinator and the Test Administrator Manuals.
Only these manuals have the most recent updates.
• School teams may use, without state approval, only standard accommodations listed in categories A, B, C, or D. Please note: Categories E and F work differently, as follows:
Accommodations for the Pilot
Use of Category E “Other” Accommodations -
Contact NHDoE, Gaye Fedorchak, in advance of testingto discuss any other (non-listed) accommodations you want touse during the pilot.
• Accommodation(s) must be consistent with those used in student’s regular classroom instruction.
• If the DOE finds the Category E-Other accommodation to be comparable to a standard accommodation, we will note this and consider for future updates to Accommodations Manual.
• DOE is seeking & collecting teacher ideas for the Inquiry Task
• During full test implementation (May 2008), student work done using category A, B, C, D, or state approved E accommodations will be fully credited & scored.
Accommodations for the Pilot
Use of Category F Modifications -
• If the state determines that your request for a (non-listed) E-Other Accommodation will change what the test measures, then the state will respond in writing that use of this procedure will produce a test “modification” and must therefore be documented as an F-Modification.
• After the pilot, during full test administration, use of an F-Modification will result in no credit given for student work during test sessions in which this F-Modification was used.
• When full assessment starts, any E –Other Accommodation not registered as “approved” by your state DOE will be treated as an F- Modification.
Accommodations for Pilot
• After Testing, Document all accommodations and modifications actually used on page 2 of the Student Answer Booklet. (If not used, don’t bubble.)
• Accommodation Updates for the Science Pilot:
• C-4 ……. Now includes Science • C-12 ….. Now includes Science• C-13 ….. Does not appear in Test Manuals but is still in effect
for NECAP and will return in future manuals.
An abacus is not likely to be needed for the Science
Pilot.• D-5 ……. Now includes Science• D-6 ……. Now includes Science• D-7 ……. Reserved for Future Standard Accommodation
(afterpilot data is gathered)
Accommodations - Thinking long term
• Support teachers through the accommodations decision- making process.
• Include all of a student’s classroom teachers, parents, and, whenever possible, the student in the decision-making process.
• Consult with parents regarding use of accommodations through phone or similar kinds of contacts. A face-to-face meeting is not required.
• Standardize the accommodation administration process and plan the resources necessary for large-scale implementation.
• Ensure that the students’ records include the decisions made to inform both current and future educational planning.
Scheduling Test Sessions (page 5)
Session 1 of the NECAP Science pilot test in grades 4, 8, and 11 is designed to be completed in approximately 50 minutes.
Students are allowed an additional 45 minutes for Session 1 without an accommodation. Plan accommodations for those students who typically take more than 50% additional time for regular classroom assessment. Only those students with an extended time accommodation may be permitted more than 95 minutes to complete Session 1.
Session 2 of the NECAP Science pilot test in grades 4 & 8 is designed to be completed in approximately 95 minutes. Session 2 in grade 11 is designed to be completed in approximately 80 minutes.
The student questionnaire for grades 4, 8, and 11 is designed to be completed in 20 minutes.
Scheduling Test Sessions (page 5)
All testing, including accommodated sessions, must occur within the testing window.
Test sessions must be scheduled and given in the order presented in the Student Test Booklet.
All classrooms of students in a school should take the same test session simultaneously.
Student ID Labels (page 7)
• Student ID Labels• Labels created for students based on beginning of
school year 2006-07 enrollment files• 2 identical labels printed for each student (one for
Student Answer Booklet, one for Student Test Booklet)• Student labels are sorted by group field prior to printing
(if requested)
Student ID Labels (page 7)
Students enrolled in your school WITH Student ID Labels
• 3 fields MUST be correct in order to use label: student name, state-assigned Student ID number, and school name
• If any of the 3 fields are incorrect or missing, DO NOT USE the label.
• Call your state DOE to report incorrect information.
• Follow procedure for students without Student ID Labels.
Student ID Labels (page 7)
Student ID Labels for students NOT in your school
• Labels are NOT transferable between schools.
• Throw away any labels provided for students not enrolled in your school.
• DO NOT forward these labels on to other schools.
• DO NOT affix these labels to Student Answer Booklets.
Student ID Labels (page 7)
Students WITHOUT ID labels• Complete the student information on pages 1 and 2
of the Student Answer Booklet.
Required on the Student Answer Booklet for students without a label State
Page 1 Page 2
NH Student name, state assigned student ID, and birth date
No student demographic information is required
RI Student name, state assigned student ID, and birth date
Gender, primary race/ethnicity, LEP, IEP, SES, Migrant, 504 Plan, Title 1A
VT Student name and birth date Gender, Primary race/ethnicity, LEP, IEP, SES, Migrant
Preparing Student Test Booklets and Answer Booklets for Testing (page 7)
• Booklets will be shrink-wrapped in packs of 15, 10, 5, and singles.
• Count the booklets to verify that the quantity received matches the quantity sent. Call Measured Progress if your count does not match the quantity indicated on the Material Summary form sent by Measured Progress.
• Do not re-sequence test booklets or answer documents.
• Student Answer Booklets come inserted in the Student Test Booklet, paired by form.
Preparing Student Test and Answer Booklets for Testing (page 7)
• DO NOT separate the Student Answer Booklets from the Student Test Booklets.
• If the booklets do become separated, you will need to match the form number on the front cover of the Student Test Booklet with the bracketed portion of the number printed on the bottom right corner of the Student Answer Booklet.
• The unique serial numbers on Student Test Booklets and Student Answer Booklets are not designed to match.
Preparing Student Test Booklets and Answer Booklets for Testing (page 7)
For students WITH Student ID labels For students enrolled with a label, affix the label to the
front cover of the Student Answer Booklet.
Affix second label on the front cover of the Student Test Booklet
For students WITHOUT Student ID labels For students enrolled without a label, fill in all required
information.
Write student name and school name on cover of the Student Test Booklet
New Hampshire
Prior to Test Administration (page 8)
Designating Test Administrators
Administer content area test sessions simultaneously within each grade level at the school and district.
Test students in surroundings that will provide them the opportunity to do their best work. (Grades 4 and 8 will need a level workspace for session 2).
Students who require accommodations must be supervised by trained test administrators (refer to Accommodations, Guidelines, and Procedures: Administrator Training Guide)
Preparing Test Administrators (page 8)
Assign each Test Administrator to a specific group of students.
Notify Test Administrators of the testing schedule.
Explain security procedures.
Plan for grouping students into pairs in grades 4 & 8 prior to Session 2.
Plan for inventorying, distributing, collecting, and storing materials.
Create a plan for applying Student ID Labels or code student identification info on covers of Student Test Booklets and Answer Booklets.
For students without a label, plan for completing student info on page 2 of Student Answer Booklet.
Preparing Test Administrators (cont.)
Discuss additional materials needed:• calculators, • scratch paper and/or Post-Its, • Science reference sheets
Explain guidelines for classroom environment.
Encourage completion of Test Administrator Questionnaire.
Answer questions regarding test administration and security.
Test Materials (pages 10-14)
Inventory Test Materials
• Packing Order of NECAP Science Materials
• Quantities of Student Test Booklets and Answer Booklets
• Quantities of Other Materials
• Ordering Additional Materials
• Storing and Access to Test Materials
• Equipment and Materials Permitted During Test Administration
• Equipment and Materials Prohibited During Test Administration
• Ancillary Test Materials
Test Administration
Distributing Test Materials• Make sure materials are kept in a locked storage
area prior to testing and between sessions. • Include an additional set of test materials for the
test administrator to use while giving directions.
Monitoring Test Administration• Test administrators may not comment on students’
work. Test administrators may not help students in any way except during the General Instructions, Student Questionnaire, or as specified in the Test Administrator Manual.
DURING TESTING (page 14)
Preparation of Test Materials for Return Collecting Materials After Testing List on page 15 of Principal/Test Coordinator Manual
Special Materials Make sure that all non-standard, student-generated
work (computer-generated, large-print, and Braille responses) have been transcribed into a regular Student Answer Booklet.
Examples of materials for the Special Handling envelope: torn booklets, responses written with anything other than a #2 pencil, damaged test booklets
AFTER TESTING (page 15)
Verifying Completion of Student Information on Student Answer Booklets (page 16)
Ensure that a label is affixed properly for all students with a Student ID Label.
Ensure that all applicable student information has been competed for students without a Student ID Label.
Ensure that accommodation information has been coded on page 2 of the Student Answer Booklet for students who used an accommodation(s).
Completing Principal’s Certification of Proper Test Administration (page 16)
• Complete 1 form online for each grade tested.• Must be done prior to return of materials
• Numbers you need: • total # of booklets sent to your school • # of used booklets being returned• total # of booklets being returned
• Detailed instructions will be shipped with test materials.
• Print, sign, and return a copy of the form with test materials.
Return of Materials (page 17)
• Packaging test materials for return to Measured Progress
• UPS One-Day Pickup on May 25th at 8:00 a.m.
• Use original shipping cartons.
• Pack materials for one grade only per carton.
• Follow packing instructions on the bottom on page 17 of your Principal/Test Coordinator Manual.
DO NOT return the following (page 18):• Manipulatives from the Inquiry Task Kits
• Inquiry Task Placemats
• Materials Summary Form & Packing Slips *Secured Material*
• Science reference sheets
• Principal/Test Coordinator Manual and Test Administrator Manuals
• Principal/Test Coordinator Questionnaire (Return completed answer sheets only.)
• Test Administrator Questionnaire (Return completed answer sheets only.)
• Student Questionnaires (Students answered the questions in their Student Answer Booklets.)
NH Science NECAP ResourcesNECAP Page on NH Dept. of Ed Website.
www.ed.state.nh.usPrograms and Services N NECAP2007 Science pilot
Student Support and Testing Materials• Science Reference Sheets
Policy Material• Accommodations, Guidelines, and Procedures:
Administrator Training Guide• Calculator Policy• 2007 NECAP Science Principal/Test Coordinator & Test
Administrator ManualsReference Materials
• 2007 Test Administration Workshop Presentation
Questions and Answers