end-of-course winter 2014 training-of-trainers school assessment coordinators december 12, 2013...
TRANSCRIPT
End-Of-CourseWinter 2014
Training-of-TrainersSchool Assessment Coordinators
http://www.k12.wa.us/TestAdministration/default.aspx
December 12, 2013
This material should be augmented with special consideration appropriate for your local district.
ACM
Hyperlinks have been embedded throughout the ACM. This allows electronic users to quickly access the related section of the document or external Web sites. Hyperlinked areas are bold and underlined.
The Access Supports and Accommodations Guidelines apply to all state assessments: www.k12.wa.us/Assessment/StateTesting
For online school program students registered through WAMS to test at an alternate site, DRC will package test booklets by the online school program, and will deliver directly to the testing district.
Test Proctor Assurance Forms require two signatures. One signature will be collected at time of training and the final signature at conclusion of testing.
The EOC test material return shipments will be a pre-scheduled one day pick-up. The EOC material pickup up date will be identified mid-November. Refer to the Key Dates Calendar specific to the administration: www.k12.wa.us/TestAdministration/Calendars
What’s NEW
Slide 2
Delivery andAdministration Schedule
Date Activity
November 22 Assessment Coordinators Manuals arrived in district
December 9 or January 2
Test booklets, accommodated forms, student Pre-ID Adhesive Labels, and English and Spanish Directions for Administration arrive in district
December 31 Conclude proctor training
January 2 – February 7
Testing window
Final Day of Testing
Assessment Dept. reviews and picks up End-of-Course Math and Biology
Determined by district response to OSPI survey
All EOC test materials due to DRC on date determined by district response to OSPI survey
Slide 3
Administrator’s Preparation Read the ACM (Tip: save as a PDF to your
desktop to search for topics/questions)
Notify district assessment coordinator (DAC) of any changes to your school’s Secure Test Material Handling Plan
Complete the Proctor PowerPoint with building-specific information
Familiarize your team with the tools and accommodations needed and allowed for the Winter End-of-Course administration
Slide 4
Preparing StudentsResources and Tools (sample passages, questions, anchor sets, test and item specifications)
Mathematics - www.k12.wa.us/Mathematics/Assessment • Mathematics End-of-Course Sample Item Booklet:
www.k12.wa.us/Mathematics/pubdocs/EOCSampleItemBookletandAnswerKey.pdf
• Biology - www.k12.wa.us/Science/EducatorResources.aspx • Biology- Science assessment resources for educators:
www.k12.wa.us/Science/Assessments.aspx
Administrators Item and Point Totals Charts and Scale Score Ranges at:
www.k12.wa.us/assessments/StateTesting Graduation requirements and resources: www.k12.wa.us/Resources
Web site links to Classroom Demos for: Translated CDs; Released Items; PLDs and other resources listed on pages 3 in the ACM.
ACM2-3
Slide 5
Test Question Ambiguity
ACM5
How to report a perceived error on a test:
1.During the assessment, make note of the perceived error. Include subject, test booklet form, question number, and page number.
2.Instruct students to do their best and complete the assessment. Do not attempt to provide a remedy.
3.Complete a Test Question Ambiguity Form and deliver to the district assessment coordinator with your secure materials.
4.The district assessment coordinator must alert the state test coordinator by fax at (360) 586-2728 or by phone (360) 951-9901.
Do not copy any test content, share with colleagues or transmit this information through any device with cellular, messaging, or wireless capabilities (e.g., email, cell phones, pagers, iPods, tablets, other web-enabled devices, photo technology).
Slide 6
Policies and Test SecurityState Laws Governing Security
All test content including, but not limited to, test booklets, and accommodated forms are confidential and must not be reviewed except to the extent necessary for administration of state assessments.
Securing Testing EnvironmentWho and what can be in the testing room Trained proctors, not volunteers No media (and limited access to the campus) Only approved electronic devices No purses or backpacks near the students
What is your role and what are your responsibilities?Superintendent (p7) Principal (p8-9)District Asmt. Coord. (p9-10) School Asmt. Coord.(p11-12)Special Ed. Coord.(p12) Bilingual Coord. (p12)
ACM5-14
Slide 7
Responsibilities of the PrincipalAppoint School Assessment Coordinator
Training Attend required trainings. Ensure that proctors, individuals providing accommodations (such as
scribes, readers, etc.), and staff who process materials attend required trainings.
Overall Planning and Scheduling Includes assigning test proctors; designating testing areas; ensuring test
security of materials by communicating; planning testing schedules, locations & testing population. Develop and have approved your school’s Secure Test Material Handling Plan.
Communication Communicate with parents and all ancillary staff members and
departments regarding the schedule, testing, importance of attendance and how test results will be reported.
Communicate your school’s Secure Test Material Handling Plan.Implementation
Implement all district policies and procedures and monitor testing process.
Provide necessary accommodations as required by IEP, 504, and ELL plans as well as access supports.
Submit required documentation on time.
ACM8-9
Slide 8
Responsibilities of the District Assessment Coordinator (DAC)
Approve the school’s Secure Test Material Handling Plan
Training Attend required trainings. Train school administrators, school assessment coordinators, and ensure
that they provide appropriate training to proctors, scribes, and persons needed to assist with accommodations and test material processing.
Overall Planning and Scheduling Develop and implement a plan to collect the information in a timely
manner in order to ensure that each student has access to the appropriate assessment and testing environment. Develop, in collaboration with the school coordinator, the school’s Secure Test Material Handling Plan.
Implementation Implement all district policies and procedures and monitor testing process. Submit required documentation to OSPI on time.
ACM9-10
Slide 9
Responsibilities of the District Assessment Coordinator (DAC)
A school’s Secure Test Material Handling Plan should include:
1. Schedule for testing (Winter EOC window is January 2-February 7).
2. Administration Training and Proctor Training schedule.3. Change in transportation arrangements for the day.4. Accommodations needed per student.5. Identify students who are allowed accommodated forms,
require a pre-approved special accommodation, or pre-approval for other exemptions.
6. Inventory and make available the universal tools and manipulatives allowed for each assessment.
7. Determine who is responsible for test security, including: receiving, inventorying, and securing documents throughout the assessment window.
8. Provide the communication plan for all targeted audiences.
ACM9-10
Slide 10
Responsibilities of the School Assessment Coordinator (SAC)
Before: Attend required training Provide training to all appropriate staff Immediately inventory all material Ensure security protocols in place Provide test proctors with list of accommodations needed per students’
IEP, 504, and ELL plan Provide proctors with contact information/process for immediate needs
during testingDuring:
Provide a positive test-taking environment Distribute all appropriate test materials and ensure security protocols Monitor proper test administration Report and document any irregularities to the DAC
After: Inventory and return test materials (process ancillary materials-
including transcription) Complete Security Reports and required documentation
ACM 11-12
Slide 11
Responsibilities of: Special Education & Bilingual
Coordinators
Work closely with teachers and student teams to determine testing needs of each student.
Attend required training and read assigned materials Follow district/school procedures for providing a list of students and
their testing needs (braille, large print, Translated CDs, etc.), to your DAC.
ACM 12
Slide 12
Assessment Options
English Language Learners (ELL) Students who qualify for English Language Development (ELD) services:
Testing accommodations plans for ELL students must be documented and placed in the student’s cumulative folder.
ACM15-17
Slide 13
Participation Assessment Option
Grades 7-12 completing an EOC math course in Winter 2013 or completed an EOC math course prior to Winter 2013 and either did not take or did not pass and EOC exam
Year 1: Algebra or Integrated Math 1Year 2: Geometry or Integrated Math 2
Grades 7-12 completing an EOC biology course in Winter 2013 or completed an EOC biology course prior to Winter 2013 and either did not take or did not pass and EOC exam*Class of 2013 and 2014 are not required to pass the EOC Biology to meet graduation requirements.
Biology
Pre-Identification and LabelsEnd-of-CourseWinter 2014
Pre-ID LabelsStudents pre-registered October 1- October 30, 2013 will receive blank booklets and pre-ID labels.
1. Apply pre-ID label on the front cover.2. Note the booklet number on the electronic or paper student roster.
Site LabelsStudents using an overage or additional order booklet
1. Apply Site label on the front cover.2. Note the booklet number on the electronic or paper student roster.3. Hand-Grid student information in Boxes 1-6 (all left justified).
Use legal name on the demographic page.Each booklet MUST have State Student ID (SSID), not a social security number.
Slide 14
Uniform administration of state assessments ensures that no one student has an unfair advantage over any other student:
Allow 15 to 20 additional minutes for test proctor activities. Breaks are not included in the timeframes below, follow
breaks as outlined in the Directions for Administration for each test.
Assessments are untimed but must be completed by end of the school day in which it was started.
State Testing Schedules
Testing Window: January 2- February 7
Subject Estimated Student Working Time per session
Algebra, Integrated 1, Geometry, Integrated 2, Biology
3 sessions or single session administration
120 minutes
ACM 19-21
Slide 15
• For EOC assessments given in a single session:• Students who are absent on the day of the assessment may
not make up the assessment during the winter test administration. The next opportunity to test in the spring administration.
• For EOC assessments given over 3 days:• Students who are absent for Day 1 or Day 2 of the test may
take the session they missed on the following day within the 3-day test window.
• Students who are absent for Day 3 of the test cannot make up missed sessions because it is no longer within the approved 3-day window.
State Testing Schedules: Absences
Slide 16
ACM23-26
Tools and Manipulatives
In order to ensure consistent, reliable administration of assessments across the state, OSPI has compiled a chart of tools and manipulatives that students may access during the EOC assessments.
Manipulatives that are used during state assessments should not provide answers but should be:
Familiar to the students Used regularly in the classroom Available where students can get them if they elect to use
them
The charts on page 32-33 in the ACM identify the tools allowed for the end-of-course assessments. The tools
allowed and calculator policy are on pages 25-26 and 33.Any manipulative or tool NOT included in the charts on page 33
should be considered not allowed. (Non-Standard Accommodation Use Forms should be completed to
request the use of an accommodation that is on an IEP but not listed in the Access Supports and Accommodations Guidelines.)Slide 17
Score Results Release Dates
Administration
Subject Paper Reports
Winter EOC 2014
Algebra, Integrated Math 1, Geometry, Integrated Math 2
4/26/13
Slide 18
Irregular Test Administration All group and individual testing irregularities must be documented. Follow your district guidelines and protocols.
Proctors should:1. Call the SAC as soon as possible.2. Make a notation on the Test Security Assurance Form.3. Make a notation in the Note section on the booklet cover (in consultation in the
SAC).School assessment coordinators should:1. Call DAC as soon as possible.2. Hand-grid the demographic page, where applicable.3. Note the irregularity on the Pre-ID Roster.4. Complete the corresponding irregularity report.
Never invalidate a test. Invalidations are determined by DAC, SAC, and in consultation with OSPI .
NOTE: A decision of whether or not to invalidate a test may be deferred until after student scores are available and it is determined if the irregularity impacted what the student knows and is capable of doing.
Slide 19
What can we learn?Scenario:
Proctor provided graph paper for students during a Math EOC assessment.
Response:Not OK. There is a list of materials for students and those are the only ones that can be provided. Students may only use the graph paper included within the math EOC test booklets. While students are encouraged to make notes in the booklet, additional graph paper is not allowed for End-of-Course.
Scenario:Proctor allowed students who needed more testing time to carry their test booklets down the hall to the library.
Response :Not OK. When moving students, proctors are to collect test booklets; they should be redistributed once students are seated in the new location. It is important to verify that the student is working in his/her booklet and the new location does not have inappropriate materials on the wall for that particular test.
Slide 20
What can we learn?Scenario:
Proctor observed two students sharing information during the test. She collected the note passing between them and separated the students but allowed the students to continue testing.
Response:OK, but incomplete. This irregularity must be reported to your building Coordinator as soon as possible. Remember: Never invalidate a test yourself.
Scenario:The principal trained a proctor to scribe for an IEP/504 student.
Response:OK. IEP/504 students are allowed to have a scribe if documented as an accommodation in the Individualized Education Program or 504 Plan.
Slide 21
What can we learn?Scenario:
Teacher inadvertently sees a test question and it occurs to him that he did not cover that content. He adds that problem to today’s lesson plan.
Response:Not OK. If you legitimately see a test question through test administration, it violates the state code of conduct to use that information to try to improve test results, such as doing special instruction with students based on what you saw on the test.
Scenario:A student reports that when he turned in the test booklet the teacher flipped through the booklet and told him he had left a response blank. He was asked to go back and complete the test.
Response:Not OK. No one is allowed to review or read test booklets except when necessary during test administration. It is okay to repeat the direction to the whole class, “When you finish be sure to check that you have answered all the questions on each page.”
Slide 22
CAUTION: Never mark or obscure the security barcode on front of test booklet.
(This barcode is used to track the return of test booklets.)
CAUTION: Never mark or obscure the security barcode on front of test booklet.
(This barcode is used to track the return of test booklets.)
Place Pre-ID student or a Site label here, if needed.
Test Booklet Cover
Notes:Use to note scribe name, irregular administration information, etc.
Student’s Signature (Required)
Print or use school- or district-created labels here
Booklet Number
Spine markings and booklet colors will differentiate between Biology, Year 1, and Year 2 Math booklets.
Slide 23
Coding Demographics
Bubble State Use Box, Row 1 “Y” if a scribe is used for an emergent inability to write.
Left Justify all demographic information
Slide 24
Your electronic or paper Pre-ID Roster should be used to: Track material within the district and school. Verify accuracy of pre-coded student demographics and suggest updates for your
student information system. Document test booklet barcode assignment when using an overage booklet. Document reason for not testing, Excused or Unexcused, Withdrawn date, etc. Document testing irregularities. Document accommodations used. Add student information when assigning a test booklet to a new student.
Pre-ID Student Roster
Slide 25
After Testing – Boxing Booklets
Sort booklets by grade level: Put hand-gridded booklets and booklets with an irregularity
on top of each grade level stack (for district assessment coordinator review).
Verify booklet count and annotate your student roster as needed.
Sort booklets by:To-be-Scored
Stacked by content.
Not-to-be-Scored Use Red X label (placed in or over the student label box)
on individual booklets. Leave shrink wrapped booklets as is.
Includes all unused booklets.
ACM37-38
SAVE BOXES FOR RETURNING MATERIALS
Slide 26
After Testing - Paperwork
Forms that must be completed on pick up date: Test Security Assurance Form Proctor Training Log School/Site Administration Security Report Pre-ID Roster signed by the Principal E-mail the Pre-ID Electronic Student Roster or
deliver the paper roster with annotations
Slide 27
For AssistanceWhen you have questions:
Proctors: Refer to the DFA Contact their school assessment coordinators
School assessment coordinator: Refer to the ACM Contacts the district assessment coordinator
District assessment coordinator: Refer to the ACM Contact OSPI
OSPI will refer calls from school staff to their district assessment coordinator.
Slide 28