Spring 2010 Administration of theMeasurements of Student Progress (MSP)

Grades 3-8

Proctor Training

Assessment & Student Information

Jack B. Monpas-Huber, Ph.D.Director

Dianne MurrayAssessment Specialist

Purpose of this Document

To train proctors what they need to know to effectively proctor the 2010 Measurements of Student Progress (MSP)

Paper/PencilGrade Level Paper/Pencil Tests

Grades 3 and 6 MSP—Reading and Mathematics

Grades 4 and 7 MSP—Reading, Writing and Mathematics

Grades 5 and 8 MSP—Reading, Mathematics and Science

Online Grade Level Online TestsGrades 6, 7 and 8 MSP—Reading and Mathematics

The MSP Assessments

Security of the State Test is Paramount

There are three fundamental dimensions to the security of state assessments.

First, the test booklets and accommodated forms must be maintained in a secure manner and not revealed to students or teachers prior to testing.

Second, the students must not be given inappropriate assistance during the time they are taking the test (e.g., visual, tactile or audible clues that lead the students to the correct answer, materials on the walls or blackboards that assist students in finding correct answers, or explanations that lead the student to the correct answers).

Third, the test booklets and accommodated forms have to be maintained in a secure manner before and after administration because items are reused over time.

Staff are not permitted to read, inspect, discuss or transmit secure test content as in items, passages or performance tasks before, during or after the assessment has been administered. Follow your district/building security plan.

Following proper assessment protocol is a matter of professional conduct in Washington

• Confidentiality• Generally Recognized Standards

Ensure understanding of test protocol Confirm the accuracy of student demographics Watch for irregularities during testing Document any inappropriate behavior during

testing Follow the Code of Professional Conduct – Chapter 181-87 WAC

Chapter 181-87 WAC

Teachers are expected to provide students with an opportunity to acquire the knowledge and skills that will be assessed, primarily by providing students with a rich instructional program

Teachers may not, under any circumstances, use secure test materials for instruction of students

Teachers shall maintain the confidentiality of individual students’ results

Teachers may help students improve test-taking skills by: Teaching students test-taking strategies; Providing practice assessments that demonstrate

various item formats; and Using resource materials provided by your district and the Office of

Superintendent of Public Instruction

Responsibilities of Teachers

Responsibilities of Proctors and Staff

Test proctors are educational practitioners who shall:– Attend all required training, read all associated training materials, and sign

Proctor Training Log– Administer tests according to assessment manuals and OSPI updates– Ensure tests are given only to the student identified in the coding– Maintain confidentiality concerning all test content– Document and report any testing irregularities immediately– Sign and submit Test Security Assurance Forms, as required by OSPI

Examples of Prohibited Activities:– Reading, revealing or copying test content– Interpreting or reading test items or passages for students unless otherwise

noted in the student’s IEP for this accommodation; and– Copying or reading student responses – Causing achievement to be inaccurately measured or reported

Estimated Testing Times

Proctor Checklist - Before Testing

Review sample questions at the beginning of each content area in the DFA manuals

Multiple-choice items have either three (Grades 3, 4 and 5) or four (Grades 6, 7 and 8) response options. For these items, students must choose the best answer and completely fill in the circle next to the answer. Any unwanted marks must be erased completely. Each item is worth one point.

Short-answer items ask students to supply the answer, which may be in the form of words, phrases, sentences, numbers and/or pictures/diagrams. Each item is worth two points.

Completion items ask students to supply the answer, which may be in the form of a word, phrase, short sentence and/or numeric answers on the answer line or in the box provided. Each item is worth one point.

Stand-alone items on the Reading assessments are not connected with a passage. Stand-alone items on the Science assessments are not connected with a scenario. Stand-alone items ask students to choose the best answer or write a word or phrase. Each item is worth either one or two points.

In Writing, students are asked to write an essay in response to two prompts. Each prompt is worth six points.

MSP Item Format

Proctor Checklist - Before Testing

Calculators

NO CALCULATORS on Mathematics Grades 3-6

Calculators OK on:Mathematics (use optional) Grades 7 and 8 (MSP)

Science Grades 5 and 8 (MSP)

Students must be thoroughly familiar with the operation of the calculator they plan to use on the test. All calculators must be approved hand-held devices for mathematical computations.

Providing Testing Materials

No. 2 Pencils ONLY Pens, highlighters, markers, mechanical pencils, crayons, and pencils of 2.5, 3.0

etc., are NOT permitted; they will not be picked up by the scanners. Students may use a No. 2 pencil to underline or circle key words in the assessment

directions.

Scratch PaperFor the Reading, Mathematics and Science Assessments, additional paper of any kind is not permitted.

For the Writing Assessment, students must be provided scratch paper for the prewriting and first drafts of each session. It is suggested that you provide at least 3 sheets of yellow lined letter-size (8 ½” x 11”) scratch paper so that it can be easily identified and removed for shredding.

Word ProcessorsWord processors must not be used for any portion of the assessment unless specified in an IEP or Section 504 Plan. Students may not use semantic mapping software. Any student responses generated with word processers must be transcribed verbatim into the student booklet.

Tools and ManipulativesMathematics (MSP) Glossary of non-mathematics terms

(Included in material shipment: one glossary for every 6 students preregistered) Mathematics Formula Sheet

(included on the inside front cover of the student test booklet for grades 6–8) Acetates—ruler, protractor (not provided in shipment-may be ordered via WAMS)

Science (MSP) Glossary of non-science terms

(Included in material shipment: one glossary for every 6 students preregistered) Acetates—ruler, protractor (optional during the Science assessment)

Manipulatives and tools used during the assessment should be those that are familiar to students.

Mathematics Formula Sheets and Glossaries (individual student and poster versions) are available for download from the Test Administration Web site

Mathematics Formula Sheets are included on the inside front cover of grades 6, 7 and 8 mathematics test booklets

Can also project these onto screen for all students “Individual Student“ and Classroom Poster” versions are

available for download from the OSPI Test Administration Web site.

Students must be instructed not to use this page as scratch paper.

All individual student copies provided during the assessment must be collected and accounted for by the proctor then immediately and securely shredded

Mathematics Formula Sheets

Goal is to assure every student has the opportunity to participate in the assessment, without providing a special advantage.

Refer to the Accommodations Guidelines for specific accommodations available to students receiving Special Education Services and English Language Learners

Accommodations available to all students

Document Accommodations

Mark the accommodations usedMark the accommodations used Box 6 must be completed on the back cover (demographic page) of the test booklet, if applicable.

Mark the accommodation plan Mark the accommodation plan Box 7 must be completed on the back cover (demographic page) of the test booklet, if applicable.

Important Note: Important Note: Refer to the Washington State’s Accommodations Guideline for Students with Disabilities

When Speech Recognition software or other assistive technology is used, ensure that secure test information has been removed from all storage devices, including computers.

New this year

Scribing

Scribing should only be used for students who are unable to write their own responses in the test booklet. The need for a scribe must be documented on the students’ IEP or Section 504 Plan. Scribing should not be used to compensate for:

Poor handwriting Poor spelling Difficulty with writing organization and slow production Student’s resistance to performing writing tasks

Partial Scribing may be used if document in the students’ IEP or 504 Plan Transcribing Student Work from a Computer Scribing for student with broken arm, hand, etc.

Individual Testing Irregularity Report must be submitted to OSPI, Assessment Operations Office

Proctor Checklist - Before Testing

Posting Testing Locations Each testing location must be posted with a

sign that alerts staff and administration of testing. When placing the sign, care should be taken not to obscure windows.

This posting assists in preventing interruptions in testing and facilitates the monitoring of testing sites by administration.

Data Recognition Corporation will provide one sign for every 20 students pre-registered.

Create a Proper Testing Environment

An appropriate testing environment:• Includes a site that meets security and supervision requirements but is

familiar and comfortable to students

• Is scheduled so that there are not competing demands on students’ attention before, during or immediately following the assessments

• Includes walls that do not show information that may help students answer items on the assessment. The following are samples of items permitted:

Alphabet Simple number line Writing Checklists Glossaries for non-mathematics and non-science terms Mathematics Formula Sheet

Proctor Checklist - During Testing

Communication Devices and Backpacks

Because cell phones, iPods and other communications devices can be used to transmit information, capture images and disrupt testing, they must be turned off and kept out-of-view and out-of-reach during testing sessions

Use of cell phones during testing will result in an irregularity and possible invalidation

Backpacks, bags and purses must be kept a distance from the student so that items may not be retrieved without leaving the seat

Handling Perceived Error on a Test

Procedure: Contact the School and/or District Assessment Coordinator

immediately Have students complete the section of the assessment. Do not

attempt to provide your own remedy. Assure the student that items found to contain errors will not be counted toward their score.

Security requires that the perceived problem is not copied, shared with colleagues or transmitted via e-mail.

The District Assessment Coordinator will contact OSPI OSPI will provide an equitable remedy, if needed, for all students

Students must: Check their own work to assure that

it is complete Not disrupt others when finished

Students must erase completely any marks they wish to change on multiple-choice items.

If incorrect multiple-choice marks are not completely erased, the scanners may be unable to accurately read the response.

Important Note: The above samples are captured in the DFA and the students’ reading, mathematics and science test booklets.

Incorrect

Correct

Set standards of quality for student testing work

No Media

Media are never allowed in classrooms where there are test booklets or students are taking the test.

Handling Irregularities

Examples of irregularities• Reproduction or review of secure test materials before, during or after the

test administration• Improper test preparation• Unforeseen interruption in test administration• Improper test proctoring including:• Providing non-allowed accommodations• Permitting breaks during testing outside the parameters listed in the DFA• Providing student access to tools or materials not allowed for that test• Coaching, departing from prescribed script in DFA manual or attempting

to artificially inflate the test scores of students• Reviewing student work in the test booklets• Not providing students the accommodations listed on their IEP, Section

504 Plan or ELL accommodations

Handling Irregularities

Proctors should document any testing/security irregularity in administration in:

• “Notes: Proctor/Coordinator Use” box on student booklet• Individual Irregularity Report

Report all irregularities to School MSP Coordinator

Unprofessional Conduct

Acts of unprofessional conduct that may result in invalid scores include, but are not limited to:

• Improper test preparation activities• Improper test administration / proctoring• Providing access to tools or materials not allowed on that test• Reproduction / retention of test content• Student misconduct (cheating)

ATTE

NTI

ON

:Ap

ply

barc

ode

labe

l her

e if

docu

men

t is t

o be

scor

edStudent Signature (Required)

Notes Box:Use to annotate, scribes, irregular administration, etc.

Test

Boo

k Se

curit

y Ba

rcod

e P

rinte

d He

re

Design of the 2010 Test Booklet

Proctors sign student booklet here

The Reading, Mathematics and Science Assessments are to be given in one session. The Writing Assessments are to be given in two sessions.

Reading, Mathematics and Science test booklets must be collected after the completion of the testing day and returned to your school assessment coordinator according to your test security plan.

Writing test booklets must be collected after the completion of session one and stored in a secure, locked, limited access area. Return to your school assessment coordinator at completion of session two according to your test security plan.

Distributing and Collecting Booklets

If a test booklet is incomplete, defective or damaged, the proctor should follow the steps below:

1. Obtain a new test booklet from your School Assessment Coordinator

2. Verify the student’s name and State Student ID (SSID) are bubbled on the back cover (demographic page) of the replacement booklet

3. Document the testing irregularity in the “Notes: Proctor/Coordinator Use” box on the front cover of the student booklet

4. Tell the student to continue with the replacement copy, beginning after the last question answered in the defective booklet

5. Band both the replacement and damaged/incomplete booklets together prior to returning to School Assessment Coordinator.

Handling Defective or Damaged Booklets

Proper Monitoring of Student Test-taking

Proctors and monitors must observe students to ensure they are engaged with the assessment and working independently.

Monitor students and watch for the following:• Be sure students are working on the correct session of the Writing

Assessment;• Be sure students are following the directions given at the beginning of the

session (you may reread the directions to the student, if needed);• Be sure students are using only authorized tools, No. 2 pencils, etc.;• Watch for use of cell phones or other electronic devices

You may not:• Point out to students an incorrectly answered question• Point out questions that have not been completed, or read and comment

on student essays• Paraphrase questions or read the items to the students

Proctor Checklist - Following Testing