aims pre-test workshop

AIMS Pre-Test WorkshopSpring 2011

Test Coordinator Resources

• AIMS Update• Test Coordinator Manual• Test Administrator Directions• Directions for Administration• ADE Resources• Pearson Resources

District Test Coordinators

• Serve as the liaison between ADE and MSD for all AIMS and Stanford 10 testing issues.

• Preferred method of communication: email– Use Appropriate Subject Lines

• District Test Coordinator– Emergency Contact Number 602.463.8256

TCM p. 1

Site Test Coordinator

• Monitor Test Activities• Check-out materials at the beginning of each

test day• Check-in test materials at end of day


• Student Responses have been properly transferred

• Complete Header Sheets and all accompanying inventory documents


• Communicate Schedule• Arrange for test Materials

– Pencils, dictionaries, thesaurus, etc

STUDENTS TO BE TESTEDAND TEST SCHEDULE

Spring 2011 Test Administration

Students to Be Tested

All Arizona public school students in Grades 2 and above will participate in testing as described in the following slides.

Students with an IEP who are eligible forAIMS A are excluded from AIMS or Stanford 10 testing.

TCM p4

Test Administration Schedules

• All AIMS tests and Stanford 10 tests are untimed

• Times are provided for planning purposes only• Students must be allowed to finish testing

even if the scheduled time for the test has elapsed

• There are breaks scheduled within all days of AIMS and Stanford 10 testing - refer to TADs and TCM for details

TCM p5TAD p3

Test Coordinator Question

• 99% of your the students have finished taking the reading assessment and 80 minutes have passed since the beginning of testing.

• What will happen at your school?

Test Coordinator Question

• How are you going to organize and schedule Make-Ups Test?

AIMS 3-8

• Students in Grades 3-8 are expected to test in all content areas as determined by grade

Grade Writing Science Reading Math

3

4

5

6

7

8

AIMS 3-8

• Day 1 – Writing and Science – April 12• Day 2 – Reading and Mathematics – April 13• Day 3 – Reading and Mathematics – April 14• Day 4 – Reading and Mathematics – April 15

• Make –ups will be conducted no later than April 22nd

AIMSUpdate

TAD p2-3

Test Schedule – AIMS 3-8

AIMS 3-8

• Pre-ID Labels – Pre-ID Labels will be produced for all

students in grades 3-8 based on SAIS enrollment data.

AIMSUpdate

AIMS 5, 6, 7 Writing Changes

• Scoring AIMS Writing prompt– The AIMS Writing prompt response will be

scored using a holistic rubric based on 6-traits.

– The time to administer the AIMS Writing prompt has not changed.

– The extended response score will account for 60% of the AIMS Writing score.


• Addition of Multiple Choice Items – AIMS Writing multiple choice items will be

embedded in the AIMS Reading test. – The time to administer AIMS Reading has

not changed. – AIMS Writing multiple choice items will

account for 40% of the AIMS Writing score.


AIMS Writing Score Reports– To receive an AIMS Writing score students

must complete both the prompt response and the multiple choice items.

– The prompt response score and the multiple choice scores will be reported.

Stanford 10 – Grade 2

• Students in Grade 2 in state-funded schools are expected to test.

• Reading Comprehension—40 minutes – April 12th, 2010; Tuesday

• Mathematics Problem Solving—44 minutes – April 13th 2010; Wednesday

• Language—38 minutes – April 13th 2010 or April 14th 2010 – Wednesday or Thursday

TCM p6

Stanford 10 – Grade 2

TEST SECURITY

Test Security

• Test Administrators and Test Proctors must be employees of the school

• Test Administrators and Test Proctors must be trained by the Test Coordinator in all correct test administration and test security procedures for Spring 2011 test administration

TCM p. 25TAD p6TCM p10

Test Security

• Test Administrators and Test Proctors must sign a copy the Spring 2011 AIMS/Stanford 10 Test Security Agreement and adhere to test security procedures

• Signed Test Security Agreements must be kept for 6 years at district

TCM p. 25TAD p7TSA

Test Security

TCM p. 25TAD p7TSA

Test Security Return to District Office for Storage

TCM p. 25TAD p7TSA

RECEIVING TEST MATERIALSPearson

Receiving Test Materials – AIMS 3-8

• RECEIVING TEST MATERIALS• Site Drop-Off

– Monday, April 5th

• Site Pick Up– April 25th to April 29th – Set Appointment with Jason

TCM 11

Receiving Test Materials – Stanford 10

• Site Drop-Off– Monday, April 5th

• Site Pick Up– April 25th to April 29th – Set Appointment with Jason

Critical Dates

Receiving Test Materials

• Verify all boxes you received are for your School

• Verify all boxes were received

TCM 11


• Keep all boxes for return shipping• White boxes will be used for District and

School Test Coordinator’s Kits• Brown boxes will be used for test materials• Each box of the shipment will be hand-

numbered

TCM 11


• Organize shipment by box number


• Refer to School Packing List for Box Numbers and Box Contents

TCM 11

Inventorying Test Materials• Open school boxes

– Materials should match School Packing List(s)

• Test materials in school boxes are based on participation counts

TCM 13

Inventorying Test Materials

• Test materials in district box are overage– 5% overage AIMS 3-8– 5% overage Stanford 10

TCM 13


• Compare actual quantities of test books and answer documents received with quantities needed

• Verify that your school has sufficient scoring and shipping materials

• If additional test materials or scoring materials are needed, contact Jason ASAP with a specific count

TCM 13


• Maintain an accurate inventory of all materials at your school

• Save all packing lists from the initial order and any additional orders to aid in the completion of the Materials Inventory Sheets when materials are packaged for return

• Test books and answer documents are to be stored in a secure location at all times

TCM 13

Additional Order Window

• AIMS 3-8 – March 24 – 29– Closes at 5:00 pm MST on March 29

TCM Pp14,43

Additional Order Window

• Stanford 10 – March 24 – 29– Closes at 5:00 pm MST on March 29

TCM pp14,43

Additional Orders

• Only the District Test Coordinator may place Additional Orders.

• Only one Additional Order should be placed per district per Additional Order Window.

• ADE approves all additional orders. Be prepared to justify all large additional orders.

• Order as early as possible – orders are shipped as they are approved.

TCM p14

PREPARATION OF TEST ROOMTest Administrator and Proctor

Preparation of Test Room• Test rooms should be prepared prior to day of

testing– Submit date:

• Help student performance by providing– Good lighting– Good ventilation– Freedom from distractions and interruptions


Preparation of Test Room• Student seating should be arranged so that:

– Students cannot easily see the answer documents of others

– Test administrators and proctors can walk by each student.

– Desks and tables should be cleared of backpacks and unnecessary materials


Preparation of Test Room• Materials that can be posted in testing room

– AIMS Mathematics Reference Sheets– AIMS Science Reference Sheet – Holistic Rubric Based on 6 Traits Official

Scoring Guide• Materials must match the grade level tested.

• All other visual aids that could assist students while testing must be removed or covered completely


Preparation of Test Room• Authorized resources:

– Dictionaries and thesauri must be available for the prompt section of the AIMS Writing tests


TEST ADMINISTRATIONTest Administrator and Proctor

Test Administration

• AIMS and Stanford 10 are standardized tests.• Test Administrators should be given the Test

Administration Directions or Directions for Administering at least one day prior to testing

• Test Administrators must follow the directions and read the script exactly as stated in the Test Administration Directions or in the Directions for Administering

TAD p8TCM p10

During Testing

• Students should be allowed to progress at their own pace

• Monitoring should consist of:– Supervising the room at all times during

testing– Answering student questions that pertain to

clarification of test directions– Checking that students are progressing

through testTAD p9

During Testing

• Students may not have access to any electronic devices including computers, calculators, cell phones, portable music players, etc.

TAD p11

During Testing• Disruptive students and students suspected of

cheating– Stop disruptive behavior or suspected cheating– Allow student to continue to test– Student may be moved to a different location so

that others may continue to test undisturbed– Student may be subject to disciplinary

procedures after completion of testing– Document as many details as possible and

report to School/District Test CoordinatorTAD p11-12

During Testing• Students who leave the room during testing

– Students may be allowed to go to the restroom, if necessary, during testing• Only one student may leave at a time• Collect student’s test materials before the

student leaves the room and give back upon student’s return

TAD p12

During Testing

• Students who leave school during testingAIMS 3-8 and Stanford 10– Student will not be permitted to finish that

testing session when he/she returns to school

– Student may participate in other testing sessions upon returning to school

TAD p12

As students finish testing• Students close test book and answer document• Place answer document on top of test book• Raise hand• Test Administrator will collect the test

materials• Once test materials have been collected

student can read or do classwork silently• No electronic devices are allowed

TAD p10

End of Testing Session

• Most students should have time to finish the test during the allotted testing session

• Students that need additional time must be allowed to finish testing– Test Administrators will follow directions

established by Test Coordinator• A testing session or HS content area must

be completed within the school dayTAD – End of each test day


• Account for all test books and answer documents at the end of each testing session

• Missing test books and answer documents must be accounted for prior to dismissing any students

TAD p10


• Inspect each test book and answer document– Student name on front of test book and answer

document – Test books and answer documents in separate

stacks– Pre-ID label affixed or demographic data

bubbled– Form bubbled on answer document – Complete accommodation bubbles in section K– All marks on scorable materials in No. 2 pencil

TCM p15


• All test materials must be returned to test coordinator at the end of the testing session.

• No test materials may be left in a testing room overnight.

Testing Incidents

• Testing incidents that should be sent to Test Administrator for review would include, but are not limited to:– Possible cheating– Inappropriate accommodations– Administration errors

If ADE invalidates a test, invalidation code must be entered on student answer document.

If ADE invalidates a test, invalidation code must be entered on student answer document.

Testing Incidents-Electronic Devices

• Do not send in an incident report for only possession of an electronic device. For these situations, handle student discipline per school policies.

• Do send in an incident report if there is

evidence that the student used an electronic device during AIMS testing.

Questions

• When can items from the test be discussed?• When can a student use scratch paper?• Is an AIMS test available for non enrolled

students?• How are you going to have a daily verification

of test items?

ACCOMMODATIONSTest Administrator and Proctor

Accommodations

• All Test Administrators must read and be familiar with:

Testing Accommodations: Guidelines for 2010-2011

Standard Accommodations

• Standard accommodations are provisions made in how a student accesses and demonstrates learning that do not substantially change the instructional level, the content, or the performance criteria.

• Use of standard accommodations are considered valid for comparison and accountability purposes.

TAG p5


• Accommodations may not provide verbal or other clues or suggestions that hint at or give away the correct response to the student.

• Not all accommodations appropriate for instruction are appropriate for use during state testing.

TAG p5


• Standard accommodations available to:– Students with certain injuries– English Language Learners– FEP Year 1 and Year 2 students– Students with an IEP or 504 plan

TAG p5


• Standard accommodations available to students while testing on AIMS and Stanford 10 are limited to those listed in the

Testing Accommodations: Guidelines for 2010-2011

TAG p5


• It is the responsibility of the Test Administrator to see that: – Students who qualify for testing

accommodations receive them. – Students who do not receive

accommodations are not affected.– Accommodations are marked on answer

document.

TAG p5

Question

How will you organize your ELL students?

What happens if a student has an injury that makes writing or bubbling difficult?

Consider a student at your school that will probably require a standard accommodation, How the process be communicated to the teacher/test administrator?

STUDENT IDENTIFICATION INFORMATION

Test Administrator and Proctor

Pre-ID Labels

• Test Administrators (or other designated adults) are responsible for affixing Pre-ID labels in the proper location on scorable AIMS and Stanford 10 materials – Pre-ID labels may be applied before or after

testing

TCM p. 25TAD p 59

Bubbling Demographic Data

• Test Administrators (or other designated adults) are responsible for bubbling student demographic data on scorable AIMS and Stanford 10 materials for students without Pre-ID labels– Directions for bubbling student demographic

data are included in all Test Administration Directions and Directions for Administering

– Student demographic data may be bubbled before or after testing

TCM p. 25TAD p 59

Recording Accommodations

• Test administrators must record the use of standard accommodations in section K of the AIMS demographic data grid on the student answer document.

• Detailed directions for marking the use of standard accommodations are on pages 36-37 of the TAD.

TAD p 59

Question

• When are the Pre-ID labels affixed? Any reason why not?

RETURNING MATERIALSScorable Materials

Assembling Scorable Materials

• Prior to assembling scorable test materials review pages 16-30 in the Test Coordinator Manuals

• Page 42 in the Test Coordinator Manual has a checklist for packing and shipping test materials - scorable materials

TCM pp 16-30

Use this checklist to help with packing and shipping of Scorable Test Materials

Use this checklist to help with packing and shipping of Scorable Test Materials

TCM pp 42


• Scorable materials must be assembled and boxed exactly as described in the Test Coordinator Manual

• Score reports will be delayed for districts/charters with incorrectly assembled or boxed scorable materials

TAD p16


• Special Circumstance– Test materials contaminated with blood,

vomit, or other bodily fluids• Contaminated test materials cannot be

scored• Student responses must be transferred to

clean documents• Securely destroy contaminated test

materials and indicate on Materials Inventory Sheet

TCM p16


• Special Circumstance– Students who did not respond directly on a

standard answer document or scorable test book (used Braille, large print, or certain accommodations) • Student responses must be transferred to

a standard answer document or scorable test book

TCM p16

Assembling Scorable Materials (AIMS)

• For each school, organize the scorable materials by test program (3-8 and HS).

• All scorables for each test program must be assembled and boxed separately.

• Mixing scorables from multiple testing programs will delay the Spring 2011 AIMS test results.

TCM p16


• AIMS 3-8– Organize the scorable answer documents and

3rd grade test books• Separate by grade• Within each grade, group by teacher if

desired• Each group may only include students from

one grade level

TCM p16


• For each group of AIMS scorables, select a green preslugged Header Sheet with the correct school name

• Pre-slugged and blank Header Sheets have been provided in the Test Coordinator’s Kit

• Header sheets are scannable – Do not photocopy

TAD p16

Header Sheet (AIMS)

• The green AIMS Header Sheet provides data that appears on the score reports.

• Many schools have similar names, confirm that the correct school code is used

• Follow directions on pages 21-23 in the Test Coordinator Manual for completing the Header Sheets

TCM p21-23

Header Sheet (AIMS)

• AIMS 3-8– Group name on page 1 must match group

name bubbled on page 2– Number of Documents on page 1 must

match exactly the # of documents that will be included with the Header Sheet

– Grade on page 2 must be completed

TCM p21-23

Assembling Scorable Materials (Stanford)

• Stanford 10– Organize the 2nd grade test books

• Group by teacher if desired

TCM p16

SSID Sheet (Stanford)

Stanford 10• For each group of Stanford 10 scorables, select

a purple SSID sheet with the correct school name– Pre-slugged and blank SSID sheets have

been provided in the Test Coordinator’s Kit– SSID sheets are scannable – Do not

photocopy

TCM p24

SSID Sheet (Stanford)• Stanford 10

– Grade on top section on page 1 must match grade bubbled in bottom section on page 1

– Teacher, Counselor or Group must match Teacher, Counselor or Group name bubbled on page 2

– Number of Documents must match the exact # of documents that will be included with the SSID Sheet

– “If You are Using This Side, Please Mark this Circle” on page 2 this bubble must be marked

TCM p24


For each group:•Arrange all scorable documents face up in the same direction•Place the completed green Header Sheet (or purple SSID) on top of group with Side 1 facing up•Wrap one band around the stack horizontally or vertically. Be sure the band holds the documents securely.

TCM p17


TCM p17

Assembling Scorable Materials• If a group of scorables is too large for the

paper bands• Divide the large group into two or more stacks

so that each can be wrapped securely• Complete a green Header Sheet (or purple

SSID) for each stack of the large group with the same group name on each Header Sheet (or SSID)

• The number of documents indicated on the Header Sheet (or SSID) is the number under that particular Header Sheet (or SSID) not the total number in the entire large group

TCM p17

Stack 1Group Name: Group A

Number of Documents: 100

Stack 2Group Name: Group A

Number of Documents: 70

Complete 2 header sheets for “Group A.” Put one on each stack. The only difference between the header sheets will be

the number of documents bubbled.


TCM p17

School Header Lists

• Prior to completing the School Header Lists review pages 27-30 in the Test Coordinator Manual

• The School Header List serves as a packing list for your scorable materials

• Make sure you are using the correct School Header List for the documents to go under it

• Keep a photocopy of all School Header Lists

TCM p27


• Add each group to the School Header List• Information on School Header List must match

corresponding Header Sheet or SSID• Large groups with more than one header sheet

– List the group once with the total number of documents from all header sheets

– Identify the number of stacks for the large group in the Comments section

TCM p27


• Box scorable materials by testing program– AIMS 3-8– AIMS HS– Stanford 10

• Include in each box only scorable materials from only one school and only one testing program

TCM p18

Assembling Scorable Materials• Place bundled scorables in shipping boxes by

group in reverse order as listed on School Header List(s)– First group on the School Header List should

be on top of first box• Place School Header List(s) at top of the first

scorable box for each school• Fill any empty space with crumpled paper or

plastic bubbles

TCM p18


• Affix a precoded, colored return label on the top of each box of scorables

• Do not mix testing programs• Do not mix scorable and nonscorable materials • Do not box scorable materials for multiple schools

together

TCM p18

RETURNING MATERIALSNonscorable Materials

Stanford 10

• Keep these Stanford 10 Grade 2 test materials in secure storage for use next year– Unused Grade 2 test books– All Stanford 10 Grade 2 Directions for

Administering

TCM p31

Assembling Nonscorable Materials

• Prior to assembling nonscorable test materials review pages 31-33 in the Test Coordinator Manuals

• Page 42 in the Test Coordinator Manual has a checklist for packing and shipping test nonscorable materials

TCM pp 31-33

Use this checklist to help with packing and shipping of

Nonscorable Test Materials

Use this checklist to help with packing and shipping of

Nonscorable Test MaterialsTCM pp 42


• All AIMS test materials must be returned• Organize the nonscorable test materials from

the district overage that was not sent to schools

• Count the number of each type of document and note it on the District Materials Inventory Sheet

TCM pp 31


• Organize the nonscorable test materials by document type for each school

• Count the number of each type of document and note it on the School Materials Inventory Sheet(s)

TCM pp 31


• Box all nonscorables by school• Add district nonscorables in one of the school

boxes• Ok to mix nonscorables from multiple test

programs in the same school box• Place School Materials Inventory Sheet on the

top of each school’s first nonscorable box• Place District Materials Inventory Sheet on the

top of box #1 for districtTCM pp 31


• Fill any empty space with crumpled paper or plastic bubbles

• Affix precoded green return label on the top of each box of nonscorable test materials.

• Number the nonscorable boxes– Sch: Box ____of ____

mark accordingly for each school– Dist: Box ____ of ____

mark in one continuous numbering sequence for the entire district without restarting the numbering for each school

TCM p 33


• Large Districts that return materials on shrink-wrapped pallets – Completing the Dist: Box ____ of ____ section of

the return label is optional– May use Palletized Materials Return form posted

on the Common Logon

Copy on CD

MATERIALS RETRIEVAL

Materials Retrieval

• Schedule a Pick-up date with Jason

SCORE REPORTS

AIMS Score Reports• District Level Reports

– District Summary Report (.pdf)– Student Data File (.txt)District reports are available only electronically.

• School Level Reports– Student Report (.pdf)– Confidential Roster Report with Summary (.pdf)– Summary Concept Performance Report (.pdf)School reports will also be provided on paper.

Stanford 10 Score Reports• District Level Reports

– Master List Summary (.pdf)– Student Data File (.txt) Student Data File is available only electronically.

• School Level Reports– Student Report with Narratives (.pdf)– Master List of Test Results (.pdf)– Master List Summary (.pdf)– Class Master List Summary (.pdf)All .pdf reports will also be provided on paper.

Score Reports

• Download and securely save all electronic reports

• Confirm that results were received for all students who tested– Do not wait until paper reports arrive to

verify all student results have been received• Notify Pearson of any missing results, missing

reports, or report errors by the closing date for corrections

Score Reports – Due Dates

• 3-8 Reading, 3-8 Mathematics, 4 & 8 ScienceMay 25 – posted to PearsonAccessJune 24 – paper copiesJuly 29 – closing date for corrections

• 5, 6, 7 WritingJune 17 – posted to PearsonAccessJune 24 – paper copiesJuly 29 – closing date for corrections

Score Reports – Due Dates

• Stanford 10, Grades 2 and 9May 25 – posted to PearsonAccessJune 24 – paper copiesJuly 29 – closing date for corrections

NEXT STEPSSpring 2011

TEST ADMINISTRATOR AND TEST PROCTOR TRAINING

Test Administrator and Test Proctor Trainings

• Sample items to be included on agenda• Test Security• Preparation of test rooms• Test administration procedures• Correct use of accommodations• Use of pre-ID labels and hand bubbling

TAD p10

Test Administrator and Test Proctor Trainings

• What to do if. . . ?– Student needs additional time– Student is caught cheating– Student is sick– There is a fire drill– Student has an injury that makes writing or

bubbling difficult

TAD p10

Need to send information to Jason

• What day will all test rooms be prepared for testing?• What is the exact location of the overnight test storage room and who has

access to it? • When will you meet with me to count and process tests?

aims pre-test workshop

Documents

test schedule aims

aims reading

aims writing prompt

aims writing score students

test materialspencils

test administrationstudents

test daycheck

days of aims