ISTEP+ Pretest WorkshopSpring 2013

1

Agenda• Operational ISTEP+

– Grades 3, 4, 5, 6, 7, 8

• Pilot and Validation Sites

• ISTEP+ Paper/Pencil

• ISTEP+ Online

• Return of Results– Online Reporting – Parent Network

• ISTAR Assessment

• IMAST Assessment

• LEP Students

• Ethical Testing Practices

• Questions & Answers

2

Test Windows

• March 4 – 13 ISTEP+ Applied Skills (Paper/Pencil and

Online)

• April 29 – May 8 ISTEP+ Multiple-Choice Paper/Pencil IMAST

• April 29 – May 10 ISTEP+ Multiple-Choice Online

• May 6 – 17 CoreLink Online

3

Operational ISTEP+

Applied Skills: Online, Paper/Pencil

Applied Skills Online: • Online ELA and SS ONLY• Math and Science – custom

“partial” paper/pencil booklet

Applied Skills Paper/Pencil: • Gr. 3-8: one single student test

booklet • Students MUST use the same

correct book for ALL sessions What if two books are used

(TCM) Avoid Undetermined test

results!

Multiple-Choice: Online, Paper/Pencil

Multiple-Choice Online:• ELA, Math, Science, Social

Studies

Multiple-Choice Paper/Pencil: Insufficient Technology / Accommodation ONLY

• Gr. 3 one single test booklet

• Gr. 4-8 two booklets Test booklet Answer booklet

• Students MUST use the same answer book for ALL sessions

Avoid Undetermined test results!

• Gridded Responses / Calculator Usage begins in Grade 6

4

All Students, Grades 3-8• Same rules apply

– Who participates, accommodations, security– IMAST participation (April/May window)

Critical – do not take ISTEP+ in IMAST content area(s)

(Applied Skills and Multiple-Choice Assessments)

Avoid Undetermined test results!

• Results have consequences for students, schools, and corporations– Remediation, accountability

• Science and Social Studies required

• Applied Skills images and Applied Skills items released via the web

5

Student Test Number (STN)• Every test MUST have an STN

• STN is critical for matching students across test windows (AS, MC)– Undetermined and accountability concerns

• Results are dependent on matching student records (AS, M/C)– If you do not have a barcode label for paper/pencil, bubble!

One STN per student (stays with student) Schools required to supply missing STNs

– Used to calculate participation rate

• Every Undetermined score will count as a “Not Participating” student

• Schools must account for every student not tested—keep records now to prepare for the DOE-NT collection.

6

Book II (Pilot) and Validation Sites

• Book II Sites (Pilot)– Applied Skills window ONLY; Paper/Pencil ONLY– Selected schools; required participation– Early pickup of test materials (by school)

March 15GREEN label

• Validation Sites– Multiple-Choice window ONLY; Online and Paper/Pencil– Critical to verifying the equating process

• Selected schools; required participation

– Early pickup of paper/pencil test materials (by school) May 10TAN label

7

DOE-TL Barcode File: Paper/Pencil and Online

• Period 1 Barcode file submitted Dec. 10 – Jan. 16 – Labels delivered Feb. 15-19 in Applied Skills TC Kits

• Period 2 Barcode file submission Feb. 25 – March 8– Via STN site

– Any students who were not submitted in Period 1, including: Students new to the school

Additional IMAST students, based on Case Conference Committee decisions for students that were not submitted in Period 1

– Labels delivered April 15-16 in Multiple-Choice TC Kits Paper/Pencil (due to insufficient technology/accommodation) IMAST

• Barcode files used to “populate” ISTEP+ Online (AS, MC)

8

ISTEP+ Paper/Pencil: Barcode Labels

• Review Barcode Label “rules” in the Test Coordinator’s Manual (TCM) SIQ #3 - #8

• Not all data on the label; see the roster for details

• Bubble for all “new” students without labels

• Use ONLY labels for the Spring 2013 test administrations Destroy all unused labels after Multiple-Choice test (May)

Students’ names MUST also be on the tests written in the students’ own handwriting!

9

ISTEP+ Paper/Pencil: Calendar

Applied Skills

• Dec. 10 – Jan. 16 Period 1 Barcode File

• Feb. 11-15 Test Materials Delivery

• Feb. 15-19 Test Coordinator Kits

(include Period 1 Barcode Labels)

• Feb. 27 Last day to report shortages (TMA opens 2/15)

www.ctb.com/

• March 15 Mandatory pickup date for ALL Book II schools; GREEN label

• March 18-26 Scheduled pickups for corporations and nonpublic schools; YELLOW and BLUE labels

Multiple-Choice• Feb. 25 – Mar. 8 Period 2

Barcode File Via STN site Include any new students and

additional IMAST students

• April 3-12 Test Materials Delivery

• April 15-16 Test Coordinator Kits

(Per. 1 & 2: ISTEP+ and IMAST Barcode Labels)

• April 23 Last day to report shortages

www.ctb.com/ (TMA opens 4/11)

• May 10 Mandatory pickup date for ALL Validation schools; TAN label

• May 13-15 Scheduled pickups for corporations and nonpublic schools; PURPLE and BLUE labels (very tight schedule—no extensions!)

10

February 15 – Predetermined Pickup Schedule posted: IDOE-TCC and www.ctb.com/istep

ISTEP+ Paper/Pencil: Large Print & Braille

• Shipped directly to TC

• Know how to process documents– See Appendices in TCM – Avoid Undetermined results!

• Non-Standard Responses (NSR)– Use pastel paper (computer-generated)– Insert document(s) in front of the back

cover– Keep a copy in a secure location

(principal’s office)– Documentation

At top of CG response and on School/Group List

CGR bubble on front of test booklet 11

ISTEP+ Paper/Pencil: Materials Return

• SAVE YOUR BOXES!! (ISTEP+ and IREAD-3)– Return in correct boxes - do not mix (Blue; Gold)

• Please read directions! (TCM and posters)

• “Things To Remember” (TCM)

• How will you account for every test document?– ALL student test documents must be returned

• Teacher names must match exactly on:– Group Information Sheet (GIS) and– School/Group List (SGL)

• All three counts must match (GIS, SGL, actual documents)

This is a critical issue with regard to turnaround time for results!

12

ISTEP+ Paper/Pencil: Packing & Shipping

• ISTEP+: Use “Stack Cover Cards” and Paper Bands– Please read directions, TCM

• IREAD-3: Use envelopes

• Unique Barcode Shipping Labels (by school)

• Be sure to use the correct shipping labels and boxes for each test!! (ISTEP+, IREAD-3)

13

IREAD-3: Gold-and-white

box

Blue-and-white box used for paper/pencil tests:• Applied Skills• Multiple-Choice (Insufficient Technology /

Accommodation only)• IMAST

14

ISTEP+ Online: Calendar

Applied Skills

• Dec. 10 – Jan. 16 Period 1 Barcode File

• Feb. 15 AS Online Examiner’s Manual Delivery

• Feb. 15-19 Test Coordinator Kits (include Period 1 Barcode

Labels)

• Feb. 18 AS Content Release and Pre-assigned Practice and Operational Tests

• Feb. 25 – March 13 AS Online Practice Test Window

Multiple-Choice• Feb. 25 – Mar. 8 Period 2 Barcode

File Include any new students and additional

IMAST students

• March 8 MC Online Examiner’s Manual Delivery

• March 15 MC Content Release and Pre-assigned Practice Tests

• March 18 – May 10 MC Online Practice Test Window

• April 1 MC Pre-assigned Operational Tests

• April 15-16 Test Coordinator Kits (IMAST and ISTEP+ P/P Barcode Labels)

15

Test Administration System (TAS) Trainings• February 20 – April 16• 5 Regional (onsite sessions) & 15

Webinars • Optional 7 Pre-Administration Q&A Sessions

CoreLink: • Early April – Content Release and Pre-

assigned Practice/Operational Tests• April 15-16 Online Examiner’s Manual

Delivery• May 6-17 CoreLink Test Window

ISTEP+ Online: Overview• Applied Skills: ELA and Social Studies ONLY

• Multiple-Choice: Extended window (April 29 – May 10)

• List of schools with testing online status posted www.ctb.com/istep

• Test Administration Trainings (TAS) Train-the-Trainer: February 20 – April 16 Required Session: Regional (onsite) or Webinar Optional: Pre-Administration Q&A Sessions

• Practice Test Required 2 opportunities scheduled per student; at least

1 required 16

ISTEP+ Online: iPads

• iPads for Multiple-Choice Online (and CoreLink) only– iPad 2 or later– iOS 6 or later– iTunes Store “OAS IN”

• Expected availability week of February 11• Watch for more information from CTB

– “Guided Access” MUST be enabled– Android tablets supported next year

(10-inch class)

• More info & WebEx posted www.ctb.com/istep

17

ISTEP+ Online: Details

• Accommodations must be assigned

• Scheduling – All students in a class complete test

session on the same day

• Critical changes for 2013– Display of “Not Testing”– Confirmation of “Do Not Score”

• EVERY one of these must be documented!!!

18

Oklahoma Online Program Overview www.ctb.com/istep

Test and Technology Coordinator Support Materials

General information about the tests

Single Sign-on Access

Demo TAS Website Access

Report testing problems to CTB

News and Information

Community forum access

Contact details to reach

the Help Desk

Scrolling News Ticker

ISTEP+ Online: CTB Web Portal

c

a

e

b

d

f

a

b

c

e g

h

i

j

d

f

g

h

i

j

k

k

Test Administration System (TAS) Enhancements

• Display students “Not Testing” on student panel• “Do Not Score” status change confirmation• Class name included on student and summary test

tickets• Test ticket student credentials printed in lowercase• Corporation or school name visible after login

without having to click double arrow button• Ability to view up to 500 students in test session

status from single screen

Looking Ahead C3ISTEP+ Online: Enhancements

Blocking Ruler NEW!

Eraser

Highlighter

Manipulative (protractor, ruler, calculator)

Mark for Later Review

Option (Answer choice) Eliminator

Reference card (grade 8)

ISTEP+ Online: Student Testing Tools

•Screen reader / Text-to-speech (TTS)•Variable Font Size, Font Color•Variable Screen Background Color

Accommodations available for

students with an IEP, Section 504 Plan, ILP include:

ISTEP+ Online: Student Testing Accommodations

CTB• Create and pre-assign students to all test sessions

using Barcode data by February 19:• Two practice test sessions created and students

assigned • Operational test sessions created and students

assigned

Corps/Schools• Prior to Testing:

• Add new students to system and assign to test sessions

• Assign online testing accommodations (font, screen reader)

• Move students to different classes (reporting)

ISTEP+ Online: Pre-Assigned Test Sessions

ISTEP+ Applied Skills and IREAD-3 Spring

CTB• Create and pre-assign students to all test sessions

using Barcode data by April 1:• Two practice test sessions created and students

assigned• Operational test sessions created and students

assigned

Corps/Schools• On or before March 25:

• Add new students to system for CTB to create and assign

• Assign online testing accommodations (font, screen reader)

• Move students to different classes (reporting)• After April 1:

• Add new students to system; assign new students to sessions

ISTEP+ Online: Pre-Assigned Test Sessions

ISTEP+ Multiple-Choice

Experience Online Testing (Optional)

Access at IDOE Website

Internet Simulation of Test Delivery Client

Open Access – No Login Credentials Required

No Software or Content to Download or Install

Available 24/7

Can be Taken at Home

Practice Test (Required)

Create Test Session in TAS

Assign Students in TAS

Requires Test Tickets and Access Codes

Requires use of Workstation- Installed Test Delivery Client

One Practice Test per Student Required by IDOE

Must Be Taken at School

ISTEP+: Experience Online Testing , Practice Test

URL: http://www.doe.in.gov/achievement/assessment/

ISTEP+ Online: Marking a Test Session “Do Not Score”

Click the Toggle DNS (Do Not Score) button, which is activated after highlighting the student record.

Indicating students who will not test

ISTEP+ Online: Mark a Student as “Moved/Not Testing”

Results: Online Reports• All reports via Indiana Online Reporting System

(INORS) Corporation- and school-level Secure site with unique passwords Contains FERPA-protected data! (Family

Educational Rights and Privacy Act) Teacher Access

• Determined by GIS and SPN/Online teacher groups Available 24/7

• Student-level data, end of May• Summary-level data, June

• One paper copy of Student Report and Label (June)

28

Results: Details

29

ELA, Math, Social Studies:

Grades 3-8 ELA, MathGrades 5, 7 Social Studies

• End of May: INORS Reports and Applied Skills Images available

• June 7: Student Reports and Labels delivered

• End of May/mid-June: Rescore Window

• Late July/Early August: Rescore reports arrive

Science: Grades 4, 6

• Late June: ISTEP+ and IMAST Science Cut Score Setting

• Late August: INORS Reports and Applied Skills Images available

• Late August: Student Reports and Labels delivered

• Late September: Rescore Window

• October: Rescore reports arrive

Results: Parent Network

• Online parent access

• Parents can see test results “over time” (multiple years)

• Invitation Codes sent to May “testing schools”– Distribute upon receipt

• Applied Skills Images linked to results in PN– Parent review of student response

• Parent Request Required for Rescore– Parent / school staff collaborate– School to document and submit rescore request

30

Parent Network

31

ISTAR: Indiana’s Alternate Assessment

• Indiana Standards Tool for Alternate Reporting

• ISTEP+ or ISTAR– All students must participate in assessment; Case

Conference Committee decision to use ISTAR Referenced to Indiana Standards; will NOT lead to

diploma March 1 – April 30 window; Web-based system Requires use of STN Teacher ratings; cut scores (Pass+, Pass, Did Not

Pass)

– Federal Regulation Sets a 1% limit for corporations & state on students

who can be “proficient on Alternate Standards” for accountability

No limit on the number of students who can participate in ISTAR

32

It is important for each student to participate in the most appropriate assessment for that student.

IMAST: Indiana’s Modified Assessment

• Indiana Modified Achievement Standards Test– Grades 3-8; E/LA, Math, Science, Social Studies– Students on-track to receive a diploma

• Eligibility criteria– Case Conference Committee decision by February 28

• Collecting student counts (no survey this year)– Include students in DOE-TL Barcode submissions

• Multiple-Choice Format – April/May window ONLY– Critical – do not take ISTEP+ in IMAST content area(s)

(AS, M/C)– Avoid Undetermined test results!

• No limit on the number of students taking IMAST

33

It is important for each student to participate in the most appropriate assessment for that student.

English Learners/LEP Students

• All EL students MUST take ISTEP+– Except those enrolled in US schools < 1

yearEnrolled after March 1, 2012 to be <1

year MAY substitute LAS Links for ISTEP+ E/LA

Corporation-wide decision!

Must take Math and Science (4 & 6) Social Studies (5 & 7)

– Accommodations (refer to Appendix C)34

• Appendix C in the Indiana Assessment Program Manual – Outlines the standard accommodations for students with

an IEP, Section 504 Plan, ILP or Nonpublic Service Plan

• Non-Standard Assessment Accommodation – One NOT identified in the Indiana Assessment Program

Manual– Deadline to submit based on dates listed on the Request

for Non-Standard Assessment Accommodation form– Must be approved by the Office of Student Assessment– Note: Request for paper test during Online administration =

non-standard

Accommodations for Special Education and LEP

students

35

Ethical Testing Practices: Overview/Highlights

• Indiana Assessment Program Manual – Chapter 10– The basis for local training– Test security and integrity training prior to actual test window

represents a review; highlight areas of critical importance.

• Formal Training for Staff– To administer the assessment, staff MUST have

• participated in security training (at the beginning of the school year).

• signed the Indiana Testing Security and Integrity Agreement.• received training regarding specifics of test administration

(mechanics).

• Policy requirement– Every school corporation and school (public, charter, nonpublic,

and Choice) MUST have a test security policy.

36

Ethical Testing Practices: Preparing for the Test

• Review and approve materials used to prepare students

• Provide training for staff (classroom practices, test administration)– Acceptable teacher practices: prior to, during, and after the

test– Appropriate test administration policies/practices

(mechanics)– Specifics regarding test security and integrity

• Assign test examiners and proctors – Review examiner qualifications

37

Ethical Testing Practices: Ensuring Examiner Readiness

• Examiner’s Manual: secure document

• Access to Examiner’s Manual (EM)– Staff may retain EM in a secure location

after orientation session

• Access to assessment books (student documents)– NO advance access to actual student test

documents

• Usernames, passwords and access codes – Same level of security as test books

38

Ethical Testing Practices: Administering the Test

• Administer test sessions in order• Examiners/Proctors must monitor test sessions

– Reminder: no cell phones (students and adults)

• Examiners/Proctors should not use a student’s keyboard except in the case of a scribe.

• If a concern arises regarding an item….– Refer to the item by content area, test

session, and item number– NEVER make a copy or email the item (even to

IDOE)!

• Unannounced security audits (IDOE due diligence)

39

Ethical Testing Practices: Materials Security

• CTCs and STCs MUST:

– Control secure storage, distribution, administration, and collection of test documents/materials Inventory and track materials, including Test

Tickets Critical: Daily sign-in/sign-out system for paper

tests

– Ensure that no test items are copied from a computer screen or by using a copy machine

– Return all used and unused test materials40

Ethical Testing Practices: Security Violations – Part 1

• Communicate security policy, ethical practices, consequences

• Provide a way for students and staff to report concerns and insure rights of those involved

• Establish a process to investigate irregularities, concerns, complaints

• Report security violations to the Assessment Office – Appendix B: Testing Irregularity Report form

(send via fax)– Note: “Testing Concerns & Security Violations Report”

designed for use by parents or other concerned individuals

41

Ethical Testing Practices: Security Violations – Part 2

• It is a violation of test security to:– Give students access to test questions in advance

– Coach students in any way during the test

– Copy, reproduce, or use in any manner any portion of a secure test document for any reason

– Alter answer documents during or after testing

– Score student responses on the assessment

42

Refer to Chapter 10 of the Indiana Assessment Program Manual for more details.

What if…• If in doubt call the ISTEP+ office! (317-

232-9050)– A number of events can occur; time is of the

essence!

– Document (Write it down at the time!)

– Sample issues/concerns: Test material issues Test irregularities Student or adult cheating Student illness Interruption to testing Exposure of items Acts of nature Inappropriate testing practices

43

Assessment Resources• Visit www.doe.in.gov/achievement/assessment

– ISTEP+ Blueprints; Item Samplers; Instructional/Assessment Guidance

– Diagnostic Assessments– And more!

• Test Coordinator Corner (TCC)– Information specific to TCs

Electronic copies of TCM and other resources– Located in Learning Connection community

IDOE - Test Coordinator Corner For CTCs and nonpublic/charter/Choice STCs

44

Contact Information• ISTEP+ Office

Telephone 317-232-9050; Toll Free 888-544-7837 Fax 317-233-2196 Web site

www.doe.in.gov/achievement/assessment Email istep@doe.in.gov Karen Stein, Spec. Programs Asmt. Specialist

kstein@doe.in.gov

• CTB / Indiana Help Desk Telephone 800-282-1132

ISTEP+ Online – Option 2 Fax 800-282-0266 Email ctb_istep_helpdesk@ctb.com CTB ISTEP+ Web Portal www.ctb.com/istep

• ISTAR – Office of Special Education 317-232-0570

• EL/LEP – Office of English Learners 317-232-055545

Questions?

Thank you for participating!

46