1 grades 3-8 test administrator training. test security law t.c.a. 49-1-607 states: any person found...

1

Grades 3-8 Test Administrator Training

Test Security Law T.C.A. 49-1-607 states:

Any person found not to have

followed security guidelines…• placed on immediate suspensionplaced on immediate suspension• grounds for dismissalgrounds for dismissal• includes dismissal of tenured employeesincludes dismissal of tenured employees• grounds for revocation of state licensegrounds for revocation of state license

3

Test AuditsTest Audits • State Test Security Measure: Conduct random

visits during testing to ensure test security and consistency of administration.

• 83 school testing audits conducted during 2008 Achievement Test

• Random audits may take place during any test administration

4

The Scope of the LawThe Scope of the Law• Standard copyright laws must be maintained

at all times.• Secure assessment materials may not be

reproduced or distributed in any way, for any reason, by any person.

• Secure assessment materials may not be paraphrased for use directly in instructional activities, study guides, or classroom resources.

5

The Scope of the LawThe Scope of the Law• Secure assessment materials include pilot and

field test materials.• Secure assessment materials should not be read,

reviewed, or analyzed before, during, or after test administration unless indicated in test instructions or special accommodations.

• Discussion of test content or specific test items with students, parents, or professional colleagues is prohibited before, during, or after the test to protect the validity of the test.

6

State Test Security GuidelinesState Test Security Guidelines• All personnel involved in the testing process must

be trained and training documentation retained for system records.

• All test materials must be kept secure by implementing check-in, check-out and quantity verification procedures for all test materials at the system level, at the school level, and for each test session.

• Handling of test materials must be restricted to authorized personnel at all times.

7

State Test Security GuidelinesState Test Security Guidelines• All test materials must be secured before and after

the test administration. • All test materials must be stored in a locked room

that is inaccessible to unauthorized persons.• All paper and online inventory verifications must

be completed. • A secure environment must be ensured during

testing.

8

Secure Testing EnvironmentSecure Testing Environment• Test administrators must be sure to follow all test

specific directions and time limits.• Test administrators must ensure that all students

receive the correct test materials and that all students receive the appropriate accommodations.

• Test administrators must ensure appropriate monitoring that does not include coaching or illegal assistance.

9

Secure Testing EnvironmentSecure Testing Environment• Create a secure, yet positive, environment for

testing.• Turn off all electronic communication devices (cell

phones, pagers, PDAs, etc.) in the test setting.• Confirm each student is the person named on the

answer document for every testing session. A photo ID may be required if administrators are not responsible for normal classroom instruction.

10

Secure Testing EnvironmentSecure Testing Environment• Require Test Administrators and Proctors to

carefully adhere to all test administration and accommodation instructions, following appropriate schedules and time limits, outlined in all test directions.

• Require Test Administrators and Proctors to remain with the students and be observant and nondisruptive throughout the testing session.

11

Secure Testing EnvironmentSecure Testing Environment• Prohibit coaching students in any way during

State assessments.• Prohibit reading test items and passages by

anyone other than the students being tested, unless indicated in test instructions or accommodations.

12

Secure Testing EnvironmentSecure Testing Environment• Ensure students respond to test without

assistance from anyone.• Ensure that test items are not reproduced,

duplicated, or paraphrased in any way, for any reason, by any person.

• Maintain confidentiality of student-specific accountability demographic information and test results at all times.

13

BreachBreach• Document test security concerns, including

missing materials, on the Breach of Testing Security Report form.

• Failure to report a breach of security compromises the integrity of the testing process and should be treated as a breach of testing security.

14

Secure Testing EnvironmentSecure Testing EnvironmentAny information regarding the content being

measured on the test must be concealed during the test administration. Including but not limited to the

following:

•Maps Maps •ChartsCharts•Posters Posters •Student Work Student Work •Bulletin Board Bulletin Board ItemsItems•Writing Formulas Writing Formulas •Word ListsWord Lists

•Parts of SpeechParts of Speech•Graphic OrganizersGraphic Organizers•Number LinesNumber Lines•DefinitionsDefinitions•Word WallsWord Walls•DisplaysDisplays•ModelsModels

15

Appropriate Calculator UseAppropriate Calculator Use

• Calculators may be used on Mathematics subtests only (Gateway, End of Course, Achievement).

• Calculators must be cleared before and after each test administration.

• Sharing calculators during testing is not permitted.

16

Appropriate Calculator UseAppropriate Calculator Use

• Students may not use the following types of calculators:• pocket organizerspocket organizers• cell phones, PSPs and IPODScell phones, PSPs and IPODS• electronic writing pads or electronic writing pads or • input devicesinput devices

• A list of unacceptable calculators can be found in the Test Administration Manual.

17

The following types of calculators/devices may NOT be used during the test:• pocket organizers• electronic writing pads or input devices• calculators that can communicate (transfer data or information) wirelessly with othercalculators/devices• calculators with symbolic algebra capabilities (e.g., multiply or factor polynomials)

18

The following types of calculators/devices may NOT be used during the test:• Casio models: CFX-9970G and Algebra FX 2.0• Hewlett-Packard models: HP-40G and HP-49G• Texas Instruments models: TI-89, TI-92, and Voyage 200• Cell phones, PSPs, and/or iPodsStudents may use any four-function, scientific, or graphing calculator that does not have any of theabove features. The Test Administrator should verify that calculators used by the students do not haveprohibited functions.

19

State Test Security GuidelinesState Test Security Guidelines• Return test materials immediately after each test

session and when the entire administration is completed.

• Store test materials in a centrally located locked room that is inaccessible to unauthorized persons.

20

Your principal will review your individual school’s test security

plans and assessment procedures with you.Required Documentation:

Security Acknowledgement FormTraining Documentation Form

21

Breach of Test Breach of Test Security ProceduresSecurity Procedures

All Test Administration

Manuals contain a flowchart provided

for guidance in handling potential breach of testing

security concerns.

22

Breach of Test Breach of Test Security ReportSecurity Report

Investigate, document, and report any test

security concerns. Don’t f

orget to

complete Report of

Irregularity

.

23

New Achievement ContractNew Achievement Contract

• Grades K-2 (Optional NRT) • Grades 3-8 (Mandated CRT)• Modified Academic Achievement Standards

Assessment (MAAS)• English Linguistically Simplified Assessment

(ELSA)

24

New Achievement ContractNew Achievement Contract

• TCAP T: Spring 2009 (Operational items assess current SPIs)

• TCAP A: Spring 2010 New Operational Assessment (Assess revised SPIs for RLA, Math, & Science)

• Summer 2010: New Cut Scores Established (Standard Setting Required)

25

Online ResourcesOnline Resources

• Item Samplers & Practice Tests• Educators Guide to Test Interpretation• Teacher Directions• Frequently Asked Questions

http://www.state.tn.us/education/assessment/tsachhome.shtml

26

PearsonAccessPearsonAccess PEMSolutions PEMSolutions

Fall 2008 •TDOE will upload EIS student data to PEMSolutions (pre-id)

Spring 2009 •Testing Coordinators will use the PEMSolutions tool of Pearson Access to:

-manage student data (before and after testing)-access reports

27

PearsonAccessPearsonAccess PEMSolutions PEMSolutions

November 2008 • TDOE will upload student data to

PEMSolutions (pre-id)Last name, First name, MIStudent ID numberBirthdateGenderEthnicityCode A/BGrade

28

Grade 3SUBTEST TEST ITEMS TIME LIMIT

Science, Part 1 39 55


Social Studies, Part 1 39 55


Grades 4-8SUBTEST TEST ITEMS TIME LIMIT





Time LimitsTime Limits

TCAP T Spring

2009 Administration

29

Third Grade Third Grade Answer DocumentAnswer Document

•Pilot results are in… Results are positive!

•ALL students grades 3 – 8 will now use a separate answer document.

•ALL students (3 – 12) may mark in test booklets.

30

•Practice answer document created as a resource for teachers of grades 3-8.

•Designed for practice in filling in bubbles on a document similar to the TCAP Achievement answer document.

Available online at:Available online at:http://www.state.tn.us/education/assessment/doc/Grade3_Ansdoc.pdfhttp://www.state.tn.us/education/assessment/doc/Grade3_Ansdoc.pdf

Practice Answer DocumentPractice Answer Document

31

Please note:On the actual

answer document, a space will be provided to indicate the

completion of each subtest.

Practice Practice Answer Answer

DocumentDocument

32

Item Item Development Development

CycleCycle

Items selectedfor test

Items field-tested

Items developed by ETS

Items reviewed by TN educators

Field-test results analyzed

33

Testing WindowTesting Window

• April 20-April 24, 2009

• Districts select 5 consecutive school days for testing and make-ups

• All schools must adhere to district-selected testing window

34


All students in a grade level within a school must adhere to the same test schedule with the exception of students who require extended time and/or flexible setting accommodations and students who are taking make-ups.(same subtest at the same time on the same day).

35


• Make plans now for calculators if your system chooses to use them.

• An entire content area is tested in the same day.

36

• Begin work on Medical Exemption documentation as soon as possible. Do not send in homebound forms as documentation. We must have a physician’s statement detailing why the student cannot test (including homebound students).

• Be sure we have your current contact information so that you will receive updates.

37

At this time we are being told that the test will be pre-coded. You must assure that the name on the bar code label correctly matches the student. Test administrators will still be required to code the following information:

• Special Ed Information• Gifted Information• Free/Reduced lunch information

38

• Allowable Accommodations must be used consistently by the student throughout curricular instruction during the school year.

• Many of the Allowable Accommodations require planning by school personnel prior to TCAP test administration.

• The teacher must discuss the accommodations with the student prior to testing.

39

http://www.state.tn.us/education/assessment/tsaccom.shtmlInstructions: http://www.state.tn.us/education/assessment/doc/tsallowaccin.pdf

40

Large Print or Braille

•Extended Time is allowed if student has this accommodation documented on the IEP or 504 Service Plan.

41

Sign Oral Instructions Verbatim

•Allowable accommodation on TCAP and writing assessment.

42

Repeating Instructions

•Directions normally read aloud or signed to students may be re-read/signed verbatim as needed. This includes prompts for the Writing Assessment.

43

Calculator /Mathematics Tables

•Four-function calculators (not provided with test materials) may be used on Part 1 and 2 of the Math Test (Page 28 and 32 in Teacher Directions).•Math Tables: multiplication, addition, subtraction, and/or division

44

Flexible Setting•Students may take TCAP assessments in an individual or small group setting, seated in a designated area of the room, in a study carrel or in another classroom setting (e.g., library). •Homebound students may take the test at home or another approved location with appropriate documentation.•Note: Recommended size for small group setting is two to five (2–5) students. Small group setting should NOT exceed ten (10) students.

45

Visual/Tactile Aids•Aids may include magnifying devices, use of templates to reduce the amount of visible print on a page, masks, pointers and abacus.

46

AUDITORY AIDS •Auditory aids include amplification devices and devices that are used as noise buffers. This includes white noise machines.

47

Multiple Testing Sessions(within school day)

•TCAP tests or subtests may be given in smaller segments adhering to the allotted time for that test/subtest as specified in the Test Administration Manual. •Use of this accommodation requires individual or small group setting. Breaks taken by the student during the testing period must be closely supervised.

48

Multiple Testing Sessions(within school day)

As an Allowable Accommodation, “Multiple Testing Sessions” does not apply to an entire general education classroom, but may be appropriate for a few students within that class. Prior arrangements must be made with the Principal.

49

Flexible Scheduling•Extended breaks between subtests may be given to the student. •Achievement subtests may be given at a different time of day than the recommended assessment schedule for individual students who may perform better (e.g., medication schedule, behavioral issues) during a specific period of the day. •The content test must be completed within the school day.

50

Flexible Scheduling•As an Allowable Accommodation, Flexible Scheduling does not apply to an entire general education classroom, but may be appropriate for a few students within that class. Prior arrangements must be made with the Principal. All testing must be completed within the system’s testing window.

51

Scribe/Recording Answers•Students who cannot mark their own answer documents may use an impartial Scribe.• A Scribe may be used to record responses or to transcribe the student’s answers from a modified answer document or test booklet. •Students who cannot utilize the answer document may record directly in the test booklet or on a separate piece of paper.

52

Scribe/Recording Answers•This accommodation may require special return packing procedures. Please contact your System Testing Coordinator for packing instructions. •This accommodation is considered a Special Accommodation for the Writing Assessment, and students must meet the required conditions for Special Accommodation J prior to its use.

53

Scribe/Recording Answers•When there is a short-term situation (e.g., broken dominant arm) where a student without an IEP or 504 Service Plan will require the use of a Scribe for the Writing Assessment, directions for IEP or 504 Plan documenting consistent use inclassroom instruction and testing must be applied. •In this case, the System Testing Coordinator should submit a Unique Adaptive Accommodations Request Form for review and approval.

54

Student Answers in Test Booklet•Not Allowed

55

Marking in Test Booklet•Allowable: This includes highlighting or underlining words or phrases. •Careful attention must be given to ensure that students record all responses on their answer documents.•The principal must ensure that all transparent overlays are erased after testing.

56

Student Reads Aloud to Self•The student may read aloud the test being administered to himself/herself if in an individual setting.

57

2008-2009 Special Accommodations are posted on the

TDOE Special Education website.

http://www.tennessee.gov/education/speced/seassessment.shtml#TCAP

58

• Have Not Significantly Changed

• Changes were made in the areas of:– Math Tables– Manipulatives– Marking in Test Booklet

59

Math TablesMath Tables

• Include: Multiplication, Addition, Subtraction, Division

• The tables listed above are the ONLY acceptable Math Tables

60

ManipulativesManipulatives

• Number Line is an acceptable manipulative.

• For more details, please refer to Instructions for TCAP Accommodations for Students with Disabilities.

61

Marking in the Test BookletMarking in the Test Booklet

• Now acceptable for the 3rd grade test book

• Acceptable for grades 3 - 12

• NOT acceptable for K-2

62

ScribeScribe

• Allowable Accommodation for Achievement, EOC, and MAAS

• Special Accommodation for Writing

63

Unique Adaptive RequestUnique Adaptive Request

• Must be sent in one month BEFORE the assessment is given.

• UAARF can be found:http://www.state.tn.us/education/speced/doc/930080809UAARF.pdf

64

Read AloudRead Aloud

• Same as previous years

• Special Accommodation

• IEP-all content areas

• 504-not Language Arts/Reading

65

CalculatorCalculator

• Allowable accommodation

• Exception - If your system does not allow, it becomes a Special Accommodation.

• Only bubble accommodation G if your system does not allow calculators.

66

Check Your Test Materials (If any materials are missing, notify your principal.PROVIDED FOR THE TEACHER: Teacher Directions test book(s) Group Information Sheet

PROVIDED FOR EACH STUDENT: Understanding the TCAP Achievement Test/Practice Test test book(s) answer sheet punch-out ruler (to be separated prior to testing)

67

Check Your Test Materials (If any materials are missing, notify your principal.

ADDITIONAL MATERIALS NEEDED FOR EACH STUDENT: No. 2 pencil with eraser extra eraser scratch paper for solving mathematics problems

OPTIONAL: four-function calculators (not provided with test materials)

68

Plan Your Testing Schedule Review the test and test directions in advance. Plan test administration for students requiring accommodations. Contact your principal if any student requires an accommodation such as a scribe due to a recent injury. Allow sufficient time to fill in the student accountability demographic information. For students marking their answers on separate answer sheets, the student accountability demographic information, including the student’s name, should be filled in on the answer sheet.

69

Plan Your Testing ScheduleAllow sufficient time to complete a content area test in a single testing session.Scheduled breaks are indicated in the specific directions for each content area. Be sensitive to students’ fatigue level and attention span and be prepared to alter your schedule as necessary. Allow time for make-up sessions for students who miss a testing session.)

70

Review your plans with proctors prior to testing.Proctors can help you:arrange the testing roomfill in student accountability demographic information on all test books or answer sheets separate punch-out rulers distribute test materials make sure students are working in the correct place and are marking only one answer for each test question prevent talking or sharing of answers collect materials at the end of the testing session

71

Plan for the distribution and collection of materials.Plan seating arrangements. Allow enough space between studentsto prevent sharing of answers.Conceal all instructional or reference materials in the test setting that are related to the content area being assessed, such as maps, posters,student samples, bulletin board items, etc.Eliminate distractions such as bells or telephones.Do not cover door windows

72

Use a Do Not Disturb sign on the door of the testing room. On the board, indicate starting and stopping times for each test session. Plan a quiet activity for students who finish testing early. Plan for accommodations to be provided as specified for individual students. Avoid calling attention to students who require accommodations. Plan testing so that students using accommodations do not distract other students or affect administration procedures.

73

Help students approach the testing in a relaxed, positive way. Explain that the purpose of taking an achievement test is to find out which skills have been learned and which skills need further development. Point out that some test questions may be more difficult than others and that some material may be new to students; students are not expected to know all the answers.

74

Reassure students that they will be given ample time to do their best. Emphasize that the test requires no special

preparation.

75

To ensure that test results are valid, reliable, and equitable, standardized tests are to be administered using standard testing procedures. These procedures indicate the exact directions, time limits, and scoring criteria to be used with the test. It is very important that these standard testing procedures be followed, and that any deviations from standard testing conditions be documented so that scores may be interpreted appropriately.

ASSESSMENT ACCOMMODATIONSWhen students have documented education plans indicating that they may participate in educational tests only under nonstandard conditions (e.g., extra testing time), appropriate accommodations should be made.

76

COACHINGBe sure students understand the directions and how to mark answers. Assist them with test-taking mechanics, but be careful not to inadvertently give hints or clues that indicate an answer or help eliminate answer choices.

77

GUESSINGEncourage students to attempt all questions. Tell them to read each question carefully and make their best attempt at answering. Be careful not to imply that they should guess randomly.

78

INVALIDATION OF TESTSStudents must mark only one response for a question and erase completely any response they do not want. Students who mark randomly will be processed normally. Do not fill out a Report of Irregularity for random marking situations. Special circumstances, interruptions, or distractions that affect individual or group performance can invalidate test results. Complete a Report of Irregularity form for students who experience sudden illness or become unduly disturbed by the testing situation. If you are not certain about how to treat a particular situation, consult your principal.

79

Administer the Understanding the TCAP Achievement Test/Practice Test.

Give the test a day or two in advance of the actual testing. It will take about 20 minutes to complete.

If additional practice seems necessary, repeat the Practice Test.

80

November/December 2008 • TDOE will upload student data to PEMSolutions

(pre-id)Last name, First name, MIStudent ID number (State EIS ID) begin with zeros to complete the field

BirthdateGenderEthnicityCode A/BGrade

0 0 0

81

Make SURE students write their test version test version on the

answer document!

83

Be sure to review the test directions in advance. (http://www.state.tn.us/education/assessment/doc/3_teacher_inst-R.pdf)

These elements are used

throughout the specific directions.

84

Before administering each content area, take a moment to have your students look through the test. Point out the various locations of the STOP signs within the test. Tell the students that when ever they see one of these STOP signs, they should stop and wait quietly until they are toldwhat to do next.Be very careful to check that students do not skip or overlook any of the test questions. Remind students to look for and answer every question on each page. Tell students that each content area test is identified by name at the bottom of each page.Remind students that they must mark answers ONLY in the spaces provided on the answer sheet. Stray pencil marks could be processed as incorrect answers.

85

The Teacher Directions Manual provides space to record time.

Follow content area test administration directions in the Teacher Manual.

86

After your testing is complete, check students’ test books and answer sheets to ensure that:

A) all punch-out rulers, markers, and scratch paper are removed.Punch-out rulers and markers should not be returned with thetesting materials.B) all student accountability demographic information is completeand correct. The BIRTH DATE section must be fi lled in properly.This information is used to verify student identity when otherinfor mation is insuffi cient.C) all applicable special codes fi elds are fi lled in according toinstructions from your Testing Coordinator.D) all circles that students in tend ed to mark are fi lled in completely.E) all stray pencil marks are erased.F) all erasures are complete.

87

Assemble and return all test materials to the Building Testing Coordinator, separated according to school procedures.A) scratch paper, signed by studentsB) list of absenteesC) completed GIS, per school instructionsD) used answer sheets stacked with demographic grids face up and cut corners aligned at upper right sideE) modified format tests and transcribed answer documentsF) completed Report of Irregularity, Breach of Testing Security forms,and Medical Exemption Request, as neededG) paper-banded Inactive Test Material (ITM) form and relatedmaterials

88

H) other used and unused test materials(1) used test books(2) unused answer sheets and test books

I) ancillary materials(1) Test Administration Manual(2) Teacher Directions(3) blank and inaccurately completed State assessment forms

J) materials with manufacturing defects (notify the Building TestingCoordinator)

NOTE: CHECK TO BE SURE THAT PUNCH-OUT RULERS ANDMARKERS HAVE BEEN REMOVED FROM ALL TESTING MATERIALS. DO NOT RETURN THE RULERS TO THE TENNESSEE TEST DISTRIBUTION CENTER.