1 test security and integrity of the testing program mark billingsley tsnap vice-president austin...
TRANSCRIPT
1
Test Security and Integrity of the Testing Program
Mark BillingsleyTSNAP Vice-President
Austin ISD
2
Why test security?ValidityReliability
3
Security Requirements in Response to Office of
Inspector General Report
Records retention – minimum of 5 yearsSeating charts – locally maintainedHonor Statement – 9 - ExitTEA on-site monitors
14-point Security Plan
4
5
Test Security In Detail Seating charts required by TEA – locally
maintained Reporting local investigatory and disciplinary
actions – (see AISD forms) Document retention – minimum of 5 years On-site monitoring
6
Test Security Student Seating Charts
Used to link test administrator to student and student to student
Should include in and out times for test administrator(s)
Must reflect movement of students
To be turned in at check-in (AISD)
Must use district form provided (AISD)
7
Test SecurityBefore test administration Emphasize importance of training Train as many staff as possible Principals are required to attend the campus training (AISD) Distribute test administrator manuals BEFORE training Follow procedures for oaths Account for all test materials Ensure proper storage of materials When applicable, set aside Form #1 booklets for oral administration and dyslexia
bundling Verify demographic information Verify testing requirements for special education students, given changes to
assessments this year Be available for questions
8
Test Security
During test administration Ensure each student receives the correct assessment and
testing materials Practice good inventory control at all levels Emphasize and verify active monitoring Ensure all testing personnel understand that they may NOT:
provide assistance view the tests without authorization discuss confidential student information check for strategies
9
Test Security
After test administration No unauthorized viewing or scoring student
responses No discussion of confidential student information No erasing stray marks or darkening response ovals Account for all test materials
10
Test SecurityPitfalls to Avoid
Assigning untrained staff to administer and/or monitor tests Failing to inventory test materials Having insufficient test booklets and/or test administrator manuals Not accounting for all test booklets and answer documents each day Assigning a student the incorrect assessment Failure to give appropriate accommodation(s) Improper (or nonexistent) monitoring Failure to remind students to record their responses and/or failure to
verify that students have bubbled their answers Leaving secure materials unattended
11
Test Security Testing Irregularities
Violations Resulting in a Referral Viewing a test before, during, or after an assessment Hand-scoring student tests Discussing secure test content or student responses Copying secure materials Any Action that Directly or Indirectly Assists Students with Responses
Clarifying or translating writing prompt or test items Gesturing, pointing, or demonstrating correct responses Changing student responses Providing answers to test questions
REMINDER: However well intentioned, these actions are never allowable orappropriate. Also, these incidents must be reported to TEA immediately.
12
Test Security Reminder Monitoring
Before a student leaves the room, the test administrator must inspect the completed answer document to be sure that the student has bubbled in answers as instructed
If the student has not done so, the test administrator must instruct the student to bubble in the answers
Test administrators should look to verify that answers are marked; they cannot look or comment on individual answers
Concerning grade 3, test administrators may quickly look through the scorable test booklets after the students are finished to ensure that all items have been answered, but they may not look at answers to individual items
13
Oath Procedures
The process for initialing and signing oaths in 2007-08 was a two-part process:
1. Initialing and signing after training and before handling secure materials
2. Signing after completion of each test administration for test administrators and at the end of the testing year for campus coordinators and principals
TAKS Campus Coordinator will submit signed oaths at the conclusion of training and will sign them again at the end of the testing season. (AISD)Oath process subject will be revised in 2008-09.
14
Common Testing Irregularities
Individualized Education Program (IEP) Errors
Accommodation errorsWrong assessment
15
Common Testing Irregularities
Procedural/Monitoring Errors
Improper distribution & handling of test materialsUse of untrained test administrators or monitorsImproper/incomplete transcribingUse of cell phones during testing
16
Common Testing Irregularities
Administering test on wrong dayAdministering assessments outside testing window
REMINDER: If caught in time and reported to TEA, these can generally be easily fixed.
Calendar Errors
17
Common Testing Irregularities
Misplaced or lost answer documentsMisplaced or lost test bookletsLate return of secure materials
REMINDER: Additional information about return of secure materials can be found in the Secure Materials Supplement.
Missing/Late Return of Secure Materials
18
Common Testing Irregularities
Failure to administer test orally to eligible studentsAdministering test orally to ineligible studentsForm 1 not usedWorking/scoring/discussing test items
NOTE: Be sure to refer to the Accommodations Manual for details.
Oral Administration Errors
19
Viewing a test before, during, or after an assessment
Hand scoring student tests
Discussing secure test content or student responses
Copying secure materials
REMINDER: These incidents must be reported to TEA immediately.
Potential Referral to Educator Certification
and Standards
20
Reporting Irregularities
1. Don’t panic2. Gather complete information3. DON’T ASSUME - contact TEA if you have any
questions about how to handle the problem4. Report the incident if an irregularity occurred
Gather all facts Collect documentation Submit documentation
21
Reporting IrregularitiesNotify the Security Task Force immediately if you become aware of one of the following types of irregularities:
Teacher/test administrator intervention or assistance
Unauthorized viewing, scoring, discussing, or duplication of secure material
22
Reporting IrregularitiesCollecting Documentation
All irregularities require the following documentation to be submitted:
Incident report (preferably via the Online Incident Reporting Process)Statement(s) from individuals involved
NOTE: Do not use the Student Assessment Incident Report Form to submit statements from individuals involved.
23
Reporting Irregularities
Submission of InformationIncident reports may be submitted to TEA online using the following guidelines:1. Access the Online Incident Reporting Process
located on the TEA Student Assessment Division website at:
2. Review the procedures for reporting an irregularity online and then click the link entitled “Click here to submit an online incident report.”
http://www.tea.state.tx.us/student.assessment/admin/incidents/online/
24
Reporting IrregularitiesSubmission of Information (cont.)
3. Select your district and campus from the pull-down menus and complete the required information on the form.
4. Attach electronic supporting documentation and complete the submission process.NOTE: If you do not choose to use the online system’s attachment
feature, all supporting documentation must be submitted by fax to 512-463-9302, or by e-mail to [email protected] within 10 working days of the incident. Be sure to include the incident identification number provided upon completion of the online submission with each set of documentation.
25
Reporting Irregularities
Submission of InformationIf you encounter difficulties using the online submission process, you can download an electronic copy of the incident report form.1. Download the incident report form from:
2. Complete the form, save it, and e-mail it as an attachment to [email protected] . Electronic supporting documentation can be attached to the same e-mail as the incident report, or it can be faxed to 512-463-9302.
http://www.tea.state.tx.us/student.assessment/admin/incidents/Student_Assessment_Incident_Report_Form.doc
26
27
28