the caveon security screen designed specifically for school district assessment programs
TRANSCRIPT
![Page 1: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/1.jpg)
The Caveon Security Screen
designed specifically for
School District Assessment Programs
![Page 2: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/2.jpg)
Of 40,000 students recently surveyed
95% admitted to cheating in High School.
Did you know?
![Page 3: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/3.jpg)
Of 7,000 adults recently surveyed
51% believed it was necessary
to be dishonest to get ahead.
Did you know?
![Page 4: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/4.jpg)
As a leader for your district, how do you know your
student test data accurately reflects student proficiency?
![Page 5: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/5.jpg)
Are you being sufficiently proactive in protecting
your testing program against common threats?
• Test taker copying during a test administration
• Memorizing questions to share with others
• Unauthorized access to test materials
• Teachers and proctors assisting test takers
![Page 6: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/6.jpg)
Recent notorious cheating scandals in some
of our nations largest public school districts
continue to receive attention in the news . . .
![Page 7: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/7.jpg)
The Houston Independent School
District has uncovered evidence
that teachers at two elementary
schools helped students cheat on
state exams, and educators at
two other campuses offered questionable assistance.
Test booklets showed suspicious erasures changing
wrong responses to right.
The Houston Chronicle February 25, 2013
![Page 8: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/8.jpg)
USA Today found
irregularities in DC schools‘
test scores from an analysis
of results between 2008
and 2010. More than 100 schools had score sheets that
had an irregularly high number of erasures of wrong
answers to right ones. Two teachers have been forced out.
USA TODAY June 22, 2012
![Page 9: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/9.jpg)
At the Los Angeles Unified
School District six institutions
from Crescendo Charter
Schools faced closure after
the founder of Crescendo gave principals copies of state
standardized tests in advance and asked teachers to
prepare students with them.
Los Angeles Times September 5, 2011
![Page 10: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/10.jpg)
Investigators in Atlanta
have found the widest
ranging incident of test
tampering in U.S. history.
179 educators have been implicated and 41 have resigned or
retired for participating in dishonest test practices. The district
is now deciding how to handle the remaining 138 implicated
educators and is looking to remove them from the system.
TIMENewsFeedJuly 6, 2011
![Page 11: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/11.jpg)
Michigan Educator Survey
Detroit Free Press, July 26, 2011
29% felt pressure to cheat on a standardized test
34% felt pressure to change students’ scores for the better
21% knew educators that changed scores on students’ tests
8% admitted to changing students’ scores due to pressure
![Page 12: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/12.jpg)
August 25, 2011
Duncan: No link between cheating and NCLB
Places the blame on school leaders
Regardless of who the perpetrators are . . .
School District Administrators will feel the heat !
![Page 13: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/13.jpg)
School district leaders need to be proactive in
protecting the validity of the test scores within
their assessment programs.
![Page 14: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/14.jpg)
Offered by the recognized world leader in test security
services, the Caveon Security Screen is a data forensic
diagnostic screening service providing school districts
a cost effective means to monitor assessment programs
for indications of test irregularities.
The Caveon Security Screen
![Page 15: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/15.jpg)
Consultation
• Consultation with a Caveon Test Security Specialist
• Advice on Test Security planning and evaluation
• Interpretation of forensic data output reports
• Guidance on test irregularity follow-up
What the Caveon Security Screen Provides
• Similarity Index analyses
• Perfect Test and Identical Test Analyses
• School level data reported by grade and by subject
• Flagged student output with cluster details for pairs and groups
Data Forensics
![Page 16: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/16.jpg)
The diagnostics include custom data forensic analyses
of student test records along with data interpretation and
consultation with a Caveon Test Security Specialist.
The data forensic analyses provide a powerfully credible
statistic highlighting the likelihood of answer copying, test
coaching, proxy test taking or collusion.
The Caveon Security Screen Data Forensics
![Page 17: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/17.jpg)
How credible is a Flagged Similarity Index ?
• Chance of being hit by lightning = 1 in 1 Million
• Chance of winning the lottery = 1 in 10 Million
• Chance of DNA false-positive = 1 in 30 Million
• Chance of students flagged for
Similarity doing their own work = 1 in 1 Trillion
The Caveon Security Screen Data Forensics
![Page 18: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/18.jpg)
Sample Forensic Output Data Report
![Page 19: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/19.jpg)
• Test Site Observations
• Policies and Procedures Review
• Test Administrator and Proctor Interviews
• Web Patrol seeking stolen test questions
• Security Audit of full Examination Program
• Focused Investigations of Test Irregularities
• Gains or Losses Forensic Analyses
• Erasures Forensic Analyses
Additional Diagnostic Services Available
![Page 20: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/20.jpg)
Build on Caveon’s test security experience and expertise
to protect and strengthen your assessment program.
Be proactive in protecting the integrity of your assessment
data and the reputation of your school district.
Contact a Caveon Test Security Specialist to learn
more about how the Caveon Security Screen can
be customized to meet your needs.
![Page 21: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/21.jpg)
Consultation
• Consultation with a Caveon Test Security Specialist
• Advice on Test Security planning and evaluation
• Interpretation of forensic data output reports
• Guidance on test irregularity follow-up
The Caveon Security Screen
• Similarity Index analyses
• Perfect Test and Identical Test Analyses
• School level data reported by grade and by subject
• Flagged student output with cluster details for pairs and groups
Data Forensics
![Page 22: The Caveon Security Screen designed specifically for School District Assessment Programs](https://reader038.vdocument.in/reader038/viewer/2022103122/56649c8e5503460f94947824/html5/thumbnails/22.jpg)
Michael W. Stetter, D.Ed.
Test Security Specialist
Caveon Consulting
(302) 415-0375