office of inspector general (oig) 2015 florida annual assessment and fsaa meeting
TRANSCRIPT
Office of Inspector General (OIG)
2015 Florida Annual Assessment and FSAA Meeting
OIG Responsibilities
Section (s.) 20.055, Florida Statutes (F. S.), establishes the Office of Inspector General (OIG) within each state agency to provide a central point for coordination of, and responsibility for, activities that promote accountability, integrity, and efficiency in government. Additionally, in accordance with s. 1001.20, F. S., the OIG will conduct or coordinate investigations into substantiated allegations that a district school board or college board of trustees is unwilling or unable to address relating to waste, fraud, or financial mismanagement, as determined by the Commissioner of Education.
Mission Statement
The mission of the Office of Inspector General (OIG) is to assist the Commissioner of Education in achieving the department’s mission of increasing student proficiency and maintaining an accountability system that measures student progress. The OIG accomplishes this by providing independent audits and reviews of programs and activities, conducting investigations of alleged violations, and offering consulting services to assist management in their efforts to maximize effectiveness and efficiency.
OIG Caveon Data Forensics Investigations
The Division of Assessment, Research, and Measurement (ARM) and Caveon Data Forensics identifies schools with extreme levels of similar answer patterns and erasures; because of the severity of these anomalies, ARM refers these schools to the OIG for investigation.
Background
• Since the implementation of Caveon Data Forensics in Spring 2011, the OIG has facilitated investigations of 92 schools.
• On average, 23 schools are referred to the OIG each year, with the majority of schools flagged in the Spring assessment.
• The OIG has investigated schools from the smallest district to the largest district in the state.
• Schools have been flagged in 24 of the 67 county school districts, prompting further investigation.
My school is flagged, what happens next?
• The OIG notifies superintendents of the schools that were identified for investigation.
• Each school is assigned an “I” (incomplete) for its accountability outcomes (school grade).
• The department requires each district to conduct an internal investigation of all flagged schools within their respective district regarding the high incidence of similarities or erasures.
Focus of District Investigation
• Let data drive investigation.– Focus on student similarity and erasure indices.• Interview students with the highest indices.
– Identify the test groups (classrooms) where the students with high indices are concentrated.• Interview staff who proctored/monitored those rooms.
– Identify all personnel that physically handled the materials.• Interview test administrators and coordinators.
Student Interviews
• Interview students with high indices– Students with high indices contributed to the school being flagged, so they should be a
focus of the investigation.– Interview students in close proximity to those with high indices (did they see anything
suspicious).
• OIG requires districts to interview 10 percent of the flagged students, or a minimum of 10 students, whichever is greater. – For example, 7th grade reading was flagged with 150 students tested, 15 or more students
must be interviewed.– Another example, 4th grade mathematics was flagged with 40 students tested, 10 or more
students must be interviewed.
Interview questions can be provided by the OIG. Parent letters can be provided by the OIG.
Convey to students that they are not the subject of the investigation and are not suspected of any wrongdoing
Staff Interviews
• Interview staff who proctored/monitored rooms with a large concentration of students with high indices.– Ask staff if they noticed anything suspicious from students,
especially those with high indices or other staff in the room.
• Interview test administrators and test coordinators.– Confirm the whereabouts of test materials before, during and
after the assessment in question.– Identify any violations of the Test Security Statute, s. 1008.24, F.S.
Interview questions can be provided by the OIG.
Do’s
• Follow investigation guide.• Provide ALL documentation
listed in investigation guide. • Interview required number
of students. • Contact OIG with any
questions or concerns.• Submit final report within
allotted timeframe.
Don’ts
• Leave any documentation out of the final report.
• Interview less than the required number of students.
• Copy and paste final reports from other school investigations. Treat every school as its own investigation.
Submitting Findings to OIG
What's Next?
When final reports are submitted, the OIG focus is on documentation, findings and conclusions:• Was sufficient documentation provided by the district to
support releasing the school grade or dismissing the allegation?
• Was sufficient documentation provided by the district to support opening a case and continuing the investigation?
• Did the final report reveal any violations of Florida Statutes 1001.20 or 1008.24?
The OIG reviews final reports on a first come, first served basis.
OIG decisions
The majority of school grades are released and allegations dismissed because• Complete and sufficient documentation was provided.
– Followed investigation guide• No violations of Florida Statutes 1001.20 or 1008.24 were identified.
The majority of school grades are held and cases are opened because• Incomplete or insufficient documentation
– Not following the investigation guide– Copy and pasting reports
• Violation of Florida Statutes 1001.20 or 1008.24
The Inspector General will notify the superintendent of his decision to recommend the school’s grade be released or that the investigation will continue.
Concluding a case
Based on evidence and testimony obtained throughout the process, the OIG develops its findings, conclusions and recommendations.
In accordance with s. 20.055(6) (e), F. S., the subjects are notified by mail of the investigative findings and are provided with an opportunity to submit a written response to these findings.
QUESTIONS, CONCERNS or COMMENTS?
Florida Department of EducationOffice of Inspector General
325 West Gaines Street, Suite 1201Tallahassee, Florida 32399-0400
Phone: 850-245-0403
Fax: 850-245-9419Email
http://www.fldoe.org/ig