state assessment quality control oklahoma maridyth mcbee, ph.d. assistant superintendent for...
TRANSCRIPT
State Assessment Quality Control Oklahoma
Maridyth McBee, Ph.D.Assistant Superintendent for Accountability and Assessment
Oklahoma State Department of Education
Three Types of Assessments
Assessments for Grades 3-8
Grade/Subject Math Reading Science Geography
Social Studies/U.S
. History Writing
Grade 3
Grade 4
Grade 5
Grade 6
Grade 7
Grade 8
Federal and State mandated tests: results used in accountability calculations
State mandated tests
General Assessments for End-of-Instruction
Algebra I
English II
Biology I
U.S.
History
Algebra
II
Geometr
y
English III
4Federal and State mandated tests:
State mandated tests
Quality Assurance Component1
Why External Verification?•Ensuring testing vendor meets contractual expectations•Preventing score reporting and appeals issues•Improving state testing services and future testing contracts
Quality Assurance Component1
• Plan to contract with third party vendor– Verification of equating procedures– Replication of scoring and reporting
• Key issue: ensuring quality and producing score reports rapidly
Quality Assurance Component1• Assessment vendor conducts psychometric analysis, scoring and
reporting• Third party vendor replicates and reports findings to state and
Quality Assurance Component2
• Assessment and Accountability Office works closely with Third Party Data Office and districts to facilitate accurate data in state system
• Use state data for test enrollment• Use state data for demographic and disaggregation• Add data such as teacher of record to allow for use with teacher evaluation
Quality Assurance Component3
• Hold regional face-to-face and web-based training for district test coordinators
• Plan to conduct more web-based training and require participants to pass test of procedural content.
• Daily phone support
Quality Assurance Component4
• Security audits– Desk monitoring– On-site monitoring
• Erasure analysis• Plans for online response change analysis
Quality Assurance Component4
• Follow up to allegations of cheating or misconduct.• Plans to classify allegations with suggested options
for remedy– Job loss– Reassign away from testing– Reprimand– Further training
Critical Issues
• Transparency and Confidence in Results• Fiscal Parameters• High Expectations for Vendors• Partnership with Districts
Further Information
Contact the Office of Assessment and Accountabilityhttp://ok.gov/sde/accountability-assessments