best assessment practices. a genda introductions & history jon s. twing, ph.d., pearson where do...
TRANSCRIPT
BestBestAssessmentAssessment
Practices Practices
AGENDAAGENDA
Introductions & HistoryJon S. Twing, Ph.D., Pearson
Where Do We Go From Here?Lisa Ehrlich, Ph.D., Measured Progress
How To Use the Best PracticesJoe Willhoft, Ph.D., Washington DOE
Wes Bruce, Indiana DOE
Distinguished Commentary and VisionGene Wilhoit, Executive Director, Council of Chief
State School Officers (CCSSO)
2
Introductions & HistoryIntroductions & History
Jon S. Twing, Ph.D., Pearson
Long Duration-Collaborative Effort- 2007-2010- ATP, CCSSO- A lot of hard work by a lot of people
Purpose was to define and describe best practices in operational fulfillment of large-scale, high-stakes assessment- Voluntary, inclusive and non-proprietary- Tells us what to do, not how to do it- Applicable to other venues like Common Core
Process involved internal and external review, professional editing and publishing
HISTORYHISTORY 4
FORESHADOWS OF THE FORESHADOWS OF THE FUTUREFUTURE
Many requests made for the Best Practices document have already been made:
- US Inspector General
- GAO
- States for inclusion in RFP’s
- Service Providers for inclusion in Proposals
- For use as Training Materials
The need seems present and time will tell if the publication is a success
5
Where Do We Go From Where Do We Go From Here?Here?
Lisa Ehrlich, Ph.D., Measured Progress
WHERE DO WE GO FROM WHERE DO WE GO FROM HERE?HERE?
Use of Best Practices document by service providers
How do I get a copy?
Version II – yikes!
7
SERVICE PROVIDER USESERVICE PROVIDER USE
Guideline for statewide assessment programs
RFP requirement for contract work
Baseline for operational program standardsUsed to improve or refine existing procedures
or processes
Gap analysis to identify area(s) needing
attention
Training document for new employees
8
HOW DO I GET A COPY?HOW DO I GET A COPY?
To be notified when the document is on Amazon, please send an email to: [email protected]
Complementary copies for States and ATP publishers/vendors
Posted for sale on central site linked to CCSSO and ATP sites
Comprehensive Best Practices communication plan with AAP Test Committee developed
A webinar will be held on July 28th to introduce the document, for more information please send an email to: [email protected]
9
VERSION II OF BEST VERSION II OF BEST PRACTICESPRACTICES
Convene new working group in 2011 to begin work on Version II document.
- On line assessment expanded
- Accommodations
- Race to the Top program requirements
Want to participate? Please contact Bob Olsen ([email protected]) or Alan Thiemann ([email protected]).
10
How To Use the Best How To Use the Best PracticesPractices
Joe Willhoft, Ph.D., Washington DOE
CHANGES IN OUR WORKCHANGES IN OUR WORK
Race to the Top
- Consortia & Common Core Standards and Assessment
◦Integrated Comprehensive Assessment System
◦Developed Over Next four Years
◦Includes Summative and Formative Components
◦Includes Common Achievement Standards, Item Bank, and Reporting System
◦Computer Adaptive
12
CHANGES IN OUR WORK CHANGES IN OUR WORK (CONT’D)(CONT’D)
-Timeline
◦Proposals Due to U.S Department of Education (USED) June 23
◦USED Decision to states by end of September
◦Work Beginning October 2010
◦Assessments in place 2014-2015
13
CHANGES IN OUR WORK CHANGES IN OUR WORK (CONT’D)(CONT’D)
-Teacher Involvement Like Never Before
◦Need to Understand the Basic Process and Collaborate on the Plan
-Consortia and State Policy must follow Best Practices
◦More than ever we require common language for states, districts, teachers, and vendors
14
USING BEST PRACTICE HERE AND USING BEST PRACTICE HERE AND NOWNOW
-Near-term work for states and vendors◦Next 3-4 Years for Ongoing Activities
-Need for continuation of best practices◦New Contracts and Amendments
◦New Staff and Training
◦Online Testing
15
How To Use the Best How To Use the Best PracticesPractices
Wes Bruce, Indiana DOE
WHY STATES NEED BEST WHY STATES NEED BEST PRACTICESPRACTICES
States have much to lose when operational breakdowns occur-Direct impact on students and families- Loss of credibility for the assessment- Impact on Federal & State Accountability Systems-Provides a reason for “change”-Policy implications- Legislative/budget implications
17
WHY STATES NEED BEST WHY STATES NEED BEST PRACTICESPRACTICES (CONT’D)(CONT’D)
Capacity of SEA staffing- Turnover at SEAs- Capacity building and training
Removes some of client/service provider tensions
- Cooperation critical to success – provides common goal
- “Partnership” model can be more flexible than a strict procurement model
Helps provide metrics, success indicators and early warning mechanisms in a systemic fashion
- Helps planning and avoids reacting on short notice to unexpected events
18
HOW WILL STATES USE THE HOW WILL STATES USE THE “BEST PRACTICES”?“BEST PRACTICES”?
Professional Development
Procurement
Policy Guidance/Defense
19
PROFESSIONAL DEVELOPMENTPROFESSIONAL DEVELOPMENT
New State Assessment Director-Has an “Owner’s Manual”
New Assessment Staff Member- Specific chapters based on responsibility
Working committees
- A resource to help understand complexities and demands of large scale
20
PROCUREMENTPROCUREMENT
Inclusion in RFP
- Specific portions
- By reference
Use as a tool for proposal evaluation
- Ability to demonstrate adherence to these standards
Contract
- Establishing common expectations for quality and deliverables
21
POLICY GUIDANCE/DEFENSEPOLICY GUIDANCE/DEFENSE
Reference for policy makers, legislators and staff on the how and why of assessment practice
Use when testifying to committees
State Policy Makers
- A reference to demonstrate our estimates of time needed for quality are supported by the industry
- A demonstration of where costs come from in the assessment program
22
Distinguished Distinguished Commentary and VisionCommentary and Vision
Gene Wilhoit, Executive Director, Council of Chief State School Officers (CCSSO)