barbara sims dean fixsen karen blase caryn ward national sisep center national implementation...
TRANSCRIPT
Barbara SimsDean FixsenKaren BlaseCaryn Ward
National SISEP CenterNational Implementation Research Network
FPG Child Development CenterUniversity of North Carolina at Chapel Hill
Lake Geneva WI
October 2014
Building Implementation Capacity Innovation and
Implementation Conference II
EBPs
Students cannot benefit from interventions they do not receive.
WHY: Educationally
Significant Outcomes
WHAT: Effective &
Usable Practices and
Programs
WHO & HOW:Effective
Implementation Methods
WHERE:Enabling Contexts
Formula for Success
WHYEducationally
Significant Outcomes
WHATEffective
Innovations
WHEREEnabling Contexts
Formula for Success
Students cannot benefit from
instruction they do not
experience
Active Implementation Frameworks
WHO
Teams
WHEN
Stages
HOW
Drivers
HOW
Cycles
WHAT
UsableInterventions
WHY: Educationally
Significant Outcomes
WHAT: Effective &
Usable Practices and
Programs
WHO & HOW:Effective
Implementation Methods
WHERE:Enabling Contexts
Formula for Success
USABLE INTERVENTIONS
An intervention needs to be teachable, learnable, doable, and be readily assessed in practice.
UsableInterventions
Usable Interventions
Operational Definitions
ClearDescription
FidelityAssessment
EssentialFunctions
Implications for Sustainability and Scalability
We tend to over-estimate how well defined “it” is We find out when we start to Install
“it”
Help Schools and Districts choose wisely based on: Needs of students Best evidence Fit and Resources Required Readiness and resources for
replication
Usable Interventions
Implications for Sustainability and Scalability
Help Schools and Districts “operationalize” the WHAT Practice Profiles
Help Schools and Districts “make space” for the new work Supportive policies and practices
Usable Interventions
Usable InterventionsTools You Can UseHexagon Tool Practice Profiles
UsableInterventions
Try It Now! Usable Interventions
Select 3-5 Indicators
Consider the following factors:What will it look like if this indicator is being implemented with fidelity?What is an acceptable variation of this in early stages of implementation?Identify any red flags that indicate unacceptable variations
SupportingNew Ways of Work
WHY: Educationally
Significant Outcomes
WHAT: Effective &
Usable Practices and
Programs
WHO & HOW:Effective
Implementation Methods
WHERE:Enabling Contexts
Formula for Success
IMPLEMENTATION TEAMS
Organized, expert assistance to develop and sustain an accountable and effective structure
Implementation TeamNo Implementation Team
80%3 Years
14%17
Years
To “Making it Happen”From “Letting it Happen”
Sources: Fixsen, Blase, Timbers, & Wolf, 2001Balas & Boren, 2000 Green & Seifert, 2005Saldana & Chamberlain, 2012
Improvement inIntervention Outcomes
Implications for Sustainability and Scalability
Teaming Structure Accountable Implementation Science informed Lasting – Key to Sustainability Linked – Key to Scalability
Why Individual champions come and go Structures host functions Intentional use of data,
improvement cycles
Implementation Teams
WHY: Socially
Significant Outcomes
WHAT: Effective &
Usable Practices and
Programs
WHO & HOW:Effective
Implementation Methods
WHERE:Enabling Contexts
Formula for Success
IMPLEMENTATION STAGES
Purposeful matching of critical implementation activities to the stage of the process
Implementation Stages
Exploration Installation Initial Implementation
FullImplementation
2-4 Years
• Assess needs• Examine
intervention components
• Consider Implementation Drivers
• Assess Fit• Build
sustainability
• Acquire Resources
• Prepare Organization
• Prepare Implementation Drivers
• Prepare Staff• Build
sustainability
• AdjustImplementation Drivers
• Manage Change• Deploy Data
Systems• Initiate
Improvement Cycles
• Build sustainability
• Monitor & Manage Implementation Drivers
• Achieve Fidelity & Outcome Benchmarks
• Further Improve Fidelity & Outcomes
• Sustainability
Implementation StagesTools You Can UseDistrict Initiative Inventory Stages of Implementation AnalysisImplementation Action Plan
District Initiative Inventory
The HexagonAn EBP Exploration Tool
NEED
FIT
RESOURCES
EVIDENCE
CAPACITY
READINESS
Fit with current Initiatives• School, district , state priorities• Organizational structures
Community values
Need in school, district, state• Academic & socially significant Issues• Parent & community perceptions of need• Data indicating need
Resources and supports for:• Curricula & Classroom• Technology supports (IT dept.)• Staffing• Training• Data Systems• Coaching & Supervision• Administration & system
Evidence• Outcomes – Is it worth it?• Fidelity data• Cost – effectiveness data• Number of studies• Population similarities• Diverse cultural groups• Efficacy or Effectiveness
Capacity to Implement• Staff meet minimum qualifications• Able to sustain Imp Drivers
• Financially • Structurally
• Buy-in process operationalized• Practitioners • Families
Readiness for Replication• Qualified purveyor• Expert or TA available• Mature sites to observe• Several replications• How well is it operationalized?• Are Imp Drivers operationalized?
The “Hexagon” can be used as a planning tool to evaluate evidence-based programs and practices during the Exploration Stage of Implementation.
Download available at:www.scalingup.org/tools-and-resources
EBP:
5 Point Rating Scale:High = 5; Medium = 3; Low = 1.Midpoints can be used and scored as a 2 or 4.
High Med Low
Need
Fit
Resource Availability
Evidence
Readiness for Replication
Capacity to Implement
Total Score
© 2009 Karen Blase, Laurel Kiser, & Melissa Van Dyke Adapted from work by Laurel J. Kiser, Michelle Zabel, Albert A. Zachik, and Joan Smith at the University of Maryland
Try It Now! Implementation Stages
Early Implementers: use the Hexagon Tool to assess potential program under consideration
Ongoing Implementation: Use the Stages of Implementation Analysis tool to identify gaps and next steps in your implementation
SupportingNew Ways of Work
IMPROVEMENT CYCLES
Changing on purpose to support the new way of work
Rapid Cycle Problem Solving
Improvement Cycles
Plan
DoStudy
Act
Usability TestingImprovement Cycles
Plan
DoStudy
Act Plan
DoStudy
Act Plan
DoStudy
Act
Implementation Team
DistrictManagement
Team
TeachersInnovations
Students
Su
stai
nab
ilit
y
Pra
ctic
e In
form
s P
olic
yP
olic
y E
na
ble
s
Pra
ctice
Practice-Policy Communication Cycle
IMPLEMENTATION DRIVERS
Common features of successful supports to help make full and effective use of a wide
variety of innovations
Fidelity Assessment
Coaching
Training
Technical
Systems Intervention
Facilitative Administration
Decision Support Data System
Com
pete
ncy
Driv
ers
Com
pete
ncy
Driv
ers
Organization D
rivers
Organization D
rivers
Implementation Drivers
© Fixsen & Blase, 2008Leadership
Selection
Adaptive
Competency Drivers
Develop, improve and sustain competent
and confident use of the innovation through
Careful selection of new and lead staff
Design and employ effective training
plans
Design and support coaching system
Routine use of fidelity assessment to
inform the process
Implementation Drivers
Com
pete
ncy
Driv
ers
WHY: Educationally
Significant Outcomes
WHAT: Effective &
Usable Practices and
Programs
WHO & HOW:Effective
Implementation Methods
WHERE:Enabling Contexts
Formula for Success
Organization Drivers
Change Organizations and Systems
Create and sustain hospitable organizational and system environments for effective services
Develop functional data systems that can be used to inform decision-making
Implementation Drivers
Organization D
rivers
Decision Support Data SystemsPurposes Monitor and improve student outcomes through
data-based decisions
Provide information to assess effectiveness of intervention and prevention practices
Analyze the relationship of fidelity to outcomes
Guide further program development Detect discrete issues as well as systemic issues
Engage in continuous quality improvement Of the Intervention and the Drivers
Celebrate success
Be accountable to parents, Board of Education taxpayers, and other funders
Implementation Drivers
Organization D
rivers
Facilitative AdministrationPurposes
Driving change within your direct sphere of influence
Creates an internally hospitable environment for the new way of work – at the level of the “agency” (e.g. school, District)
Facilitates the installation, implementation, and improvement of the Drivers for each innovation
Looks for ways to make the direct work of practitioners (e.g. teachers, school staff) and administrators more effective and less “burdensome”!!
Implementation Drivers
Organization D
rivers
Facilitative Administration Strategies
Schedule changes
Policy revision
Practice revision
Communication protocols
Change responsibilities
Revise priorities
Implementation Drivers
Organization D
rivers
Systems InterventionPurposes Driving change outside your direct sphere of
influence
Identify and “lift up” systemic barriers and facilitators to the next level to improve support for the new way of work
Create an externally “hospitable” environment for the new way of work
Embed facilitators and strengths
Contribute to cumulative learning in multi-site projects
Implementation Drivers
Organization D
rivers
Systems InterventionStrategies Communication protocols
Stakeholder groups
Community involvement
Public communication
Implementation Drivers
Organization D
rivers
Performance Assessment(Fidelity)
Coaching
Training
Technical
Systems Intervention
Facilitative Administration
Decision Support Data System
Com
pete
ncy
Driv
ers
Com
pete
ncy
Driv
ers
Organization D
rivers
Organization D
rivers
Facilitative Administration
Enabling Context
© Fixsen & Blase, 2008Leadership
Selection
Adaptive
Integrated & Compensatory
Implementation DriversTools You Can UseStrategic Analysis of Drivers Drivers Action PlanImplementation Drivers: Implementation Drivers:
Team Review & Planning Best Practices
Implementation Drivers: Team Review & Planning
Create a hospitable system with linked communication and problem-solving protocols to support the effective WHAT
Ensure that practice informs policy, and policy enables better practice
Operationalize success
Prevent the institutionalization of errors
Enabling Context Implications for Sustainability and Scalability
Try It Now! Implementation Drivers
Competency Drivers Consider how the district is
attending to these indicators Consider how your vendors attend
to these indicators
Organization Drivers Identify strategies you will use to
support building staff in implementation of your program
SupportingNew Ways of Work
WHY: Educationally
Significant Outcomes
WHAT: Effective &
Usable Practices and
Programs
WHO & HOW:Effective
Implementation Methods
WHERE:Enabling Contexts
Formula for Success
Get Connected!
www.scalingup.org
SISEP @SISEPcenter
For more on Implementation Sciencehttp://nirn.fpg.unc.edu
www.implementationconference.org
©Copyright Dean Fixsen and Karen Blase
This content is licensed under Creative Commons license CC BY-NC-ND, Attribution-NonCommercial-NoDerivs. You are free to share, copy, distribute and transmit the work under the following conditions: Attribution — You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work); Noncommercial — You may not use this work for commercial purposes; No Derivative Works — You may not alter or transform this work. Any of the above conditions can be waived if you get permission from the copyright holder.
http://creativecommons.org/licenses/by-nc-nd/3.0