Building Stronger Professional Development Systems: Using Data to Improve Implementation

Jennifer Coffey, Ph.D.OSEP Project Director and SPDG Program Lead

Audrey DesjarlaisKnowledge Mobilization Coordinator, Signetwork

Implementation: Research on Tools; Research as Tool Sonja K. Schoenwald Professor of Psychiatry & Behavioral Sciences Medical University of South Carolina August 20, 2013, Global Implementation Conference.

TODAY’S AGENDA

AGENDA – Day One Continued

Thank You! Planning Committee Members, Staff, and Facilitators

OSEP • Jennifer Coffey• Tina Diamond• David Guardino• Pat Gonzalez• Shedeh Hajghassemali• Terry Jackson• Greg Knollman• Ingrid Oxaal• Corinne Weidenthal• Susan Weigert• Grace Zamora Duran

Signetwork Staff• Linda Lynch• Melissa Moseley• Leslie Stephenson• Audrey Desjarlais

SPDG Members• Susan Bailey-Anderson, Montana• Don Briere, Connecticut• Kathy Cox, Illinois• Alice Henley, Connecticut• David Merves, Delaware & New

Hampshire• Brenda Oas, North Dakota• Mary Steady, New Hampshire

RRCP Implementation Core Team • Jeanna Mullins, Mid-South RRC• Kim Hartsell, Southeast RRC• Nancy O’Hara, Mid-South RRC

Invited Guests

OSERS• Michael Yudin, Acting Assistant Secretary, US Department of

Education

OSEP• Melody Musgrove, Director, OSEP• Ruth Ryder, Deputy Director, OSEP• Larry Wexler, Director, Research to Practice Division

Parent Centers/ Regional PTACs• Barbara Buswell, Region 5 • Debra Jennings, Region 1 • Connie Hawkins, Region 2 • Nora Thompson, Region 6

SPDG Participation• 43 States Represented• State teams range from

• 1 rep (8 states) CA, CO, MA, MN, NE, PA, VA, WI • 2 reps (4 states) AR, MT, RI, SC • 3 reps (6 states) AL, ID, NC, OR, VT, WY• 4 reps (9 states) AK, CT, IL, IN, KS, KY, MO, NM, TN• 5 reps (8 states) DE, FL, GA, MD, MI, NH, OH, OK, UT• 6 reps (1 state) MS

• Partners include representatives from: Parent Organizations, Institutes of Higher Education

Welcome!

Fiscal Year (FY) 2014• FY 2015

• What you can do to prepare• GPRA/Program Measures• Partners• Current/past data – telling your story• Start sharing with others what a new

SPDG could accomplish• IDEA Statute – SPDG• www.Signetwork.org

The Letter and Spirit of the Law

• Partnerships• Serving children with disabilities• Fulfilling the purpose of your project

GPRA/Program Measures – Pilot Review•External Review Results for FY 2012• Program Measure 1: 11 of 22 initiatives (50%)

met the set targets• Program Measure 2: 4 of 22 (18%) initiatives

met the targets they set • Program Measure 3: 7 out of 22 (32%)

initiatives me the targets they set • Program Measure 4: 1 out of 1

Reliability for the pilot• For Program Measure 1 more variation in scores

– from complete agreement to 44% difference.• For Program Measure 2 there were no

disagreements for the first pair of reviewers and just 1 disagreement for the 2nd pair.

• For Program Measure 3, there was 1 disagreement for the first pair of reviewers and 4 disagreements for the 2nd pair.

• For Program Measure 4, there was 1 disagreement for the first pair and none for the second pair.

Current External Review

• Westat – Data Quality Initiative• Will produce a 1-page document that

summarizes each project’s results• OSEP will provide another FAQ document to

improve the data coming from projects

This Meeting

• Why focus on implementation fidelity?

• Implementation Science• We are the resource• Other resources – AI Hub

INTRODUCTIONS – ALLISON METZ

SMALL GROUP DISCUSSIONS

Discussion Process

PURPOSE: • To learn from others about tools and

approaches in using data to:•define your practice,•improve the fidelity of the practice•effectively engage the various drivers to support the use of data

Discussion Process

1. Pick a topic• ?s to define the what and how – of the

‘what’• ?s to improve the fidelity of ‘what’ through

the implementation drivers • ?s about coaching systems to improve the

fidelity of ‘what’

Discussion Process

2. State Teams – Split up3. Groups – 8-10 people4. Facilitator – OSEP & RRCP5. Listen & Engage6. Write your questions7. Take Notes8. Return to Academy Hall for Allison &

Jennifer’s Q&A session – 11:30 AM

LARGE GROUP Q & A

What’s Next

11:45-1:00pm - Lunch on your own, dining options in packet

1:00-1:30pm – State team time, Action Planning, Meet with your evaluators or Meet with Project Officers

AFTERNOON SESSIONS

DAY TWO – BEGINS @ 8:00am-Project Sharing-U.S. Dept of Ed Presentation