evaluation of a collaborative ta&d initiative: implications for ta providers

23
2009 OSEP Project Directors Meeting Martha Diefendorf, Kristin Reedy & Pat Mueller

Upload: vita

Post on 05-Feb-2016

29 views

Category:

Documents


0 download

DESCRIPTION

Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers. 2009 OSEP Project Directors Meeting Martha Diefendorf, Kristin Reedy & Pat Mueller. Purpose of this Session. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

2009 OSEP Project Directors Meeting

Martha Diefendorf, Kristin Reedy & Pat Mueller

Page 2: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

To gain a deeper understanding of the facilitators, challenges and strategies of collaborative TA to State agencies through the story of the Early Childhood Transition Initiative.

To discuss your experiences with provision of collaborative TA, including benefits and challenges.

2

Page 3: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

Research on EC Transition State and local models of effective practices for transition

Technical Assistance Experience Understanding of issues being faced by states and the realities of bridging research to practice

OSEP Direction and Support Evidence to determine implementation of IDEA transition requirements

3

Page 4: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

An analysis of state performance on the transition compliance indicators as reported in their Annual Performance Reports (APR) demonstrated a need for system improvement and enhancement.

(NECTAC, 2007)

4

Page 5: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

FundsOSEP approved the allocation of RRC and NECTAC resources to support collaborative technical assistance activities focused on improving state lead agencies’ implementation of the transition requirements of the IDEA

Main purposes◦ Build the collective topical expertise of TA providers◦ Develop common materials for use in TA◦ Provide consistent TA to states based on level of need

5

Page 6: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

NECTAC (National TA Center) NECTC (Specialty Center) Regional Resource Centers OSEP

Stakeholder Input Section 619 Coordinators Part C Coordinators PACER Parent Training and Information Center

6

Page 7: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

Face-to-face meeting of TA Nov 2007

providers and stakeholders

Development of “The Document” Dec 2007 -Feb 2008

Ancillary materials Jan 2008 and

ongoing

Agenda for regional meetings March 2008

with state administrators

7

Page 8: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

General TA for all states◦ Materials on NECTAC web Feb 2008

◦ Materials on OSEP APR calendar June 2008

◦ Listserv postings ongoing

◦ Regional meetings Mar-July 2008

◦ Conference calls/webinars Summer/Fall

Intensive TA for 12 targeted states◦ Individualized onsite TA 2008-2009

◦ Ongoing individualized support◦ Development of long-term systems change plans

8

Page 9: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

9

Framework for analyzing transition system infrastructure and program components

Structured to identify strengths & weaknesses

Includes improvement strategies reflecting the most current research and recommended

practice based on an emerging evidence base

Differentiates between “evidences” that are across agencies and within agencies

“Designing and Implementing Effective Early Childhood Transition Processes”

Page 10: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

Sponsor: RRC Program Purpose: To document outcomes and

impact of the collaborative TA efforts Process: RFP was developed and external evaluator selected Who: Philliber Research Associates - familiar with provision of TA Time frame: Aug 2008 – Feb 2009 Total budget: $18,000

10

Page 11: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

To determine the extent to which…

Collaboration between OSEP, RRCP, NECTAC, NECTC and DAC was successful

States utilized materials and resources

Designated States utilized intensive TA

Strategies resulted in improvements in a State’s transition system

11

Page 12: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

Web-based survey of States receiving general TA

Interviews with recipients of intensive TA

Web-based survey of TA providers

12

Page 13: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

48% survey return rate from Part C & Preschool Coordinators

Product usage for at least 1 product: 92% had seen, 81% had read & 69% had used 2 most frequently used: Early Transition from

C to B and Part C Federal Requirements 64% visited the EC Transition web site most

often to download reports, publications, etc. 62% indicated that their State needs new or

additional TA

13

Page 14: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

STATE PERSPECTIVE Phone interviews with 3 key staff from FIT, Part

C and the State Transition Coordinator. Well received & judged to be effective Tools provided were helpful & easy to use TA by external agencies was effective in

bringing key partners together Direct effects were increased: collaboration

among the partners, family involvement in state/local team meetings & improved MOA.

Ongoing TA needed, including onsite

14

Page 15: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

PROVIDER PERSPECTIVE 74% survey return rate from Initiative members Majority of the 26 States rated were very or

somewhat receptive to the TA 67% of States rated, made the TA changes to a

great or moderate extent 77% of the Initiative members felt the Initiative

was moderately successful Barriers to improvement:

o state’s lack of time/money, o identifying transition as a high priority

15

Page 16: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

PROVIDER PERSPECTIVE Most frequently observed changes:

◦ data systems◦ interagency agreements ◦ revised policies/procedures ◦ improved communication & interagency

cooperation Greater success of the Initiative was limited

by time & sufficient resources Overall, TA providers felt the collaborative

effort resulted in benefits for the States

16

Page 17: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

Initiative achieved moderate degree of success.

Tools developed were widely used and shared extensively by States with staff and local partners.

Greater improvement can be realized with more time and States gaining an increased understanding of the Initiative.

17

Page 18: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

Explore ways to make TA normative. Address reticence by States to access TA… “promote TA as a normal part of doing business.”

Improve the process of identifying and inviting States to participate in intensive TA.

Work for increased clarification of roles and relationships among Initiative TA providers.

18

Page 19: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

19

Part B

Page 20: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

20

Part C

Page 21: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

What are your experiences with the provision of collaborative TA? ◦Benefits? ◦Challenges?◦Effective strategies?

How do you approach a State agency that has demonstrated need for your TA or similar services?

21

Page 22: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

22

National Transition Initiative Web Sitehttp://www.nectac.org/topics/transition/ectransitionta.asp

NECTAC Web sitehttp://www.nectac.org/topics/transition/transition.asp

NECTC Web sitehttp://www.ihdi.uky.edu/nectc/

OSEP – RRFC Calendar – Technical Assistance Related to Determinations Web sitehttp://spp-apr-calendar.rrfcnetwork.org/techassistance.html

Data Accountability Center (DAC)https://www.ideadata.org/index.html

Page 23: Evaluation of a Collaborative TA&D Initiative: Implications for TA Providers

Martha Diefendorf 919-962-7368

[email protected] Pat Mueller

802-434-5607 [email protected]

Kristin Reedy 802-951-8218 [email protected]

23