a service of the children’s bureau, a member of the t/ta network examining the role of coaching...

A Service of the Children’s Bureau, a Member of the T/TA Network

Examining the Role of Coaching and Peer Support for Transfer of Learning

of Leadership Competencies and Systems Change Implementation

www.ncwwi.orgA Service of the Children’s Bureau, a Member of the T/TA Network

NCWWI Leadership Model

Leadership Academy for Middle Managers Over 400 mid-level

managers from public, private, and tribal child welfare settings

Nominated by state directors and CB approved

6-day residential training Addressed skills and

competencies to implement systems change

www.ncwwi.orgA Service of the Children’s Bureau, a Member of the T/TA Network

Informed Training: Using Formative and Process

Evaluation

Process Evaluatio

n

Formative

Evaluation

Training Improvements

:• Pre-work• Enhanced

Coaching• Post-

training Supports

Improved Outcomes for Children, Youth, and

Families

Sustainable Systems Change

Strong Training System

www.ncwwi.org A Service of the Children’s Bureau, a Member of the T/TA Network

Before TrainingIndividualized Coaching

Training Introduction Online Module

Strengths-based Leadership Assessment

During TrainingIndividualized and Group Coaching

Peer-to-Peer Learning

Online Resources Catalogue

After TrainingIndividualized Coaching

Peer Networks

Online Resources Catalogue

Workforce Webinars

Adaptive, Distributiv

e, Inclusive Leadershi

p Skills

Goals of the LAMM:

LAMM Training Supports:

Change Initiatives and Coaching Delivery

Befo

re

Trai

ning

Coac

hing

Cal

l 1Co

achi

ng C

all 2

Dur

ing

Trai

ning

In-s

ession

Gro

up C

oach

ing

Add-

on

Coac

hing

Sess

ions

Afte

r Tr

aini

ng

One

-on-

One

Coac

hing Sm

all

Gro

up

Coac

hing

www.ncwwi.org A Service of the Children’s Bureau, a Member of the T/TA Network

Implementation of Change Initiative

Immediate application of learning to Change

Initiative

Development of Change Initiative effecting systems change

LAMM Evaluation Design

www.ncwwi.org A Service of the Children’s Bureau, a Member of the T/TA Network

Individual Readiness

Training Transferability

Learning

Motivation to Transfer

Transfer of Learning

Implementation of Change Initiative

Expected Return on

Investment

Work Environment

Transfer Support

moderation

• Content Validity• Instructional Design• Trainer Effectiveness

• Self-Efficacy• Learner Readiness

• Peer Support• Supervisor Support• Agency Climate for Change• Opportunity to Use

• Coaching• Training/Assistance• LAMM Peer Networks

3, 6, 12-month Competencies

Post-training Leadership Competencies

Hypothesized Transfer of Learning Model

www.ncwwi.orgA Service of the Children’s Bureau, a Member of the T/TA Network

LAMM Evaluation Design

Mixed Methods Approach– Survey Battery: Pre, Post, Follow-up (3, 6,

and 12 months) • Leadership Competencies• Change Initiative (CI) Implementation• Workplace Implementation Supports• Transfer of Learning• Peer Outreach and Networking• Coaching (one-on-one, post-training)

– Qualitative Approaches• Survey open-ended responses, 6-month

interviews

Evaluation Findings:Leadership Competencies

3-month Regression Analysis Repeated Measures

www.ncwwi.org A Service of the Children’s Bureau, a Member of the T/TA Network

Dosage Grouping Variable:• Group 1 = Training only• Group 2 = Training + Post-training Coaching• Group 3 = Training + Post-training Coaching + Peer Outreach

Variable B SE B β

Workplace Imp. Supports 0.26 0.06 .31**

Peer Outreach 0.16 0.09 .11†

Coaching 0.03 0.07 .03

R2 .13

F 11.10**N = 219; †p < .10; *p < .05; **p < .01

Pretest Posttest 3-mo FU 6-mo FU 12-mo FU3.00

3.20

3.40

3.60

3.80

4.00

4.20

4.40

4.60

Group 1 Group 2 Group 3

Evaluation Findings:CI Implementation

3-month Regression Analysis Repeated Measures

www.ncwwi.org A Service of the Children’s Bureau, a Member of the T/TA Network

Dosage Grouping Variable:• Group 1 = Training only• Group 2 = Training + Post-training Coaching• Group 3 = Training + Post-training Coaching + Peer Outreach

Variable B SE B β

Workplace Imp. Supports 0.27 0.07 .25**

Peer Outreach 0.17 0.12 .10

Coaching 0.05 0.10 .04

R2 .09

F 7.29**N = 219; †p < .10; *p < .05; **p < .01

Pretest Posttest 3-mo FU 6-mo FU 12-mo FU3.00

3.20

3.40

3.60

3.80

4.00

4.20

4.40

4.60

Group 1 Group 2 Group 3

www.ncwwi.orgA Service of the Children’s Bureau, a Member of the T/TA Network

Evaluation Findings:Predictors of

Implementation

Logistic Regression tested predictors Implementation Stage of Change Initiative at 3 months after residential training (N = 105)

Significant Predictors:Leadership CompetenciesCoaching (trend-level)

3-month CI Implementation Stage

Number of Managers

No Progress or N/A 1Exploration/Adoption 32Installation 20Initial Implementation 37Full Implementation/Operation 13Sustainability 2

www.ncwwi.orgA Service of the Children’s Bureau, a Member of the T/TA Network

Discussion

Thank You

www.ncwwi.org A Service of the Children’s Bureau, a Member of the T/TA Network