how to evaluation 70 20-10 learning ecosystems webinar slides

What we do

• how a mindset of prototyping and feedback can accelerate the maturity of a program

• how to build a culture of evaluation and research in your learning and development team

• technologies for embedding continuous measurement into learning programs

• the use of the Robert Brinkerhoff Success Case Method in the evaluation of 70-20-10 learning models.

We will discuss …

Where’s your organisation?

We don’t really evaluate beyond surveys

We take a mature approach to evaluation

“Of the 96 Fortune 500 CEOs responding to the survey, 96 percent said that they want data demonstrating the connection between investment in people and improvement in critical business measures. However, only 8 percent report getting that information.”

Source: ROI Institute/ATD research study on what CEOs think about investment in people

https://www.td.org/Publications/Blogs/Learning-Executive-Blog/2014/11/What-Ceos-Want-and

How-to-Give-It-to-Them

What is hard about evaluating learning?

It’s not a straight line of course = outcome

Image CC – by Brett Cronin

Image CC – by Michael Coghlan

It’s not about the inputs

Image CC – Antony Mayfield

We measure the wrong things

Image CC – by Glug Events

It’s about the outputs

IMPACT

Design thinking applied to learning

Startups do this QUICKLY

Low fidelityHigh fidelity

Learner stories

Learner journeys

PilotsRole plays

Project Small amount of

funding and time

Manager support for the

project

Community of Practice

Mentoring

Fostering innovation

How could this mindset of prototyping be embedded in L&D teams?

We are working on developing our line managers into being learning leaders. The first step is a program for managers in coaching skills.

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Coaching program for managers

How could this program be prototyped?

Marketing has similar problems to learning

Vague statements like promote the brand of an organisation

Digital marketing is data driven

A/B testing

xAPI aka Tin Can

The risk is that it’s only an input

1 business metric

Some LRS’s allow for the correlation between thebusiness metrics and the data.

Learning logs

Increases reflection Makes learning visible

With our coaching program what data could be collected?Your thoughts …

Success case methodwww.brinkerhoffevaluationinstitute.com

“Combines the ancient craft of storytelling with more current evaluation approaches of naturalistic inquiry and case study”

Success case methodwww.brinkerhoffevaluationinstitute.com

What are the pro and cons of using the success method with the coaching program?

Pros Cons

How could you improve the evaluation of programs in your organisation?

Thank you for your participation!

Dr Robin PetterdLearning Consultant

M: +61 419 101 928E: robin@sproutlabs.com.auT: @sproutlabs_au