how to evaluation 70 20-10 learning ecosystems webinar slides
TRANSCRIPT
What we do
• how a mindset of prototyping and feedback can accelerate the maturity of a program
• how to build a culture of evaluation and research in your learning and development team
• technologies for embedding continuous measurement into learning programs
• the use of the Robert Brinkerhoff Success Case Method in the evaluation of 70-20-10 learning models.
We will discuss …
Where’s your organisation?
We don’t really evaluate beyond surveys
We take a mature approach to evaluation
“Of the 96 Fortune 500 CEOs responding to the survey, 96 percent said that they want data demonstrating the connection between investment in people and improvement in critical business measures. However, only 8 percent report getting that information.”
Source: ROI Institute/ATD research study on what CEOs think about investment in people
https://www.td.org/Publications/Blogs/Learning-Executive-Blog/2014/11/What-Ceos-Want-and
How-to-Give-It-to-Them
What is hard about evaluating learning?
It’s not a straight line of course = outcome
Image CC – by Brett Cronin
Image CC – by Michael Coghlan
It’s not about the inputs
Image CC – Antony Mayfield
We measure the wrong things
Image CC – by Glug Events
It’s about the outputs
IMPACT
Design thinking applied to learning
Startups do this QUICKLY
Low fidelityHigh fidelity
Learner stories
Learner journeys
PilotsRole plays
Project Small amount of
funding and time
Manager support for the
project
Community of Practice
Mentoring
Fostering innovation
How could this mindset of prototyping be embedded in L&D teams?
We are working on developing our line managers into being learning leaders. The first step is a program for managers in coaching skills.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Coaching program for managers
How could this program be prototyped?
Marketing has similar problems to learning
Vague statements like promote the brand of an organisation
Digital marketing is data driven
A/B testing
xAPI aka Tin Can
The risk is that it’s only an input
1 business metric
Some LRS’s allow for the correlation between thebusiness metrics and the data.
Learning logs
Increases reflection Makes learning visible
With our coaching program what data could be collected?Your thoughts …
Success case methodwww.brinkerhoffevaluationinstitute.com
“Combines the ancient craft of storytelling with more current evaluation approaches of naturalistic inquiry and case study”
Success case methodwww.brinkerhoffevaluationinstitute.com
What are the pro and cons of using the success method with the coaching program?
Pros Cons
How could you improve the evaluation of programs in your organisation?
Thank you for your participation!
Dr Robin PetterdLearning Consultant
M: +61 419 101 928E: [email protected]: @sproutlabs_au