ka overview june2010

Overview & Capabilities

KnowledgeAdvisors

Agenda

Introductions

Review previous discussions

KnowledgeAdvisors’ Capabilities

Overview of data capture and

analysis process/tools

Discuss pilot program

2© 2010, KnowledgeAdvisors

Who we are

KnowledgeAdvisors is a human

capital analytics firm. We are the

world’s largest provider of learning

and talent measurement solutions.

3© 2010, KnowledgeAdvisors

Measurement Expertise

Advisory Board− Josh Bersin

− Dr. Robert Brinkerhoff

− Dr. Jac Fitz-Enz

− Dr. Jack Phillips

− Dr. Don Kirkpatrick (retired)

KnowledgeAdvisors

Experts− Measurement Strategy

− Statistical Analysis

− Outsourced Solutions

4© 2010, KnowledgeAdvisors

Metrics that Matter

Automated Data Collection

Push Reporting

Robust Filtering and

Analytics

5© 2010, KnowledgeAdvisors

Benchmarks & Analytics

750 Million Data Points with

many benchmark “slices”

Reporting that puts data into

context and communicates

results

Dashboards to visually

interpret trends and

relationships

Information distribution that

reduces administrative

burden

6© 2010, KnowledgeAdvisors

What we do

Automate the collection of learning

evaluation data using validated and

standardised instruments

Aggregate and present the data in a format

that is meaningful for learning & HR

professionals

Provide benchmarking to bring relevance to

the data

Provide expertise to drive continuous

improvement

7© 2010, KnowledgeAdvisors

Why we do it All the work by designers, facilitators, participants, coaches

and managers is for naught unless it manifests as results of

importance to the business.

Credible, reliable measures are needed to determine

whether the training investment is paying dividends and what

refinements are needed to further improve the program’s

effectiveness.

The only way to prove that resources have been well used is

to continuously document and communicate relevant results.

Outcomes must be communicated to drive continual

improvement in learning and development.

Effectiveness and efficiency are increased by rigorously

assessing the quality of the current output, implementing

ideas for improvement, measuring the impact and repeating

the procedure.

8© 2010, KnowledgeAdvisors

Benefits of Metrics that Matter

Provide ROUGHLY REASONABLE INDICATORS of

learning performance

Shift focus to leading, versus lagging indicators

Trainers, program manager, managers, coaches, and

mentors are ranked and benchmarked, resulting in

improved preparation & performance

Enables productive dialogue between HR and

business.

Data informs all aspects of HR including

Leadership, Recruiting, L&D, Performance, Engagem

ent, and Talent.

9© 2010, KnowledgeAdvisors

Organisations Served

10© 2010, KnowledgeAdvisors

Streamline Evaluation

11

LMS Enrollment• Class information

• Learner demographics

Post Event Evaluation

Follow Up Evaluation

Manager Evaluation

• Instant feedback

• Satisfaction indicators

• Impact, results predictors

• Impact, results indicators

• Post-class support feedback

• Impact and results

indicators and validation

• Support reinforcement

Data is transformed into

Business Intelligence

© 2010, KnowledgeAdvisors

Smile Sheets into Smart Sheets

© 2010, KnowledgeAdvisors

Value Creation vs. Value

DemonstrationA

va

ilab

ility

of D

ata

Importance to Senior Management

Efficiency

constructs

(how much we train)

Performance

constructs

(how well we train) Impact

constructs

(value we create)

Reporting Strategy - Identify Stakeholder KPI’s

Stakeholder Responsibilities

Course

Manager

Ranking of Course Scores

Instructor

Manager

Ranking of Instructor Performance

Operations

Manager

Enrollment, Completion, Cancellation Rates

Utilization Rates (Course, Location, Instructor)

Client Job Impact , Business Results, and Value Indicators

VP of L&D Operational, Financial, Cultural and Performance

Indicators

14© 2010, KnowledgeAdvisors

15© 2010, KnowledgeAdvisors

Detailed Result Catalog

View Results by Category,

Student and Question

Automate and

Share Reports

16© 2010, KnowledgeAdvisors

Crosstab

17 © 2010, KnowledgeAdvisors

Compare question

categories, courses,

instructors, locations,

etc

Color codes scores relative to your

selected benchmark:

red (under benchmark)

yellow (at benchmark)

green (exceeding benchmark)

Find Strengths &

Weaknesses

Compare Results Internally

and Against a Benchmark

Drill Into Details

18© 2010, KnowledgeAdvisors

Compare to Internal

Goals and External

Benchmarks

19© 2010, KnowledgeAdvisors

Understand when

training is applied or

why it isn’t being

applied

Calculate

Reasonable and

Scalable ROI Metrics

20© 2010, KnowledgeAdvisors

Consultative

ly Discuss

Training

Impact

21© 2010, KnowledgeAdvisors

22 © 2010, KnowledgeAdvisors

“Business Results” Imported into MTM

23© 2010, KnowledgeAdvisors

Import or Manually

Track Business

Results

Determine

Goals and

Color

Coding

Display

Results in

Dashboard

Widgets24

© 2010, KnowledgeAdvisors

Customizable

DashboardsAdd / Delete Tabs

Add Delete Widgets

Email and Download

Import Results

26 © 2010, KnowledgeAdvisors

Instructor Performance Summary

Communicates Value

Provides an overview of performance

of an individual Instructor.

Highlights Areas for Improvement

Performance by Instructor

Question Category.

Top/bottom analysis of Courses

and Classes

Trend Analysis on Ratings and Post

Event submissions

Qualitative Feedback

27 © 2010, KnowledgeAdvisors

Instructor Performance Summary

28 © 2010, KnowledgeAdvisors

A single report containing

the full story of an

instructor’s performance

Talent Development Summary Communicates Value

Provides a comprehensive view of talent and development

Quarterly report format (Word 2007 or PDF)

Highlights Areas for Improvement

Top/bottom analysis of Courses, Instructors, Learning

Providers and Locations

Trend Analysis on Learning Methodologies and

Question Categories

Impact and Value analysis by Demographics and Courses

On the Job impact and Barriers to Use analysis

29 © 2010, KnowledgeAdvisors

A single report containing

the full story of an

organization’s performance30© 2010, KnowledgeAdvisors

Next steps

Pilot Program

4-6 month trial of Metrics that

Matter

Outsourced Administration

Identify one or multiple programs to

evaluate

Participate in all steps

Outcomes include comprehensive

review of reporting and analytics

using your own program results

31© 2010, KnowledgeAdvisors

Contact Us

Stuart Halliday

Sales Director

07717 507 945

shalliday@knowledgeadvisors.com

www.knowledgeadvisors.com