ka overview june2010
DESCRIPTION
Corporate overviewTRANSCRIPT
Overview & Capabilities
KnowledgeAdvisors
Agenda
Introductions
Review previous discussions
KnowledgeAdvisors’ Capabilities
Overview of data capture and
analysis process/tools
Discuss pilot program
2© 2010, KnowledgeAdvisors
Who we are
KnowledgeAdvisors is a human
capital analytics firm. We are the
world’s largest provider of learning
and talent measurement solutions.
3© 2010, KnowledgeAdvisors
Measurement Expertise
Advisory Board− Josh Bersin
− Dr. Robert Brinkerhoff
− Dr. Jac Fitz-Enz
− Dr. Jack Phillips
− Dr. Don Kirkpatrick (retired)
KnowledgeAdvisors
Experts− Measurement Strategy
− Statistical Analysis
− Outsourced Solutions
4© 2010, KnowledgeAdvisors
Metrics that Matter
Automated Data Collection
Push Reporting
Robust Filtering and
Analytics
5© 2010, KnowledgeAdvisors
Benchmarks & Analytics
750 Million Data Points with
many benchmark “slices”
Reporting that puts data into
context and communicates
results
Dashboards to visually
interpret trends and
relationships
Information distribution that
reduces administrative
burden
6© 2010, KnowledgeAdvisors
What we do
Automate the collection of learning
evaluation data using validated and
standardised instruments
Aggregate and present the data in a format
that is meaningful for learning & HR
professionals
Provide benchmarking to bring relevance to
the data
Provide expertise to drive continuous
improvement
7© 2010, KnowledgeAdvisors
Why we do it All the work by designers, facilitators, participants, coaches
and managers is for naught unless it manifests as results of
importance to the business.
Credible, reliable measures are needed to determine
whether the training investment is paying dividends and what
refinements are needed to further improve the program’s
effectiveness.
The only way to prove that resources have been well used is
to continuously document and communicate relevant results.
Outcomes must be communicated to drive continual
improvement in learning and development.
Effectiveness and efficiency are increased by rigorously
assessing the quality of the current output, implementing
ideas for improvement, measuring the impact and repeating
the procedure.
8© 2010, KnowledgeAdvisors
Benefits of Metrics that Matter
Provide ROUGHLY REASONABLE INDICATORS of
learning performance
Shift focus to leading, versus lagging indicators
Trainers, program manager, managers, coaches, and
mentors are ranked and benchmarked, resulting in
improved preparation & performance
Enables productive dialogue between HR and
business.
Data informs all aspects of HR including
Leadership, Recruiting, L&D, Performance, Engagem
ent, and Talent.
9© 2010, KnowledgeAdvisors
Organisations Served
10© 2010, KnowledgeAdvisors
Streamline Evaluation
11
LMS Enrollment• Class information
• Learner demographics
Post Event Evaluation
Follow Up Evaluation
Manager Evaluation
• Instant feedback
• Satisfaction indicators
• Impact, results predictors
• Impact, results indicators
• Post-class support feedback
• Impact and results
indicators and validation
• Support reinforcement
Data is transformed into
Business Intelligence
© 2010, KnowledgeAdvisors
Smile Sheets into Smart Sheets
© 2010, KnowledgeAdvisors
Value Creation vs. Value
DemonstrationA
va
ilab
ility
of D
ata
Importance to Senior Management
Efficiency
constructs
(how much we train)
Performance
constructs
(how well we train) Impact
constructs
(value we create)
Reporting Strategy - Identify Stakeholder KPI’s
Stakeholder Responsibilities
Course
Manager
Ranking of Course Scores
Instructor
Manager
Ranking of Instructor Performance
Operations
Manager
Enrollment, Completion, Cancellation Rates
Utilization Rates (Course, Location, Instructor)
Client Job Impact , Business Results, and Value Indicators
VP of L&D Operational, Financial, Cultural and Performance
Indicators
14© 2010, KnowledgeAdvisors
15© 2010, KnowledgeAdvisors
Detailed Result Catalog
View Results by Category,
Student and Question
Automate and
Share Reports
16© 2010, KnowledgeAdvisors
Crosstab
17 © 2010, KnowledgeAdvisors
Compare question
categories, courses,
instructors, locations,
etc
Color codes scores relative to your
selected benchmark:
red (under benchmark)
yellow (at benchmark)
green (exceeding benchmark)
Find Strengths &
Weaknesses
Compare Results Internally
and Against a Benchmark
Drill Into Details
18© 2010, KnowledgeAdvisors
Compare to Internal
Goals and External
Benchmarks
19© 2010, KnowledgeAdvisors
Understand when
training is applied or
why it isn’t being
applied
Calculate
Reasonable and
Scalable ROI Metrics
20© 2010, KnowledgeAdvisors
Consultative
ly Discuss
Training
Impact
21© 2010, KnowledgeAdvisors
22 © 2010, KnowledgeAdvisors
“Business Results” Imported into MTM
23© 2010, KnowledgeAdvisors
Import or Manually
Track Business
Results
Determine
Goals and
Color
Coding
Display
Results in
Dashboard
Widgets24
© 2010, KnowledgeAdvisors
Customizable
DashboardsAdd / Delete Tabs
Add Delete Widgets
Email and Download
Import Results
26 © 2010, KnowledgeAdvisors
Instructor Performance Summary
Communicates Value
Provides an overview of performance
of an individual Instructor.
Highlights Areas for Improvement
Performance by Instructor
Question Category.
Top/bottom analysis of Courses
and Classes
Trend Analysis on Ratings and Post
Event submissions
Qualitative Feedback
27 © 2010, KnowledgeAdvisors
Instructor Performance Summary
28 © 2010, KnowledgeAdvisors
A single report containing
the full story of an
instructor’s performance
Talent Development Summary Communicates Value
Provides a comprehensive view of talent and development
Quarterly report format (Word 2007 or PDF)
Highlights Areas for Improvement
Top/bottom analysis of Courses, Instructors, Learning
Providers and Locations
Trend Analysis on Learning Methodologies and
Question Categories
Impact and Value analysis by Demographics and Courses
On the Job impact and Barriers to Use analysis
29 © 2010, KnowledgeAdvisors
A single report containing
the full story of an
organization’s performance30© 2010, KnowledgeAdvisors
Next steps
Pilot Program
4-6 month trial of Metrics that
Matter
Outsourced Administration
Identify one or multiple programs to
evaluate
Participate in all steps
Outcomes include comprehensive
review of reporting and analytics
using your own program results
31© 2010, KnowledgeAdvisors