lambda solutions webinar | capturing data to improve the elearning experience with analytics
TRANSCRIPT
A C C E L E R AT E L E A R N I N G P E R F O R M A N C E
Ben YoungDirector of Learning Solutions
Capturing Data to Improve the eLearning Experience with Analytics
Stewart RogersDirector of Product Management
Housekeeping
• Sound and Audio
• Poll Questions
• Q&A at the End
• Presentation Recording and Slides
• Post-Webinar Survey
Today’s Speaker
Ben YoungDirector of Learning Solutions
Stewart RogersDirector of Product Management
• Objectives
• Overview of Learning Analytics
• Common Challenges
• Approaching your LMS Data
• Techniques for implementing Learning Analytics
• Tips to Measure Learning Success
• Technology Solutions
Agenda
What LMS are you currently using?
Moodle
Totara Learn
Blackboard
Canvas
D2L
Other
Poll Question #1
Are you satisfied with your LMS reporting capabilities?
Yes, highly satisfied
Neither satisfied or dissatisfied
No, dissatisfied
Poll Question #2
Help you understand how to:
• Monitor Learning progress
• Report on Learner engagement within your courses
• Assess “time spent” by your learners and instructors
• Collect and visualize compliance data
• Analyze trends in the effectiveness of your learning programs
Our Objectives
What is it?
Learning
What Is Learning Analytics?
Measurement
Collection
Analysis Reporting
What is Reporting
“the regular provision of information to decision-
makers within an organisation to support
them in their work.”
What is Data-Driven Online Learning?
• “A data-driven approach used to optimize how your organization manages and deploys learning and development to support the
execution of your business strategy.”• - Chief Learning Officer, 2015
• Technology
• Data
• Skills
Common Challenges
Technology
Common Challenges
Data and analytics technologies such as LMS reporting solutions help bridge the gap in skills. Organizations with these technologies in place are able to leverage analytics
without hiring designated employees.
Data
Common Challenges
Most companies cannot get access to all the data stored within their LMS.
Skills
Common Challenges
Most organizations lack the skills,and knowledge needed to use learning
analytics.
Let’s Use an Analogy
● Website visits
● Page views
● Page open/ closes
● Many other events
● Course progress
● Content interactions
● Quiz results
● Course completion rate
Learning
Management
System
Some Interesting Statistics
• 43.75% of corporate organizations increased their budget for learning analytics solutions
• 56.25% kept it the same
• 0% decreased their budget
Approaching Your
LMS Data
Why?
The outcome of the analysis of data, is information
Approaching your LMS Data
Why?
The outcome of the analysis of data, is information
Approaching your LMS Data
Start with a strategy
Why?
The outcome of the analysis of data, is information
Approaching your LMS Data
Start with a strategy
What are you trying to achieve? Instead of starting with what data you could or should access, start by working out what business goal you are looking to overcome.
What?
The outcome of the analysis of data, is information
Approaching your LMS Data
What?
The outcome of the analysis of data, is information
Approaching your LMS Data
Use KPI’s (Key Performance Indicators)
Choosing the right KPI’s relies on a good understanding of what is important to an organization
What?
Approaching your LMS Data
Some common KPI’s
Grade ✔
Activity Score ✔ Quiz attempts ✔
Progress tracking ✔
Courses purchased ✔
Site logins ✔
Time spent engaged ✔
Course Completion ✔
How?
The outcome of the analysis of data, is information
Approaching your LMS Data
How?
The outcome of the analysis of data, is information
Approaching your LMS Data
Identify the analytics solution that allows…
you to access, manipulate and present your learning information to meet your requirements
How?
The outcome of the analysis of data, is information
Approaching your LMS Data
To identify the data you need to answer these questions
Focus on Identifying the data that will help answer your most pressing questions, and deliver on your strategic objectives
Techniques for Implementing Learning Analytics
Techniques for Implementing Learning Analytics
Approach your data through chunks of time
Techniques for Implementing Learning Analytics
Make an ongoing data plan• Analysis of your data on a regular basis is the best way to
measure improvements and outcomes
Techniques for Implementing Learning Analytics
Have a vision for your data• How do you want your data to be presented?
Have a vision for your data
Techniques for Implementing Learning Analytics
How do you want to communicate and share your data?
Techniques for Implementing Learning Analytics
Have a system in place for reflection and feedback
#
5 Tips To Measure Learner Success
1. Monitoring Learner ProgressMonitor Learner progress
● Who is or is NOT enrolled?
● What are start, end, and due dates?
● Who is complete or not-complete?
● Measured at all Learning Plan, Course, Activity
● Measuring date-based progress
Identify intervention opportunities
● See people behind before it is too late
● Tracking progress
• Number of logins or sessions
• Number of course visits
• Number of resource views
• Forum activity
• Activity submissions
• Completion rates
• Time spent
• See trends and correlations
• See what is used and not used
• Compare results with activity
Activity and Engagement
2. Course Activity and Engagement
Identify intervention opportunities
• Instructional design purposes
o Time on course
o Time in activity
o Activity completion criteria
• General purpose
o Course time
o Activity time
• are topics difficult to grasp
• are learners actually spending time
• Time-based activity completion
Assess “time spent”
3. Time Spent Learning
Identify intervention opportunities
• Feedback Analysis
o Feedback, Survey
• Pre/Post Assessment
o Quiz Statistics
o Quiz Questions
o Grades
• Analyzing trends across courses, sections, and groups of learners
• Identify trends of success or opportunities for intervention
• What is gained from knowing
• How it can be done
Learning Effectiveness Report
4. Analyze Learning Effectiveness
Identify intervention opportunities
• Completion / Attendance data
• Time spent
• Certificates issued or expired
• Audit trail reporting
• Automate compliance reporting
• Ease tracking for pro-active alerts
Visualizing compliance data
5. Visualizing Compliance Data
Identify intervention opportunities
Key Takeaways
• Start with a strategy
• Use KPIs to measure success
• Identify a reporting/analytics solution that gives you the tools to achieve your goals.
• Approach your data through increments of time
• Have an ongoing data plan
• Use charts to summarize your data
• Feed enhancements back into the learning system
#
Introducing Zoola Analytics
The Solution: Technology
Data and analytics technologies such as LMS reporting solutions help bridge the gap in skills. Organizations with these technologies in place are able to leverage analytics
without hiring designated employees.
Introducing Zoola Analytics
How We Help Customers Today
• Reduce the effort to produce reports
• Produce reports to complement business processes
• Produce reports for tracking progress
• Produce reports to measure learning effectiveness
Lambda Solutions
Assign Training to Groups
• Use rules to group users
• Assign groups to learning
totaraMoodle for Enterprise
Education Clients
Healthcare and Corporate Clients
#
Follow Up
• Recording & slides to follow
• Resources
• Post-webinar satisfaction survey