eLearning and Evaluation Excellence in Healthcare

www.desouzainstitute.com@desouzainst

Mathew Gancarz – IT / Operations Manager

de Souza Institute is the leading innovative centre of continuing education dedicated to cancer care excellence.

Small, but mighty Educated over 6300 nurses

Created more than 30 courses, each 10 hours long or longer

Developed a state-of-the-art integrated, innovative educational approach, expanded to be interprofessional

Almost 80% increase in the number of nurses in Ontario certified by the Canadian Nursing Association in oncology or palliative care

EducatedSelf-directedMotivated

But… BUSY

Require flexibility

The course is not their #1 priority

Learner Path - de Souza NurseDesignation

de Souza Nurse

de Souza Nurse Core Curriculum

Specialty Certification (CNA/CPHON)

de Souza Clinical Fellowship (75 hours)

Our Approach to eLearning

Engaging Interactions– Practice (but not on patients)!

• Activities

• Social Interactions Talk to someone in your field

• Assessment

Sample Activity

Discussion Forums

Content Storyboard Production Launch

eLearning Production Process

Instructional Design is

Regular Course UpdatesGot to keep up!

eLearning / Moodle Demo

Sample Activity

Sample Activity

Purpose of Evaluation

• Accountability to funders and learners– Does the program achieves its intended objectives?

• Quality and performance– Do de Souza courses change knowledge and confidence?

• Academic Excellence– Are we competitive against the best in Canada and in the

world?

Evaluation at end.. What progress did we make?

Evaluation at the start..Establish baseline

Moodle Questionnaire PluginThank you to Joseph Rezeau and Mike Churchward for building and maintaining

Supporting Cancer Care Quality Improvement (Chemotherapy example)

2300 nurses completed de Souza chemotherapy course across ON

Annual chemotherapy maintenance course offered for all trained nurses

30 chemo-facilitators trained to provide mentorship in practice

Series10%

20%40%60%80%

100%

before the course after the course

Knowledge on chemotherapyEx

am s

core

ESAS-R NCI Common toxicity criteria-grading

ECOG0

0.5

1

1.5

2

2.5

3

3.5

4

PRE vs POST Confidence Level-Validated Assessment Tools (N=131-135)

PREPOST

Mea

n (R

ated

1-4

)

Instructi

ons

Navigation

Understanding of R

equirements

Ease of Acce

ss

Exam Navigation

Technica

l Support

0

0.5

1

1.5

2

2.5

3

3.5

4

4.5

Ratings of eLearning and Tools (N=143)

Mea

n (R

ated

1-5

)

Mind Maps of EvaluationComments, Strengths and Weaknesses

Extracting Questionnaire Data across multiple courses – Pentaho ETL

Future Directions• Learner Analytics and EDM - look at analyzing

Moodle logs, evaluations across courses and time

• Empowering the learners, showing them their own improvement over time based on evaluation scores from courses.. What areas do they still need to develop?

Questions – Comments

Thank you for your time, for more information:www.desouzainstitute.comTwitter: @desouzainstOr search for de Souza Institute on LinkedIn or Facebook

Find me at mathew.gancarz@desouzainstitute.com or on LinkedIn – Mathew Gancarz

Enrollment - ePortfolio• Course Calendar integrated with enrollment software

• Registration limited by health professions, per course

• Different course requirements• Prerequisites• Approvals• Disclosure agreements

• Payment via credit card• Bulk shopping cart

Enrollment - Calendar

Transcripts and Tracking