handouttogowithindicatorpresentation_anatomy ofindicator_infographic_poetz_phipps_neurodevnet
DESCRIPTION
This is the handout that was given out at the #CKF14 conference during the presentation entitled "Indicators for Measurement at each Stage of Knowledge Translation: from research to impact" on June 9, 2014 in Saskatoon, SK. It features a detailed example of an indicator that measures impact (change) and an infographic which is an option for dissemination of evaluation information.TRANSCRIPT
Poetz,A. “Indicators for measurement at each stage of knowledge translation: from research to impact” Canadian Knowledge Mobilization Conference, Monday June 9, 3:30 – 4:00p, Saskatoon, SK
Anatomy of an indicator - example 1) Name/title of indicator: [CB] % increase in self-rated knowledge about KT
2) Definition (including numerator/denominator X 100 if applicable): Average
% increase in self-rated knowledge about KT = Sum (Each self-rated score post-workshop - each matching self-rated score pre-workshop)/# attendees X 100. Using data from question 1 on pre-post questionnaire "How would you rate your knowledge about KT?”
3) Type: Impact
4) Rationale: Useful for measuring how much knowledge was gained (capacity that was built) during a workshop or other training event. While counting # of attendees is ok, it does not tell you how much impact you had on increasing their knowledge, whereas this measure does.
5) Strengths and Limitations: Strength: measures change in knowledge pre-event compared with post-event.
Limitations: Since it is self-rated, it is subject to bias. Also, chance of missing data if some people leave before the event is over, and do not fill out the 2nd matching form, the data is lost (have pre-event info but no post-event info).
6) Data Source(s): Questionnaires handed out at event. Usually on coloured paper, green for pre-event questionnaire and orange for post-event questionnaire (for example). Numbered sheets of paper, and each participant gets a green and orange with the same number on it - this is so that the pre- and post- scores can be matched up for measuring capacity building. Same questions on pre-questionnaire as on the post-questionnaire. KT Core uses same questions for each event so events can be compared.
7) Stage in Co-Produced Pathway to Impact (CPPI): All (because Capacity Building events are to teach KT competencies in all stages of the CPPI).
8) Date (of last revision): May 28, 2014
9) Responsibility for collecting data: KT Core
Poetz,A. “Indicators for measurement at each stage of knowledge translation: from research to impact” Canadian Knowledge Mobilization Conference, Monday June 9, 3:30 – 4:00p, Saskatoon, SK