Follow us @nccmt Suivez-nous @ccnmo
Funded by the Public Health Agency of Canada | Affiliated with McMaster UniversityThe views expressed here do not necessarily reflect the views of the Public Health Agency of Canada.
EPHPP: Quality Assessment Tool for
Quantitative Studies
Presenters:
Maureen Dobbins, RN, PhD
Megan Racey, MSc
October 18, 2016
1:00 – 2:30 PM ET
Follow us @nccmt Suivez-nous @ccnmo 2
Housekeeping
Use Q&A to post comments / questions
during the webinar
• ‘Send’ questions to All (not
privately to ‘Host’)
Connection issues
• Recommend using a wired
Internet connection (vs. wireless),
• WebEx 24/7 help line
• 1-866-229-3239
Participant Side
Panel in WebEx
Q&A
Follow us @nccmt Suivez-nous @ccnmo 3
After Today
The PowerPoint presentation (in English and French)
and English audio recording will be made available.
These resources are available at:
PowerPoint: http://www.slideshare.net/NCCMT/
Audio Recording:
https://www.youtube.com/user/nccmt/videos
Follow us @nccmt Suivez-nous @ccnmo 4
Poll Question #1
How many people are watching today’s session with you?
A. Just meB. 1-3C. 4-5D. 6-10E. >10
Follow us @nccmt Suivez-nous @ccnmo
Your profession? Put a √ on your answer (or RSVP via email)
/
Epidemiologist Management (director,
supervisor, etc.)
Allied health
professionals (nurse,
dietician, dental
hygenist, etc.)
Librarian Physician / Dentist Other
5
Follow us @nccmt Suivez-nous @ccnmo
Quality Assessment Tool for
Quantitative Studies
http://www.nccmt.ca/resources/search/14
Episode 28
6
NCC
Infectious
DiseasesWinnipeg, MB NCC
Methods
and ToolsHamilton, ON
NCC Healthy
Public PolicyMontreal, QC
NCC
Determinants
of HealthAntigonish, NS
NCC
Aboriginal
HealthPrince George, BC
NCC
Environmental
HealthVancouver, BC
7
Registry of Methods and Tools
Online Learning Opportunities
WorkshopsMultimedia
Public Health+
Networking and Outreach
NCCMT Products and Services
8
Follow us @nccmt Suivez-nous @ccnmo 9
Poll Question #2
How familiar are you with the method or tool we are discussing today?
A. I am not familiar with the method or toolB. I have heard of the method or toolC. I have used the method or tool
Follow us @nccmt Suivez-nous @ccnmo 10
Presenter
Maureen Dobbins, RN, PhD
Scientific Director, Health Evidence and the National Collaborating Centre for Methods and Tools
McMaster University
Follow us @nccmt Suivez-nous @ccnmo
Presenter
Megan Racey, MSc
PhD Candidate, Department of Human Health and Nutritional Sciences
University of Guelph
11
Follow us @nccmt Suivez-nous @ccnmo 12
Follow us @nccmt Suivez-nous @ccnmo
Effective Public Health Practice Project
• Conducted 35 systematic reviews since 1999
• Creates knowledge dissemination materials
• Expedited reviews, methods and tools for quality
assessment, critical appraisal, and knowledge
synthesis
• Establishment of McMaster Evidence Review
and Synthesis Centre (MERSC)
13
Follow us @nccmt Suivez-nous @ccnmo
Quality Assessment Tool for Quantitative Studies
• Developed for use in public health
• Can be applied to articles in any public health area
• Suitable for public health researchers,
practitioners and policymakers
• Two independent reviewers
14
Follow us @nccmt Suivez-nous @ccnmo
Tool Development
15
Follow us @nccmt Suivez-nous @ccnmo
Components
• Tool for overall methodological rating
• 8 component ratings synthesized to one global
rating
• Guide to generating interrater agreement
• Dictionary of terms
• Definitions relevant to each component
• Ensures standardized results
16
Follow us @nccmt Suivez-nous @ccnmo 17
Follow us @nccmt Suivez-nous @ccnmo 18
Follow us @nccmt Suivez-nous @ccnmo 19
Follow us @nccmt Suivez-nous @ccnmo 20
Follow us @nccmt Suivez-nous @ccnmo 21
Follow us @nccmt Suivez-nous @ccnmo 22
Follow us @nccmt Suivez-nous @ccnmo 23
Follow us @nccmt Suivez-nous @ccnmo 24
Follow us @nccmt Suivez-nous @ccnmo
Global Rating
25
• Strong, Moderate or Weak
• Based on individual component ratings A-F
• Dictionary provides guide to completing this
section based on individual component ratings
• Example dictionary section:
Follow us @nccmt Suivez-nous @ccnmo 26
Follow us @nccmt Suivez-nous @ccnmo
Interrater Agreement
27
Follow us @nccmt Suivez-nous @ccnmo
Presenter
Megan Racey, MSc
PhD Candidate, Department of Human Health and Nutritional Sciences
University of Guelph
28
Follow us @nccmt Suivez-nous @ccnmo
Overview of my research
• Improving the success of nutrition education intervention relies on careful
planning of their design and feasibility of their evaluation
• There is little to guide researchers on how to best develop interventions
• We’ve conducted systematic reviews to identify characteristics of effective
interventions related to our target audience, food group focus and study
setting
• From this, we’ve developed a school-based intervention, Why Dairy and
Alternatives
29
Follow us @nccmt Suivez-nous @ccnmo
My use of EPHPP
• Used for quality assessment of dairy-specific
interventions in adolescents for systematic
review
30
Follow us @nccmt Suivez-nous @ccnmo
Excerpt of
table with
quality rating
31
Marquez et al. ICAN 2015.
Follow us @nccmt Suivez-nous @ccnmo
Why I choose EPHPP
• Experience/familiarity
• Ease of use
• Clarity
• Accessibility
• Applicability
• Practicality
32
Follow us @nccmt Suivez-nous @ccnmo
My experience
• Was easy to use
• Tool dictionary was a well-utilized resource
• Reliant on information provided by the
researcher/author of the study
• Required research judgement
33
Follow us @nccmt Suivez-nous @ccnmo 34
Your Comments/Questions
• Use Q&A to post comments
and/or questions
• ‘Send’ questions to All (not
privately to ‘Host’)
Participant Side
Panel in WebEx
Q&A
Follow us @nccmt Suivez-nous @ccnmo 35
Poll Question #3
Could this method or tool be useful
in practice?
A. Very usefulB. Somewhat useful C. Not at all usefulD. Don’t know
Follow us @nccmt Suivez-nous @ccnmo 36
Your Feedback is Important
Please take a few minutes to share your thoughts
on today’s webinar.
Your comments and suggestions help to improve
the resources we offer and plan future webinars.
The short survey is available at:
https://nccmt.co1.qualtrics.com/SE/?SID=SV_7ZJ
HPbeSunMTH7L
Follow us @nccmt Suivez-nous @ccnmo 37
Poll Question #4
What are your next steps? (Check all
that apply)
A. Access the method/tool referenced in the presentation
B. Read the NCCMT summary about the method/tool described today
C. Consider using the method/tool in practiceD. Tell a colleague about the method/tool
Follow us @nccmt Suivez-nous @ccnmo 38
Join us for our next webinarNCCMT Spotlight on Methods & Tools: NCCMT
Resources Mapped to the Core Competencies for
Public Health
DATE: Wednesday, November 23, 2016
TIME: 1:00-2:30pm EST
We have created a new tool on our website to help busy
practitioners find the many resources available from the NCCMT
that can support PHAC’s Core Competencies for Public Health in
Canada. This tool helps individuals and organizations find NCCMT
resources related to each competency so you can plan professional
development activities tailored to your own needs or those of your
team. Join us to learn more!
Register at: https://health-evidence.webex.com/health-
evidence/onstage/g.php?MTID=e3b12586dc598976035989f2f4e6152d3
Follow us @nccmt Suivez-nous @ccnmo
Funded by the Public Health Agency of Canada | Affiliated with McMaster UniversityThe views expressed here do not necessarily reflect the views of the Public Health Agency of Canada.
For more information about the
National Collaborating Centre
for Methods and Tools:
NCCMT website www.nccmt.ca
Contact: [email protected]