![Page 1: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/1.jpg)
KNOWLEDGE SYNTHESIS:
Literature Searches and Beyond
Ahmed M. Abou-Setta, MD, PhD
Department of Community Health Sciences &
George & Fay Yee Centre for Healthcare Innovation
University of Manitoba
Email: [email protected]
![Page 2: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/2.jpg)
Disclosure of Interest
• At the Centre for Healthcare Innovation, we conduct both systematic reviews and rapid reviews, and I have been an author on various funded reviews
![Page 3: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/3.jpg)
Disclosure of Interest
• At the Centre for Healthcare Innovation, we conduct both systematic reviews and rapid reviews, and I have been an author on various funded reviews
• I have been involved with development of rapid review methodology for the World Health Organization
![Page 4: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/4.jpg)
• What’s your academic background?
• What is your past exposure to
Knowledge Synthesis
(courses, work experience) ?
• What’s your expectations from this
workshop?
Ice Breaker! You tell us…
![Page 5: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/5.jpg)
GoalsAt the end of the workshop, you should have a better
idea about:
– What is Knowledge Synthesis
– Why we prefer to be ‘systematic’ in reviewing the evidence
– Different types and approaches to ‘systematically’ review the
evidence
– Analysis: when, why, and how
– Different ways of presenting the resulting information to
multiple audiences, including key stake-holders, policy-
makers, and the public
– Some of the major challenges in conducting knowledge
synthesis activities
![Page 6: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/6.jpg)
Archie CochraneIn 1979 stated that “it is surely a great criticism of
our profession that we have not
1) organised a critical summary,
2) by specialty or subspecialty,
3) adapted periodically, of all
relevant randomised
controlled trials”
![Page 7: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/7.jpg)
Evidence informed
decision making
![Page 8: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/8.jpg)
• Primary research is often false and/ or biased
Why Should We Care?
![Page 9: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/9.jpg)
![Page 10: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/10.jpg)
• Primary research is often false and/ or biased
• Evidence reviews are highly publishable (even with
negative findings)
Why Should We Care?
![Page 11: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/11.jpg)
0
5000
10000
15000
20000
19801983
19861989
19921995
1998
2001
2004
2007
2010
2013
Publications per year
Knowldege Synthesis Publications
Randomized Controlled Trials
![Page 12: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/12.jpg)
![Page 13: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/13.jpg)
0
50
100
150
200
250
300
1990 1992 1994 1996 1998 2000 2002 2004 2006 2008 2010 2012 2014
KS Publications (1990 – 2014)
![Page 14: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/14.jpg)
• Primary research is often false and/ or biased
• Evidence reviews are highly publishable (even with
negative findings)
• Governments/ funding agencies understand the need for
these types of reviews and are willing to fund them
• Many grants will not be accepted without a systematic
search showing the need for more primary research
Why Should We Care?
![Page 15: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/15.jpg)
Iden
tifyi
ngkn
owle
dge
gaps
Red
un
da
nt
an
d u
net
hic
al
![Page 16: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/16.jpg)
What’s Your Question?
![Page 17: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/17.jpg)
Population
or problem
Intervention
Comparison
Outcome
• How would you describe the population you are interested
in studying?
• What characteristics are important (e.g. age, gender, social
attributes, etc.)
What intervention or policies (e.g. education, crime
prevention, etc.) are you interested in?
What alternative or different options do you want to
compare against (e.g. status quo)?
• What outcome(s) are you interested in?
• How do you measure success?
• How do you measure failure?
• How detrimental outcomes can occur?
![Page 18: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/18.jpg)
Activity #1
* What is your PICO?
![Page 19: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/19.jpg)
What is Knowledge Synthesis?
![Page 20: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/20.jpg)
“The contextualization and integration of research findings of individual research
studies within the larger body of knowledge on the topic.”
“A synthesis must be reproducible and transparent in its methods, using
quantitative and/ or qualitative methods.”
What is Knowledge Synthesis?
Canadian Institutes of Health Research
![Page 21: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/21.jpg)
• Systematic review
• Realist syntheses
• Narrative syntheses
• Meta-analyses
• Meta-syntheses
• Practice guidelines
• Consensus conference or expert panel
Example of Knowledge Synthesis
![Page 22: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/22.jpg)
What is a Literature Review?
![Page 23: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/23.jpg)
‘an overview of research on a given topic and answers to related research questions’
What is a Literature Review?
![Page 24: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/24.jpg)
• Key characteristics:– Organizes the literature
(make sense of it all… connect the dots)
– Evaluates the literature (high quality to low quality)
– Identifies patterns and trends in the literature
– Synthesises the literature(high quality to low quality)
• But it’s not:– Annotated Bibliography
– One-stop shop for everything related to a topic
– Book review
What is a Literature Review
![Page 25: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/25.jpg)
What is a Systematic Review?
![Page 26: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/26.jpg)
‘an attempt to gather all empirical evidence that fits pre-specified eligibility criteria in order to answer a specific research or clinical question through a reproducible, transparent process’
What is a Systematic Review?
![Page 27: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/27.jpg)
• Reduce bias – by gathering ‘all’ evidence
• Transparent
• Replicable
• Resolves controversy between conflicting studies
• Identifies gaps in current research
• Can be basis of cost-effectiveness analyses and knowledge translation projects
• Provides a reliable basis for decision making
Advantages
![Page 28: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/28.jpg)
Feature Literature Review Systematic Review
Clinical Question Broad Focused
Search strategy/ sources of information Not usually specified
Comprehensive/ explicit search strategy
Selection criteria Criterion-based selection; uniformly applied
Quality assessment
Rigorous critical appraisal
Synthesis Qualitative summary Quantitative summary (usually)
Conclusions Based on a sample of the evidence
Based on all available evidence
Grading Sometimes performed Strength of Evidence is Graded
Systematic vs. Literature Review
![Page 29: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/29.jpg)
• Intervention Review (most common)
– Evidence about the effects of a healthcare intervention
Common Types of Reviews
![Page 30: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/30.jpg)
Inte
rven
tion
Revi
ew
![Page 31: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/31.jpg)
• Intervention Review (most common)
– Evidence about the effects of a healthcare intervention
• Diagnostic Accuracy Review
– Evidence around diagnostic accuracy of different screening tests
Common Types of Reviews
![Page 32: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/32.jpg)
Dia
gnos
tic A
ccur
acy
Revi
ew
![Page 33: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/33.jpg)
• Intervention Review (most common)
– Evidence about the effects of a healthcare intervention
• Diagnostic Accuracy Review
– Evidence around diagnostic accuracy of different screening tests
• Prognostic Review
– Evidence of models or predictors of patient outcomes
Common Types of Reviews
![Page 34: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/34.jpg)
Prog
nost
ic R
evie
w
![Page 35: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/35.jpg)
• Overviews of reviews
– Evidence from already published systematic reviews for a given
topic or disciplinary area
Other Types of Systematic Reviews
![Page 36: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/36.jpg)
Ove
rvie
w o
f Rev
iew
s
![Page 37: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/37.jpg)
• Overviews of reviews
– Evidence from already published systematic reviews for a given
topic or disciplinary area
• Scoping reviews
– Map out previous primary research and systematic reviews for a
given topic or disciplinary area
• Rapid reviews
– Rapidly assess (usually <6 weeks) the evidence about the
effects of a healthcare intervention
Other Types of Systematic Reviews
![Page 38: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/38.jpg)
• Realist reviews
– Deal with complex ‘system’ issues and attempt to provide
explanation rather than judgment (e.g. answer questions like
‘how’, ‘why’, and for ‘whom’)
• Provincial reviews
– Provides overview on what is happening in other jurisdictions/
regions/ states/ provinces/ countries (e.g. answer questions like
‘what are others doing’)
Other Types of Systematic Reviews
![Page 39: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/39.jpg)
Prov
inci
al R
evie
ws
![Page 40: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/40.jpg)
Learning from success
![Page 41: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/41.jpg)
Questions
![Page 42: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/42.jpg)
Activity #2
* What was their question?* Was the chosen review type the
best suited to answer this question?
![Page 43: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/43.jpg)
Activity #3
* What is your question?* What review type is best suited
to answer this question?
![Page 44: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/44.jpg)
Main steps involved in the conduct of a ‘traditional’ systematic review
![Page 45: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/45.jpg)
Pai et al.
Natl Med J India.
2004;17(2):86-95
![Page 46: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/46.jpg)
Baseline
Literature Search
Citation Screening
Full-text Screening
Quality Assessment
Data Extraction
Data Analysis
GRADEingthe Evidence
Presentation of Results
![Page 47: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/47.jpg)
Team
Core team:
Project coordinator
Content expert(s)
Methodologist(s)
Trial search coordinator(s)
Analyst(s)
Researcher assistant(s)
Supportive team:
Medical editor(s)
Business manager
Secretary
Database manager/ IT support
![Page 48: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/48.jpg)
Budget
Project phase Project member Hourly cost No. of hours Total
Protocol preparation/ registration All team members 2 – 5 days $3,000 – $9,000
Literature search Librarian $200 2 – 5 days $3,200 – $8,000
Screening 5,000 – 10,000 titles/
abstracts2 Research assistants $200 5 – 10 days $8,000 – $16,000
Screening 75 – 100 full-text reports 2 Research assistants $200 3 – 5 days $4,800 – $8,000
Data extraction/ quality assessment
for 20 – 40 full-text reports2 Research assistants $200 8 – 16 days $12,800 – $25,600
Data analysis Statistician $200 3 – 5 days $4,800 – $8,000
Preliminary presentation of results/
discussion with team members &
content experts
All team members $1000 $1000
Report preparationMedical writer $100 5 – 10 days $4,000 – $8,000
Review manager $200 5 – 10 days $8,000 – $16,000
$50,000 – $100,000+
![Page 49: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/49.jpg)
Timeline
TASKS
14-N
ov
15-N
ov
16-N
ov
17-N
ov
18-N
ov
19-N
ov
20-N
ov
21-N
ov
22-N
ov
23-N
ov
24-N
ov
25-N
ov
26-N
ov
27-N
ov
28-N
ov
29-N
ov
30-N
ov
01-D
ec
02-D
ec
03-D
ec
04-D
ec
05-D
ec
06-D
ec
07-D
ec
08-D
ec
09-D
ec
10-D
ec
11-D
ec
12-D
ec
13-D
ec
14-D
ec
15-D
ec
16-D
ec
17-D
ec
18-D
ec
19-D
ec
20-D
ec
21-D
ec
22-D
ec
23-D
ec
24-D
ec
25-D
ec
26-D
ec
27-D
ec
28-D
ec
29-D
ec
30-D
ec
31-D
ec
01-J
an
02-J
an
03-J
an
04-J
an
05-J
an
06-J
an
07-J
an
08-J
an
09-J
an
10-J
an
11-J
an
12-J
an
13-J
an
14-J
an
15-J
an
16-J
an
17-J
an
18-J
an
19-J
an
20-J
an
21-J
an
22-J
an
23-J
an
24-J
an
25-J
an
26-J
an
27-J
an
28-J
an
T F S S M T W T F S S M T W T F S S M T W T F S S M T W T F S S M T W T F S S M T W T F S S M T W T F S S M T W T F S S M T W T F S S M T W T F S S M T
Protocol1 1 1 1 1 1 1
Literature search/ snowballing1 1 1 1 1 1 1 1 1 1 1 1 1 1
Level I Screening1 1 1 1 1 1 1
Level II Screening1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Data extraction/ quality assessment1 1 1 1 1 1 1
Preliminary presentation of results1 1 1 1 1 1 1
Report preparation1 1 1 1 1 1 1 1 1 1 1 1 1 1
Considerations:
If we started today…. Probably finish sometime in Dec 2015 (earliest)
Holidays, sick days, other projects interfere with timeline
Delays happen… need to add a ‘cushion’ to timeline
Realistic end date… Mar 2016
Some reviews can last up to 2 years or longer
![Page 50: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/50.jpg)
What if the decision can’t wait…
1 day
1 week
1 month
![Page 51: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/51.jpg)
![Page 52: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/52.jpg)
Barriers• Time:
– Full review: 6 to 8 months
– Rapid review: 4 to 6 weeks
– Other review types: variable
• Cost:
– Full review: $25,000 to over $500,000
– Rapid review: $5,000 to $25,000
– Other review types: variable
![Page 53: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/53.jpg)
• Empty reviews: no studies/ evidence available
• Negative findings: no conclusive results
• Biased results: Studies are often poor quality or at
unclear to high risk of bias
• Limited answer to complex questions: results limited to
specific clinical question
• Results not directly linked to practice change
Limitations
![Page 54: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/54.jpg)
Questions
![Page 55: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/55.jpg)
Activity #4
* What is your timeline?* What is your budget?
* What are your barriers?
![Page 56: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/56.jpg)
Theoretical case study
• A friend’s grandmother fell and broke her hip
• She is fine but had to have immediate surgery
• When you visit her in the hospital, she is drowsy, confused and
seems to be in some pain
• The nurse tells you that this is ‘normal’ for her age… but you are not
convinced
• So… you (after whipping out your smartphone) decide to search for
information on managing pain in hip fracture patients
![Page 57: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/57.jpg)
Theoretical case studyQuestions we need to answer…----------------------------------------------------------------------------------------------------------------------------------------------------
What’s the question (again)???
What are we looking for???
Where should we search???
Can we ‘trust’ what is being said???
What if we find lots of ‘reports’???
What if these ‘reports’ are conflicting???
How do we ‘tell’ others what we found???
![Page 58: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/58.jpg)
What’s the question (again)???
![Page 59: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/59.jpg)
• The question will determine the inclusion and exclusion
criteria (PICOTS format):
– Population of interest
– Interventions and Comparators
– Outcomes of interest
What’s the question (again)???
![Page 60: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/60.jpg)
• The question will determine the inclusion and exclusion
criteria (PICOTS format):
– Population of interest
– Interventions and Comparators
– Outcomes of interest
– Timing (duration)
– Appropriate Settings
– Appropriate Study designs
What’s the question (again)???
![Page 61: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/61.jpg)
What’s the question (again)???
• Poorly formulated question:
What drugs best manage pain?
• Well formulated question:
In older adults (≥50 years) admitted to the
hospital following acute hip fracture, what is
the effectiveness of pharmacologic and/ or
non-pharmacologic pain management
interventions for controlling acute (up to 30
days post-fracture) and chronic pain (up to
1 year post-fracture) compared with usual
care or other interventions in all settings?
![Page 62: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/62.jpg)
What are we looking for???
![Page 63: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/63.jpg)
• Inclusion/ Exclusion criteria
– Must be defined a priori
– Allows inclusion/ exclusion of studies based on objective criteria
Inclusion criteria Exclusion criteria
Study design Randomized controlled trials, nonrandomized controlled trials (e.g. quasi-randomized trials), cohort studies (prospective or retrospective), case-control studies
Observational study designs with no comparison group (case reports, case series, cross-sectional studies)
Participants Older adults (≥50 years old) of either sex admitted to hospital with acute hip fracture due to low energy trauma
Majority (>80%) of participants <50 years; acute hip fractures due to high energy trauma
Interventions Pharmacological and/or nonpharmacological pain management monotherapy or combination therapy, regardless of mode of administration or time point during the care pathway
Interventions directly related to surgical/nonsurgical treatment of the hip fracture and not a pain management intervention
Comparator Usual care (as defined by study authors) or another intervention(s) for pain management, administered as monotherapy or combination therapy
Initial care for patients is substantially different than the current practices in North America (e.g., based on time to discharge from acute care to subacute care)
Outcomes Primary: Acute and chronic painSecondary: Mortality, functional status, pain med. UseAdverse events: mental status, quality of life, length of stay
None of the aforementioned outcomes were available from the trial report or through communication with the study’s corresponding author
Timing From time of trauma leading to acute hip fracture and thereafter
Setting All settings
What are we looking for???
![Page 64: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/64.jpg)
Where should we search???
![Page 65: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/65.jpg)
Where should we search???
• Common general medical citation
databases:
– Medline
– PubMed
– Embase
– Scopus
– Web of Knowledge
• Specialty citations also available:
– CINAHL: nursing literature
– PsycInfo: psychology and psychiatry literature
– LILACS: Spanish and Portuguese literature
![Page 66: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/66.jpg)
Database Overlap
Gavel Y, Iselid L. Web of Science and Scopus: A journal title overlap study. Online Information Review. 2008;32(1):8-21.
![Page 67: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/67.jpg)
Sources for pre-synthesized evidence• Cochrane Library http://www.thecochranelibrary.com
• AHRQ (Agency for Healthcare Research & Quality)
http://www.ahrq.gov
• Centre for Reviews and Dissemination
http://www.york.ac.uk/inst/crd/
DARE - Database of Abstracts and reviews of Effects
NHS EED – NHS Economic Evaluation Database
HTA – Heath Technology Assessment Database
• Trip database http://www.tripdatabase.com
• MEDLINE/EMBASE
Use appropriate filters or MeSH/EMTREE headings
• Up-to-date
• SR review protocol registries: PROSPERO &
Cochrane
![Page 68: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/68.jpg)
Can we ‘trust’ what is being said???
![Page 69: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/69.jpg)
JAMA 1999;281:275-7
![Page 70: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/70.jpg)
![Page 71: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/71.jpg)
• Quality assessment:
systematic review validity = validity of primary studies
– Quality of included studies need to be assessed
– Common tools include:
• Cochrane Risk of bias tool (randomized trials)
• New-Castle – Ottawa Scale (cohorts/ case controls)
• AMSTAR tool (Systematic reviews)
Can we ‘trust’ what is being said???
![Page 72: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/72.jpg)
• Quality assessment:
– Randomized trials are considered to be more rigorous than
observational studies
– Systematic reviews based on well-designed trials will likely be
more valid and accurate
Can we ‘trust’ what is being said???
![Page 73: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/73.jpg)
What if we find lots of ‘reports’???
![Page 74: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/74.jpg)
What if we find lots of ‘reports’???
• Meta-analysis:
– Combining data from different trials to get a
summary effect estimate
– Assumes clinical homogeneity between
individual trial PICOTS
– Assumes a ‘reasonable’ amount of statistical
homogeneity between individual trials
![Page 75: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/75.jpg)
Forest Plot
![Page 76: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/76.jpg)
What if we find conflicting ‘reports’???
![Page 77: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/77.jpg)
What if we find conflicting ‘reports’???
![Page 78: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/78.jpg)
How do you present the results???
![Page 79: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/79.jpg)
Online video (Reuters Health)
Medical Publication
Clinical guide
Patient guide (English)
U.S. Government Report
Patient guide (Spanish)
![Page 80: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/80.jpg)
Online video (Reuters Health)
![Page 81: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/81.jpg)
Questions
![Page 82: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/82.jpg)
Where can I search for evidence
![Page 83: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/83.jpg)
Thank You
![Page 84: KNOWLEDGE SYNTHESIS - University of Manitoba€¦ · KNOWLEDGE SYNTHESIS: Literature Searches and Beyond Ahmed M. Abou-Setta, MD, PhD Department of Community Health Sciences & George](https://reader033.vdocument.in/reader033/viewer/2022050608/5fafbb203ed0bf775e016d1c/html5/thumbnails/84.jpg)