systematic review meta- · pdf filesystematic review & meta-analysis by: jalal poorolajal,...
TRANSCRIPT
![Page 1: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/1.jpg)
Systematic Review&
Meta-AnalysisBy:
Jalal Poorolajal, MD, MPH, PhD
Department of Epidemiology & Biostatistics
School of Public Health
[email protected] October 2015 1
![Page 6: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/6.jpg)
Review ArticleInterpretation and discussion on research previously
published
An expert's opinion is more valuable
When reading individual articles, readers could miss features that are apparent to an expert clinician-researcher.
Readers benefit from the expert's explanation and assessment of the validity and applicability of individual studies
[email protected] October 2015 6
![Page 7: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/7.jpg)
Systematic Review
A systematic review is
a literature review
focused on a single research question
select and synthesize all high quality research evidence relevant to that question
[email protected] October 2015 7
![Page 8: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/8.jpg)
[email protected] October 2015 8
![Page 9: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/9.jpg)
Key Characteristics of SR
Features that distinguish a systematic review (SR) from a review article
1. Clear objective(s)
2. Pre-defined eligibility criteria
3. Reproducible methodology
4. A systematic search
5. Assessment of risk of bias
6. Synthesis of findings
[email protected] October 2015 9
![Page 10: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/10.jpg)
Systematic Review
Systematic review is often applied in the context of
Biomedical
Healthcare
But it can be applied in all other sciences where data are
collected
published in the [email protected] October 2015 10
![Page 11: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/11.jpg)
Meta-analysisSystematic reviews often, but not always, use
statistical techniques (meta-analysis) to combine results of the eligible studies
Meta-analysis is the statistical procedure for combining data from multiple studies to yield an overall statistic
[email protected] October 2015 11
Systematic Review
Meta-analysis
![Page 12: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/12.jpg)
Types of Meta-analysis
Meta-analysis of interventional studies
Randomized controlled trials
• Estimate of a treatment effect
Meta-analysis of observational studies
Cohort studies
• Measure of an association (RD or RR or HR)
Case-control studies
• Measure of an association (OR)
Cross-sectional studies
• Estimate of a prevalence (P)
[email protected] October 2015 12
![Page 13: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/13.jpg)
Classification of Epidemiologic Studies
Study
Observational
Descriptive
Case report
Case series
Cross-sectional
Analytic
Ecologic
Case-control
Case base
Case-crossover
Nested
Case-cohort
Cohort
Prospective
Retrospective
Interventional
Community Trial
Filed Trial
RCT
Parallel
Crossover
FactorialLaboratory study
Animal study
Systematic Review Meta-analysis
RCT: Randomized Controlled Trial
[email protected] October 2015 13
![Page 14: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/14.jpg)
Cross-Sectional Study
Participants
Exposedwith disease
Exposedwithout disease
Unexposedwith disease
Unexposedwithout disease
• CRF and hypertension• Breast cancer and depression• Cigarette smoking and fail rate
[email protected] October 2015 14
![Page 15: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/15.jpg)
Case-Control Study
Participants
Cases
Exposed Unexposed
Controls
Exposed Unexposed
[email protected] October 2015 15
![Page 16: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/16.jpg)
Cohort Study
Participants
Exposed
Disease No Disease
Unexposed
Disease No Disease
[email protected] October 2015 16
![Page 17: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/17.jpg)
Randomized Controlled Trials
Volunteers
Intervention
ImprovedNot
improved
Comparison
ImprovedNot
improved
[email protected] October 2015 17
![Page 19: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/19.jpg)
Archie Cochrane (1909-1988)Scottish Physician & Epidemiologist
[email protected] October 2015 19
His book: Effectiveness and Efficiency: Random Reflections on Health Services
This book advocated for the use of RCTs to make medicine more effective and efficient
His advocacy of RCTs eventually led to the development of the Cochrane Library database
![Page 21: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/21.jpg)
The Cochrane Collaboration
[email protected] October 2015 21
Non-profit, non-governmental organization
Formation: 1993
Headquarters: Oxford, England
Region served: Worldwide
Over 120 countries
Volunteers: Over 31,000
Over 5,000 published online reviews
Website: www.cochrane.org
![Page 22: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/22.jpg)
[email protected] October 2015 22
The Cochrane Review Groups53 groups worldwide
http://www.cochrane.org/contact/review-groups
![Page 23: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/23.jpg)
The Cochrane Collaboration
[email protected] October 2015 23
Systematically review randomized trials
Prevention
Treatments
Rehabilitation
Cochrane Reviews are published in
The Cochrane Database of Systematic Reviews section of The Cochrane Library
The 2013 impact factor: 5.703
Ranked 10th in the “Medicine, General & Internal” category
![Page 24: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/24.jpg)
![Page 25: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/25.jpg)
![Page 26: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/26.jpg)
![Page 27: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/27.jpg)
![Page 28: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/28.jpg)
![Page 29: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/29.jpg)
![Page 30: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/30.jpg)
![Page 31: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/31.jpg)
![Page 32: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/32.jpg)
![Page 34: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/34.jpg)
Steps in conducting a systematic review
1. Objective
2. Inclusion and exclusion criteria
3. Search methods
4. Study selection
5. Data extraction
6. Assessment of metrological quality
7. Measures of treatment/risk effect
8. Data synthesis
9. Assessment of heterogeneity
10. Assessment of reporting biases
11. Sensitivity analysis
12. Subgroup analysis
[email protected] October 2015 34
![Page 35: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/35.jpg)
Step 1: Objective
The topic should be
Focus of special attention
Enough evidence
Controversial
[email protected] October 2015 35
![Page 36: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/36.jpg)
Step 1: Objective
Primary objective
A precise statement of the primary objective of the review, ideally in a single sentence.
Specific objectives
A series of specific objectives relating to different subgroups.
e.g. age, sex, dose, etc.
[email protected] October 2015 36
![Page 37: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/37.jpg)
Step 1: Objective
StructureTo assess the effects of intervention for health problem
for/in types of people.
Example 1To assess the effect of booster dose vaccination for
preventing hepatitis B infection in previously vaccinated healthy individuals.
Example 2To assess the effect of vitamin D supplementation for
treatment of essential hypertension
Example 3To estimate the prevalence of chronic hepatitis B infection
in Iran
[email protected] October 2015 37
![Page 38: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/38.jpg)
Step 2: Inclusion & Exclusion Criteria
[email protected] October 2015 38
• Population
• Intervention
• Comparison
• Outcome
• Study
PICOS
![Page 39: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/39.jpg)
Step 2: Inclusion & Exclusion Criteria
1. Types of participants
Diagnoses, Age groups, Sex, Settings
Example
We will include those patients with essential hypertension (i.e., diastolic BP equal to or greater than 90 mmHg and/or systolic BP equal to or greater than 140 mmHg).
We will exclude studies whose participants were not screened for ruling out the secondary hypertension.
[email protected] October 2015 39
![Page 40: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/40.jpg)
Step 2: Inclusion & Exclusion Criteria
2. Types of intervention or risk factor
Dose, Interval, Duration
Example
The intervention of interest is administering vitamin D supplementation with or without calcium versus placebo or no treatment to assess reduction in BP.
We will assess vitamin D supplementation, irrespective of drug preparation, dosage, frequency, or duration.
We excluded other types of intervention, including vitamin D supplementation in combination with other vitamins (i.e. multivitamin)
[email protected] October 2015 40
![Page 41: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/41.jpg)
Step 2: Inclusion & Exclusion Criteria
3. Types of comparison or control
Placebo
No intervention
Example
The intervention of interest is administering vitamin D supplementation with or without calcium versus placebo or no treatment to assess reduction in BP.
[email protected] October 2015 41
![Page 42: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/42.jpg)
Step 2: Inclusion & Exclusion Criteria
4. Types of outcome measures
Death, Disease, Recovery
Example
The primary outcome of interest is the reduction in diastolic and/or systolic BP in term of mmHg.
The secondary outcome of interest is proportion with undesirable systemic adverse events developed after vitamin D supplementation including weakness, fatigue, sleepiness, headache, loss of appetite, dry mouth, metallic taste, nausea, vomiting and constipation.
[email protected] October 2015 42
![Page 43: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/43.jpg)
Step 2: Inclusion & Exclusion Criteria
5. Types of studies
RCT, Cohort, Case-control, Cross-sectional
Example We will include RCTs addressing response to vitamin D
supplementation in patients with essential hypertension.
We will include trials, irrespective of randomization method, blinding, period of follow-up, publication status, or language.
We will exclude particular types of randomized studies such as crossover or factorial trials.
[email protected] October 2015 43
![Page 44: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/44.jpg)
Step 3: Search Methods
1. Bibliographic databases
2. Searching other resources
[email protected] October 2015 44
![Page 45: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/45.jpg)
Step 3: Search Methods
1. Electronic searches
Bibliographic databases
• CENTRAL
• MEDLINE
• ISI Web of Knowledge
• Scopus
• EMBASE
Dates and periods of search
Language
Full search strategies for each database
[email protected] October 2015 45
![Page 46: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/46.jpg)
Step 3: Search Methods Example
We will search
Cochrane Central Register of Controlled Trials (The Cochrane Library 2012),
MEDLINE (from January 1950 to December 2012),
Web of Knowledge (from January 1945 to December 2012).
Scopus (from January 1980 to December 2012)
[email protected] October 2015 46
![Page 49: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/49.jpg)
Step 3: Search Methods
Example #1 Vitamin D #2 Ergocalciferol #3 Cholecalciferol #4 Calciferol #5 (#1 OR #2 OR #3 OR #4) #6 Hypertension #7 Hypertensive #8 Blood Pressure #9 (#6 OR #7 OR #8) #10 Randomized Controlled Trial #11 Randomised Controlled Trial #12 Randomized Clinical Trial #13 Randomised Clinical Trial #14 Controlled Clinical Trial #15 Placebo #16 (#10 Or #11 Or #12 Or #13 Or #14 Or #15) #17 Animals #18 (#5 AND #9 AND #16) #19 (#18 NOT #17)
[email protected] October 2015 49
![Page 50: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/50.jpg)
[email protected] October 2015 50
![Page 51: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/51.jpg)
[email protected] October 2015 51
![Page 52: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/52.jpg)
![Page 53: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/53.jpg)
![Page 54: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/54.jpg)
![Page 55: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/55.jpg)
![Page 56: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/56.jpg)
![Page 57: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/57.jpg)
![Page 59: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/59.jpg)
Step 3: Search Methods
2. Searching other resources
Reference lists
Hand searching
Conference proceedings
Authors of the included articles
[email protected] October 2015 59
![Page 60: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/60.jpg)
Step 3: Search Methods
Example
We will scan the reference lists of all included studies and pertinent reviews for additional relevant reports.
We will contact the trials’ authors of included studies for additional unpublished trials.
The following conference databases will be searched for unpublished data: American Society of Hypertension; available form: http://www.ash-us.org
American Heart Association; available from: http://www.ish-world.com
British Hypertension society; available from: http://www.bhsoc.org
Europeant Society of Hypertension; available form: http://www.eshonline.org
International Society of Hypertension; available from: http://www.ish-world.com
[email protected] October 2015 60
![Page 61: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/61.jpg)
[email protected] October 2015 61
![Page 62: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/62.jpg)
Step 4: Study Selection
Examine identified studies
1. Titles and abstracts
2. Full text reports
Studies have to meet pre-specified criteria for inclusion in the review
A single failed eligibility criterion is sufficient for a study to be excluded from a review.
[email protected] October 2015 62
![Page 63: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/63.jpg)
Step 4: Study Selection
Assessment of eligibility of studies should be done by at least two people, ideally independently.
Any disagreements should be resolved either via discussion or by 3rd author.
Classification of the studies
Include
Exclude
Unsure
[email protected] October 2015 63
![Page 64: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/64.jpg)
Step 4: Study Selection
Example
Two authors independently will make the decision on which studies meet the inclusion criteria to objective of this meta-analysis.
The authors will not be blinded to the names of the studies authors, journals, and results.
Any disagreements will resolve through discussion among the authors until consensus is reached.
[email protected] October 2015 64
![Page 65: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/65.jpg)
[email protected] October 2015 65
![Page 66: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/66.jpg)
Step 5: Data extraction
Data collection form
Electronic forms
Paper forms
Extraction of data from study reports should be done by at least two people, ideally independently.
Any disagreements should be resolved either via discussion or by 3rd author.
[email protected] October 2015 66
![Page 67: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/67.jpg)
Step 5: Data extraction
Example
Extraction of data from study reports, will be done by at least two authors independently using the 'Data Collection Form‘.
Any disagreements will be resolved through discussion among the authors until consensus is reached.
In cases of missing data or need for clarification, trial authors will be contacted.
[email protected] October 2015 67
![Page 69: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/69.jpg)
Step 6: Assessment of Methodological Quality
The methodological quality should be assessed by at least two people independently.
Many tools have been proposed for assessing the quality of studies, including:
Scales
• in which various components of quality are scored and combined to give a summary score;
Checklists
• in which specific questions are asked
[email protected] October 2015 69
![Page 70: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/70.jpg)
7023 September 2013 [email protected]
Risk of bias tools for randomized clinical trails
Cochrane
CONSORT Statement (2010)
Consolidated Standards of Reporting Trials
Risks of bias tools for observational studies Newcastle Ottawa Statement (NOS) Manual (2009)
Cohort, case-control
STROBE Statement (2007) Strengthening the Reporting of Observational studies in
Epidemiology Cohort, case-control cross-sectional
Step 6: Assessment of Methodological Quality
![Page 71: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/71.jpg)
7123 September 2013 [email protected]
Risks of bias tools for meta-analysis
PRISMA Statement (2009)
Preferred Reporting Items for Systematic Reviews and Meta-Analyses.
QUOROM Statement (1999)
Improving the Quality of Reports of Meta-analyses of Randomized Controlled Trials
Moose Statement (2000)
Meta-analysis of Observational Studies inEpidemiology
Step 6: Assessment of Methodological Quality
![Page 72: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/72.jpg)
Step 6: Assessment of Methodological Quality
Cochrane criteria for judging risk of bias in RCTs
Sequence generation
Allocation concealment
Blinding of participants and personnel
Incomplete outcome data
Selective outcome reporting
Judgment
Yes
No
[email protected] October 2015 72
![Page 73: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/73.jpg)
7323 September 2013 [email protected]
Example
The risk of bias in included studies will be assessed by two authors independently using therisk of bias tool.
Any disagreements will be resolved through discussion among the authors until consensus is reached.
Step 6: Assessment of Methodological Quality
![Page 76: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/76.jpg)
Step 7: Measures of Treatment/Risk Effect
The effect measures of choice should be stated. Dichotomous data
• Risk Ratio (RR)• Odds Ratio (OR)• Risk Difference (RD)
Continuous data • Mean Difference (MD)• Standardized Mean Difference (SMD)
Count data• Rate Ratio (RR)
Time-to-event data• Hazard Ratio
[email protected] October 2015 76
![Page 77: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/77.jpg)
Step 7: Measures of Treatment/Risk Effect
Example
The effect measure of choice for dichotomous outcome was risk ratio (RR).
The effect measure of choice for continuous outcome was mean difference (MD).
All estimates were reported with 95% confidence interval (CI)
[email protected] October 2015 77
![Page 78: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/78.jpg)
Odds Ratio, Risk Ratio, Rate Ratio, Risk Difference
[email protected] October 2015 78
Event No event Total Person-year
Intervention experimental 80 20 100 425
Control intervention 40 60 100 472
a
c
b
d
n1
n2
py1
py2
![Page 79: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/79.jpg)
Step 8: Data Synthesis
One goal of a meta-analysis will often be to estimate the overall, or combined effect.
If all studies in the analysis were equally precise we could simply compute the mean of the effect sizes.
However, some studies were more precise than others.
Therefore, in meta-analysis, we compute a weighted mean, with more weight given to the studies that carried more information and less weight given to others.
[email protected] October 2015 79
![Page 80: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/80.jpg)
Square: Point estimate
Horizontal line: Confidence interval
Square area: Sample size
Vertical line: No effect
Diamond: Summary measure
If confidence intervals include vertical line, then the difference in the effect of experimental and control groups is not statistically significant at conventional levels.
[email protected] October 2015 80
Step 8: Data Synthesis – Forest Plot
![Page 84: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/84.jpg)
Step 8: Data Synthesis
The choice of meta-analysis method should be stated:
1. Fixed-effect model
2. Random-effects model
[email protected] October 2015 84
![Page 86: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/86.jpg)
Step 8: Data Synthesis
Fixed-effect model
Under the fixed effect model the only source of error in our estimate of the combined effect is the random error (within studies variance).
Therefore, with a large enough sample size, the error will tend toward zero.
[email protected] October 2015 86
![Page 88: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/88.jpg)
Step 8: Data Synthesis
Random-effects model
Under the random effects model there are two levels of sampling and two levels of error and our combined effect depends on both:
1. the number of subjects within studies (within studies variance)
2. the total number of studies (between studies variance)
[email protected] October 2015 88
![Page 89: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/89.jpg)
Step 8: Data Synthesis
Example
Data were analyzed and the results were reported using a fixed effect model with 95% CI when the results of fixed and random effects models are the same.
Otherwise, the random effects models are reported.
[email protected] October 2015 89
![Page 90: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/90.jpg)
Step 9: Assessment of Heterogeneity
1. Chi-squared test
2. I2 statistic
3. Tau-squared statistic (τ2 or Tau2)
4. Galbraith plot (Radial plot)
5. L'Abbe plot
6. Meta-regression
[email protected] October 2015 90
![Page 91: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/91.jpg)
Step 9: Assessment of Heterogeneity
Chi-squared test (χ2 or Chi2)
Chi-squared test has low power in the common situation of a meta-analysis when studies have small sample size or are few in number.
A statistically significant result may indicate a problem with heterogeneity
A non-significant result must not be taken as evidence of no heterogeneity.
This is also why a P value of 0.10, rather than the conventional level of 0.05, is sometimes used to determine statistical significance.
[email protected] October 2015 91
![Page 92: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/92.jpg)
I2 statistic
Cochrane categorization• 0% to 40%: Unimportant• 30% to 60%: Moderate heterogeneity• 50% to 90%: Substantial heterogeneity• 75% to 100%: Considerable heterogeneity
Higgins categorization• 25%: Low heterogeneity• 50%: Moderate heterogeneity• 75%: High heterogeneity
[email protected] October 2015 92
Step 9: Assessment of Heterogeneity
![Page 93: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/93.jpg)
Tau-squared (τ2 or Tau2)between-study variance in a random-effects model
• A: between-studies variance is low, because total variance is low.
• B: Between-studies variance is low, because within-studies variance is high.
• C: between-studies variance is high, because total variance is high and within-studies variance is low.
[email protected] October 2015 93
Step 9: Assessment of Heterogeneity
![Page 94: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/94.jpg)
Example
The statistical heterogeneity was explored using the chi-squared test at the 10% significance level (P<0.10).
The inconsistency across studies results was quantified using I2 statistic.
In addition, the between-study variance was estimated using tau-squared.
[email protected] October 2015 94
Step 9: Assessment of Heterogeneity
![Page 95: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/95.jpg)
Galbraith plot (Radial plot)
Regression line constrained through the origin, with its 95% CI.
• Y axis: θ/se (z statistic)
• X axis: 1/se
• Slope: log OR, RR or HR in a fixed effect model.
• The position of each trial on the horizontal axis indicates its allocated weight (small trials on the left and large trials on the right)
In the absence of heterogeneity we could expect all the points to lie within the confidence bounds.
[email protected] October 2015 95
Step 9: Assessment of Heterogeneity
![Page 97: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/97.jpg)
L'Abbe plot
Plotting the event rate in the treatment group on the vertical axis and in the control group on the horizontal axis.
Visual inspection gives a quick and easy indication of the level of agreement among trials.
Heterogeneity is often assumed to be due to
• either variation in the experimental and control event rates
• or to the small size of trials
[email protected] October 2015 97
Step 9: Assessment of Heterogeneity
![Page 99: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/99.jpg)
Meta-regression is used to explore
sources of heterogeneity
associations between treatment effects and other covariates
[email protected] October 2015 99
Step 9: Assessment of HeterogeneityMeta-Regression
![Page 100: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/100.jpg)
Step 9: Assessment of Heterogeneity
BCG vaccination for preventing tuberculosis
[email protected] October 2015 100
![Page 101: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/101.jpg)
Step 9: Assessment of Heterogeneity
Meta-Analysis & Meta-Regression
[email protected] October 2015 101
_cons -.7451778 .1867262 -3.99 0.002 -1.152019 -.3383363 logor Coef. Std. Err. t P>|t| [95% Conf. Interval] With Knapp-Hartung modification% residual variation due to heterogeneity I-squared_res = 92.65%REML estimate of between-study variance tau2 = .3378Meta-regression Number of obs = 13
Random | 0.474 0.325 0.690 -3.887 0.000Fixed | 0.647 0.595 0.702 -10.319 0.000 13-------+----------------------------------------------------Method | Est Lower Upper z_value p_value studies | Pooled 95% CI Asymptotic No. of
Meta-analysis (exponential form)
Moment-based estimate of between studies variance = 0.366Test for heterogeneity: Q= 163.165 on 12 degrees of freedom (p= 0.000)
Random | -0.747 -1.124 -0.371 -3.887 0.000Fixed | -0.436 -0.519 -0.353 -10.319 0.000 13-------+----------------------------------------------------Method | Est Lower Upper z_value p_value studies | Pooled 95% CI Asymptotic No. of
![Page 102: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/102.jpg)
[email protected] October 2015 102
_cons 6.125588 35.12686 0.17 0.865 -72.14193 84.3931 latitude -.0282374 .0129503 -2.18 0.054 -.0570925 .0006177 year -.0030306 .0178584 -0.17 0.869 -.0428217 .0367605 logor Coef. Std. Err. t P>|t| [95% Conf. Interval] With Knapp-Hartung modification Prob > F = 0.0413Joint test for all covariates Model F(2,10) = 4.46Proportion of between-study variance explained Adj R-squared = 59.82%% residual variation due to heterogeneity I-squared_res = 69.20%REML estimate of between-study variance tau2 = .1357Meta-regression Number of obs = 13
In 1950 and Latitude 50°
Log OR = 6.125588 – (1950×0.0030306) –(50×0.0282374) = -1.1959521
OR = exp(-1.1959521) = 0.30
Step 9: Assessment of Heterogeneity
Meta-Regression
![Page 103: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/103.jpg)
[email protected] October 2015 103
-1.5
-1-.
50
.5
logor
10 20 30 40 50 60Latitude
Step 9: Assessment of Heterogeneity
Meta-Regression Plot
![Page 104: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/104.jpg)
1. Funnel plot
2. Begg adjusted rank correlation
3. Egger regression asymmetry test
4. Trim & Fill
[email protected] October 2015 104
Step 10: Assessment of Reporting Biases
![Page 105: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/105.jpg)
Funnel plot
A funnel plot is a simple scatter plot of the intervention effect estimates against study’s size or precision.
• X axis: the effect estimates
• Y axis: the measure of study size
Effect estimates from small studies scatter more widely at the bottom of the graph, with the spread narrowing among larger studies.
In the absence of bias the plot should resemble a symmetrical (inverted) funnel.
[email protected] October 2015 105
Step 10: Assessment of Reporting Biases
![Page 107: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/107.jpg)
Begg adjusted rank correlation
It is a direct statistical analogue of the funnel plot performing an adjusted rank correlation test based on Kendall's tau (ρ).
P>0.05: no publication bias
P<0.05: publication bias
[email protected] October 2015 107
Step 10: Assessment of Reporting Biases
Pr > |z| = 0.322 (continuity corrected) z = 0.99 (continuity corrected) Pr > |z| = 0.299 z = 1.04 Number of Studies = 15 Std. Dev. of Score = 20.21 adj. Kendall's Score (P-Q) = 21 Begg's Test
![Page 109: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/109.jpg)
Egger regression asymmetry test
This test regresses the standardized effect estimates against their precision.
If intercept deviates significantly from zero and confidence interval about the intercept fails to include zero indicates asymmetry in the funnel plot.
[email protected] October 2015 109
Step 10: Assessment of Reporting Biases
bias 1.114582 .4891211 2.28 0.040 .0579 2.171264 slope -.4823081 .1086472 -4.44 0.001 -.7170261 -.2475902 Std_Eff Coef. Std. Err. t P>|t| [95% Conf. Interval] Egger's test
![Page 111: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/111.jpg)
Metatrim
The method estimates the number and outcomes of missing studies and adjusts the meta-analysis to incorporate the theoretical missing studies.
As an option, metatrim provides a funnel graph of the filled data.
[email protected] October 2015 111
Step 10: Assessment of Reporting Biases
![Page 112: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/112.jpg)
[email protected] October 2015 112
Step 10: Assessment of Reporting BiasesMetatrim
Moment-based estimate of between studies variance = 0.019Test for heterogeneity: Q= 24.949 on 19 degrees of freedom (p= 0.162)
Random | -0.323 -0.454 -0.191 -4.814 0.000Fixed | -0.331 -0.435 -0.226 -6.221 0.000 20-------+----------------------------------------------------Method | Est Lower Upper z_value p_value studies | Pooled 95% CI Asymptotic No. of
Meta-analysis Filled
5 | -0.331 96 5 0 4 | -0.331 96 5 4 3 | -0.307 94 5 8 2 | -0.290 90 4 10 1 | -0.263 85 3 120----------+--------------------------------------iteration | estimate Tn # to trim diff
Meta-analysis type: Random-effects modelTrimming estimator: Linear
Moment-based estimate of between studies variance = 0.000Test for heterogeneity: Q= 13.942 on 14 degrees of freedom (p= 0.454)
Random | -0.263 -0.375 -0.150 -4.581 0.000Fixed | -0.263 -0.375 -0.150 -4.581 0.000 15-------+----------------------------------------------------Method | Est Lower Upper z_value p_value studies | Pooled 95% CI Asymptotic No. of
Meta-analysis
![Page 114: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/114.jpg)
Step 11: Sensitivity Analysis
The potential impact of the missing data on the results should be considered in the interpretation of the results of the review.
Sensitivity analysis for dichotomous outcomes
Best-case scenarios
Worst-case scenarios
[email protected] October 2015 114
![Page 115: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/115.jpg)
Step 11: Sensitivity Analysis
Best-case scenario
All participants with missing outcomes in the experimental group had good outcomes, and all those with missing outcomes in the control group had poor outcomes.
Worst-case scenario
All participants with missing outcomes in the experimental group had poor outcomes, and all those with missing outcomes in the control group good outcomes.
[email protected] October 2015 115
![Page 116: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/116.jpg)
Sensitivity AnalysisGastro-gastrostomy of obese patients to reduce excess weight,
19-47 months after surgery
123(Baseline)
103(Available)
60(Success)
43(Failed)20
(Dropt out)
• Success rate base on:– Available case approach = 60/103 = 58%– Best case scenario = (60+20)/123 = 65%– Worst case scenario = 60/123 = 49%
[email protected] October 2015 116
![Page 117: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/117.jpg)
Example
To handle the dropouts and withdrawals for whom no outcome data were obtained we performed a sensitivity analysis based on consideration of:
• Best scenario: assuming all missing participants did not experience the event or infection
• Worst scenario: assuming all missing participants experienced the event or infection
[email protected] October 2015 117
Step 11: Sensitivity Analysis
![Page 118: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/118.jpg)
Metainf
This method investigates the influence of a single study on the overall meta-analysis estimate.
This command shows the results of an influence analysis, in which the meta-analysis estimates are computed omitting one study in each turn.
[email protected] October 2015 118
Step 11: Sensitivity Analysis
![Page 120: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/120.jpg)
Step 12: Subgroup Analysis
Subgroup analyses may be done often so as to make comparisons between:
subsets of participants (sex, age groups)
types of studies
types of interventions
different geographical locations
Subgroup analyses may be done:
to investigate heterogeneous results
to answer specific questions about particular patient groups
[email protected] October 2015 120
![Page 121: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/121.jpg)
Step 12: Subgroup Analysis
Example
To assess the effect of various variables on cumulative incidence of HBV infection at maximum follow-up, we performed subgroup analysis across different levels of variables.
The variables under investigation included: studies design, types of vaccine, various endemic regions, types of participants, and age groups.
[email protected] October 2015 121
![Page 122: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/122.jpg)
Cumulative Meta-Analysis
Cumulative meta-analysis is defined as the repeated performance of meta-analysis whenever a new relevant trial becomes available for inclusion.
This allows the retrospective identification of the point in time when a treatment effect first reached conventional levels of statistical significance.
[email protected] October 2015 122
![Page 124: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/124.jpg)
Planning New Studies
The meta-regression can help identify
which questions have already been answered and
which remain to be answered
[email protected] October 2015 124
![Page 125: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/125.jpg)
Errors in Meta-Analysis
The estimating summary measure will be misleading when:
1. The results of studies are heterogeneous
χ2 , I2, τ2
2. The designs of studies are different
Cohort, Case-control, Cross-sectional
3. The methods of analysis are not the same
Rate ratio, Risk ratio, Odds ratio
[email protected] October 2015 125
![Page 126: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/126.jpg)
Software
Review Manager 5
Stata
Comprehensive Meta-analysis
Metanalysis
Metawin
[email protected] October 2015 126
![Page 127: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/127.jpg)
Stata CommandsMeta-analysis & Forest Plot
Meta-analysis
meta logor selogor, eform gr(r) cline xline(1) id(id)
metan a b c d, label(namevar=id) random or
Cumulative meta-analysis
metacum logor selogor, label(namevar=id) eform random
[email protected] October 2015 127
![Page 128: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/128.jpg)
I2 statistic
heterogi #Q #df
Galbraith plot
galbr logor selogor
L'Abbe plot
labbe a b c d, null
Meta-regression
metareg logor var1 var2, wsse(selogor)
[email protected] October 2015 128
Stata CommandsHeterogeneity
![Page 129: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/129.jpg)
Funnel plot
funnel logor selogor
metafunnel logor selogor
Begg test & plot
metabias logor selogor, graph(begg) gweight
Egger test & plot
metabias logor selogor, graph(egger) gweight
Trim & Fill
metatrim logor selogor, reffect eform print funnel
[email protected] October 2015 129
Stata CommandsPublication Bias
![Page 130: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/130.jpg)
Metainf
metainf logor selogor, eform random id(id)
[email protected] October 2015 130
Stata CommandsSensitivity Analysis
![Page 131: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/131.jpg)
Simpson Paradox
This confounding effect occurs when the exposure and outcome are strongly associated with a third variable.
In this phenomenon, the third factor reverses the association first observed.
Example
A historical comparison of success rates in removing kidney stones.
[email protected] October 2015 131
![Page 132: Systematic Review Meta- · PDF fileSystematic Review & Meta-Analysis By: Jalal Poorolajal, MD, MPH, PhD Department of Epidemiology & Biostatistics School of Public Health 11 October](https://reader031.vdocument.in/reader031/viewer/2022030405/5a7e77a57f8b9a66798e8416/html5/thumbnails/132.jpg)
Simpson ParadoxNephrolithotomy Successful Unsuccessful Total
Success Rate
RR
Open surgery 273 77 350 78% 0.94
Percutaneous 289 61 350 83%
[email protected] October 2015 132
Stone diameter
Nephrolithotomy Successful Unsuccessful TotalSuccess
RateRR
<2 cmOpen surgery 081 06 087 93% 1.07
Percutaneous 234 36 270 87%
≥2 cmOpen surgery 192 71 263 73% 1.06
Percutaneous 055 25 080 69%
pt (exposure) diameter .7881161 .0783421 -2.40 0.017 .6486002 .9576422 litotomy 1.069106 .1055357 0.68 0.498 .881039 1.297317 result IRR Std. Err. z P>|z| [95% Conf. Interval]
Log likelihood = -682.29806 Pseudo R2 = 0.0045 Prob > chi2 = 0.0448 LR chi2(2) = 6.21Poisson regression Number of obs = 700