cochrane learning live webinar: may 7th · 2020: introduction to rob2 ... outcome measure e.g. beck...
TRANSCRIPT
![Page 1: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/1.jpg)
Trusted evidence.Informed decisions.Better health.
Trusted evidence.Informed decisions.Better health.
Cochrane Learning live webinar: May 7th
2020: Introduction to RoB2
![Page 2: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/2.jpg)
•
•
•
![Page 3: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/3.jpg)
•
•
![Page 4: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/4.jpg)
•
•
•
•
•
![Page 5: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/5.jpg)
•
•
![Page 6: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/6.jpg)
•
•
•
•
•
•
![Page 7: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/7.jpg)
•
•
•
Quality scales should not be used in Cochrane reviews
![Page 8: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/8.jpg)
BMJ 2011; 343: d5928
![Page 9: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/9.jpg)
![Page 10: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/10.jpg)
![Page 11: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/11.jpg)
•
•
•
•
•
•
•
•
![Page 12: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/12.jpg)
•
•
•
•
•
•
•
![Page 13: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/13.jpg)
riskofbias.info
![Page 14: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/14.jpg)
•
•
•
![Page 15: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/15.jpg)
Outcome domain e.g. depression
Outcome measuree.g. Beck depression
inventory
Timepoint e.g. 12 weeks
Outcome data
Measurement in all participants
Result
Analysis to compare groups
RoB 2 this
![Page 16: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/16.jpg)
•
•
•
•
![Page 17: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/17.jpg)
Risk of bias assessment for a specific result
1. Specify result being assessed
5. Judge risk of bias for each domain
2. Specify effect of interest
4. Answer signalling questions
6. Judge overall risk of bias for the result
3. List sources of information used to inform assessment
For each study
For each outcome (each key synthesis in the review)
Integrate judgement(s) into results and conclusions
e.g. stratify meta-analysis by overall risk of bias judgement
For the synthesis
![Page 18: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/18.jpg)
1.02 3.872.20 4.321.38 5.44
![Page 19: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/19.jpg)
•
•
![Page 20: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/20.jpg)
•
•
•
![Page 21: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/21.jpg)
•
•
•
![Page 22: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/22.jpg)
![Page 23: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/23.jpg)
Domain 1 Domain 2 Domain 3 Domain 4 Domain 5 Overall
Low Low Low Low Low Low
Low Some concerns Low Low Some concerns Some concerns
Low Low High Low Low High
High Low Some concerns High High High
Some concerns Some concerns Some concerns Low Some concerns High?
Discretionary override
![Page 24: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/24.jpg)
•
•
•
![Page 25: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/25.jpg)
Randomization
Society Cafe
Little Victories
Cafe
![Page 26: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/26.jpg)
26
Washout period
Period 2
Randomization
Period 1
![Page 27: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/27.jpg)
•
•
•
![Page 28: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/28.jpg)
•
•
![Page 29: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/29.jpg)
![Page 30: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/30.jpg)
•
•
•
![Page 31: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/31.jpg)
![Page 32: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/32.jpg)
32
![Page 33: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/33.jpg)
Additional Domain: Bias arising from the timing of identification and recruitment of participants
Add issues related to carry over and period effects
•
In development!
![Page 34: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/34.jpg)
34
robvis
https://bit.ly/36Bku8L
Online platform (later in 2020)
Excel tool
The recommended way to do RoB 2
assessments at the moment
![Page 35: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/35.jpg)
•
•
•
![Page 36: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/36.jpg)
RoB 2 Implementation
• Pilot
• RevMan Web
Protocol considerations
![Page 37: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/37.jpg)
•
•
•
Author teams
CRGs and editors
Inform implementation
•
•
![Page 38: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/38.jpg)
CRG / Author team join the Pilot
Protocol assessment
Kick off call
Monthly web clinics
Methods Support Unit
CRGMSUAuthorsImplementation teamRevMan Web developers
![Page 39: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/39.jpg)
Editorial comments on RoB 2
CRG Review teams
Methods Support Unit
![Page 40: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/40.jpg)
Pilot
• 18 reviews
• 16 CRGs
Joining the pilot
• 22 reviews
• 8 CRGS
Total
• 40 reviews
• 23 CRGs
![Page 41: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/41.jpg)
RevMan 5 RevMan Web
![Page 42: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/42.jpg)
https://documentation.cochrane.org/revman-kb/assessing-risk-of-bias/how-to-use-risk-of-bias-2-0-rob-2-0-tool-in-revman-web
![Page 43: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/43.jpg)
•
https://bit.ly/2YGGBtY
Author teams CRG teams
•
•
![Page 44: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/44.jpg)
•
•
•
![Page 45: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/45.jpg)
•
•
•
Implications for RoB 2
RoB 2 has implications
![Page 46: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/46.jpg)
Rationale: Implications for which variants of the RoB 2 tool you will use
![Page 47: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/47.jpg)
State RoB 2 will be used and provide a reference to it
State which results will be assessed
State effect of interest
State plans for design variants (cluster-rand., crossover) if needed
Detail assessors (how many? who? independently? consensus?)
List the domains in the tool (these can’t be modified)
List the judgement options : High, Low, Some concerns; overall RoB
Storage and presentation of assessments (inc. consensus decisions)
1
2
3
4
5
6
7
8
Your choice
Usually those in SoF table
![Page 48: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/48.jpg)
a b
c d
Rationale: All methods in Cochrane systematic reviews are pre-specified to minimize bias
•
•
•
•
•
•
•
![Page 49: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/49.jpg)
Cochrane Central Executive Methods Team
More information:
https://methods.cochrane.org/our-team
Methods Support Unit https://bit.ly/2YGGBtY
RevMan Web
Cochrane online RevMan training https://bit.ly/2SFKZWa
RevMan Web team
![Page 50: Cochrane Learning live webinar: May 7th · 2020: Introduction to RoB2 ... Outcome measure e.g. Beck depression inventory Timepoint e.g. 12 weeks Outcome data Measurement in all participants](https://reader034.vdocument.in/reader034/viewer/2022042613/5fa7f5d413b42702e07222b9/html5/thumbnails/50.jpg)
Trusted evidence.Informed decisions.Better health.
Trusted evidence.Informed decisions.Better health.