![Page 1: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/1.jpg)
How to read an RCT: introduction, workshop, wrap-up
Martin Gallagher
![Page 2: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/2.jpg)
Overview
ChecklistsCONSORT Statement & others
Impt elements to considerRandomisationPoweringBiasSecondary analyses
Exercises Causality and importance Still going on now: ACT and HDF studies
![Page 3: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/3.jpg)
RCT vs non-RCT
Ioannidis, JAMA 2001-45 topics-408 studies (240+168)
![Page 4: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/4.jpg)
Critical appraisal tools
CONSORT GuidelinesConsolidated Standards of Reporting TrialsEndorsed by >50% of core medical journals
• Extensions for different types of trials: Cluster randomised Non-inferiority trials>25 items on checklist
![Page 5: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/5.jpg)
![Page 6: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/6.jpg)
Other appraisal tools
Centre for Evidence Based Medicine (Oxford)2 page documenthttp://www.cebm.net/index.aspx?o=1157
Critical Appraisal Skills Program (CASP) toolPublic Health Resource Unit, NHShttp://www.sph.nhs.uk/sph-files/rct%20appraisal%20tool.pdf
![Page 7: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/7.jpg)
Cochrane risk of bias tool
Were methods for sequence generation reported? Was there adequate allocation concealment? Was there complete outcome data? Was there intention to treat analysis? Was there blinding of participants, investigators, outcomes
assessors, data analysts? Was there selective outcome reporting? Other sources of bias?
• Co-interventions• Commercial
Yes, No, Unclear
![Page 8: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/8.jpg)
Elements of appraisal
1. Did the study ask a clearly focussed question?
2. Was it an RCT and an appropriate design for the question?
3. Were subjects appropriately allocated to int/cont groups?
4. Were subjects/staff/others blinded to allocation?
5. Were all who entered the trail accounted for at the end?
6. Were all subjects followed up and measured the same way?
7. Did the study have enough subjects to minimise the play of chance?
8. How are the results presented and what is the main result?
9. How precise are these results?10. Were all impt outcomes
considered so the results can be applied?
![Page 9: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/9.jpg)
![Page 10: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/10.jpg)
Lack of randomisation concealment
Number of studies
% with significant result
Concealed randomizaton 57 8.8%
Unconcealed randomization 45 24.4%
Non-random assignment [historical or selected controls]
43 58.1%
Chalmers et al. N Engl J Med 1983;309:1358-61
![Page 11: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/11.jpg)
Concealment of allocation
![Page 12: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/12.jpg)
Concealment of allocation
![Page 13: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/13.jpg)
Randomisation
The play of chance Ideally central/independent rather than local
Separate preparation of the agents• Eg: pharmacy, with numbered/coded bottles
Serially numbered, opaque, sealed envelopesBeware: alternation, dates of arrivalNote:
• Permuted blocks• Stratification
Put yourself in the place of the local PI….
![Page 14: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/14.jpg)
Outcome of effective randomisation
Table 1Assurance that the groups were equivalent at baselineAccounts for both measured and (more importantly) unmeasured
confounders
![Page 15: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/15.jpg)
Power
Not a part of all appraisal tools Not many treatments have an effect size (RRR) of >30-
40%A clue to study quality
• Why did they chose it?• What evidence supports such a view?• Is that consistent with my perception of risk in this population?
![Page 16: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/16.jpg)
Bias
Definition:When an estimated measure of frequency or association differs
systematically from the true value.
Random samples will differ from the true population because of random sampling variability
• Bigger the sample, more proximate it is to the underlying pop.
Selection biasConfoundingMeasurement bias
![Page 17: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/17.jpg)
Selection bias
Not usually so much of an issue in RCTs
Except:Through the treatment of missing participants
• Loss to follow up• Other select exclusions (non-compliant, intolerant)
![Page 18: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/18.jpg)
Confounding
A situation in which a measure of the effect of exposure on disease is distorted because of the association of the study factor with other factors that influence the outcome.
Three criteria:An idependent risk factor for the outcome of interestNot an intervening variableUnevenly distributed in study groups
In RCTs should be fixed by adequate randomisationLook to Table 1
![Page 19: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/19.jpg)
Measurement bias
Distortion in the measure of frequency or association due to inaccuracy in measurement
Minimise in RCTs by:Use of placeboKeep measurements ‘blind’ to interventionAvoid differential treatments to the study groups
![Page 20: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/20.jpg)
Blinding
Not always possible Try to blind
ParticipantsCliniciansOutcome assessment
Colorectal surgery example
![Page 21: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/21.jpg)
Secondary analyses
Should not overshadow the primary outcome Greater validity if pre-specified Beware
1/20 chance of statistically significant finding by chance alone• More that are done, more likely to make a ‘significant’ finding
![Page 22: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/22.jpg)
Critical appraisal exercises
![Page 23: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/23.jpg)
Ronco et al: HDF dosing in AKI
![Page 24: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/24.jpg)
Ronco et al: HDF dosing in AKI
Very influential trial, driven the research agenda Heavily cited
Outcome measure?
Single centre, long recruitment time, surgical patient spectrum
Outcomes of subsequent studies?
![Page 25: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/25.jpg)
SAFE Study
![Page 26: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/26.jpg)
SAFE Study
Fundamental question in ICU
Blinding of study treatment?
![Page 27: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/27.jpg)
Tepel: NAC for contrast nephropathy
![Page 28: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/28.jpg)
Tepel: NAC for contrast nephropathy
Very influential and highly cited study
How were they randomised?
Power?
Blinding?Is it impt?
![Page 29: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/29.jpg)
Sulfinpyrazone post MI
![Page 30: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/30.jpg)
Sulfinpyrazone post MI
FDA:We do not believe that either reported outcome can be accepted
for the following reasons:• Assignment of patients often inaccurate and failed to conform to
criteria set forth at the outset• Errors in assignment nearly all favoured the conclusion that
sulfinpyrazone decreased sudden death• Mortality classification system had no clear logic• Reported effect upon overall mortality heavily dependent upon
after-the-fact exclusion from the analysis of certain patients• The exclusions virtually all favoured sulfinpyrazone
![Page 31: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/31.jpg)
SHARP Study
![Page 32: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/32.jpg)
SHARP Study
Change in the primary outcome?
Press release:“During this long trial, the proportion of patients who stopped taking their allocated treatment was about one third, but this was not generally due to side-effects and was the same for both real and dummy treatments. If taken without interruption, however, ezetimibe plus simvastatin could have even larger effects than were seen in SHARP, potentially reducing risk by about one quarter.”
How will/does it change your treatment?
![Page 33: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/33.jpg)
Renal nerve ablation
![Page 34: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/34.jpg)
Renal nerve ablation
Randomisation?Table 1
Blinding?Sham operation?Outcome assessment?
![Page 35: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/35.jpg)
Sevalemer trial
![Page 36: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/36.jpg)
Sevalemer trial
Power?
Blinding?
Bias?
What about patients over 65?
![Page 37: How to read an RCT: introduction, workshop, wrap-up](https://reader035.vdocument.in/reader035/viewer/2022062218/56815f0c550346895dcdcc2c/html5/thumbnails/37.jpg)
But is it still an issue?
ACTNAC trial from South America2308 patients, randomisationBlinding of study treatment?
HDF StudiesCONTRAST & Turkish studiesDesigned to answer one question but conclude:
• “treatment with…HDF does not seem to offer a survival benefit…However, subgroup analysis suggested benefit among patients treatment with high convection volumes on all cause mortality”
• “Composite for death from any cause and non-fatal CV events is not different between post-dilution on-line HDF and high flux HD. HDF treatment with substitution volume over 17.4L provides better CV and overall survival compared to HD”