accounting for clinical heterogeneity in comparative effectiveness research how can one examine a...
TRANSCRIPT
![Page 1: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/1.jpg)
Accounting for Clinical Heterogeneity in Comparative Effectiveness Research
How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)?
The Example of the BARI trial for CABG vs PTCA
September 28, 2010
Carlos Weiss, MD, MHS
![Page 2: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/2.jpg)
AHRQ DEcIDE Project:
Methods to Study the Heterogeneity of Treatment Effects in Comparative Effectiveness Research
PI: Ravi Varadhan, PhD
Co-I: Jodi Segal, MD, MPH; Cynthia Boyd, MD, MPH; Al Wu, MD, MPH
Consultant: David Kent, MD, MPH
Technical Experts: Curt Furberg, MD, PhD; Bruce Psaty, MD, PhD
Task Order Officer: Parivash Nourjah, PhD
![Page 3: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/3.jpg)
N=1,829
![Page 4: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/4.jpg)
BARI Clinical Question
Population targeted: “Multivessel disease” with severe angina or ischemia
Intervention: PTCA (a form of PCI)
Comparator: CABG
Outcome: 5-yr Mortality
![Page 5: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/5.jpg)
Questions to Audience - Set 1
What are sources of HTE?
How would pre-specification of analyses affect interpretation of results?
![Page 6: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/6.jpg)
BARI Design for HTE
Protocol pre-specified 4 subgroup analyses:• angina severity
![Page 7: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/7.jpg)
BARI Design for HTE
Protocol pre-specified 4 subgroup analyses:• angina severity• left ventricular function• number of diseased vessels• complex lesions
![Page 8: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/8.jpg)
BARI Clinical Question: Sources of HTE in CABG vs PTCA
![Page 9: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/9.jpg)
BARI Clinical Question: Sources of HTE in PTCA v CABG
• Patients– baseline risk– competing risks– risk of treatment harms– treatment responsiveness
>>Ideas drawn from Kravitz, Duan & Braslow, 2004, Milbank Quarterly
![Page 10: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/10.jpg)
BARI Clinical Question: Sources of HTE in PTCA v CABG
• Patients – baseline risk– competing risks– risk of treatment harms– treatment responsiveness
• Treatment• Providers• Environments
![Page 11: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/11.jpg)
PATIENTS
PROVIDERS ENVIRONMENTS
TREATMENT
![Page 12: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/12.jpg)
BARI Results
5-yr Mortality:
Overall, no clinically significant nor statistically significant difference
![Page 13: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/13.jpg)
![Page 14: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/14.jpg)
CABG,+ treated diabetes
PTCA,+ treated diabetes
PTCA ,- treated diabetesCABG,- treated diabetes
![Page 15: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/15.jpg)
Questions to Audience - Set 2
When should one be worried that a subgroup result is an error (Type I or Type II) ?
What can be done to lower error probabilities?
![Page 16: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/16.jpg)
Proposed General Approach to Examining a Trial for HTE
1. HTE hypotheses pre-specified?
2. Design and measurement quality?
3. Modeling pre-specified?
![Page 17: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/17.jpg)
Proposed General Approach to Examining a Trial for HTE
1. HTE hypotheses pre-specified?
2. Design and measurement quality?
3. Modeling pre-specified?
4. If No to 1, 2 or 3:
Validation study available?
![Page 18: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/18.jpg)
Proposed General Approach to Examining a Trial for HTE
1. HTE hypotheses pre-specified?
2. Design and measurement quality?
3. Modeling pre-specified?
4. If No to 1, 2 or 3:
Validation study available?
5.a. If frequentist, test of interaction performed?
6.b. If Bayesian, pre-specified priors and variance acceptable?
![Page 19: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/19.jpg)
![Page 20: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/20.jpg)
Extra Slides
![Page 21: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/21.jpg)
What is Heterogeneity of Treatment Effect?
Non-random variability in the direction or magnitude of a treatment effect
![Page 22: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/22.jpg)
Ris
k if
Tre
ated
, ev
ents
per
100
p-y
5
10
Risk if UnTreated or “Baseline Risk”, events per 100 p-y105
Treatment Effects for 2 Hypothetical Studies: Heterogeneity According to Scale
![Page 23: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/23.jpg)
Ris
k if
Tre
ated
, ev
ents
per
100
p-y
5
10─ Average Absolute Treatment Effect (ARR)
Risk if UnTreated or “Baseline Risk”, events per 100 p-y105
AR
Open circles - HTE absentClosed circles - HTE present
Treatment Effects for 2 Hypothetical Studies: Heterogeneity According to Scale
![Page 24: Accounting for Clinical Heterogeneity in Comparative Effectiveness Research How Can One Examine a Trial for Heterogeneity of Treatment Effect (HTE)? The](https://reader035.vdocument.in/reader035/viewer/2022062716/56649dce5503460f94ac2f36/html5/thumbnails/24.jpg)
Ris
k if
Tre
ated
, ev
ents
per
100
p-y
5
10
Risk if UnTreated or “Baseline Risk”, events per 100 p-y105
- - Average Relative Treatment Effect (RRR)
Δy/Δx = RR
Open circles - HTE presentClosed circles - HTE absent
Treatment Effects for 2 Hypothetical Studies: Heterogeneity According to Scale