spectrum bias of studies on diagnostic tests
DESCRIPTION
Presented by Luz Letelier at I Conference on EBCP, Rio 2010TRANSCRIPT
![Page 1: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/1.jpg)
I Congresso Brasileiro de Prática Clínica Baseada em Evidências
Viés de espectro em estudos que avaliam a performance de testes diagnósticos.
Spectrum bias in studies on diagnostic tests
Luz M. Letelier MD; FACPAssociate Professor
Pontificia Universidad Católica de Chile
![Page 2: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/2.jpg)
OBJECTIVES
Analyze how an inappropriate spectrum of disease may bias the results of a study on the performance of a diagnostic test.
Understand spectrum of disease.
![Page 3: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/3.jpg)
Spectrum of disease
• When do we use a diagnostic test?
• What do we expect a test to do, when we apply it?
![Page 4: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/4.jpg)
Likelihood of a disease1) Maria A: 26 year old, feeling “nervous” for 2
months, she’s lost 10 kilos, has tremor, increased sweating and 5 bowel movements/day. On exam: tremor, tachycardia 110/min, goiter, thyroid bruit and lid lag.
2) Maria B: 26 year old, feeling “nervous” for 2 months, feels short episodes of palpitations every day and has insomnia. PA 142/88. Thyroid somewhat enlarge.
3) Maria C: 26 year old woman feeling “nervous” for 2 months, no other symptoms, but tells you she is moving to another country due to her husband’s new job. No remarkable findings on exam.
![Page 5: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/5.jpg)
Diagnostic Process
Diagnostic threshold
Therapy thresholdUncertainty area
0% 100%
![Page 6: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/6.jpg)
Diagnostic process for the likelihood of disease
Diagnostic threshold Therapy threshold
Uncertainty area
Maria B Maria A
Maria A Maria B HyperthyroidismMaria CMaria C
![Page 7: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/7.jpg)
Diagnostic test
• We use a diagnostic test to move the probability of having a condition or not having the condition when there is uncertainty.
![Page 8: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/8.jpg)
Diagnostic test
• Assuming we use a test when we are uncertain regarding the condition status.
• We need the test to discriminate between those who do from those who do not have the condition.
![Page 9: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/9.jpg)
Spectrum of disease
Distribution of people without hyperthyroidism
Distribution of people with hyperthyroidism
![Page 10: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/10.jpg)
How can an inappropriate spectrum of patients influence the results of a study on the performance of a diagnostic test?
![Page 11: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/11.jpg)
Let’s assume we want to validate a new test for morbid obesity:
THE RING SIZE
We prospectively recruit 100 women
Compare “the ring size” (our test) to the Gold Standard: Body Mass Index (BMI).If the ring size is > 10 the test is (+)If the ring size is <10 the test is (-)
![Page 12: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/12.jpg)
BMISuzana Luz
40
THE RING SIZE TEST
Of the 100 women recruited: 70 look like Suzana 30 and look like Luz
![Page 13: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/13.jpg)
CONDITION MORBID OBESITY
SI NO
TESTRING SIZE> 10
(+)
(-)
30 70 100
SuzanaLuz
![Page 14: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/14.jpg)
CONDITION MORBID OBESITY
SI NO
TESTRING SIZE> 10
(+) 30 0 30
(-) 0 70 70
30 70 100
![Page 15: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/15.jpg)
CONDITION MORBID OBESITY
SI NO TESTRING SIZE
(+) 30 0 30
(-) 0 70 7030 70
0 False positive and 0 false negative SENSITIVITY = 100%
SPECIFICITY = 100%PERFECT TEST!!!!
![Page 16: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/16.jpg)
RING SIZE TEST
Now we have a perfect test that correctly identifies all morbid obese patients from all of those who are not. BUT will it perform as good in a sample of women with real uncertainty…….?
![Page 17: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/17.jpg)
TRUE OR FALSE
• The ring test is the perfect test.
• We chose an inappropriate spectrum of patients.
F
V
![Page 18: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/18.jpg)
Studies on diagnostic tests might render biased results when:
An inappropriate spectrum of patients is chosen.
![Page 19: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/19.jpg)
ESPECTRUM OF DISEASE AND TEST RESULTS
D-Dimer
![Page 20: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/20.jpg)
Normal individuals Very sick patients
600400
D-Dimer
![Page 21: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/21.jpg)
D Dimer
Possibly sick Not severe sickness
![Page 22: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/22.jpg)
D-Dimer
Possibly sick Non severe sick
600400
![Page 23: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/23.jpg)
Spectrum of disease
![Page 24: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/24.jpg)
BREAST CANCER DIAGNOSIS
Diagnostic threshold
Therapy threshold
![Page 25: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/25.jpg)
TO REMEMBER
Diagnostic tests should be validated on patients with diagnostic uncertainty.
![Page 26: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/26.jpg)
REMEMBER
• The appropriate spectrum of patients is crucial to reduce bias in a study on the performance of a diagnostic test.
• The appropriate spectrum of patients are those who have diagnostic uncertainty regarding the condition under study.
![Page 27: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/27.jpg)
OBRIGADA
![Page 28: Spectrum bias of studies on diagnostic tests](https://reader034.vdocument.in/reader034/viewer/2022042500/568c46fe1a28ab49168c1502/html5/thumbnails/28.jpg)
Background: Survivin is a member of the family of inhibitor of apoptosis proteins that is overexpressed in several human tumors. Previous studies have found that overexpression of survivin in cancer cells induces an antibody response. Methods: We compared 232 serum samples from colorectal cancer (CRC) patients and 365 samples from healthy volunteers using an in vitro enzyme-linked immunosorbent assay to evaluate the survivin autoantibody response in patients.
Conclusions Our results suggest that analysis of both parameters would assist in screening patients with CRC.
CHEN JS, CHEN KT et al. Combined analysis of survivin autoantibody and carcinoembryonic antigen biomarkers for improved detection of colorectal cancer.Clin Chem Lab Med. 2010 Feb 24.