the results of automated image analysis workshop at the 10th european congress on telepathology and...
TRANSCRIPT
![Page 1: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/1.jpg)
The Results of Automated Image Analysis Workshop at the
10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy
Arvydas Laurinavičius
Pathology Visions 2010
VILNIUS UNIVERSITY NATIONAL CENTRE
OF PATHOLOGY
![Page 2: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/2.jpg)
Background and Disclaimer
• Pathologist (Renal)• Director, National Center of Pathology, LT• Professor, Vilnius University• EU COST Telepathology Network• EU LLL EUROPALS• MB, IHTSDO (SNOMED CT)• International Member, CAP• User of Aperio and TissueGnostics tools• No competing interests
![Page 3: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/3.jpg)
2010 Vilnius Lithuania2012 Venice Italy
![Page 4: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/4.jpg)
Telepathology - Programhttp://www.telepathology2010.com/31Screen clipping taken: 2010-09-27; 11:14
http://www.telepathology2010.com
![Page 5: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/5.jpg)
The Goal
To provide an overview of automated image analysis tools in terms of their robustness and workflow efficiency in a structured and comparable fashion
![Page 6: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/6.jpg)
Outline
• Why – A Pathologist’s Vision of the Digital
• How – Workshop Design and Results
• What – Ways to Go
![Page 7: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/7.jpg)
>19th 20th 21st century
Evolution of Pathology
DIGITALMOLECULAR
IMUNOHISTOCHEMISTRYMICROSCOPYMACROSCOPY
Spectrum of Technologies
![Page 8: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/8.jpg)
Pathology Lab …
transforms biological information into medical
Biospecimen
Pathology Diagnosis
Patient
Clinical Decision
Spectrum of Technologies
![Page 9: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/9.jpg)
Adding Digital Path-WayTissue collected
Tissue sampled
Tissue processed
Slides produced
Pathologist ”reads” slides
Pathologist interprets images Computer
scans slides
Computer analyzes images
Digital patholo
gy
Competition? Ignorance? Synergy?
MacroscopyMicroscopy
Immunohistochemistry
![Page 10: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/10.jpg)
Questions asked:
• Does this work?• Why is Digital better than Conventional?• Tool or Toy? Long way to go…
More specifically:• Shall I scan everything?• Should scanners be certified for diagnostic use?• Is it legal to make a diagnosis on virtual slides?• Can I work faster on digital images?• Are quantification results reliable?
![Page 11: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/11.jpg)
Innovation versus Routine
Psychology
Technology
Involvement needs awareness
![Page 12: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/12.jpg)
Treat the Tools and Humans equally
Pathologist #1 Pathologist #1
Pathologist #2
perfect
Pathologist #2moderate
Tool #1 Tool #1
Tool #2
perfect
Tool #2perfect
inte
r-ob
serv
er
intra-observer
mod
erate
???
Are different tools in agreement? Are they better than we?
![Page 13: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/13.jpg)
Partitioning the Observer
Tissue collected Tissue sampled Tissue
processed
Slides produced
Pathologist ”reads” slides
Pathologist interprets images
Computer scans slides
Computer analyzes images
1st European Scanner Contest
Automated Image Analysis Workshop
“2 in 1”
“2 in 1”
“Software” “Hardware”
![Page 14: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/14.jpg)
Outline
• Why – A Pathologist’s Vision of the Digital
• How – Workshop Design and Results
• What – Ways to Go Next
![Page 15: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/15.jpg)
Workshop Design
• Keep simple, explore feasibility of a Contest • Estrogen Receptor and HER2 IHC
– Whole slide and TMAs from the Spanish QA Program
• HER2 FISH– Whole slides from the Ntl Ctr Pathol
• Available for scanning >1 month (at the 1st ESC)• Participants presented their workflow and results
at the Workshop• Presentations posted at http://www.telepathology2010.com
![Page 16: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/16.jpg)
Participants
Company Speaker IHC FISH
Aperio Kate Lillard √
Leica/SlidePath Sean Costello √
BioImagene Vikram Mohan √ √
MetaSystems Christian Schunck √*
3DHistech Csaba Hankó √ √
* Used for analysis the FISH slides provided
![Page 17: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/17.jpg)
Workshop Results
Concordance testing of the results was out
of scope, however, some output data
provided by the Participants were
analyzed
![Page 18: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/18.jpg)
Estrogen Receptor, % Pos Nuclei3 outlier cases by A, variable ROI selection?
![Page 19: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/19.jpg)
Estrogen Receptor, Total Nuclei CountedB and C, different size of ROI?
![Page 20: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/20.jpg)
Participant B and C Correlation 0.898 p<.0001
Estrogen Receptor, % Pos NucleiStrong correlation; nonlinearity possible?
![Page 21: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/21.jpg)
Nonlinear regression p<.0001
B
Estrogen Receptor, % Pos NucleiNonlinearity: C outputs higher values (frequent 100%) than B
![Page 22: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/22.jpg)
Estrogen Receptor, % Pos NucleiB tends to output lower values than A and C
Not significant
![Page 23: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/23.jpg)
HER2 IHC Score Agreement between B and C
C 0 1+ 2+ 3+ n/a TotalB0 4 0 0 1 0 5
1+ 4 4 1 0 0 9
2+ 0 0 1 0 0 1
3+ 0 2 2 16 0 20
n/a 1 0 0 0 4 5
Total 9 6 4 17 4 40
Simple Kappa 0.61Weighted Kappa 0.69 Note: different cutoff used by B and C for 3+ (10 vs 30%)
![Page 24: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/24.jpg)
Lessons learned
• Plan thoroughly, involve Participants
• Improve scanning logistics, especially FISH
• Provide gold standard slides, preferably TMAs
• Define sampling
– whole slide, manual annotation, automated ROI
detection
• Harmonize output formats
![Page 25: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/25.jpg)
Outline
• Why – A Pathologist’s Vision of the Digital
• How – Workshop Design and Results
• What – Ways to Go
![Page 26: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/26.jpg)
Ways to Go
• Do nothing
• Do the same
• Do inter-observer (inter-Tool) variability study
• Develop an ongoing QA program
• Disseminate the results
![Page 27: The Results of Automated Image Analysis Workshop at the 10th European Congress on Telepathology and 4th International Congress on Virtual Microscopy Arvydas](https://reader035.vdocument.in/reader035/viewer/2022062802/56649ef25503460f94c03fd7/html5/thumbnails/27.jpg)
Disseminate
D-PathLympics
Digital Pathology League
Scanner Contest
Image Analysis Contest