ata 2007 dmj presentation v2.ppt [read-only]

38
Modeling of content-based image retrieval tools for dermatopathology applications Diamond Software Diamond Software

Upload: others

Post on 15-Jan-2022

3 views

Category:

Documents


0 download

TRANSCRIPT

Modeling of content-based image retrieval tools for dermatopathology applications

Diamond SoftwareDiamond Software

ATA 2007 FY 05 IMITS Telepathology Project

The TeamThe Team

• Drazen M. Jukic, UPMC

• Simon King, Carnegie Mellon University

• Casey Helfrich, • Anu Melville• Adil Wali• Rahul Sukthankar• Mahadev Satyanayaranan

ATA 2007 FY 05 IMITS Telepathology Project

What is WSI (whole slide imaging)?What is WSI (whole slide imaging)?

• Relatively novel technology (depends on whom you ask).• Virtual Slide

• Utilizes robotic scanning of glass microscopic slide (GMS).

• Creates an image of the entire GMS.

• Slides can be handled either manually (one by one) or automatically (autoloader).

ATA 2007 FY 05 IMITS Telepathology Project

ATA 2007 FY 05 IMITS Telepathology Project

Why Virtual Slides?Why Virtual Slides?

“Drazen (Dr. Jukic) is working in informatics, he will make all our work and diagnostics go to India” – actual quote

• I have heard similar statements multiple times

• Answer is simple … NO!

ATA 2007 FY 05 IMITS Telepathology Project

Now you have a Now you have a Virtual Slide!Virtual Slide!

• One has all of these images –how is this better than old-fashioned kodachromes?

• How do you find images in a jumble on your hard drive?

• Oooh – where is Quincy when you need him?

ATA 2007 FY 05 IMITS Telepathology Project

• How do you “Google” an image?

• There’s no how if images are not annotated.

• Diamondhelps here.

Now you have a Now you have a Virtual Slide!Virtual Slide!

ATA 2007 FY 05 IMITS Telepathology Project

““OpenOpen”” DiamondDiamond

• Jointly developed by Carnegie Mellon University and Intel Research Labs.

• In Dermatopathology - Allows for efficient, rapid feature-specific searching of large image set helping to create knowledge out of image features "locked away" in digital imaging archives.

• Diamond's storage architecture is equipped for "early discard."

ATA 2007 FY 05 IMITS Telepathology Project

Early DiscardEarly Discard

ATA 2007 FY 05 IMITS Telepathology Project

Discard?Discard?

• How many of you read beyond page 2 or 3 of Google results?

• Goal is to develop an application that will:• Enable non-experts to be more effective in

diagnosing particular disease.• Enable the creation of novel, more efficient

diagnostic procedures incorporating vision technology.

• Two arms – Radiology and Pathology.

ATA 2007 FY 05 IMITS Telepathology Project

PathFindPathFind DemoDemo

ATA 2007 FY 05 IMITS Telepathology Project

PathFindPathFind DemoDemo

ATA 2007 FY 05 IMITS Telepathology Project

Application DesignApplication Design

• How do you get an ideal application?• Interview numerous pathologists. • Enlist participants who are informatics savvy and hostile.

• Who (what) is a Pathologist?• Somebody pushing little pieces of glass, incredibly fast,

across a black square while observing color variations.• The faster your hand and eyes, the better your TAT.

• Speed is based on the motoric and ocular skill of the individual, as well as ability to maintain concentration.

• Somebody who wants to be left alone.

ATA 2007 FY 05 IMITS Telepathology Project

View Search Compare Diagnose

PathFindPathFind -- VIEWVIEW

Currently Currently Slow, non-intuitive interfaces taking 5-10 x longer than a microscope.

With With PathFindPathFindSlide rotation to simulate true slide “driving”.

Why is it better?Why is it better?PathFind interaction is closer to native microscope interaction.

Lowers learning curve, increasing user adoption.Increases interaction speed, enhancing efficiency.

ATA 2007 FY 05 IMITS Telepathology Project

PathFindPathFind -- SEARCHSEARCH

Currently Currently Trial and error searching through atlases, textbooks, and journals.

With With OnPath ????????OnPath ????????Highlight area of image and click “search.”

Why is it better?Why is it better?Digital workflow.Faster results.Larger data set.Multiple similar items for better decision making.

View Search Compare Diagnose

ATA 2007 FY 05 IMITS Telepathology Project

PathFindPathFind -- COMPARECOMPARE

View Search Compare Diagnose

Currently Currently Compare static journal or atlas image to the screen via memory.

With With PathFindPathFindSide-by-side virtual slide and synced manipulation with lock-in feature.

Why is it better?Why is it better?Side-by-side view enables more direct comparison.Image manipulation for more detailed comparison. Direct access to referring experts/pathologists.

ATA 2007 FY 05 IMITS Telepathology Project

PathFindPathFind -- DIAGNOSEDIAGNOSE

View Search Compare Diagnose

Currently Currently Diagnosis is made based on features of the image.

With With PathFindPathFindDiagnosis substantiated with references to similar cases.

Why is it better?Why is it better?Decision making process is recorded.Higher accuracy because of explicit comparison to all case information.Stronger legal defense, decreasing malpractice costs.

ATA 2007 FY 05 IMITS Telepathology Project

View

ATA 2007 FY 05 IMITS Telepathology Project

ATA 2007 FY 05 IMITS Telepathology Project

ATA 2007 FY 05 IMITS Telepathology Project

Search

ATA 2007 FY 05 IMITS Telepathology Project

ATA 2007 FY 05 IMITS Telepathology Project

ATA 2007 FY 05 IMITS Telepathology Project

ATA 2007 FY 05 IMITS Telepathology Project

ATA 2007 FY 05 IMITS Telepathology Project

Compare

ATA 2007 FY 05 IMITS Telepathology Project

ATA 2007 FY 05 IMITS Telepathology Project

ATA 2007 FY 05 IMITS Telepathology Project

ATA 2007 FY 05 IMITS Telepathology Project

ATA 2007 FY 05 IMITS Telepathology Project

ATA 2007 FY 05 IMITS Telepathology Project

Diagnose

ATA 2007 FY 05 IMITS Telepathology Project

ATA 2007 FY 05 IMITS Telepathology Project

ATA 2007 FY 05 IMITS Telepathology Project

Why Diamond?Why Diamond?

ATA 2007 FY 05 IMITS Telepathology Project

Virtual Slide SegueVirtual Slide Segue

• Virtual slides promise to deliver a new level of care in digital pathology.

• Important to outline that today, an application is defined by ease of use and speed of acceptance.

• If we do not deliver an improvement over the microscope, the technology will not be adopted.

ATA 2007 FY 05 IMITS Telepathology Project

Parting Thoughts

• Digital Pathology has to deliver improvements over the current glass-based pathology;

• What is a pathologist?

• Somebody who pushes little pieces of glass incredibly fast across a black square while looking at the color variations;

• Faster you hand and eyes are, better TAT you have;

• The speed is based on the motoric and ocular skill of the individual, as well as ability to maintain focused concentration.

• Somebody who mostly wants to be left alone.

ATA 2007 FY 05 IMITS Telepathology Project

Parting Thoughts

• Our current studies:• Revealed that speed of “digital glass pushing’

is very important;• Network speed extremely important;

• Microscopes vs. Robots• If additional features are not incorporated,

VS has long wait to be implemented;• I would invite additional “features” for

incorporation