Medical Image Database Medical Image Database Resource for Software Resource for Software Tools Evaluation and Tools Evaluation and

MIRCMIRC

Laurence P Clarke, PhDLaurence P Clarke, PhDBarbara Croft PhDBarbara Croft PhDCarl Jaffe MDCarl Jaffe MDGary Becker MDGary Becker MDDan Sullivan MDDan Sullivan MDCancer Imaging ProgramCancer Imaging Program

Resource for Benchmarking Resource for Benchmarking Application Application SpecificSpecific Software Performance. Software Performance.

Need to develop a consensus or standards for assessment of Need to develop a consensus or standards for assessment of application specificapplication specific software for cancer imaging. software for cancer imaging.

Software methods and related informatics tools lag behind the Software methods and related informatics tools lag behind the front end imaging technology in terms of their performance front end imaging technology in terms of their performance (MRI,CT, Molecular Imaging..). (MRI,CT, Molecular Imaging..).

Need to engage the national and international community in Need to engage the national and international community in the development and assessment of advanced software tools.the development and assessment of advanced software tools.

Need to explore if this resource could be employed to reduce Need to explore if this resource could be employed to reduce delay or uncertainty in FDA approval.delay or uncertainty in FDA approval.

Need to develop IT resource to establish this database and Need to develop IT resource to establish this database and provide web access to this resource to encourage standards provide web access to this resource to encourage standards for software assessment.for software assessment.

Example Projects: Evaluation of Example Projects: Evaluation of Software Tools as required Lung Software Tools as required Lung

Cancer using X-ray CTCancer using X-ray CT..

Lung Image Database Consortium (LIDC): Lung Image Database Consortium (LIDC): Database to permit the benchmarking of Database to permit the benchmarking of CAD methods for cancer screening.CAD methods for cancer screening.

Lung Database for Drug Response. Lung Database for Drug Response. Database to permit the benchmarking of Database to permit the benchmarking of software metrics such as volumetric software metrics such as volumetric measures of tumor response to drug or measures of tumor response to drug or radiation therapy.radiation therapy.

U01: Lung Image Database Consortium U01: Lung Image Database Consortium (LIDC) (U01: 2001-2006): (LIDC) (U01: 2001-2006):

NCI: ACRIN/NLST (2002-2008: NCI: ACRIN/NLST (2002-2008: $200M/9 years)$200M/9 years) is is supporting a large lung cancer screening trial using supporting a large lung cancer screening trial using helical CT, where subsets of images can be collected.helical CT, where subsets of images can be collected.

LIDC LIDC ($7M/5 years:($7M/5 years: 5 Academic Sites). Goals: 5 Academic Sites). Goals: Develop an image database for the comparison of Develop an image database for the comparison of CAD methods, and encourage standards for CAD methods, and encourage standards for assessment of application-specific software. assessment of application-specific software.

LIDC Steering Committee: Includes academic LIDC Steering Committee: Includes academic members from each site, FDA CDRH scientists and members from each site, FDA CDRH scientists and consultants that are engaged in the developing broad consultants that are engaged in the developing broad understanding of all the issues involved in the understanding of all the issues involved in the development of a public database, as a transparent development of a public database, as a transparent process.process.

Foundation for NIH: Facilitate Foundation for NIH: Facilitate Public Private PartnershipsPublic Private Partnerships

Authorized by Congress in 1991--and established in Authorized by Congress in 1991--and established in 1996-- to support the NIH in its mission through 1996-- to support the NIH in its mission through collaboration with academia, industry, individuals, and collaboration with academia, industry, individuals, and other non-profits.other non-profits.

An independent non-profit, not a government An independent non-profit, not a government organization. organization.

Governed by independent Board of Directors, including Governed by independent Board of Directors, including the Director of NIH and the FDA Commissioner as ex-the Director of NIH and the FDA Commissioner as ex-officio members.officio members.

Partnership ModelPartnership ModelBased on the Osteoarthritis InitiativeBased on the Osteoarthritis Initiative

Steering Commit

teeFDA

FNIH

NIH

Grants or

Contracts

Private Partne

rs

$$ Flow

Information Flow

FNIH-NCI Plans (2005-06): FNIH-NCI Plans (2005-06): Expand the proposed databases as an Expand the proposed databases as an

industry resourceindustry resource Form an overarching steering committee with Form an overarching steering committee with

FNIH, NCI, Academic and Industry FNIH, NCI, Academic and Industry representationrepresentation

Identify specific milestones for early delivery of Identify specific milestones for early delivery of

databases acquired from NCI clinical trails.databases acquired from NCI clinical trails.

• Lung Cancer Screening: Expand the number of sites Lung Cancer Screening: Expand the number of sites for X-ray CT include digital chest X ray (Jan 2005)for X-ray CT include digital chest X ray (Jan 2005)

• Lung Cancer Drug Response: X-ray CT. Expand Pilot Lung Cancer Drug Response: X-ray CT. Expand Pilot Project (Sept 2004): PPP timetable: Summer Fall 2005Project (Sept 2004): PPP timetable: Summer Fall 2005

The Database Resource The Database Resource Research CommunityResearch Community

MIRC sites:MIRC sites:• NCINCI• FDA CDRHFDA CDRH• Cornell UniversityCornell University• MD Anderson Cancer CenterMD Anderson Cancer Center• Memorial Sloan Kettering Cancer CenterMemorial Sloan Kettering Cancer Center• University of California, Los AngelesUniversity of California, Los Angeles• University of ChicagoUniversity of Chicago• University of IowaUniversity of Iowa• University of Michigan…University of Michigan…

• Industry PartnersIndustry Partners

4/4 Markings

2/4 Markings 2/4 Markings

Meta Data: Results of Unblinded Reads: Nodule Location

We will capture one aspect of reader variability in this way

Metadata: Description of NoduleMetadata: Description of Nodule

Focal AbnormalitiesFocal Abnormalities

( )NodulesNodules

• A spectrum of abnormalities?

ScarSpiculated Nodule

Calcified Nodule

Meta Data: Nodule Characteristics Meta Data: Nodule Characteristics Library to Standardize Radiologist Library to Standardize Radiologist

InterpretationInterpretation..

Meta Data: Nodule Boundaries

Example Spiculated Nodule: Comparison of Contours

Meta Data: Probabilistic Description Meta Data: Probabilistic Description of Boundaryof Boundary

RSNA: 2003:LIDC: Fundamental Issues for the Creation of a International Research Resource for the Image Informatics Community.

NCI Current and Future Clinical Trials.NCI Current and Future Clinical Trials.Potential Sources of Data and TimelinePotential Sources of Data and Timeline

Col

onos

copy

col

lect

ion

AC

RIN

Live

r met

s - M

SK

Dig

ital b

reas

t- A

CR

IN

Ultr

asou

nd

MR

I - A

CR

IN

Year 1 Year 2 Year 3

PE

T al

lianc

es

Enh

ance

har

dwar

e an

d so

ftwar

e

infra

stru

ctur

e w

ith N

CIC

B

NTR

OI o

ptic

al d

atab

ase

Dem

onst

ratio

n P

roje

ct:

LID

C

Col

onos

copy

col

lect

ion

AC

RIN

Live

r met

s - M

SK

Col

onos

copy

col

lect

ion

- Nav

y

Dig

ital b

reas

t- A

CR

IN

Ultr

asou

nd

MR

I - A

CR

IN

Enh

ance

har

dwar

e an

d so

ftwar

e

infra

stru

ctur

e w

ith N

CIC

BLu

ng D

rug

Res

pons

e: P

ilot P

roje

ctN

TRO

I opt

ical

dat

abas

e

MolecularSignatures

ClinicalTrials

NCI Core

accessportals

participatinggroup nodes

CancerGenomics

TGI

GAI

CCAP

MouseModels

Meta Data: NCI Informatics Infrastructure Meta Data: NCI Informatics Infrastructure Planned Reference Database Resource to be Fully Planned Reference Database Resource to be Fully

Integrated into caBIG Informatics GRID.Integrated into caBIG Informatics GRID.

•Open source

•Open access

•Open development

•Federated

GRID Principles

GroupNodes:CancerCentersSPORESCGAPMMHCCOthers

Database Database ResourceResource

InternetInternet

NCI and FDA

Users

MIRC sites

PACS

MIRCSite

Work-stations

n

Cornell

MDA

MSK

UCLA

Chicago

Iowa

Mich.

ModalityMIRC

ClinicalTrial

ServiceCTMS

PACS

MIRCStorage

Principal Investigator SiteField Center Sites

(images)

DICOM

(csv data)

HTTP

MIRCClinical

TrialService

MIRCStorage

DIC

OM

HTTP(S)

8080

Database Resource Several Demonstration Projects 2005-06

Required extensions:1. image export in groups2. CSV converter to metadata for NID

Desirable extensions:1. name spaces2. cde viewing / query3. extend author service

8443