Searching for Meaning: Radiology Image Retrieval with ARRS GoldMiner®

Searching for Meaning: Radiology Image Retrieval with ARRS GoldMiner®

Charles E. Kahn Jr., MD, MS

Medical College of WisconsinMilwaukee, Wisconsin, USA

goldminer.arrs.org

ARRS

American Roentgen Ray Society

Publisher of AJR

Annual meeting April 26 – May 1, 2009

Google® Imagescirca 2006

goldminer.arrs.org

ARRS GoldMiner®

Image search engine Open access images and articles Built by and for radiologists Powered by a major radiology

organization Available freely to all

goldminer.arrs.org

Overview

ARRS GoldMiner®

How it works Get the most for your search

New features Advanced search Spell check GoldMiner Global

What’s on the horizon

goldminer.arrs.org

Search term

goldminer.arrs.org

Click on the thumbnailto view the full-size original image

Click on the titleto link to the original article

goldminer.arrs.org

Dynamically filter results by age, sex,

and imaging modality

goldminer.arrs.org

ARRS GoldMiner®

Image search engine Radiology images Peer-reviewed journals

Combines search strategies Keywords (text strings) Medical concepts

Filters search results Age, sex, and imaging modality

goldminer.arrs.org

Concept-based Search

Semantic knowledge Lexical variants

“oesophagus” = “esophagus” = “esophageal” Abbreviations

“HCC” = “hepatocellular carcinoma” Synonyms

“renal calculi” = “kidney stones”

Powered by UMLS® Unified Medical Language System

goldminer.arrs.org

Concept-based Search

GoldMiner understands relationships between concepts

For example: “gallstones” is a type of “gallbladder

disease” “osteosarcoma” is a “bone tumor”

goldminer.arrs.org

goldminer.arrs.org

GoldMiner’s Software

Harvester A Web "robot" intelligently crawls journal web

sites to gather figures and their text captions

Indexer Discovers medical concepts in free-text figure

captions Indexes the figures to speed retrieval

Search engine Retrieves images to answer your search query

goldminer.arrs.org

Image Library

7 core journals including AJR, Radiology, and RadioGraphics

250+ peer-reviewed journals Image collection grows weekly

goldminer.arrs.org

Outstanding Performance

Fast retrieval Mean = 0.041 sec

Accurate search results High precision and recall (86%+) Image metadata (~85% accuracy)

Age, sex, imaging modality

goldminer.arrs.org

goldminer.arrs.org

A “How-To” Guide

Keep it simple ! Use a search term that represents

A disease An imaging finding, or An anatomic feature

Filter your search results Limit images by age group, sex, and/or

imaging modality

goldminer.arrs.org

New Features

GoldMiner Spelling corrector Advanced search

Image Gallery GoldMiner Global

10 languages

goldminer.arrs.org

Spelling Correction

goldminer.arrs.org

Advanced Search

Combine up to 3 search queries e.g., “Lung metastases” and “colon

cancer”

Limit to core journals Search by age

Age group (“Child”) or specific range

Sex Imaging modalities

goldminer.arrs.org

Image Gallery

Instantly add images to a web site All it takes is one line of HTML code!

GoldMiner “inlines” relevant images into web pages based on their content

GoldMiner inserts up to four relevant images, based on the page’s title and subject

The caption pops up when your mouse hovers over an image; click on the image to view it at full size

GoldMiner® Image Gallery

at the CHORUS web site

(chorus.rad.mcw.edu)

goldminer.arrs.org

GoldMiner Global

Multi-lingual search engine

10 other languages

Uses MeSH Medical Subject

Headings

Arabic Chinese French German Italian Japanese Korean Portuguese Russian Spanish

Arabic Chinese French German Italian Japanese Korean Portuguese Russian Spanish

العربية日本語

Deutsch

Español Русский中文

Português

Italiano

Français

A customized NLM web interface translates the query term into an English-language MeSH term

The ARRS GoldMiner® serversends a translation request; it uses the English-languagequery term to retrieve images.

Users can search for images using search terms in 10 languages other than English.

Searching in Chinese for “Liver Cancer”

Searching in Chinese for “Liver Cancer”

“ ”肝癌

goldminer.arrs.org

Coming Soon

Premium content ARRS Categorical Courses ARRS Case-based Review

Content-based image retrieval Imaging modality Find similar images

Point-of-care learning Category 1 CME

goldminer.arrs.org

Premium Content

goldminer.arrs.org

Image Modality Classifier

Use visual info to detect modality 95% accuracy

Combine with existing text data

“CT”

goldminer.arrs.org

“Visual Search” for Images

goldminer.arrs.org

Point of care learning “Just-in-time” knowledge

CME credits for clinically directed search

ARRS member benefit

goldminer.arrs.org

Point of Care Learning

Learning LogSearch Results

goldminer.arrs.org

The ARRS GoldMiner® Team

Michael Bruno (Penn State / Hershey)

Susanna Lee (Harvard / MGH) Michael Richardson (U. Washington) Daniel Rubin (Stanford)

thanks to ... ARRS staff

goldminer.arrs.org

56+ CME credits Practical sonography Case-based review Subspecialty tracks

Great value Members $299