concept-based image retrieval: the arrs goldminer ® image search engine charles e. kahn jr., md, ms...
TRANSCRIPT
![Page 1: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/1.jpg)
Concept-based Image Retrieval: The ARRS GoldMiner® Image Search Engine
Concept-based Image Retrieval: The ARRS GoldMiner® Image Search Engine
Charles E. Kahn Jr., MD, MS
Medical College of WisconsinMilwaukee, Wisconsin, USA
![Page 2: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/2.jpg)
Disclosure
No commercial interests
American Roentgen Ray Society (ARRS) Executive Council member
(Publications) Consulting stipend
![Page 3: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/3.jpg)
Google® Imagescirca 2006
![Page 4: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/4.jpg)
ARRS GoldMiner®
Image search engine “Open access” images Built by and for radiologists Powered by a major radiology
organization Available freely to all
![Page 5: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/5.jpg)
goldminer.arrs.orggoldminer.arrs.org
![Page 6: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/6.jpg)
Overview
ARRS GoldMiner®
How it works Get the most for your search
New features Advanced search Spell check GoldMiner Global
What’s on the horizon
![Page 7: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/7.jpg)
Search term
![Page 8: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/8.jpg)
Click on the thumbnailto view the full-size original image
Click on the titleto link to the original article
![Page 9: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/9.jpg)
Dynamically filter results by age, sex,
and imaging modality
![Page 10: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/10.jpg)
ARRS GoldMiner®
Image search engine Radiology images Peer-reviewed journals
Combines search strategies Keywords (text strings) Medical concepts
Filters search results Age, sex, and imaging modality
![Page 11: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/11.jpg)
Concept-based Search
Semantic knowledge Lexical variants
“oesophagus” = “esophagus” = “esophageal”
Abbreviations “HCC” = “hepatocellular carcinoma”
Synonyms “renal calculi” = “kidney stones”
Powered by UMLS® Unified Medical Language System
![Page 12: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/12.jpg)
“Searching for Meaning”
GoldMiner understands relationships between concepts
Expands queries using UMLS Metathesaurus concept hierarchy
![Page 13: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/13.jpg)
UMLS Metathesaurus
SNOMED-CT Systematized Nomenclature of Medicine
Foundational Model of Anatomy Medical Subject Headings
MeSH vocabulary Indexes MEDLINE / PubMed
![Page 14: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/14.jpg)
![Page 15: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/15.jpg)
![Page 16: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/16.jpg)
![Page 17: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/17.jpg)
![Page 18: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/18.jpg)
Software
Harvester A Web "robot" intelligently crawls journal web
sites to gather figures and their text captions
Indexer Discovers medical concepts in free-text figure
captions Indexes the figures to speed retrieval
Search engine Retrieves images to answer your search query
![Page 19: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/19.jpg)
Image Library
7 core journals including AJR, Radiology, and RadioGraphics
250+ peer-reviewed journals Image collection grows weekly
![Page 20: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/20.jpg)
Outstanding Performance
Fast retrieval Mean = 0.041 sec
Accurate search results High precision and recall (86%+) Image metadata (~85% accuracy)
Age, sex, imaging modality
![Page 21: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/21.jpg)
![Page 22: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/22.jpg)
A “How-To” Guide
Keep it simple ! Use a search term that represents
A disease An imaging finding, or An anatomic feature
Filter your search results Limit images by age group, sex, and/or
imaging modality
![Page 23: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/23.jpg)
New Features
GoldMiner Spelling corrector Advanced search
Image Gallery GoldMiner Global
10 languages
![Page 24: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/24.jpg)
Spelling Correction
![Page 25: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/25.jpg)
Advanced Search
Combine up to 3 search queries e.g., “Lung metastases” and “colon
cancer”
Limit to core journals Search by age
Age group (“Child”) or specific range
Sex Imaging modalities
![Page 26: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/26.jpg)
![Page 27: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/27.jpg)
![Page 28: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/28.jpg)
Image Gallery
Instantly add images to a web site All it takes is one line of HTML code!
GoldMiner “inlines” relevant images into web pages based on their content
![Page 29: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/29.jpg)
GoldMiner inserts up to four relevant images, based on the page’s title and subject
The caption pops up when your mouse hovers over an image; click on the image to view it at full size
GoldMiner® Image Gallery
at the CHORUS web site
(chorus.rad.mcw.edu)
![Page 30: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/30.jpg)
GoldMiner Global
Multi-lingual search engine
10 other languages
Uses MeSH Medical Subject
Headings
Arabic Chinese French German Italian Japanese Korean Portuguese Russian Spanish
Arabic Chinese French German Italian Japanese Korean Portuguese Russian Spanish
![Page 31: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/31.jpg)
العربية日本語
Deutsch
Español Русский中文
Português
Italiano
Français
A customized NLM web interface translates the query term into an English-language MeSH term
The ARRS GoldMiner® serversends a translation request; it uses the English-languagequery term to retrieve images.
Users can search for images using search terms in 10 languages other than English.
![Page 32: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/32.jpg)
Searching in Chinese for “Liver Cancer”
Searching in Chinese for “Liver Cancer”
“ ”肝癌
![Page 33: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/33.jpg)
![Page 34: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/34.jpg)
In Development
Content-based image retrieval Imaging modality classifier Find similar images
Point-of-care learning Category 1 CME
![Page 35: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/35.jpg)
Image Modality Classifier
Use visual info to detect modality 95% accuracy
Combine with existing text data
“CT”
![Page 36: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/36.jpg)
“Visual Search” for Images
![Page 37: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/37.jpg)
Point of care learning “Just-in-time” knowledge
CME credits for clinically directed search
ARRS member benefit
![Page 38: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/38.jpg)
Point of Care Learning
Learning LogSearch Results
![Page 39: Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin,](https://reader036.vdocument.in/reader036/viewer/2022062718/56649ea75503460f94baadca/html5/thumbnails/39.jpg)
goldminer.arrs.orggoldminer.arrs.org
Any questions?Any questions?Any questions?Any questions?