shambala - a modern web interface for medical image retrieval · shambala - a modern web interface...

15
Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera Roger Schaer, Henning Müller

Upload: others

Post on 04-Jan-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera

Shambala - A Modern Web

Interface for Medical Image

Retrieval

SGMI2014

Presented by : Alba García Seco de Herrera

Roger Schaer, Henning Müller

Page 2: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera

Motivation

• Image search is a daily task for medical

professionals

• Medical images are abundant

• Clinicians’ schedules are tight

• Intuitive, easy-to-use, efficient retrieval tools

are needed!

2

Page 3: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera

KHRESMOI

• Multilingual, multimodal search and access

system for biomedical information and

documents

• Three target user groups

– General public

– General practitioners

– Radiologists

3

Page 4: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera

Methods

• ParaDISE (Parallel Distributed Image Search

Engine)

– Image retrieval system

• Text & CBIR

– Focused on

• Modularity : independent components

• Expandability : easy to add new features

• Scalability : efficient with very large image collections

4

Page 5: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera

ParaDISE Web Layer

5

Page 6: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera

Datasets

6

ImageCLEF2012

>300’0000 images

PubMed OpenAccess

>1’500’000 images

Page 7: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera

Shambala

• Buddhist concept of ParaDISE :-)

• Based on 3 principles

– Easy

– Interactive

– Modern

7

Page 8: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera

Shambala

1 2

3

4

5

http://shambala.khresmoi.eu

Page 9: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera

Features

• Adaptive results zone

• Image editing

9

Page 10: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera

Features

• Compound figure interaction

10

Page 11: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera

Features

• Image samples & upload

– Random samples from ImageCLEF2012

– Upload by drag’n’drop from the computer directly

11

Page 12: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera

Features

• Search configuration

– Choose dataset

– Filter by imaging modality

– Use image examples’ captions for text search

– Replace image captions with semantic terms

obtained by a third-party Web Service

12

Page 13: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera

Future Work • Integration with Leap Motion sensor

13

Page 14: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera

Conclusions

• Shambala is easy-to-use and modern

• Currently works with ParaDISE, could be

adapted for any web-based retrieval system

• User tests will be performed to evaluate the

benefit of using this interface

14

Page 15: Shambala - A Modern Web Interface for Medical Image Retrieval · Shambala - A Modern Web Interface for Medical Image Retrieval SGMI2014 Presented by : Alba García Seco de Herrera

15

Thank you for your attention !

Questions?

http://shambala.khresmoi.eu