ND Presentation State

D. SluisAugust 21, 2003, WG11 Meeting

D Sluis, 2003-08-21 2

Overview

• ND Presentation State motivation• Conceptual overview of ND image

(Sup63)• Requirements overview• Straw man pipeline & info model• Next Steps

D Sluis, 2003-08-21 3

Clinical Use

• Describe how to view acquired “ND images”

• Preserve user created views for recall

• View “thumbnails” for user selection

D Sluis, 2003-08-21 4

2D Images have Display State

Up

Down

• DICOM 2D image– Is array of pixels– Has orientation– Has Photometric

Interpretation

• Presentation State alters or augments image display

Left RightPixels

Photometric Interpretation

D Sluis, 2003-08-21 5

ND “Images” Have No Display State• No pixels

– Cannot display as is– No horz/vert, up/down,

left/right– No photometric

interpretation– Multiple layers to

display

• Acute need for ND Presentation State– A view of Stored Values

in Component Array

Z

X Y

T7T6T5T4T3T2T1T0

Z

X Y

XY Y

F xF y

X

Y

M

D Sluis, 2003-08-21 6

ND Framework

Component Array

Component Dimension

Component Value

Stored Values

D Sluis, 2003-08-21 7

Real World Domain Mapping

Component Array

Real World Domains

Component ValueValue A

ValueMapping

Value B

Stored Values

Space, time, absorbance, velocity, …

ComponentDimension

Mapping

Unified, Consistent Mapping of Real World Domains

D Sluis, 2003-08-21 8

Ultrasound Example

Component Array

Space

Component ValueEcho

SpatialMapping

Doppler Velocity

VelocityTissueEcho

dB

mm/smm

Stored ValueMapping

D Sluis, 2003-08-21 9

Requirements Classification

• Data Domain– Masking, thresholds, …

• Display domain– Mapping the 2D Display Window to the data– Define pixel intensity mapping– Multi-Window Display– Annotation and Graphics

• Other– Presentation Thumbnails

D Sluis, 2003-08-21 10

Masking

• Spatial and other Masking– Cut planes, bit

masks, shapes…– Unions and

intersections• Value Masking

– Threshold window– Comparative values

(aka write priority)

D Sluis, 2003-08-21 11

Display Window

• Horizontal and vertical mapping to Component Array axes– Orthogonal, oblique,curved

• Dynamic behavior– Cine– Scrolling, sweeping, M-Mode– State paths

• Fly-through, moving cut plane

• Overlapping windows• 2D Annotation and mask

D Sluis, 2003-08-21 12

Rendering

• Rendering type– Tomographic– Integrals

• Volumetric, MIP, etc.• Shading: Phong,

surface …• Support coarse set of

models?

• Value rendering– Color– Multi-Value Blending ()– Layer priority …

D Sluis, 2003-08-21 13

Multi-Window Display

• Bi- and multi-plane views, MPR

• M-Mode• Synchronized

windows (shared state)

D Sluis, 2003-08-21 14

Annotation and Graphics

• Data space– Shapes– Semantics

• Display space

D Sluis, 2003-08-21 15

Presentation State “Thumbnail” Views • A 2D view intended to help user

navigate images and presentation states

• Include in Presentation State? Image?– Icon Image (0088,0200) has awkward

restrictions

D Sluis, 2003-08-21 16

ImageData

SpatialMask

AssignColor/Opacity

View Xform DisplayView 2D View

Blend

3D Render1/2D Render

rotation, flip...Screen shape(rect, circle) andposition

ROI's, points,shapes, vectors ...

Annotation

ValueWindow

thresholds,morphological operations...

planarcurvedMmode

IP, MaxIP,MinIP, ...

Shapes cut planes, bit or function mask, ...

2DAnnotation

Blend,Overlay, ...

Eye Point

Point/path

Display SpaceData Space

D Sluis, 2003-08-21 17

Draft Info Model

Data Window

Presentation State

Display Window

1

1..*

Display Text

DisplayAnnotation

Display Mask

0..*

0..*

0..*

display over

1..*

1..*

Array Mask

Value Mask

Display State

State Path

0..11..*

1..*

Render State1..*

0..*

State1..*

0..1

0..1

0..1

0..1

ND Annotation0..*

0..1

1

1

1..*1

Icon Image0..11

D Sluis, 2003-08-21 18

DICOM Supplements

2003 2004 2005

2006

WG17

WG12

Spatial Registration (73)

ND Image (63)

ND Presentation State

ND Presentation State

Enhanced US

Approximate Time when Official DICOM

WG17&WG11

Enhanced US PS

3D/4D US (43)

D Sluis, 2003-08-21 19

Next Steps?

• Use case and requirements consensus

• Tiered supplements?• Work & coordination consensus• Draft Work Item