ND Presentation StateWhat should it do?

D. SluisDecember 2, 2003, Open Discussion at WG11 Meeting, RSNA

D Sluis, 2003-12-2 2

Meeting Goals

• Identify functional needs for NDPS– Clinical use cases, workflow, (prioritize)– Actors and transactions: creators &

users– Features to supports

• Consensus on scope of deliverables• Explore conceptual approach

D Sluis, 2003-12-2 3

Some Proposed Classes of Use

• Specify views of “ND images”– Created by modality, user, CAD or other post-

processing system

• Specify views on existing 2D-frame images– CT, MR, PET, NM …

• Specify fused presentations leveraging Supplement 73: multi-modality, atlas …

• “Presentation path” for usability & productivity– Unburden distracting navigation tasks

D Sluis, 2003-12-2 4

Review ND DICOM Status

• ND Presentation State motivation

• Overview of ND and prior discussion

• Functional requirements– WG12, WG17

D Sluis, 2003-12-2 5

2D Images Have Default Display State

Up

Down

• DICOM 2D image– Is array of pixels– Has orientation– Has Photometric

Interpretation

• Grayscale Softcopy Presentation State alters or augments image display

Left RightPixels

Photometric Interpretation

D Sluis, 2003-12-2 6

ND Instances Have No Display State• No pixels • No horz/vert,

up/down, left/right• No photometric

interpretation• Potentially multiple

bit-plane types Z

X Y

Acute need for ND Presentation State Acute need for ND Presentation State

D Sluis, 2003-12-2 7

ND Framework

Component Array

Component Dimensions

Component Value

Stored Values

D Sluis, 2003-12-2 8

Real World Domain Mapping

Component Array

Real World Domains

Component ValueValue A

ValueMapping

Value B

Stored Values

Space, time, absorbance, velocity, …

ComponentDimension

Mapping

Real World Domain-Centric; not Sample-CentricReal World Domain-Centric; not Sample-Centric

D Sluis, 2003-12-2 9

Masking

• Spatial Masking– Cut planes, bit

masks, shapes…– Unions &

intersections

• Value Masking– Threshold window– Comparative values

(aka write priority)

D Sluis, 2003-12-2 10

Display Window Mapping

• Map Real World Domains to horizontal & vertical – Orthogonal, oblique, curved

• Dynamic behavior– Cine– Scrolling, sweeping, M-Mode– State paths

• Fly-through, moving cut plane

• Overlapping windows• 2D Annotation and mask

D Sluis, 2003-12-2 11

Rendering

• Rendering type– Tomographic– Integrals

• Volumetric, MIP, etc.• Shading: Phong,

surface …• Support coarse set of

models?

• Value rendering– Color– Multi-layer Blending ()

• Eg functional and anatomy

– Layer priority …

D Sluis, 2003-12-2 12

Multi-Window Display

• Bi- and multi-plane views, MPR

• M-Mode• Synchronized

display windows (shared state)

D Sluis, 2003-12-2 13

Annotation and Graphics

• Data space– Shapes– Semantics

• Display space– Overlays, graphics

D Sluis, 2003-12-2 14

Modality and Atlas Fusion – Sup73

D Sluis, 2003-12-2 15

ImageData

SpatialMask

AssignColor/Opacity

View Xform DisplayView 2D View

Blend

3D Render1/2D Render

rotation, flip...Screen shape(rect, circle) andposition

ROI's, points,shapes, vectors ...

Annotation

ValueWindow

thresholds,morphological operations...

planarcurvedMmode

IP, MaxIP,MinIP, ...

Shapes cut planes, bit or function mask, ...

2DAnnotation

Blend,Overlay, ...

Eye Point

Point/path

Display SpaceData Space

D Sluis, 2003-12-2 16

DICOM Supplements

2003 2004 2005

2006

WG17

WG12

Spatial Registration (73)

ND Image (63)

Framework forND Presentation State

US ND Presentation State

Approximate Time when Official DICOM

WG17&WG11

3D/4D US (43)

WGnn

Specialized ND Presentation State

D Sluis, 2003-12-2 17

Next Steps

• Use case and requirements consensus

• Tiered supplements?

• Work & coordination consensus

D Sluis, 2003-12-2 19

Ultrasound Example

Component Array

Space

Component ValueEcho

SpatialMapping

Doppler Velocity

VelocityTissueEcho

dB

mm/smm

Stored ValueMapping