on reasoning with images: the use of images in clinical research thomas bittner louis goldberg...

68
ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Upload: bertha-robinson

Post on 20-Jan-2016

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

ON REASONING WITH IMAGES:

THE USE OF IMAGES IN CLINICAL RESEARCH

Thomas BittnerLouis Goldberg

University at Buffalo

Page 2: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

CLINICAL RESEARCH IN TEMPOROMANDIBULAR DISORDERS

TMD is a pain and disability disorder

current studies have significantly increased the size of the domain of analysis to capture all relevant variables

the temporomandibular joint (TMJ) is a crucial variable: it drives diagnosis and treatment

controversies abound concerning the relationship of joint characteristics as represented in images to patient symptoms and treatment choices

problem: how to represent TMJ image characteristics in a computer-based system that is interoperable with other data collected in the study

Page 3: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

EXAMPLES OF MEASURABLE VARIABLES

pain levels

functional capacity

gross mobility of the jaw

mobility of the TMJ

pressure-pain threshold of the TMJ

biopsychosocial factors contributing to TMD

Page 4: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

CLINICAL RESEARCH IN TEMPOROMANDIBULAR DISORDERS

TMD is a pain and disability disorder

current have studies increased the size of the domain of analysis to capture all relevant variables

the temporomandibular joint (TMJ) is a crucial variable: it drives diagnosis and treatment

controversies abound concerning the relationship of joint characteristics, as represented in images, to patient symptoms and treatment choices

problem: how to represent TMJ image characteristics in a computer-based system that is interoperable with other data collected in the study

Page 5: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

The problems with pre-coordination, such as the pre-coordination of certain relationships of entities in the TMJ with clinical syndromes.

Page 6: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

AN EXAMPLE OF PRE-COORDINATION

zone of articulation: relation of the posterior band of the articular disc in relation to the head of the condyle in the closed position. The posterior band should be between 11:30 and 12 o’clock. If it is anterior to that position it demonstrates the pathology; anterior disc displacement

Page 7: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Consequences

How to resolve conflicts that arise out of pre-coordination in the face of deeply held beliefs.

Research is necessary to determine if such pre-coordinations are valid.

Page 8: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

TMJ DYNAMICS: NORMAL

Annika Isberg,Temporomandibular joint Dysfunction:A Practitioner's Guide, ISIS Medical Media, 2001

Page 9: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

TMJ DYNAMICS: NORMAL & ABNORMAL

Annika Isberg,Temporomandibular joint Dysfunction:A Practitioner's Guide, ISIS Medical Media, 2001

Page 10: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

RECAPTURE OF THE DISC

Annika Isberg,Temporomandibular joint Dysfunction:A Practitioner's Guide, ISIS Medical Media, 20019

Page 11: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

GOAL

represent the relationships among the condyle, the articular disc and the temporal bone in an automatic system

Page 12: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

the practical point of view

the ontology must be immediately useful to a specific research enterprise

Page 13: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

OVERVIEW

1. Identify the major parts of the TMJ

2. Establish the connectedness and adjacency relations among the various parts

3. Establish the qualitative order relations using landmarks as frames of reference

4. Establish relative size relations

Page 14: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Major parts of the TMJ

the TMJ is a real, three dimensional structure

choose the coarsest level of granularity sufficient to distinguish the major proper parts of the TMJ

gross anatomical granularity in this case

Page 15: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Major parts of the TMJ

material partsrigid partsnon-rigid parts

cavities

Page 16: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

ANTERIOR

material parts

TMDs: An Evidence Based-Approach to Diagnosis and Treatment. (2006) Eds: D. M. Laskin, C. S. Greene, W. L. Hylander. Quintessence Books, Chicago.

Page 17: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Rigid material parts

parts that do notchange shape(bones)

fixed

movable

Page 18: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Non-rigid material parts

parts that do change shape

but the topology does not change: the connected partsremain connected

Page 19: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

ANTERIOR

Cavities

filled with liquid: synovial fluid in the case of the TMJ

Page 20: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

we have identified three kinds of entities (parts) in the TMJ

material rigidmaterial non-rigid cavities

Page 21: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Connectedness and adjacency relations among the parts of the

joint

Page 22: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Connectedness Relations

ANTERIOR

connectedness

connectednessgraph

Page 23: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

closed and opened positions

jaw closed

jaw openedTMDs: An Evidence Based-Approach to Diagnosis and

Treatment. (2006) Eds: D. M. Laskin, C. S. Greene, W. L. Hylander. Quintessence Books, Chicago.

Page 24: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Connectedness remains invariant in the opened and closed positions

ANTERIOR

connectedness

Connectednessgraph

Page 25: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Every TMJ can be represented by this connectedness graph

Connectednessgraph

Page 26: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

adjacency relations

No connectednessOnly (temporary) adjacency

Connectednessadjacencygraph

Adjacency relations

Page 27: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

adjacency

•At all times the disc (red) is adjacent to the fossa (yellow)•At all times the disc (red) is adjacent to the condyle (pink)

Adjacency relations

But at different times the discmay be adjacent to different partsof the fossa / condyle

Page 28: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Adjacency disc-fossa

Time 1

Page 29: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Adjacency disc-fossa

Time 2

Page 30: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Adjacency disc-fossa

Time 3

Page 31: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Adjacency disc-condyle

Time 1

Page 32: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Adjacency disc-condyle

Time 2

Page 33: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Adjacency disc-condyle

Time 3

Page 34: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Ordering relations

Refining adjacencyrelation betweendisc and fossa

Refining adjacencyrelation between disc and condyle

Specifying relativelocation of condyle andfossa

Page 35: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Shape landmarks of the fossa

Rigid does notChange shape(bones)

Convex curvaturechanges to concave

Page 36: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Fiat boundaries

Rigid does notchange shape(bones)

Convex curvaturechanges to concave

Page 37: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Rigid does notchange shape(bones)

Local maxima/minima

Shape landmarks of the fossa

Page 38: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Rigid does notchange shape(bones)

articular (glenoid)fossa

articular eminence

Shape landmarks of the fossa

Page 39: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Fiat boundaries

Rigid does notchange shape(bones)

Page 40: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Fiat boundaries

Rigid does notchange shape(bones)

6 major fiat parts

Page 41: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Frames of reference

Rigid does notchange shape(bones)

A

BC

DE

F

Circle is adjacent-to A

Page 42: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Frames of reference

Rigid does notchange shape(bones)

A

BC

DE

F

Circle is adjacent-to B

Page 43: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Frames of reference

Rigid does notchange shape(bones)

A

BC

DE

F

Disc is adjacent-to C and D

Page 44: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Ordering relations

Refining adjacencyrelation betweendisc and fossa

Refining adjacencyrelation between disc and condyle

Specifying relativelocation of condyle andfossa

Page 45: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Shape landmarks of the condyle

as frame of reference

anterior head of condyle

Disc is adjacent to the posterior head of the condyle

Posteriorhead of condyle

Page 46: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Shape landmarks of the condyle

as frame of reference

anterior head of condyle

Disc is adjacent to the

posterior and anterior head of the condyle

Posteriorhead of condyle

Page 47: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Shape landmarks of the condyle

as frame of reference

anterior head of condyle

Disc is adjacent to the anterior head of the condyle

Posteriorhead of condyle

Page 48: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Ordering relations

Refining adjacencyrelation betweendisc and fossa

Refining adjacencyrelation between disc and condyle

Specifying relativelocation of condyle andfossa

Page 49: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Middle axis ofthe condyle

Extension ofThe middle axis

Shape landmarks of the condyle

Page 50: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Frames of reference

Rigid does notchange shape(bones)

A

BC

DE

F

The extension of the axis of the condyleintersects the fossa in region C

Page 51: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Frames of reference

Rigid does notchange shape(bones)

A

BC

DE

F

The extension of the axis of the condyleintersects the fossa in region D

Page 52: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Bringing the various ordering relations together

Page 53: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Ordering relations

Refining adjacencyrelation betweendisc and fossa

Refining adjacencyrelation between disc and condyle

Specifying relativelocation of condyle andfossa

Page 54: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Ordering relations

A

B C D E F

A

B C D E F

Page 55: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

bringing together multiple ordering structures:two frames of reference locates the position of the disc and condyle with respect to each other and to the fossa

•The extension of the axis of the condyle intersects the fossa in region DA

B CD E F

• The disc is adjacent-to fossa regions C and D

• The disc is adjacent to the posterior and anterior head of the condyle

Page 56: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

we now have a three dimensional combinatorial space of possible

relationshipscontained in the domain of the TMJ

Page 57: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

All combinatorial possible constellations

Disc adjacent to posterior head

Page 58: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

All combinatorial possible constellations

Disc adjacent to anterior head

Disc adjacent to posterior head

Page 59: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

All combinatorial possible constellations

A B C D E F

Disc is adjacent to fossa region

Disc adjacent to posterior head

Page 60: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

All combinatorial possible constellations

A B C D E F

A

B

C

D

E

F

AxisOfCondyleintersects

Disc is adjacent to fossa region

Disc adjacent to posterior head

Page 61: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

A B C D E F

A

B X X X

C

D

E

F

AxisOfCondyleintersects

QuickTime™ and aTIFF (LZW) decompressor

are needed to see this picture.

Disc is adjacent to fossa region

Disc adjacent to posterior & anterior head

Page 62: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

A B C D E F

A

B X

C

D

E

F

AxisOfCondyleintersects

QuickTime™ and aTIFF (LZW) decompressor

are needed to see this picture.

Disc is adjacent to fossa region

Disc adjacent to anterior neck

Page 63: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

A B C D E F

A

B X X

C

D

E

F

AxisOfCondyleintersects

QuickTime™ and aTIFF (LZW) decompressor

are needed to see this picture.

Disc is adjacent to fossa region

Disc adjacent to anterior head & neck

Page 64: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

A B C D E F

A

B

C

D

E X X

F

AxisOfCondyleintersects

Disc is adjacent to fossa region

Disc adjacent to posterior & anterior head

Page 65: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

Conclusions/Methodology

Page 66: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

TMJ ontology

Mereology•How many parts•What kind of parts

Topology•Which parts are connected•Which parts are adjacent

Page 67: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

TMJ ontology

Mereology•How many parts•What kind of parts

Topology•Which parts are connected•Which parts are adjacent

Qualitative order•How are things arranged with respect to each other•How does relative location change during movement

Page 68: ON REASONING WITH IMAGES: THE USE OF IMAGES IN CLINICAL RESEARCH Thomas Bittner Louis Goldberg University at Buffalo

TMJ ontology

Qualitative order•How are things arranged with respect to each other•How does relative location change during movement

A|B|C|D|E|Fadjacent-to

intersects