medical illustration: current uses and process · •mesoscale illustration of a nerve synapse by...

68
Medical Illustration: Current Uses and Process [email protected] www.MeCoVisuals.com www.ChicagoMedicalGraphics.com

Upload: others

Post on 22-Aug-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Medical Illustration: Current Uses and Process

[email protected]

www.ChicagoMedicalGraphics.com

Page 2: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

My Background

• Two Companies:• MeCo Visuals• Chicago Medical Graphics

• BS, Biology: The University of Texas at Austin• Neurobiology focus

• Clinical Assistant at Dell Children’s Medical Center• Pre- and post-surgical

• MS, Biomedical Visualization: The University of Illinois at Chicago• 3D Animation in medical education

© Sam Bond

Page 3: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

The Association of Medical Illustrators

© Audra Geras

Page 4: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Asking the Right Questions

• Understanding patient needs

Page 5: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Asking the Right Questions

• Understanding patient needs• Physical

Page 6: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Asking the Right Questions

• Understanding patient needs• Physical• Psychological

Page 7: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Asking the Right Questions

• Understanding patient needs• Physical• Psychological• Learning Needs!

Page 8: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Asking the Right Questions

• Understanding patient needs• Physical• Psychological• Learning Needs!

• Engagement leads to better outcomes, better understanding

Page 9: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

The Healthcare Ecosystem is Changing!

• Moving away from fee-for-service• Accountable Care Organizations• Bundled payments

• Understanding patient needs• Physical• Psychological• Learning Needs!

• Engagement leads to better outcomes, better understanding

Asking the Right Questions

Page 10: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

So, What Does a Medical Illustrator Do?

Most people think:Frank Netter & anatomy books

Frank Netter

Page 11: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

© Peg Gerrity

Research Journals

Page 12: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

© Peg Gerrity

Websites and Apps

Page 13: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

© Peg Gerrity

Patient Handouts

Page 14: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Patient Education

• Patient engagement• Better-informed consent• Treating pediatric patients like “little scientists”

Page 15: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

• Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #)• Hand-painted in watercolor

Molecular Visualization

B. D. Campbell and S. Francesca, "Using Art to Visualize Cellular Environments: An Interview with David Goodsell," in IEEE Computer Graphics and Applications, vol. 36, no. 6, pp. 6-10, 2016. doi:10.1109/MCG.2016.116

Page 16: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

• Pharmaceutical Mechanism of Action• Modified adenovirus, attacking glioblastoma cells

Pharmacological Visualization

Page 17: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

• Virus Explorer: directed and modeled by Fabian de Kok-Mercado, MA-CMI• From Howard Hughes Medical Institute (HHMI) BioInteractive

Molecular Visualization

Page 18: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Medical Device

Page 19: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Medical Device

Page 20: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Patient and Investor Education

Page 21: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

CME Courses, Webinars

Page 22: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Research Presentations

Page 23: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Representational

Page 24: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Representational

Page 25: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Anaplastology

© Ali Padilla

Page 26: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Legal Cases

© Gerrity/Connolly

Page 27: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Veterinary

© Kip Carter

Page 28: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Sciart

© Katrina van Grouw

Page 29: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Mesozoic Art

© Mark Witton

Page 30: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Paleoart

© Robert Shonk

Page 31: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Interactivity: Augmented Reality (AR)

Page 32: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Interactivity: Augmented Reality (AR)

Page 33: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Interactivity: Virtual Reality (VR)

Page 34: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Interactivity: Virtual Reality (VR)

© Tiffany Raber

Photo Credit: Ted Kucklick

Page 35: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

• We Are Alfred: Embodied Labs, CEO Carrie Shaw• For patient families & medical professionals

Immersive Experiences (Virtual Reality)

Page 36: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

• We Are Alfred: Embodied Labs, CEO Carrie Shaw• For patient families & medical professionals

Immersive Experiences (Virtual Reality)

Page 37: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Interactivity: Mixed Reality (MR)

© Microsoft© Marvel Studios

Page 38: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Interactivity: Haptics

© James Vincent, The Verge

Page 39: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Interactivity: Gaming!

© Sam Bond

https://www.youtube.com/watch?v=BjnMX-1reus#action=share

Page 40: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Stretch Break!

Page 41: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

So how do we even make models?

Page 42: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization
Page 43: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Segmenting the White Matter of a Brain

Page 44: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Raw Models from CT Data

Page 45: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Final Still Image

Page 46: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Imaging (DICOM) Data

Page 47: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Segmentation

Page 48: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Segmentation Model

Page 49: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Raw Model from DICOM Data

Page 50: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Research

Page 51: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Problem-Solving

Page 52: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Sculpting, Lighting, & Texturing

Page 53: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Final Results

Used in patent applications

Page 54: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Software

Programs used:ITK-SNAPMaterialise MimicsOsirix3D slicer*Zbrush*3Ds MaxMudboxVrayArnoldRed Giant SuiteMolecular MayaPyMolJmolePMVAutoPack/CellPackChimeraXAdobe Illustrator, Photoshop, *After Effects, Premiere, Audition

Page 55: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Our Process

How do you work with a Medical Illustrator?Contact with an idea: earlier is better

Page 56: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Our Process

We will chat about:Your audience

Page 57: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Our Process

We will chat about:Your audienceThe visual problem

Page 58: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Our Process

We will chat about:Your audienceThe visual problemPotential solution options

Page 59: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Our Process

We will chat about:Your audienceThe visual problemPotential solution optionsTimeline

Page 60: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Our Process

We will chat about:Your audienceThe visual problemPotential solution optionsTimelineGrants

Page 61: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Our Process

We will chat about:Your audienceThe visual problemPotential solution optionsTimelineGrantsUsage rights

Page 62: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Our Process

We will chat about:Your audienceThe visual problemPotential solution optionsTimelineGrantsUsage rightsBudget

Page 63: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Our Process

I will ask for:Primary literature

Page 64: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Our Process

I will ask for:Primary literatureImages (DICOM, device, your sketches)

Page 65: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Our Process

I will ask for:Primary literatureImages (DICOM, device, your sketches)Responses to checkpoints within 48 hours

Page 66: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Our Process

I will ask for:Primary literatureImages (DICOM, device, your sketches)Responses to checkpoints within 48 hoursPotential observation

Page 67: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

In Conclusion

Page 68: Medical Illustration: Current Uses and Process · •Mesoscale illustration of a nerve synapse by David Goodsell, PhD (citation #) •Hand-painted in watercolor Molecular Visualization

Thank you!

MELANIE [email protected]

www.MeCoVisuals.comwww.ChicagoMedicalGraphics.com