cis 4930/6930-902 s v - cspaul.com › ... › uploads › 2015 › 05 › l05-perception.pdf ·...

65
CIS 4930/6930-902 SCIENTIFIC VISUALIZATION PERCEPTION FOR VISUALIZATION Paul Rosen Assistant Professor University of South Florida slides credits Chris Johnson (U of Utah), Hanspeter Pfister (Harvard), BangWong (Broad Institute), Miriah Meyer (U of Utah)

Upload: others

Post on 09-Jun-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

CIS 4930/6930-902SCIENTIFICVISUALIZATION

PERCEPTION FOR VISUALIZATIONPaul RosenAssistant ProfessorUniversity of South Florida

slides credits Chris Johnson (U of Utah), Hanspeter Pfister (Harvard), BangWong (Broad Institute), Miriah Meyer (U of Utah)

Page 2: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•ADMINISTRATIVE

•project 1: due next class•watch: “Hans Rosling: The

best stats you've ever seen”

Page 3: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•TODAY

•eye construction•perceptual vulnerabilities

•popout•gestalt principles

•NEXT TIME

•color

Page 4: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

data knowledge

Page 5: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen
Page 6: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

Wandell,“Foundations ofVision” (left)

David R.Williams,Univ.of Rochester (right)

120 million rods 5-6 million cones

Page 7: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•CONE RESPONSE

Page 8: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

E.B.Goldstein“Sensation and Perception” (Adapted from Lindsay & Norman,1977)

Page 9: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

Ware 2010

Page 10: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

C.Ware,“VisualThinking for Design”

Foveation is relatively easy tosee. The key to recognizingthe phenomenon is to stair ata single word on the printedpage. Then, without movingyour gaze, note the blurrinessof the surrounding text.

Page 11: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•SACCADIC EYE MOVEMENTS

•rapid involuntary eye movements•moving: 20-100 ms

•fixations: 200-600 ms

http://vision.arc.nasa.gov/personnel/jbm/home/projects/osa98/osa98.html

Page 12: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•BLIND SPOT

Close left eyeStair at +Move forward and backward until disappears

Page 13: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•BLIND SPOT

Page 14: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•TAKEAWAY

•Our vision at any given moment is relatively limited. Our brain “fills in the missing

pieces” using a variety of evolved tools.

•Be careful placing too much data on the screen. Crisp and clear will result

in the best interpretation.

Page 15: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•EDGE DETECTION

Page 16: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

Bear,Connors,Paradiso,“Neuroscience”

100M rods and cones

1M ganglion cells

•RECEPTIVE FIELDlight hits rods and cones

single neuron fires

Page 17: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

low activitycenter and surrounds cancel

activity increasedor decreased at edges

Page 18: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

Annie Prud’homme-Généreux

•HERMANN GRID EFFECT

Page 19: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen
Page 20: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•CONSEQUENCES OFEDGE EXTRACTION

Page 21: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•CORNSWEET

ILLUSION

Page 22: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•CORNSWEET

ILLUSION

Page 23: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•CORNSWEET

ILLUSIONActual Luminance

Perceived Luminance

Page 24: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

D.Purves and R.B.Lotto

•CORNSWEETILLUSION

Page 25: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•MACHBANDING

Page 26: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

SIMULTANEOUSCONTRAST

Page 27: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

http://persci.mit.edu/_media/gallery/checkershadow_double_full.jpg

SIMULTANEOUS CONTRAST

Page 28: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

SIMULTANEOUS CONTRAST

Page 29: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

SIMULTANEOUS CONTRAST

Page 30: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

SIMULTANEOUS CONTRAST

Page 31: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•TAKEAWAY

•Our visual system is attracted to edges and is sensitive to differences, not absolute values.

•Maximize the contrast with the background if the outlines of shapes are important.

Page 32: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•WEBER’S LAW•we judge based on relative, not absolute, differences

Page 33: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•AXIS OF ALIGNMENT

Page 34: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•AXIS OF ALIGNMENT

Page 35: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•TAKEAWAY

•We have a strong propensity to assume our judgments are absolute, when in fact they are generally relative to the local context.

•Do your best to not place data in difficult contexts. Choose position and

orientation of objects carefully.

Page 36: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•POPOUT

Page 37: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•POPOUT

Page 38: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•POPOUT

Page 39: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•POPOUT

Page 40: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•PRE-ATTENTIVE PROCESSING•requires attention, despite name

•very fast: <200 ms•what matters most is contrast between features

Page 41: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

Ware 2008

•BASIC POPOUTCHANNELS

Page 42: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

Healy 2007

•PICK THE OUTLIER

Page 43: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

Healy 2007

•PICK THE OUTLIER

Page 44: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

Healey 2007

•PICK THE OUTLIER

Page 45: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

Healey 2007

•CONJUNCTION•or, why to use a single channel at a time

Page 46: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•CONJUNCTION•or, why to use a single channel at a time

Page 47: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen
Page 48: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•TAKEAWAY

•We can easily see objects that are different in color and shape, or that are in motion.

•Use color and shape sparingly to make the important information pop out.

Page 49: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•GESTALT PRINCIPLES

•German: “Gestalt” = form•patterns transcend the visual stimuli that

produced them

Page 50: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

BangWong,“Gestalt Principles,1”,Nature Methods

•SIMILARITY

Page 51: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

Andy Rutledge,“Gestalt Principles of Perception”

•SIMILARITY

Page 52: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

Andy Rutledge,“Gestalt Principles of Perception”

•PROXIMITY

Page 53: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

BangWong,“Gestalt Principles,1”,Nature Methods

•PROXIMITY

Page 54: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

Ware,“InformationVisualization”

•CONNECTEDNESS

Page 55: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

Similarity

Connection

Enclosure

BangWong,“Gestalt Principles,1”,Nature Methods

•GROUPING

Page 56: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

Jorge Camoes

proximity similarity

enclosure

•GROUPING

Page 57: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

BangWong,“Gestalt Principles,II”,Nature Methods

•CONTINUITY

Page 58: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

BangWong,“Gestalt Principles,II”,Nature Methods

•CONTINUITY

Page 59: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•CLOSURE

Page 60: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•FIGURE /GROUND

Page 61: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

A.Rutledge

•COMMON FATE

Page 62: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•GESTALT PRINCIPLES

•similarity: things that look like each other (size, color, shape) are related

•proximity: things that are visually close to each other are related

•connection: things that are visually connected are related

•continuity: we complete hidden objects into simple, familiar shapes

•closure: we see incomplete shapes as complete

•figure / ground: elements are perceived as either figures or background

•common fate: elements with the same moving direction are perceived as a unit

Page 63: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•TAKEAWAYS

•Gestalt principles give us a conceptual understanding of the way our mind

converts shapes into structured thought.

•Using the Gestalt principles wisely will lead improve performance in

interpretation of visualizations. Poor use may cause users to see

things that aren’t there…

Page 64: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen

•DISCUSSION

Niklas Elmqvist and Ji Soo Yi•Patterns for Visualization Evaluation

Page 65: CIS 4930/6930-902 S V - cspaul.com › ... › uploads › 2015 › 05 › L05-perception.pdf · CIS 4930/6930-902 SCIENTIFICVISUALIZATION PERCEPTION FORV ISUALIZATION Paul Rosen