gestalt and picture organization - hci.stanford.edu · picture organization & gestalt context:...
TRANSCRIPT
![Page 1: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/1.jpg)
Perceptual and Artistic Principles for Effective Computer Depiction
Fredo DurandMIT- Lab for Computer Science
Gestalt and Picture Organization
![Page 2: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/2.jpg)
Picture Organization & Gestalt
Grouping by colorGeorgia O’Keeffe
![Page 3: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/3.jpg)
Picture Organization & Gestalt
Grouping, illusory contour & fig/gndAbsolut
![Page 4: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/4.jpg)
Picture Organization & Gestalt
Context: Gestalt psychology• [Palmer 99]• Early 20th century• Inspired by field theory in physics• Holistic philosophy of vision
– “Spontaneous” organization– Opposed to unconscious inference
• Has been integrated recentlyinto modern framework
![Page 5: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/5.jpg)
Picture Organization & Gestalt
Context: Gestalt psychology• Early 20th century• Arnheim had a Gestalt
psychology background• Very popular in design• Advertisement vs. art
![Page 6: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/6.jpg)
Picture Organization & Gestalt
Prägnanz• Cornerstone of Gestalt• “Goodness”• “Simplest” possible figure or organization• Things are organized spontaneously and assumed
to be in the simplest configuration
• Has recently been related to information theory(simple in terms of amount of information required to encode it)
![Page 7: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/7.jpg)
Picture Organization & Gestalt
Plan• Grouping• Figure-ground• Completion and illusory contours
![Page 8: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/8.jpg)
Picture Organization & Gestalt
Grouping• “Similar” or “close” objects are perceived to
belong to groups• Spontaneous and powerful perceptual effect
![Page 9: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/9.jpg)
Picture Organization & Gestalt
Grouping• By Proximity
• By Color
• By size
![Page 10: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/10.jpg)
Picture Organization & Gestalt
Grouping• By Region
• By connectedness
![Page 11: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/11.jpg)
Picture Organization & Gestalt
Grouping by synchronicity
![Page 12: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/12.jpg)
Picture Organization & Gestalt
Grouping by synchronicity
![Page 13: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/13.jpg)
Picture Organization & Gestalt
Grouping by synchronicity
![Page 14: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/14.jpg)
Picture Organization & Gestalt
Grouping by synchronicity II
![Page 15: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/15.jpg)
Picture Organization & Gestalt
Grouping by synchronicity II
![Page 16: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/16.jpg)
Picture Organization & Gestalt
Grouping conflict• Proximity is overweighed by region
• Proximity is overweighed by connectedness
![Page 17: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/17.jpg)
Picture Organization & Gestalt
Grouping effect• Task: Detect repetition of a shape in a sequence• The repetition can be inside or across a group• Slower when between groups (~0.7 vs. ~1.1s)Repetition within group
Repetition across group
Repetition in neutral sequence
Redrawn after [Palmer 99]
![Page 18: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/18.jpg)
Picture Organization & Gestalt
Grouping effect• Task: Detect repetition of a shape in a sequence• The repetition can be inside or across a group• Slower when between groups (~0.7 vs. ~1.1s)Repetition within group
Repetition across group
Repetition in neutral sequence
Redrawn after [Palmer 99]
![Page 19: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/19.jpg)
Picture Organization & Gestalt
Grouping conflict• Faster when within small oval
Redrawn after [Palmer 99]
![Page 20: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/20.jpg)
Picture Organization & Gestalt
Grouping in complex situations• No quantitative rule yet!• Very complex problem• Too many parameters
![Page 21: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/21.jpg)
Picture Organization & Gestalt
Grouping and photoEdward
Weston
![Page 22: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/22.jpg)
Picture Organization & Gestalt
Grouping• Grouping by proximity tells story
![Page 23: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/23.jpg)
Picture Organization & Gestalt
Grouping & Map Making• Grouping provides efficient analysis
![Page 24: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/24.jpg)
Picture Organization & Gestalt
Grouping and ornament• Repetition, rhythm
![Page 25: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/25.jpg)
Picture Organization & Gestalt
Plan• Grouping• Figure-ground• Completion and illusory contours
![Page 26: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/26.jpg)
Picture Organization & Gestalt
Figure-ground• What is in front (figure), and behind (ground)?• There has to be one figure and one ground• Related to occlusion and thus to depth• Less attention is dedicated to the ground
Picture Dark=figure Light=figureRedrawn after [Palmer 99]
![Page 27: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/27.jpg)
Picture Organization & Gestalt
Figure-ground• The shape with the best “Prägnanz” is the figure • Can be bimodal: we switch from one
interpretation to the other– Visible on brain imagery
• But only one at a time
PictureRedrawn after [Palmer 99]
![Page 28: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/28.jpg)
Picture Organization & Gestalt
Figure-ground• Effect of geometric properties on the “Prägnanz”
Redrawn after [Palmer 99]
symmetry Convexity vs. parallelism
parallelism
![Page 29: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/29.jpg)
Picture Organization & Gestalt
Figure-ground & familiarity• Familiarity helps: We recognize a horse
Redrawn after [Palmer 99]
![Page 30: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/30.jpg)
Picture Organization & Gestalt
Figure-ground pun• Rubin vase
![Page 31: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/31.jpg)
Picture Organization & Gestalt
Figure-ground transition• +grouping
![Page 32: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/32.jpg)
Picture Organization & Gestalt
Enhancing depth through contrast• Occluding edges
![Page 33: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/33.jpg)
Picture Organization & Gestalt
Negative space• The ground defines the negative space• Usually overlooked• Fundamental for balance
– Also for typography
picture figure negative space
![Page 34: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/34.jpg)
Picture Organization & Gestalt
Closure & Negative space• George Seurat• Negative space are enclosed in the picture frame
![Page 35: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/35.jpg)
Picture Organization & Gestalt
Plan• Grouping• Figure-ground• Completion and illusory contours
![Page 36: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/36.jpg)
Picture Organization & Gestalt
Continuation• Lines are continued after junctions
• And after gapsPicture good “Prägnanz” not so good “Prägnanz”
![Page 37: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/37.jpg)
Picture Organization & Gestalt
Continuation and Map-Making
![Page 38: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/38.jpg)
Picture Organization & Gestalt
Continuation and design• El Lissitzky, Self Portrait: The Constructor 1924
![Page 39: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/39.jpg)
Picture Organization & Gestalt
Continuation
![Page 40: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/40.jpg)
Picture Organization & Gestalt
Closure• Closed shapes have better “Prägnanz”• + continuation• + illusory lines
![Page 41: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/41.jpg)
Picture Organization & Gestalt
Closure• Matisse
![Page 42: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/42.jpg)
Picture Organization & Gestalt
Illusory contour• An illusory contour is implied by continuation of
the lines• Related to figure ground
![Page 43: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/43.jpg)
Picture Organization & Gestalt
Illusory contours• Kanisza
![Page 44: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/44.jpg)
Picture Organization & Gestalt
Illusory contour• Can be more effective
![Page 45: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/45.jpg)
Picture Organization & Gestalt
Illusory contour• Familiarity helps
![Page 46: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/46.jpg)
Picture Organization & Gestalt
Illusory contour• Matisse
![Page 47: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/47.jpg)
Picture Organization & Gestalt
Figure-ground and illusory contour
![Page 48: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/48.jpg)
Picture Organization & Gestalt
Visual completion• We complete the occluded part
with the simplest shape (best “Prägnanz”)• Related to continuation and closure
Picture Other possible interpretationsSimplest interpretations
Redrawn after [Palmer 99]
![Page 49: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/49.jpg)
Picture Organization & Gestalt
Completion• Magritte
![Page 50: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/50.jpg)
Picture Organization & Gestalt
Completion• Marc Riboud• Completion is challenged
![Page 51: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/51.jpg)
Picture Organization & Gestalt
Summary• Prägnanz (goodness, simple in terms of
information)
• Grouping• Figure-ground• Completion
• As usual pictures can– Simplify– Challenge
![Page 52: Gestalt and Picture Organization - hci.stanford.edu · Picture Organization & Gestalt Context: Gestalt psychology • [Palmer 99] • Early 20th century • Inspired by field theory](https://reader030.vdocument.in/reader030/viewer/2022012403/5c5c253e09d3f24f368cf020/html5/thumbnails/52.jpg)
Picture Organization & Gestalt
History of science• Initially, strong opposition between Gestalt and
other theories• Lack of experimental data• Has been applied beyond its scope• Has been taken too literally
• Now, has been integrated with other theories• Experiments• Computational models