perceptual organization as a foundation for intelligent sketch editing eric saund james mahoney...
TRANSCRIPT
![Page 1: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/1.jpg)
Perceptual Organization as a Foundation for
Intelligent Sketch Editing
Eric SaundJames Mahoney
David FleetDaniel LarnerEdward Lank
Palo Alto Research Center
![Page 2: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/2.jpg)
Goal: Intelligent Sketch Editing
![Page 3: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/3.jpg)
Central Problem: Selection
Goal: Simple, easy user actions to select desired image material (e.g. tap, click, crude gesture).
WYPIWYG: What You Perceive is What You Get
![Page 4: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/4.jpg)
Motivation
Prior Domain Knowledge
high
low "paint" editors
domain structureeditors
Choice: What degree of prior domain knowledge?
!
Perceptual Organization
•make available generic visual structure
•foundation for domain-specific recognition
![Page 5: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/5.jpg)
Gestalt Rules of Perceptual Organization
?
•ClosureWhich dot is on an object?
•Smooth ContinuationWhat are the objects?
•ProximityIdentify the text groups
•Symmetry
•Similarity
•Coherent Motion
Although algorithms are empirically moretop level, the level of
Me gustaria aprovecharsaludarlos y darles la
information de interes
and mechanismsaccessible, it is the
computational theoryesta oportunidad parabienvenida a ofrecer
en espanol, Nicaragua
![Page 6: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/6.jpg)
Perceptual Structure in Sketches
![Page 7: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/7.jpg)
The ScanScribe Document Image Editor
I. GUI substrate•convenient encircling gestures•implicit creation of image objects•management of grouping structure
![Page 8: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/8.jpg)
The ScanScribe Document Image Editor
I. GUI substrate•convenient encircling gestures•implicit creation of image objects•management of grouping structure
II. Automatic structure detection•grouping/P.O.
Image/StrokeData
Primitives Groups
prime
composite
![Page 9: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/9.jpg)
Image
PrimeObjects
image processingcontour tracing
thinningjunction detection
line followingcorner detection
shape classification
Extracting Primitives
![Page 10: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/10.jpg)
Perceptual Grouping
analyze localspatial relations
form links
assemble larger structures:
CompositeObjects
C C
C A
Closed_Path
Text_Run
TextLine Art
![Page 11: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/11.jpg)
Curvilinear Continuity
clear ambiguous
potential combinatorial explosion
![Page 12: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/12.jpg)
Curvilinear Closure
smooth-continuation
maximally-turning
![Page 13: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/13.jpg)
Text Layout
![Page 14: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/14.jpg)
Key Problem: Ambiguity
Local evidence is insufficient.
Research problem: effectiveuse of spatially extended context.
![Page 15: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/15.jpg)
Conclusion
Intelligent Sketch Editing
•Easy selection of visually-salient material
•Recognition at the level of Perceptual Organization
•Research-prototype: the ScanScribe image editor
![Page 16: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/16.jpg)
![Page 17: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/17.jpg)
P.O. Level Structuring
Image/StrokeData
Primitives Groups
![Page 18: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/18.jpg)
Line-art and Text
Prime objects can servemultiple roles.
![Page 19: Perceptual Organization as a Foundation for Intelligent Sketch Editing Eric Saund James Mahoney David Fleet Daniel Larner Edward Lank Palo Alto Research](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e025503460f94aec57c/html5/thumbnails/19.jpg)
Goal: Intelligent Sketch Editing