an aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this)...
Post on 22-Dec-2015
222 views
TRANSCRIPT
![Page 1: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/1.jpg)
an aside: peripheral drift illusion
illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking your eyes repeatedly also strengthens the illusion.
![Page 2: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/2.jpg)
Visual Cognition IIObject Perception
![Page 3: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/3.jpg)
Theories of Object Recognition
• Template matching models• Feature matching Models• Recognition-by-components• Configural models
![Page 4: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/4.jpg)
Template matching
Detect patterns by matching visual input with a set of templates stored in memory – see if any template matches.
TEST INSTANCE
“J” TEMPLATE “T” TEMPLATE
match
![Page 5: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/5.jpg)
Problem:
what if the object differs slightly from the template? E.g., it is rotated or scaled differently?
Solution:
use a set of transformations to best align the object with a template (using translation, rotation, scaling)
TEST INSTANCE
“J” TEMPLATE “T” TEMPLATE
rotation
match
![Page 6: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/6.jpg)
Template-matching works well in constrained environments
![Page 7: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/7.jpg)
Figure 2-15 (p. 58)Examples of the letter M.
Problem: template matching is not powerful enough for general object recognition
![Page 8: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/8.jpg)
Feature Theories
• Detect objects by the presence of features• Each object is broken down into features• E.g.
A = + +
![Page 9: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/9.jpg)
Sensory Binding Problem
• If spatially different areas are functionally specialized for processing visual attributes such as shape, color, orientation, and direction of motion….
• then how does the brain then “bind” together the sensory attributes of an object to construct a unified perception of the object?
Binding Problem
![Page 10: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/10.jpg)
Binding Problem
![Page 11: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/11.jpg)
Recognition by Components (RBC)
• Biederman (1987): Complex objects are made up of arrangements of basic, component parts: geons.
• “Alphabet” of 24 geons
• Recognition involves recognizing object elements (geons) and their configuration
![Page 12: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/12.jpg)
Why these geons?
• Choice of shape vocabulary seems a bit arbitrary• However, choice of geons was based on non-accidental
properties. The same geon can be recognized across a variety of different perspectives:
except for a few “accidental” views:
![Page 13: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/13.jpg)
Viewpoint Invariance
• Viewpoint invariance is possible except for a few accidental viewpoints, where geons cannot be uniquely identified
![Page 14: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/14.jpg)
Prediction
• Recognition is easier when geons can be recovered
• Disrupting vertices disrupts geon processing more than just deleting parts of lines
ObjectDeleting
line segments
Deleting vertices
![Page 15: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/15.jpg)
Evidence from priming experiments
![Page 16: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/16.jpg)
Problem for RBC
• Theory does not say how color, texture and small details are processed. These are often important to tell apart specific exemplars or similar objects. E.g.:
![Page 17: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/17.jpg)
Configural models of recognition
• Individual instances are not stored; what is stored is an “exemplar” or representative element of a category
• Recognition based on “distance” between perceived item and prototype
prototype
match
“Face space”
no match
![Page 18: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/18.jpg)
Prediction: Caricatures might be better recognized than original face
from: Face Recognition by Humans: 20 Results all Computer Vision Researchers Should Know About. Sinha et al. (2005).
average female face “veridical” face caricature of B
![Page 19: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/19.jpg)
a) no, nothingb) same mouthc) same nosed) same eyes
Do these faces have anything in common?
![Page 20: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/20.jpg)
How about these ones?
By disrupting holistic (configural) processing, it becomes easier to process the individual parts
![Page 21: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/21.jpg)
• Configural effects often disappear when stimulus is inverted
Face Inversion
![Page 22: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/22.jpg)
Top-down and Context Effects in Object Recognition
![Page 23: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/23.jpg)
Slide from Rob Goldstone
![Page 24: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/24.jpg)
Context can often help in identification of an object
Later identification of objects is more accurate when object is embedded in coherent context
![Page 25: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/25.jpg)
Context can alter the interpretation of an object
![Page 26: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/26.jpg)
Context Effects in Letter Perception
The word superiority effect: discriminating between letters is easier in the context of a word than as letters alone or in the context of a nonword string.
DEMO:http://psiexp.ss.uci.edu/research/teachingP140C/demos/demo_wordsuperiorityeffect.ppt (Reicher, 1969)
![Page 27: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/27.jpg)
Interactive Activation Model
• Word superiority effect suggests that information at the word level might affect interpretation at the letter level
• Interactive activation model: neural network model for how different information processing levels interact
• Levels interact– bottom up: how letters combine to form words– top-down: how words affect detectability of letters
![Page 28: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/28.jpg)
The Interactive Activation Model
• Three levels: feature, letter, and word level
• Nodes represent features, letters and words; each has an activation level
• Connections between nodes are excitatory or inhibitory
• Activation flows from feature to letter to word level and back to letter level
(McClelland & Rumelhart, 1981)
![Page 29: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/29.jpg)
The Interactive Activation Model
• Bottom-up:– feature to word level
• Top-down: – word to letter level
• Model predicts word superiority effect because of top-down processing
(McClelland & Rumelhart, 1981)
![Page 30: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/30.jpg)
Predictions of the IA model – stimulus is “WORK”
• At word level, evidence for “WORK” accumulates over time• Small initial increase for “WORD”
WORK
WORD
WEAR
![Page 31: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/31.jpg)
Predictions of the IA model – stimulus is “WORK”
Why does the letter “K” get activated?
a) because of (partial) activation from feature level
b) because of activation from word level back to feature level
c) both a) and b)
K
R
D
![Page 32: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/32.jpg)
Predictions of the IA model – stimulus is “WORK”
Why does the letter “R” get partially activated?
a) because of (partial) activation from feature level
b) because of activation from word level back to feature level
c) both a) and b)
K
R
D
![Page 33: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/33.jpg)
For a demo of the IA model, see:
http://www.itee.uq.edu.au/~cogs2010/cmc/chapters/LetterPerception/
![Page 34: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/34.jpg)
“Mind reading”
![Page 35: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/35.jpg)
Predicting What Somebody is Seeing (“mind reading”)
Viewing a Bottle Viewing a Shoe
If the brain response is different for different kinds of stimuli, can we predict what somebody is thinking of solely based on the brain’s response?
bold response bold response
![Page 36: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/36.jpg)
Pattern Classification Method
1. Acquire brain data for different stimuli (e.g. bottles and shoes)
2. Train a classifier (such as the neural network on right) to discriminate between bottle voxel patterns and shoe voxel patterns
3. Test classifier on novel images
(slide from Ken Norman)
bottle shoe
Input Layer (voxels)
Output layer(categories)
![Page 37: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/37.jpg)
Faces
Cats
Scissors
Chairs
Houses
Bottles
Shoes
Scrambled Pictures
slides courtesy of Jim Haxby
Haxby et al. (2001)can predict with 96% accuracy stimuli from 8 categories
![Page 38: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/38.jpg)
Reconstructing the Mental Image
• If we can predict what somebody is looking at, can we also reconstruct what somebody might be looking at from just the brain’s response?
Image Brain’s responseMathematical
Model Reconstructed image
![Page 39: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/39.jpg)
Reconstructing simple patterns from fMRIMiyawaki et al. (2008)
from: Miyawaki et al. (2008). Neuron, 60(5), pp. 915-929. movie at: http://psiexp.ss.uci.edu/research/teachingP140C/demos/mmc2.mpg
![Page 40: An aside: peripheral drift illusion illusion of motion is strongest when reading text (such as this) while viewing the image in your periphery. Blinking](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d7a5503460f94a5db3e/html5/thumbnails/40.jpg)
Brain Computer Interfaces
ATR Laboratories in Japan developed arobotic hand that can be controlledusing fMRI
Rainer Goebel’s team had two patients play mental ping-pong in fMRI machines