effect of test patch location on color appearance, in the context of 3d objects bei xiao and david...
TRANSCRIPT
![Page 1: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/1.jpg)
Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects
Bei Xiao and David H.Brainard
University of Pennsylvania
![Page 2: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/2.jpg)
What Color is the Mug?
![Page 3: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/3.jpg)
Most Appearance Studies Consider Flat Uniform Patches
![Page 4: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/4.jpg)
Highlight
Inter-reflection Inter-reflection
A Complex Pattern of Light is Reflected from 3D Objects
![Page 5: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/5.jpg)
Surface Gloss Increases the Variation of Reflected Light
![Page 6: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/6.jpg)
How do people perceive the color of different parts of an object?
Questions
How do material properties of the object affect color perception?
![Page 7: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/7.jpg)
Task: Asymmetric Color Matching
Test Match
![Page 8: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/8.jpg)
Task: Asymmetric Color Matching
Adjusting!
Test Match
![Page 9: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/9.jpg)
Task: Asymmetric Color Matching
Adjusting!
Test Match
![Page 10: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/10.jpg)
Task: Asymmetric Color Matching
Adjusting!
Test Match
![Page 11: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/11.jpg)
Task: Asymmetric Color Matching
Adjusting!
Test Match
![Page 12: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/12.jpg)
Task: Asymmetric Color Matching
Adjusting!
Test Match
![Page 13: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/13.jpg)
Task: Asymmetric Color Matching
Test Match
Done!
![Page 14: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/14.jpg)
Rendering Methods
Images are rendered wavelength by wavelength using customized Matlab software (RenderToolbox). The underlying renderer is Radiance.
RenderToolbox is available at www.rendertoolbox.org.
![Page 15: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/15.jpg)
Ward Model of Surface Reflection
Specular Component (material properties)
Diff
use
Co
mp
on
ent (
bo
dy
colo
r)
![Page 16: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/16.jpg)
Experimental Variables: Location, Material, Color
Material
Color
Location
![Page 17: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/17.jpg)
Results: Pictorial Representation
Mean Up
Match Up
Mean Bottom
Match Bottom
Test Up
Test Bottom
![Page 18: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/18.jpg)
Results: Pictorial Representation
Match Up
Match Bottom
Test Up
Mean Up
Test Bottom
Mean Bottom
![Page 19: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/19.jpg)
Results: Pictorial Representation
Test Up
Mean Up
Match Up
Test Bottom
Mean Bottom
Match Bottom
![Page 20: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/20.jpg)
Match Bottom
Results: Pictorial Representation
Test Up
Mean Up
Match Up
Test Bottom
Mean Bottom
![Page 21: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/21.jpg)
Match Bottom
Results: Pictorial Representation
Test Up
Mean Up
Match Up
Test Bottom
Mean Bottom
![Page 22: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/22.jpg)
Match Bottom
Results: Pictorial Representation
Test Up
Mean Up
Match Up
Test Bottom
Mean Bottom
![Page 23: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/23.jpg)
Preliminary Conclusions
Changing test patch location of an object has a small effect on color perception of the patch.
This is not predicted by the average of the light reflected from the patch.
Effect of surface material properties on color perception of the patch is also small.
![Page 24: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/24.jpg)
Quantitative Data Representation
test
mean
Xiao, B. and Brainard, D.H. (under review) Visual Neuroscience
![Page 25: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/25.jpg)
Transformed Data Representation
test
mean
![Page 26: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/26.jpg)
Transformed Data Representation
test
mean
match
![Page 27: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/27.jpg)
Transformed Data Representation
test
mean
match
![Page 28: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/28.jpg)
Transformed Data Representation
test
mean
match
![Page 29: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/29.jpg)
Transformed Data Representation
test
mean
match
![Page 30: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/30.jpg)
Transformed Data Representation
test
mean
match
![Page 31: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/31.jpg)
Soccer Ball Experiment, More Data
![Page 32: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/32.jpg)
Location Effect Index (LEI)
up
bottom
Vt
Vm
For each material condition: LEI = [ |Vm| / |Vt| ]
test
mean
match
![Page 33: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/33.jpg)
LEI Histograms
Corrected mean: Purple = 0.09
Yellow-green = 0.13
![Page 34: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/34.jpg)
Material Influence Index (MII)
For each mach: MII = [ |Vm| / |Vt| ]
matte
glossytest
mean
match
Vt
Vm
![Page 35: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/35.jpg)
MII Histograms
Corrected mean: Purple = 0.17
Yellow-green = 0.13
![Page 36: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/36.jpg)
Conclusions
Effect of location is small in comparison with the mean prediction. This suggests color appearance is stable across different parts of an object.
Matches are not predicted by the average of the light reflected across the image of the object.
We’re interested in the color appearance of 3D objects in rich scenes.
Surface gloss has a small effect on color perception of the test patch on 3D objects when the diffuse component is constant.
![Page 37: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/37.jpg)
Prof. David H. Brainard
Ah Rim Shin
Lu Yin
Dan Lichtman
Dr. Sarah Allred
Prof. James Hillis
Dr. Robyn Oliver
Chris Broussard
Acknowledgement
![Page 38: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/38.jpg)
Implications For Models
Image-statistics: Use image mean, skewness, percentiles to estimate diffuse reflectance (body color).
Inverse-optics: estimating geometry of the light source and use the estimated geometry to infer diffuse reflectance.
![Page 39: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/39.jpg)
Design: Test Patch Location Effect
![Page 40: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/40.jpg)
Results: Pictorial Representation
Test Up
Match Up
Mean Up
Test Bottom
Match Bottom
Mean Bottom
![Page 41: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/41.jpg)
Results: Pictorial Representation
Test Up
Match Up
Mean Up
Test Bottom
Match Bottom
Mean Bottom
![Page 42: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/42.jpg)
Results: Pictorial Representation
Test Up
Match Up
Mean Up
Test Bottom
Match Bottom
Mean Bottom
![Page 43: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/43.jpg)
CIELAB Representation of Test Stimuli
![Page 44: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/44.jpg)
LEI Histograms, Compared with Residuals
![Page 45: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/45.jpg)
Material Influence Index (LEI)
![Page 46: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/46.jpg)
![Page 47: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/47.jpg)
Results: Pictorial Representation
Test Up
Match Up
Mean Up
Test Bottom
Match Bottom
Mean Bottom
![Page 48: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/48.jpg)
Results: Pictorial Representation
Test Up
Match Up
Mean Up
Test Bottom
Match Bottom
Mean Bottom
![Page 49: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/49.jpg)
Results: Pictorial Representation
Test Up
Match Up
Mean Up
Test Bottom
Match Bottom
Mean Bottom
![Page 50: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/50.jpg)
Results: Pictorial Representation
Test Up
Match Up
Mean Up
Test Bottom
Match Bottom
Mean Bottom
![Page 51: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/51.jpg)
Results: Pictorial Representation
Test Up
Match Up
Mean Up
Test Bottom
Match Bottom
Mean Bottom
![Page 52: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/52.jpg)
Results: Pictorial Representation
Test Up
Match Up
Mean Up
Test Bottom
Match Bottom
Mean Bottom
![Page 53: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/53.jpg)
Results: Pictorial Representation
Test Up
Match Up
Mean Up
Test Bottom
Match Bottom
Mean Bottom
![Page 54: Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania](https://reader034.vdocument.in/reader034/viewer/2022051614/5518c2e7550346881f8b56af/html5/thumbnails/54.jpg)
Results: Pictorial Representation
Test Up
Match Up
Mean Up
Test Bottom
Match Bottom
Mean Bottom