effect of test patch location on color appearance, in the context of 3d objects

54
Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects Bei Xiao and David H.Brainard University of Pennsylvania

Upload: courtney-rogers

Post on 01-Jan-2016

25 views

Category:

Documents


1 download

DESCRIPTION

Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects. Bei Xiao and David H.Brainard University of Pennsylvania. What Color is the Mug?. Most Appearance Studies Consider Flat Uniform Patches. A Complex Pattern of Light is Reflected from 3D Objects. Highlight. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Effect of Test Patch Location on Color Appearance, in the Context of 3D Objects

Bei Xiao and David H.Brainard

University of Pennsylvania

Page 2: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

What Color is the Mug?

Page 3: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Most Appearance Studies Consider Flat Uniform Patches

Page 4: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Highlight

Inter-reflection Inter-reflection

A Complex Pattern of Light is Reflected from 3D Objects

Page 5: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Surface Gloss Increases the Variation of Reflected Light

Page 6: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

How do people perceive the color of different parts of an object?

Questions

How do material properties of the object affect color perception?

Page 7: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Task: Asymmetric Color Matching

Test Match

Page 8: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Task: Asymmetric Color Matching

Adjusting!

Test Match

Page 9: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Task: Asymmetric Color Matching

Adjusting!

Test Match

Page 10: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Task: Asymmetric Color Matching

Adjusting!

Test Match

Page 11: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Task: Asymmetric Color Matching

Adjusting!

Test Match

Page 12: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Task: Asymmetric Color Matching

Adjusting!

Test Match

Page 13: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Task: Asymmetric Color Matching

Test Match

Done!

Page 14: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Rendering Methods

Images are rendered wavelength by wavelength using customized Matlab software (RenderToolbox). The underlying renderer is Radiance.

RenderToolbox is available at www.rendertoolbox.org.

Page 15: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Ward Model of Surface Reflection

Specular Component (material properties)

Diff

use

Co

mp

on

ent (

bo

dy

colo

r)

Page 16: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Experimental Variables: Location, Material, Color

Material

Color

Location

Page 17: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Results: Pictorial Representation

Mean Up

Match Up

Mean Bottom

Match Bottom

Test Up

Test Bottom

Page 18: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Results: Pictorial Representation

Match Up

Match Bottom

Test Up

Mean Up

Test Bottom

Mean Bottom

Page 19: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Results: Pictorial Representation

Test Up

Mean Up

Match Up

Test Bottom

Mean Bottom

Match Bottom

Page 20: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Match Bottom

Results: Pictorial Representation

Test Up

Mean Up

Match Up

Test Bottom

Mean Bottom

Page 21: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Match Bottom

Results: Pictorial Representation

Test Up

Mean Up

Match Up

Test Bottom

Mean Bottom

Page 22: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Match Bottom

Results: Pictorial Representation

Test Up

Mean Up

Match Up

Test Bottom

Mean Bottom

Page 23: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Preliminary Conclusions

Changing test patch location of an object has a small effect on color perception of the patch.

This is not predicted by the average of the light reflected from the patch.

Effect of surface material properties on color perception of the patch is also small.

Page 24: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Quantitative Data Representation

test

mean

Xiao, B. and Brainard, D.H. (under review) Visual Neuroscience

Page 25: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Transformed Data Representation

test

mean

Page 26: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Transformed Data Representation

test

mean

match

Page 27: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Transformed Data Representation

test

mean

match

Page 28: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Transformed Data Representation

test

mean

match

Page 29: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Transformed Data Representation

test

mean

match

Page 30: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Transformed Data Representation

test

mean

match

Page 31: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Soccer Ball Experiment, More Data

Page 32: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Location Effect Index (LEI)

up

bottom

Vt

Vm

For each material condition: LEI = [ |Vm| / |Vt| ]

test

mean

match

Page 33: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

LEI Histograms

Corrected mean: Purple = 0.09

Yellow-green = 0.13

Page 34: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Material Influence Index (MII)

For each mach: MII = [ |Vm| / |Vt| ]

matte

glossytest

mean

match

Vt

Vm

Page 35: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

MII Histograms

Corrected mean: Purple = 0.17

Yellow-green = 0.13

Page 36: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Conclusions

Effect of location is small in comparison with the mean prediction. This suggests color appearance is stable across different parts of an object.

Matches are not predicted by the average of the light reflected across the image of the object.

We’re interested in the color appearance of 3D objects in rich scenes.

Surface gloss has a small effect on color perception of the test patch on 3D objects when the diffuse component is constant.

Page 37: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Prof. David H. Brainard

Ah Rim Shin

Lu Yin

Dan Lichtman

Dr. Sarah Allred

Prof. James Hillis

Dr. Robyn Oliver

Chris Broussard

Acknowledgement

Page 38: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Implications For Models

Image-statistics: Use image mean, skewness, percentiles to estimate diffuse reflectance (body color).

Inverse-optics: estimating geometry of the light source and use the estimated geometry to infer diffuse reflectance.

Page 39: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Design: Test Patch Location Effect

Page 40: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Results: Pictorial Representation

Test Up

Match Up

Mean Up

Test Bottom

Match Bottom

Mean Bottom

Page 41: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Results: Pictorial Representation

Test Up

Match Up

Mean Up

Test Bottom

Match Bottom

Mean Bottom

Page 42: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Results: Pictorial Representation

Test Up

Match Up

Mean Up

Test Bottom

Match Bottom

Mean Bottom

Page 43: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

CIELAB Representation of Test Stimuli

Page 44: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

LEI Histograms, Compared with Residuals

Page 45: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Material Influence Index (LEI)

Page 46: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects
Page 47: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Results: Pictorial Representation

Test Up

Match Up

Mean Up

Test Bottom

Match Bottom

Mean Bottom

Page 48: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Results: Pictorial Representation

Test Up

Match Up

Mean Up

Test Bottom

Match Bottom

Mean Bottom

Page 49: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Results: Pictorial Representation

Test Up

Match Up

Mean Up

Test Bottom

Match Bottom

Mean Bottom

Page 50: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Results: Pictorial Representation

Test Up

Match Up

Mean Up

Test Bottom

Match Bottom

Mean Bottom

Page 51: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Results: Pictorial Representation

Test Up

Match Up

Mean Up

Test Bottom

Match Bottom

Mean Bottom

Page 52: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Results: Pictorial Representation

Test Up

Match Up

Mean Up

Test Bottom

Match Bottom

Mean Bottom

Page 53: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Results: Pictorial Representation

Test Up

Match Up

Mean Up

Test Bottom

Match Bottom

Mean Bottom

Page 54: Effect of Test Patch Location on Color Appearance,  in the Context of 3D Objects

Results: Pictorial Representation

Test Up

Match Up

Mean Up

Test Bottom

Match Bottom

Mean Bottom