Transparent Object Reconstruction via Coded Transport of Intensity

Supplemental Video

Paper ID: 846

Turb

ulen

ce /

Gas

Flam

eW

ater

Gla

ss

Transparent Objects

Aero

nauti

cal

Engi

neer

ing

ApplicationsG

raph

ic R

ende

ring

Live

Cel

l Im

agin

g

Light Field Probes

Intrusive Methods

Wet

zste

in e

t al.,

ICCP

201

1

Schlieren Imaging

Yu e

t al.,

CVP

R 20

13At

ches

on e

t al.,

SIG

GRA

PH A

sia

2008

Impe

rical

Col

lege

Lod

on

Hul

lin e

t al.,

SIG

GRA

PH 2

008

Trifo

nov

et a

l., E

GSR

200

6Related Work

Non-intrusive Methods

Collimated Coded Illumination

Moveable Sensor PlaneObject

Our Method

We propose to reconstruct transparent object using two different intensity projections based on transport of intensity equation.

Transport of Intensity

( )( ( ) ( , ) )

c

I xI x n x z ds

z x

In Volumetric Object Case: In Thin Object Case:

( )( ( ) ( ))

I xI x n x

z x

( )( , )

v

zz

I xv l x v dv

z x

Obtaining Outgoing Light Field via Transport of Intensity Equation

Collimated Coded Illumination

Moveable Sensor PlaneObject

Estimate Ray-ray Correspondences Using Spatial Intensity Codes

Light Path ApproximationCollimated

Coded IlluminationMoveable

Sensor PlaneObject

( )I x const ( )I x CodedPattern

Tomographic Volume ReconstructionCollimated

Coded IlluminationMoveable

Sensor PlaneObject

Rotating

Diff

eren

tpe

rspe

ctive

s

3D V

olum

e

Collimated Coded Illumination Moveable Sensor Plane

Object

Sensor 1

Sensor 2

Illumination 2

Illumination 1

Sensor 3

Illumination 3

Dynamic Volume Reconstruction

…

…

…

…

Experimental Results

Simulation Results: Thin refractive objectSi

mul

ation

Setti

ngRe

cons

truc

tion

Target Object

Simulation Results: Homogeneous Volume

Reconstructed 2D Projections of 3D Refractive Index Field

Simulation Results: Homogeneous Volume

Reconstructedvolume

Target Object

Simulation Results: Inhomogeneous Volume

Reconstructed Isosurface and Refractive Index Field

Target Object

Our Prototype

ProjectorRefractive sample

CollimatinglensCamerasBeam splitter

& screens

Prototype Result: Thin refractive objectTa

rget

Obj

ect

Reco

nstr

ucte

dRe

nder

ed

Prototype Result: Dynamic refractive index fields

Targ

et O

bjec

t

Reco

nstr

ucte

d

Imag

e Pa

irs

Imag

e Pa

irs

Prototype Result: Refractive Volumetric Reconstruction

Reco

nstr

ucte

dvo

lum

e

Targ

et O

bjec

t

Reconstructed Refractive Index

Surface Reconstruction

-90° -45° 0° 45° 90°