attenuating natural flicker patterns yoav y. schechner nir karpel support: taub foundation,...

13
Attenuating Natural Flicker Patterns Yoav Y. Schechner Nir Karpel Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF Ack: Yoav Fhiler, Naftali Blau, Nir Geva Dept. Elect. Eng . Technion – Israel Institute of Technology

Post on 22-Dec-2015

223 views

Category:

Documents


0 download

TRANSCRIPT

Attenuating Natural Flicker Patterns

Yoav Y. Schechner

Nir Karpel

Support: Taub Foundation, Ollendorff Foundation (BMBF), ISF

Ack: Yoav Fhiler, Naftali Blau, Nir Geva

Dept. Elect. Eng.Technion – Israel Institute of Technology

Spatio-Temporal Illumination Patterns

Y. Schechner & N. Karpel, Attenuating flicker

• Spatially nonuniform illumination• Temporally varying illuminaton• May disrupt computer-vision

Spatio-Temporal Patterns

Y. Schechner & N. Karpel, Attenuating flicker

Spatiotemporal pattern = Caustic networks = Flicker

Dependency on Depth: Normalized-Amplitude

Y. Schechner & N. Karpel, Attenuating flicker

strong flicker at shallow depths

strong flicker when very deep

Walker 1994

Marine Light Field Statistics

Y. Schechner & N. Karpel, Attenuating flicker

Dependency on Depth: Temporal Frequency

z

z

1max ~

Walker 1994

Marine Light Field Statistics

max

Inte

nsity

1 Hz 2 Hz 3 Hz

Broadband Temporal Spectrum

Conclusion: Need seconds to average out flicker

Walker 1994

Marine Light Field Statistics

z

1What Do We Want?

we need seconds to average out flicker

but for video…

we want O(0.1 sec) to eliminate flicker

linear method

nonlinear method

Y. Schechner & N. Karpel, Attenuating flicker

Failure of Trivial Methods

Raw frames

Y. Schechner & N. Karpel, Attenuating flicker

spatial derivative

temporal median

integration

Weiss 2001Matsushita et. al. 2002

Shadow Removal in Open Air

median of derivative

Hypothesis: A similar method can be applied

to handle underwater flicker

Distinguishing aspects

DC (mean energy) value: implication to color

Very frequent changes (spatially and temporally)

Gradual changes (spatially and temporally)

Veiling light (not multiplicative)

Spatio-Temporal Patterns

Y. Schechner & N. Karpel, Attenuating flicker

Raw frames

Flicker-removed

Spatio-Temporal Patterns

Flicker-removed

Raw frames

Y. Schechner & N. Karpel, Attenuating flicker

Not a Final Word

Stabilize illumination

This is heuristic.

…Place for better sophistication?

Yoav Schechner & Nir Karpel