symbolic light: enabling single-shot 3d cameras...symbolic light: enabling single-shot 3d cameras ....

17
Symbolic Light: Enabling Single-Shot 3D Cameras Dr. Benjamin Braker Chiaro Technologies 3D Cameras Symbolic light Motion-capable 3D techniques Cloudburst symbolic light data

Upload: others

Post on 13-Jul-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

Symbolic Light: Enabling Single-Shot 3D Cameras

Dr. Benjamin Braker Chiaro Technologies

• 3D Cameras • Symbolic light • Motion-capable 3D techniques • Cloudburst symbolic light data

Page 2: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

3D CAMERA MARKET

Page 3: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

WHAT TYPE OF 3D DO YOU NEED? DEPTH MAPS, POINT CLOUDS, ETC

RGB Image

Depth map (Z-only)

Point-cloud (X,Y,Z)

Page 4: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

SYMBOLIC LIGHT: OVERVIEW

• Camera & projector • Pattern is 30-50k laser

beams as symbols. • Each beam is detected,

identified, & located in 1 image frame

Page 5: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

SYMBOLIC LIGHT 3D: TRIANGULATION

Bandwidth or phase resolution limited

Depth resolution of angle measurements depends on distance vs. baseline

Spatial resolution limited

Page 6: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

STEREO COMPARISON

Resource intensive Performance challenges • Two cameras • High performance requires

significant processing • Synch/ bandwidth/ buffers

• Block size smoothing • Dark or featureless scenes • Perspective limited • Doubled noise & speckle • Specular reflections

Can be Passive!

Page 7: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

CHOOSING 3D TECHNOLOGIES

Page 8: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

SYMBOLIC LIGHT TRADEOFFS

Technology limits • Motion capable costs resolution • Transparent/ obstructed objects • Single-shot dynamic range Product limits (trade-offs) • Measurement density • FOV & maximum range • Precision/ accuracy • Calibration • Shutter speed/ algorithm settings

Page 9: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

SYMBOLIC LIGHT DATA: CLOUDBURST SYSTEMS

• Motion-capable example

• Dynamic lighting example

• Accuracy & precision example

• Scanning example

Page 10: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

MOTION CAPABLE SYMBOLIC LIGHT

• 3D measurements from 1 frame

• Motion is frozen by the shutter speed

Page 11: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

DYNAMIC LIGHTING

• Multiple sources • Sunlight and shadow • Measurement must be

insensitive to changing conditions

Page 12: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

SYMBOLIC LIGHT & DYNAMIC LIGHTING

• 3D measurements require 1 frame

• More frames remove ambient light artifacts and/or shading.

• Still motion-capable.

Page 13: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

MEASUREMENTS REQUIRE ACCURACY

• Calibrated Cloudburst symbolic light systems deliver accurate 3D measurements

• Symbolic light measurements deliver sub-pixel XYZ precision.

Page 14: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

SYMBOLIC LIGHT: ACCURACY AND PRECISION

• Method: Measure many planes at known depth. • Result: Measurements are accurate & precise.

Page 15: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

APPLICATION NOTE: A SYMBOLIC LIGHT SCANNER

• While Symbolic Light 3D data is sparse, this approach allows for scanning.

• Result is like having 33,000 laser point scanners.

Page 16: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

THANK YOU

Cloudburst 3D Camera

Symbolic light offers a unique 3D method. • Motion capable • Robust to lighting • Factory calibrated for accuracy & precision • Robust to object colors/shading • Reduced processing/bandwidth/etc. cost

Benjamin Braker CTO & Co-Founder 303-554-0557 [email protected]

Page 17: Symbolic Light: Enabling Single-Shot 3D Cameras...Symbolic Light: Enabling Single-Shot 3D Cameras . Dr. Benjamin Braker . Chiaro Technologies • 3D Cameras • Symbolic light •

A1: 3D & SPEED