ubiq – low bandwidth visual communication

Exploratory Computer Vision Group

© 2007 IBM Corporation

Jonathan H. ConnellExploratory Computer Vision GroupIBM T. J. Watson Research CenterHawthorne, NY 10532

UBIQ – Low Bandwidth Visual Communication

Exploratory Computer Vision Group

© 2007 IBM Corporation

UBIQ = The expert can be everywhere

Hybrid solution– Send out medium-skilled person for quick fix in most cases

– Call back to main office for more difficult problems

“Beaming in” the expert– Sometimes verbal communications is insufficient

– Pictures can be sent but take a long time to transmit

– Person in the field might take picture of wrong aspect

Provide a real-time “viewfinder” mode to allow expert to quickly snap the right picture on a remote mobile phone

Field service dilemma (e.g. repair):– Most problems have simple solutions

– Some field-service problems require experts

– Experts are expensive, want to utilize effectively

– Medium-skilled labor can fix many problems

Exploratory Computer Vision Group

© 2007 IBM Corporation

Scenario: fixing a copier

Local maintenance guy shows up promptly– Checks for correct paper & toner level

Expert asks for view of “fuser roller”– “What’s that?” – Local person uses video mode to

get to correct location

Customer calls in problem = streaks on paper

Calls back to home office for advice– Shows paper markings

Expert snaps image and examines

– Fix problem by using alcohol wipe on this component (marked)

… there.

Open the side …

… closer …

Exploratory Computer Vision Group

© 2007 IBM Corporation

Value Proposition

End Users

Lower cost of operations– No expense for cars, plane trips, lodging …

Right brain at the right place quickly– Can easily change experts if needed

– No delays due to flights, visa approval …

– Increases customer satisfaction

Better leverage existing expertise– No time lost on travel (or getting lost)

Bigger expert recruitment pool– No onerous travel or relocation

– Social skills less important

Telcos

Differentiated offering– No one else has this cool capability

– New Value-Added-Service application to increase stickiness

Focus on (more lucrative) enterprise customer base

Optimized use of data network

Supports higher usage data traffic– Offset by increased (worker) productivity

Exploratory Computer Vision Group

© 2007 IBM Corporation

Deployment Model (Telco OEM)

Build software

PC client

Mobile server

customize implementation

for Telco

IBMTelco

Offers application to

enterprise customers

Samsung

Hospital

Ricoh

…

…

…

Exploratory Computer Vision Group

© 2007 IBM Corporation

Summary

Looking for Deployment model

Customers (telco and/or end user)

Catcher or partner for technology transfer

Current status Research project (unfunded)

Working on more specialized codecs– Hybrid lines + blobs– Spatially varying resolution– Camera tracking partial stills– Quick remote zoom refinement

Single platform implementation– Windows XP (PC client) – Windows Mobile 5.0 (Smartphone server)

Covered under US patent 7,219,364

Demo possible (see wiki)

Exploratory Computer Vision Group

© 2007 IBM Corporation

Demo – click here to play