Advanced Image Processing

Lecture 3 - Overview of Smart Camera Networks

01/21/10

Sensornetwork

- Low cost- Small size- Power constraint- Computational limited- Bandwidth limited- Certain degree of intelligence

Internet vs. Sensornet

To be able to understand, monitor, and interact with the physical world (real world) in a timely, intelligent, and reliable fashion.

Application examples• Hubble telescope (every 5 to 10 ft)• Structuring health monitoring (SHM)

– Bridge– Space shuttle

• Environmental monitoring– Bio/chemical agent detection

• Biosensors for human health monitoring

• Remote surveillance– Battlefield– Hazardous area

NASA Tech Briefs, January 2001.

Sensor node architecture

Location finding system Mobilizer

Sensor ADCProcessorStorage

Transceiver

Power unit

Sensing unit Processing unit

sGate sensor node(Sensoria)

UCB mote (Crossbow)

Communication unit

Power unit

Sensor network protocol stack

Application layer(CSIP)

Transport layer

Network layer

Data link layer (MAC)

Physical layer

Ta

sk ma

nag

eme

nt plane

Mo

bility m

an

age

me

nt p

lan

e

Po

we

r man

ag

emen

t plane

• Application-oriented- Task-adaptive- Mission-oriented

• Energy-efficient

I. F. Akyildiz, W. Su, Y. Sankarasubramaniam, E. Cayirci. A survey on sensor networks. IEEE Communications Magazine, 40(8):102-114, August 2002.

Collaborative Processing concerns: Lower-power communication and computation Space-time processing Distributed and fault-tolerant algorithms Adaptive systems Sensor fusion Decision theory

Eliminate redundancy

Need redundancy

Two contradictory requirements• Energy-efficiency

– Operating system– Communication– Routing – Computing – etc.

• Fault-tolerance– Robust response– compensation

Collaborative vs. Distributed vs. Decentralized

• Collaboration among neighbors

• Distributed processing

• Decentralized processing

http://www.cs.virginia.edu/~adw5p/conferences.html

Conferences

• Directly related to CSIP– IPSN

• Debut: 2001

• Due: Nov, Conf: Apr

• http://ipsn.acm.org

– DCOSS • Debut: 2005

• Due: Feb, Conf: Jun

• http://www.dcoss.org/

– ICDSC• Debut: 2007

• Due: Mar, Conf: Sept

• http://www.icdsc.org

• Directly related to SN– SenSys

• Debut: 2003• Due: Apr, Conf: Nov• http://sensys.acm.org

– SECON• Debut: 2004• Due: Dec, Conf: Jun• http://www.ieee-secon.org/

– MobiHoc• Debut: 2000• Due: Nov, Conf: May• http://www.sigmobile.org/

mobihoc

– MASS• Debut: 2003 (???)• http://www.cse.psu.edu/

IEEEMASS08/

Journals

• ACM Transactions on Sensor Networks– http://tosn.acm.org/– Debut: August 2005– Publisher: ACM

• International Journal of Distributed Sensor Networks– http://www.informaworld.com/smpp/title~content=t714578688

~link=cover– Debut: 2005– Publisher: Taylor & Francis

• International Journal of Sensor Networks– http://www.inderscience.com/browse/index.php?

journalCODE=ijsnet– Debut: 2006– Publisher: Inderscience

Special issues• J-STSP

– SI on Distributed Processing in Vision Networks, vol. 2, no. 4, August 2008

• PIEEE– SI on Distributed Smart Cameras, vol. 96, no. 10, October 2008

• CVIU– SI on Multi-camera and Multi-modal Sensor Fusion, 1st quarter, 2010

• TIP– SI on Distributed Camera Networks: Sensing, Processing, Communication and

Computing, June 1, 2010

• EURASIP-Journal on Image and Video Processing– SI on Multicamera Information Processing: Acquisition, Collaboration,

Interpretation, and Production, June 1, 2010

• IEEE-SPM – SI on Distributed Image Processing and Communications, May 2011

• ACM TOMCCAP– SI on Multimedia Sensor Fusion, Fall 2010

• Ad Hoc Networks (Elsevier)– SI on Multimedia Ad Hoc and Sensor Networks, May 2010

Groups

• Wireless Sensor Networks Laboratory (WSNL)– http://wsnl.stanford.edu– Andrea Goldsmith and Hamid Aghajan

Books

• S. Phoha, T. F. LaPorta, Sensor Network Operations, Wiley-IEEE Press, 2005

• R. Brooks, S. S. Iyengar, Frontiers in Distributed Sensor Networks, CRC Press, 2004

• F. Zhao, L. Guibas, Wireless Sensor Network, Morgan Kaufmann, 2004.

Challenges in SCNs (Smart Camera Networks)

• The coverage problem– Directional sensing vs. Omni-directional sensing– Occlusion vs. no occlusion

• The clustering problem– Geographical neighbor vs. Semantic neighbor– Content-based neighbor search

• The data aggregation problem– What to propagate? (application oriented)– Distributed protocol?

• The application development– Target detection and localization– Target tracking