panoptes: a scalable architecture for video sensor networking applications wu-chi feng, brian code,...

32
Panoptes: A Scalable Panoptes: A Scalable Architecture for Video Architecture for Video Sensor Networking Sensor Networking Applications Applications Wu-chi Feng, Brian Code, Ed Kaiser, Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng Mike Shea, Wu-chang Feng (OGI: The Oregon Graduate Institute) (OGI: The Oregon Graduate Institute) Presented by Gary Huang Presented by Gary Huang March 1 March 1 st st , 2004 , 2004

Post on 18-Dec-2015

221 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

Panoptes: A Scalable Panoptes: A Scalable Architecture for Video Sensor Architecture for Video Sensor

Networking ApplicationsNetworking Applications

Wu-chi Feng, Brian Code, Ed Kaiser, Wu-chi Feng, Brian Code, Ed Kaiser,

Mike Shea, Wu-chang FengMike Shea, Wu-chang Feng

(OGI: The Oregon Graduate Institute)(OGI: The Oregon Graduate Institute)

Presented by Gary HuangPresented by Gary Huang

March 1March 1stst, 2004, 2004

Page 2: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

OutlineOutline

MotivationMotivation Video Sensor PlatformVideo Sensor Platform Video Sensor Networking ApplicationVideo Sensor Networking Application ExperimentationExperimentation Related WorkRelated Work ConclusionConclusion Future WorkFuture Work

Page 3: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

1. Motivation1. Motivation

Video sensor networking application requires video sensor:Video sensor networking application requires video sensor:

- - low power consumptionlow power consumption

- - flexible enough to support a broad range of flexible enough to support a broad range of applications and environments (scalability)applications and environments (scalability)

Panoptes sensor employed:Panoptes sensor employed:

-- a low-power, high-quality video capturing platform.a low-power, high-quality video capturing platform.- a prioritizing buffer management algorithm to save power.a prioritizing buffer management algorithm to save power.- a bit-mapping algorithm for the efficient querying and a bit-mapping algorithm for the efficient querying and

retrieval of video data.retrieval of video data.

Page 4: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

Introduce Panoptes Video Sensor in terms of:Introduce Panoptes Video Sensor in terms of:- Video Sensor Platform (Design)Video Sensor Platform (Design)

-- Video Sensor Networking Application Video Sensor Networking Application (Implementation)(Implementation)

-- Experimentation (Performance)Experimentation (Performance)

Page 5: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

2. Video Sensor Platform2. Video Sensor Platform

Design RequirementDesign Requirement Panoptes Sensor HardwarePanoptes Sensor Hardware Panoptes Sensor Software ArchitecturePanoptes Sensor Software Architecture

Page 6: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

2.1 Design Requirement2.1 Design Requirement

Low powerLow powerMinimizing power can significantly increase the Minimizing power can significantly increase the number of number of sensors that can be economically deployed.sensors that can be economically deployed.

Flexible adaptive bufferingFlexible adaptive bufferingVideo sensors should support a variety of latency and Video sensors should support a variety of latency and networking configurations, with a buffer on the sensor acting as networking configurations, with a buffer on the sensor acting as the intermediate store for the date.the intermediate store for the date.

Power ManagementPower Management-- Turn on sensor to capture as much video as it can before the Turn on sensor to capture as much video as it can before the

battery dies.battery dies.- - Turn off some components to save power when sensor is Turn off some components to save power when sensor is

idle.idle.

Page 7: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

2.2 Panoptes Sensor Hardware2.2 Panoptes Sensor Hardware

IntelStrongArm 206 MHz embedded platformIntelStrongArm 206 MHz embedded platform Logitech 3000 USB-based video cameraLogitech 3000 USB-based video camera 64 Mbytes of memory64 Mbytes of memory Linux 2.4.19 operating system kernelLinux 2.4.19 operating system kernel 802.11-based networking card802.11-based networking card

Page 8: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

Figure: Panoptes Sensor HardwareFigure: Panoptes Sensor Hardware

Approximately 7 inches long (with an 802 card inserted).Approximately 7 inches long (with an 802 card inserted). Approximately 4 inches wide.Approximately 4 inches wide.

Page 9: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

2.3 Panoptes Sensor Software Architecture2.3 Panoptes Sensor Software Architecture

Video CaptureVideo Capture FilteringFiltering CompressionCompression Buffering and AdaptationBuffering and Adaptation

Page 10: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

Figure: Panoptes Sensor Software Figure: Panoptes Sensor Software ComponentsComponents

Page 11: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

Video CaptureVideo Capture

Choose a USB-based video cameraChoose a USB-based video camera

Use the Phillips Web Camera interface with video for Use the Phillips Web Camera interface with video for LinuxLinux

Page 12: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

FilteringFiltering

Filtering uninteresting data to reduce the overhead of Filtering uninteresting data to reduce the overhead of compression or transmission.compression or transmission.

Allows a user to specify how and what data should be Allows a user to specify how and what data should be filtered.filtered.

Use a brute-force, pixel-by-pixel algorithm that detects Use a brute-force, pixel-by-pixel algorithm that detects whether or not the video has changed over time. whether or not the video has changed over time. Unchanged frames will be filtered.Unchanged frames will be filtered.

Page 13: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

CompressionCompression

JPEG and differential JPEG are set up as the compression JPEG and differential JPEG are set up as the compression format on the Panoptes platform.format on the Panoptes platform.

Compression on the Panoptes sensor is CPU bound.Compression on the Panoptes sensor is CPU bound.

- - a 320x240 4:1:1 YUV frame requires a 320x240 4:1:1 YUV frame requires approximately approximately 33 ms of CPU time.33 ms of CPU time.

Page 14: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

Buffering and AdaptationBuffering and Adaptation Important for 3 Reasons:Important for 3 Reasons:

-- be able to manage transmitting video during be able to manage transmitting video during network network congestion.congestion.- - save battery life for a long-lived scenariosave battery life for a long-lived scenario- - when buffer fills up, which data should be when buffer fills up, which data should be discarded discarded first.first.

Priority-based Streaming Mechanism:Priority-based Streaming Mechanism:-- Incoming video data are mapped to priorities Incoming video data are mapped to priorities defined defined by the applications.by the applications.-- If the buffer gets full, the algorithm starts If the buffer gets full, the algorithm starts discarding discarding data based on data priorities.data based on data priorities.-- It is important to note that the priority mapping can It is important to note that the priority mapping can be be dynamic over time.dynamic over time.

Page 15: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

Figure: A Dynamic Priority ExampleFigure: A Dynamic Priority Example

Page 16: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

3. The Little Sister Sensor Networking 3. The Little Sister Sensor Networking ApplicationApplication

The User InterfaceThe User Interface Video Sensor SoftwareVideo Sensor Software Video Aggregation SoftwareVideo Aggregation Software

Page 17: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

3.1 The User Interface3.1 The User Interface

Figure: the Little Sister Sensor Networking ApplicationFigure: the Little Sister Sensor Networking Application

Page 18: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

3.2 Video Sensor Software3.2 Video Sensor Software

A simple change detection filtering algorithmA simple change detection filtering algorithm

- - for event recognition.for event recognition.

A simple bitmapping algorithmA simple bitmapping algorithm

- - for the efficient querying and access to the stored for the efficient querying and access to the stored video data.video data.

Page 19: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

3.3 Video Aggregation Software3.3 Video Aggregation Software

Responsible for the storage and retrieval of the video data Responsible for the storage and retrieval of the video data between video sensors and clientsbetween video sensors and clients

There are 3 components within a video aggregation node.There are 3 components within a video aggregation node.

- - Camera ManagerCamera Manager

- - Query MangerQuery Manger

- - Stream ManagerStream Manager

Page 20: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

Figure: Video Aggregation SoftwareFigure: Video Aggregation Software

Page 21: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

Camera ManagerCamera Manager

Responsible for dealing with the video sensors.Responsible for dealing with the video sensors.

Register video sensors.Register video sensors.

Maximize scalability (using multiple Camera Managers).Maximize scalability (using multiple Camera Managers).

Create an event_overview_map.Create an event_overview_map.

- - Purpose: create an overview of the entire event to Purpose: create an overview of the entire event to aid aid in the efficient querying of the video data.in the efficient querying of the video data.

- - Two approaches (Union maps and Trail maps)Two approaches (Union maps and Trail maps)

Page 22: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

Figure: Union Map and Trail map ExamplesFigure: Union Map and Trail map Examples

Page 23: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

Query ManagerQuery Manager

Responsible for handling requests from clients.Responsible for handling requests from clients. Users can highlight a 16x16 pixel region.Users can highlight a 16x16 pixel region. Finds all events within the system matching the region.Finds all events within the system matching the region. Returns the list of matching events to usersReturns the list of matching events to users..

Page 24: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

Stream ManagerStream Manager

Responsible for streaming events of interest to the clients.Responsible for streaming events of interest to the clients.

Page 25: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

4. Experimentation4. Experimentation

USB PerformanceUSB Performance Compression PerformanceCompression Performance Component InteractionComponent Interaction Power measurementsPower measurements

Page 26: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

4.1 USB Performance4.1 USB Performance

For two different size of frames, the smaller frame has a For two different size of frames, the smaller frame has a larger transmission rate under a same compression level.larger transmission rate under a same compression level.

For two same size of frames, the frame has higher For two same size of frames, the frame has higher compression, the transmission rate is larger.compression, the transmission rate is larger.

Page 27: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

4.2 Compression Performance4.2 Compression Performance

Page 28: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

4.3 Component Interaction4.3 Component Interaction

Page 29: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

4.4 Power Measurements4.4 Power Measurements

Page 30: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

5. Related Work5. Related Work

Sensor Networking ResearchSensor Networking Research Mobile Power ManagementMobile Power Management Video Streaming TechnologiesVideo Streaming Technologies

Page 31: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

6. Conclusion6. Conclusion

There are a number of significant contributions:There are a number of significant contributions:- - Developed a low-power, high-quality video Developed a low-power, high-quality video capturing capturing platform.platform.- - Designed a prioritizing buffer management Designed a prioritizing buffer management algorithm algorithm to save powerto save power- - Designed a bit-mapping algorithm for the efficient Designed a bit-mapping algorithm for the efficient

querying and retrieval of video data.querying and retrieval of video data.

Buffering and adaptation algorithms manage to deal with Buffering and adaptation algorithms manage to deal with being disconnected from the network.being disconnected from the network.

Experiments show that high quality video can be captured Experiments show that high quality video can be captured fairly while a lower power is consumed like as a standard fairly while a lower power is consumed like as a standard night light running.night light running.

Page 32: Panoptes: A Scalable Architecture for Video Sensor Networking Applications Wu-chi Feng, Brian Code, Ed Kaiser, Mike Shea, Wu-chang Feng (OGI: The Oregon

7. Future Work7. Future Work

Assembling a sensor with a wind-powered generator for Assembling a sensor with a wind-powered generator for deployment along the coast of Oregon.deployment along the coast of Oregon.

Creating an open source platform that can be used by Creating an open source platform that can be used by researchers.researchers.

Working on similarity searching algorithms for the trail Working on similarity searching algorithms for the trail maps being generated.maps being generated.