49696322 smart cameras as embedded systems

8/7/2019 49696322 Smart Cameras as Embedded Systems

1/14


2/14

Smart cameras are equipped with a high-performance onboard computing and

communication infrastructure, combining

in a single embedded devicevideo sensing

processing

communications


3/14


4/14

From Analog to Digital Cameras: 1st generation surveillance: analog equipment

(closed circuit TV cameras transmitted videosignal over analog lines)

2nd generation: digital back-end components;allow real time automated analysis of incoming

data

3rd generation: complete digital transformation;video converted in digital domain at the camera

and transmitted via a computer network;cameras can also compress video to savebandwidth

Evolution


5/14

4th generation: intelligent cameras; perform low-levelimage processing operations on the captured frames

onboard to improve video compression and intelligenthost efficiency however most of the processing is done at a central unit

But smart cameras

directly perform highly sophisticated video analysis video sensing

video processing

communication

designed as reconfigurable and flexible processing nodes withself-reconfiguration, self-monitoring, and self diagnosis

capabilities.


6/14

Shift from a central to a distributed control

surveillance system Increase the surveillance systems functionality,

availability, and autonomy

Can react autonomously to changes in the systems

environment Can detected events in the monitored scenes.

A static surveillance system configuration is no

longer feasible!


7/14

Sensing unit Monochrome CMOS image sensor

delivers images with VGA resolution at up to 30 fps

transfers images via a first-in, first-out (FIFO) memory to the PU

Processing unit (PU)

Up to10

Texas Instruments TMS320

C64x DSPs can deliver an aggregate performance of up to 80 GIPS while keeping the power

consumption low

PCI bus couples the DSPs and connects them to the network processor

Communication unit network processor: Intel XScale IXP425

establishes the connection between the processing and communication units

controls internal and external communication

currently supports two interfaces for IP-based external communication: Wired Ethernet wireless Global System for Mobile Communications/general packet radio service (GSM/GPRS)


8/14


9/14

Commercial off the shelf hardwarecomponents to test and evaluate the videosurveillance system

1 cam consists of:

network processorseveral DSPs

a CMOS image sensor


10/14


11/14


12/14

Multicamera object-tracking application

Multicamera system instantiates only a single tracker (agent) task

The agent follows the tracked object migrating to the SmartCam that shouldnext observe the object

Tracking agent based on a Kanade-Lucas-Tomasi feature tracker

Main advantage is its short initialization time Applicable for multicamera object tracking by mobile agents

Tracking agents control the handover process, using predefined migration regions

When the tracked object enters a migration region, the tracker initiates handoverto the next SmartCam

Each migration region assigned to one or more possible next SmartCams

Motion vectors help distinguish among several SmartCams assigned to the samemigration migration region

Motion vectors check whether the object moves in the correct direction

A master-slave approach for the tracked object handover

Tracking agents migration between SmartCams takes up to 1 second

Task-allocation systems setup timeapproximately 190 milliseconds


13/14


14/14

Conclusions

Keys to successful deployment of smart

cameras are:the integration of sensing, computing, and

communication in a small, power-aware

embedded device

the availability of high-level image/video

processing algorithms

System usage:

traffic surveillance

detection of stationary vehicles

detection of wrong-way drivers

computation of average speed,lane occupancy

49696322 smart cameras as embedded systems

Documents