inference of non-overlapping camera network topology by measuring statistical dependence
DESCRIPTION
Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence. Date : 2009.01.21. Motivation. With the price of camera devices getting cheaper, the wide-area surveillance system is becoming a trend for the future. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/1.jpg)
Inference of Non-Overlapping Inference of Non-Overlapping
Camera Network Topology by Camera Network Topology by Measuring Statistical Measuring Statistical
DependenceDependence
Date : 2009.01.21
![Page 2: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/2.jpg)
MotivationWith the price of camera devices getting
cheaper, the wide-area surveillance system is becoming a trend for the future.
For the purpose of achieving the wide-area surveillance, there is a big problem we need to take care : non-overlapping FOVs.
![Page 3: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/3.jpg)
Non-overlapping FOVsMore practical in the real wordBut we begin to bump into many problems…
- Correspondence between cameras, but the difference view angles of camera may enhance the difficulty
- Hard to do the calibration, so we may not have the information of relative positions and orientations between cameras
![Page 4: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/4.jpg)
Correspondence btw Cameras Means we have to indentify the same object
in different cameras.Usually by space-time and appearance
feature.But actually in wide-area surveillance,
because cameras may be widely separated and objects may occupy only a few pixels, so is difficult to solve.
![Page 5: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/5.jpg)
View from Another AngleTo link the objects across no-overlapping
FOVs, we need to know the connectivity of movement between FOVs.
Turn into the problem of finding the topology of the camera network.
![Page 6: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/6.jpg)
What’s our goal now?Want to determine the network structure
relating cameras, and the typical transitions between cameras, based on noisy observations of moving objects in the cameras.
Departure and arrival locations in each camera view are nodes in the network. An arc between a departure node and an arrival node denotes connectivity (like transition)
![Page 7: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/7.jpg)
First Consider a simple case…
![Page 8: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/8.jpg)
What feature can we use?Object occupy little pixels Appearance may
failsSpace relationship btw cameras unknown
Space may failsAha! Time may be a good feature to use!
![Page 9: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/9.jpg)
The model
T
Departure and arrival locations in each camera view are nodes in the network. An arc between a departure node and an arrival node denotes connectivity Transition Time Distribution
![Page 10: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/10.jpg)
Problem FormulationNow, given departure and arrival time
observations X and Y, they are connected by the transition time T.
T
![Page 11: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/11.jpg)
Main HypothesisIf camera are connected, the arrival time Y
might be easily predict from departure time X. There is a regularity between X and Y Given the correspondence, the transition time distribution is highly structured Dependence between X and Y is strong
![Page 12: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/12.jpg)
Problem FormulationHow do we measure the dependency ?By Mutual Information !
write in terms of entropy…
![Page 13: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/13.jpg)
Problem Formulation
Since from the graphical model, we have Y = T(X) Y = X + T (assumed X indept. with T) Therefore relate h(Y|X) to the entropy of T h(Y|X) = h(X+T|X) = h(T|X) = h(T)
T
![Page 14: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/14.jpg)
Problem FormulationWe get I(X;Y) = h(Y) – h(T)
maximizing statistical dependence is the same as minimizing the entropy of the distribution of transformation T
Distribution of T is decided by the matching π between X and Y ! (π is a permutation for correspondence btw X and Y)
![Page 15: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/15.jpg)
Problem FormulationSo what we want to do now is trying to find
the matching ((xi, yπ(i))) whose transition time distribution have lowest entropy maximum dependence
But how to compute the entropy? by Parzen density estimater
![Page 16: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/16.jpg)
Problem FormulationOkay, but how to find the matching ((xi,
yπ(i)))? It’s a NP hard problem…
Look for approximation algorithms Markov Chain Monte Carlo (MCMC)
Briefly, MCMC is a way to draw samples from the posterior distribution of matchings given the data.
![Page 17: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/17.jpg)
Markov Chain Monte CarloWe use the most general MCMC algorithm
Metropolis-Hastings Sampler
![Page 18: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/18.jpg)
Markov Chain Monte CarloThe key to the efficiency of an MCMC
algorithm is the choice of proposal distribution q(.) . Here we use 3 types of proposals for sampling matches: 1 . Add 2. Delete 3. Swap
The new sample is accepted with probability proportional to the relative likelihood of the new sample vs. the current one. The likelihood of a correspondence is proportional to the log probability of the corresponding transformations.
![Page 19: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/19.jpg)
Missing MatchesBut actually not all the observations in X and
Y will be matched, but contain missing matches. (some xi may not have corresponding yπ(i))
Consider missing data as outliers, and model the distribution of transformations as a mixture of the true and outlier distributions.
Usually use a uniform outlier distribution
![Page 20: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/20.jpg)
Results
![Page 21: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/21.jpg)
Results
![Page 22: Inference of Non-Overlapping Camera Network Topology by Measuring Statistical Dependence](https://reader036.vdocument.in/reader036/viewer/2022070413/56814d51550346895dba878c/html5/thumbnails/22.jpg)
Results