forward-scan sonar tomographic reconstruction phd filter multiple target tracking dec1@hw.ac.uk...

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Bayesian Multiple Target Tracking in Forward Scan Sonar Images Using The PHD Filter

Daniel Clark and Judith Bell

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Thesis Topic: “Tomographic Reconstruction of a Sequenceof Forward Scan Sonar Images”

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Thesis Topic: “Tomographic Reconstruction of a Sequenceof Forward Scan Sonar Images”

Problems to Address:

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Thesis Topic: “Tomographic Reconstruction of a Sequenceof Forward Scan Sonar Images”

Problems to Address:•Segment Sonar into Homogeneous Regions of Same Seabed Type

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Thesis Topic: “Tomographic Reconstruction of a Sequenceof Forward Scan Sonar Images”

Problems to Address:•Segment Sonar into Homogeneous Regions of Same Seabed Type•Locate Objects on the Seabed

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Thesis Topic: “Tomographic Reconstruction of a Sequenceof Forward Scan Sonar Images”

Problems to Address:•Segment Sonar into Homogeneous Regions of Same Seabed Type•Locate Objects on the Seabed•Align Images onto Global Co-ordinate System

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Thesis Topic: “Tomographic Reconstruction of a Sequenceof Forward Scan Sonar Images”

Problems to Address:•Segment Sonar into Homogeneous Regions of Same Seabed Type•Locate Objects on the Seabed•Align Images onto Global Co-ordinate System•Reconstruct Sonar Data into 3D Elevation Map of Seabed

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Thesis Topic: “Tomographic Reconstruction of a Sequenceof Forward Scan Sonar Images”

Problems to Address:•Segment Sonar into Homogeneous Regions of Same Seabed Type•Locate Objects on the Seabed•Align Images onto Global Co-ordinate System•Reconstruct Sonar Data into 3D Elevation Map of Seabed

Why?

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Thesis Topic: “Tomographic Reconstruction of a Sequenceof Forward Scan Sonar Images”

Problems to Address:•Segment Sonar into Homogeneous Regions of Same Seabed Type•Locate Objects on the Seabed•Align Images onto Global Co-ordinate System•Reconstruct Sonar Data into 3D Elevation Map of Seabed

Why?•To Aid Navigation and Path Planning

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Thesis Topic: “Tomographic Reconstruction of a Sequenceof Forward Scan Sonar Images”

Problems to Address:•Segment Sonar into Homogeneous Regions of Same Seabed Type•Locate Objects on the Seabed•Align Images onto Global Co-ordinate System•Reconstruct Sonar Data into 3D Elevation Map of Seabed

Why?•To Aid Navigation and Path Planning•Obstacle Avoidance, mines etc.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Principle of Sonar:Transmission of an acoustic pulse of energy into water andmeasure reflected energy:

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Principle of Sonar:Transmission of an acoustic pulse of energy into water andmeasure reflected energy:

The intensity of the energy reflected is measured against time to give information on the surface below:

distance to surface = (speed of sound in water)x(time to return)/2

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Forward Scan Sonar:•The acoustic energy from the sonar is transmitted in a radial sector.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Forward Scan Sonar:•The acoustic energy from the sonar is transmitted in a radial sector.•The backscattered energy can be shown as a sonar image:

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Environmental ReconstructionMethods for creating elevation maps of the seabed have been implemented using Lambert's Law and knowledge of the Sonar's Position.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Environmental ReconstructionMethods for creating elevation maps of the seabed have been implemented using Lambert's Law and knowledge of the Sonar's Position.

Lambert's Law relates the reflected energy from the surface to the anglebetween the direction of reflection and the surface normal.

I s I I cos2

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Local Propagation Technique:Each successive point is determined from the intersection ofthe circle centred at the sonar fish and the surface gradientdetermined from Lambert's Law.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Sonar Image:

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Sonar Image:

Reconstructed Image:

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Multiple Target Tracking

This work will be used to address the issues of:•Detecting and Locating Objects on the Seabed•Aligning Images onto a Global Co-ordinate System

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Multiple Target Tracking

This work will be used to address the issues of:•Detecting and Locating Objects on the Seabed•Aligning Images onto a Global Co-ordinate System

Targets to be Tracked:Mines, metallic objects which have high reflectance property:

Measurements obtained by thresholding.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Recursive Bayesian Estimation

To make inference about a dynamic system, two models are needed:

•Motion Model – describes evolution of state with time ie the motion of underwater vehicle.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Recursive Bayesian Estimation

To make inference about a dynamic system, two models are needed:

•Motion Model – describes evolution of state with time ie the motion of underwater vehicle.

•Measurement Model – relates the measurements to the state ie the objects on the seabed.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Recursive Bayesian Estimation

To make inference about a dynamic system, two models are needed:

•Motion Model – describes evolution of state with time ie the motion of underwater vehicle.

•Measurement Model – relates the measurements to the state ie the objects on the seabed.

These correspond to prediction and update stages when tracking.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Single Target Inference

The tracking problem is governed by two functions:

These relate to the motion and measurement models respectively.

x t F t x t 1 , v t 1

zt H t x t , nt

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Single Target Inference

The tracking problem is governed by two functions:

These relate to the motion and measurement models respectively.•The process noise v reflects the unknown target motion •The measurement noise n reflects sensor errors

x t F t x t 1 , v t 1

zt H t x t , nt

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Bayesian Recursion

The prior distribution of a target location based on previous observationsis obtained from the motion model and the posterior at time t-1:

f t t 1 x t z1 :t 1 f t t 1 x t x t 1 f t 1 t 1 x t 1 z1: t 1 dx t 1

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Bayesian Recursion

The prior distribution of a target location based on previous observationsis obtained from the motion model and the posterior at time t-1:

When a new measurement is obtained, the posterior distribution at time tis obtained by Bayes' Law:

where g is the likelihood of observing z given target state x.

f t t 1 x t z1 :t 1 f t t 1 x t x t 1 f t 1 t 1 x t 1 z1: t 1 dx t 1

f t t x t z1. .t g t zt x t f t t 1 x t z1. .t 1

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Multiple Target Inference Model

The single target recursive state estimation can be directly extended to a multiple target model using Finite Set Statistics (FISST).

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Multiple Target Inference Model

The single target recursive state estimation can be directly extended to a multiple target model using Finite Set Statistics (FISST).

A Random Finite Set (RFS) is used to represent a multiple-target state.The set of objects tracked at time t is an RFS containing :•Set of objects survived from time t-1.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Multiple Target Inference Model

The single target recursive state estimation can be directly extended to a multiple target model using Finite Set Statistics (FISST).

A Random Finite Set (RFS) is used to represent a multiple-target state.The set of objects tracked at time t is an RFS containing :•Set of objects survived from time t-1.•Set of object appearing at time t.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Multiple Target Inference Model

The single target recursive state estimation can be directly extended to a multiple target model using Finite Set Statistics (FISST).

A Random Finite Set (RFS) is used to represent a multiple-target state.The set of objects tracked at time t is an RFS containing :•Set of objects survived from time t-1.•Set of object appearing at time t.

The measurements at time t are modelled by an RFS containing:•Measurements generated from actual targets.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Multiple Target Inference Model

The single target recursive state estimation can be directly extended to a multiple target model using Finite Set Statistics (FISST).

A Random Finite Set (RFS) is used to represent a multiple-target state.The set of objects tracked at time t is an RFS containing :•Set of objects survived from time t-1.•Set of object appearing at time t.

The measurements at time t are modelled by an RFS containing:•Measurements generated from actual targets.•Spurious measurements from clutter.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Multiple Target Bayesian Recursion

The single target Bayesian recursion can be extended to the multipletarget scenario using the calculus defined in FISST:

f t t 1 X t Z1 :t 1 f t t 1 X t X t 1 , Z1 :t 1 f t 1 t 1 X t 1 Z1 : t 1 X t 1

f t t X t Z 1: t gt Z t X t f t t 1 X t Z1:t 1

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

PHD Filter

The Probability Hypothesis Density or PHD is defined as the first orderstatistical moment of the multiple target posterior distribution.The integral of the PHD in any region represents the expected numberof objects in that region.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

PHD Filter

The Probability Hypothesis Density or PHD is defined as the first orderstatistical moment of the multiple target posterior distribution.The integral of the PHD in any region represents the expected numberof objects in that region.

Why bother?Computationally cheaper to calculate than full posterior.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

PHD Filter

The Probability Hypothesis Density or PHD is defined as the first orderstatistical moment of the multiple target posterior distribution.The integral of the PHD in any region represents the expected numberof objects in that region.

Why bother?Computationally cheaper to calculate than full posterior.

Where are the targets?The locations of the targets can be found as peaks of this distribution.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

PHD Filter

Prediction Equation:

Dt t 1 x t Z1:t 1 b t x t PS x t 1 f t t 1 x t x t 1 Dt 1 t 1 x t 1 Z1 :t 1 x t 1

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

PHD Filter

Prediction Equation:

Data Update Equation:

Dt t 1 x t Z1:t 1 b t x t PS x t 1 f t t 1 x t x t 1 Dt 1 t 1 x t 1 Z1 :t 1 x t 1

Dt t x t Z1:t F t Z t x t Dt t 1 x t Z1:t 1

F t Z t x t 1 PD zti Z t

PD gt zti x t

t c t zt PD Dt t , g t

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Particle Filter Algorithm

Particle filters were designed for implementing Bayesian recursionby representing probability distributions by random samples or particles rather than in their functional forms.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Particle Filter Algorithm

Particle filters were designed for implementing Bayesian recursionby representing probability distributions by random samples or particles rather than in their functional forms.

The areas with higher probability will have a larger number of particles.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Particle Filter Algorithm (Single Target)

•Step 1: Initialisation.N particles are uniformly distributed across the Field of View (FoV).

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Particle Filter Algorithm (Single Target)

•Step 1: Initialisation.N particles are uniformly distributed across the Field of View (FoV).

•Step 2: Data Update.After a new measurement, weights are assigned to the particlesaccording to their likelihoods.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Particle Filter Algorithm (Single Target)

•Step 1: Initialisation.N particles are uniformly distributed across the Field of View (FoV).

•Step 2: Data Update.After a new measurement, weights are assigned to the particlesaccording to their likelihoods.

•Step 3: ResamplingAn unweighted particle set is obtained by resampling from the weighted set.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Particle Filter Algorithm (Single Target)

•Step 1: Initialisation.N particles are uniformly distributed across the Field of View (FoV).

•Step 2: Data Update.After a new measurement, weights are assigned to the particlesaccording to their likelihoods.

•Step 3: ResamplingAn unweighted particle set is obtained by resampling from the weighted set.

•Step 4: Estimation of Target LocationThe location of the target is estimated by calculating the mean positionof the particles.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Particle Filter Algorithm (Single Target)

•Step 1: Initialisation.N particles are uniformly distributed across the Field of View (FoV).

•Step 2: Data Update.After a new measurement, weights are assigned to the particlesaccording to their likelihoods.

•Step 3: ResamplingAn unweighted particle set is obtained by resampling from the weighted set.

•Step 4: Estimation of Target LocationThe location of the target is estimated by calculating the mean positionof the particles.

•Step 5: PredictionThe location of the next target location is estimated using the motion model.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Particle Filter Algorithm (Multiple Target)

•Step 1: Initialisation.N particles are uniformly distributed across the Field of View (FoV).

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Particle Filter Algorithm (Multiple Target)

•Step 1: Initialisation.N particles are uniformly distributed across the Field of View (FoV).

•Step 2: Data Update.After a new measurement, weights are assigned to the particlesaccording to the data update equation for the PHD.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Particle Filter Algorithm (Multiple Target)

•Step 1: Initialisation.N particles are uniformly distributed across the Field of View (FoV).

•Step 2: Data Update.After a new measurement, weights are assigned to the particlesaccording to the data update equation for the PHD.

•Step 3: Estimation of Target LocationThe locations of the targets are estimated by fitting a Gaussianmixture model to the particles where the number of targets is the sum of the weights.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Particle Filter Algorithm (Multiple Target)

•Step 1: Initialisation.N particles are uniformly distributed across the Field of View (FoV).

•Step 2: Data Update.After a new measurement, weights are assigned to the particlesaccording to the data update equation for the PHD.

•Step 3: Estimation of Target LocationThe locations of the targets are estimated by fitting a Gaussianmixture model to the particles where the number of targets is the sum of the weights.

•Step 4: ResamplingAn unweighted particle set is obtained by resampling from the weighted set.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Particle Filter Algorithm (Multiple Target)

•Step 1: Initialisation.N particles are uniformly distributed across the Field of View (FoV).

•Step 2: Data Update.After a new measurement, weights are assigned to the particlesaccording to the data update equation for the PHD.

•Step 3: Estimation of Target LocationThe locations of the targets are estimated by fitting a Gaussianmixture model to the particles where the number of targets is the sum of the weights.

•Step 4: ResamplingAn unweighted particle set is obtained by resampling from the weighted set.

•Step 5: PredictionThe locations of the next target locations are estimated using the PHDprediction equation.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Implementation on Forward Scan Sonar Data

•n beams separated by k degrees

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Implementation on Forward Scan Sonar Data

•n beams separated by k degrees•Intensity vs time data

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Implementation on Forward Scan Sonar Data

•n beams separated by k degrees•Intensity vs time data•Tracks range and bearing of targets

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Implementation on Forward Scan Sonar Data

•n beams separated by k degrees•Intensity vs time data•Tracks range and bearing of targets

Measurements are obtained by thresholding the data:

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Implementation on Forward Scan Sonar Data

•n beams separated by k degrees•Intensity vs time data•Tracks range and bearing of targets

Measurements are obtained by thresholding the data:

The motion of the sonar is assumed to be linear Field of View in the range of 20m to 60m

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Implementation on Forward Scan Sonar Data

Sequence of Simulated Forward Scan Sonar Images with Objects

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Results on Simulated Data

Linear Tracking in Sonar Image Reference Frame

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Results on Simulated Data

Linear Tracking in Global Reference Frame

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Results on Simulated Data

Sinusoidal Tracking in Global Reference Frame

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Implementation on Forward Scan Sonar Data

Sequence of Real Forward-Scan Images

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Results on Real Data

Tracked Cylinder in Forward Direction

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Results on Real Data

Tracked Cylinder in Backward Direction

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Extensions To PHD Filter:

The multi-target state set does not give individual target identities.

How do we associate measurements between frames?

Two possible approaches:

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Extensions To PHD Filter:

The multi-target state set does not give individual target identities.

How do we associate measurements between frames?

Two possible approaches:

•Increase state vector with invariant attribute

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Extensions To PHD Filter:

The multi-target state set does not give individual target identities.

How do we associate measurements between frames?

Two possible approaches:

•Increase state vector with invariant attribute

•Data Association

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

What do I do with it now?

The target tracks will be used for alignment by computinga geometric transform between the frames eg affine/similarity.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

What do I do with it now?

The target tracks will be used for alignment by computinga geometric transform between the frames eg affine/similarity.

This will be used as a preliminary step for 3D reconstruction of asequence of images.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

Future Work on Reconstruction

Segmentation into different seabed types.

Reconstructed 3D elevation map of sequence of images.

Forward-Scan Sonar Tomographic Forward-Scan Sonar Tomographic Reconstruction Reconstruction

PHD Filter Multiple Target TrackingPHD Filter Multiple Target Tracking

dec1@hw.ac.uk

References

R. Mahler:"Multitarget Bayes Filtering via First-Order Multitarget Moments",IEEE Transactions on Aerospace and Electronic Systems, 2003.

Vo, Singh and Doucet:“Sequential Monte Carlo Implementation of the PHD Filter for Multi-targetTracking”Proc. FUSION 2003

Sidenbladh and Wirkander:“Tracking random sets of vehicles in terrain”IEEE Workshop on Multi-Object Tracking, Madison, WI, USA, 2003