a model-based approach to the detection and classification of mines in side-scan sonar
DESCRIPTION
A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar. S.Reed, Y.Petillot, J.Bell. Why Use Unsupervised Techniques? Our Proposed CAD/CAC algorithm. The Sonar Process. Automated Object Detection. Extraction of Object Features. Automated Object Classification. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/1.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
A Model-Based Approach to the Detection A Model-Based Approach to the Detection and Classification of Mines in Side-scan and Classification of Mines in Side-scan
SonarSonar
S.Reed, Y.Petillot, J.BellS.Reed, Y.Petillot, J.Bell
![Page 2: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/2.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
ContentsContents
• Why Use Unsupervised Techniques?• Our Proposed CAD/CAC algorithm.• The Sonar Process.• Automated Object Detection.• Extraction of Object Features.• Automated Object Classification.• Future Research.• Conclusions.
![Page 3: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/3.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Unsupervised TechniquesUnsupervised Techniques
• Rapid Advances in AUV Technology.
• On-board analysis now required.
• Large amounts of data quickly available for analysis.
![Page 4: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/4.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Unsupervised Techniques Unsupervised Techniques
• Future automated systems will require all available information (navigation data, image processing models .etc.) to be fused.
![Page 5: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/5.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
CAD/CAC ProposalCAD/CAC Proposal
Detect MLO’s(MRF-based Model)
Fuse Other Views
ExtractHighlight/Shadow
(CSS Model)
Classify Object(Dempster-Shafer)
FalseAlarm?
PositiveClassification?
1 2 YES
YES
NO
NOMINE
REMOVE FALSE ALARM
![Page 6: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/6.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
The Sonar ProcessThe Sonar Process
• Sonar images represent the time of flight of the sound rather than distance.
• Objects appear as a highlight/shadow pair in the sonar image.
![Page 7: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/7.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
The Detection ModelThe Detection Model
• A Markov Random Field(MRF) model framework is used.
• MRF models operate well on noisy images.• A priori information can be easily incorporated.
• They are used toretrieve the underlying label field (e.g shadow/non-shadow)
![Page 8: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/8.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Basic MRF TheoryBasic MRF Theory
A pixel’s class is determined by 2 terms:
– The probability of being drawn from each classes distribution.
– The classes of its neighbouring pixels.
![Page 9: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/9.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Incorporating A Priori InfoIncorporating A Priori Info
• Object-highlight regions appear as small, dense clusters.
• Most highlight regions have an accompanying shadow region.
),()(ln),()],(1[),(),,(,
2
Ss ts Ss Ss
sssXstsstsss oxsexxxyxoyxU Segment by minimising:
![Page 10: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/10.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Initial Detection ResultsInitial Detection Results
• Initial Results Good.• Model sometimes detects false alarms due to clutter
such as the surface return – requires more analysis!
DETECTED OBJECT
![Page 11: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/11.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Object Feature ExtractionObject Feature Extraction
• The object’s shadow is often extracted for classification.
• The shadow region is generally more reliable than the object’s highlight region for classification.
• Most shadow extraction models operate well on flat seafloors but give poor results on complex seafloors.
![Page 12: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/12.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
The CSS ModelThe CSS Model
• 2 Statistical Snakes segment the mugshot image into 3 regions : object-highlight, object-shadow and background.
A priori information is modelled:
• The highlight is brighter than the shadow
• An object’s shadow region can only be as wide as its highlight region.
![Page 13: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/13.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
CSS ResultsCSS ResultsCSS ModelStandard Model
![Page 14: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/14.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
The Combined ModelThe Combined Model
• Objects detected by MRF model are put through the CSS model.
• The CSS snakes are initialised using the label field from the detection result. This ensures a confident initialisation each time.
• The CSS can detect MANY of the false alarms. False alarms without 3 distinct regions ensure the snakes rapidly expand, identifying the detection as a false alarm.
• Navigation info is also used to produce height information which can also remove false alarms.
![Page 15: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/15.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
ResultsResults
![Page 16: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/16.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Results 2
![Page 17: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/17.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Results 3
![Page 18: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/18.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Result 4
![Page 19: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/19.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
BP ’02 ResultsBP ’02 Results
• The combined detection/CSS model was run on 200 BP’02 data files containing 70 objects.
• 80% of the objects where detected and features extracted(for classification).
• 0.275 false alarms per image.
• The surface return resulted in some of the objects not being detected. Dealing with this would produce a detection rate of ~ 91%.
![Page 20: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/20.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Object ClassificationObject Classification• The extracted object’s shadow can be used for
classification.
• We extend the classic mine/not-mine classification to provide shape and dimension information.
• The non-linear nature of the shadow-forming process ensures finding relevant invariant features is difficult.
Shadows from the same objectShadows from the same object
![Page 21: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/21.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Modelling the Sonar ProcessModelling the Sonar Process
• Mines can be approximated as simple shapes – cylinders, spheres and truncated cones.
• Using Nav data to slant-range correct, we can generate synthetic shadows under the same sonar conditions as the object was detected.
• Simple line-of-sight sonar simulator. Very fast.
![Page 22: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/22.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Comparing the ShadowsComparing the Shadows
• Iterative Technique is required to find best fit. Parameter space limited by considering highlight and shadow length.
• Synthetic and real shadow compared using the Hausdorff Distance.
• It measures the mismatch of the 2 shapes.
HAUSDORFFDISTANCE
),(),,(max),( ABhBAhBAH
||||min max),( babahBbAa
![Page 23: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/23.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Incorporating KnowledgeIncorporating Knowledge
• As the technique is model-based, information on likely mine dimensions can be incorporated.
• Limited information from the highlight region can also be used to distinguish between the tested classes.
• We obtain an overall membership function for each class.
)()()(),,( elongjj
parjj
hausjjj
finalj HH
![Page 24: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/24.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
The Classification DecisionThe Classification Decision
• A decision could be made by simply defining a ‘Positive Classification Threshold’. This is a ‘hard’ decision and non-changeable.
• The ‘lawnmower’ nature of Sidescan surveys ensures the same object is often viewed multiple times. The model should ideally be capable of multi-view classification.
• We use DEMPSTER-SHAFER theory.
![Page 25: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/25.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Mono-view ResultsMono-view Results
• Dempster-Shafer allocates a BELIEF to each class.
• Unlike Bayesian or Fuzzy methods, D-S theory can also consider union of classes.
Bel(cyl)=0.83Bel(sph)=0.0Bel(cone)=0.0Bel(clutter)=0.08
Bel(cyl)=0.0Bel(sph)=0.303Bel(cone)=0.45Bel(clutter)=0.045
Bel(cyl)=0.42Bel(sph)=0.0Bel(cone)=0.0Bel(clutter)=0.46
![Page 26: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/26.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Mono-view ResultsMono-view ResultsModel was tested on 66 mugshots containing cylinders,Spheres, Truncated cones and clutter objects.
![Page 27: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/27.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Multi-view AnalysisMulti-view AnalysisDempster-Shafer allows results from multiple views to be fused.
Mono-Image Belief Fused BeliefObj Cyl Sph Cone Clutt Objs
FusedCyl Sph Cone Clutt
1 0.70 0.00 0.00 0.21 1 0.70 0.00 0.00 0.21
2 0.83 0.00 0.00 0.08 1,2 0.93 0.00 0.00 0.05
3 0.83 0.00 0.00 0.08 1,2,3 0.98 0.00 0.00 0.01
4 0.17 0.00 0.00 0.67 1,2,3,4 0.96 0.00 0.00 0.03
![Page 28: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/28.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Multi-Image AnalysisMulti-Image Analysis
Mono-Image Belief Fused BeliefObj Cyl Sph Cone Clutt Objs
FusedCyl Sph Cone Clutt
5 0.00 0.17 0.23 0.45 5 0.00 0.17 0.23 0.45
6 0.00 0.00 0.37 0.44 5,6 0.00 0.00 0.30 0.60
7 0.00 0.303 0.45 0.045 5,6,7 0.00 0.02 0.67 0.17
8 0.00 0.32 0.23 0.31 5,6,7,8 0.00 0.01 0.62 0.20
![Page 29: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/29.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Future ResearchFuture ResearchThe current detection model considers objects as a Highlight/Shadow pair. An object can also be considered as a discrepancy in the surrounding texture field.
![Page 30: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/30.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
ConclusionsConclusions
• Automated Detection/Feature Extraction model has been developed and tested on a large amount of data. Good Results obtained, improvements expected when surface returns removed.
• Classification model uses a simple sonar simulator and Dempster-Shafer theory to classify the objects. Extends mine/not-mine classification to provide shape and size information.
• Future research is focusing on texture segmentation to complement the current work.
![Page 31: A Model-Based Approach to the Detection and Classification of Mines in Side-scan Sonar](https://reader035.vdocument.in/reader035/viewer/2022062218/56815d0a550346895dcb09cb/html5/thumbnails/31.jpg)
Automated Detection and Classification Automated Detection and Classification ModelsModels
Acknowledgements
We would like to thank the following institutions for
their support and for providing data:
DRDC–Atlantic, Canada
Saclant Centre, Italy
GESMA, France