use of computer vision for crack detection · crack extraction using computer vision techniques...

15
Use of Computer Vision for Use of Computer Vision for Crack Detection Crack Detection Krisada Krisada Chaiyasarn Chaiyasarn supervised by supervised by Dr Kenichi Soga and Prof. Roberto Dr Kenichi Soga and Prof. Roberto Cipolla Cipolla

Upload: others

Post on 25-May-2020

21 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Use of Computer Vision for Crack Detection · Crack extraction using computer vision techniques (e.g. edge, corner, line, pattern detection) Crack recognition by machine learning

Use of Computer Vision forUse of Computer Vision forCrack DetectionCrack Detection

KrisadaKrisada ChaiyasarnChaiyasarn

supervised by supervised by

Dr Kenichi Soga and Prof. Roberto Dr Kenichi Soga and Prof. Roberto CipollaCipolla

Page 2: Use of Computer Vision for Crack Detection · Crack extraction using computer vision techniques (e.g. edge, corner, line, pattern detection) Crack recognition by machine learning

IntroductionIntroduction

Recently graduated with Recently graduated with BA(Hons)/MEngBA(Hons)/MEngin Civil, Structural and Environmental in Civil, Structural and Environmental Engineering from University of Cambridge Engineering from University of Cambridge

MEngMEng project on project on FibreFibre Optics Strain Optics Strain MeasurmentMeasurment (BOTDR) in Reinforced(BOTDR) in ReinforcedConcrete StructureConcrete Structure

Official start the PhD study in Computer Official start the PhD study in Computer Vision in Geotechnical Engineering in Vision in Geotechnical Engineering in October 2007October 2007

Page 3: Use of Computer Vision for Crack Detection · Crack extraction using computer vision techniques (e.g. edge, corner, line, pattern detection) Crack recognition by machine learning

OutlineOutline

Current technologies for tunnel inspectionsCurrent technologies for tunnel inspections

Computer vision in Underground MComputer vision in Underground M33

Review of some literaturesReview of some literatures

Possible future planPossible future plan

Page 4: Use of Computer Vision for Crack Detection · Crack extraction using computer vision techniques (e.g. edge, corner, line, pattern detection) Crack recognition by machine learning

Current use of imaging techniques for Current use of imaging techniques for infrastructure assessmentinfrastructure assessment

Paris metro: Use Paris metro: Use ofof laserlaser scanner scanner forfor imageimage acquisitionacquisition

SankyoSankyo CoCo. . JapanJapan: : RecordingRecording ofof imagesimages usingusing highhigh--resolutionresolution digital cameras ($18digital cameras ($18--2525-- mm22))

KeisokuKeisoku KensaKensa CoCo. . JapanJapan: Crack : Crack detectiondetection systemsystem: Use : Use ofofhighhigh speedspeed video camera (video camera ($65k$65k//dayday))

Page 5: Use of Computer Vision for Crack Detection · Crack extraction using computer vision techniques (e.g. edge, corner, line, pattern detection) Crack recognition by machine learning

Tunnel Inspection System, Takenaka Civil Engineering & Construction Co., Ltd

Page 6: Use of Computer Vision for Crack Detection · Crack extraction using computer vision techniques (e.g. edge, corner, line, pattern detection) Crack recognition by machine learning

Focus on Computer Vision (CV) and Machine Learning (ML)

Page 7: Use of Computer Vision for Crack Detection · Crack extraction using computer vision techniques (e.g. edge, corner, line, pattern detection) Crack recognition by machine learning

Crack Crack detectiondetection//localizationlocalization

Two steps:

Crack extraction using computer vision techniques (e.g. edge, corner, line, pattern detection)

Crack recognition by machine learning (e.g. support vector machine(SVM) and neural networks)

Above approaches must be together in order to achieve crack detection algorithms

Page 8: Use of Computer Vision for Crack Detection · Crack extraction using computer vision techniques (e.g. edge, corner, line, pattern detection) Crack recognition by machine learning

Image processingImage processing

Yu et al. (2006) proposed an inspection system, consisted of a Yu et al. (2006) proposed an inspection system, consisted of a mobile robot with Charged Couple mobile robot with Charged Couple Device(CCDDevice(CCD) for data ) for data acquisition and crack detection system using image acquisition and crack detection system using image processing. processing.

Cracks and non-crack areas are distinguished by their light reflectance values

Cracks are extracted by graph search method with given start and end points

Page 9: Use of Computer Vision for Crack Detection · Crack extraction using computer vision techniques (e.g. edge, corner, line, pattern detection) Crack recognition by machine learning

ResultsResults

Erroneous recognition of cracks and nonErroneous recognition of cracks and non--cracks prevailscracks prevailsUsed semiUsed semi--automated system to discard erroneous pointsautomated system to discard erroneous pointsFurther works such as a study of crack characteristics and develFurther works such as a study of crack characteristics and development of opment of fully automated softwarefully automated software

Page 10: Use of Computer Vision for Crack Detection · Crack extraction using computer vision techniques (e.g. edge, corner, line, pattern detection) Crack recognition by machine learning

Support Vector MachineSupport Vector Machine

ZhiweiZhiwei et. al.(2002)et. al.(2002) usedused crack crack intensityintensity featurefeature toto detectdetect crack crack edgesedges((DiscriminantDiscriminant AnalysisAnalysis MethodMethod). ). HoweverHowever otherother nonnon--crack crack imageimage may be may be extractedextracted. .

SVM SVM isis usedused toto classifyclassify intointo crack, noncrack, non--crack crack andand intermediateintermediate imageimage. . ExperimentedExperimented by by balancedbalanced andand unbalancedunbalanced subsub--imageimage. .

Page 11: Use of Computer Vision for Crack Detection · Crack extraction using computer vision techniques (e.g. edge, corner, line, pattern detection) Crack recognition by machine learning

ResultsResults

Balanced subBalanced sub--image is more effective than image is more effective than unbalanced subunbalanced sub--imageimage

Use image features to enhance image recognitionUse image features to enhance image recognition

OnlyOnly linear linear crackscracks werewere consideredconsidered

SVM SVM needneed furtherfurther developmentdevelopment

Page 12: Use of Computer Vision for Crack Detection · Crack extraction using computer vision techniques (e.g. edge, corner, line, pattern detection) Crack recognition by machine learning

Automated detection of cracks in buried concrete Automated detection of cracks in buried concrete pipe imagespipe images (Computer Vision)(Computer Vision)

SinhaSinha et. al.(2005)et. al.(2005) proposes approach for crack detection in proposes approach for crack detection in pipes.pipes.

Page 13: Use of Computer Vision for Crack Detection · Crack extraction using computer vision techniques (e.g. edge, corner, line, pattern detection) Crack recognition by machine learning

ResultsResultsResults were good since cracks in pipe images were clearly visible pattern

This paper present excellent system of comparing qualitative values such as visual comparison, correctness, and completeness

Image of mushroom cracks were not as good

Page 14: Use of Computer Vision for Crack Detection · Crack extraction using computer vision techniques (e.g. edge, corner, line, pattern detection) Crack recognition by machine learning

How may we go from here?How may we go from here?

ImproveImprove thethe methodsmethods ofof crack crack extractionextraction

ImproveImprove thethe methodsmethods ofof crack crack recognitionrecognition basedbased onon newnewtechniquestechniques suchsuch as as boostingboosting

HighHigh accuracyaccuracy ofof crack crack detectiondetection algorithmsalgorithms toto enableenableevaluationevaluation ofof crack crack sizessizes

TheThe characterizationcharacterization module module wouldwould recogniserecognise crackscracks fromfrom thetheimagesimages andand classifyclassify themthem intointo deteriorationdeterioration categoriescategories

Page 15: Use of Computer Vision for Crack Detection · Crack extraction using computer vision techniques (e.g. edge, corner, line, pattern detection) Crack recognition by machine learning

Thank you for your attention