robotic impact-acoustics system for tile-wall bonding ... · robotic impact-acoustics system for...

10
Robotic impact-acoustics system for tile-wall bonding integrity inspection B.L. Luk a, * , K.P. Liu a , Z.D. Jiang a,b , F. Tong c a Department of Manufacturing Engineering and Engineering Management, City University of Hong Kong, Hong Kong b College of Information Science and Engineering, Ningbo University, Zhejiang, China c Key Laboratory of Underwater Acoustic Communication and Marine Information Technology of the Minister of Education, Xiamen University, Xiamen, China article info Article history: Received 15 January 2009 Accepted 24 July 2009 Keywords: Impact acoustic Non-destructive evaluation ZigBee Wavelets Climbing service robot abstract Impact acoustic is an effective non-destructive evaluation (NDE) method for many applications especially for inspecting the bonding quality of mosaic tile-walls. However, the audio noise can affect the power spectrum density (PSD) distribution of an acquired signal seriously. So, the traditional method of using PSD as the main identification tool is not sufficient. This paper proposes an evaluation method based on wavelet packet decomposition (WPD). Using WPD, the PSD of the signal is allocated into certain component fields. Investigation on the component PSD indicates it can reveal the bonding quality even in a noisy environment. An artificial neural network (ANN) is chosen as a classifier to simplify the eval- uation system and makes it more effective and efficient. The performance of the proposed approach is evaluated experimentally. It is verified that this WPD approach can be applied to impact acoustic method to enhance its evaluation capability in a noisy environment. For practical implementation, an automatic gondola based climbing robot, called WICBOT, is being developed. To reduce the difficulty in handling large amount of cables, ZigBee and Bluetooth wireless network are used to transmit the inspection results and sample data from the climbing robot to the ground station. Ó 2009 Elsevier Ltd. All rights reserved. 1. Introduction There exist a considerable number of high-rise buildings in metropolitan cities like Hong Kong. Most of these high-rise build- ings use tiles, especially ceramic and mosaic ones, to decorate and protect their large-area of concrete structures. However, due to im- proper installation process, climate corrosion and aging effects, the bonding strength of tile adhesives between the tiles and the under- lying concrete structure can be severely weakened well before the end of the expected building life [1,2]. There are more and more accidents and injuries related to tiles falling from heights caused by defective adhesives or poorly bonded tiles. In view of this prob- lem, the Hong Kong Housing, Planning and Land Bureau has just completed a public consultation on mandatory building inspection. The Hong Kong Government intends to enforce the mandatory inspection for all tall buildings aged 30 years or above. However, the current method of inspection is hazardous since the human workers are required to carry out this work in mid-air and at high altitudes. In addition, the method is very laborious and is subjected to human fatigue and inconsistency. Thus there is an urgent need to develop an effective non-destructive test method to facilitate quick, accurate and cost-effective inspections of high-rise build- ings. In addition, the method should be suitable for integrating with a service robot to automate the inspection tasks in order to reduce the human workers’ risk in working at life-threatening height. Numerous NDE technologies [3–8] have been developed for testing the quality of material or the integrity of structure, such as ultrasound, laser, X-rays, infrared, impact-echo, impact acoustic, etc. Among the various NDE methods, the impact acoustic is the most convenient and cost-effective method for automating the tile-wall inspection process since, unlike ultrasound and impact echo, the method does not require an inspection device to have a continuous contact with the wall surfaces. Also, as compared with other optical methods such as infrared thermographic method, the method is low cost and robust enough for on-site applications. Impact acoustic inspection method is based on the sound signal generated by a small hard object impacting the surface of the spec- imen. This impact actually causes the underlying structure of the sample to vibrate. So, this sound signal could contain information about the integrity of the sample. Tong et al. [8] analyzed the impact process using a mass-spring model and Christoforou and Yigit [9] studied the impact response with the energy distribution. Wu and Siegel [10] defined the ratio of the power of the lower 1/3 frequency range to that of the overall frequency range in impact sounds spectrum as the power accumulation ratio (PAR) factor. All those studies presume that the signals were obtained from noise-free environments. However, audio noise in the acquired signal can distort the original PSD distribution pattern seriously. 0957-4158/$ - see front matter Ó 2009 Elsevier Ltd. All rights reserved. doi:10.1016/j.mechatronics.2009.07.006 * Corresponding author. E-mail address: [email protected] (B.L. Luk). Mechatronics 19 (2009) 1251–1260 Contents lists available at ScienceDirect Mechatronics journal homepage: www.elsevier.com/locate/mechatronics

Upload: others

Post on 23-Mar-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Robotic impact-acoustics system for tile-wall bonding ... · Robotic impact-acoustics system for tile-wall bonding integrity inspection B.L. Luka,*, K.P. Liua, Z.D. Jianga,b, F. Tongc

Mechatronics 19 (2009) 1251–1260

Contents lists available at ScienceDirect

Mechatronics

journal homepage: www.elsevier .com/ locate/mechatronics

Robotic impact-acoustics system for tile-wall bonding integrity inspection

B.L. Luk a,*, K.P. Liu a, Z.D. Jiang a,b, F. Tong c

a Department of Manufacturing Engineering and Engineering Management, City University of Hong Kong, Hong Kongb College of Information Science and Engineering, Ningbo University, Zhejiang, Chinac Key Laboratory of Underwater Acoustic Communication and Marine Information Technology of the Minister of Education, Xiamen University, Xiamen, China

a r t i c l e i n f o

Article history:Received 15 January 2009Accepted 24 July 2009

Keywords:Impact acousticNon-destructive evaluationZigBeeWaveletsClimbing service robot

0957-4158/$ - see front matter � 2009 Elsevier Ltd. Adoi:10.1016/j.mechatronics.2009.07.006

* Corresponding author.E-mail address: [email protected] (B.L. Luk).

a b s t r a c t

Impact acoustic is an effective non-destructive evaluation (NDE) method for many applications especiallyfor inspecting the bonding quality of mosaic tile-walls. However, the audio noise can affect the powerspectrum density (PSD) distribution of an acquired signal seriously. So, the traditional method of usingPSD as the main identification tool is not sufficient. This paper proposes an evaluation method basedon wavelet packet decomposition (WPD). Using WPD, the PSD of the signal is allocated into certaincomponent fields. Investigation on the component PSD indicates it can reveal the bonding quality evenin a noisy environment. An artificial neural network (ANN) is chosen as a classifier to simplify the eval-uation system and makes it more effective and efficient. The performance of the proposed approach isevaluated experimentally. It is verified that this WPD approach can be applied to impact acoustic methodto enhance its evaluation capability in a noisy environment. For practical implementation, an automaticgondola based climbing robot, called WICBOT, is being developed. To reduce the difficulty in handlinglarge amount of cables, ZigBee and Bluetooth wireless network are used to transmit the inspection resultsand sample data from the climbing robot to the ground station.

� 2009 Elsevier Ltd. All rights reserved.

1. Introduction

There exist a considerable number of high-rise buildings inmetropolitan cities like Hong Kong. Most of these high-rise build-ings use tiles, especially ceramic and mosaic ones, to decorate andprotect their large-area of concrete structures. However, due to im-proper installation process, climate corrosion and aging effects, thebonding strength of tile adhesives between the tiles and the under-lying concrete structure can be severely weakened well before theend of the expected building life [1,2]. There are more and moreaccidents and injuries related to tiles falling from heights causedby defective adhesives or poorly bonded tiles. In view of this prob-lem, the Hong Kong Housing, Planning and Land Bureau has justcompleted a public consultation on mandatory building inspection.The Hong Kong Government intends to enforce the mandatoryinspection for all tall buildings aged 30 years or above. However,the current method of inspection is hazardous since the humanworkers are required to carry out this work in mid-air and at highaltitudes. In addition, the method is very laborious and is subjectedto human fatigue and inconsistency. Thus there is an urgent needto develop an effective non-destructive test method to facilitatequick, accurate and cost-effective inspections of high-rise build-ings. In addition, the method should be suitable for integrating

ll rights reserved.

with a service robot to automate the inspection tasks in order toreduce the human workers’ risk in working at life-threateningheight.

Numerous NDE technologies [3–8] have been developed fortesting the quality of material or the integrity of structure, suchas ultrasound, laser, X-rays, infrared, impact-echo, impact acoustic,etc. Among the various NDE methods, the impact acoustic is themost convenient and cost-effective method for automating thetile-wall inspection process since, unlike ultrasound and impactecho, the method does not require an inspection device to have acontinuous contact with the wall surfaces. Also, as compared withother optical methods such as infrared thermographic method, themethod is low cost and robust enough for on-site applications.

Impact acoustic inspection method is based on the sound signalgenerated by a small hard object impacting the surface of the spec-imen. This impact actually causes the underlying structure of thesample to vibrate. So, this sound signal could contain informationabout the integrity of the sample. Tong et al. [8] analyzed theimpact process using a mass-spring model and Christoforou andYigit [9] studied the impact response with the energy distribution.Wu and Siegel [10] defined the ratio of the power of the lower 1/3frequency range to that of the overall frequency range in impactsounds spectrum as the power accumulation ratio (PAR) factor.All those studies presume that the signals were obtained fromnoise-free environments. However, audio noise in the acquiredsignal can distort the original PSD distribution pattern seriously.

Page 2: Robotic impact-acoustics system for tile-wall bonding ... · Robotic impact-acoustics system for tile-wall bonding integrity inspection B.L. Luka,*, K.P. Liua, Z.D. Jianga,b, F. Tongc

Climbing robot

ZigBee transceiver module

Ground station and its control console

Sound proofing box

Fig. 2. A photograph of the climbing robot with its ground station and controlconsole.

1252 B.L. Luk et al. / Mechatronics 19 (2009) 1251–1260

As a result, detection methods which just depend on the PAR canbe weakened significantly by the noise.

Wavelet transform has become a prevalent method in advancesignal processing that people often use to reveal the underlyingcharacteristic of a given signal. For practical NDE applications,when an inspection device is working in unstructured or chaoticenvironments, the acquired signal is usually contaminated withnoise. In the past decade, the wavelet-based de-noising methodwas verified to be effective, and has been adopted widely [11].The main idea of the method lies on the decomposition of raw sig-nal by using wavelet transformation. Based on the information inwavelet domain, we propose a characteristic-extracting methodusing wavelet packet decomposition and an artificial neural net-work is then used as a classifier to simplify the evaluation processfor the impact acoustic method.

In order to automate the inspection tasks, a gondola-basedclimbing service robot, called WICBOT, has been developed totransport the inspection tool to the required locations. Unlike otherclimbing service robots using vacuum grippers [12–15], WICBOTcan handle wall surfaces with cracks, grooves or holes, and providea fast effective method to carry out the inspection process. This pa-per will first give a brief description of the whole inspection sys-tem. The rest of the paper will concentrate on describing theproposed tiled wall inspection method and its experimentalresults.

2. Robotic system for inspecting tile-walls of high-rise buildings

2.1. Basic robot structure and operations

The tile-wall inspection robotic system, WICBOT, consists ofthree main parts as indicated in Figs. 1 and 2. (1) a climbing robotequipped with an impact-acoustic nondestructive-evaluation(NDE) device for surface inspection, (2) a heavy ground stationwith cable driving mechanism for providing the up-down move-ment of the robot, and a control console, and (3) a supportingstructure at the building roof for providing support to the cablepulley-block.

In term of mechanical design, the robotic system adopted a sim-ilar mechanism as those used in common industrial gondola forbuilding maintenance. However, the new design provides addi-

Supporting structure at the building roof

NDE device

Closed cable-loop

Climbing robot

Tension device

Cable driving mechanism

Ground station

Pulley-block

Fig. 1. The basic structure of the of the

tional capabilities of automatically climbing up-and-down onbuilding wall and performing inspection of the entire wall surfaces.In the ground station, there is a cable driving mechanism consist-ing of two high-power cable driving motors for hoisting the robotup-and-down and level-inclination control. Basically, the robot canbe driven to access any location on the wall segment by controllingthe two motor motions. Inside the climbing robot, there is a ten-sion device to pull the cable-loop away from the robot front. Theaim is to maintain a strong contact force between the robot wheelsand the wall surface. The idea borrows the principle of bowstringaction on arrow which can receive strong forward force. It is espe-cially important under windy condition as the strong contact forcecan guarantee the robot sticking on the correct position withoutbeing affected by the wind. Also, there is a two-degrees-of-freedommanipulator installed in the robot. It is to position the NDE deviceto inspect the specified location on the wall surface. Normally, thispositioning and detection operations are done continuously andautomatically by the commands given to the control console. Forillustration purpose, Fig. 3 shows the photograph of the robot car-rying out an inspection operation on a high-rise building.

Building body

Robot wheels

WICBOT inspection robot system.

Page 3: Robotic impact-acoustics system for tile-wall bonding ... · Robotic impact-acoustics system for tile-wall bonding integrity inspection B.L. Luka,*, K.P. Liua, Z.D. Jianga,b, F. Tongc

Fig. 3. The WICBOT system carried out inspection on a high-rise building in a publichousing estate.

B.L. Luk et al. / Mechatronics 19 (2009) 1251–1260 1253

2.2. Impact-acoustic NDE device

The impact-acoustic non-destructive test device consists of: asteel sphere of diameter 12 mm, an impactor which is a linear sole-

Fig. 4. The system block diagram of the impact acoustic inspection device.

Fig. 5. A close-up view of the inspection system in operation.

Fig. 6. A normal

noid actuator for pushing the steel sphere to generate the requiredimpact force, pre-amplifier module, ADC card with 40 KHz sam-pling frequency, and a highly directional C900 microphone (seeFigs. 4 and 5). With a frequency response of 20–20 kHz and a sen-sitivity of 12.5 mv/Pa, the C900 is a cardioid pattern condensermicrophone. The microphone is installed to pick up more impactsounds and suppress as much as possible the noise from otherdirections, with the axis of its directivity beam toward the impactposition (See Fig. 5). The main advantage of this method is that theimpacting device and microphone need not be coupled onto thewall surface continuously. This is of great convenience for therobot system working at heights. Moreover, it takes less time andeffort to perform inspection on large-area of wall surfaces. For bet-ter comparison, concrete specimens and physical tile-walls in theuniversity campus with different voids and tile types are used astest cases.

2.3. Zigbee network for robot communication

As the robot is required to climb up and down buildings, aZigBee [16] wireless network is used for the communication be-tween the control console and the robot. This arrangement reducesthe number of cables connected to the robot and hence the needfor installing any complicated automatic cable handling system.ZigBee is a high level communication protocol designed to be usedon a small, low-power digital wireless communication networksystem based on the IEEE 802.15.4 standard with data rate of250 kbps. As the climbing robot has its own on-board industrialPC to carry out the low level control and real-time data analysis,the communication throughput provided by ZigBee is sufficientfor the intended application and would not cause any problemsin stability and performance. For this tile-wall inspection applica-tion, a simple packet based protocol has been developed. A packetconsists of the header and data field (see Fig. 6). The header con-tains the source address and the packet ID. The data field containsthe data to be carried inside the packet.

The protocol utilized a simple ACK/Retransmission mechanismto ensure the reliable communication between two parties. Underthis mechanism, Fig. 7 shows the receiver returns an acknowledge-ment (ACK) packet with the packet ID to the sender indicating thesuccessful reception of the packet. In case of any interruptionoccurred during a packet transmission, which is detected by theACK time-out timer, the sender will retransmit the packet again.

The packet transmission is delivered by the transceiver com-plied with the IEEE 802.15.4 standard. The transceiver will ensurethe data integrity of the packet. The normal operating range of theIEEE802.15.4 technology is about 50 m. For 30-year old buildingsin Hong Kong, the 50 m range is sufficient. However, for most ofthe more modern high-rise buildings, they are taller than 50 m.In order to extend the operating range of the climbing robot, anIEEE802.15.4 based data repeater has been developed.

To make it easier for operators to operate the robot and to col-lect inspection data, PDA or tablet PC is used. Although ZigBee isvery suitable for this type of industrial applications, there is nobuilt-in ZigBee solution for PDA and PC. As a result, a Bluetoothcommunication network is installed in the control console.Through the Bluetooth system, PDA or Tablet PC can be used to

data packet.

Page 4: Robotic impact-acoustics system for tile-wall bonding ... · Robotic impact-acoustics system for tile-wall bonding integrity inspection B.L. Luka,*, K.P. Liua, Z.D. Jianga,b, F. Tongc

Fig. 7. An ACK (acknowledgment).

Fig. 8. The system block diagram of the communication system for the inspection robot system.

ZigBee transceiver module

Bluetooth transceiver module

Fig. 9. Ground station control console with ZigBee and Bluetooth wireless network.

Fig. 10. Display of the real-time inspection data with the PocketPC.

1254 B.L. Luk et al. / Mechatronics 19 (2009) 1251–1260

control the robot and to view inspection data. The overall commu-nication system is shown in Fig. 8.

Fig. 9 shows the ZigBee and Bluetooth transceiver modulesarrangement installed at the control console to allow the climbingrobot to communicate with the control console through ZigBeenetwork and at the same time allow user to communicate with

the system using PDA through the Bluetooth network. Fig. 10shows the audio signal obtained from the impact-acoustic inspec-tion device and Fig. 11 shows the inspection results. This arrange-ment provides a cost-effective, robust and user-friendly solutionfor communication between human operator and remote roboticinspection system without the hassle of handling long cables andthe risk of damaging the cables during remote operations, whichare two common problems occurred in many remotely operatedrobotic system.

Page 5: Robotic impact-acoustics system for tile-wall bonding ... · Robotic impact-acoustics system for tile-wall bonding integrity inspection B.L. Luka,*, K.P. Liua, Z.D. Jianga,b, F. Tongc

Fail

Fig. 11. Display of the testing result with the PocketPC.

B.L. Luk et al. / Mechatronics 19 (2009) 1251–1260 1255

3. Theoretical basis

3.1. Signal processing for impact acoustic signal

In the proposed method, the sound signal is sampled and storedas a discrete digital sequence, {x(n), n = 0,1, . . ., N � 1}, with thelength N. Suppose that the signal x(n) is contaminated with theadditive noise v(n). According to the linearity property of Fouriertransform, the actual PSD of the resultant signal y(n) = x(n) + v(n)that can be calculate by,

2p � pðkÞ ¼ jYðkÞj2 ¼ jXðkÞj2 þ jVðkÞj2 þ 2jXðkÞj � jVðkÞj;k ¼ 0;1; . . . ;N � 1 ð1Þ

where Y(k) and V(k) refer to the FFTs of y(n) and v(n), respectively.The PSD distribution pattern can be defined as,

qðkÞ ¼ pðkÞPk

pðkÞ ; k ¼ 0;1; . . . ;N � 1 ð2Þ

For the noise having proportional distribution in frequency domain(e.g. white noise), from Eq. (1), it just increases the overall PSD ofthe raw signal to a certain level without affecting the pattern ofq(k). Therefore, the proposed approach focuses on the reductionof the frequency-limited noise, which have affected the pattern ofq(k) in the finite frequency band. As a result, the majority of q(k)is retained and distortion is suppressed.

Normally, multi-band filters group is considered. The wholeband will be divided into M subbands and q(k) is fallen into L com-ponents qj(k) (j = 0,1, . . ., M � 1). Suppose that the noise just con-taminates the J-th sub-band and leaves other subbands free ofnoise, the other M � 1 components of PSD distributions qj(k)(j – J and j = 0,1, . . ., M � 1) will still contain the majority of infor-mation reflecting the bonding quality.

Fig. 12. Wavelet packe

3.2. Wavelet packet decomposition

The wavelet transform is the most recent technique in advancesignal processing. It is defined in term of basic function obtained bycompression or dilatation, and translation operations of motherwavelet. In view of signal filtering, it uses a series of orthogonalfilter to sample the input signal. The orthogonal high-and low-passfilters are used to extract one sample from two and decompose thesignal into a series of constituent parts in time domain. Due to itsorthogonal property, the wavelet transform can extract time–frequency features effectively and keep the signal information‘‘unaffected” during the decomposition process. So, the wavelet issuitable for the analysis of non-stationary signals.

The wavelet packet can be used to discompose the signal over thefull frequency band [17]. It has the same process as the wavelettransform, the only difference is that the wavelet packet transformfurther decomposes both the approximate and detail componentswhile the wavelet transform just decomposes the former. Fig. 12shows the L-level wavelet packet decomposition. From the decom-position process, it can be regarded as performing through a serial offilters with scale and translation parameters. It is fit to combine thewavelet packet decomposition with the component PSD distribu-tion. The L-th wavelet packet decomposition has 2L component, soM equals to 2L. Through the wavelet transform, the time signal ismapped into wavelet domain. From Fig. 12, we will get M = 2L com-ponent PSD distribution patterns after L levels decomposition. So,the wavelet packet coefficients of the signal s(t) can be computed via

wmj;k ¼ hsðtÞ;W

mj;kðtÞi ¼

ZsðtÞWm

j;kðtÞdt ¼ 2�j=2Wmð2�jt � kÞ ð3Þ

Now, the power of signal is mapped into the wavelet packet node.We can define the power of the node as

qmj ¼

Xk

jwmj;kj

2 ð4Þ

which is the signal power in some specific frequency band indexedby parameter j and m. In fact, according to energy conservation law,the sum of the node power in the same level is equal to the power ofsignal: |s(t)| =

Pqj

m, in which the node(m) powers are contained inthe l-th level of wavelet packet decomposition.

The wavelet thresholding technique is adopted in de-noisingprocessing according to the rules proposed by Donoho and John-stone [18,19] using the following equation

wmj;k ¼ 0; for jwm

j;kj < k

wmj;k ¼ signðwm

j;kÞ � ðjwmj;kj � kÞ; for jwm

j;kj P k

(: ð5Þ

where, the parameter k is the threshold in wavelet domain.

t decomposition.

Page 6: Robotic impact-acoustics system for tile-wall bonding ... · Robotic impact-acoustics system for tile-wall bonding integrity inspection B.L. Luka,*, K.P. Liua, Z.D. Jianga,b, F. Tongc

1256 B.L. Luk et al. / Mechatronics 19 (2009) 1251–1260

3.3. Artificial neural network (ANN)

An artificial neural network (ANN) is a mathematical or compu-tational model that tries to simulate the structure and functionalaspects of biological neural networks existed in human brain.ANN consists of an interconnected group of artificial neurons andprocesses information using a connectionist approach to computa-

Fig. 13. A basic artificial neural network.

0 100 200 300 400 50-5

0

5

Am

plitu

de(V

)

Time(0.0

0 2 4 6 8 10

0.2

0.4

0.6

0.8

1

Nor

mal

ized

PS

D

Frequen

a

0 100 200 300 400 50-5

0

5

Am

plitu

de(V

)

Time(0

0 2 4 6 8 10

0.2

0.4

0.6

0.8

1

Nor

mal

ized

PS

D

Freque

b

Fig. 14. Impact response from (

tion. It is a powerful non-linear data modelling tool and can beused to model complex relationships between inputs and outputsor to find patterns in data. The most widely-used ANN architectureis the feedforward, back-propagation architecture which com-prises of an input layer, an output layer and at least one hiddenlayer. The layer of input neurons receives the data informationfrom outer world, while the output layer sends the result to theoutside world for classification, pattern recognition, control orother secondary process. Between these two layers can be variousnumbers of hidden layers; there is no theoretical limit on the num-ber of hidden layers but typically just one or two would be suffi-cient for most applications. Fig. 13 shows a basic ANN, in whichvarious inputs are represented by xn and each of these inputs ismultiplied by a connection weight wn. In this simplest case, theproducts are summed, fed through a transfer function to get a re-sult output. The weights are obtained through the learning unitsimilar to a cognitive processing of the human brain by training.The most commonly-used method for training an ANN is Back-propagation technique which is the generalization of the Wid-row-Hoff learning rule to multiple-layer networks and nonlineardifferentiable transfer functions.

0 600 700 800 900 100025ms)

0 12 14 16 18 20cy(KHz)

0 600 700 800 900 1000.025ms)

0 12 14 16 18 20ncy(KHz)

a) ‘solid’ and (b) ‘void’ slab.

Page 7: Robotic impact-acoustics system for tile-wall bonding ... · Robotic impact-acoustics system for tile-wall bonding integrity inspection B.L. Luka,*, K.P. Liua, Z.D. Jianga,b, F. Tongc

B.L. Luk et al. / Mechatronics 19 (2009) 1251–1260 1257

4. Experimental results

4.1. Experiment setup

The NDE experimental system is illustrated in Figs. 4 and 5. Inorder to make it easier to develop the algorithms, two types ofsample slabs are prepared in the experiment: one is of good bond-ing property; the other contains an ø280 mm circular void at theconcrete substrate layer at the centre location. The dimension ofthe slabs is 400 mm � 400 mm � 150 mm. We call them ‘solid’and ‘void’ for short respectively. In order to reduce the unwantedaudio noise coming from the working environment, the whole im-pact device and the microphone are covered in all five sides by arectangular box. The interior of the box is installed with soundproofing materials to stop unwanted audio noise entering into sys-tem as much as possible. However, as the box cannot be sealed to-tally on the side where the impacting device is in contact with thewall surface, some amount of noise will always get through and be

0 100 200 300 400 50-6-4-20246

Am

plitu

de(V

)

Time(0

0 2 4 6 8 10

0.20.40.60.8

1

Nor

mal

ized

PS

D

Frequen

0 100 200 300 400 50-6-4-20246

Am

plitu

de(V

)

Time(0

0 2 4 6 80

0.2

0.4

0.6

0.8

1

Nor

mal

ized

PS

D

Freque

a

b

Fig. 15. Impact response contaminated by ad

DataAcquirement

WaveletPacket

Discomposition(WPD)

Impact

Response

Fig. 16. System diag

picked up by the microphone. To investigate the effect of noise,typical audio noise from real working environments are recorded.These audio noise signals are then added to the impacting soundsignal generated by the impacting device. Different levels of sig-nal-to-noise ratio (SNR) are used to test the developed techniquein order to ensure the method can be used in noisy environments.

4.2. PSD distribution from different specimens

The PSD distribution of impact acoustic has been investigated indetail as discussed in [8]. Extracting the characteristics of impactsound in frequency domain by PSD can easily be implemented ina noise-free environment. It is because the PSD patterns of the im-pact response are different with respect to different bonding qual-ities. Fig. 14a shows the normalized PSD of the impact sound froma ‘solid’ slab, and Fig. 14b is from a ‘void’ slab. As shown in thesetwo figures, it is easy to distinguish the signals generated byimpacting the ‘solid’ and ‘void’ slabs.

0 600 700 800 900 1000.025ms)

0 12 14 16 18 20cy(KHz)

0 600 700 800 900 1000.025ms)

10 12 14 16 18 20ncy(KHz)

ditive noise (a) ‘solid’ and (b) ‘void’ slab.

ComponentPSD

Generation

ArtificialNeonencNetwork(ANN)

Result

ram with WPD.

Page 8: Robotic impact-acoustics system for tile-wall bonding ... · Robotic impact-acoustics system for tile-wall bonding integrity inspection B.L. Luka,*, K.P. Liua, Z.D. Jianga,b, F. Tongc

w1w22×4

input hidden layer output layer

w1w22×4

input hidden layer output layer

1258 B.L. Luk et al. / Mechatronics 19 (2009) 1251–1260

Although the specially designated microphone can have ahighly directional property, the received sound signal will be con-taminated by noise inevitably while working in a chaotic and noisyenvironment because the microphone can absorb all kinds of audi-ble sound including the background noise. The contaminated sig-nals obtained from a typically noisy working site and byimpacting the ‘solid’ and ‘void’ slabs are plotted in Fig. 15a and b,respectively. In Fig. 15a, although the contaminated signal hassmaller and even amplitude waveforms when plotted in the tem-poral domain, it has distinct PSD characteristics which are similarto the ‘solid’ one as shown in Fig. 14a. However, in Fig. 15b, itshows that the noise distorts the PSD pattern of ‘void’ case seri-ously. In fact, this PSD pattern is more looked like to the PSD ob-tained from the ‘solid’ slab (see Fig. 14a for comparison). So, itwill give a wrong judgement if the determination replies only onthe PSD pattern and when the signals contain background noise.

In fact, the noise has the same spectrum as the signal so anyfilter in temporal or frequency domain will not be effective enoughto demist the contamination and achieve the distinguishing task.

b1b22×1

4

21×2

1×1

b1b22×1

4

21×2

1×1

Fig. 18. Artificial neural network structure.

4.3. Component PSD

Under the noisy environment, the spectrum method on PSDdoes not work efficiently to distinguish the ‘void’ slabs from the so-

PSD

per

cent

age

b

PSD

per

cent

age

a

Specimen numbers

Specimen numbers

Fig. 17. Component PSD of wav

lid slabs. However, through the wavelet packet decomposition toget component PSD pattern in special frequency bands, it is possi-ble to develop a method to identify the health condition of the testsample in noisy conditions. The system diagram is shown inFig. 16.

The impact response is translated in Data Acquirement moduleto digital data, sequentially put through a threshold filter modulein temporal domain to remove stochastic noise. Then, WPD opera-tion is implemented with wavelet packet node coefficients fromwhich the component PSD is generated. For the simplicity of sys-tem, 2-level wavelet packet decomposition is adopted (Fig. 12).After that, filters are implemented according to the Eq. (5) to re-move the noise in wavelet domain in order to extract further the

Component numbers

Component numbers

elet packet decomposition.

Page 9: Robotic impact-acoustics system for tile-wall bonding ... · Robotic impact-acoustics system for tile-wall bonding integrity inspection B.L. Luka,*, K.P. Liua, Z.D. Jianga,b, F. Tongc

0 2 4 6 8 10 12 14 16 18 200

10

20

30

40

50

60

70

80

90

100

SNR (dB)

Pro

porti

on (%

)

rightwrongfailure

Fig. 19. Performance with SNR.

B.L. Luk et al. / Mechatronics 19 (2009) 1251–1260 1259

nature of the PSD pattern of the signal. Finally, the pattern is fed toan artificial neural network module to classify. Result of WPDexperiment is showed in Fig. 17.

In experiment, we use the 2-level wavelet packet decomposi-tion generating four node coefficient sequence: w2

1;k;w31;k;

w41;k;w

51;k. The wavelet is of arbitrary choice, and the ‘db3’ wavelet

is used in the experiment. The powers of them are computed asq2

1;q31;q4

1;q51, respectively, to forming the component PSD.

In the experiment, 400 specimens (including 200 solid slabs and200 void slabs) are investigated. Through 2-level wavelet packetdecomposition, the power of raw signal allocates into four compo-nent fields. In Fig. 17a, it shows that the component PSD distribu-tion of the noise-free raw signal. And Fig. 17b stands for the one ofnoised signal. The first half 200 specimens are the impact re-sponses of solid slabs and the second half 200 specimens the oneof void slabs. Comparing the two figures, we find that the noise dis-torts the PSD distribution of raw signal. But the outline of compo-nent PSD pattern is not damaged which reflects the majorcharacteristics of bonding quality.

4.4. ANN for classification

Now, the nature component PSD pattern of the signal is ob-tained. To obtain the final result, a simple structure of ANN is ap-plied to classify the signal. As showed in Fig. 18, a 3-layer neuralnetwork of classical structure is used in our experiment includinga 4-neuron input layer, one hidden layer and one output layer. Theerror backup propagation (BP) method with a momentum updat-ing algorithm is chosen to train the ANN.

In the experiment, the hyperbolic tangent sigmoid transferfunction tansig(n) and the symmetric saturating linear transferfunction satlins(n) are used as the transfer functions sequentially,

tansigðnÞ ¼ en � e�nð Þ= en þ e�nð Þ ð6Þ

satlinsðnÞ ¼�1; n 6 �1N; �1 < n < 11; n P 1

8><>: : ð7Þ

Connecting the component PSD as the input of ANN, the weights(w1 and w2) and the scalar biases (b1 and b2) associated with theconnection are obtained as follows after the training process,

w1 ¼3:9776 �2:2199 �3:9728 �2:9945�0:7040 �2:7241 0:3585 2:5408

��������

w2 ¼ �6:9559 1:4569j jb1 ¼ �1:3331 0:8957j jb2 ¼ 0:3867

5. Performance

To verify the method, the performance of various SNR levels issimulated. It meets the normal signal detection principle. The per-formance is improved with the increase of the SNR. As shown inFig. 19, when SNR is greater than 15 dB, the successful detectionrate reaches 100%. Even with the SNR reduced to 2 dB, the success-ful detection rate is still as high as 80%.

6. Conclusion

Robotic impact-acoustics system is introduced, including mech-anism, hardware and software. In our investigation, the audiblenoise mixed with the impact response distorts the PSD distribu-tion; however, it does not damage the outline of component PSDpattern. So, a novel method based on the wavelet packet is pro-posed to extract the characteristic of impact response. The pro-spective experimental results are obtained.

Also, a simple structure of ANN is applied to obtain the evalua-tion result. All the experimental results show the whole roboticimpact-acoustic system could work with good performance.

Acknowledgement

The authors are grateful for the funding by a grant from CityUniversity of Hong Kong (Project No. 9610024-630: ITRG006-06)and sponsorship from Wicbot Technology Limited in support ofthe present research.

References

[1] Chew MYL. Factors affecting ceramic tile adhesion for external cladding.Construct Build Mater 1999;13(5):293–6.

Page 10: Robotic impact-acoustics system for tile-wall bonding ... · Robotic impact-acoustics system for tile-wall bonding integrity inspection B.L. Luka,*, K.P. Liua, Z.D. Jianga,b, F. Tongc

1260 B.L. Luk et al. / Mechatronics 19 (2009) 1251–1260

[2] Zhao ZY, Zhang WL. Influence of workmanship on the bonding strength of tilesto external walls. Int J Adhesion Adhesives 1997;17(1):47–53.

[3] Tan KS, Chan KC, Wong BS, Guan LW. Ultrasonic evaluation of cement adhesionin wall tiles. Cement Concrete Compos 1996;18(2):119–24.

[4] Yang S, Gu L, Gibson RF. Nondestructive detection of weak joints in adhesivelybonded composite structures. Compos Struct 2001;51(1):63–71.

[5] Cheng C, Sansalone M. The impact-echo response of concrete plates containingdelaminations: numerical, experimental and field studies. J Mater Struct1993;26(5):274–85.

[6] McCann DM, Forde MC. Review of NDT methods in the assessment of concreteand masonry structures. NDT&E Int 2001;34(2):71–84.

[7] Mori K, Spagnoli A, Murakami Y, Kondo G, Torigoe I. A new non-contactingnon-destructive testing method for defect detection in concrete. NDT&E Int2002;35(6):399–406.

[8] Tong F, Tso SK, Xu XM. Tile-wall bonding integrity inspection based on time-domain features of impact acoustics. Sens Actuat A: Phys 2006;132(2):557–66.

[9] Christoforou AP, Yigit AS. Effect of flexibility on low velocity impact response. JSound Vibrat 1998;217(3):563–78.

[10] Wu HD, Siegel M. Correlation of accelerometer and microphone data in theCoin Tap Test. In: Proceedings of the instrumentation and measurementtechnology conference, vol. 2; 1999. p. 814–9.

[11] Sardy S, Tseng P, Bruce A. Robust wavelet denoising. IEEE Trans Signal Process2001;49(6):1146–52.

[12] Tso SK, Fung YH, Chow WL, Zong GH, Liu R. Design and implementation of aglass-wall cleaning robot for high-rise buildings. In: Proceedings of the worldautomation congress eighth international symposium on robotics withapplications; 2000. Paper ID: ISORA123.

[13] Hillenbrand C, Berns K, Weise F, Koehnen J. Development of a climbing robotsystem for non-destructive testing of bridges. In: Proceedings of the 8th IEEEconference on mechatrinics and machine vision in practice; 2001. p. 399–403.

[14] Luk BL, Cooke DS, Galt S, Collie AA, Chen S. Intelligent legged climbing servicerobot for remote maintenance applications in hazardous environments. JRobot Autonom Syst 2005;53(2):142–52.

[15] Luk BL, Liu KP, Collie AA, Cooke DS, Chen S. Tele-operated climbing and mobileservice robots for remote inspection and maintenance in nuclear industry. IndRobot 2006;33(3):194–204.

[16] Kinney P. Zigbee technology: wireless control that simply works. Technicalwhite paper from Zigbee Alliance; <http://www.zigbee.org/en/resources/whitepapers1.asp>.

[17] He Z, Zhao J, He Y, Meng Q. Wavelet transform and multiresolution signaldecomposition for machinery monitoring and diagnosis. In: Proceedings ofIEEE international conference on industrial technology; 1996. p. 724–7.

[18] Donoho DL, Johnstone JM. Ideal spatial adaptation by wavelet shrinkage.Biometrika 1994;81(3):425–55.

[19] Donoho DL, Johnstone IM. Adapting to unknown smoothness via waveletshrinkage. J Am Stat Assoc 1995;90:1200–24.