alignment of multi-sensor data: adjustment of sampling...

1
Alignment of Multi-Sensor Data: Adjustment of Sampling Frequencies and Time Shifts Marcus Vollmer 1 , Dominic Bläsing 2 , Lars Kaderali 1 1 Institute of Bioinformatics, University Medicine Greifswald, Germany 2 Institute of Psychology, University of Greifswald, Germany P N S H H H H S S S S F F F N N N “Multisensor data fusion refers to the acquisition, processing and synergistic combination of information gathered by various knowledge sources and sensors to provide a better understanding of a phenomenon.” Varshney, P. K. (1997). Multisensor data fusion. Electronics & Communication Engineering Journal, 9(6), 245-253. Our aim is to establish a robust method for correcting sampling frequencies and time shifts in order to align non-synchronized sensors from multiple devices. Our approach is based on RR intervals from multiple ECG measurements. Beneficial effects: Improved system reliability and robustness Extended coverage (spatial, temporal) Extended sensor variety Increased confidence Improved resolution Experimental data collected from 13 subjects u 5 min standing rest u 5 min walking on treadmill (1.2m/s) u cognitive task (2-back audio test) u 5 min walking on treadmill (1.2m/s, 15% gradient) u In between: NASA Task Load Index to measure individual strain SOT/EKG FAROS/ECG NEXUS/Sensor-B:EKG HEXOSKIN/ECG_I POLAR/RR Time delay d s 1 s 2 s 3 s 4 s 5 s i=1,2,... beat-to-beat differences SOMNOtouch NIBP | EKG Faros 360° | ECG NeXus-10 MKII | Sensor-B:EKG Hexoskin Hx1 | ECG_I Polar RS800 | RR Equipped devices S SOMNOtouch NIBP | 512 Hz F EMotion Faros 360° | 1000 Hz N NeXus-10 MKII | 8000 Hz H Hexoskin Smart Shirt Hx1 | 256 Hz P Polar RS800 Multi | 1000 Hz Raw data Condition before multi-sensor adjustments. Why should I adjust for sampling frequencies? In 24h-ECG measurement sampled at 1000 Hz we assume to collect 1000*24*60*60 = 86,400,000 samples Actually given the impreciseness of the clock signal (quartz crystal) +0.01% we observe 86,408,640 samples 8,640/1000 Hz = 8.64 s divergence Identical signals are not aligned anymore. Without frequency adjustment wrong conclusions can be reached: The heart rate increased subsequent to the accident. The heart rate increased just before the accident. g 1 We aligned the sensors locally using a short and clean segment of 300 beats from a resting state period. The time shift d was determined by searching for a time shift d for which S, the sum of absolute differences to the reference sensor, reached the minimum value. We took into account that some of the heartbeats could be misplaced due to noise, or could not be identified at all. Therefore, S is based only on matched beats which differ not more than 750 ms. g 2 Linear adjustment of sampling frequencies was performed by computing a robust linear regression from the 300 matched beats of the resting period using iteratively reweighted least squares with a bisquare weighting function. Next, we transformed the resulting slope into a factor for sampling frequency correction: Fs correct = Fs · (1 - Slope of robust regression fit) 250 300 350 400 450 500 -60 -40 -20 0 Adjustment of sampling frequency Faros to Nexus | Test person 5 Non-conformance in the sampling frequency result in linear drifts of pairwise differences of aligned heartbeats. Some differences d rise or fall over time linearly. Recording time t [sec] Beat-to-beat differences s i [ms] -1000 -800 -600 -400 -200 0 200 0 20 40 60 80 Correction of time shift Faros to Nexus | Test person 5 The sum of absolute differences of mismatched beats S = i |s i | are randomly distributed at a constant high value. Time delay d [sec] Sum of absolute differences S [sec] Hexoskin as the reference 0 500 1000 1500 2000 -80 -60 -40 -20 0 20 40 60 80 -80 -60 -40 -20 0 20 40 60 80 Nexus 7999.666 Hz (-0.004%) Faros 1000.186 Hz (+0.019%) 0 500 1000 1500 2000 SOMNOtouch 511.973 Hz (-0.005%) Polar 999.914 Hz (-0.009%) Recording time t [sec] Recording time t [sec] s i [ms] s i [ms] Recording Device Factory speci- fication (Hz) Measured mean (min to max in Hz) Linear adjustable SOMNOtouch NIBP 512 511.97 (511.97 to 511.97) " eMotion Faros 360° 1000 1000.23 (1000.15 to 1000.36) % NeXus-10 MKII 8000 7999.60 (7999.37 to 7999.68) " Polar RS800 Multi 1000 999.91 (999.87 to 999.95) % Adjusted sampling frequencies 13 independent measurements, Hexoskin as reference We observed changes in the sampling frequencies of Faros and Polar devices. Non-linear adjustments can be carried out by resampling and the use of a robust non-linear fit. u It was possible to increase the integrity and accuracy of the experimental data by conducting a simple method specifically for alignment of multiple ECG signals. u Results are currently under review by mimicking a car- diac signal at a given exact heart frequency using an ar- bitrary waveform generator. Acknowledgments: We thank Maria Nisser (Institute for Physiotherapy, University of Jena), Anja Buder (Institute for Sports Science, University of Jena), Marlene Pacharra and Julian Reiser (Leibniz Institute for Labour Research at the Technical University of Dortmund) for their help in conducting the experiment with us. We also thank Bernd Pompe (Institute of Physics, University of Greifswald) for his help with standardized measurements using an arbitrary waveform generator. +49 (0)3834 86-5444 [email protected] MarcusVollmer.github.io Dominic Bläsing acknowledges financial support by the Federal Ministry of Education and Research of Germany in the project Montexas4.0 (FKZ 02L15A261): GEFÖRDERT VOM 09/2018 Marcus_Vollmer

Upload: phunganh

Post on 10-Aug-2019

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Alignment of Multi-Sensor Data: Adjustment of Sampling ...bioinfsync.med.uni-greifswald.de/~bioinf\vollmer/vollmer/poster_gmds.pdfAlignmentofMulti-SensorData: AdjustmentofSamplingFrequenciesandTimeShifts

Alignment of Multi-Sensor Data:Adjustment of Sampling Frequencies and Time Shifts

Marcus Vollmer1, Dominic Bläsing2, Lars Kaderali11 Institute of Bioinformatics, University Medicine Greifswald, Germany 2 Institute of Psychology, University of Greifswald, Germany

P

N

S

H

H

H H

S

S

S

SF F

FN

NN

“Multisensor data fusion refers to the acquisition, processing and synergisticcombination of information gathered by various knowledge sources and sensorsto provide a better understanding of a phenomenon.”

Varshney, P. K. (1997). Multisensor data fusion. Electronics & Communication Engineering Journal, 9(6), 245-253.

Our aim is to establish a robust method for correcting sampling frequencies andtime shifts in order to align non-synchronized sensors from multiple devices.Our approach is based on RR intervals from multiple ECG measurements.

Beneficial effects:' Improved system reliability and robustness' Extended coverage (spatial, temporal)' Extended sensor variety' Increased confidence' Improved resolution

Experimental data collected from 13 subjectsu 5 min standing restu 5 min walking on treadmill (1.2m/s)u cognitive task (2-back audio test)u 5 min walking on treadmill (1.2m/s, 15% gradient)u In between: NASA Task Load Index to measure individual strain

SOT/EKG

FAROS/ECG

NEXUS/Sensor-B:EKG

HEXOSKIN/ECG_I

POLAR/RR

Time delay d� s1 s2 s3 s4 s5

si=1,2,... beat-to-beat differences

SOMNOtouch NIBP | EKG

Faros 360° | ECG

NeXus-10 MKII | Sensor-B:EKG

Hexoskin Hx1 | ECG_I

Polar RS800 | RR

Equipped devicesS SOMNOtouch NIBP | 512 HzF EMotion Faros 360° | 1000 HzN NeXus-10 MKII | 8000 HzH Hexoskin Smart Shirt Hx1 | 256 HzP Polar RS800 Multi | 1000 Hz

Raw dataCondition before multi-sensor adjustments.

Why should I adjust for sampling frequencies?In 24h-ECG measurement sampled at 1000 Hz we assume to collect 1000*24*60*60 = 86,400,000 samplesActually given the impreciseness of the clock signal (quartz crystal) +0.01% we observe 86,408,640 samples

8,640/1000 Hz = 8.64 s divergence

Identical signals are not aligned anymore. Without frequency adjustment wrong conclusions can be reached:The heart rate increased subsequent to the accident.

The heart rate increased just before the accident.

g1 We aligned the sensors locally using a short and clean segment of 300 beats from aresting state period. The time shift dwas determined by searching for a time shift d for which S,the sum of absolute differences to the reference sensor, reached the minimum value.We took into account that some of the heartbeats could be misplaced due to noise, or couldnot be identified at all. Therefore, S is based only on matched beats which differ not more than750ms.

g2 Linear adjustment of sampling frequencies was performed by computing a robust linearregression from the 300matched beats of the resting period using iteratively reweighted leastsquares with a bisquare weighting function. Next, we transformed the resulting slope intoa factor for sampling frequency correction:

Fscorrect = Fs · (1− Slope of robust regression fit)

250 300 350 400 450 500-60

-40

-20

0

Adjustment of sampling frequencyFaros to Nexus | Test person 5

Non-conformance in the sampling frequency result in linear drifts ofpairwise differences of aligned heartbeats. Some differences d riseor fall over time linearly.

Recording time t [sec]

Beat-to-beat

differe

nces

s i[ms]

-1000 -800 -600 -400 -200 0 2000

20

40

60

80

Correction of time shiftFaros to Nexus | Test person 5

The sum of absolute differences of mismatchedbeats S =

∑i |si| are randomly distributed at a

constant high value.

Time delay d [sec]

Sumofabsolute

differe

nces

S[sec

]

Hexoskin as the reference

0 500 1000 1500 2000

-80-60-40-20

020406080

-80-60-40-20

020406080

Nexus7999.666 Hz (-0.004%)

Faros1000.186 Hz (+0.019%)

0 500 1000 1500 2000

SOMNOtouch511.973 Hz (-0.005%)

Polar999.914 Hz (-0.009%)

Recording time t [sec] Recording time t [sec]

s i[ms]

s i[ms]

Recording Device Factory speci-fication (Hz)

Measured mean (min to max in Hz) Linearadjustable

SOMNOtouch NIBP 512 511.97 (511.97 to 511.97) "

eMotion Faros 360° 1000 1000.23 (1000.15 to 1000.36) %

NeXus-10 MKII 8000 7999.60 (7999.37 to 7999.68) "

Polar RS800 Multi 1000 999.91 (999.87 to 999.95) %

Adjusted sampling frequencies13 independent measurements,Hexoskin as reference

We observed changes in the sampling frequencies of Faros and Polar devices. Non-linearadjustments can be carried out by resampling and the use of a robust non-linear fit.u It was possible to increase the integrity and accuracyof the experimental data by conducting a simple methodspecifically for alignment of multiple ECG signals.

u Results are currently under review by mimicking a car-diac signal at a given exact heart frequency using an ar-bitrary waveform generator.

Acknowledgments:

We thank Maria Nisser (Institute for Physiotherapy, University of Jena), Anja Buder (Institute for Sports Science, Universityof Jena), Marlene Pacharra and Julian Reiser (Leibniz Institute for Labour Research at the Technical University ofDortmund) for their help in conducting the experiment with us. We also thank Bernd Pompe (Institute of Physics, Universityof Greifswald) for his help with standardized measurements using an arbitrary waveform generator.

+49 (0)3834 [email protected]

Dominic Bläsing acknowledges financial support by the Federal Ministry ofEducation and Research of Germany in the project Montexas4.0 (FKZ 02L15A261):

GEFÖRDERT VOM

09/2018

Marcus_Vollmer