sensor data integration: concepts and...

22
Tuna Kalaycı & Apostolos Sarris Institute for Mediterranean Studies Laboratory of Geophysical-Satellite Remote Sensing and Archaeo-environment Sensor Data Integration: Concepts and Methods

Upload: others

Post on 26-Jun-2020

18 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

Tuna Kalaycı & Apostolos Sarris Institute for Mediterranean Studies

Laboratory of Geophysical-Satellite Remote Sensing and Archaeo-environment

Sensor Data Integration:

Concepts and Methods

Page 2: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

According to Luo and Kay (1992) multi-sensor fusion “refers to any stage in an integration

process where there is an actual combination (or fusion) of different sources of sensory

information into one representational format.”

Starr and Desforges (1998) suggests “[d]ata fusion is a process that combines data and

knowledge from different sources with the aim of maximising the useful information

content, for improved reliability or discriminant capability, while minimising the quantity of

data ultimately retained.”

Wald (1998) defines it as “a formal framework in which are expressed means and tools for

the alliance of data of the same scene originating from different sources. It aims at obtaining

information of greater quality; the exact definition of greater quality will depend upon the

application.”

According to McGirr (2001) data fusion is “the process of bringing large amounts of

dissimilar information together into a more comprehensive and easily manageable form”

A PLETHORA of DEFINITIONS and WORKFLOWS

R. C. Luo and M. G Kay (1992) Data fusion and sensor integration: State-of-the-art 1990s.

Data Fusion in Robotics and Machine Intelligence, Academic Press Limited, San Diego

Starr and M. Desforges (1998) Strategies in data fusion - sorting through the tool box. Proceedings of European Conference on Data

Fusion

L. Wald (1998) A European proposal for terms of reference in data fusion, In: International Archives of Photogrammetry and Remote

Sensing, Vol. XXXII, Part 7, pp. 651-654

S. C. McGirr (2001) “Resources for the design of data fusion systems”, In: Proc. International Conference on Information Fusion

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 3: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

DATA INTEGRATION/FUSION STUDIES in ARCHAEOLOGY

Brizzolari, E., F. Ermolli, L. Orlando, S. Piro, and L. Versino. 1992. “Integrated Geophysical

Methods in Archaeological Surveys.” Journal of Applied Geophysics 29 (1): 47–55.

Cammarano, F., P. Mauriello, and S. Piro. 1997. “High-Resolution Geophysical Prospecting

with Integrated Methods. The Ancient Acropolis of Veio (Rome, Italy).” Archaeological

Prospection 4: 157–64.

Doneus, M., and W. Neubauer. 1998. “2D Combination of Prospection Data.”

Archaeological Prospection 5: 29–56.

Gaffney, V., H. Patterson, S. Piro, D. Goodman, and Y. Nishimura. 2004.

“Multimethodological Approach to Study and Characterize Forum Novum (Vescovio,

Central Italy).” Archaeological Prospection 11 (4): 201–12.

Johnson, Jay K., and B.S. Haley. 2004. “Data Fusion as a Means of Sensor Evaluation in

Archaeological Applications.” In SPIE Proceedings, 5234:688–97. International Society for

Optics and Photonics.

Drahor, M.G. 2006. “Integrated Geophysical Studies in the Upper Part of Sardis

Archaeological Site, Turkey.” Journal of Applied Geophysics 59 (3): 205–23.

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 4: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

Kvamme, K.L. 2006. “Integrating Multidimensional Geophysical Data” Archaeological

Prospection 13 (1): 57–72.

Piro, S., D. Peloso, and R. Gabrielli. 2007. “Integrated Geophysical and Topographical

Investigation in the Territory of Ancient Tarquinia (viterbo, Central Italy).” Archaeological

Prospection 14 (3): 191–201.

Masini, N., E. Rizzo, R. Lasaponara, and G. Orefici. 2008. “Integrated Remote Sensing

Techniques for the Detection of Buried Archaeological Adobe Structures: Preliminary

Results in Cahuachi (Peru).” Advances in Geosciences 19: 75.

Keay, S., G. Earl, S. Hay, S. Kay, J. Ogden, and K.D. Strutt. 2009. “The Role of Integrated

Geophysical Survey Methods in the Assessment of Archaeological Landscapes: The Case of

Portus.” Archaeological Prospection 16 (3): 154–66.

Cardarelli, E., and G. Di Filippo. 2009. “Integrated Geophysical Methods for the

Characterisation of an Archaeological Site (Massenzio Basilica — Roman Forum, Rome,

Italy).” Journal of Applied Geophysics 68 (4): 508–21.

DATA INTEGRATION/FUSION STUDIES in ARCHAEOLOGY

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 5: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

(Brizzolari et al. 1992)

Some Examples

(Doneus and Neubauer 1998)

(Gaffney et al. 2004)

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 6: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

Kvamme, 2006, Integrating Multidimensional Geophysical Data

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 7: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

DATA INTEGRATION LEVELS

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 8: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

METHODS of INTEGRATION: Two Case Studies

Almyros 2

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 9: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

METHODS of INTEGRATION: Two Case Studies

Mantinea

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 10: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

METHODS of INTEGRATION: A Comprehensive List

Graphical Integration

•RGB Composites

•Alpha Compositing

•HIS Transformation

Binary Operations

•Boolean Union

•Boolean Intersection

•Boolean Sum

Continuous Data Operations

•Numeric Combinations

•Data Product and Data Sum

Statistical Operations

•Cluster Analysis

•Principle Component Analysis

•Mahalanobis Classification

•Logistic Regression

•Cokriging

•Wavelet Transformation

•Curvelet Transformation

•Multi-scale Decompositions

…and many others

•Neural Networks

•Dempster-Shafer Evidence Theory

•Joint Inversion Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 11: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

GEOPHYSICAL PROSPECTION

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 12: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

RGB Composites

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 13: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

RGB Composites

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 14: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

HIS Transformation

• Intensity is the total brightness/lightness of a color

• Hue is the color itself as we perceive it

• Saturation is the purity of that color

< transform RGB space to HIS space >

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 15: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

HIS Transformation

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 16: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

Data Product and Data Sum

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 17: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

Data Product and Data Sum

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 18: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

Wavelet Transformation

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 19: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

Wavelet Transformation

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 20: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

Multi-Scale Decomposition

Subsampling results in size differences in sub-band images, creating a

pyramid.

A rule based cascading of pyramids of different data sources while keeping

the most significant details provides integration

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 21: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

Multi-Scale Decomposition

Geo

Sat

ReS

eArc

h

IMS-F

ORTH

Page 22: Sensor Data Integration: Concepts and Methodspoliteia.ims.forth.gr/files/wCAA2015_Kalayci_Sarris.pdf · Sensor Data Integration: Concepts and ... DATA INTEGRATION/FUSION STUDIES in

Conclusion and Future Prospects

1 + 1 = 1.5 1 + 1 = 3

• the need for more empirical studies,

representing diverse datasets

• systematic testing for different methods

• a method for performance evaluation

• a specialized software for data integration in

archaeological prospection

Geo

Sat

ReS

eArc

h

IMS-F

ORTH