![Page 1: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/1.jpg)
IntellinQ © 201616-2-2017 1
Managing hydrographic data for multiple usage
Mark Terlien
![Page 2: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/2.jpg)
IntellinQ © 2016
Introduction
• Mark Terlien, Director Product Development IntellinQ
• IntellinQ was founded in 2013
• Focus on spatial data management:
• GeolinQ: Web-based solution for spatial data management
• C-MAP BathyManager: Bathymetry Management system
![Page 3: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/3.jpg)
IntellinQ © 2016
Hydrographic Data Management
Collection Integration Distribution
![Page 4: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/4.jpg)
IntellinQ © 2016
Managing data management chain with GeolinQ
Collection Integration Distribution
Data Management Chain
![Page 5: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/5.jpg)
IntellinQ © 2016
Data collection
Field data collection Data services Data formats
POINT CLOUDS• ASCII• LASRaster• GeoTIFFVector• Shape• XML/GML• WFS• S-57
![Page 6: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/6.jpg)
IntellinQ © 2016
Management of point clouds
Data management Metadata management
![Page 7: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/7.jpg)
IntellinQ © 2016
Management point cloud collections
• Archive
• Quality control
• Publication
![Page 8: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/8.jpg)
IntellinQ © 2016
Plug-and-play data model (from XSD to data model)
![Page 9: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/9.jpg)
IntellinQ © 2016
Generated S-57 data model
![Page 10: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/10.jpg)
IntellinQ © 2016
Management of features
![Page 11: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/11.jpg)
IntellinQ © 2016
Data integration
Integration
![Page 12: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/12.jpg)
IntellinQ © 2016
Integration of surveys into seafloor model
Integration
![Page 13: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/13.jpg)
IntellinQ © 2016
Data processing
Processing
![Page 14: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/14.jpg)
IntellinQ © 2016
Data Distribution
DevicesFormats/ProtocolsUsages
FILE• ASCII• GeoTIFF• GML• ShapeOWS• WMS• WFSAPI• REST
![Page 15: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/15.jpg)
IntellinQ © 2016
Different data standards
• IHO:• S-52, S-57, S-100, S-101, S-102
• INSPIRE
• OGC:• WFS, WMS
• ISO:• ISO-19115, ISO19139
![Page 16: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/16.jpg)
IntellinQ © 2016
Data model linking
Linking
![Page 17: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/17.jpg)
IntellinQ © 2016
Publish data as OWS (INSPIRE)
WMS (PNG)
WFS (GML)
![Page 18: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/18.jpg)
IntellinQ © 2016
Publish metadata via REST API (XML/JSON)
[{"system":{"ID":100177},"type":{"Namespace":null,"Name":"Survey"},"user":{"Datasource":{"system":{"ID":100137},"type":{"Namespace":null,"Name":"GlCatalogDatasource"},"user":{"ReadOnly":false,"Type":{"system":{"ID":100137},"type":{"Namespace":null,"Name
![Page 19: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/19.jpg)
IntellinQ © 2016
New challenges
![Page 20: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/20.jpg)
IntellinQ © 2016
Hydrographic Data Management evolution
• Past:• File-based, manual product compilation
• Now:• Enterprise database, semi-automatic product generation and single channel distribution
• Future:• Virtual database, automatic multiple product generation and multiple channel distribution
• Past:• File-based, manual product compilation
• Now:• Enterprise database, semi-automatic product generation and single channel distribution
• Future:• Virtual database, automatic multiple product generation and multiple channel distribution
![Page 21: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/21.jpg)
IntellinQ © 2016
Hydrographic Data Management: Now
Data collection Data Integration Data Distribution
Store
Store
Store
Data In
tegration
Retrieve
Retrieve
Retrieve
ETL
Messaging
File import
File
![Page 22: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/22.jpg)
IntellinQ © 2016
Integration of maritime datasets into information products
• Challenges:
• Increasing data volumes
• Variety of internal and external data sources (e.g. open data)
• Access to data instead of downloading pre-defined products,
• Different technologies to access andpublish data (SOAP, REST, OWS, files)
![Page 23: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/23.jpg)
IntellinQ © 2016
Hydrographic Data Management: Future
Data collection Data Integration Data Distribution
Data In
tegration
Retrieve
Retrieve
Retrieve
Map en link
Map en link
Retrieve
Retrieve
File import File
OWS
REST
![Page 24: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/24.jpg)
IntellinQ © 2016
In the future situation:
• Reduction of number of ETL processes
• Real-time data access
• Product generation on-demand
• Data virtualization (get data from source directly)
• Multiple channels for data distribution
![Page 25: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/25.jpg)
IntellinQ © 2016
GeolinQ Data Management Concept
Data Sources Data Models Data Services
Link to
Data So
urces
Link to
Data Services
Mapping and
Linking
WFS
File Import
Databases
Visualisation
File Export
XML/GML
Web Services
![Page 26: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/26.jpg)
IntellinQ © 2016
Hydrographic Data Management software
• Future requirements
• Multiple datasources
• No pre-defined data models and changing metadata definitions
• Data mapping and linking
• Point cloud management and distribution
• Importance of metadata (traceability, liability)
![Page 27: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/27.jpg)
IntellinQ © 2016
Multiple data Sources: create a data hub
• Catalog Data Source• Create model manually
• GML/XML Data source• Generate model from GML and XML XSD’s
• WFS Data source• Generate model from WFS feature type description
• Database Data Source• Generate model from external database (Oracle/ PostgreSQL)
• S-57 Data Source• Generate model and import features from S-57 file
![Page 28: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/28.jpg)
IntellinQ © 2016
No pre-defined data model
• Changing data definitions on-the-fly:
• Traditionally:
• x, y, depth
• S-57 (fixed set of feature definitions)
• Nowadays:
• Additional attributes (e.g. time), backscatter data
• S-100/S-101/S-102 (plug-and-play data models)
• Future:
• More data definitions to come?
![Page 29: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/29.jpg)
IntellinQ © 2016
Changing metadata definitions
• Changing metadata definitions:
• Traditionally:
• No standardized metadata definitions
• Metadata for specific domains
• Nowadays:
• Metadata standards mostly based on ISO19115 (e.g. S-102)
• Combination of metadata standards and internal metadata requirements
• Future:
• Changing metadata standards and requirements
![Page 30: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/30.jpg)
IntellinQ © 2016
Map and link from source to target data models
GeolinQ Flexible Data Model
Source data models
Map
pin
g and
lin
king Target data models
HydrologHydrolog
S-100
HydrologHydrolog
INSPIRE
HydrologHydrologWFS sources
HydrologHydrolog
DB sources
HydrologHydrologGML sources
HydrologHydrolog
File sources
![Page 31: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/31.jpg)
IntellinQ © 2016
Managing point clouds
• Fast point cloud import, retrieval and visualisation
• Querying on point cloud metadata attributes
• Showing point cloud footprints on chart
• Visualisation of point cloud data on chart
• For integrated quality control of point clouds:• Correct coordinate system transformations applied
• Correct vertical datum
• Same units for attributes
![Page 32: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/32.jpg)
IntellinQ © 2016
Import algorithm
• No limitions on number of points, point cloud size, physical memory of hard disk size
• Algorithm does not require any prior knowledge aboutnumber of points or MBR
• Optimized database storage of data chunks, no proprietary data types (database independent)
• Automatic generation of visualisation pyramid
• Automatic delineation of point cloud foot print (TIN)
![Page 33: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/33.jpg)
IntellinQ © 2016
Preview of Point cloud with metadata
![Page 34: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/34.jpg)
IntellinQ © 2016
Point cloud footprints and attribute data
![Page 35: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/35.jpg)
IntellinQ © 2016
Quality control
![Page 36: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/36.jpg)
IntellinQ © 2016
Data publishing: Export, Services and REST
• Export data as files• Tabular ASCII, Geotiff, LAS, Shape
• Other file formats on request.
• OWS web services meet end-user information needs:• WMS Services
• WFS Services
• Authenticated REST services • http request to access data structures and data
![Page 37: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/37.jpg)
IntellinQ © 2016
Easy sharing of point cloud data
• Web based
• Publishing using different technologies (file as well as web service)
• Open standards and Open data
• Spatial and metadata querying
• User-defined styling
![Page 38: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/38.jpg)
IntellinQ © 2016
Publishing as service
![Page 39: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/39.jpg)
IntellinQ © 2016
Accessing point cloud WMS or Export to file
![Page 40: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/40.jpg)
IntellinQ © 2016
GeolinQ architecture in the cloud
• GeolinQ architecture is optimized for easy implementation and deployment
• Configuration instead of development
• Web-based
• Scalable
• OGC web services
• REST
• Platform independent
![Page 41: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/41.jpg)
IntellinQ © 2016
Hydrographic data management in the future
Different data sourcesDifferent technologiesOpen data
Data accessOn-demand productsDifferent technologies
Changing metadata definitions
Link to
Data So
urces
Link to
Data Services
Mapping and
LinkingWFS
File Import
Databases
Visualisation
File Export
XML/GML
Web Services
Virtual database
![Page 42: Managing hydrographic data for multiple usage · Hydrographic Data Management evolution • Past: • File-based, manual product compilation • Now: • Enterprise database, semi-automatic](https://reader033.vdocument.in/reader033/viewer/2022050421/5f8fea1e2518676e454933d5/html5/thumbnails/42.jpg)
IntellinQ © 2016
Contact/ Meer informatie
Mark Terlien [email protected]
Websites:www.intellinq.nlwww.geolinq.nl
Tel: +31(0)10 846 74 10