mastering geospatial metadata with fme
TRANSCRIPT
![Page 1: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/1.jpg)
FME and MetadataMastering Metadata with FME 2012
Don MurrayDean Hintz
FME ® Desktop 2012 Version
![Page 2: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/2.jpg)
Agenda
FMEMetadataMetadata StandardsReadingUpdatingWritingHarvestingValidatingPublishing
![Page 3: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/3.jpg)
Safe Software Facts
Private company Founded in 1993 Headquarters in
Vancouver, BC, Canada 90+ employees
50+ value-added resellers &system integrators in 35 countries
~100 FME Certified Professionals & Trainers around the globe
Thousands of customersacross 116 countries
![Page 4: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/4.jpg)
IT Service Case Distribution
4
![Page 5: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/5.jpg)
Introduction to FME
What is FME?
How Does FME Work? Centralized Semantic Transformational
Data Translation Basics FME Desktop Training 2012
![Page 6: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/6.jpg)
FME Moves Data
![Page 7: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/7.jpg)
FME is all about …
![Page 8: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/8.jpg)
Barriers to Interoperability
Web
Data Types
Data Translation Basics FME Desktop Training 2012
![Page 9: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/9.jpg)
Translation
FME supports reading from a wide array of data formats and types 275+ formats, with more added each year CAD, GIS, XML, raster, database, non-spatial, 3D
9
![Page 10: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/10.jpg)
Poll Question #1: FME
How long have you been using FME?
?
![Page 11: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/11.jpg)
Metadata – What is it?
![Page 12: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/12.jpg)
Metadata – What it is
Metadata provides information about whatever types of data you have:
12
![Page 13: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/13.jpg)
Metadata – Data about data
Describes data structures• tables• geometry types• data types• fields
Describes data content• coordinate system• extent• modification date• quality, ownership, etc.
![Page 14: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/14.jpg)
Metadata - Purpose
![Page 15: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/15.jpg)
Common Metadata Questions
What does the data set describe?Who produced the data set?Why was the data set created?How was the data set created?How reliable are the data; what problems remain
in the data set?How can someone get a copy of the data set?Who wrote the metadata?
geology.usgs.gov/tools/metadata/tools/doc/ctc/
?
![Page 16: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/16.jpg)
Poll Question 2: Metadata
How often do you work with metadata?
?
![Page 17: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/17.jpg)
Metadata Standards
FGDC & ISO 19115 • describes geographical
information and services
• contents, spatial-temporal, data quality, access and rights to use
• 400 metadata elements, 20 core
![Page 18: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/18.jpg)
ISO / OGC Standards
ISO/TS 19139• defines Geographic Meta Data XML (gmd) • XML Schema implementation derived from ISO
19115• Version "2007-04-17" uses GML 3.2.1
(http://www.opengis.net/gml/3.2)• Version "2006-06-04" use GML 3.2.0 (http://
www.opengis.net/gml)• ISO 19119 – web services
Bottom line: need to know what GML version and what ISO standard you need to comply with
![Page 19: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/19.jpg)
Poll Question #3: Standards
Which metadata standards/types are interested in?
?
![Page 20: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/20.jpg)
Key FME Metadata Capabilities
• Reading
• Writing
• Updating
• Harvesting
• Validating
• Integration with web services
![Page 21: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/21.jpg)
Demos
Reading
Writing
Updating
Harvesting
Validation (Syntax, Schema)
![Page 22: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/22.jpg)
Demo: Reading
Metadata attributes
XML Reader / Fragmenter with Feature Paths and flattening
HTTPFetcher
Reading from database
![Page 23: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/23.jpg)
Demo: Reading Metadata Attributes
![Page 24: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/24.jpg)
Demo: Reading Geodatabase Metadata
expose the geodb_metadata_string attribute
![Page 25: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/25.jpg)
Demo: Writing
XMLTemplaterTemplates for • FGDC• ISO 19115
Database write mode: geodatabase
![Page 26: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/26.jpg)
Demo: Harvesting and Writing
![Page 27: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/27.jpg)
Demo: Writing Geodatabase Metadata
Geometry:geodb_metadataExpose: geodb_metadata_string
![Page 28: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/28.jpg)
Demo: Updating
XMLUpdater, XQueryTimeStamperXMLFormatter
![Page 29: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/29.jpg)
Demo: Updating
XMLUpdater: Insert, Delete, Replace, Replace Contents
![Page 30: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/30.jpg)
Poll Question 4: XML
What XML tools do you use?
?
![Page 31: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/31.jpg)
Validation – What to validate against?
ISO 19139 with GML 3.2.0:http://schemas.opengis.net/iso/19139/20060504/gmd/gmd.xsd
To Validate XML against ISO 19139 with GML 3.2.1:http://standards.iso.org/ittf/PubliclyAvailableStandards/ISO_19139_Schemas/
See page 13 of:http://
inspire.jrc.ec.europa.eu/reports/ImplementingRules/metadata/MD_IR_and_ISO_20090218.pdf
Or Google and click top link: “inspire metadata implementing rules technical guidelines”
Key takeaway: to validate gmd:MD_Metadata you need to validate against gmd.xsd
![Page 32: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/32.jpg)
Demo: Validation
XMLValidator• Syntax• Schema
![Page 33: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/33.jpg)
Validation Report – Bad Syntax
![Page 34: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/34.jpg)
Validation Report – Bad Schema
![Page 35: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/35.jpg)
Validation Report – Good Metadata
![Page 36: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/36.jpg)
Validation Workspace
![Page 37: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/37.jpg)
Other Validation Options
• Tester• Field names• Data types (numeric, date etc)• IDs
• CoordinateSystemExtractor• GeometryFilter• GeometryOGCvalidator• SpatialFilter (check extents)
![Page 38: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/38.jpg)
CSW: Catalog Service for the Web
• Deegree
• GeoNetwork
• OpenGIS
• TerraCatalog
![Page 39: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/39.jpg)
Metadata Services: CSW
• Reading• Writing / Publishing• Updating
![Page 40: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/40.jpg)
Poll Question #5: CSW
What CSW tools do you use?
?
![Page 41: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/41.jpg)
![Page 42: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/42.jpg)
Arkansas Geostor: Download
![Page 43: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/43.jpg)
Customer Implementations: LGII – Lithuania Geospatial Portal
File Formats: AutoCAD DXF / DWG ESRI Personal Geodatabase Shape MapInfo TAB Microstation Design V8 GML GIF / PNG JPEG TIFF ERDAS IMG ECW
Coordinate systems: LKS94 WGS84 ETRS89 1963 Pulkovo 1942 UTM (34, 35 zones)
Other data sources: WFS SDE Files
![Page 44: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/44.jpg)
Summary
Metadata describes your dataHelps with searches and
managementFME can help drive your metadata: • Read / write and update• Harvest• Validate• Automate maintenance tasks• Integrate with CSWSwitch from manual to automatic by
using FME to power your metadata
![Page 45: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/45.jpg)
Online Training
Upcoming Online Courses in 2012 Online FME Desktop:
May 16/17 June 20/21 Sept 19/20 Oct 17/18 Dec 5/6
FME Server Authoring: May 24 Sept 27
Online Advanced FME Desktop: XML Reading May 16 or 17 XML Writing May
23 or 24 Oracle Spatial June 7 or Sept
26 Esri (demo only) Sept 6 KML Nov
14 Raster Nov
29
![Page 46: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/46.jpg)
Poll Question 6: Training
Would you like to enter for a chance to win a free seat of online FME training?
?
![Page 47: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/47.jpg)
FME 2012 World Tour
http://fme.safe.com/content/FME-2012-World-Tour
Twitter Hashtag: #FMEWT
![Page 48: Mastering Geospatial Metadata with FME](https://reader036.vdocument.in/reader036/viewer/2022081422/5560c13dd8b42af43b8b5444/html5/thumbnails/48.jpg)
Thank You
Questions?
www.safe.com/support
www.youtube.com/fmechannel
fmepedia.safe.com/knowledgeSearch?k=metadata