an update from the metadata work group - energistics · 2017. 9. 27. · an update from the...
TRANSCRIPT
![Page 1: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/1.jpg)
Energy Industry Profile An Update from the
Metadata Work Group
May 1, 2012
PUG Conference 2012
Houston, Texas
![Page 2: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/2.jpg)
Metadata Work Group
Outline
• Metadata Initiative Background / EIP Overview
• 2012 Release of EIP V1.0
• EIP Roadmap
• Energistics Geoportal Demonstration
• Esri Software Customizations to Support EIP V1.0
2
![Page 3: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/3.jpg)
Background: Business Driver & Goal State
Business Driver • 40% of staff time devoted to finding, retrieving, and verifying information, while
data volume is growing at 60-80%/yr and need for integrating distributed,
diverse resources is increasing
Goal State: Realize metadata standards and guidelines which enable stakeholders in the
energy industry (“the community”) to effectively and efficiently discover,
evaluate, and retrieve structured and unstructured information resources.
Support both proprietary data management needs, and exchange of data
between and within organizations.
Leverage existing open standards to encourage adoption within the
community and integration into the business, and exploit existing
organizational resources needed for governance and long-term
maintenance.
3
![Page 4: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/4.jpg)
Background: Scope Facets
1. Application usage:
Discovery, evaluation and retrieval of information resources distributed across
the community
2. User community:
Anyone cataloging, searching, evaluating or accessing information with value
to members of the energy industry:
Energy companies & consortia
Data & Information providers
Software vendors
Government agencies & Academia
3. Resource types:
Initial focus on structured and unstructured information resources which have
associated spatial coordinates:
Geospatial data sets & web services
Mapping, Interpretation & Modeling project data sets
Physical resources with associated location
4
![Page 5: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/5.jpg)
EIP-compliant
Catalog
External
Metadata
Catalog
Externally Harvested (Commercial,Gov’t,
& Academic)
Partner &
Subscription
Delivered
Structured
resources
Unstructured
resources
Application
Managed
Internally
Harvested
Background: Vision for Industry Metadata Exchange & Use
5
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
Legend
: Metadata exchange
via EIP standard
________
________
________
________
________
_____
![Page 6: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/6.jpg)
Initiative Participants
AAPG
Apache
Boise State Univ.
Carbon Lifecycle Technology
ConocoPhillips
DCP Midstream
Deloitte Services LP
Devon Energy
ETL Solutions
Exprodat
ExxonMobil1
First American Spatial Solutions
Flare Solutions
Fugro Robertson
Geoscience Australia
Geosoft
Ies Brazil Consulting & Services1
IHS Energy
Maersk Oil1
New Century Software
North West Geomatics
Oracle1
ORNL
P2 Energy Solutions
PEMEX
PennWell
PetroWEB
Pioneer Natural Resources1
PPDM1
Priemere Consulting Group
SAS Global Oil & Gas
Schlumberger1
Shell1
Univ. of Auckland, NZ
Virginia Dept of MM&E
Wood Mackenzie
Dave Danko, ESRI
Lisa Derenthal, Gimmal
Alan Doniger, ACD Consulting Solutions1
Scott Hills, Chevron1
Hari Koduru, Energistics
Steve Richard, USGIN, AZ Geol Survey1
Steering Team Active Participants (SMEs)
1 Energistics member; Bold: Contributed initial EIP requirements,
Feedback about v1.0 Release Candidate
Asset/Data Management SIG
Metadata Work Group
Energistics
6
![Page 7: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/7.jpg)
Key External Engagements
USGIN Project • Joint project of U.S. Geological Survey and all 51 U.S. State Geological Surveys
• Steve Richard (AZ State Geol. Survey) on Work Group Steering Team, contributing
significant technical input
ISO/TC 211, 19115 Revision Project • Energistics granted Class A Liaison status to ISO TC 211
• Metadata Work Group on ISO 19115 Revision Project Team & Editing Committee
• Contributed several enhancements to ISO/DIS 19115-1 important to the Energy
Industry Metadata Initiative vision
ISO/TC 211, 19115-1 XML Encoding Project • Energistics submitted New Work Item Proposal for XML encoding of ISO 19115-1
• Invited Dr. Ted Habermann (NOAA) to fill Team Lead role
• Steve Richard representing Metadata Work Group on Project Team
NOAA/National Geophysical Data Center • Accepted key role in proposed EIP Prototype Project
7
![Page 8: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/8.jpg)
EIP builds on established ISO 19115 standard
Our approach leverages existing
standards -
• ISO 19115 metadata standard for
geographic information –
internationally accepted
• Existing profiles:
– North American Profile (NAP)
– European INSPIRE guidelines
– ANZLIC - Australia, New Zealand
– USGIN profile – AASG/USGS
• Use same approach to deliver a
“Energy Industry Profile” built on
these
8
![Page 9: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/9.jpg)
Overview of EIP Specification
9
Leverage existing standards • ISO 19115 (content model)
– and ISO 19139 (XML encoding)
• Existing profiles of ISO 19115 – ANZLIC Profile (Australia, New Zealand)
– European Union INSPIRE guidelines
– USGIN Profile
… to Deliver
• Energy Industry Profile of ISO/DIS 19115-1
and ISO 19115-2 v1.0
– ISO Conformance Level 1 Profile designed to
enable community interoperability
• 125 pp. Specification Document includes:
– Normative Specifications
– Implementation Guidelines
– Selected XML Encoding Examples
![Page 10: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/10.jpg)
EIP Design Basis
Anticipating need for automated processing of large numbers
of metadata records, - and to simplify development, implementation, and maintenance of
supporting software –
EIP v1.0 • identifies Three Classes of
Information Resources, and
decomposes them into Five
Groups of Metadata Elements
• maps different combinations
of Metadata Element Groups
to MD_Scope codelist values,
and thus the metadata confign
- e.g., “dataset” value identifies a
Geolocated Digital Product
10
![Page 11: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/11.jpg)
Key Metadata Packages
Portrayal
Catalogue
Constraint Content
Distribution
Citation &
Responsible
Party
Metadata
Extension
Reference
System
Extent
Units of
Measure
Spatial
Representation
Key packages
are highlighted
Application
Schema
Maintenance
Lines between packages are ‘uses’ dependencies
Metadata
Entity
Identification Data Quality
11
![Page 12: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/12.jpg)
EIP Roadmap
PUG
EIP v1.0 Release Candidate Development
2010 2011
Community
Review
ISO/DIS 19115-1 Release
EIP v1.0
Updates: ESRI UC
EIP v1.0 Release Candidate
ISO 19115-1 Revision Drafts (WD0, WD1, CD, DIS)
AGU
Stakeholder Webinars
2012
ISO 19115-1 XML Encoding TS
Initial Workable XML Encoding
Pilots
EIP Prototype
EIP v1.1
OGC TC Mtg
12
![Page 13: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/13.jpg)
EIP-compliant
Catalog
External
Metadata
Catalog
Externally Harvested (Commercial,Gov’t,
& Academic)
Partner &
Subscription
Delivered
Structured
resources
Unstructured
resources
Application
Managed
Internally
Harvested
Recap: Vision for Industry Metadata Exchange & Use
13
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
Legend
: Metadata exchange
via EIP standard
________
________
________
________
________
_____
![Page 14: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/14.jpg)
EIP-compliant
Catalog
External
Metadata
Catalog
Externally Harvested (Commercial, Gov’t,
& Academic)
EIP Prototype Project
14
_________
_________
_________
_________
_________
______
_______
_______
_______
_______
_______
_____
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
Search
Editing
Harvesting
Service Interface
Project Focus
![Page 15: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/15.jpg)
EIP Prototype Project
Objectives • Implement an Energistics-managed, EIP-compliant Catalog &
Search System – Based on Esri Geoportal Server
• Establish a Network of 3-4 Systems Demonstrating Discovery of
Distributed Resources
Contributors – Energistics
– USGIN
– NOAA
– USGS
– Esri
– U. of Colorado/CIRES
15
![Page 16: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/16.jpg)
EIP Prototype Project –
Deliverables
16
Minimum 1. EIP-compliant Geoportal installation
2. XSLTs for harvesting FGDC, ISO 19115:2003 metadata
3. Compliance validation utility (Schematron)
4. Vocabulary web service for code lists
5. EIP-compliant metadata editor
6. Documented changes needed to EIP v1.0
7. Community workshops and webinars
Optional (subject to Sponsor support) or Phase 2
• Outline of design for non-Geoportal implementations
• .NET assembly for developers
• Tutorial documentation
![Page 17: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/17.jpg)
EIP Geoportal - Search Feature
Out of the box
features, no
customization
![Page 18: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/18.jpg)
EIP Geoportal – Metadata Details View
![Page 19: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/19.jpg)
EIP Geoportal – Metadata Details View (2)
• Task: update
presentation of full
metadata record
• Key content at the top
of the listing:
– Title
– Abstract
– Access constraints
– Distribution
![Page 20: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/20.jpg)
EIP Geoportal - Setup Harvest
![Page 21: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/21.jpg)
EIP Geoportal - Creating Records
• Create records
through UI
• Upload from
files (single
records)
• Harvest from
network
– WAF
– CSW
– ….
![Page 22: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/22.jpg)
EIP Geoportal - Editor Configuration
• Can configure for
various metadata
profiles
• Task: Add EIP ISO
profile to list
– Dataset
– Service
– Physical resource
![Page 23: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/23.jpg)
EIP Geoportal - Editor Features
• Tabs for metadata sections
• Automatically calculated
values
• Default values
• Pick lists
![Page 24: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/24.jpg)
EIP Geoportal - Harvest from Variety of Sources
• Metadata has
to be in known
format
• EIP geoportal
will harvest
ISO19115 and
FGDC XML
![Page 25: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/25.jpg)
Geoportal - Catalog Service (CSW)
• Geoportal windows we’ve been looking at are the
canned, out of the box interface
• Important function of catalog is the service
interface
– Allows queries from other clients using a variety of
protocols (openSearch, OGC CSW, ESRI REST)
– Responses in various formats (csw:record, EIP ISO,
atom…)
– Opportunity for others to build search interfaces
– Records in catalog may be harvested
![Page 26: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/26.jpg)
Geoportal – Output Formats
• Other output formats available
via ESRI REST API
![Page 27: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/27.jpg)
Geoportal - Atom Response in Web Browser
http://....org/geoportal/rest/find/document?searchText=Kentucky&f=atom
![Page 28: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/28.jpg)
CSW request, XML response
![Page 29: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/29.jpg)
Custom Search Client using CSW
![Page 30: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/30.jpg)
Search from USGS National Map
![Page 31: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/31.jpg)
EIP Prototype Contributors
• University of Colorado Role
– XSLT for FGDC to EIP ISO
– XSLT for ISO(2006) to EIP ISO
– Schematron rules for validation
• Esri Role
– ESRI Product Support for EIP
– Prototype Tasks
31
![Page 32: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/32.jpg)
EIP Prototype Project –
Esri Custom Tools
• Esri Geoportal Server
– Identify, validate, and create EIP v1.0 metadata
• Implement U. of Colorado/CIRES Metadata Transform Capabilities
– Geoportal transforms ISO 19115/FGDC metadata to EIP v1.0
• Search Prototype Project catalogs from ArcMap
• Use ArcCatalog 10 to view, create, and export EIP v1.0 metadata
• Assist Energistics making tools publically available
32
![Page 33: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/33.jpg)
EIP Prototype Project –
Community Workshops and Tech Transfer
• Geoportal Technology Transfer to Energistics
• First Energy Community Workshop
• Second Energy Community Workshop
• Follow-on Training Webcast
XML
33
![Page 34: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/34.jpg)
EIP Prototype Project –
Online EIP v1.0 Geoportal Metadata Editor
34
![Page 35: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/35.jpg)
EIP Prototype Prototype –
Transform existing metadata to EIP v1.0 & publish
Transform
• ISO/FGDC
• Becomes EIP v1.0
Validate
• Transformed metadata validated against EIP v1.0 rules
• Passes or Fails validation
Publish
• Valid, approved EIP 1.0 MD is published
• Invalid is saved as ‘Draft’
35
![Page 36: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/36.jpg)
EIP Prototype Project –
Search Project Catalogs from ArcMap
36
![Page 37: An Update from the Metadata Work Group - Energistics · 2017. 9. 27. · An Update from the Metadata Work Group May 1, 2012 PUG Conference 2012 Houston, Texas . Metadata Work Group](https://reader034.vdocument.in/reader034/viewer/2022051911/6002310a1d21c469fe4c45c2/html5/thumbnails/37.jpg)
Use ArcCatalog
to view, create,
& export EIP v1.0
metadata
37