granules and iso metadata

1

ISO Metadata and GranulesTed Habermann, Director of Earth Science The HDF [email protected]

ISO Metadata Standards

ISO Standards come in two parts:

Concepts / Content Representations

3

The Goal

Include ISO concepts/content in [NASA] Earth Science products in a representation that is useful and consistent across products and missions.

SMAP Approach

Concepts / Content Representations

1) Identify ISO concepts important for SMAP users (ISO 19115-2).2) Represent those concepts in standard XML (ISO 19139-2).

SMAP Granules Approach (1)

ISO XML blob included as a string attribute in the Metadata group.

ISO 19139-2

SMAP Granules Approach (2)

As groups and attributes in Metadata Group.

7

Achieves the Goal?

The approach achieves the first part of the goal:

Include ISO concepts/content in NASA Earth Science products

in a representation that is useful and consistent across products and missions.

But… the representation is specific for the SMAP mission.

ISO Metadata as Information Hub

Citations are included in the ISO Metadata Standards as a way to reference resources that provide details that are not included directly in the metadata.

Metadata

XML

dataset /resource

source

keywordthesaurus

& ontologyevaluationprocedure

standardspecification

algorithm associatedresource

applicationschema

alternatemetadata

metadata& servicestandard

associatedresource

name/metadata

additionaldocumentation

constraintsreference

sourcemetadata

processreference &

documentation

softwarereference

featurecatalog

formatspecification

ISO Dataset Titles

All ISO Citations include the concept of ”Title" which can be represented as a CharacterString or a FileName. The ISO xPath to the dataset title is special.

/gmi:MI_Metadata/gmd:identificationInfo/gmd:MD_DataIdentification/gmd:citation/gmd:CI_Citation/gmd:title/gco:CharacterString | gmx:FileName

ISO

10

SMAP Dataset Titles (1)

11

SMAP Dataset Titles (2)

Accessing Dataset Titles

We have the dataset titles in two locations: ISO and SMAP (HDF)


/Metadata/DatasetIdentification/fileName

This mapping is unique to SMAP.


/Metadata/DatasetIdentification/fileName=/

ISO

SMAP

Can HDF Paths = ISO Paths?

=?ISO

HDF

ISO: Roles and Types

Roles = lowerCamelCase / Types = AA_UpperCamelCase

ISO XML always alternates between roles and types.Each hierarchy level is either a role level or a type level.


HDF: Groups and Attributes

HDF: Groups and Attributes

NcML: Groups and Attributes with XML attributes

The Goal

ISO Roles and Types

NcML Groups and Attributes and XML Attributes

Rules

17

The Workflow

SMAP19115-2

(19139-2)

SMAP19115-1

(19115-3)

SMAPNcML

SMAP19115-1

(19115-3)

Translation Proofing File Differencing

SMAPHDF

Product DesignerThe method we use to develop and test this

approach involves several (standard) XSLT transforms (solid arrows) and comparisons between input metadata and metadata transformed to NcML and back to ISO (grey arrows). All of these transforms are lossless.

18

The Workflow

SMAP19115-2

(19139-2)

SMAPNcML

SMAP19115-2

(19139-2)

File Differencing

The same transforms can be used to go directly from ISO 19139-2 (the ISO version currently used by NASA and NOAA) to NcML and back. SMAP

HDF

Product Designer

19

ISO 19139-2 > NcML > HDF


/nc:netcdf/nc:group[@name=“gmi:MI_Metadata]/nc:group[@name=“gmd:identificationInfo]/nc:group[@name=“gmd:citation]/nc:group[@name=“gmd:title]/nc:attribute[@name=“value”]/@value

ISO

NCML

/gmi:MI_Metadata/gmd:identificationInfo/gmd:citation/gmd:title/valueSMAP

20

ISO 19115-3 > NcML > HDF

/nc:netcdf/nc:group[@name=“mdb:MD_Metadata]/nc:group[@name=“mdb:identificationInfo]/nc:group[@name=“mri:citation]/nc:group[@name=“mri:title]/nc:attribute[@name=“value”]/@value

/mdb:MD_Metadata/mdb:identificationInfo/mri:MD_DataIdentification/mri:citation/cit:CI_Citation/cit:title/gco:CharacterString | gcx:FileName

ISO

NCML

SMAP

/mdb:MD_Metadata/mdb:identificationInfo/mri:citation/mri:title/value

21

ISO 19139-2 and 19115-3 = HDF


/gmi:MI_Metadata/gmd:identificationInfo/gmd:citation/gmd:title/value

/mdb:MD_Metadata/mdb:identificationInfo/mri:MD_DataIdentification/mri:citation/cit:CI_Citation/cit:title/gco:CharacterString | gcx:FileName

/mdb:MD_Metadata/mdb:identificationInfo/mri:citation/mri:title/value

~

~

ISO 19115-2 HDF

ISO 19115-1 HDF

At least the transforms are consistent and the same!

22

What Does This Mean?

Any ISO conceptual model can be transformed into HDF and extracted using standard transforms.

What Does This Mean?

1) We can write standard interoperable ISO metadata into SWOT, NISAR, and PDS granules

2) They are all accessible with standard xPaths.3) We can add standard ISO 19115 and 19115-1 groups to SMAP

without any impact on current metadata access.

24

The Goal

Include ISO concepts/content in NASA Earth Science products in a representation that is useful and consistent across products and missions.

25

Acknowledgements

This work was partially supported by contract number NNG10HP02C from NASA.

Any opinions, findings, conclusions, or recommendations expressed in this material are those of the author and do not necessarily reflect the views of NASA or The HDF Group.