Download - Common Metadata Repository (CMR)
![Page 1: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/1.jpg)
1
COMMON METADATA REPOSITORY (CMR)Update and Near Term Plans – ESIP Winter 2014
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014
Dan Pilone ([email protected])
![Page 2: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/2.jpg)
2
In a world where metadata matters…
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 3: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/3.jpg)
3
URSGIBSEMSEOSDIS
Discovery Tools
DAACsNear Real
Time (LANCE)
???CMR
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 4: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/4.jpg)
4
Seriously? Another catalog?
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 5: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/5.jpg)
5
No.
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 6: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/6.jpg)
62014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 7: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/7.jpg)
7
So why are we doing this?
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 8: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/8.jpg)
2014 ESIP Winter Meeting | Washington DC 8
Emphasis on Metadata Quality
January 10 2014
![Page 9: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/9.jpg)
92014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 10: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/10.jpg)
10
Reconciliation Progress and Plans
Science Coordinators will assess differences between associated records and work from easiest to hardest with providers
Initial pass will associate ECHO 10 Collections with GCMD DIFs
Assessment and correlation between ECHO and GCMD holdings has started
GCMD is programmatically monitoring ECHO for new Collections and Updates
DIF support added to ECHO
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 11: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/11.jpg)
11
Handling Metadata Changes• Science Coordinator will work with Data Providers to
make changes at Metadata source• CMR will support pluggable Ingest Adapters to allow in-
line updates to ingested metadata if needed• Science Coordinator can make updates to metadata on
behalf of providers when approved by owner
January 10 2014 2014 ESIP Winter Meeting | Washington DC
![Page 12: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/12.jpg)
12
Initial Metadata Targets
LANCE (NRT)
MEaSUREs MODAPS
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 13: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/13.jpg)
13
Emphasis on Performance
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 14: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/14.jpg)
Current Holdings• Collections: ~4k + ~24k• Granules: ~140M• Growth:
• Current• 500k+ granules/week
• Future• ~1 million granules/day during
MODIS Collection 6 Reprocessing
As of 12/18/2013
2014 ESIP Winter Meeting | Washington DC 14January 10 2014
![Page 15: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/15.jpg)
Client breakdown for a week in Oct 2013
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014 15
Reverb Ops18%
GMU0%
GMUCWICWrapper39%
SSW1%GESDISC
0%
AVAPC7%
MODAPS0%
GHRC/UAH32%
Other2%
![Page 16: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/16.jpg)
16January 10 2014 2014 ESIP Winter Meeting | Washington DC
![Page 17: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/17.jpg)
2014 ESIP Winter Meeting | Washington DC 17
CMR Transition
ECHO components progressively replaced with CMR components
Early work to focus on search performance
Updated requirements effort starting soon
Initial requirements based on MASI and MASII studies
CMR will build on ECHO and GCMD capabilities
January 10 2014
![Page 18: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/18.jpg)
18
Metadata Concept Support
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 19: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/19.jpg)
19
Extensibility
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 20: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/20.jpg)
20
ECHO 10GCMD DIF
EMS
ISO19115UMM
Ingest Adapter
VisualizationDocumentation
ServicesParameters
1 2
3
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 21: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/21.jpg)
21
How Will This Affect Me?
http
://st
ore.
met
mus
eum
.org
/con
tent
/ebi
z/th
emet
stor
e/in
vt/8
0010
981/
8001
0981
_01_
l.jpg
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 22: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/22.jpg)
22
Metadata Providers
• You won’t have to reconcile multiple systems• Most systems will continue to work
• ECHO FTP ingest going away• Current formats will continue to function• You will need to be engaged in the adaptation process• You will need to support controlled vocabularies• You will have a voice through the Technical Committee
Streamlined Processes, More Engagement
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 23: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/23.jpg)
23
Client Developers
More Metadata, Better Quality
• Richer, higher quality metadata will be available• Existing APIs will be supported• Standards-compliant APIs will be available• Metadata will be available in an ISO19115 compliant format
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 24: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/24.jpg)
24
End Users
More Metadata, Better Quality
• Richer, higher quality metadata will be available• Unified view of EOSDIS holdings • Easier access through a variety of clients, data casting, etc• Metadata will be available in an ISO19115 compliant format
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014
![Page 25: Common Metadata Repository (CMR)](https://reader033.vdocument.in/reader033/viewer/2022061610/56816739550346895ddbebbb/html5/thumbnails/25.jpg)
25
Questions?
2014 ESIP Winter Meeting | Washington DCJanuary 10 2014