us ioos regional data managementstaff.washington.edu/emiliom/out/mayorga2015... · 1 us ioos...
TRANSCRIPT
![Page 1: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/1.jpg)
1
US IOOS Regional Data Management:
The NANOOS NW Perspective
Emilio Mayorga, Ph.D.NANOOS Data ManagerApplied Physics LaboratoryUniversity of Washington
Seattle, WA
MEOPAR Ocean Data Management Expert Forum. Montreal, 2015 Nov 18-19
http://www.nanoos.org
![Page 2: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/2.jpg)
2
US IOOS Regional Data Management:
The NANOOS NW Perspective
Emilio Mayorga, Ph.D.NANOOS Data ManagerApplied Physics LaboratoryUniversity of Washington
Seattle, WA
MEOPAR Ocean Data Management Expert Forum. Montreal, 2015 Nov 18-19
http://www.nanoos.org
Putting data to use for local to (bi)national needs:Data partnerships, support, enablement, dissemination
![Page 3: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/3.jpg)
3
NANOOS: NW Association of Networked Ocean Observing Systems
Supported observing assets (~ 2013)
Matching Regional Priorities to Regional
Observing Capability & Strategy
![Page 4: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/4.jpg)
4
Reg. Associations
Engage, Disseminate
DIVERSE LOCAL STAKEHOLDERS
Assure, Expose
CONSISTENT NATIONAL CAPABILITY
Leverage and Link
![Page 5: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/5.jpg)
5
NANOOS Governing Council Members to date… (Mar. 2010)
http://www.nanoos.org/about_nanoos/members.php
![Page 6: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/6.jpg)
6
IOOS vs. Regions ?
• IOOS (National)– Standards-based data servicesStandards-based data services– Enable seamless data integration at national scaleEnable seamless data integration at national scale– Assess and ensure system maturity, robustnessAssess and ensure system maturity, robustness
• NANOOS (Regional Associations)– Serve regional usersServe regional users– Consume federal (national) dataConsume federal (national) data– Facilitate integration of local data sets, data streamsFacilitate integration of local data sets, data streams– Expose and distribute local data nationally, interoperablyExpose and distribute local data nationally, interoperably– Redistribute data regionally, easy accessRedistribute data regionally, easy access– Support community of users and providersSupport community of users and providers
• Ongoing engagement– Reconciling national and regional views, prioritiesReconciling national and regional views, priorities
![Page 7: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/7.jpg)
7
NANOOS Visualization System (NVS):Data Integration with Customized Views
http://nvs.nanoos.org
![Page 8: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/8.jpg)
8
NVS Data Explorer
http://nvs.nanoos.org
![Page 9: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/9.jpg)
9
NVS Data Explorer
http://nvs.nanoos.org
A key objective for NANOOS is to provide data and user-defined products to a diverse group of stakeholders in a timely fashion, and at spatial and temporal scales appropriate for their needs. To this end, NANOOS developed the NVS, which aggregates, displays and serves meteorological and oceanographic data, derived from buoys, gliders, tide gauges, HF Radar, meteorological stations and satellites, as well as model forecast information in such a way that it presents end users with a rich, informative and user friendly experience.
Strong focuson usability,user experience
![Page 10: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/10.jpg)
10
Other NVS Apps
![Page 11: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/11.jpg)
11
Other NVS Apps
![Page 12: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/12.jpg)
12
NVS Information System
DS: Data SourceDAC: Data Assembly CenterNH: NVS data HarvesterMD: MetadataUI: User Interface (web)
(note: diagram from 2010)
![Page 13: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/13.jpg)
13
NVS Data Harvesting: Ingesting data from providers
DS: Data SourceDAC: Data Assembly CenterNH: NVS data HarvesterMD: MetadataUI: User Interface (web)
• Accommodate local providers’ constraints
• Harvesting frequency: 5 min - 3 days
• Ingest widely diverse set of data sources
• Extensive use of metadata from NVS DB
(note: diagram from 2010)
![Page 14: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/14.jpg)
14
NVS Data Harvesting: Ingesting data from providers
DS: Data SourceDAC: Data Assembly CenterNH: NVS data HarvesterMD: MetadataUI: User Interface (web)
• Accommodate local providers’ constraints
• Harvesting frequency: 5 min - 3 days
• Ingest widely diverse set of data sources
• Extensive use of metadata from NVS DB
Data Services
(note: diagram from 2010)
![Page 15: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/15.jpg)
15
NVS Metadata: Enabling consistency across all providers
• Vocabulary translation between diverse data sources & NVS unified information
– Date-time encoding & timezone, location, asset identifier and name, platform type, observation depth representation, measurement names, units, etc
• Widely used across all of NVS.
• Reusable.
(note: from 2010)
![Page 16: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/16.jpg)
16
NVS Metadata: Enabling consistency across all providers
• Vocabulary translation between diverse data sources & NVS unified information
– Date-time encoding & timezone, location, asset identifier and name, platform type, observation depth representation, measurement names, units, etc
• Widely used across all of NVS.
• Reusable.
(note: from 2010)
From Canada: Environment Canada VENUS Vancouver Island University
![Page 17: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/17.jpg)
17
Data Provider Partnerships: PNW Shellfish aquaculture community
•PCSGA•Pacific Shellfish Institute•Taylor Shellfish•Whiskey Creek Hatchery•Penn Cove Shellfish•Stillaguamish Tribe•Vancouver Island University•(WA Dept. of Health)
![Page 18: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/18.jpg)
18
Data Provider Partnerships: PNW Shellfish aquaculture community
•PCSGA•Pacific Shellfish Institute•Taylor Shellfish•Whiskey Creek Hatchery•Penn Cove Shellfish•Stillaguamish Tribe•Vancouver Island University•(WA Dept. of Health)
![Page 19: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/19.jpg)
19
Data Provider Partnerships: PNW Shellfish aquaculture community
•PCSGA•Pacific Shellfish Institute•Taylor Shellfish•Whiskey Creek Hatchery•Penn Cove Shellfish•Stillaguamish Tribe•Vancouver Island University•(WA Dept. of Health)
![Page 20: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/20.jpg)
20
Data Provider Partnerships: PNW Shellfish aquaculture community
•PCSGA•Pacific Shellfish Institute•Taylor Shellfish•Whiskey Creek Hatchery•Penn Cove Shellfish•Stillaguamish Tribe•Vancouver Island University•(WA Dept. of Health)
![Page 21: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/21.jpg)
21
NVS Shellfish Growers Web App
![Page 22: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/22.jpg)
22
NVS Shellfish Growers Web App
![Page 23: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/23.jpg)
23
2015 Partnership with Washington Department of Health
![Page 24: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/24.jpg)
24
Local observation providers:Relationship, Benefits
• Incentives, motivations (esp. when no funding is involved)– Online access to their data (RA tools as Online access to their data (RA tools as
supplemental or main data access)supplemental or main data access)– Wider data dissemination and recognitionWider data dissemination and recognition– Provider data available in broader context, with Provider data available in broader context, with
similar data from other providerssimilar data from other providers– Regional mechanism for platform status-update Regional mechanism for platform status-update
broadcastingbroadcasting– Support for national networks with minimal Support for national networks with minimal
overheadoverhead• Challenges
– Everyone is stretched thinEveryone is stretched thin– Building closer ties, support, feedbackBuilding closer ties, support, feedback
![Page 25: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/25.jpg)
25
• Minimal requirements for participation– Make data files or services available to NANOOS, in Make data files or services available to NANOOS, in any any
accessible format (even emailed zipped MS Access files!)accessible format (even emailed zipped MS Access files!)
– NANOOS handles standardization / match-upsNANOOS handles standardization / match-ups
– Respond to queries about status, updates, etcRespond to queries about status, updates, etc
• Distributed team, closer to range of users– Leverage distributed expertiseLeverage distributed expertise
– Bridges to NVS from local providers or specialized data Bridges to NVS from local providers or specialized data (forecast models, remote sensing, climatologies)(forecast models, remote sensing, climatologies)
– Enable greater productivity for group as a whole, Enable greater productivity for group as a whole, diversity of feedback and perspectivesdiversity of feedback and perspectives
Approach also applied to models
Local observation providers:Making it work
![Page 26: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/26.jpg)
26
Web Services Ecosystem
• From NVS MySQL Database (mainly near-real-time) to:
– Light-weight JSON services > [NVS Web Apps], [Mobile Apps (data, Light-weight JSON services > [NVS Web Apps], [Mobile Apps (data, plots, UI elements)]plots, UI elements)]
– PostgreSQL > IOOS 52North SOSPostgreSQL > IOOS 52North SOS
– PostgreSQL > “Situational Awareness” (GeoServer OGC WMS, WFS)PostgreSQL > “Situational Awareness” (GeoServer OGC WMS, WFS)
– NDBC data pushNDBC data push
Models, remote sensing, temporal map data products
– Overlay map tile serviceOverlay map tile service
– THREDDS / OPeNDAP / WMSTHREDDS / OPeNDAP / WMS
Long time series and NCEI archiving (under construction)
– NetCDF > [THREDDS (> ERDDAP?) > NVS, users], [NCEI archives]NetCDF > [THREDDS (> ERDDAP?) > NVS, users], [NCEI archives]
Map layers
– GeoServer (OGC WMS, WFS, KML, etc)GeoServer (OGC WMS, WFS, KML, etc)
● HF Radar Network
● Glider data (NetCDF)
– IOOS Glider DACIOOS Glider DAC
– NDBCNDBC
– THREDDS THREDDS (under construction)(under construction)
![Page 27: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/27.jpg)
27
Benefits: Leverage NANOOS Data and Analysis Tools
VIU added Nov 14
![Page 28: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/28.jpg)
28
Benefits: Leverage NANOOS Data and Analysis Tools
VIU added Nov 14
![Page 29: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/29.jpg)
29
Benefits: Integration into other Regional efforts: ERMA PNW / Encyclopedia of Puget Sound
![Page 30: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/30.jpg)
30
Benefits: West Coast Ocean AcidificationMonitoring, with WCGA, C-CAN, IOOS, RA's
![Page 31: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/31.jpg)
31
Benefits: West Coast Ocean AcidificationMonitoring, with WCGA, C-CAN, IOOS, RA's
![Page 32: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/32.jpg)
32
Benefits: National Data Services and Integration:Vancouver Island University Deep Bay in US IOOS Catalog (currently offline)
![Page 33: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/33.jpg)
33
Data Management And Communication: Regional Components of a National Network
• Local/regional presence in close interactions with local stakeholders and potential data providers
• Strongly complementary partnership• Formal, close linkages to national coordinating network (IOOS)• Nimble: Reacting to changing needs, emerging opportunities,
informal partnerships• Neutral party• Pooled diverse, technical expertise, with ready access to
national Regional Association peers for technical consultation, best practices
• Interoperable, open data and web service standards, coupled with exposure of data to wide community of users through user-friendly applications
• Value of incremental but steady progress
![Page 34: US IOOS Regional Data Managementstaff.washington.edu/emiliom/out/Mayorga2015... · 1 US IOOS Regional Data Management: The NANOOS NW Perspective Emilio Mayorga, Ph.D. NANOOS Data](https://reader034.vdocument.in/reader034/viewer/2022042219/5ec4e1fa3866dc54184805a2/html5/thumbnails/34.jpg)
34
Thank You