nesdis strategic communications€¦ · step 2: select from the drop down product menu and...

17
2015 NOAA Satellite Conference, April 27 – May 1, 2015 NOAA Satellite and Information Service | National Centers for Environmental Information NOAA’s National Centers for Environmental Information CLASS Access

Upload: others

Post on 28-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

2015 NOAA Satellite Conference, April 27 – May 1, 2015 NOAA Satellite and Information Service | National Centers for Environmental Information

NOAA’s National Centers for Environmental Information

CLASS Access

Page 2: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

2 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Key Discussion Points

• CLASS’s role verses NCEI’s role • Current plans for future access • Datasets in CLASS • Access statistics and patterns • Users accessing data • Levels of data access in CLASS

Page 3: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

3 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

CLASS Role vs. NCEI Role • Comprehensive Large Array-data Stewardship System (CLASS) is

managed by the NESDIS Office of Satellite Ground Services (OSGS). CLASS’s current responsibilities include ingest, management, archival and access to its information holdings.

• NOAA’s National Centers for Environmental Information (NCEI), in

addition to providing similar services as CLASS, are responsible for data stewardship and user support of all information holdings in CLASS and in NCEI.

Page 4: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

4 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

CLASS’s Evolution to an Enterprise Archival Storage System

Preservation Planning

Administration

Ingest Access

Data Managemen

t

Archival Storage

PRODUCER

CONSUMER

requests

results

Present CLASS

Satellite

NOAA Enterprise

Archival Storage System

Inge

st

Inte

rfac

e Diss. Interface

Access Interface

Administration and Preservation

Climate. Gov Ordering Discovery

Commercial Cloud

Services

Dissemination Services

Access Services

Model

Insitu

Pre-ingest Services

Future CLASS (in red)

Data Gateway

Data Gateway

Data Gateway

Private Cloud

Services

Web Accessible

Folders

Direct Delivery

Admin. Interface

4

Page 5: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

5 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

CLASS M2M Interface

CLASS Core System

Machine-to-Machine Interface (RESTful Services)

AccessService (SOAP-based

Services)

NCEI- NC

NCEI- CO

NCEI- MD

Users

Users

Users

CLASS Backend CLASS Middleware Users

CLASS Frontend (Web)

The M2M API implements a set of RESTful web services for searching, ordering, and order status querying of CLASS’s information holdings.

Page 6: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

6 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

What Data can be Accessed? • There are 80 data families in CLASS. • Each family of data may contain many data types. • Altogether there are 300 datasets in CLASS

accessible through its web interface. • The most popular are the original radiance datasets

from GOES, POES, and S-NPP.

Page 7: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

7 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Most Popular Datasets

Satellite/instruments Period of record Volume archived

S-NPP VIIRS xDRs

2012 to current 4400 TB

GOES GVAR and pre-GVAR Imager datasets

1979 to current 335 TB

POES/MetOp AVHRR and ATOVS Level 1b datasets

1978 to current 116 TB

MetOp IASI datasets 2007 to current 109 TB

Page 8: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

8 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Most Popular Datasets by Volume* *Based on ad hoc orders from Jan 2013 to Mar 2015

VIIRS-SDRs

GOES GVAR

AVHRR

IASI L 1C

23 CLASS data families with over 2 TB delivered

Page 9: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

9 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Access Statistics by File Age Based on orders placed from Jan 2013 to Dec 2014

Page 10: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

10 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Monthly Totals (TB) Accessed

Subscriptions Ad Hoc Orders

S-NPP compression began

Page 11: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

11 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Total Archive Growth in CLASS Total archive volume in CLASS is around 11.5 PB

S-NPP Launched Oct 2011

Page 12: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

12 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Who are the users of CLASS?

Page 13: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

13 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Step 1: Register for a user id account at www.class.noaa.gov (minimal information: your name, e-mail address, a password) Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region, start/end dates and times, and data types). Step 4: Determine if you need greater access or a subscription

Note: Always provide your user ID when contacting the CLASS helpdesk

How do I access data from CLASS?

Page 14: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

14 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Levels of Access Services (1) CLASS order types: Average

completion time Average File Limit Contact the CLASS

Help Desk? Ad hoc orders (Use Search button to obtain inventory)

Usually within 12 to 24 hours

Up to 500 files No

Large orders (use Quick Search button to skip inventory )

24 to 48 hours 1000 to 3000 No

Block orders (use Quick Search button)

> 48 hours 3000 to 6000 Yes

Subscription (standing orders)

< 6-7 hours No limit Yes

Page 15: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

15 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Subscription Delivery Times

Page 16: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

16 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Levels of Access Services (2) CLASS provides daily tar files containing publicly available S-NPP products (excluding the Raw Data Records) for easy anonymous FTP download at: ftp://ftp-npp.class.ngdc.noaa.gov/ • Most recent 85 days • 76 datatypes (including Geolocation files) • Data are compressed and “tar”-ed by datatype • Sorted by date/instrument-processing

level/product • Includes manifest files (xml format) • No registration required

Page 17: NESDIS Strategic Communications€¦ · Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region,

17 NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

For technical questions regarding access in CLASS:

[email protected] [email protected]

Tutorial on using CLASS:

SNPP Access tutorial - on CLASS Home Page in the News section

Please see me for a hands on overview of CLASS website!

Assistance and Support