profile of npoess hdf5 files
DESCRIPTION
The NPOESS program uses Unified Modeling Language (UML) to describe the format of the HDF5 files produced. For each unique type of data product, the HDF5 storage organization and the means to retrieve the data is the same. This provides a consistent data retrieval interface for manual and automated users of the data, without which would require custom development and cumbersome maintenance. The data formats are described using UML to provide a profile of HDF5 files. This poster will show each unique data type so far produced by NPOESS, and the contents of the files. We will also have overhead snapshots of the data contents.TRANSCRIPT
HDF5 Workshop VII, 26 - 28 Oct 2004
Profile of NPOESS HDF5 Files
William Johnsen, Ph.D., Chad Johnson
NPOESS Program
Raytheon Company
Aurora, Colorado
HDF5 Workshop VII, 26 - 28 Oct 2004 22
General HDF5 File Structure for NPP Data Products
Root Group Attributes are here.
1...*
1
AggregateDatasetArray(from HDF_xxx_Product_Aggregation)... )
<<H_RO Array>>
HDF_xxx_Product_Aggregation
AggregateDataset : H_RO
(from HDF_xxx_Product)
<<H_DS>>
HDF_xxx_Product(from NPOESS General HDF_File_Root)... )
<<H_G>>
DatasetArray(from HDF_xxx_Product_Granule_#)... )
<<H_RR Array>>
HDF_xxx_Product_Granule_#
Dataset : H_RR
(from HDF_xxx_Product)
<<H_DS>>
A root group may have one or more product groups.
Product groups contain datasets for aggregations and individual granules.
The Product Aggregation contains a regional object (H_RO) to the data.xxx is the product type, for example RDR, SDR, EDR, etc.# is a number corresponding to the granule number within the aggregated dataset.
The Product Granule contains a regional reference (H_RR) to the data.xxx is the product type, for example RDR, SDR, EDR, etc.# is a number corresponding to the granule number within the aggregated dataset.
The dataset is a regional reference (H_RR) to the data.
NPOESS General HDF_File_Root<<Root>>
HDF_All_Data<<H_G>>
The dataset is a regional reference (H_RO) to the data.
HDF_xxx_Product_Data<<H_G>>
xxx_Data<<H_DS>>
The All_Data group is populated with nested xxx_Product_Data groups.
The xxx_Product_Data contains a collection of product datasets
xxx_Data contains the sensor data for a given NPOESS data product
HDF5 Workshop VII, 26 - 28 Oct 2004 33
General EDR File Structure relationships
Note: All NPP EDR HDF5 files contain the HDF_All_Data Group thus will not be depicted in the following diagrams.
HDF_EDR_Product_Granule_n Dataset(from HDF_EDR_Product Group)
<<H_DS>>HDF_EDR_Product_Aggregation Dataset
(from HDF_EDR_Product Group)
<<H_DS>>
HDF_EDR_Product Group(from HDF_File_Root)
<<H_G>>
1..n1..n
11
A H_DC is attached to each H_DS item. See specific EDR diagrams for details.
xxx_Data<<H_DS>>
HDF_xxx_Product_Data<<H_G>>
1..*
11
1..*
HDF_File_Root<<Root>>
11HDF_All_Data
<<H_G>>
1
1..*
1
1..*
1
11
1
HDF5 Workshop VII, 26 - 28 Oct 2004 44
VIIRS Aerosol Optical Thickness
(EDR VIIRS Aerosol Optical Thickness)
AOT_Land Ref : H_RRAOT_Water Ref : H_RRQuality Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
HDF_EDR_Product_Granule_n Dataset
Ascending/Decending_Indicator : H_STRBeginning_Date : H_CUBeginning_Time : H_CUCloud_Cover : H_I
East_Bounding_Coordinate : H_FEnding_Date : H_CUEnding_Time : H_CUG_Ring_Latitude : H_F ArrayG-Ring_Longitude : H_F Array
Input_Dataset_Identifier.Dataset_Identifier : H_STRN_Algorithm_Version : H_STRN_Anc_Type_Used : N_STR
N_Automatic_Quality_Parameter_Value : H_FN_Automatic_Quality_Test_Explanation : H_STRN_Beginning_Orbit_Number : H_UIN_Beginning_Time_IET : H_LLN_Creation_Date : H_STRN_Creation_Time : H_STRN_Day_Night_Flag : H_FN_Degraded_Mode : H_STRN_EDR_Field : H_F
N_EDR_Scale_Factor : H_FN_Ending_Time_IET : H_LL
N_Graceful_Degradation : H_STRN_Granule_ID : H_IN_Granule_Version : H_STRN_LEO_Flag : H_STRN_Nadir_Latitude_Max : H_FN_Nadir_Latitude_Min : H_FN_Nadir_Longitude_Max : H_FN_Nadir_Longitude_Min : H_FN_Percent_Missing_Data : H_FN_Solar_Zenith_Angle_Max : H_FN_Solar_Zenith_Angle_Min : H_FN_Update_Date : H_STRN_Update_Time : H_STRNorth_Bounding_Coordinate : H_FOperational_Mode : H_STRSouth_Bounding_Cooridinate : H_FWest_Bounding_Coordinate : H_F
(from HDF_EDR_Product Group)
<<H_DS>>
11
(EDR VIIRS Aerosol Optical Thickness Aggregation)
AOT_Land Ref : H_ROAOT_Water Ref : H_ROQuality Flags Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
HDF_EDR_Product_Aggregation Dataset
<<NPOESS>> AggregateBeginningDate : H_CU<<NPOESS>> AggregateBeginningGranuleID : H_IL<<NPOESS>> AggregateBeginningOrbitNumber : H_IL<<NPOESS>> AggregateBeginningTime : H_CU<<NPOESS>> AggregateCreationDate : H_STR<<NPOESS>> AggregateCreationTime : H_STR<<NPOESS>> AggregateEndingDate : H_CU<<NPOESS>> AggregateEndingGranuleID : H_IL<<NPOESS>> AggregateEndingOrbitNumber : H_IL<<NPOESS>> AggregateEndingTime : H_CU<<NPOESS>> AggregateG-RingLatitude : H_F Array<<NPOESS>> AggregateG-RingLongitude : H_F Array<<NPOESS>> AggregatePercentMissingDataAve : H_F
(from HDF_EDR_Product Group)
<<H_DS>>
11
HDF_File_Root
Mission_Name : H_STRN_Quasi-Static_Metadata_Reference
Identifier_Information.Dataset_Indentifier : H_STR
<<Root>>
HDF_EDR_Product Group
Band_Measurement_Mode_ID : H_STRInstrument_Short_Name : H_STRN_Dataset_Type_Tag : H_STR
N_Instrument_Flight_SW_Version : H_STRN_Spacecraft_SW_Version : H_STRN_Subsystem_SW_Version : H_STR
Platform_Short_Name : H_STRProcessing_Level_Identifier : H_STR
(from HDF_File_Root)
<<H_G>>
1..n1..n
11
1
11
1
These Arrays are different for each product. Subsequent slides show only these Arrays for each data product.
HDF5 Workshop VII, 26 - 28 Oct 2004 55
HDFView Snapshot
HDF5 Workshop VII, 26 - 28 Oct 2004 66
xDR Example Data - HDFViewxDR: VIIRS SST Num Granules: 50Rows: 128,000Columns: 3,200Dimensions: 100 x 1000 km2Data Source: Simulated Propagating Sine Wave, 4 phase, 1.5:1 phase shift
xDR: VIIRS Cloud Mask Scan All OceanNum Granules: 12
Rows: 3,072Columns: 3,200
Dimensions: 100 x 1000 km2Data Source: Simulated Propagating
Sine Wave, 4 phase, 1.5:1 phase shift
xDR: VIIRS NCC Imagery DNBNum Granules: 1Rows: 256Columns: 4,064Dimensions: 100 x 1000 km2Data Source: MODIS plus granule edge fill data
HDF5 Workshop VII, 26 - 28 Oct 2004 77
VIIRS Aerosol Particle Size Parameter
(EDR VIIRS Areosol Particle Size Parameter Aggregation)
Angstrom_Exponent_Water Ref : H_ROEffective_Radius Ref : H_ROQuality Flags Ref : H_ROAngstrom_Exponent_Land Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS Aerosol Particle Size Parameter)
Angstrom_Exponent_Land Ref : H_RRAngstrom_Exponent_Water Ref : H_RREffective_Radius Ref : H_RRQuality Flags Ref
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
VIIRS Cloud Cover/Layer(EDR VIIRS Cloud Cover/Layers Aggregation)
Layer Cloud Cover Ref : H_ROTotal Cloud Cover Ref : H_ROCloud Type Ref : H_ROQuality Flags Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS Cloud Cover/Layers)
Layer Cloud Cover Ref : H_RRTotal Cloud Cover Ref : H_RRQuality Flags Ref : H_RRCloud Type Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
VIIRS Cloud Effective
Particle Size(EDR VIIRS Cloud Effective Particle Size Aggregration)
Layer Effective Particle Size Ref : H_ROTotal Effective Particle Size Ref : H_ROQuality Flags Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS Cloud Effective Particle Size)
Layer Cloud Effective Particle Size Ref : H_RRTotal Cloud Effective Particle Size Ref : H_RRQuality Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
VIIRS Cloud Height
(EDR VIIRS Cloud Base Height Aggregation)
Layer Cloud Base Height Ref : H_ROTotal Cloud Base Height Ref : H_ROQuality Flags Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS Cloud Base Height)
Layer Cloud Base Height Ref : H_RRTotal Cloud Base Height Ref : H_RRQuality Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
HDF5 Workshop VII, 26 - 28 Oct 2004 88
VIIRS Cloud Optical Thickness
(EDR VIIRS Cloud Optical Thickness Aggregation)
Layer Cloud Optical Thickness Ref : H_ROTotal Cloud Optical Thickness Ref : H_ROQuality Flags Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS Cloud Optical Thickness)
Layer Cloud Optical Thickness Ref : H_RRTotal Cloud Optical Thickness Ref : H_RRQuality Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
VIIRS Cloud Top Height(EDR VIIRS Cloud Top Height Aggregation)
Layer Cloud Top Height Ref : H_ROTotal Cloud Top Height Ref : H_ROQuality Flags Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS Cloud Top Height)
Layer Cloud Top Height Ref : H_RRTotal Cloud Top Height Ref : H_RRQuality Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
VIIRS Cloud Top Pressure
(EDR VIIRS Cloud Top Pressure Aggrgation)
Layer Cloud Top Pressure Ref : H_ROTotal Cloud Top Pressure Ref : H_ROQuality Flags Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS Cloud Top Pressure)
Layer Cloud Top Pressure Ref : H_RRTotal Cloud Top Pressure Ref : H_RRQuality Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
VIIRS Cloud Top Temperature
(EDR VIIRS Cloud Top Temperature Aggregation)
Layer Cloud Top Temperature Ref : H_ROTotal Cloud Top Temperature Ref : H_ROQuality Flags Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS Cloud Top Temperature)
Layer Cloud Top Temperature Ref : H_RRTotal Cloud Top Temperature Ref : H_RRQuality Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
HDF5 Workshop VII, 26 - 28 Oct 2004 99
VIIRS Cloud Mask IP(EDR VIIRS CM Aggregation)
Cloud_Mask Ref : H_ROScan_All_Ocean Ref : H_ROScan_No_Ocean Ref : H_RO
(from HDF_EDR_Product_Aggregation Datas...
<<H_RO Array>>
(EDR VIIRS CM)
Cloud_Mask Ref : H_RRScan_All_Ocean Ref : H_RRScan_No_Ocean Ref : H_RRQuality_Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Datas...
<<H_RR Array>>
VIIRS I1-Channel Imagery
(EDR VIIRS I1-Channel Imagery Aggregation)
Radiance_I1_!mg Ref : H_ROReflectance_I1_Img Ref : H_ROBand Quality Flags I1 Img Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS I1-Channel Imagery)
Radiance_I1_Img Ref : H_RRReflectance_I1_Img Ref : H_RRBand Quality I1 Img Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
VIIRS Ice Surface Temperature
(EDR VIIRS Ice Surface Tempurature Aggregation)
Ice Surface Tempurature Ref : H_ROQuality Flags Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS Ice Surface Temperature)
Ice Surface Temperature Ref : H_RRQuality Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
VIIRS Imagery NCC
(EDR VIIRS NCC)
NCC_Imagery_DNB Ref : H_RRNCC_Imagery_Quality_DNB Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
(EDR VIIRS NCC Aggregation)
NCC_Imagery_DNB Ref : H_RONCC_Imagery_Quality_DNB Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
HDF5 Workshop VII, 26 - 28 Oct 2004 1010
VIIRS Land Surface Temperature(EDR VIIRS Land Surface Tempurature Aggregation)
Land Surface Tempurature Ref : H_ROQuality Flags Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS Land Surface Temperature)
Land Surface Temperature Ref : H_RRQuality Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
VIIRS Net Heat Flux(EDR VIIRS Net Heat Flux Aggregation)
Net Heat Flux Ref : H_ROQuality Flags Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS Net Heat Flux)
Net Heat Flux Ref : H_RRQuality Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
VIIRS Ocean Color/Chlorophyll
(EDR VIIRS OC Aggregation)
Chorophyll_a Ref : H_ROIOP_a Ref : H_ROIOP_s Ref : H_ROWater_Leaving Ref : H_ROQuality_Flags Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS OC)
Chlorophyll_a Ref : H_RRIOP_a Ref : H_RRIOP_s Ref : H_RRWater_Leaving Ref : H_RRQuality_Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
VIIRS Sea Ice Characterization
(EDR VIIRS Sea Ice Characterization Aggregation)
Ice Age Ref : H_ROIce Age Weight Ref : H_ROQuality Flags Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS Sea Ice Characteriization)
Ice Age Ref : H_RRIce Age Weight Ref : H_RRQuality Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
HDF5 Workshop VII, 26 - 28 Oct 2004 1111
VIIRS Sea Surface Temperature
(EDR VIIRS SST Aggregation)
Skin_Sea_Surface_Tempurature Ref : H_ROQuality_Flags Ref : H_RO
Bulk_Sea_Surface_Tempurature Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS SST)
Skin_Sea_Surface_Tempurature Ref : H_RRBulk_Sea_Surface_Tempurature Ref : H_RRQuality_Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
VIIRS Snow Cover/Depth(EDR VIIRS SST Aggregation)
Skin_Sea_Surface_Tempurature Ref : H_ROQuality_Flags Ref : H_RO
Bulk_Sea_Surface_Tempurature Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS SST)
Skin_Sea_Surface_Tempurature Ref : H_RRBulk_Sea_Surface_Tempurature Ref : H_RRQuality_Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
VIIRS Soil Moisture(EDR VIIRS Soil Moisture Aggregation)
Quality Flag Ref : H_ROSoil Moisture Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS Soil Moisture)
Soil Moisture Ref : H_RRQuality Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
VIIRS Surface Albedo(EDR VIIRS Surface Albedo Aggregation)
Quality Flag Ref : H_ROSurface Albedo (bright pixel algo.) Ref : H_ROSurface Albedo (dark pixel algo.) Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS Surface Albedo)
Surface Albedo (dark pixel algo.) Ref : H_RRSurface Albedo (bright pixel algo.) Ref : H_RRQuality Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
HDF5 Workshop VII, 26 - 28 Oct 2004 1212
VIIRS Surface Type(EDR VIIRS Surface Type Aggregation)
Surface Type Flags Ref : H_ROQuality_Flags Ref : H_ROVegetation Fraction Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS Surface Type)
Surface Type Flags Ref : H_RRVegetation Fraction Ref : H_RRQuality Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
VIIRS Suspended Matter(EDR VIIRS Suspended Matter Aggregation)
Suspended Matter Type Ref : H_ROQuality Flags Ref : H_ROSmoke Concentration Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
(EDR VIIRS Suspended Matter)
Suspended Matter Type Ref : H_RRSmoke Concentration Ref : H_RRQuality Flags Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
VIIRS Vegetation Index
(EDR VIIRS VI)
Top_of_Canopy_EVI Ref : H_RRTop_of_Atmosphere_NDVI Ref : H_RR
(from HDF_EDR_Product_Granule_n Dataset)
<<H_RR Array>>
(EDR VIIRS VI Aggregation)
Top_of_Canopy_EVI Ref : H_ROTop_of_Atmosphere_NDVI Ref : H_RO
(from HDF_EDR_Product_Aggregation Dataset)
<<H_RO Array>>
HDF5 Workshop VII, 26 - 28 Oct 2004 1313
General RDR File Structure relationships
HDF_All_Data<<H_G>>
RDR_Product_Aggregation<<H_DS>>RDR_Product_Granule_#
<<H_DS>>
HDF_RDR_SpacecraftDiary_Aggregation<<H_DS>>
HDF_RDR_SpacecraftDiary_Dataset_#<<H_DS>>
HDF_AUX_SensorCalibrationCoefficient_Aggregation<<H_DS>>
HDF_AUX_SensorCalibrationCoefficient_Dataset_#<<H_DS>>
HDF_RDR_Product<<H_G>>
HDF_RDR_SpacecraftDiary<<H_G>>
11
HDF_AUX_SensorCalibrationCoefficient<<H_G>>
xxx_Data<<H_DS>>
HDF_xxx_Product_Data<<H_G>>
1..*
11
1..*
HDF_File_Root<<Root>>
11
1111
1
1..*
1
1..*
Note: All NPP RDR HDF5 files contain the HDF_All_Data Group thus will not be depicted in the following diagrams.
HDF5 Workshop VII, 26 - 28 Oct 2004 1414
HDF_AUX_SensorCalibrationCoefficient_Dataset_#
Ancillary_Dataset_Identifier.Dataset_Identifier : H_STRCalendar_Date
Input_Dataset_Identifier.Dataset_Identifier : H_STRN_Beginning_Time_IET : H_LLN_Creation_Date : H_STRN_Creation_Time : H_STRN_Ending_Time_IET : H_LLN_LEO_Flag : H_STRN_Update_Date : H_STRN_Update_Time : H_STRPlatform_Short_Name : H_STRTime_of_Day : H_STR<<HDF>> Dataset : H_RR
(from HDF_AUX_SensorCalibrationCoefficient)
<<H_DS>>
RDR_Product_Aggregation
<<NPOESS>> AggregateBeginningDate : H_CU<<NPOESS>> AggregateBeginningOrbitNumber : H_ILLU<<NPOESS>> AggregateBeginningTime : H_CU<<NPOESS>> AggregateBeginningGranuleID : H_I<<NPOESS>> AggregateCreationDate : H_STR<<NPOESS>> AggregateCreationTime : H_STR<<NPOESS>> AggregateEndingGranuleID : H_I<<NPOESS>> AggregateEndingDate : H_CU<<NPOESS>> AggregateEndingOrbitNumber : H_ILLU<<NPOESS>> AggregateEndingTime : H_CU
<<NPOESS>> AggregatePercentMissingDataAve : H_F<<HDF>> AggregateDataset : H_RO
(from HDF_RDR_Product)
<<H_DS>>
RDR_Product_Granule_#
Beginning_Date : H_CUBeginning_Time : H_CUEnding_Date : H_CUEnding_Time : H_CUN_Beginning_Orbit_Number : H_ILLU = NON_Beginning_Time_IET : H_IN_Creation_Date : H_STRN_Creation_Time : H_STRN_Ending_Time_IET : H_IN_Granule_ID : H_IN_Granule_Version : H_STRN_LEO_Flag : H_STRN_Packet_Type : H_STRN_Packet_Type_Count : H_UIN_Percent_Missing_Data : H_IN_Update_Date : H_STRN_Update_Time : H_STROperational_Mode : H_STR<<HDF>> Dataset : H_RR
(from HDF_RDR_Product)
<<H_DS>>
HDF_RDR_SpacecraftDiary_Aggregation
<<NPOESS>> AggregateBeginningDate : H_CU<<NPOESS>> AggregateBeginningOrbitNumber : H_ILLU<<NPOESS>> AggregateBeginningTime : H_CU<<NPOESS>> AggregateBeginningGranuleID : H_I<<NPOESS>> AggregateCreationDate : H_CU<<NPOESS>> AggregateCreationTime : H_CU<<NPOESS>> AggregateEndingGranuleID : H_I<<NPOESS>> AggregateEndingDate : H_CU<<NPOESS>> AggregateEndingOrbitNumber : H_ILLU<<NPOESS>> AggregateEndingTime : H_CU
<<NPOESS>> AggregatePercentMissingDataAve : H_F<<HDF>> AggregateDataset : H_RO
(from HDF_RDR_SpacecraftDiary)
<<H_DS>>
HDF_RDR_SpacecraftDiary_Dataset_#
Beginning_Date : H_CUBeginning_Time : H_CUEnding_Date : H_CUEnding_Time : H_CUN_Beginning_Orbit_Number : H_ILLUN_Beginning_Time_IET : H_IN_Creation_Date : H_STRN_Creation_Time : H_STRN_Ending_Time_IET : H_IN_Granule_ID : H_IN_Granule_Version : H_STRN_LEO_Flag : H_STRN_Packet_Type : H_STRN_Packet_Type_Count : H_UIN_Percent_Missing_Data : H_IN_Update_Date : H_STRN_Update_Time : H_STROperational_Mode : H_STR<<HDF>> Dataset : H_RR
(from HDF_RDR_SpacecraftDiary)
<<H_DS>>
HDF_AUX_SensorCalibrationCoefficient_Aggregation
<<NPOESS>> AggregateBeginningDate : H_CU<<NPOESS>> AggregateBeginningTime : H_CU<<NPOESS>> AggregateEndingDate : H_CU<<NPOESS>> AggregateEndingTime : H_CU<<HDF>> AggregateDataset : H_RO
(from HDF_AUX_SensorCalibrationCoefficient)
<<H_DS>>
HDF_RDR_Product
Instrument_Short_Name : H_STRN_Dataset_Type_Tag : H_STRN_Instrument_Flight_SW_Version : H_STRN_Spacecraft_SW_Version : H_STRN_Subsystem_SW_Version : H_STRPlatform_Short_Name : H_STRProcessing_Level_Identifier : N_STRN_Dataset_Source : H_STRN_Processing_Domain : H_STRN_Granules : H_I
Identifier_Information.Dataset_Identifier : H_STR
(from HDF_File_Root)
<<H_G>>
HDF_RDR_SpacecraftDiary
Instrument_Short_Name : H_STRIdentifier_Information.Dataset_Indentifier : H_STR
N_Dataset_Type_Tag : H_STRN_Instrument_Flight_SW_Version : H_STR
N_Spacecraft_SW_Version : H_STRN_Subsystem_SW_Version : H_STR
Platform_Short_Name : H_STRProcessing_Level_Identifier : N_STR
N_Dataset_Source : H_STRN_Processing_Domain : H_STR
(from HDF_File_Root)
<<H_G>>
HDF_AUX_SensorCalibrationCoefficient
N_Dataset_Source : H_STRN_Dataset_Type_Tag : H_STRN_Processing_Domain : H_STR
N_Spacecraft_SW_Version : H_STRN_Subsystem_SW_Version : H_STR
Identifier_Information.Dataset_Indentifier : H_STR
(from HDF_File_Root)
<<H_G>>
HDF_File_Root
Mission_Name : H_STRN_Quasi-Static_Metadata_Reference
Identifier_Information.Dataset_Indentifier : H_STR
<<Root>>
1
1
1
1
1
1
1
1
RDR
HDF5 Workshop VII, 26 - 28 Oct 2004 1515
Ancillary / Auxiliary Data Products
AncillaryData
Calander_Date : H_STRTime_of_Day : H_STR
(from ANC_HDF_File_Root Group)
<<H_G>>
xxx_Data<<H_DS>>
HDF_xxx_Product_Data<<H_G>>
1..*
11
1..*
ANC_HDF_File_Root Group
Ancillary_Dataset_Identifier.Dataset_Identifier : H_STRIdentification_Information.Citation.Citation_Information.Online-Linkage : H_STR
Identifier_Information.Dataset_Indentifier : H_STRInput_Dataset_Identifier.Dataset_Identifier : H_STRMission_Name : H_STR
N_Anc_Type : H_STRN_Creation_Date : H_STRN_Creation_Time : H_STRN_Dataset_Source : H_STRN_Dataset_Type_Tag : H_STRN_Processing_Domain : H_STRN_Update_Date : H_STRN_Update_Time : H_STR
<<Root>>
HDF_All_Data<<H_G>>
1
1..*
1
1..*
1
11
1
AUX_HDF_File_Root group
Ancillary_Dataset_Identifier.Dataset_Identifier : H_STRIdentification_Information.Citation.Citation_Information.Online-Linkage : H_STR
Identifier_Information.Dataset_Indentifier : H_STRInput_Dataset_Identifier.Dataset_Identifier : H_STRInstrument_Short_Name : H_STRMission_Name : H_STR
N_Anc_Type : H_STRN_Beginning_Time_IET : H_LLN_Creation_Date : H_STRN_Creation_Time : H_STRN_Dataset_Source : H_STRN_Dataset_Type_Tag : H_STRN_Ending_Time_IET : H_LLN_LEO_Flag : H_STRN_Processing_Domain : H_STRN_Spacecraft_SW_Version : H_STRN_Subsystem_SW_Version : H_STRN_Update_Date : H_STRN_Update_Time : H_STRPlatform_Short_Name : H_STR
<<Root>>
AuxiliaryData
Calendar_DateN_Granule_Version : H_STRTime_of_Day : H_STR
(from AUX_HDF_File_Root group)
<<H_G>>
xxx_Data<<H_DS>>
HDF_xxx_Product_Data<<H_G>>
1..*
11
1..*
1
1
HDF_All_Data<<H_G>>
1
1..*
1
1..*
1
1
1
1
1
1
HDF5 Workshop VII, 26 - 28 Oct 2004 1616
General SDR File Structure relationships
A H_DC is attached to each H_DS item. See specific EDR diagrams for details.
xxx_Data<<H_DS>>
HDF_xxx_Product_Data<<H_G>>
HDF_File_Root<<Root>>
HDF_All_Data<<H_G>>
1..*
1..*
11
1..*
1
11
1..*
11
1
HDF_SDR_Product_Granule_n Dataset<<H_DS>>
HDF_SDR_Product Group<<H_G>>11
1..*
1
HDF_SDR_Product_Aggregation Dataset<<H_DS>>
1
11
1
1
1..*
Note: All NPP SDR HDF5 files contain the HDF_All_Data Group thus will not be depicted in the following diagrams.
HDF5 Workshop VII, 26 - 28 Oct 2004 1717
HDF5 file structure – Example CDFCB-X Table for RDR Product Granule Group (primary data)
* Data types are explained on chart 15-16
HDF5 Workshop VII, 26 - 28 Oct 2004 1818
HDF5 file structure – Example CDFCB-X Table for RDR Auxiliary Data Calibration Coefficients Group (secondary data)
* Data types are explained on chart 15-16
HDF5 Workshop VII, 26 - 28 Oct 2004 1919
HDF5 file structure – HDF5 data type to CDFCB-X cross-reference
HDF5 Workshop VII, 26 - 28 Oct 2004 2020
HDF5 file structure – HDF5 attribute to CDFCB-X cross-reference