accessing nasa data nasa ornl daac (distributed active archiving center) oak ridge national...
TRANSCRIPT
Accessing NASA dataNASA ORNL DAAC
(Distributed Active Archiving Center)
Oak Ridge National Laboratoryhttp://www.daac.ornl.gov/
NASA Observing Spacecraft for Earth System Research
Moderate Resolution Imaging Spectroradiometer (MODIS)
Sunglint
Haze
Cloud
Data provided by NASA Goddard Space Flight Center. Image processed by Battelle using MODIS HDF Look.
MODIS Aerosol Optical Depth
25 June 2002
Data provided by NASA Goddard Space Flight Center. Image processed by Battelle using MODIS HDF Look.
•NASA’s Earth Observing System (EOS) Program– centerpiece of NASA’s Earth Science Directorate, largest component in the
U.S. Climate Change Science Program– spaced-based observing system– ground-based field campaigns– objective is to enable quick and easy access to data about the earth
•EOS Data and Information System (EOSDIS)– explicitly planned and funded by NASA to make maximum use of the data– data available at 8 Distributed Active Archive Centers (DAACs), organized
by scientific discipline
EOSDIS Archive
TerraTerra
The Earth Observing System (EOS) Program
EOSDIS Distributed Active Archive Centers
JPLJPL
U. AlaskaU. Alaska
U. ColoradoU. Colorado
EDCEDC
ORNLORNL
GSFCGSFC
LaRCLaRC
Cryosphere
Land ProcessesSEDACSEDAC
Socio-economic
BiogeochemicalDynamics
Sea Ice andPolar Processes
AtmosphericProcesses
Upper Atmosphere,Global Biosphere, and
Geophysics
Ocean CirculationAnd Air-sea Interaction
Data Center Earth System Science disciplineASF DAAC- Alaska Satellite Facility
U. of Alaska
Synthetic Aperture Radar (SAR), Sea Ice, Polar processes, Geophysics
GES DAAC - GSFC Earth Sciences
Goddard Space Flight Center
Atmospheric Composition , Atmospheric dynamics, Global Precipitation, Ocean biology, Ocean dynamics, Solar irradiance
GHRC – Global Hydrology Resource Center
Nat’l Space Science & Technology Center
Hydrologic cycle, Severe Weather Interactions, Lightning, Convection
LaRC DAAC –
Langley Research CenterRadiation budget, clouds, Aerosols, Tropospheric Chemistry
LP DAAC – Land processes
EROS Data Center (USGS)Land Processes
NSIDC DAAC- National Snow and Ice Data
U. of Colorado
Snow and ice, Cryosphere and climate
ORNL DAAC-
Oak Ridge National Lab
Biogeochemical dynamics, Ecological data, Environmental processes
PO,DAAC – Physical Oceanography
Jet Propulsion Lab (JPL)
Oceanic Processes, Air-Sea interactions
SEDAC – Socioeceonomic Data and Applications Center
Columbia University
Population, Sustainability, Geospatial data, Multilateral Environmental Agreements
Getting data from Data Centers
• Directly from Data Centers websites– Center-unique search-and-order systems– Specialized data set tools
• Viewing, subsetting, web GIS
• EOS Data Gateway (EDG)- A NASA site where one can search across all the NASA data centers and also order (soon to be replaced by another system called ECHO). Has browse capability. http://eos.nasa.gov/imswelcome
• Global Change Master Directory – Allows one to search across all the NASA data centers plus many other data sites. Over 2,400 providers. Points you to where to order. ( but is not the place to order.) http://gcmd.nasa.gov
• Many of the data sets require special tools for image processing and analysis. These tools are provided by the data centers and are under continual development.
ORNL DAAC ~ Distributed Active Archive Center
• Mission: Support the needs of NASA’s Earth Science Enterprise (ESE) and Earth Observing System (EOS) Program by assembling, archiving, and distributing terrestrial biogeochemistry and ecosystem dynamics data
• Sponsor: NASA– Martha Maiden - EOSDIS– Diane Wickland - Earth System Science – Carbon Cycle and
Ecosystems
• Is not responsible for satellite downloading. Does get satellite data from other NASA data centers… and then puts it in a format accessible to ecological field researchers.
http://www.daac.ornl.gov/
ORNL DAAC: Roles in EOSORNL DAAC: Roles in EOS
3. Regional and3. Regional and Global Global Studies*Studies*
• Climate• Soils• Vegetation• Hydroclimatology
2. Validation of Remote Sensing 2. Validation of Remote Sensing ProductsProducts
Four primary data management roles, supporting:
1. Field Campaigns1. Field Campaigns• 6-9 year intensive
study of a region:•Amazon (LBA)•Canada (BOREAS)•Southern Africa(SAFARI 2000)
BOREAS
LBA
LBA
S2KS2K
In-situObservations
?
Remote Sensing
LAI/fPAR NPP
LAI/fPARNPP
4. Model Code*4. Model Code*• Benchmark Models
•IBIS, BIOME-BGC, LSM• Manuscript Models
•PNeT, Century, Biome-BGC
ORNL DAAC data sets & renewable energy?
• Regional & global data relevant to hydropower
– Climate collections - Several global climate data sets. Climate data include measured and modeled values for variables such as temperature, precipitation, humidity, radiation, wind velocity, and cloud cover
– Hydroclimatology collections - data on streamflow and climatology. The data were collected with a range of frequencies (daily and monthly) and are from meteorological and streamflow discharge stations in the U.S.
– River discharge - The Global River Discharge (RivDIS) data set contains monthly discharge measurements for 1018 stations located throughout the world. The period of record varies widely from station to station, with a mean of 21.5 years.
ORNL DAAC data sets & renewable energy?
• Regional & global data relevant to bioenergy
– Climate collections - Several global climate data sets. Climate data include measured and modeled values for variables such as temperature, precipitation, humidity, radiation, wind velocity, and cloud cover
– Soil Collection - data on the physical and chemical properties of soils, including soil carbon and nitrogen, soil water-holding capacity, soil respiration, and soil texture. The data are gridded at spatial scales ranging from regional to global.
– Vegetation Collections - Gridded data on vegetation from regional to continental scales. Information about vegetation data archived at the ORNL DAAC is available on the Leaf Area Index Web page. The DAAC also offers data from the Net Primary Productivity Database, which contains biomass and NPP estimates.
MODIS ASCII Subsets: Remote Sensing Products for Field
Sites
Bob Cook, Steve Margle, Susan Holladay, and Suresh Kumar
ORNL DAACOak Ridge National Laboratory
Distributed Active Archive CenterOak Ridge, Tennessee, USA
Subsets of Terra and Aqua MODIS Land Products for 280 sites worldwide (field sites or flux towers) in ASCII format
7 km x 7 km centered on flux tower or field sites Two annual products, four 8-day products, two 16-day products,
and calculated albedo, from 2000 to present
MODIS ASCII MODIS ASCII Subsets (Coll. 4)Subsets (Coll. 4)MODIS ASCII MODIS ASCII Subsets (Coll. 4)Subsets (Coll. 4)
MODIS Products
Surface Reflectance
Surface Temperature
Land Cover
NDVI / EVI
LAI / fPAR
Net Photosynthesis
Annual NPP
Albedo (calc)
Reflectance – BRDF
Adjusted
NDVI Time series for cropland in Michigan
Dec 02 Feb 02 Apr 02Mar 02Jan 03
Greenup (Above images) – Matches with time series
Also 2001, seems to be a special case – Scope for further analysis
Location from Google maps
Location
* Images from USGS Global Visualization Viewer
http://glovis.usgs.gov/
Multiple paths to access data
• FTP – most popular method • Picklists
– Site, investigator, land cover class, network
• WebGIS– Site location plus background layers
• GeoTIFF file picklist– with WebGIS
• Google Earth– MODIS Subset metadata file that opens in
Google Earth application
Using Google Earth to Access Subsets
NDVI at Lost CreekLAI at Lost Creek
Pixel ValuesMean Value of Pixels
Percent of Pixels that meet QC Criteria
Albedo (Visible)
Comparison of MODIS and Tower NDVIMissouri Ozark Site
0
0.2
0.4
0.6
0.8
1
0 50 100 150 200 250 300 350
Julian Day in 2005
ND
VI
Tower NDVI
MODIS NDVI
NDVI
Pixel ValuesMean Value of Pixels
Percent of Pixels that meet QC Criteria
Beginning to compile site data for comparison
ASCII tiles ASCII tiles (per SDS)(per SDS)
InventoryInventory
Acquisition and Processing of MODIS Tiles: Tool for North America
MODISMODISDataDataPoolPool HDF TilesHDF Tiles
InventoryInventoryAutomatic Automatic
FTP pull from FTP pull from Data PoolData Pool
ORNL DAACORNL DAAC
MODIS Reprojection
Tool:Conversion
to Binary
LP DAACLP DAAC
1200 x 1200 km
ORNL Code: Conversion
to ASCII
SDS = Science Data Set
Files for User Interface
Computer Resources
Dedicated Server
10 TB RAID storage
(capacity through 2009 for 1.5 TB/y)
Temporary
User Interface
• User selects center coordinates or site, areal extent, and period of interest
• Processing of time series (selection of tiles, mosaicking, generating time series data file and graphs) takes 10 to 60 minutes for most products (depends on area, time period, and product)
• URL with graphs and pointers to data files is emailed to user
EVI Southern California
Time SeriesExample
Center PixelMean Value of Pixels
Percent of Pixels that meet QC Criteria
Mean (std dev) for pixels with same land cover as the center pixel (20 of 49 pixels)
Center pixel = Woody Savannas
Center PixelMean Value of Pixels
Percent of Pixels that meet QC Criteria
Time SeriesExample
Importing ASCII Grid Data into GIS/Image processing software
Table of Contents
Importing data into:
• ArcGIS 9.x
• ENVI
• ArcView 3.x
• GRASS
Prepared by Suresh Kumar on March 10th 2006, ORNL DAAC
Importing the ASCII Grid data into ArcGIS 9.x
Prepared by Suresh Kumar on March 10th 2006, ORNL DAAC
Go to Table of Contents
Example File : GRID.MOD13A2.asc
MODIS ASCII Subsets: Data Visualization[MOD13A2] Terra Vegetation Indices (NDVI, EVI) USA, Walker Branch Watershed, Oak Ridge, TennesseeCentered on Latitude [35.958767] Longitude [-84.287433]7 Kilometers [7 Pixels] Wide and 7 Kilometers [7 Pixels] High Requested Time Span November 2005 to November 2005For a PRJ file, access http://daac.ornl.gov/cgi-bin/MODIS/GR_common/modis.prjFor a prj.adf file, access http://daac.ornl.gov/cgi-bin/MODIS/GR_common/prj.adf
MODIS HDF Tile MOD13A2.A2005305.h11v05.004.2005325075111.hdf
-----START Scientific Data Set (Band): 1_km_16_days_NDVI, MODIS Date: A2005305 (Nov. 1, 2005)-----ncols 7nrows 7xllcorner -7589988.98yllcorner 3995608.83cellsize 926.62543305583381nodata_value -99999995579 5846 5940 5769 5566 5869 57766173 5722 5876 5912 5920 5882 56325844 5812 5972 5904 5154 4966 52825786 5765 5822 5695 5739 5817 59925609 5094 4333 5790 5763 5793 58635602 5499 5844 5811 5210 5436 57284749 5674 5419 2617 4012 5607 5219-----END Scientific Data Set (Band): 1_km_16_days_NDVI, MODIS Date: A2005305 (Nov. 1, 2005)-----
MODIS HDF Tile MOD13A2.A2005321.h11v05.004.2005342022515.hdf
-----START Scientific Data Set (Band): 1_km_16_days_NDVI, MODIS Date: A2005321 (Nov. 17, 2005)-----ncols 7nrows 7xllcorner -7589988.98yllcorner 3995608.83cellsize 926.62543305583381nodata_value -99999995279 5480 5584 5584 5226 5248 52755781 5508 5517 5383 5347 5281 50515634 5554 5571 5511 4825 4557 53445635 5375 5293 5432 5298 5562 55815386 4646 4660 5279 5446 5480 53935396 5118 5750 5563 4825 5260 55874774 5425 5047 3500 4174 5187 4955-----END Scientific Data Set (Band): 1_km_16_days_NDVI, MODIS Date: A2005321 (Nov. 17, 2005)-----
Prepared by Suresh Kumar on March 10th 2006, ORNL DAAC
Step 1
Copy contents between “-----START Scientific Data Set (Band)…………..”And “-----END Scientific Data Set (Band)……………...”
Into a separate file.
If there are more than one START-END entries, copy contents within each of the START-END statements into individual files like:
File GRID_MOD13A2_A2005305 _1_km_16_days_NDVI.asc from example file GRID.MOD13A2.asc
ncols 7nrows 7xllcorner -7589988.98yllcorner 3995608.83cellsize 926.62543305583381nodata_value -99999995579 5846 5940 5769 5566 5869 57766173 5722 5876 5912 5920 5882 56325844 5812 5972 5904 5154 4966 52825786 5765 5822 5695 5739 5817 59925609 5094 4333 5790 5763 5793 58635602 5499 5844 5811 5210 5436 57284749 5674 5419 2617 4012 5607 5219
Prepared by Suresh Kumar on March 10th 2006, ORNL DAAC
Importing the individual file GRID_MOD13A2_A2005305 _1_km_16_days_NDVI.asc into ArcGIS :
Step 2
Using ArcToolbox from ESRI’s ArcGIS 9.x software
Select:
Conversion Tools To Raster ASCII to Raster
Prepared by Suresh Kumar on March 10th 2006, ORNL DAAC
Step 3
Provide path to ASCII file (GRID_MOD13A2_A2005305 _1_km_16_days_NDVI.asc )and Output Raster (MD13A205305)
Click OK
Prepared by Suresh Kumar on March 10th 2006, ORNL DAAC
Step 4
After converting to Raster the output raster (MD13A205305) would automatically load into ArcMap
Prepared by Suresh Kumar on March 10th 2006, ORNL DAAC
Export this file (MD13A205305) into ArcGIS GRID
Step 5
Right Click on the file to Export
Provide output filename (e.g. md13a2053051)and format
Prepared by Suresh Kumar on March 10th 2006, ORNL DAAC
Setting up the projection
Download file prj.adf from http://daac.ornl.gov/cgi-bin/MODIS/GR_common/prj.adf
copy the prj.adf file into the GRID file directory (md13a2053051) created in the previous step
Step 6
Prepared by Suresh Kumar on March 10th 2006, ORNL DAAC
If the projection isn't defined, use the following file to define the projection.
Download file modis.prj from http://daac.ornl.gov/cgi-bin/MODIS/GR_common/modis.prj
Copy this file into <ESRI installation Folder>\Coordinate Systems\Projected Coordinate Systems\World\Sphere-basedand manually set the projection for the file
Step 7
Load the GRID file in ArcMap – Make sure that the projection is defined on the dataset
Final output md13a2053051 with projection set, overlaid with the MODIS site locations
Prepared by Suresh Kumar on March 10th 2006, ORNL DAAC