lecture 04: data storage and representation & access to spatial data geography 128 analytical...
Post on 15-Jan-2016
214 views
TRANSCRIPT
![Page 1: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/1.jpg)
Lecture 04: Data Storage and Representation &Access to Spatial Data
Geography 128
Analytical and Computer Cartography
Spring 2007
Department of Geography
University of California, Santa Barbara
![Page 2: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/2.jpg)
Storage Media
Traditionally, the paper map has performed a storage function for spatial information
Computer cartography requires information to be digital and stored explicitly
Storage is increasingly distributed over networks
Many mapping programs require local storage of data
Cost and size restraints now less important
![Page 3: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/3.jpg)
Evolution of Storage Media
![Page 4: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/4.jpg)
Physical Storage
Bit - the most basic information unit in a binary system (1 / 0)
1 Byte = 8 bits
Binary (2-based), Decimal(10-based), and Hexadecimal (16-based) System
Binary Operator – AND, OR, NOT
Data on a disk -Sectors, Tracks, Platters
File system – File, Directory
![Page 5: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/5.jpg)
Maps as Numbers
Map data is stored in the computer’s memory in a physical data structure (i.e. files and directories).
Files can be written in binary or as ASCII (American Standard Code for Information Interchange) text.
Binary is faster to read and smaller, ASCII can be read by humans and edited but uses more space.
![Page 6: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/6.jpg)
ASCII Table
![Page 7: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/7.jpg)
ASCII Table (extend)
![Page 8: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/8.jpg)
Storage Efficiency and Data Compression
Cartographic data sets are typically large
Need to reconfigure data formats, structures etc.
Seek to retain information content, lose volume.
Is redundancy necessary?
![Page 9: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/9.jpg)
Rasters vs. Vectors
![Page 10: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/10.jpg)
Storing Coordinates (Vector)
Physical Compression
– 4,513,410 m N;587,310 m E; Zone 18,N (32 characters, 15 digits)
– 4513410 587310 (13 digits, one space) Need metadata
– 98 96 7F 0F 42 3F (six bytes)
Logical Compression
– Drop last two digits (10 ASCII or 2 bytes per coordinate)
![Page 11: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/11.jpg)
Raster data Compression
Run-length encoding
Quad-trees
…
![Page 12: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/12.jpg)
Data Storage Formats for Cartography- U.S. Geological Survey
DLG – Digital Line Graphs (1:24,000; 1:100,000; 1:2,000,000)
DEM – Digital Elevation Model (1:24,000; 1:250,000)
GIRAS – Land-use and Land-cover Digital Data (1:100,000; 1:250,000)
GNIS – Digital Cartographic Text
![Page 13: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/13.jpg)
Data Storage Formats for Cartography- U.S. Geological Survey
USGS DLG format
![Page 14: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/14.jpg)
Data Storage Formats for Cartography- U.S. Geological Survey
USGS 1:250,000 3-arc second DEM format (1-degree block)
![Page 15: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/15.jpg)
Data Storage Formats for Cartography- U.S. Geological Survey
USGS 1:24,000 30 meter DEM format (7.5-minute quadrangle)
![Page 16: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/16.jpg)
Data Storage Formats for Cartography- CIA World Data Bank
WDB I (1:12M base, 100K points)
WDBII (1:3M base, 6M Points)
DCW 1:1M base- 4 CDs, 14 layers DMAs VPF
![Page 17: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/17.jpg)
Data Storage Formats for Cartography- Industry “Standard” Vector Formats
Vector formats are either page definition languages or preserve ground coordinates.
Page languages are HPGL, PostScript, and AutoCAD DXF.
Proprietary GIS Formats– Arc/Info, ArcGIS– MapInfo– …
![Page 18: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/18.jpg)
Data Storage Formats for Cartography- Industry “Standard” Raster Formats
Most raster formats are digital image formats.
Most GISs accept TIF, GIF, JPEG or encapsulated PostScript, which are not geo-referenced.
GeoTIFF is true geographic data format
![Page 19: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/19.jpg)
Finding Existing Map Data
Map libraries
Reference books
State and local agencies
Federal agencies
Commercial data suppliers e.g. GeographyNetwork.com, Rand McNally, Thompson, NAVTEQ, maps.com
![Page 20: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/20.jpg)
Existing Map Data
Existing map data can be found through a map library, via network searches, or on media such as CD-ROM and disk.
Many major data providers make their data available via the World Wide Web, a network of file servers available over the Internet.
GIS vendors package data with products.
![Page 21: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/21.jpg)
Commercial vendors
![Page 22: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/22.jpg)
Federal Data Agencies
U.S. Geological Survey (USGS)
National Oceanic & Atmospheric Administration (NOAA)
Census Bureau
National Geospatial-Intelligence Agency (NGA)
Environmental Protection Agency (EPA)
many more...
![Page 23: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/23.jpg)
National Spatial Data Infrastructurehttp://www.fgdc.gov/nsdi/nsdi.html
![Page 24: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/24.jpg)
Geodata.gov
![Page 25: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/25.jpg)
National Spatial Data Clearinghouse
![Page 26: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/26.jpg)
USGS: National Mapping
![Page 27: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/27.jpg)
National Map Viewer
![Page 28: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/28.jpg)
DOQQ (Digital Orthophoto Quarter Quadrangle ) plus DLG streets
![Page 29: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/29.jpg)
DRG (Digital Raster Graphics) plus DLG streets
![Page 30: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/30.jpg)
Seamless data download
![Page 31: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/31.jpg)
Other components of the NSDI (Portals, standards, services, data)
Geospatial Onestop
Geography Network
EROS Data Center
FGDC: Standards
Alexandria Digital Library
State data centers e.g. Teale in CA
MapQuest
NAVTEQ, etc.
Counties, municipalities, universities, tribes, etc.
![Page 32: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/32.jpg)
U.S. Bureau of the Census
![Page 33: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/33.jpg)
National Oceanic and Atmospheric Administration (NOAA) Weather and other data
![Page 34: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/34.jpg)
Distributed active archive center
Sioux Falls, SD
Operated by USGS
Eros Data Center
![Page 35: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/35.jpg)
US GeoDataftp access toDEMDLGGNISGIRASetc.
![Page 36: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/36.jpg)
GNISFeature locations
![Page 37: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/37.jpg)
GIRASLand Use and Land Cover Data
![Page 38: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/38.jpg)
GIRAS into Arc/Info (GIRASARC)
![Page 39: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/39.jpg)
Terrain dataDEMDLG ContoursDCW Contours
![Page 40: Lecture 04: Data Storage and Representation & Access to Spatial Data Geography 128 Analytical and Computer Cartography Spring 2007 Department of Geography](https://reader035.vdocument.in/reader035/viewer/2022081520/56649d3b5503460f94a16270/html5/thumbnails/40.jpg)
Next Lecture
Spatial Data Structure