basics of using lidar data - water resources center · 2015-05-14 · basics of using lidardata 3...

29
Basics of Using LiDAR Data 1 Conservation Applications of LiDAR Data Conservation Applications of LiDAR Data Workshops funded by the Minnesota Environment and Natural Resources Trust Fund Conservation Applications of LiDAR Data In collaboration with: Minnesota Board of Water and Soil Resources USDA Natural Resources Conservation Service Minnesota Department of Natural Resources Presented by: University of Minnesota Co-sponsored by the Water Resources Conference tsp.umn.edu/lidar Workshops funded by: Minnesota Environment and Natural Resources Trust Fund Conservation Applications of LiDAR Data Training Modules: Basics of Using LiDAR Data Terrain Analysis Hydrologic Applications Engineering Applications Wetland Mapping Forest and Ecological Applications tsp.umn.edu/lidar Basics of Using LiDAR Data Basics of Using LiDAR Data Joel Nelson Univ of Minnesota, Dept of Soil, Water, and Climate Funded by the Minnesota Environment and Natural Resources Trust Fund Introduction Intended as the first in a series of workshops related to LiDAR and allied analyses, “Basics of LiDAR” will serve as both a prerequisite and jumping-off-point for following workshops: Terrain Analysis Hydrologic Applications Engineering Wetland Mapping Forest and Ecological Applications Introductions - Logistics Course Instructor – Joel Nelson Workbooks Breaks Restrooms

Upload: others

Post on 23-May-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data1

Conservation Applications of LiDAR Data

Conservation Applications of LiDAR Data

Workshops funded by the Minnesota Environment and Natural Resources Trust Fund

Conservation Applications of LiDAR Data

In collaboration with:

Minnesota Board of Water and Soil Resources

USDA Natural Resources Conservation Service

Minnesota Department of Natural Resources

Presented by:

University of Minnesota

Co-sponsored by the Water Resources Conference

tsp.umn.edu/lidar

Workshops funded by:

Minnesota Environment and Natural Resources Trust Fund

Conservation Applications of LiDAR Data

Training Modules:

Basics of Using LiDAR Data

Terrain Analysis

Hydrologic Applications

Engineering Applications

Wetland Mapping

Forest and Ecological Applications

tsp.umn.edu/lidar

Basics of Using LiDAR DataBasics of Using LiDAR Data

Joel NelsonUniv of Minnesota, Dept of Soil, Water, and Climate

Funded by the Minnesota Environment and

Natural Resources Trust Fund

IntroductionIntended as the first in a series of workshops related to LiDAR and allied analyses, “Basics of LiDAR” will serve as both a prerequisite and jumping-off-point for following workshops:

•Terrain Analysis

•Hydrologic Applications

•Engineering

•Wetland Mapping

•Forest and Ecological

Applications

Introductions - Logistics

Course Instructor – Joel Nelson

Workbooks

Breaks

Restrooms

Page 2: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data2

Introductions – Student Intros

Students

Who uses ArcGIS 10?

Who uses LiDAR data currently?

Who calculates products or does raster processing from LiDAR data?

Course Objectives

Lecture and Hands-on Format

Raster Data

What is LiDAR?

LiDAR Products

Lecture 1 – Raster Data

Credit – Tim Loesch - MNDNR

About Raster Data

Raster Data Less used today than the

vector data model

Raster environment and principles not as well understood

Most users familiar with aerial photos or satellite imagery

Credit – IBM

Raster DataStructure/Model

Regular set of cells in a grid pattern

Typically square

Attribute values associated with each location (cell)

Models “continuous” data well

Key features Cell size

Units Credit – ESRI

Page 3: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data3

Raster Data Analysis - Advantages History

Flexible

○ Data structure

Wide range of variables

Simple to complex – single cell, networks, groups of cells

○ Well-developed

Wide variety of applications

Continuous Data – i.e. elevation

Credit – ESRI

Raster Data Analysis – Disadvantages Precision limited to cell

size

○ Tradeoff – higher resolution comes at greater storage cost and speed of processing

“Stairstep” edges

Often assigned a single “value” for a single attribute rather than a host of attributes per cell

Credit – ESRI

Raster Data Analysis Basic to complex

Mathematical (Map Algebra), neighborhood (moving window) distance, surface, statistical, etc.

Credit – ESRI

Raster Data Analysis - Map AlgebraMap Algebra – Raster Calculator

Raster layers combined via mathematical combinations

Cell-by-cell – added, subtracted, divided, or multiplied

Variety of uses Change detection – e.g. year 2000

data subtracted from year 2010 data

Terrain attributes – e.g. SPI –multiply effect of one variable by another

Credit – ESRI

Raster Data AnalysisNeighborhood Functions

Moving window of cells swept across all raster cells, typically multiplying values by data found around center cell

Very common in raster analysis

Slope, hillshade, filter, and kriging calculations for example, all employ a moving-window approach

Working with Raster Data

Page 4: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data4

Working in the Raster Environment

Raster = Grid

File Structure

Grid Alignment

Resampling

Aggregation

File StructureArc GRIDS are not single files

Several folders with associated files

Linked – cannot work independent of one another

Use ArcCatalog to copy, move or rename

Can export into variety of single file-types - .img, .e00, etc.

VS.

Grid AlignmentSnap Raster Setting

○ The cells in the output raster are aligned with the cells of the snap raster.

○ The lower-left corner of the extent is snapped to a cell corner of the snap raster.

○ The output cell size is same as the snap raster cell size.

Proper Grid Alignment = Snap Raster Settings

Credit – Sean Vaughn- MNDNR

Resolution

Cell size should be same for all inputs

If not

Nearest neighbor resampling automatically occurs

Resampled to coarsest resolution of all inputs

Esp. not recommended for continuous data – i.e. Elevation

Aggregate/Resample

Changing the resolution (Upscaling) –if cells evenly divisible, use AGGREGATE

If not evenly divisible or changing the alignment, then use RESAMPLE

You can downscale, but this does not create any new information

Credit – Sean Vaughn- MNDNR

Elevation Data -DEMs

Page 5: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data5

Raster Elevation Data Sources

Stereo photography

Topographic maps (elevation contours)

Ground survey (GPS, other)

LiDAR

Stereo Photography• View shape of

topographic surface

• Overlapping photographs

• View from two perspectives (parallax)

• Old technology – has been used extensively in Soil Survey and forestry

Credit – Steve Kloiber- MNDNR

Topographic/Contour Data Also called contour maps

Contour line joins points of equal elevation

Can interpret slope, relief, shape/size of valleys and hills

Paper and digital

○ Digital leaves visualizationup to the user

Survey• GPS survey or Total

Station

• Small areas

• Labor intensive

• Very precise

Credit – Steve Kloiber - MNDNR

Raster Elevation Data FormatsModels of Topography

Multiple ways of representing elevation

○ Triangulated irregular network

○ Contours (Vector)

○ Digital elevation model (Raster)

Each has advantages and disadvantages

DEM is used most often for terrain analysis and watershed delineation

Credit – Steve Kloiber- MNDNR

Digital Elevation Model (DEM)

What is a DEM?• Digital file that:

• Contains elevation of terrain over a specified area

• Is arranged as a fixed-grid interval over the earth surface

• Is geo-referenced

• Can be manipulated to create other elevation-dependentdata products

Page 6: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data6

Digital Elevation Model (DEM)

• Consists of pixels or cells

• Value assigned represents average elevation of grid cell

Credit – Steve Kloiber- MNDNR

Digital Elevation Model (DEM)

DEMs are a common way of representing elevation where every grid cell is given an elevation value. This allows for very rapid processing and supports a wide-array of analyses.

Credit – Steve Kloiber- MNDNR

DEMCharacteristics

Resolution– Density of elevation measurements

– Determines level of detail of surface representation

– 30m coarse – 1m fine

Interpolation– Calculation used to find elevation of unspecified

location

– Various techniques/algorithms: Kreiging, TheissenPolygons, Spline, IDW, Bilinear, Nearest Neighbor

Effect of Cell Size - Resolution

Coarse Resolution

Fine Resolution

DEM Comparison Why so much interest in LIDAR?

• Higher resolution data than we ever thought possible

• Opens up opportunities to describe and characterize landscapes in ways previously not feasible

Comparison to existing national standard product

USGS DEM LiDAR DEM

Horizontal Resolution 30 meters ~1 meter

Vertical Resolution 7‐15 meters ~15 cm

Contour Interval 5‐20 feet 1‐3 feet

DEM Resolution Tradeoff

Lower resolution = faster processing

Higher resolution = more precision, maintains small features

Coarse to Fine

Page 7: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data7

DEM ComparisonUSGS 30m DEM LiDAR 3m DEM

LiDAR Derived DEMCell Size: 1 meter sqVertical Error: 15 cm1

1.5 mil points / sq mile

USGS Standard DEMCell Size: 30 meter sqVertical Error: “Equal to or better than 15 m.”2

1600 points / sq mile

2.5 mi

1 Varies based on project specifications2 http://edc.usgs.gov/guides/dem.html

Credit – Tim Loesch - MNDNR

DEM Comparison USGS 30 meter Elevation Data

LiDAR 3 meter Elevation Data Hillshade DEM3m vs 30m

Page 8: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data8

Contour Comparison – Vector Product

2 ft contours created from LIDAR data

10 ft contours createdfrom standard 30m

DEM data

End of Lecture 1Questions/Comments?

Lecture 2 – What is LiDAR?

Credit – ESRI

LiDAR

What is LiDAR?

• Light Detection And Ranging – a remote sensing system used to collect topographic data

• Produces high-resolution, accurate, land-elevation information

LiDARHow is LiDAR data collected?

Airborne survey:• Covers the surface with

multiple discrete laser pulses

• Up to 150,000 per second

• Collects the returnsTime = distance + GPS = Location

LiDAR Survey Equipment

Light Detection and Ranging

Laser Rangefinder

IMU (INS)

GPS

On board computer

Produces accurate land elevation data

Credit - USGS

Page 9: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data9

LiDAR Survey Equipment

Laser Rangefinder

Records distance to target

○ Time * c / 2

Wavelengths differ

○ 1064 nm

Various scan rates

Credit - USGS

LiDAR Survey Equipment

Inertial Measurement Unit (IMU)

Gyroscopes and accelerometer

Records roll, pitch, yaw of aircraft

.005 degree pitch & roll

.008 degree heading

Roll

Pitch

Yaw

Credit – NASA

LiDAR Survey Equipment

Global Positioning System (GPS)

Differentially corrected

Provides cm accuracy of aircraft

Allows cm accuracy of laser pulse

Credit - USGS

LiDAR Survey Equipment

On board computer

Records data

○ Laser distance and intensity

○ IMU info

○ GPS info

Converts into

○ X, Y, Z

○ Millions of points

On-board display

Credit - USGS

LiDAR Data ResolutionBased on collection density

1 point/meter to 8 points/meter with ground control point validation

Supports 2 foot contours to sub 1-foot contours depending on collect www.esri.com/library/userconf/proc00/professional/papers/Pap808/p808.htm

• End-product is accurate, with geographically registered longitude, latitude, and elevation (x,y,z) for every data point

• Several file types and derivative productsavailable to end-users

• LAS point cloud, DEM, contours, hydrologic breaklines

LiDAR Products

Page 10: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data10

LiDAR Data CollectionLiDAR Returns: Multiple discrete return pulses

LiDAR Intensity: Magnitude or strength-of-return pulse

Metadata: Information about how data was collected—READ IT!

All returns can be used• Forest canopy• Intensity image• Vegetation mapping

Returns

Single Return

Multiple returns

Waveform Returns

Credit - USGS

Returns

Single Return

Multiple returns

Waveform Returns

1st return

2nd return

3rd return

4th return

Credit - USGS Credit - USGS

Returns

Single Return

Multiple returns

Waveform Returns

Credit - USGS

Intensity Intensity = amount of

energy reflected for each return

Different surfaces reflect differently based on wavelength of laser

Example at 1064nm (NIR), water absorbs, vegetation highly reflective

Can be used to build black and white near-IR images

Credit - USGS

Page 11: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data11

MN LiDAR Data

Minnesota Mapping InitiativeIn the beginning…..

Red River Collect – 2006

Obi Sium – DNR Waters/FEMA

Technical Group to develop

standards

Governor’s Council on Geographic

Information

Digital Elevation Committee

○ Working to achieve publicly available,

high accuracy elevation data

statewide

○ Federal, State and County

representatives

High ResolutionElevation

Data?

Credit – Tim Loesch - MNDNR

Credit – Tim Loesch - MNDNR

Minnesota Mapping Initiative

Several unsuccessful attempts to secure funding at the state level

Worked with counties to ensure consistent data

• Technical advice and assistance

• Standards and accuracy

Minnesota Mapping InitiativeClean Water Fund of the Legacy Amendment

Citizens of the state have invested in Water Quality

High Resolution Elevation data can be used for all future water quality projects

Secured $5.6 million in funding Funds in Division of Ecological

Resources/Waters

Project led by Management Resources/MIS

Credit – Tim Loesch - MNDNR

Minnesota Mapping InitiativeMulti-Government Partnership

USGS, EPS

○ Technical Advice

○ Potential funding opportunities

MnDOT, MnDNR, MnGEO

○ GIS technical expertise

○ Project management

○ Survey and Validation Coordination

○ Data Coordination

County and Local Governments

○ Survey Points and Data validation

Credit – Tim Loesch - MNDNR

Statewide LiDAR Coordination and Collaboration

Two committees are tasked with LiDAR data development, management, and deployment

1. MN Digital Elevation Committee

http://www.mngeo.state.mn.us/committee/elevation

2. MN Digital Elevation Committee - Research and Education Subcommittee

http://www.mngeo.state.mn.us/committee/elevation/research_education

Mission Statement:

○ Design and promote best practices with LiDAR data for Minnesota Ensure there is consistency in data development, application, and training.

Training:

• Course Planning and Design

• Survey

Page 12: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data12

LiDAR AcquisitionStandards

Defined by the MN Digital Elevation Committee

Based on the recent USGS Base LiDAR Specification.

<=15 centimeter RMSEz.

2-foot vertical accuracy (95% confidence).

1-meter horizontal accuracy.

Coordinate system

UTM Zone 15, NAD83 horizontal datum.

NAVD88 vertical datum Vertical units in meters.

LiDARAcquisition

LiDAR Status

MN LiDAR Data – What’s Available –What’s Not

Available for Download

Elevation Data

○ Bare Earth points

○ DEM – 1m and 3m

○ Hillshade

○ Contours

○ Terrain/TIN

Associated Data

○ Hydro Breaklines

○ Buildings

Calculate on your own Elevation Data

○ Hydrologicallyconditioned DEM

○ Custom resolution DEM or contours – e.g. 5m

Derived Products

○ Slope

○ Flow Accumulation

○ Stream Power Index (SPI)

○ Compound Topographic Index (CTI)

MN LiDAR Project ActivitiesPoint Classification

Points are processed to determine what they bounced off of

○ Bare Earth

○ Buildings

○ Cars and other anthropomorphic things

○ Bridge decks

○ Vegetation (High, Medium, and Low)

○ Water

ASPRS has developed a set of standard classifications for LiDAR derived data

Credit – Tim Loesch - MNDNR

Page 13: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data13

MN LiDAR Project Activities

Point Classification

Automated Classification

○ Can identify features with 70-74% accuracy

Manual Classification

○ Needed to get higher accuracies

○ Typically done with Air Photos and other sources of data

○ Typically the most time consuming portion of any project and the most likely to be farmed overseas

MN LiDAR Data Validation

Vertical Accuracy QA/QC Purpose:

○ Data Validation – we got what we bought

○ Data Integrity – we want people to trust the data

Compare LiDAR elevations with Surveyed Points

○ 100 surveyed validation points per county

○ 20 points in each of 5 cover categories

○ Help from county surveyorsCredit – Tim Loesch - MNDNR

LiDAR Error and Accuracy

Error and AccuracyWhat’s the value of your data?

How is accuracy measured? National Standard for Spatial Data Accuracy

(NSSDA)

○ Addresses accuracy of the product at ground scale

○ Squared Root Mean Square Error (RMSE2)

National Map Accuracy Standard (NMAS)

○ Accuracy based on Contour Interval at published map scale

Error and Accuracy

Comparison of NDDSA and NMAS

NMAS Contour Interval

Equivalent

NSSDA RMSE (z) NSSDA Accuracy (z2)

Required Accuracy for Tested Data for “Tested

to Meet”

0.5 0.15 ft or 4.60 cm 0.30 ft or 9.10 cm 0.10 ft

1 0.30 ft or 9.25 cm 0.60 ft or 18.2 cm 0.20 ft

2 0.61 ft or 18.5 cm 1.19 ft or 36.3 cm 0.40 ft

4 1.22 ft or 37.0 cm 2.38 ft or 72.6 cm 0.79 ft

5 1.52 ft or 46.3 cm 2.98 ft or 90.8 cm 0.99 ft

10 3.04 ft or 92.7 cm 5.96 ft or 181.6 cm 1.98 ft

Error and Accuracy Validation Points

○ Level ground away from breaks in topography

○ Open, visible sky

Five cover classes – 20 points per class (30 preferred)

○ L1O – Open terrain

○ L2T – Tall Grass

○ L3B – Brush

○ L4F – Forested

○ L5U - Urban

Page 14: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data14

Error and Accuracy

Types of Accuracy

Fundamental Accuracy = Best Case Scenario

○ Open terrain tested to 95% accuracy

Supplemental Accuracy

○ Accuracy for Cover Classes other than Open terrain

Consolidated Accuracy

○ All Cover Class Accuracies Combined

Error and AccuracyLiDAR points Interpolated Value 372.115

Observe Interpolated value vs. Actual (Surveyed Point)

371.93

Error and Accuracy

Winona County Validation Points

Error and Accuracy…

RMSE Calculations

RMSE(z) = Sqrt(sum(Zdata(i) – ZCheck(i))2 / n)

Vertical Accuracy 95% Rate = 1.96 * RMSE2

Error and Accuracy…--------- Report Summary ---------

Error Mean: -0.116Error Range: [-0.435,0.143]Skew: -0.305RMSE(z): 0.161NMAS/VMASAccuracy(z) (90% CI): ±0.265ASPRS/NSSDAAccuracy(z) (95% CI): ±0.315

176 control points included in summary out of 176- 0 control points turned off- 0 control points returned no-data

--------- Control Points ---------

Name Control X Control Y Control Z Surface Z Error L1O0 604760.340 4878787.629 201.217 201.389 -0.172 L5U1 608921.294 4878065.350 201.488 201.806 -0.318 L1O2 610991.353 4876621.369 200.214 200.397 -0.183 L1O3 607292.402 4874401.804 233.428 233.606 -0.178 L1O4 622397.772 4873262.387 207.292 207.356 -0.064 L1O5 626922.206 4869248.810 202.936 202.969 -0.033 L1O6 631669.497 4863815.331 200.254 200.333 -0.079 L1O7 635439.901 4857649.190 375.011 375.070 -0.059 L1O8 625518.897 4864620.423 385.756 385.722 0.034 L2T9 621174.012 4864494.226 388.359 388.470 -0.111 L2T10 620283.975 4857065.579 386.810 387.048 -0.238

LiDAR Project ActivitiesWinona County Validation Report

Op

en

Tall

gra

ss

Bru

sh

Fo

rest

ed

Urb

an

Ove

rall

RMSE across cover Types

Page 15: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data15

LiDAR Project ActivitiesWinona County Validation Report

-0.5

-0.4

-0.3

-0.2

-0.1

0

0.1

0.2

175 225 275 325 375 425

Vertical Error Distribution

L1O

L2T

L3B

L4F

L5U

Credit – Tim Loesch - MNDNR

Accuracy Comparisons

NMASContourInterval

NMAS90%Conf

NSSDA95%Conf

NSSDARMSEz

2’ 1’ 1.2’ 0.6’18.5 cm

4’ 2’ 2.4’ 1.2’37.0 cm

Accuracy and What it Means…

National Accuracy Standards Specifications

USGS Base LiDAR Specifications V13

NDEP Guidelines For Digital Elevation Data

LiDAR SystemLimitations

Cannot penetrate:

○ Water (near-infrared Lasers)

○ Heavy canopy cover

○ Rain, snow, clouds

Limited window of opportunity to collect

○ Vegetation and snow free periods in the spring and fall

○ Flooding is bad too!

○ High winds hinder collection

End of Lecture 2Questions/Comments?

Lecture 3 – LiDAR Applications and Products

Credit – ESRI

Page 16: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data16

Potential LiDAR ApplicationsWater Resources

Floodplain mapping

Storm water management

Drainage basin delineation

Shoreline erosion

Geology Sinkhole identification

Geologic/geomorphic mapping

Transportation Road and culvert design

Cut and fill estimation

Archaeological site identification

Agriculture Erosion control structure design

Soils mapping

Precision farming

Water Quality

Watershed modeling

Wetland reconstruction

Land cover/land use mapping

Forestry

Forest characterization

Fire fuel mapping

Fish and Wildlife Management

Drainage and water control

Walk-in Accessibility

Habitat Management

Emergency Management

Debris removal

Hazard Mitigation

Credit – Tim Loesch – MN DNR

Hurricane KatrinaHurricane Katrina LIDAR –Emergency Management

• How much debris and where?

• Volume cut/fill statistics

• Aid Debris Removal

LIDAR• May 2004 –

Pre-Ivan

LIDAR• May 2004 –

Pre-Ivan• September

2004 –Post-Ivan

Page 17: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data17

LIDAR• August

31st, 2005 –Post-Katrina

LIDAR

LiDAR Applications

StructuralAnalyses

VegetativeAnalyses

Bare EarthAnalyses

Courtesy of Dodson & Associates

Bare Earth, Vegetative, and Structural Applications

Bare Earth Analysis

• Buildings and trees removed

• Automatic and manual filtering

• Shows bare earth surface DEM

• Provides elevation “base layer” for further calculations

Bare Earth –Top: Digital Surface Model (DSM)Bottom: Digital Elevation Model (DEM)

Credit – Tim Loesch - MNDNR

Page 18: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data18

Bare Earth – Example of Removing Artifacts

Initial Bare Earth Surface from LiDAR

Credit – Tim Loesch - MNDNR

Bare Earth –

Filtered Bare Earth Surface

3/27/2012 MN GIS/LIS Fall Workshops Slide courtesy of Sanborn

Bare Earth –Contours – Initial Bare Earth Surface

Credit – Tim Loesch - MNDNR

Bare Earth –Contours - Filtered Bare Earth Surface

Credit – Tim Loesch - MNDNR

Terrain Analysis

Model real landscape processes

Utilize base layer DEM

Credit – Adam Birr – MN Department of Agriculture

Hydrologic Modeling

Identify appropriate water conveyance

Watersheds

Page 19: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data19

Credit – Tim Loesch - MNDNR

Vegetation – Canopy Height Vegetation - Hillside with deciduous vegetation

Credit – Tim Loesch - MNDNR

Vegetation - Profile of points

DeciduousDeciduousConiferous

Credit – Tim Loesch - MNDNR

Crownbase height

Credit – Tim Loesch - MNDNR

Credit – Tim Loesch - MNDNR

Structures - Lidar Point Cloud First Return Digital Surface Model (DSM)

Credit – Tim Loesch - MNDNR

Page 20: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data20

Bare Earth DEM (no vegetation or buildings)

Credit – Tim Loesch - MNDNR

Difference Image – height of buildings and trees

Credit – Tim Loesch - MNDNR

Software

Credit – Tim Loesch - MNDNR

Software ArcGIS, IDRISI, Open Source GIS viewers

ArcHydro

TauDEM

LAS Reader

○ ArcMAP Extensions

LiDAR Analyst, LP360, etc

○ Stand-Alone Programs

MARS

AutoCAD

○ Civil 3D

Stand-Alone Viewers (free)

○ Qcoherent (www.qcoherent.com)

○ Fugro EarthData (www.fugroviewer.com)

○ Sanborn (http://www.sanborn.com/technologies/lidar.asp)

Software – Training Purposes

ESRI – ArcGIS

Spatial Analyst

○ Hydrologic modeling

○ Raster analysis

3D Analyst (ArcScene, ArcGlobe)

○ Cut/Fill

○ Line of Sight

○ 3D Perspective

Spatial AnalystESRI Extension – Additional cost

Fairly robust set of general raster processing tools

Surface (Slope, Curvature)

Reclassify

Zonal Statistics

Conditional

Neighborhood

Raster Calculator

Some specialized tools

Hydrology

Groundwater Credit – Steve Kloiber - MNDNR

Page 21: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data21

3D Analyst

ESRI Extension –Additional cost

Specifically designed for elevation data

3D visualization

Creating & working with TINs

Cross-section tool

Credit – Steve Kloiber - MNDNR

ArcHydro Free Extension for

ArcGIS(Maidment)

Suite of tools for geospatial hydrology

Semi-complicated install

Terrain analysis focused on stream and watershed delineation

Tools for analyzing sinks and reconditioning DEM

AGREE

Credit – Steve Kloiber - MNDNR

Tau DEM Free toolbox for

ArcGIS 9.3 (Tarboton)

Easy install

Specialized terrain analysis tools focused on stream and watershed delineation

Tools not found in the standard ArcGISextensions or ArcHydro

D-infinity flow direction

Credit – Steve Kloiber - MNDNR

Whitebox GAT Free stand alone

program (Lindsay)

Open source

Fairly robust suite of terrain analysis tools

Handles LAS data (LiDAR)

Many hydrologic analyses

Uses Python as native language

Credit – Steve Kloiber - MNDNR

Getting Ready for LiDAR – Hardware

Bigger is better

Workstations

○ Duo or Quad Core

○ > 3.0ghz

○ > 4Gb RAM

○ 256 RAM Display OPEN GL

High Speed disks – storage is cheap

External hard drive for backup

LiDARRepresentations

Credit – Tim Loesch - MNDNR

Page 22: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data22

LiDAR Representations

Point Cloud

Triangulated Irregular Network (TIN)

Raster – DEM

Vector – Contours

Terrain

Credit - USGS

Bare Earth Filtering

Credit – Tim Loesch - MNDNR

Bare Earth vs. First Return

Credit – Grit May - IWI

LiDAR Representations

Point Cloud

Triangulated Irregular Network (TIN)

Raster – DEM

Vector – Contours

Terrain

Credit - USGS

TIN Triangles Hillshaded andColored by Elevation

Credit – USGS Credit – Tim Loesch - MNDNR

TIN – With Breakline enforcement

Page 23: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data23

LiDAR Representations

Point Cloud

Triangulated Irregular Network (TIN)

Raster – DEM

Vector – Contours

Terrain

Credit – USGS Credit – USGS

Interpolating to Raster

LiDAR Representations

Point Cloud

Triangulated Irregular Network (TIN)

Raster – DEM

Vector – Contours

Terrain

Credit – Tim Loesch - MNDNR

Vector Contours

Contours

Interpolation process

LiDAR Representations

Point Cloud

Triangulated Irregular Network (TIN)

Raster – DEM

Vector – Contours

Terrain

Credit – Tim Loesch - MNDNR

Terrain Data Structure• Data structure specific to elevation data• TIN model represents surfaces• Terrains use pyramids to represent multiple

levels of resolution• Data Inputs

Mass Points – TIN

Breaklines

• Data Outputs TINS

Rasters

Credit – Grit May, IWI

Page 24: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data24

Credit – Tim Loesch - MNDNR

LiDAR Products

• Several file types and derivative products available to end-users

• LAS point cloud, DEM, contours, hydrologic breaklines, etc.

LiDAR Additional ProductsBreaklines

Breaklines identify changes in landscape elevation

○ Too small or continuous to be reliably recorded with LiDAR

○ Stream banks, curbs, centerlines, water/land interface

Used to influence interpolation for contours

Can help enforce stream and lake elevations

Generated from Air Photos

LiDARGrammetry

LiDARGrammetry

○ Classify points by intensity

○ Trace around water intensity values to create a contour

Credit – Penn State

Breaklines

Note Water Elevation Change

Credit – Tim Loesch - MNDNR

Breaklines

Credit – Tim Loesch - MNDNR

MN LiDAR Data Delivery

Credit – Tim Loesch - MNDNR

Page 25: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data25

MN LiDAR Data Delivery

What Data Do People Use? Primary use products

○ Raster Digital Elevation Model

○ Contours

Most consumers don’t bother with the raw LiDAR data

○ Not a lot of tools available but this list is growing

○ ArcGIS extensions are now available to read LAS format LiDAR data

Derived products from LiDAR is a growing research field

MN LiDAR Data Delivery Four Ways

Data Currently Divided between Red River Valley and rest of the State

Red River Valley - Complete

○ http://gis.rrbdin.org/lidardownload/index.html

Rest of State – In Progress

○ ftp.lidar.dnr.state.mn.us

○ ftp.lmic.state.mn.us/pub/data/elevation/lidar/data

○ Interactive Beta Viewer to come April 1st – Data Services May 11th

MN LiDAR Data Delivery – Red River

Interactive Viewer

Graphically browse datasets – download customized extents

○ http://gis.rrbdin.org/lidardownload/index.html

MN LiDAR Data Delivery Format MN DNR FTP Site

ftp.lidar.dnr.state.mn.us

File Geodatabases

Data Organization Tiling Scheme

○ County

○ Project

○ Quarter quarter quarterquad (1/16th of a quad) (Raw)

Not all data types tiled the same

Size limitations

Where To Get It

What Data Type?

What Geographic

Scale?

MN DNR FTP LiDAR

Quick Download

Guide

FTP Download Site

County

DEM

Contours

Lidar.state.mn.us/

data/county

Smaller

DEM

Contours

Bare Earth Points

Lidar.state.mn.us/

data/raw/county

MN LiDAR Data Delivery Format MN GEO (formerly LMIC) FTP

Site

ftp.lmic.state.mn.us/pub/data/elevation/lidar/data

File Geodatabases

Data Organization

Tiling Scheme

○ County

○ Project

○ Quarter quarter quarter quad (1/16th of a quad) (Raw)

Not all data types tiled the same

Size limitations

Page 26: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data26

MN LiDAR Data Delivery Format MN DNR Interactive

Download and Viewer

Beta Viewer Available April 1st

Data Services Available May 11th

Mobile App Available June 1st

MN LiDAR Data Delivery Format

Things to know…

Use third party FTP Software - Filezilla

Know what you want before you download

Interactive web download page coming in near future

RTM – Read the Manual!

○ Several helpful Readme’s

MN LiDAR Data Delivery Format - LAS Files

LAS – Common LiDAR Data Exchange Format

Industry Standard

○ Easily transferred from system to system

○ Less volume and more easily transferred than ASCII

Retains flight information and instrument parameters

○ GPS, IMU, Laser Pulse Range

Current version is LAS 1.1 (5/05)

○ 1.2 has been proposed and in final review

○ 2.0 has been proposed

http://liblas.org/raw-attachment/wiki/WikiStart/asprs_las_format_v11.pdf

Delivery Format - LASLAS files

Stores a variety of point information

○ Number of returns

○ Return Number

○ Intensity

○ X,Y, Z values

○ Scan Direction

○ Classification

○ Scan Angle Rank

○ GPS Time

LAZ files = Compressed LAS files

Visualization

Credit – Tim Loesch - MNDNR

Visualization

Lidar data can be visualized a number of ways Shaded Relief images can reveal very subtle

relief ○ Especially with high detail data

○ Helpful for data validation and looking for anomalies and errors in the data

3-Dimensional viewing

Cross-sections

Contour generation

Triangulated Irregular Networks (TIN)

Page 27: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data27

Shaded relief imagery

3/27/2012 MN GIS/LIS Fall Workshops Credit – Tim Loesch - MNDNR 3/27/2012 MN GIS/LIS Fall Workshops Credit – Tim Loesch - MNDNR

Sinkhole

3/27/2012 MN GIS/LIS Fall Workshops

2006 color NAIP airphoto

3/27/2012 MN GIS/LIS Fall Workshops

Sinkhole

3/27/2012 MN GIS/LIS Fall Workshops

Sinkhole – Cross-section

3/27/2012 MN GIS/LIS Fall Workshops

Page 28: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data28

3/27/2012 MN GIS/LIS Fall Workshops Credit – Tim Loesch - MNDNR 3/27/2012 MN GIS/LIS Fall Workshops Credit – Tim Loesch - MNDNR

3/27/2012 MN GIS/LIS Fall Workshops Credit – Tim Loesch - MNDNR 3/27/2012 MN GIS/LIS Fall Workshops Credit – Tim Loesch - MNDNR

3/27/2012 MN GIS/LIS Fall Workshops Credit – Tim Loesch - MNDNR 3/27/2012 MN GIS/LIS Fall Workshops Credit – Tim Loesch - MNDNR

Page 29: Basics of Using LiDAR Data - Water Resources Center · 2015-05-14 · Basics of Using LiDARData 3 Raster Data Analysis - Advantages History Flexible Data structure Wide range of variables

Basics of Using LiDAR Data29

3/27/2012 MN GIS/LIS Fall WorkshopsCredit – Tim Loesch - MNDNR

Credit – Tim Loesch - MNDNR

Credit – Tim Loesch - MNDNR

Credit – Tim Loesch - MNDNR

Credit - Marvin H. Treu – University of Nebraska - Omaha

Credits/Acknowledgements

Tim Loesch – MN Dept. of Natural Resources

Sean Vaughn – MN Dept. of Natural Resources

Steve Kloiber – MN Dept. of Natural Resources

Dr. Adam Birr – MN Dept. of Agriculture

Jake Galzki – University of Minnesota

Dr. Jay Bell – University of Minnesota

Ann Lewandowski – University of Minnesota

Les Everett – University of Minnesota