managing imagery and raster data using mosaic datasets
DESCRIPTION
2013 Esri International User Conference July 8–12, 2013 | San Diego, California. Technical Workshop. Managing Imagery and Raster Data Using Mosaic Datasets. Hong Xu, Prashant Mangtani. Presentation Overview. Introduction to mosaic datasets Build a mosaic dataset - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/1.jpg)
Esri UC2013 . Technical Workshop .
Technical Workshop
2013 Esri International User ConferenceJuly 8–12, 2013 | San Diego, California
Managing Imagery and Raster Data Using Mosaic Datasets
Hong Xu, Prashant Mangtani
![Page 2: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/2.jpg)
Esri UC2013 . Technical Workshop .
Presentation Overview
• Introduction to mosaic datasets
• Build a mosaic dataset
• Design and serve mosaic datasets in your organization
• Maintain and update
• Q&A
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 3: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/3.jpg)
Esri UC2013 . Technical Workshop .
Why Mosaic Dataset?
• A lot of images- Ortho images, DEM, scanned maps ->mosaic- Sensor images -> process- Manage and catalog-> search and retrieve
Managing Imagery and Raster Data Using Mosaic Datasets
• Advantages- Store efficiently (reference images)- Process fast (on-the-fly)- Scalable- Search easily (selection and query)- Update easily- Multiple clients
![Page 4: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/4.jpg)
Esri UC2013 . Technical Workshop .
Mosaic Dataset - Storage
• A model in geodatabase
• Stored as set of tables- Footprint table references source images- Boundary, Seamlines- Raster type, color correction
• Displayed as a composite layer in Map- Boundary- Footprint- Image
Mosaic Dataset
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 5: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/5.jpg)
Esri UC2013 . Technical Workshop .
Mosaic Dataset – Mosaic Method
• Mosaic method to set the display order- North west (default)- Closest to center - By attribute- Closest to nadir- Seamline
• Mosaic operator to resolve the overlaps- First/Min/Max/Mean/Blend
Closest to the center
By attribute: cloud cover
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 6: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/6.jpg)
Esri UC2013 . Technical Workshop .
Mosaic Dataset – Overviews and Visibility
OID Shape Raster Name MinPS MaxPS LowPS HighPS Category …
1 Polygon <Raster> P01.met 0 40 1 4 Primary
2 Polygon <Raster> P02.met 0 40 1 4 Primary
3 Polygon <Raster> filename1.tif 40 400 40 40 Overviews
4 Polygon <Raster> filename2.tif 40 400 40 40 Overviews
5 Polygon <Raster> Filename3.tif 400 4000 400 400 Overviews
• Overviews are resampled rasters added in the footprint table
• Increase visible range of mosaic dataset
• Fast image display at all levels of details
• MinPS and MaxPS define the visible range of items
Managing Imagery and Raster Data Using Mosaic Datasets
Cell size = 500
Cell size=50
![Page 7: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/7.jpg)
Esri UC2013 . Technical Workshop .
Use of Mosaic Dataset
• Produce orthorectified seamless mosaic product- Ortho quad products (7.5 or 3.75 minutes) using Split Raster tool
• Use as an input in raster analysis
• Manage and catalog images- Query and search- Time aware
• Publish as image service for web- Seamless mosaic and image catalog
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 8: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/8.jpg)
Esri UC2013 . Technical Workshop .
Mosaic Dataset Basics
Demo
![Page 9: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/9.jpg)
Esri UC2013 . Technical Workshop .
Build a Mosaic Dataset
• Getting data to mosaic dataset- Create a mosaic dataset- Adding rasters
• Editing rasters in mosaic dataset
• Making mosaic dataset look good
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 10: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/10.jpg)
Esri UC2013 . Technical Workshop .
• Define spatial reference- Spatial reference defined in your organization- Web Mercator
• Number of bands and pixel types
• Product definition- Used for automatic band matching- Examples: RGB, RGBI, Landset, etc
Creating a Mosaic Dataset Create Mosaic Dataset tool - Create footprint table
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 11: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/11.jpg)
Esri UC2013 . Technical Workshop .
• Defines what data to add- Processing template- Construct a raster function- Fields for footprint table
- Sensor, CloudCover, etc.
• Examples:- Raster Dataset, NITF, QuickBird etc
• Raster types for sensor images- Use DEM for orthorectification- Use Gram-Schmidt for pansharpen
Adding Rasters – Raster Type
Managing Imagery and Raster Data Using Mosaic Datasets
Add Rasters to Mosaic Dataset tool - Populate field values
![Page 12: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/12.jpg)
Esri UC2013 . Technical Workshop .
• Raster field contains processed raster- Created by applying raster function at run time
• Raster function- Defines a processing algorithm- Input images, parameters
• Process pixels on-the-fly
Adding Rasters – Raster FunctionPopulate values for raster field
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 13: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/13.jpg)
Esri UC2013 . Technical Workshop .
• Pyramids- Speed up raster display
• Statistics- Used in raster function
Statistics and Pyramids of Source Images
Source raster Processed raster
Managing Imagery and Raster Data Using Mosaic Datasets
Build Pyramids and Statistics tool
• Calculate before adding data from a folder
• Tips- No need to calculate statistics on processed images- Pyramids speed up statistic calculation of large skip factor- Skip factor should be 2x2 for Gram-Schmidt pansharpen raster
![Page 14: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/14.jpg)
Esri UC2013 . Technical Workshop .
• MinPS and MaxPS define the visibility of these rasters
• Calculated based on resolutions and overlaps- Default cell size range factor is 10
• Can be set using field calculator
Calculate Mosaic Dataset Item VisibilityUsing Calculate Cell Size Ranges tool
OID Shape Raster Name MinPS MaxPS LowPS HighPS Category …
1 Polygon <Raster> P01.met 0 400 10 40 Primary
2 Polygon <Raster> P02.met 0 400 10 40 Primary
5 Polygon <Raster> filename1.tif 400 4000 400 400 Overviews
5m visible range 0-50
1m visible range 0-5
5-30
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 15: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/15.jpg)
Esri UC2013 . Technical Workshop .
Build a Mosaic Dataset
• Adding data to mosaic dataset
• Editing rasters in mosaic dataset- Georeferecing- Footprint- Raster function
• Make mosaic dataset look good
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 16: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/16.jpg)
Esri UC2013 . Technical Workshop .
Refine Mosaic Dataset Georeferencing
• Apples to certain data where georeferencing is not precise
• Automatic image registration
• Register Raster tool- Takes mosaic dataset as input- Matching each item to a given target
- Use world imagery on ArcGIS Online as target
- Matching MS to Pan of the pansharpen rasters
Using Register Raster tool
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 17: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/17.jpg)
Esri UC2013 . Technical Workshop .
• Build Footprints- Optionally edit using Editor- Optionally import from an external file - black pixels excluded
• NoData tool- Based on a value or a range- Nodata pixels included
• ArcMap’s Editor to edit
Handling the Image BackgroundUse Build Footprints and Set NoData tools
Use footprint
Use NoData
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 18: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/18.jpg)
Esri UC2013 . Technical Workshop .
• Define the boundary of the mosaic dataset- Pixels outside the boundary will be clipped
Build BoundaryBuild Boundary tool
Managing Imagery and Raster Data Using Mosaic Datasets
• Automatically generated based on footprints- Can be modified using Editor- Import Mosaic Dataset Geometry tool
![Page 19: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/19.jpg)
Esri UC2013 . Technical Workshop .
• Edit mosaic dataset or one item- From function tab
• Edit multiple items - Make a selection- using raster function batch editor
• The Edit Raster Function tool- For editing item (s) or mosaic dataset
Refine RadiometryInsert, remove, edit raster function
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 20: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/20.jpg)
Esri UC2013 . Technical Workshop .
Mosaic Dataset – Merge Items
• Merge multiple mosaic dataset items into one
• Applies to certain cases- Merge images of same metadata
- IKONOS case- Option in the raster type
- Reduce table size/ Remove slivers- Avoid merging large number of terms
Merge Mosaic Dataset Items tool
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 21: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/21.jpg)
Adding data
Demo
![Page 22: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/22.jpg)
Esri UC2013 . Technical Workshop .
Build a Mosaic Dataset
• Adding data to mosaic dataset
• Edting rasters in mosaic dataset
• Make mosaic dataset look good- Color correction- Seamlines- Overviews
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 23: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/23.jpg)
Esri UC2013 . Technical Workshop .
• Statistics in multiple places- Source raster dataset- Mosaic dataset item (processed raster)- Mosaic dataset
• Use Build Pyramids and Statistics tool- Input is a mosaic dataset- Required by color correction operation
Calculate Statistics for the ItemsUse Build Pyramids and Statistics tool
Source raster Processed raster Mosaic dataset
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 24: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/24.jpg)
Esri UC2013 . Technical Workshop .
• Based on a calculated color surface- Single color, color grid- First, second, third polynomial
• Based on an existing target raster- World imagery service
• Support excluded area
Color Correcting Mosaic DatasetUse Color Balance Mosaic Dataset tool or Color Correction window
Before After
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 25: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/25.jpg)
Esri UC2013 . Technical Workshop .
• A feature class stored in the seamline table
• Generate seamlines automatically
• Edit and import seamlines
Building SeamlinesUse Build Seamlines tool
1 2
Managing Imagery and Raster Data Using Mosaic Datasets
• Used by Seamline mosaic method- Blend along the seamlines with a
default width
• Define Seamline as default method from mosaic dataset property page
![Page 26: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/26.jpg)
Esri UC2013 . Technical Workshop .
Using Build Overviews tool
Building Overviews
• Build Overviews tool create images with default- TIFF with JPEG compression- Size of 5120x5120- Factor of 3
• Use Define Overview tool to refine the parameters
• Add a raster dataset as an overview- Create a tile cache using Manage Tile Cache tool and
as an overview
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 27: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/27.jpg)
Esri UC2013 . Technical Workshop .
• Identify errors and provide performance tips- Check raster- Check footprint geometry- Check function chain- Check broken path- Performance- etc.
• Recommended for publishing as image services
Analyzing Mosaic DatasetsUsing Analyze Mosaic Dataset tool
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 28: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/28.jpg)
Make mosaic look good
Demo
![Page 29: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/29.jpg)
Esri UC2013 . Technical Workshop .
• Update existing items- Any change in source images- Any change in rasters- Option to maintain the existing fields
• Add new rasters• Remove items of broken source
• Data must be added from folder mosaic datasets
Updating and Synchronizing Mosaic DatasetUsing Synchronize Mosaic Dataset GP tool
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 30: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/30.jpg)
Esri UC2013 . Technical Workshop .
Moving Mosaic Dataset
• Copy from OS- Copy the file mosaic dataset ( or .gdb)- Copy the source and overview images- Repair path using Repair dialog
- Or Repair Mosaic Dataset Paths GP tool
- Auto repair capability
-Use Distributed Geodatabase toolbar- Extract all or a portion to a designated folder and .gdb- Source files and overview copied- Path repaired
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 31: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/31.jpg)
Esri UC2013 . Technical Workshop .
• Capabilities- Mosaicking, catalog
- Mensuration, editing
Publish Image Services
Managing Imagery and Raster Data Using Mosaic Datasets
• Parameters- Transmission format (JPEG, LZ77/LERC)
- Mosaic methods
- etc
• Server raster functions- Register using function template
- response to client’s request- server side on-the-fly image
processing
![Page 32: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/32.jpg)
Esri UC2013 . Technical Workshop .
• Source mosaic dataset- References source images
• Reference mosaic dataset- References an external mosaic- Read only - Multiple views of source mosaic
• Derived mosaic dataset- Table type to copy rows
- Raster Dataset type add as one row
• Support update mechanism
Reference and Derived Mosaic DatasetsCreate Reference Mosaic Dataset tool
Managing Imagery and Raster Data Using Mosaic Datasets
CloudCover <10%
Boundary = My County
county1
State
county2
![Page 33: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/33.jpg)
Esri UC2013 . Technical Workshop .
Designing Mosaic Datasets
• Source mosaic dataset contains similar type
• Elevation• Ortho images of same date• QuickBird, IKONOS• Landsat 5 or 7
• Derived mosaic datasets
• Centralize your data
• Referenced mosaic datasets
• Multiple products
• Protect your data
Managing Imagery and Raster Data Using Mosaic Datasets
• Use server raster function
• Reduce the number of services
• Build server side processing Applications
![Page 34: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/34.jpg)
Publish Mosaic Dataset as an Image Service
Demo
![Page 35: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/35.jpg)
Esri UC2013 . Technical Workshop .
What is New for Mosaic Dataset in 10.2• Support more raster types
- Landsat 8, SPOT 6, DMCii, Pleiades-1, Socet Set (.sup file)
- Raster Types for Chinese Satellite Imagery - ZY-3, ZY-1 02C, HJ 1A/1B
- free plug-in
• Local function- Logical, conditional, mathematical operations
• New tools- Merger Mosaic Dataset Items
- Split Mosaic Dataset Items
- Compute Pan-sharpening Weights
• Search Imagery• Based on key properties (sensor name, cloud cover, etc.)
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 36: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/36.jpg)
Esri UC2013 . Technical Workshop .
Summary
• Mosaic dataset is an effective model to manage large image collections
• Workflows and tips of building mosaic datasets
• Using source mosaic dataset, derived mosaic dataset, reference mosaic dataset, and server raster functions to manage and publish data in your organization
• Additional resources:- http://resources.arcgis.com/en/communities/imagery/
- Imagery tutorial
- Image management workflows (topics and scripts)
- http://blogs.esri.com/Dev/blogs/imagery/default.aspx
- Image blogs
Managing Imagery and Raster Data Using Mosaic Datasets
![Page 37: Managing Imagery and Raster Data Using Mosaic Datasets](https://reader035.vdocument.in/reader035/viewer/2022062217/56812bc6550346895d901151/html5/thumbnails/37.jpg)
Esri UC2013 . Technical Workshop .
Please fill out the session evaluation
Offering ID: 1560
Online – www.esri.com/ucsessionsurveys
Paper – pick up and put in drop box
Thank you…