![Page 1: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/1.jpg)
Image Segmentation and Classification in ArcGIS ProHua Wei
Gerry Kinn
![Page 2: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/2.jpg)
Topics
• Introductory remarks
- We will work in Pro
- Discussion on the overall process
- Architecture
- Image processing commentary
• Tools
- Segmentation
- Classification logic
• Workflows
• Closing remarks
- QA/QC commentary
- A brief look ahead
![Page 3: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/3.jpg)
Schema Considerations
The things we extract from imagery
Set of All Features
FeaturesVisible
FeaturesOf
Interest
Features Available
to Work with
![Page 4: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/4.jpg)
Choosing the correct schema
• The most important choice you can make is the optimal schema
• Existing schemas – Anderson, NLC, etc.
• You can create your own
- Be aware of separable features
- Understand semantic labels and their relationships
- 1 1
- many 1
- Consider collaborator needs
- Keep it simple
Level I Level II 1 Urban or Built-up Land
11 Residential 12 Commercial and Services 13 Industrial 14 Transportation, Communications, and Utilities 15 Industrial and Commercial Complexes 16 Mixed Urban or Built-up Land 17 Other Urban or Built-up Land
2 Agricultural Land 21 Cropland and Pasture 22 Orchards, Groves, Vineyards, Nurseries, and Ornamental Horticultural Areas23 Confined Feeding Operations 24 Other Agricultural Land
3 Rangeland 31 Herbaceous Rangeland
![Page 5: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/5.jpg)
The second most important choice is process designFind the processing that enhances your desired features
• Machines learn best when the features are clearest
• Choose your extraction paradigm
- Not all features are spectrally distinct
- If your schema calls for objects, consider segmentation
- If your features are set on a background, minimize the background
- Consider if you want to extract a feature (or few) at a time or all at once
- Consider image processing to mitigate lighting, maximize vegetation, etc
- Can you use other GIS data, preprocessed or post?
• Build your input image stack
• Consider post extraction labeling and filtering
![Page 6: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/6.jpg)
Choose your data carefullyOptimize your data if possible
• Choose your best sensor
• Optimize for seasonality and phenomenology – timing is key
• Process effectively
- Normalize for sensor anomalies
- Understand your radiometry
- Minimize any variation in your datasets
Autumn
Winter
SummerSpring
![Page 7: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/7.jpg)
SegmentationPreserving the object edges
• This technique helps
- preserve edges of objects
- Provides object specific values
• A pre-processing step
• Needs to be tuned to the production requirements
![Page 8: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/8.jpg)
SegmentationSupporting Text
![Page 9: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/9.jpg)
Concept Diagram
Artificial Intelligence Remote Sensing
Machine Learning Image Classification
![Page 10: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/10.jpg)
Supervised Image Classification
10
Input Image Segmenter Segmented Image
Training Samples
ClassifierClassified Image
Accuracy assessment
Generate training& inspect *
Mean Shift Segmentation
Maximum Likelihood Support Vector Machine
Random Trees
Train Test/Classify.ecd
* in development
![Page 11: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/11.jpg)
Supervised ClassificationSupporting Text
![Page 12: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/12.jpg)
Unsupervised Image Classification
12
Input Image Segmenter Segmented Image
Classifier Classified Image
Accuracy assessment
ISOData
Human Labels Reclassify
Classified Image
![Page 13: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/13.jpg)
Unsupervised ClassificationSupporting Text
![Page 14: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/14.jpg)
Support in different ArcGIS processing frameworks
On-the-fly Processing Geoprocessing Raster Analytics
Segment √ √ √
Train √ √
Classify √ √ √
![Page 15: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/15.jpg)
SummarySegmentation – Classification
• This is a comprehensive processing suite of tools
• It is based on both RFF and GPF
• It provides segmentation capabilities
• Traditional and machine learning classifiers
![Page 16: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/16.jpg)
Please Take Our Survey on the Esri Events App!
Select the session you attended
Scroll down to find the survey
Complete Answersand Select “Submit”
Download the Esri Events app and find
your event
![Page 17: Image Segmentation and Classification in ArcGIS Pro · 2017-08-14 · Image Segmentation and Classification in ArcGIS Pro Hua Wei ... 12 Commercial and Services 13 Industrial 14 Transportation,](https://reader031.vdocument.in/reader031/viewer/2022011912/5fa595bcf412c61d016b10aa/html5/thumbnails/17.jpg)