bringing hyperspectral imaging into the mainstream · the number of proven indices has surpassed...
TRANSCRIPT
Bringing Hyperspectral Imaging
Into the Mainstream
Rich Zacaroli
Product Line Manager, Commercial Hyperspectral Products
Corning Advanced Optics
August 2018
© 2018 Corning Incorporated .© 2018 Corning Incorporated
Corning Incorporated is one of the world’s leading innovators in materials science. For more than 165
years, Corning has applied its unparalleled expertise in glass science, ceramics, and optical physics to
develop products and processes that have transformed industries and enhanced people’s lives.
Founded:
1851
Headquarters:
Corning, New York
Employees:
~46,000 worldwide
2017 Core Sales:
$10.3 billion
Fortune 500 Ranking (2018):
293
3Advanced Optics © 2018 Corning Incorporated
Corning has a proven track record of innovation
2012Ultra-Slim
Flexible Glass
2000Low-Density
LCD Glass
2013All-Optical
Converged
Cellular &
Wi-Fi Solution
Antimicrobial
Glass
2016High-Transmission
Light-Guide Plate
for LCD Displays
Advanced
Glass for
Wearables
Gasoline
Particulate
Filters
2017Damage-Resistant
Pharmaceutical
Glass Packaging
Ultra-Bendable
Optical Fiber
2007Tough, Thin
Cover Glass
for Mobile
Devices
2015Light, Tough
Automotive
Glass
2006High
Throughput
Cell Culture
Solutions
1982Liquid Crystal
Display Glass
1877Signal Lenses
1879Glass Bulb
for Edison’s
Electric Light
1912Railroad
Lanterns
1915Heat-Resistant
PYREX®Glass
1935Hale
Telescope
Mirror
1947Television
Picture Tube
Processes
1952Glass-Ceramics
1964Fusion
Overflow
Process
1970Low-Loss
Optical Fiber
1972Ceramic
Substrates
for Catalytic
Convertors
1932High-Purity
Fused Silica
1934Silicones
1961Space
Window Glass
4Advanced Optics © 2018 Corning Incorporated
Presentation Agenda
• Practicalizing hyperspectral imaging
• Use cases
• Corning Hyperspectral Products
5Advanced Optics © 2018 Corning Incorporated
Hyperspectral vs. Multispectral Imaging Technology
• Spectroscopy is the branch of science concerned with the
investigation and measurement of spectra when matter
reflects electromagnetic radiation.
• Hyperspectral imagers (HSI) cover many dozens to hundreds
of spectral bands contiguously
• Multispectral imagers (MSI) cover a selected set of bands
non-contiguously• Spectral information critical for research and development
applications may be missing
• Number of spectral bands is insufficient to address multitude of
developed and proven applications
• Ease of deployment and low cost makes MSI attractive for
many applications
• A product that can be both HSI and MSI and is reasonably
priced provides high flexibility for research and practical
applicationsSource: NASA (public domain information)
Reflected
Energy
Absorbed
EnergyTransmitted
Energy
6Advanced Optics © 2018 Corning Incorporated
Spectral Data Cube Formation
• High performance hyperspectral sensors are scanning instruments• In an airborne application the spectral data cube is formed using
aircraft motion
• In a field application a rotational stage may be used to form a spectral
data cube by scanning the HSI camera
• In a laboratory or field application a linear stage is used to translate
the subject matter across the camera field-of-view
• In an in-line processing environment the product is scanned as it is
moving along a conveyor
7Advanced Optics © 2018 Corning Incorporated
What is driving the need for Hyperspectral Sensors?Four main points…
• All new applications and indices are developed using hyperspectral imagery
data, and are often simplified for MSI
• The number of proven vegetation indices has surpassed the capability of
multispectral sensors
• New algorithms/applications are being developed that use the entire
spectrum to increase probability of detection, identification, and classification
• The size, weight, and cost of hyperspectral imaging sensors and systems
now approaches higher end multispectral sensors and systems
8Advanced Optics © 2018 Corning Incorporated
The number of proven indices has surpassed capability of MSI sensors
• ENVI incorporates 60 vegetation indices for:• Broadband Greenness
• Narrowband Greenness
• Canopy Nitrogen
• Canopy Water Content
• Dry or Senescent Carbon
• Leaf Pigments Light Use Efficiency
• New vegetation indices are expanding beyond the
visible-near-IR spectrum (> 1000 nm)
• ENVI also incorporates non-agriculture applications
44+ spectral
narrow bands
60 vegetation
indices
…are used to generate…
9Advanced Optics
Use of the entire spectrum increases probability of detection, identification, and classification(Imagery from Corning® microHSI™ 410 SHARK provided by MTSI, Inc.)
Healthy Vegetation
Dark Vehicle Paint
Gravel
Vehicle Glass
10Advanced Optics © 2018 Corning Incorporated
Size, weight, and cost of hyperspectral imaging sensors and systems now
approaches higher end multispectral sensors and systems
1
10
100
1000
# of spectral bands
Weight (grams)
Volume (cm2)
Estimated price
Corning microHSI 410 Sensor Tetracam mini MCA-6 Tetracam mini MCA-12 Sequoia Parrot
Hyperspectral
cameras can cost
less than the most
capable MSI
cameras
Hyperspectral
cameras provide
higher spectral
performance and
flexibility compared to
MSI cameras
Hyperspectral cameras
are comparable in size
and weigh less than the
most capable MSI
cameras
(Comparisons based on published information)
11Advanced Optics © 2018 Corning Incorporated
Integrated Airborne Hyperspectral System Miniaturization(Images are approximately to scale)
2008 2013 2018
Now
adaptable
to small
UAS!
> One order of
magnitude cost
reduction!
12Advanced Optics
Hyperspectral Imaging Use Cases
13Advanced Optics © 2018 Corning Incorporated
Crop Growth and Health Assessment/Management
• Enables the evaluation of vegetation stress, often before it is visible to the human
eye or with other sensors
• Enables the visualization of change in crop growth and health, and yield
prediction throughout the growing season
Early season Late season Post-harvest
Early stage or stressed Late stage/ robust growth
14Advanced Optics © 2018 Corning Incorporated
Seed Performance Analysis
• Hyperspectral imagery enables the evaluation of crop performance for different seed stocks
• The below spectral map clearly shows defined boundaries for three different Roma tomato stocks
and crop performance.
July 31 Survey
---------Seed stock #1-------- --Seed stock #2-- ---Seed stock #3----------
15Advanced Optics © 2018 Corning Incorporated
Native Virginia Forest(Data collected by MTSI with Corning ® microHSI™ 410 SHARK)
Modified
Red Edge
NDVI
Red Green
Ratio Index
RGBGeo-
referenced
Water Band
Index
16Advanced Optics © 2018 Corning Incorporated
Nitrogen Fertilization Recommendation
Nitrogen Fertilization
Recommendation
(kg/ha)
17Advanced Optics © 2018 Corning Incorporated
Augmentation/Replacement of Manual Processes
• HSI applications that replicate results
obtained using reliable and stable
processes that:• Are labor intensive
• Cost of equipment is high
• Successful implementation can
significantly reduce operating costs
• Co-develop with University Research
Centers• Often leveraging grant funding
18Advanced Optics © 2018 Corning Incorporated
Coastal and Fresh Water Lake Environmental Surveys
• Corning Hyperspectral System was flown on UAV over
shallow reef, sea grass in Florida Keys for climate
change assessment (2014)
• Corning Hyperspectral System was deployed on ISS
for sea environment assessments (2009-2014)
• Corning providing equipment and funding for
detection/classification of harmful algal blooms in New
York fresh water lakes (2018)
3-band composite image over
Cheeca Rocks coral study area;
lower image used glint
reduction algorithm
3-band composite image
over seagrass study area;
lower imageused glint
reduction algorithm
(Image processing applied by University of South Florida College of Marine Science)
Hyperspectral Imager
for the Coastal Ocean
(HICO)
19Advanced Optics © 2018 Corning Incorporated
Other Remote Sensing Applications
Coastal
Contamination
Open Water
Surface Contamination
Mineral and petroleum
exploration
(Public domain images)
20Advanced Optics © 2018 Corning Incorporated
Applications in Health and Medicine
• Cancer detection and comparison with pathological
results
• Studies underway for detection of sepsis
• Positive indications
• Moving into clinical trials
• Requires exploitation of the entire spectrum,
not just selected bands
21Advanced Optics © 2018 Corning Incorporated
Industrial Processing Applications
22Advanced Optics © 2018 Corning Incorporated
Corning® microHSI™ 410 Family of Products
410 Sensor
410 Application Development Kit
(ADK)Selectable Hyperspectral
Airborne Remote Sensing Kit (SHARK)
Spectrometer Sub-AssemblySpectrometer Core
23Advanced Optics © 2018 Corning Incorporated
Introduction to Corning® MicroHSI™ 425 Sensor
• World’s first commercially available hyperspectral sensor
covering entire visible range through extended short
wave infrared range from 400nm to 2500nm in a single
high spatial resolution (640 spatial pixels) sensor• One focal plane array
• One optical path
• 460 spectral bands
• Lower size, weight and power than two sensor
configuration• 2.4 kg (5.3 lb), 35 watts
• Eliminates need for precise alignment of focal length and
field-of-view of two sensors, and a more complicated
mechanical and electrical integration
microHSI™ 425 Sensor
False color image from microHSI™ 425 Sensor