applications of hyperspectral imaging from planetary ... · the university of leicester space...
TRANSCRIPT
Hyperspectral Imaging
1
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Applications of Hyperspectral Imaging from Planetary Science Through to
Healthcare
Professor Mark Sims
Space Research Centre Department of Physics and Astronomy
University of Leicester
Hyperspectral Imaging
2
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Talk Purpose: General Introduction (aimed especially at non-specialists) Overview of Applications + Introduction for more specialist papers to follow Space Research Centre: Applications of Hyperspectral Imaging Talk Contents: Space Research Centre: University of Leicester Hyperspectral vs Multispectral Imaging Hyperspectral Imaging Data Hyperspectral Techniques Hyperspectral Applications Planetary Science Healthcare Concluding Remarks
Talk Contents
Origins …
1960
Univ. Leicester Space Research Group established by Royal Society grant of £13,006
“to study solar and stellar X-ray emissions”
To the present … 2011
Instrumentation development for High Energy Astrophysics, Planetary Exploration, Earth Observation Science, and Knowledge Exchange Total grant and contract portfolio ~£20M
Space Research Centre
The University of Leicester Space Research Centre • ~100 staff and postgraduate students, housed in purpose-built accommodation • Recent expansion: 550 sq.m Michael Atiyah Building Annexe (MAB Phase-3) – occupied November 2010 • Diversified funding for 5 current space projects and for laboratory programme in detectors and optics • Nationally recognised for Knowledge Exchange • Partnerships with National (e.g Astrium) and Regional (e.g Magna Parva) Industry • Interacting with the ESA Centre and Harwell ISIC •Three associated spin-off companies, plus G-STEP, Space IDEAS Hub • Partner in NERC/TSB Centre for Earth Observation Instrumentation
Synergy – Connecting the Areas of the Space Research Centre’s Programme
Science & Technology Research & Development (e.g. sensors)
Space Systems Engineering Project Management
Astrophysics Earth Observation Science
Planetary Science Knowledge Exchange –
‘Spin-Off ’ Public Outreach
Missions and Mission Proposals, October 2011
Mission Instrument Partners
JWST MIRI ESA/NASA ) Current BepiColombo MIXS ESA ) Flight EXOMARS LMC/XRF/Raman ESA ) Projects Astrosat SXT India ) Gaia Data Pipeline ESA ) Lobster All-Sky Monitor India Athena Various ESA JUICE Auroral Imager ESA Plato CCD calibration ESA LOFT Large-area detector ESA Marco-Polo-R Various ESA SVOM X-ray Telescope China /CNES XTIM/XNAV X-ray Telescope DARPA/ESA BEXUS LaBr3 Detector ESA/DLR/Swedish Space Agency Operational : Swift, XMM-Newton, Chandra, MSG I and II, (Envisat)
Hyperspectral Imaging
7
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Principles: Image a target in a number of discrete bands over a given wavelength band UV, Visible, NIR, SWIR, LWIR, (Tera-hertz) Known source, natural or artificial broad or narrow band Look at reflectance spectrum Characteristics of target change “reflected” light Unique signatures of objects, chemicals, features and substances may become
visible
Hyperspectral vs Multispectral: Multispectral: number of discrete bands not necessarily continuous coverage in
wavelength, ~>10nm width (visible) Hyperspectral: Continuous coverage high resolution ~2-5nm (visible) Can be enhanced in some cases by a wavelength tunable light source
Hyperspectral vs. Multispectral Imaging: I
Hyperspectral Imaging
8
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Issues: Large data-sets Understanding what you are seeing Analysis Expense (of system)
Advantages: Non-contact Unique signatures may present themselves Many applications
Hyperspectral vs. Multispectral Imaging: II
Hyperspectral Imaging
9
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Applications: Defence/Security Precision Agriculture Earth Resources Pollution Control Plastics/Recycling Pharma Art, Antiquities Ecology Food Forensics Healthcare Research ++……………
Hyperspectral vs. Multispectral Imaging: III
Hyperspectral Imaging
10
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Large data sets consisting of images at each wavelength band, possibly 10-100’s GB Depending on spectral and spatial resolution Each image pixel has a “n” point spectrum associated with it Data called a image cube and sometimes incorrectly a “hypercube” Complex data analysis e.g. PCA may be needed to identify “target” May need to correct for atmospheric Absorption as well illumination source spectrum Image Credit “Why Use Hyperspectral Imaging? Peg Shippert Photgrammetric Engineering and Remote Sensing, April 2004, p377
Hyperspectral Imaging Data
Hyperspectral Imaging
11
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Need to spectrally disperse data from a image pixel Need an detector (single pixel or ideally imaging 2-d array) Need to scan spatially and/or spectrally to collect full data set e.g. Whiskbroom or Pushbroom Scanning can be achieved via moving mirrors or imager Spectral dispersion can be achieved via gratings, linear variable filters, tunable band pass filters (filter wedges), spectrometers, prisms Image Credit Hyperspectrum News Letter http://www.techexpo.com/WWW/opto-knowledge/hyperspectrum/hypersp4.html (a), (b) multispectral (c), (d) hyperspectral
Hyperspectral Techniques
Hyperspectral Imaging
12
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Defence/Security Security LWIR Credit: Holma, H., (May 2011) Thermische Hyperspektralbildgebung
im langwelligen Infrarot, Photonik Remote chemical imaging of a simultaneous release of SF6 and NH3 at 1.5km
using the Telops Hyper-Cam imaging spectrometer Credit: M. Chamberland, V. Farley, A. Vallières, L. Belhumeur, A. Villemaire, J. Giroux et J. Legault, "High-Performance Field-Portable Imaging Radiometric Spectrometer Technology For Hyperspectral imaging Applications” Proc. SPIE 5994, 59940N, September 2005
Hyperspectral Applications: I
Hyperspectral Imaging
13
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Precision Agriculture
Stress detection (lack of water) via chlorophyll content (Credit: USDA, SpecTIR web site)
Earth Resources
Identification of Mineral deposits e.g USGS survey of Afghanistan (Credit USGS)
Hyperspectral Applications: II
Hyperspectral Imaging
14
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Pollution Control
Detection of pollutants e.g. oil leak Credit: http://www.resonon.com/application_ecology.html Below (Credit) from “Hyperspectral Image Analysis for Oil Spill Mitigation” F. Salem and M. Kafatos, paper at 2001 22nd Asian Conference on Remote Sensing 5-9 November 2001
Hyperspectral Applications: III
Hyperspectral Imaging
15
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Plastics/Recycling
Detection of clear plastics (Image Credit Resonon Web Site)
Pharma
Identification of Drugs, QA of Drugs (Image Credit Resonon Web Site) Near infrared identification of two different drug products.
Both appear white to the naked eye, however they can be easily distinguished using a Hyperspectral Imaging spectrograph.
Hyperspectral Applications: IV
Hyperspectral Imaging
16
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Art, Antiquities
Detection of hidden detail, potentially overcome degradation/aging of materials Detection of mold Detection of earlier works Image Credit “Quantitative Hyperspectral Imaging of Historical Documents: Technique and Applications”, R. Padoan et al. 9th International Conference on NDT of Art, Jerusalem, Israel, 25-30 May 2008
Hyperspectral Applications: V
Hyperspectral Imaging
17
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Forensics Detection of hidden evidence, body fluids, buried bodies, GSR, Forgery, Counterfeit items etc. Tunable light source may be useful Right and middle images Credit ChemImage Left image University of Leicester
Hyperspectral Applications: VI
Hyperspectral Imaging
18
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Food
Detection of mold/degradation Detection of damage e.g. bruises on fruit Classification of quality e.g. meat Image Credit “Prediction of Meat Quality: Application of hyperspectral and Raman Spectroscopy” Moss et al. Report CMS/REP/114446/1 http://www.eblex.org.uk/documents/content/research/rd_qs_b_c_fr_-_nirhyperspectralimagingtopredictbeefquality_191010.pdf
Hyperspectral Applications: VII
Hyperspectral Imaging
19
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Ecology
Land Use Change Climate Change (effects on plants, environment, estimate of carbon area index
m2m-2 , canopy water content) Detection of illegal logging Detection of disease e.g. diseased trees Detection of invasive species (plants, animals (latter if they affect plants,
environment)
Hyperspectral Applications: VIII
Hyperspectral Imaging
20
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Planetary Science : I
Detect geo-chemistry (mineralogy) of planetary surfaces Based mainly in IR as that is where key absorptions occur Data load can be a problem Currently used from Orbit
Examples CRISM NASA Mars Reconnaissance Orbiter In future on-ground e.g. MicroOmega IR hyperspectral microscope on ESA
ExoMars 2018 rover for mineral classification Note only samples top surface of any rock outcrop, question mark over how much
this represents underlying geology Need an extensive library of spectra and pattern matching
Hyperspectral Applications: IX
Hyperspectral Imaging
21
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Hyperspectral Applications: X
Planetary Science: II
Images courtesy CRISM, NASA JPL
Hyperspectral Imaging
22
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Hyperspectral Applications: XI
Images Courtesy CRISM,
NASA JPL
Hyperspectral Imaging
23
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Healthcare I
Non-invasive technique Both visible and NIR, can see into body “~700-900nm window “ Examples:
Skin Cancer Wound Healing
Many studies use limited numbers of patients University of Leicester has set up a Non-Invasive Diagnostics Development Unit (DDU) in conjunction with Leicester Royal Infirmary and Local NHS Trust to pursue start of the art techniques including hyper-spectral (visible) Based in accident and emergency resuscitation bay Want to look at real clinical use
Hyperspectral Applications:XII
Image Courtesy University of Leicester DDU
Hyperspectral Imaging
24
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Healthcare: II
Initial Study 500 patients 20 most common presenting complaints e.g. breathlessness, chest pain No hyper-spectral, but TIR Applying for ethics approval for hyper-spectral work Initial planned studies: Kidney, Liver, Bruising, Skin Lesions Data shows blood distribution using a multi-spectral imager
Hyperspectral Applications: XIII
Background
Signal
Image Courtesy University of Leicester DDU
Hyperspectral Imaging
25
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012 Healthcare: III
Hyperspectral Applications: XIV
Diagnostic Development Unit Equipment
Image Courtesy University of
Leicester DDU
Hyperspectral Imaging
26
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
General Remarks Hyper-spectral imaging is a growing area Many applications, an ever growing list Many companies related to topic now in existence: hardware, data processing and
applications Costs are reducing and it is no longer just a research or defence/security tool IR hyperspectral remains comparatively expensive Data processing can be an issue Understanding the data is needed by the user – skilled expertise may still be
needed in many applications to process and interpret the data Need other data to complement data obtained from hyper-spectral
The Future Development of further applications Growth of field and companies associated with it
Concluding Remarks
Hyperspectral Imaging
27
Updated: 11/10/12 Issue 1
Space Research Centre Copyright M.R. Sims 2012
Photonex 2012 for hosting this event Prof. Steve Marshall, Gilden Photonics Ltd. and Photonex for the invite You for attending Various companies, institutes as credited on slides for images and information University of Leicester My contact details are e-mail: [email protected] , tel: 0116 2523513
Please enjoy the Conference and Visit the Exhibitors Stands
Thank You for Listening
Acknowledgements