1
Lightning Round Talks
All Distribution A: Approved for Public Release, Distribution Unlimited.
2
George Bennett, Rice University
Project Overview
Teaming Goals
Team Strengths
Contact PALS Proposers Day
3
Rice University (J.J. Silberg, G.N. Bennett, R.Verduzco, L. Biswal, J. Robinson, B. Aazhang); LBNL (Caroline Ajo-Franklin)
[email protected]; 713 348 3849
• Our team has strengths relevant to PALS technical area 1 and some in 2, including expertise in PALS1. biological sensing: (components 1&2 in project overview panel) protein engineering (Silberg), microbiology (Bennett), exoelectrogen design (Ajo-Franklin), with some expertise related to PALS 2. (component 3) conductive materials (Verduzco/Biswal), bioelectronics nanotechnologies (Robinson), and initial signal processing (Aazhang)
Controlling exoelectrogen current production using engineered protein switches
We are working to make chemical-dependent protein e- carriers with specificities for UUV exhaust molecules, use these switches to control the current produced by microbes at their surface, create miniature devices that are able to read out the current from microbes that sense different chemicals, and process the individual signals for patterns useful in monitoring marine locations.
• We are seeking partners with strengths in PALS technical area 2, biological signal interpretation: components 3, 4, & 5 in the project overview panel including: devices capable of electronic signal refinement, interpretation & data analysis allowing for determination of “alert” status for signal transmission to satellites, as well as partners with strengths in specific marine microbe systems for optimal porting of our sensing system to most appropriate marine organisms.
4
Magdi Essawy, United Technologies Aerospace Systems
Project Overview
Teaming Goals
Team Strengths
Contact PALS Proposers Day
United Technologies Aerospace Systems (UTAS) – Sensors and Integrated Systems (SIS) 5
Dr. Magdi Essawy – United Technologies Aerospace Systems, Dr. Pete Marchetto and Dr. Peter Sorensen – University Of Minnesota, Dr. Holger Klinck - Cornell University
[email protected] 952-892-4331 (office) – 612-770-9168 (Mobile)
• Develop undersea mobile sensor network for underwater target detection and tracking (used for data collection in early phases)
• The sensor network will perform passive listening to the undersea environment and mine sensory data from the environment, and response of various sea/ocean organisms
• The sensors will communicate with each other and central floating communication node through acoustic link, and the central node will communicate to command and control through stellate or RF link.
• Sensors will be autonomous and mobile to optimize their location with respect to monitored targets, region of interest, signal strength and location of detection organisms
• UTAS-SIS develop aerospace and aircraft sensors and systems for aerospace and defense industry.
• UTAS owns a 10,000 sq. ft. class-1000 MEMs facility and advanced environmental qualification testing and wind, icing, and supersonic tunnels
• The UOM & Cornell marine biology and acoustic sensing teams with experience in underwater testing in ocean and rivers, and knowledge of bio-organisms and bioacoustics Research, and data of Perennial Acoustic Observatory - Antarctic Ocean
Mobile Senor Networks for Undersea Target Detection & Tracking using Natural Organisms
Develop undersea mobile sensor network that can detect and track presence and movement of M/UUVs through monitoring the behavior of certain organisms. The sensors will operate autonomously and will communicate with each other and command and control. Acoustic beamforming sensors, light sensors, and video cameras will be used.
• We seek collaboration with teams of background and experience with Marine Biology, undersea organisms, and expected behavior and response to nearby moving targets, signals, and environment
• Current data regarding undersea organisms, bioacoustics, bio-organisms response signals, and behaviors would help jump start the effort
• Teams with experience of operation and challenges with unmanned underwater vehicles (UUV), unattended underwater sensors, and underwater acoustics would be a plus.
• Capabilities for extended under water testing and continuous data collection are required
Satellite Link
Acoustic Link
Mobile Senor Network Concept
6
Lauren Freeman, Naval Undersea Warfare Center
Project Overview
Teaming Goals
Team Strengths
Contact PALS Proposers Day
Lauren A. Freeman1, Simon E. Freeman2, Jason E. Gaudette2.
[email protected], 858-401-9920
• Unique Coral Reef Soundscapes expertise• Environmental Validation• Oceanography• Coral Reef Ecology• Multivariate Data Analysis & Machine Learning• Remote Sensing & Image Processing• Signal Processing• Rapid Instrumentation Prototyping• Non-Traditional Sensors & Sonar Development• NUWC: Unique Institutional Assets (See Jason
Gaudette’s slide/poster)
Passive Underwater Acoustics for Rapid Detection of Key Littoral Marine Environmental Features
• Collect field & lab data to form an Acoustic Spectral Library of Marine Soundscapes & Ecological Responses
• Machine learning algorithm paired with hierarchical clustering & classification to rapidly group & understand acoustic signals
• Soundscapes can be used to rapidly identify underwater activity
We need:• Access to tanks and facilities with coral reef
husbandry capability• Testing facilities near appropriate
ecosystems
Teaming Goals
NUWC
Signal Processing
Littoral Sensing
1Code 85 AUV Division. 2Code 15 Sensors Division. Naval Undersea Warfare Center, Newport RI, USA
Soundscapes are an accepted means of studying biological activity above water, but have historically been under-utilized in maritime environments. Recent advances in acquisition technology have made rapid collection of passive acoustic signals in marine littoral environments more straightforward. Our team has unique signal processing expertise to interpret these signals. Multivariate analysis, systematic clustering of data, and machine learning algorithms can rapidly sort & process such processed acoustic signals for near real-time determination of environmental changes.
A new acoustic spectral library, similar to spectral libraries used in remote sensing image processing, will be used to train algorithms.
Passive Acoustic Signals
Further Processing for
Unknown Signals
Identify Biological
Sound Response
Match Signals to Known Acoustic
Spectra
8
Simon Freeman, Naval Undersea Warfare Center
Project Overview
Teaming Goals
Team Strengths
Contact PALS Proposers Day
9
Simon E. Freemana, Lauren A. Freemanb, Jason E. Gaudettea.
[email protected], 401-832-3209
• Unique coral reef acoustics expertise• Array processing and multivariate data analysis• Environmental validation• Coral reef ecology• Oceanography• Rapid instrumentation prototyping• Non-traditional sensors and sonar development• NUWC: unique institutional assets (See Jason
Gaudette’s slide)
Interpreting the Information in Coral Reef Soundscapes
We have developed unconventional signal processing approaches for ambient biological soundscape analysis1. So far, they have yielded new and previously overlooked environmental information from reef sound2. We want to apply these to detect and classify the subtle bio-acoustic signals associated with the interaction between organisms and man-made objects in strategically relevant coral reef environments.
We need:• Access to tanks and facilities with coral reef
husbandry capability• Testing facilities near appropriate
ecosystems
Teaming Goals
NUWC
Signal Processing
Littoral Sensing
aCode 15 sensors Division. bCode 85 AUV Division.Naval Undersea Warfare Center, Newport RI
24 h 2 s 2 ms
Directional processor / Multivariate detector and classifier
6m
M. Lee, B. Robotics, L. Robotics
1. Freeman LA., Freeman SE. (2016) Rapidly Obtained Ecological Indicators in Coral Reef Soundscapes. Mar. Ecol. Prog. Ser. 561, 69-82
2. Freeman SE., Freeman LA., Giorli G., Haas AF. PNAS (in review)
10
Paul Gader, University of Florida
Project Overview
Teaming Goals
Team Strengths
Contact PALS Proposers Day
11
Paul Gader, Computer & Information Sci and Eng, Eng. School of Sustainable Infrastructrure and Environment
Paul Gader, [email protected], 352-262-4267
• Over 30 years of experience in:• Machine Learning / Pattern Recognition. Image
and Signal Analysis with many sensors: RADAR, IR, EMI, Acoustic, Hyperspectral
• Robust Algorithms, e.g. Contributed algorithms for fielded Systems for detecting IEDs
• High-Performance/Real-time computing• Engineering Experiment Station: Tech Transfer
Machine Learning with Sensor Data
Apply experience gained in researching, developing, and implementing algorithms that are robust with respect to problems associated
with sensors in unconstrained environments
• Help Domain Specialists and Sensor Developers to perform Machine Learning with Sensor Data using Best Practices
• Design Meaningful Evaluation Tools
• Identify strange behavior by Sensors
• Adapt Robust Algorithms to Sensors• Deep Learning• Gaussian Processes• Manifolds• Markov Modeling• Multiple-Instance Learning
12
Scott Gallager, Woods Hole Oceanographic Institution
Project Overview
Teaming Goals
Team Strengths
Contact PALS Proposers Day
13
Oceanic Plankton as Living Sensors of DisturbanceScott Gallager, Houshuo Jiang, and Eugene Terray, Woods Hole Oceanographic Institution
[email protected] ,508 289 2783; [email protected]; [email protected]
GOAL: The goal is to provide anomaly detection in the ocean environment with high spatial-temporal signal strength relative to ambient noise at some maximum distance from a target. METHODS: The ubiquitous distribution of living organisms in the ocean on the scale of microns to millimeters allows the use of a simple, low cost detection system that would monitor and understand changes in plankton behavior, aberrant chemical signatures, light pulses from bioluminescent organisms, and far field sound emanating from a moving target, all integrated using deep learning to provide an understanding of the environment.
*Fluid mechanics at all scales, CFD and DNS modeling, of vehicles and plankton*Turbulence measurement and modeling,*Biological understanding of hydromechanical, chemical and light signatures
in ocean and those produced by plankton,*Open and coastal ocean experience with many AUV vehicles,*Teaming with REMUS group at WHOI,*Deep Learning AI experience of data integration/classification of behavior,
anomaly detection,*Experience in lab and ocean experimentation,*Open ocean imaging, PIV, machine vision, machine learning,*100 collective years in oceanography.
Collaborators are encouraged at all levels particularly in the following Technical Areas:
• Machine learning• Bioluminescence• Passive acoustic data processing• Chemical sensing
Distribution Statement 14
Jason Gaudette, Naval Undersea Warfare Center
Project Overview
Teaming Goals
Team Strengths
Contact PALS Proposers Day
15
Jason E. Gaudette1, Simon E. Freeman1, Lauren A. Freeman2.
[email protected], 401-832-6601
NUWC Newport has expertise in• Acoustic and array signal processing• Embedded electronics development• Mechanical packaging for underwater systems• Low-power, high-throughput data telemetry• Piezoelectric and optical fiber transduction• Environmental analysis and validation• UUV test assets and payload integration• Sensor testing facilities (e.g., anechoic
chambers, high-speed flow tanks, pressure vessels, electromagnetic sensing, optical equipment)
Advanced Underwater Sensor Development and Testing
NUWC Division Newport is well positioned to facilitate the prototyping and testing of PALS concepts with academic and industry partners.
• Academic partners with advanced underwater sensing concepts
• Industry partners for commercialization and transition of successful Phase I projects
Teaming Goals
NUWC
Signal Processing
Littoral Sensing
1Code 15 sensors Division. 2Code 85 AUV Division.Naval Undersea Warfare Center, Newport RI
DARPA SandShark UUV Example Payload Integration
16
Viktor Gruev, University of Illinois at Urbana-Champaign
Project Overview
Teaming Goals
Team Strengths
Contact PALS Proposers Day
17
Viktor Gruev1, Barani Raman2, Shantanu Chakrabartty2, Naresh Shanbhag1, Andy Singer1 and Tom Cronnin31 University of Illinois at Urbana-Champaign, 2 Washington University in St. Louis, 3 University of Maryland Baltimore County.
Viktor Gruev, email: [email protected], phone: 217.300.9919
• Objective: utilize the lobster’s olfactory system to detect M/UUV and geolocate them based on underwater polarization optical signatures.
• We will redesign our low power neural recording device to collect neural information from the olfactory system of the lobster. Our proposed “backpack” will have: array of electrodes, amplifiers and low power neural classifier. The work will be based on our low power backpack for olfactory neural recordings in the locust.
• We will geolocate the detected odor based on underwater polarization optical signatures. We have developed camera system capable of geolocating with 1km accuracy at 100m depth.
• Developed and deployed low power neural recording backpack and odor classifier for locust’s olfactory system.
• Developed underwater camera systems for geolocalization using polarization information.
• Deployed underwater imaging systems and collected data at various depths.
• Expertise in: animal vision and olfaction, low power imagers and neural recording devices, on-chimp (deep memory) machine learning system under constrained resources, high speed underwater ultrasound communication.
• Extensive publication record in top tier journals (Science, Nature, Science Advances, PNAS) on olfaction, polarization vision, geolocalization and neural recordings.
Olfaction and Polarization Vision for Underwater Target Detection
We will record neural activity from the olfactory system of migrating lobster to detect underwater targets and use underwater polarization optical information to geolocate the target. Low power neural recording devices coupled with classifiers will reduce the amount of information sent to a remote station via a millimeter-scale implanted ultrasound transmitters .
• Seeking industry collaborators to help with the design and deployment of the proposed underwater system.
• Collaborators to address scaling and reproducibility changes of the system.
• Help in testing the detection of the system at long distances (100m and 500m)
Saha et al, Nature Communication, 2017
Powell et al, Science Advances, 2018
18
Leila Hamdan, University of Southern Mississippi
Project Overview
Teaming Goals
Team Strengths
Contact PALS Proposers Day
200m sample transect
19
Dr. Leila J. Hamdan, University of Southern Mississippi, School of Ocean Science and Technology
[email protected]; 228-818-8011; www.hamdanlab.com;https://www.usm.edu/school-ocean-science-and-technology
• Impact of Deepwater Horizon spill, currents on Gulf of Mexico (GOM) fauna
• How geochemical, physical features of shipwrecks shape microbiomes• Merged ecology, contaminant and sensing/detection studies• Basis for PALS ideas
• Technical Area 1: Characterize Signal• Biotic signatures of disturbances (hurricanes, spills) (micro – macro)• Mapping and distribution of organisms• Physiological & ecological drivers of animal behavior• Design, deployment of landers/sensors to monitor environment (SCHEMA; ECOGIG; CONCORDE)
• Technical Area 2: Interpret Signal• USM Instrumentation, Sensing & Vehicles Program (AUVs, ROVs, Moorings, Landers)• Unmanned Maritime Systems & Hydrographic Science Programs• Micro, meso & macrocosm facilities; Access to GOM • Research Vessel Point Sur (136 ft)
Biotic Underwater Sentries of the Benthic Environment (BUSyBE)
• Detect known features from micro & macro-organism data (biodiversity, behavior, acoustic telemetry)
• Develop computational/sensing tools to predict location of features
• To test utility & reliability of signatures and tools on new targets
• Collaborators on Technical Area 2• Biological Signal propagation to
detector• Development of hardware and alert system • Employing USM marine vehicles & moorings
as sensing platforms and targets
Hamdan et al. in press; Nature Sci. Rep.
20
David Kehoe, Indiana University
Project Overview
Teaming Goals
Team Strengths
Contact PALS Proposers Day
21
Dr. David M. Kehoe1 and Dr. Joel Ybe21Department of Biology and 2School of Public Health, Indiana University, Bloomington, IN 47405
[email protected] cell (812) 929-9083 work (812) 856-4715
Exploiting Novel Subsurface Light Color and Intensity Sensing Systems in Marine Microbes
Blue-greenlight color sensing
capacity is widespread
globally in the world’s oceans1
(40% of total)
Color sensors control pigmentation and light
harvesting ability1
Blue-green photoreceptors control a 45-fold change in the transcription of specific genes2
In the past decade, we developed molecular genetic tools to routinely genetically modify strains of marine Synechococcus from around the
world. We are using these tools to reveal how blue-green light regulates transcriptional activity. We are also investigating responses to other environmental signals with these tools. Our goal is to create
synthetic biology tools for use in industry and biotechnology.
TA1 highlights our strengths. We can engineer Synechococcus, which exists throughout the world, to respond to (1) the blue to green light ratio (2) the blue light irradiance level (3) the green light irradiance level. The output is transcriptional activity, so we can use any reporter gene protein as the transmitting signal in our system. This light-activated response is extremely fast, sensitive, and reversible. Also, no external energy is
required since Synechococcus is photosynthetic.
We can provide the sensing requirement for TA1 and can create many different protein output signals as
needed. However, the signals produced must be selected to be detectable by a secondary system that
will amplify and transmit the signal as part of TA2. Thus we seek collaborators who can provide a system(s) that
will accomplish the goals of TA2.
We are capable of creating all TA1-required organisms, including the appropriate biotechnological constraints on genetically engineered organisms, and testing them in small-scale environments. However, we will also require partnering with groups who have access to M/UUVs and facilities where larger scale testing can be carried out.
1 PNAS 2018; published ahead of print February 12, 2018, https://doi.org/10.1073/pnas.17170691152 PNAS 2016; 113: 6077–6082
22
Jennifer Miksis-Olds, University of New Hampshire
Project Overview
Teaming Goals
Team Strengths
Contact PALS Proposers Day
23
Jennifer Miksis-Olds, University of New Hampshire, School of Marine Science & Ocean EngineeringKelley Thomas, University of New Hampshire, Hubbard Center for Genome Studies
Jennifer Miksis-Olds – [email protected], 603 862-5147Kelley Thomas - [email protected], 603 862-2470
• UNH Expertise• Active marine eDNA research program • Genomics/Bioinformatics• Underwater and environmental acoustics
Targeted Sampling of eDNA Directed by Soundscape Features
UNH excels in the R&D to support future bio-referenced monitoring systems. We aim to contribute the basic science needed to apply sensor elements in a two-phase process where the larger spatial scale of passive acoustic detections inform targeted fine scale sampling of eDNA to provide a double layer of detection with the potential for further target classification.
• Seeking collaborations • Transition of eDNA techniques from lab to field• Remote, near-real time data transmission• System integration
• Assets required to be competitive• M/UUV access
Soundscape Features1. Direct detection2. Acoustic shadow3. Silent soundscape
• Assets/Facilities• 60’ x 40’ x 20’ engineering tank• Atlantic Deepwater Ecosystem
Observatory Network (ADEON)• In-house next generation
sequencing capacity• HPC computing facility and staff
24
Shawn Mulvaney, Naval Research Laboratory
Project Overview
Teaming Goals
Team Strengths
Contact PALS Proposers Day
• Persistent aquatic living sensors will need to sense their environment and then communicate that tactical information to Department of Defense assets.
• Smart, distributed assets will link PALS and the DoD• Long-term, continuous operation in a marine environment• Assets can both receive and transmit information
• Assets can process information to avert false positive reports
• Assets can move in the water column• Assets can operate at different depths• Materials that mitigate biofouling• Materials that are compatible with
marine distribution – do not pollute
25
Drs. Shawn P. Mulvaney and James H. Wynne, U.S. Naval Research Laboratory
[email protected], 202.404.2120; [email protected], 202.404.4010
• Materials development• Materials integration• Sensor development and prototyping• Biofilm and antifouling expertise• Broad understanding of the marine
environmentLaboratory for Autonomous Systems Research
Integrated Materials Solutions for Marine Sensor Deployment
We envision a distributed set of PALS and linking assets that caneffectively monitor the marine environment for tactical information.The PALS and assets will need long-term operability at all depths,the ability to communicate with each other, and the ability toresolve information such that the DoD receives tactically relevantinformation.
Seeking partner(s) that have a strong understanding ofthe PALS, their reporting capabilities, and theirdistribution and range within the marine environment.Our materials solutions can accommodate multiplesensing modes and deployment strategies.
Fig 1. Cartoon of a distributed asset. The sensingand computing components are cleverly encased in amulti-part shell that assures operability, locomotion,and length of persistence
Fig 2. Littoral Bay: wave pool, simulated sea floor, sedimentationprofiles, autonomous sensor deployment tanks, confirmatory sensingmodules
26
Marco Rolandi, University of California, Santa Cruz
Project Overview
Teaming Goals
Team Strengths
Contact PALS Proposers Day
27
Rolandi, Dowla, Amemiya, de Coursey- UC Santa Cruz, UC Merced, Rush Medical Center
[email protected] 831459 9138
• 5 nV/ cm sensitivity• Jelly is a very good proton conductor• Are protons part of the electric field sensing mechanism?• E.J. Josberger, P. Hassanzadeh, Y. Deng, J. Sohn, M. J. Rego, C.
T. Ammemiya, M. Rolandi, Proton Conductivity in Ampullae of Lorenzini Jelly, Science Advances, 2, e1600112 (2016).
• Interdisciplinary mix between electrical engineering (devices and signal), evolutionary biology, and electrophysiology.
• Fundamental approach to identify signal transduction between electric field and neuronal input
Shark Sense
Shark Sense will investigate the fundamental pathways of signal transduction in the electrical field sensor of shark and skates called the Ampullae of Lorenzini. With this fundamental knowledge Shark Sense will develop a strategy to retrieve the signal from the shark for detection of M/UUV
• We are seeking collaborations in transferring the signal from the shark to the detector to meet PALS technical milestones.
• We are seeking collaborations in engineering ampullae biomimetics in synthetic organisms or including transmission element in ampullae (ie. Ampullae releases chemical once e-field detected)
28
Michael Smanski, University of Minnesota
Engineering barriers to transgene escapeMichael Smanski University of Minnesota
Team StrengthsProject Overview
• We have a technology that leverages programmable transcription factors (dCas9, TALE, or Zn-Finger-based) to engineer ‘species-like’ barriers to reproduction in sexually-reproducing organisms
• Proof-of-concept in yeast, and work underway in plants, vertebrates, nematodes, and insects.
• Synthetic Speciation provides a bidirectional barrier to gene flow. It prevents transgenes from getting out into wild populations and prevent wild genes from introgressing into your GE organism.
Contact: Michael Smanski – [email protected] – 612-624-9752 PALS proposers day29
• Our team has experience in geneticengineering of fish, mammals, insects,roundworms, plants, yeast, and bacteria
• We could contribute to TA1, byproviding a genetic biocontainmentoption for transgenic organisms used inyour project
Teaming Goals• I am looking to contribute to a team or
teams who are interested in applyingour genetic biocontainment technology
• Depending on organism of interest, wehave 1-2 collaborators who may also begood to add to the team.
30
Brett Tyler, Oregon State University
Detection of M/UUVs using reflected marine animal sounds
Sounds from a marine animal reflected by an M/UUV are recorded, then transmitted to a high performance computing cluster for interpretation
PRINCIPLE OF THE PROJECT
Oregon State University, NOAA Corvallis & Newport Oregon Team StrengthsTechnical Expertise• Sensor arrays and underwater gliders. • Detection, classification, and location of marine
animals acoustically. • Ocean ambient noise; long-term acoustic data.• Machine learning and data mining for
bioacoustics.• Statistical signal processing and machine learning
for bioacoustics.• Cyberinfrastructure for data-intensive research in
the life and environmental sciences.Institutional Assets• Sensor arrays of the Ocean Observatories Institute • NOAA and OSU Research Vessels • CGRB and CEOAS high performance computing
clusters, including GPU arrays• OSU artificial intelligence and data science group
(16 faculty in EECS and Statistics)
Technical Expertise Needed• Interpretation of reflected sounds into spatial
information about M/UUVs
Teaming Goals
Brett M. Tyler, David K. Mellinger, Jack Barth, Joe Haxel, Xiaoli Fern and Joe Haxel
marineanimal
Contacts:Brett Tyler ([email protected], 541-737-3347), Jack Barth ([email protected], 541-737-1607) and David Mellinger ([email protected], 541-867-0372)