deep learning and electronic intelligence kyle davidson

25
INNOVATION IN SPACE AND DEFENCE DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON May 14 th , 2019

Upload: others

Post on 29-Oct-2021

1 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

INNOVATION

IN SPACE

AND DEFENCE

DEEP LEARNING AND ELECTRONIC INTELLIGENCE

KYLE DAVIDSON

May 14th, 2019

Page 2: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Innovation in Space and Defence

Use, duplication or disclosure of this document or any of the information or images contained herein is subject to the restrictions on the title page of this document. COPYRIGHT ©2018 Maxar Technologies 2

Page 3: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

MDA Value Streams

Use, duplication or disclosure of this document or any of the information or images contained herein is subject to the restrictions on the title page of this document. COPYRIGHT ©2018 Maxar Technologies 3

Space Radar

Earth ObservationSystems

Robotics, Sensors and Automation

Satellite Antennas, Electronics and Payloads

Defence Systems

• Multi-mission Earth observation ground systems • Mission planning through reception, processing and analytics• Enterprise geospatial systems

• System integration and complex system delivery and operations• Intelligence and Surveillance, Command and Control, and communications• Engineering, production, in-service support partner

• Satellite-based radar missions and systems • Radar analytics, services, and imagery • Mission and infrastructure operations

• Robotic manipulators, rovers, and sensor systems • Ranging, automated docking, inspection and navigation• Space exploration, satellite servicing, debris removal• Medical, nuclear and industrial automation

• Engineering, production and testing of equipment and payloads• Space-based communications, radar, exploration and science• High-volume production for large satellite constellations

Page 4: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

MDA Heritage: Over 120 Years

Use, duplication or disclosure of this document or any of the information or images contained herein is subject to the restrictions on the title page of this document. COPYRIGHT ©2018 Maxar Technologies 4

Page 5: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Use, duplication or disclosure of this document or any of the information or images contained herein is subject to the restrictions on the title page of this document. COPYRIGHT ©2018 Maxar Technologies 5

INTRODUCTION TO MACHINE LEARNING

Deep Learning and ELINT

Page 6: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Traditional Signal Classification

Functional Flowchart for key feature extraction in analogue modulations [1].

Functional flowchart for modulation classification [1].

[1] E.E. Azzouz, and A.K. Nandi, Automatic Modulation Recognition of Communications Signals, Springer, 1996.

Page 7: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Training vs. Programming

Classical Software

Data

Rules

AnswersMachine Learning

Data

Answers

Rules

More Information = Improved Rules

Page 8: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Machine Learning

Page 9: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Deep Learning

Page 10: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Neuron

Page 11: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Training the Network

Network Layer

Network Layer

Weights

Weights

Predictionመ𝐶𝑘

Loss Function

Prediction𝐶𝑘

Calculate New Weights

Updated Weights

Input Data

Page 12: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Where do we see this applied?

Page 13: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

• Image Net Challenge

– 1000 categories

– 1.4 million colour images

– 2011 winner = 74 %

– 2012 winner = 84 % (Hinton & U of T)

– 2015 winner = 96.4 %

Where is the technology now?

• Deep learning is the prevalent method.

• Deep learning does not require feature engineering.

• Classification is a mature technology.

• Rapidly changing field.

• It has major limitations.

Page 14: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Use, duplication or disclosure of this document or any of the information or images contained herein is subject to the restrictions on the title page of this document. COPYRIGHT ©2018 Maxar Technologies 14

DEVELOPING THE DEEP LEARNING CLASSIFIER

Deep Learning and ELINT

Page 15: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

ELINT Scenario

Page 16: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Training Data

Page 17: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Training and Testing the Network

Page 18: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Use, duplication or disclosure of this document or any of the information or images contained herein is subject to the restrictions on the title page of this document. COPYRIGHT ©2018 Maxar Technologies 18

RESULTS

Deep Learning and ELINT

Page 19: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Classification – with and without nosie

Page 20: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Multiple Signal Classification

Page 21: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Effects of Numerous Pulses

• Classifying a pulse in isolation.

• Using the information from a sequence of pulses.

Page 22: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

RF Fingerprinting

Page 23: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Conclusion

• ML can offer significant performance gains in ELINT classifiers.

• Training the NN using cloud computing.

• Real-time implementation.

Use, duplication or disclosure of this document or any of the information or images contained herein is subject to the restrictions on the title page of this document. COPYRIGHT ©2018 Maxar Technologies

Page 24: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

Use, duplication or disclosure of this document or any of the information or images contained herein is subject to the restrictions on the title page of this document. COPYRIGHT ©2018 Maxar Technologies 24

QUESTIONS?

Deep Learning and ELINT

Page 25: DEEP LEARNING AND ELECTRONIC INTELLIGENCE KYLE DAVIDSON

SSL MDA Proprietary Use or disclosure of the data contained on this sheet is subject to the restrictions on the title page