flying with intel® soc fpga · game of drones processor sensors data link motor ... flight...
TRANSCRIPT
![Page 1: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/1.jpg)
Flying with Intel® SoC FPGA: Smart Drones Enabled by Open Source Platform
Zongbo Wang / CEO Aerotenna
1
![Page 2: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/2.jpg)
Agenda
• Game of Drones
• The Path to Smart Drones
• Flying with OcPoC Open Source
Platform
• Summary
2
![Page 3: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/3.jpg)
Game of Drones
3
![Page 4: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/4.jpg)
4
Game of Drones
Processor
Sensors
Motor Data Link
Motor
Motor
Motor
Flight Controller
Exciting combination of electrical and aerospace engineering
and computer science, from theory to practice.
![Page 5: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/5.jpg)
5
Current Hardware Option and Software Stack
Pixhawk with ARM* MCU
Compatible Open Hardware
(Pixhawk, APM, etc.)
Embedded OS
(RT Linux*, NuttX, etc.)
PX4 or APM Flight Code
![Page 6: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/6.jpg)
Evolution to Smart Drones
6
![Page 7: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/7.jpg)
7
Sensing
Processing
From Drones to Smart Drones
How to Achieve Safe and Reliable Autonomous Flying? Sensors and Sensor Fusion
• Ultrasonic, Microwave • Optical (Infrared, Vision)
Onboard Real-time Processing and AI • Remote processing is not feasible
during flight due to time sensitivity
![Page 8: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/8.jpg)
8
Designing the Brain of the Smart Drone
Demands in Smart Flight Technical Features of SoC FPGA
Sensor Interface and Communication I/O Throughput
Sensor Signal Processing and Sensor Fusion FPGA
High-level Decision Making and Flight Control Embedded ARM* Processor
Real-time AI and Deep Learning FPGA-based Real-time Processing
![Page 9: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/9.jpg)
9
Brain of the Smart Drone
ARM*
Processor
FPGA
SoC FPGA
Cyclone® V SoC
Basic peripheral devices for drones
Additional external sensors for smart drones
Processing System
Ardupilot on Linux*
DDR 3
IMU
Baro
GPS
Programmable Logic
PWM Coding
PWM Coding
PWM Coding
PWM Coding
PPM Decoding
RC Receiver
ESC ESC ESC ESC
UART
Rangefinder
Patten Reorganization
CSI
Camera Collision-Avoidance
Radar
2D-FFT
LVDS
![Page 10: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/10.jpg)
10
Advantages of SoC FPGA Structure
PPM/PWM
Coding/Decoding Logic
PPM Signal from Remote Controller
PWM Signals to Motors
ARM ARM + FPGA
500+ lines of C/C++ VS 20 lines of VHDL/Verilog + 6 lines of C/C+
1000+ CPU cycles VS <5 clock cycles of pipeline delay
Free up CPU load for high-level “thinking”
FPGA
ARM* Processor
![Page 11: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/11.jpg)
Flying with OcPoC* Open Source Platform
11
![Page 12: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/12.jpg)
12
Introducing OcPoC* – “Octagonal Pilot on Chip”
Highlights
• First Intel® SoC FPGA-based flight controller
• Utilizes Enpirion® power modules
• >100 I/Os for sensor integration
• Video streaming and processing
• Enhanced GPS and IMU sensor packages
• APM compatible (dronecode.org)
• Open source platform (hardware, software)
![Page 13: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/13.jpg)
Flying with OcPoC
13
![Page 14: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/14.jpg)
14
OcPoC’s Sensor Options
Aerotenna’s Microwave Sensors OcPoC* Compatible Sensors
μLanding* Compact Altimeter
μSharp*
360° Sense-and-Avoid Radar Dual-Camera Module
Courtesy of Human+ Tech
Flight Control Platform
OcPoC
![Page 15: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/15.jpg)
15
Aerotenna’s Microwave Sensors for OcPoC*
Compact Altimeter for All Drones • < 60 grams in weight • < 1.5 watts in power • < 4 cm in range accuracy • Up to 120 m in sensing range
360° Sense-and-Avoid Radar • < 150 grams in weight • < 2.5 watts in power • < 4 cm in range accuracy • Up to 60 m in sensing range
OcPoC Onboard Processing
![Page 16: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/16.jpg)
16
IP Library for OcPoC*
PPM Decoding
PWM Coding
S.BUS Decoding
μLanding* Interface
μSharp* Range
Processing
Available
Interface IPs
Sensor IPs
Under Development
CSI-bus
Dual Camera Depth
Retrieving
… …
Programmable Logic
Cyclone® V SoC
Processing System
Ardupilot on Linux* PWM
Coding
PWM Coding
PWM Coding
PWM Coding
PPM Decoding
![Page 17: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/17.jpg)
17
Dronecode in the Game of Drones
Dronecode Project Members
![Page 18: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/18.jpg)
18
Open Source
Open Culture
Open Skies
Open to Exploring New Tech!
Dronecode.org
![Page 19: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/19.jpg)
19
Summary
• Drones are evolving into smart drones
• Intel® SoC FPGAs fit perfectly as the brain of the smart drone
• OcPoC* is available as an open-source platform supporting drones
• OcPoC enables the development of:
- Sensor fusion
- Real-time processing
- Vision-based flying assistance
- Deep learning and environmental sensing
- and more…
Are You Ready for Smart Drones?
![Page 20: Flying with Intel® SoC FPGA · Game of Drones Processor Sensors Data Link Motor ... Flight Controller Exciting combination of electrical and aerospace engineering and computer science,](https://reader033.vdocument.in/reader033/viewer/2022041917/5e6a2403ccd7955e37202c6a/html5/thumbnails/20.jpg)
20
Additional Sources of Information
More web based info: www.aerotenna.com
2
0