![Page 1: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/1.jpg)
AI in Air Traffic ManagementChristian Thurow, Head of R&D at Searidge
WWW.SEARIDGETECH.COM/AIMEE
![Page 2: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/2.jpg)
2
What is Air Traffic Control?
Motivation 1/3
![Page 3: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/3.jpg)
3
Work Increase
Source: International Civil Aviation Organization,Civil Aviation Statistics of the World and ICAO staff estimates.
• Annual Growth: 6-7% • both #passengers and #flights • 2016: 3.7b passengers worldwide
Motivation 2/3
![Page 4: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/4.jpg)
4
Motivation 3/3
![Page 5: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/5.jpg)
5
Our Goals
![Page 6: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/6.jpg)
5
Our Goals
• reduce controller workload
![Page 7: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/7.jpg)
5
Our Goals
• reduce controller workload• increase situational awareness
![Page 8: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/8.jpg)
5
Our Goals
• reduce controller workload• increase situational awareness• declutter workspace
![Page 9: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/9.jpg)
5
Our Goals
• reduce controller workload• increase situational awareness• declutter workspace• provide additional surveillance data source (added safety)
![Page 10: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/10.jpg)
6
What does Searidge do?
![Page 11: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/11.jpg)
6
What does Searidge do?
![Page 12: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/12.jpg)
7
![Page 13: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/13.jpg)
8
Challenges
![Page 14: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/14.jpg)
8
Challenges
• Building the NN
![Page 15: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/15.jpg)
8
Challenges
• Building the NN • Training
![Page 16: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/16.jpg)
8
Challenges
• Building the NN • Training • Inferencing Speed
![Page 17: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/17.jpg)
8
Challenges
• Building the NN • Training • Inferencing Speed• Safety & Acceptance
![Page 18: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/18.jpg)
9
1. Challenge: building the NN
![Page 19: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/19.jpg)
• company policy: c++
9
1. Challenge: building the NN
![Page 20: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/20.jpg)
• company policy: c++• first tried caffe, stayed with it
9
1. Challenge: building the NN
![Page 21: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/21.jpg)
• company policy: c++• first tried caffe, stayed with it• first try with VGG16
9
1. Challenge: building the NN
![Page 22: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/22.jpg)
• company policy: c++• first tried caffe, stayed with it• first try with VGG16• now VGG19 with custom layers for tracking (37 total)
9
1. Challenge: building the NN
![Page 23: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/23.jpg)
• company policy: c++• first tried caffe, stayed with it• first try with VGG16• now VGG19 with custom layers for tracking (37 total)• superior performance over previous algorithm
9
1. Challenge: building the NN
![Page 24: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/24.jpg)
• company policy: c++• first tried caffe, stayed with it• first try with VGG16• now VGG19 with custom layers for tracking (37 total)• superior performance over previous algorithm• problems: small objects
9
1. Challenge: building the NN
![Page 25: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/25.jpg)
2. Challenge: Training
10
![Page 26: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/26.jpg)
2. Challenge: Training
• Broad vs. Random Training Initialization?
10
![Page 27: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/27.jpg)
2. Challenge: Training
• Broad vs. Random Training Initialization?
10
![Page 28: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/28.jpg)
2. Challenge: Training
• Broad vs. Random Training Initialization?• How many annotations needed per site?
10
![Page 29: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/29.jpg)
2. Challenge: Training
• Broad vs. Random Training Initialization?• How many annotations needed per site?• Same training set for all airports or specific?
10
![Page 30: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/30.jpg)
2. Challenge: Training
• Broad vs. Random Training Initialization?• How many annotations needed per site?• Same training set for all airports or specific?• How many neurons, layers?
10
![Page 31: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/31.jpg)
2. Challenge: Training
• Broad vs. Random Training Initialization?• How many annotations needed per site?• Same training set for all airports or specific?• How many neurons, layers?
10
![Page 32: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/32.jpg)
2. Challenge: Training
• Broad vs. Random Training Initialization?• How many annotations needed per site?• Same training set for all airports or specific?• How many neurons, layers?• How many Epochs?
10
![Page 33: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/33.jpg)
2. Challenge: Training
• Broad vs. Random Training Initialization?• How many annotations needed per site?• Same training set for all airports or specific?• How many neurons, layers?• How many Epochs?
10
![Page 34: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/34.jpg)
11
3. Challenge: inferencing speed
![Page 35: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/35.jpg)
12
4. Challenge: Safety & Acceptance
![Page 36: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/36.jpg)
• safety first in ATC
12
4. Challenge: Safety & Acceptance
![Page 37: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/37.jpg)
• safety first in ATC• need to prove performance
12
4. Challenge: Safety & Acceptance
![Page 38: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/38.jpg)
• safety first in ATC• need to prove performance• regulator decides if system may be used operationally
12
4. Challenge: Safety & Acceptance
![Page 39: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/39.jpg)
• safety first in ATC• need to prove performance• regulator decides if system may be used operationally• we treat ANN as human, same tests as for ATController
12
4. Challenge: Safety & Acceptance
![Page 40: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/40.jpg)
13
Example Images and Videos
![Page 41: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/41.jpg)
• list a couple of sample sites and show actual video
14
Example Images and Videos
![Page 42: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/42.jpg)
15
Example Images and Videos
![Page 43: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/43.jpg)
16
![Page 44: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/44.jpg)
16
![Page 45: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/45.jpg)
17
![Page 46: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/46.jpg)
17
![Page 47: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/47.jpg)
18
![Page 48: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/48.jpg)
19
Future Work
• Optimal Flight Level Prediction • Optimal Aircraft to Gate Assignment • AI Controller Assist • many potential new application in ATC
![Page 49: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/49.jpg)
Thank you!
HEAD OFFICE
19 Camelot Drive Ottawa, Ontario K2G 5W6
PHONE 613 686 3988 TOLL FREE 1 866 799 1555
EMAIL [email protected]
Thank you for your time.
I’ll be happy to answer any questions you may have.
![Page 50: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/50.jpg)
21
Challenge: Annotation
![Page 51: AI in Air Traffic Management - NVIDIAon-demand.gputechconf.com/gtc/2018/presentation/s... · Thank you! HEAD OFFICE 19 Camelot Drive Ottawa, Ontario K2G 5W6 PHONE 613 686 3988 TOLL](https://reader033.vdocument.in/reader033/viewer/2022052000/60124805ccb0aa52004440ea/html5/thumbnails/51.jpg)
Plattform Screenshots