autonomous capabilities of the joint tactical aerial ... · small company values, big company...

24
SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES Autonomous Capabilities of the Joint Tactical Aerial Resupply Vehicle Shawn Recker , Rob Baltrusch, Joe Rosenthall, Jon Worobey, Christiaan Gribble, and Mark Butkiewicz SURVICE Engineering Company Applied Technology Operation 4603A Compass Point Road, Belcamp, MD 21017 [email protected]

Upload: others

Post on 24-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

Autonomous Capabilities of the Joint

Tactical Aerial Resupply Vehicle

Shawn Recker, Rob Baltrusch, Joe Rosenthall, Jon Worobey, Christiaan Gribble, and Mark Butkiewicz

SURVICE Engineering Company

Applied Technology Operation

4603A Compass Point Road, Belcamp, MD 21017

[email protected]

Page 2: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

OUR PEOPLE

2

With a staff of approximately people,

SURVICE employees have backgrounds in

engineering, physics, mathematics, chemistry,

computer science, acquisition, technical writing,

training, and other technical and administrative fields.

And many of our personnel have DoD and/or

operational military experience. Using a

matrix approach, we draw on expertise from across

our workforce to build customized work teams for

each project and customer. The result is a

successful, skilled workforce and many

satisfied customers.

Page 3: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES 3

Since 1981, SURVICE has supported the DoD community, as well as the homeland security, advanced technologies,

environmental, and commercial markets. We have also worked hard to retain the original vision upon which the company was

founded—to provide the warfighter with the safest, most survivable, and most effective equipment possible.

Our customer-acclaimed support primarily falls into five core business areas:

Test & Evaluation

Providing experience

in the test and

evaluation roles that

are vital to the design,

acquisition, and

fielding of all new and

modified combat

systems.

Modeling &

Simulation/

Software

Engineering

Delivering a broad

range of modeling and

simulation, software

engineering, and

systems engineering

capabilities.

Dimensional

Metrology and

Reverse

Engineering

Offering customers

precision dimensional

metrology, modeling,

and related services.

Studies &

Analysis

Conducting a wide

variety of safety,

survivability,

effectiveness, and

systems engineering

studies.

Information

Technologies &

Management

Collecting, maintaining,

distributing, storing,

verifying, and

protecting the nation’s

critical defense

information.

ABOUT SURVICE

Page 4: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

Partnership

4

Page 5: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

Joint Tactical Aerial Resupply Vehicle (JTARV)

5

Page 6: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

Target Platform Architecture

6

Common Control

Module

Flight Controller

Ground Control

Station

Radio

Transceiver

Radio Controller

Page 7: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

Ground Control Station

7

Page 8: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

Common Control Module

8

Page 9: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

Autonomous Landing

9

Page 10: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

Autonomous Landing Pipeline

10

Incoming Image DNN Detection Photogrammetry

#39

Target Direction

Computed

Craft Movement

IssuedDisarm

Page 11: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

Pipeline Motivation

11

Page 12: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

Underlying Technologies

12

Advanced 3D

Reconstruction

Real-Time In-Situ

Intelligent Video

Analytics

Page 13: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

DetectNet

13

Input FCN Output Error

NVIDIA Parallel Forall: DetectNet [1]

Page 14: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

DetectNet Dataset Creation

14

Page 15: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

DetectNet Training with DIGITS

15

Page 16: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

HawkEye™ Advanced 3D

Reconstruction Technology

16

• Project goals: • Low-cost means of capturing accurate 3D

data in the field for post-IED events in a

secure environment

• Data to feed analysis tools to estimate IED

event and post-event structural integrity

• SURVICE developing HawkEye to

combine:• Structure-from-Motion (SfM) Technology

• Image analysis can be done either on the

device or in a secure computing

environment

• Photogrammetry Technology

• Hybrid approach substantially improves

accuracy of SfM from imagery alone

• Low-cost 3D Scanning Technology

• Increases 3D point cloud data and accuracy,

especially for large featureless surfaces

Page 17: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

HawkEye™ Photogrammetry

Technology

17

CMSC 2014 Paper Recently Published & Presented by SURVICE and UC

Davis on Hybrid SfM Methodology

• SURVICE has developed hybrid

photogrammetry technology for SfM to

significantly improve accuracy over

current SfM methods

• Achieving an order-of-magnitude

improvement in 3D resolution/accuracy

• Approach & preliminary

results published

at CMSC 2014

conference

Page 18: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

HawkEye™ SfM Technology

18

• SURVICE & UC Davis developing methods

to produce dense reconstructions given

initial sparse estimate• Currently uses parallax paths constraints

imposed by path of moving camera

• Working to relax constraints to create a more

flexible dense reconstruction pipeline

Joint Paper by UC Davis and SURVICE on Dense SfM Methodology

HawkEye Dense SfM Existing State-of-the-Art

Page 19: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

Future Applications: Dense Aerial

Reconstruction

19

Parallax-Path Based Dense Reconstruction [3]

Page 20: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

Future Applications: Real-Time UAV Target

Tracking

20

Page 21: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

Acknowledgement

This work was supported in part by the US

Marine Corps SBIR program, the US Air

Force SBIR program, and SURVICE

Engineering’s Internal R&D program. The

authors thank their colleagues in the Applied

Technology Operation at SURVICE

Engineering for their support.

21

Page 22: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

References[1] DetectNet: Deep Neural Network for Object Detection in DIGITS

Andrew Tao, Jon Barker, and Sryia Sarathy

https://devblogs.nvidia.com/parallelforall/detectnet-deep-neural-network-object-detection-digits/

[2] Depth Data Assisted Structure-from-Motion Parameter Optimization and Feature Track Correction

Shawn Recker, Christiaan Gribble, Mikhail M. Shashkov, Mario Yepez, Mauricio Hess-Flores, and Kenneth I. Joy

Applied Imagery Pattern Recognition (AIPR), IEEE 2014

[3] Efficient Dense Reconstruction Using Geometry and Image Consistency Constraints

Mikhail M. Shashkov, Jason Mak, Shawn Recker, Connie Nguyen, John Owens, Kenneth I. Joy

AIPR 2015: Applied Imagery Pattern Recognition Workshop, Washington DC, 2015.

22

Page 23: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES

Questions

23

Page 24: Autonomous Capabilities of the Joint Tactical Aerial ... · SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES OUR PEOPLE 2 With a staff of approximately people, SURVICE employees have

SMALL COMPANY VALUES, BIG COMPANY CAPABILITIES 24

Providing unparalleled services and technology solutions

in support of National Defense and the U.S. Warfighter.

Serve our customers with specialized and innovative

solutions, while promoting responsible growth and

maintaining focus on our employees, values, and ethical

standards.