the last stop before autonomous...

The Last Stop before Autonomous Navigation:

Augmented Reality using Microsoft HoloLens

bySamuel R. Pecota

eNavigation Underway North America 2017

The coming extinction of the merchant mariner


• Merchant sailors have been plying the oceans for over 3000 years

• The job wasn’t all that romantic though

• The work was, and still is, generally hard, dirty, and dangerous

• Autonomous cargo vessels of the future

• Rolls Royce• Kongsberg

But perhaps for not much longer…


• People will still be going to sea, but only for fun

• Not for the purpose of moving cargo from Point A to Point B

Unless you are a paying passenger of course…


• Which could still be set up for autonomous navigation too!

…or you have your own boat


• On the surface, underwater and in the air

The world’s navies are also going autonomous


• No one can say how long it will last…

• Or exactly what problems will need to be overcome

But there will be a transition period


• Super VTS• Direct, daily

fleet operational control

• A human always still on duty

Remotely controlled vessels may be a first step toward full autonomy


• Wire splicing?• Knot tying?• Line handling?• Sight reduction?

• All becoming obsolete skills

What does this mean for the future of Maritime Education and Training (MET)?


• Modern merchant bridge

• Modern warship bridge

Evolution not Revolution


• eNavigation lecture 2010

• Docking in Honolulu

MET is not accomplished overnight


• Paper chart navigation• ECDIS and radar

navigation• What is next?

One way might be to simplify the navigational task


• Cosco Busan (2007)• USS Fitzgerald (2017)

Navigational skills are in a state of slow decline


• Better electronics perhaps?

• Immersion without distraction

• Eyes out the window!

What can be done to fix this problem?


Microsoft HoloLens


• First announced Jan 2015

• We turned it into a navigational tool

HUD Holo (Oct 2016)


Bob

Typewritten Text

Bob

Typewritten Text

Bob

Typewritten Text

SEE VIDEO BELOW

Bob

Typewritten Text

HoloLens HUD for Maritime (2017)


Bob

Typewritten Text

SEE VIDEO BELOW

• Eyes out the window!

• Easy to learn and use

• Immediate and constant position information

• Enhanced situational awareness

Advantages of HoloLens HUD


• ECDIS interface• Display AIS targets in

proper location and orientation

• Provide collision avoidance advice

• Direct communication with autonomous vessels

More advantages (still to be developed)


Come to starboardyou idiot human!

I told himbut he’s notlistening!

• Full autonomy is the end game

• How we get there safely is critical

• HoloLens for HUD Maritime could help

Conclusion


Thank you!


the last stop before autonomous...

Documents