developing 3d image-recognition augmented reality training

Sumaria Networks

Lessons Learned in

Developing 3D Image

Recognition-Augmented

Reality Training

A Sumaria Company

Carole A. Meade

People ▪ Training ▪ Solutions

our Objectives

After this session you should be able to…

Assess how to use this technology to design

your own immersive end-user experience

Apply lessons learned and avoid mistakes in

using this leading-edge technology in

development

Experience how image-recognition and

augmented-reality works

2 Carole Meade -3D Image Recognition-AR #903

Sumaria Networks, LLC began in 2000 as a

learning services organization created by

Sumaria Systems, Inc.,

a Boston, MA company

about Us


…a leading Global, High-Tech learning services

company for the IT, Telecom, Utilities

and Healthcare industries.

Our international team of 150+ industry

and product specialists have more than

12 years of proven performance in

Instructional Design, Development,

Certification, Technical Writing

and Delivery Support expertise.

we Are


our AR Software

Have you seen or used 3D modeling,

Image-Recognition or

Augmented-Reality software?


Who Uses It?

IKEA

Gizmo Greeting Cards

Macy’s Star Gifts


We Started

…when our client wanted to update their end-user

training to a world-class level.

They were very interested in

image-recognition and

augmented-reality technologies.


we Found

The McLaren –P1 App

8

https://www.facebook.com/photo.php?fbid=101510348762367

17&set=pb.371554081716.-

2207520000.1361197976&type=3&theater

https://www.facebook.com/photo.php?fbid=10151034876236717&set=pb.371554081716.-

2207520000.1361197976&type=3&theater

Carole Meade -3D Image Recognition-AR #903

https://www.facebook.com/photo.php?fbid=10151034876236717&set=pb.371554081716.-2207520000.1361197976&type=3&theater







Download It

https://itunes.apple.com/gb/app/mclaren-

p1/id562173543?mt=8

https://play.google.com/store/apps/details?id=com.

mclaren.McLarenProject1&hl=en

For IOS

For Android


https://itunes.apple.com/gb/app/mclaren-p1/id562173543?mt=8





https://play.google.com/store/apps/details?id=com.mclaren.McLarenProject1&hl=en





Once Our Client Agreed

..we started looking for existing

technologies that could support our

needs.


Metaio SDK for augmented

reality (http://www.metaio.com/)

Unity 3D to add complex 3D

Modeling in the augmented

screen

Java & Objective C for

Android & IOS specific apps to

enable communication between

augmented reality screen and

details web page

HTML5 (CSS3/JavaScript)

for details screen and WBT

What Technology

was Used?


http://www.metaio.com/



How Does it Work?

Step 1 The end-user downloads the APP and then

points their device at the 3D object.

The APP recognizes the

common identifier and

an augmented reality

sub-menu instantly

appears.

If there is a unique identifier then the menu can be

by-passed or an alternative menu can be used


How Does it Work?

Step 2 The user selects the

model or if the object has a

single unique identifier,

they are presented with

a 3D model of the object with

highlighted interactive

points of interest.


How Does it Work?

Step 2 continued The content becomes server-

based allowing these benefits:

Smaller size of APP

Maintenance of content more cost-efficient

Only content specific to the device is loaded onto the

smart phone or tablet

Content can be held within a secure internal LAN or

made available on Public Servers

APP not reliant on the object following initial

identification, giving user more freedom to

enjoy the experience where

and how they choose! 14 Carole Meade -3D Image Recognition-AR #903

How Does it Work?

Step 3

The user is then able to interact with the highlighted

points of interest. The content can be accessed in

different media modalities:

A knowledge-based text

box with explanation

A simulation-animation

with audio

Scripted text

The user is free to move away from the device

& enjoy the training experience!


3D Video Demo

& WBT Module

https://services.geolearning.com/courseware/show/721/306466/v3.zip/file/player.html


http://www.youtube.com/

watch?v=e2FhIiCWsQU&featur

e=youtu.be



http://www.youtube.com/watch?v=e2FhIiCWsQU&feature=youtu.be





What Were

the Issues?

How do you get QR codes on the products?

What if it cannot detect differences in models?

How can we make it easier to interact with?

How do you create one image that fits all sizes?

How do you create content that fits both needs?

How do you manage the app size issues?


What Did

We Learn?

QR Code vs 3D Modeling

Variations in models

User experience – ability to interact/walk away from

the model

Screen real estate/size variations

Size of app

Secure front end/registration

Web vs. app content


Try It Yourself!


Thank You!

Any questions?


our Client Awards

We have won both the

Key and Best Supplier/Partner Award

for 2 years running out of a pool of

more than 7000 suppliers

Best Supplier/Partner Award, 2012

Key Supplier Award, 2012

Best Supplier/Partner Award, 2011

Key Supplier Award, 2011


Contact Us

Carole A. Meade, Director of Learning Services

303.619.9555

[email protected]

www.sumarianetworks.com


mailto:[email protected]

http://www.sumarianetworks.com/

developing 3d image-recognition augmented reality training

Mobile