the uber-spatial web browser • the clickable world lightfield • medical/healthcare ... · swipe...

• The Uber-Spatial Web Browser • The Clickable World Lightfield • Medical/Healthcare App • Sensoryware Games Cross Platform

Screentm

•••• •

••\••

••••z:`,

Sp JOM NtONdra A„I is, X 0 Yi

mnototto

• . ';'•::••••••• ' ' • '' ' ' ' ' ' ' '

s.s.••••• ••••••• \

• ..

• • • • • • • • .. •

•• •

fiiiFi

ii/1l: min

. .. . . .

• ei/

Magic Leap Sensory Weartm Music Venue Applications

Our studio will develop initial applications that will show off the capabilities of Magic Leap in the music space.

Digital Live Artisttm will "beam" an artists in full scale and digital presence into your home - enabling you and your friends to enjoy a personal

concert at home from your favorite band.

Digital Music Venuetm will "beam" you and your friends into a amazing digital space it will look and feel as if you are at a live music concert.

Magic Leap will also partner with an array of artists, labels, publishers, and managers.

ffliiiiYflfiiYfffliYfffffffffffffffffffffffff/fffff////, ......... .........

• \-4

Digital Live Concerttm

a ic Leap Sensory Weartm Systei Beta Applications

The technology demonstrated in the Speakbot app (demo) paves the way for Monster Battle

and Digital Live Artist.

The Development for Wire World & Digital Live Concert paves the way for

a multitude of other applications and tools in the SDK.

Our Users:

Persona Overview

AVERAGE GAMER

Soda! Sarah Samantha & Greg

MMOG EXTREME GAMER COMIC-CON

Coe the icd Taylor the Teena9er

• • • Yryry- .. - „•, --

UNDER 6 GIRL GAMER

Average Andrew

UNDER 18 COOL KIDS

ANTI-GAMER TEENAGE GIRL OUTDOOR TH

GAMIFIED WORKER-

ara the Teenager Outdoor Owen Waiter the Worker

••/////////////////////////////////////////////////////////////////////// •

DJ Magic Mix

MUSIC CULTURE

amazon

eZz/ 044'

........ ........ ........ mm.3informs :""""- estg.

cont„ &-ftitOr6-'pattheitttottabbratof.

Sprint

•••••••••••••••••••••••••••••••••••••••••••••

Product Overview &

Design

• §,

Sensory Weartm System

Backlit on/off finger slide

Molded in textural pattern

*:•.•!:4r;$;r:i:%;

Sensory Wear System

•Novel technology which "paints" images on to the retina

•Reality Engine - Cinematic Realitytm Depth Technology provides for lifelike depth realism

•Blends the physical world and the digital world

Registers and localizes the world

• MAGIC LEAP

• WORLD OBJECT STATES

MAGIC LEAP WORt41.

0 ******0

CLOUD SERVERS

Magic Leap Sensory Weartm System

USER GRID

• it

045 **E:36*****6004*********

Massive Parallel State Computing Cloud & Grid Network

Shared Resources To Enable World Platforms

r „as4 , v,7, /7/

%A d A iii/.

• General Purpose Wearable Computing

• Initially Targeting $65b+ Gaming Market

• Can Expand To $100b+ Mobile Comm Market

• Enabled By Proprietary Scanning Fiber Projector & True3D Technology

Sensorywaretm System: Current Design Families

......... .......... .......... ........... ............. .........................

v/‘ , r/ 'iii/ z A A A

z owa.

..'‘ -- --- ----

Engineering Program Management • Agile process • Task/ownership assignment • Schedule System & Software Teams • Architecture • Alpha prototypes • Integrate with Dr. G Invaders Alpha Optical Engineering • Benchtop Testbed • Optic System Simulations Industrial Design/Human Factors • ID • Personas • Ergonomics

464.4m000

.;i44W3x0.d...%

SX.:10.XX;

YI!..14f4Z*%

• 11!

xv.6.,:ekt

no?. • .....

Preliminary Component Architecture Vniumafrie. Rfinorialc

7 r ,/,

Volumetric Model OTS

ID Model Custom Integrated Parts

Components

A Design Attributes: Lite, Gamer, Extreme Gamer

Extreme Gamer

DESIGN DIRECTION ›),

"A THRO"

41;;;0*4"

%:( /..

V ... /r. ..A IA .d.:i.

' ,, .. 4:: ....... / ..:!:,:' ' •/: :- %:0::.A -V :V ...:' ../ .4.V./. .:/:: 0:/':./...

. A Design Attributes: Magic Glass, Organic, Minimal, Human Tec

DESIGN DIRECTION ›),

THRO CLEAR"

:::::•::"""""""""""""••••••••••••••••••""

DESIGN DIRECTION

"CLEAR"

A Design Attributes: Magic Glass, Organic, Minimal, Human Tech

/, , 4f. /, .47.0 z

/W/ 0,/ /

,,,,,,,,,,,,, • ,,,,,,,, ,, ,,,,,, ,,,,,,,,,,,,,,

, „0/ "1"/

.• •. • . •:•:...

, - /Z // /r

••••••:!, text"'

,,,,,,,,,,,,,,,

:%%"/Afe.yhreee4f,

/ 40/ „, •4 / 4/i , /4/ / / 0 4

ma ' ( t er n efface

ENTERTAIIIMEP,I TOOLS NA:! GAT ON RC:A.)1j( 31' ITY

,„„„„„„„„„„„„„„„„„„„„„„„„„„„„„, 5

/,•;;',,5:;;•

X. X. 44.. $

• ;••.,:".% •

• •„.,••

HY OM VA ma ve v... me vv. OM VA

5'7A PY5 , •• • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • •••

g-p •,.44

frS, XS VS. SSC XX. XS X. OX XS SS, XS VS.

p NEWS"

rAPY el,. Alie HA§

VA ma ve v... me vv. OM VA AV VA OA

.ip .0 VV, OM VA Avr ve v.. ve vv. OW VA Avr

PHOTO g

" FILE $

▪ CORE CONTENT

iteratiVf •••% • ;7, e,51 e,4%%11

Determine the scope of the systei , ,3 • • ,,•;•$: 5 'v..). ••••••••

••;;;'••.•:,r,•:;y:1

_SIGN Contents and Organization_ • • Preliminary System Diagram rMX* XS X9 S. WO S. 004 JOGS X* CRS X9 S. VAS. 004.41

g. XV VV. S. VV. VSg

VS VA.. W. ...A., /A/ IV, /A* VA./. /.4 VA./ IV, 4. We /A* WVA. /A/ IV, VA./ ri..n /4, /4 .1. IV, VA./ e.

Areas of Focus

nformation Architecture / Content Organization

Navigation of Content

0 Primary navigation

Secondary navigation

interaction / Input Styles

Direct vs. Indirect / Physical vs. Virtual / Gestural vs. 7"raditiona I Etc.

0 Direct vs Proxy

0 Floating vs. Mapped

Scenario Based Brainstorming

For Example -3 User wants to connect via video with a friend

0 Context: Standing/sitting/walking

0 Environment: Home/work/public space

Social: Open vs. discrete

Aesthetics / Visualization

. Ul Philosophy

UI Philosophy

n./Inr TrA ,T

Intelligent / Empathetic (context specific)

Fun / Playful interaction (when appropriate)

Symbiotic (user aware)

Adaptable (system learns, user learns, idea of scaffolding)

just because you can do it, doesn't mean you should.

o 'wow actor" should not trump usability

Aim tor a long "wow"

omv0'0%w (.; 4.5xQ

User selects application/menu object to expand experience (experience

varies depending on the application)

A 'swipe' hand gesture brings UI 'ring' UI 'ring' presents user with into the users field of view, application/menu options (scrollable)

........

Hula-Hoop Interface

This could be the first step to opening up 'magic rooms'

Portals provide access to system contents (apps, games, tools. etc.)

Navigation or method for "drilling down" tbd

Portals can be opened on any sized object (or open space), including

small pads for discrete interactions

Magic Portal Interface

Gestural interaction used to initiate new 3D portal

Specific tools can be assigned to specific objects so that they open

automatically, eliminating the need to navigate the UI

Virtual 3D objects can be removed from the portals and mapped to objects in the room

This interaction design principle would enable users to build

virtual 'magic rooms'

........... ......... .........

•• ,,,,,,,,,

Magic Portal Interface

Expanding Hand Interface

Image recognition in the system brings

The user can select an item from up the primary navigation menu when

the menu or spread fingers to

the user holds up his/her hand

expand menus

Expanding Hand Interface

Alternatively, users can rotate through menus using a circular

gesture in the palm of his/her hand

Map to Environment Interface

........ •

Holding the gesture, the user moves his/her arm towards the

environmental object to be mapped to

Both objects are highlighted in the same color to confirm action

User opens hand to map the virtual object to the physical

environment

User pinches virtual object to be mapped and holds gesture

Objects that can be mapped to in the environment are

illuminated

Exploration of Primary Interaction

Scenario Based Brainstorming

' '/ //# 1

Content Organization A New Platform

. • • • • • • • ••.x/Aw'' ..• • ... ......•.•

. ' .. ' ..... ' • .

,W;)4%;,;

:vvm.,:,0;,•„//..,//w/7/4/

Swipe the side (Sio • Spread hands apart ▪ Bring hands together

wrs;t, movements las ),)nosed to rde arm move

!•%, y

• Al aVe

• Puli hand back Swipe to the side (s ow)

• Hip hand over. sz Close hand • Siie to the sde fr-"-"a ri

Pinch- thumb to fore lint • Pause (hand, .finger,

Stab (Pont)

• we / 6( (“.Ao - Flip hang over

t Plovement

MMERS ,ON ,SRRATION Common Interaction & Input Gestures

Gesture auidethi

Intuitive

Ergonomic for a wide variety of body sizes and abilities

F"laid

Scalable / Discrete (when appropriate-

Cufturally accepted

i#1.;14,41:

MME, ,SON INSPIRATION The Aeon Project

Expanding radio menu

Icon based main menu

3d helix content management

Pop up 2d alerts

VIDEO: h tp,://v ww,yankodestn.comI2011/08/021 (-)n

be% ond-au emented-realit

MK,E, ,S,ON INSPRATION Mediating Mediums — The digital 3d

2d and 3d objects dl splays

Mapping to 2d sue faces (real and virtua l

Site recognition

Visualizing / manipulating virtual objects

VIDEO: httgiAwww,yankodesio.com/2011 /09114/virtual-

architecture/

MKERSION f IN SP RATION "Sight"

r" r i ig and mapped interfaces

Site recognition

pup tracking as a means of navigation fe, Navigation of content

VIDEO: http://www.fa odest stn co mil 670420/watch-

what-ha ens-if- oovie-s lasses-are-evi

m , ERS,O Ni i, SP RAT!O N Ringo Holographic Interface

Flu a-hoop like interface

Navigation of content

Data entry / Game play

VIDEO I: h 2://vommyoutt be.comiwatch?v=t0H I NiNia6zX

M , E , 3,0, / ,NsPRATION 3D Navigation with 2D platforms

3d storage navigation space

Visual grouping by subject and/or color

Organic navigation style

VIDEO I: httg://www.yout be.comiwatch 9 =r0 .•4

VIDEO 2: h p://www.yo co m ANa t ?v= , xn ip7r

Organization of 2d icons l content

exilD6 ty (maybe too much?)

Personalization

VIDEO: h tp://www,ted.comitalksianand___a.garawala de

nos i bumptop

MN,F S ON / NISPIRATION .g,„„. 4 / ̀,/„, e 4

3D Organization of 2D Content

,soN i INsp RATION The Future of Firefighting

.............

:~W:1 Hand mapped interface

Layered Content

,/ Constant always availab e, easy o access, corner of user's FOV

On Demand — gestural interaction to initiate, menus to dig deeper

Alerts — pop-up style icons

VIDEO: tapillwww.youtube.comiwatch?v=QQA11122........L

.. . ......

rOE ,a0N INSP RATION Other examples

Radial menu

Scalable 3d virtualobjects

2d display of information

Floating interface

VIDEO: h tp:Mmtvw.yo itube,com/wa ch?‘"=Wt,7rnn,

r7/777/7

we" ''PO,00 o0 PZ4

......,:::::::::»

USER 1NT,„„„RA.CTON "Rooms" Scenario

Average Andrew:

• 34 years old

• Civil Engineer

• Sports enthusiast, fantasy football

Scenarios:

• Working at the office 4 message from co-worker comes in (alert)

• Select virtual "room" from living room; change from entertainment room to work room

• Open/access specific application from one room while in another room (i.e., open camera

app from the entertainment room)

OFF CE ROOM "Rooms 31

OFF CE ROOM "Rooms"

vex'. //// . . . . ...

,„ 4

OFF CE ROOM "Rooms"

OFF CE ROOM "Rooms

..... . ...

..stentit ori;tfi e;',ws

USER ,NITERA.CTON Navigating Rooms

;moo Scenarios:

Select a room for use

ffe Navigate from FrIt rtainment room to Work room

• r•////////////////

Physical Living Room Virtual Entertainment Room

;:i?:,;i;7;7;7;7;!;!;!:,,,,,,,,•• • • • • • • ....... • • • • :55,..V.V.V.V.,

•••••••;•,.,

USER ,NTERACT1ON Navigating Rooms

SELECT A ROOM FOR US

Work Room Entertainment Room

...............

USER ,NTERACT1ON Navigating Rooms

'AV GATE BETWEEN ROOM

777777

USER ,NTER, Selecting and/or Navigating Rooms

or. Demand: User inout to access menu system

o Gesture — i.e., hand motion up

o Button on Glasses or Pack

o Voice command

tye tracking

3D C,„„t„JST,„„„S Gesture to open icon based clusters

Provides quick access to non-functional rooms; different gesture to pull up comprehensive menu

Functional group of room based applications

Provides access to functional tools and applications while in another room; mini work station

00 Functional group of room based applications

Swipe through context specific rooms

.. ................................... .. ,,,,,,,,,,,,,,,,,,

ROOM PREV1E W Swipe to navigate available rooms

Location specific rooms; rooms have previously been mapped to physical location

„OOM PREV1E N Swipe to navigate available rooms

Navigating aesthetic "skins” that have been mapped to the living room

HIE, ,R „,,HA„„ MENU SYSTEM Virtual touch pads

Navigate primary menu to access user defined rooms; rooms are a feature of the primary navigation menu

H1E„RCHAL MENU SYSTEM Input by proxy

777777

........ . . . . . .

CONSTANT RADIAL MENU Peripheral vision

Expandable menu always available in the upper right hand corner of user's field of view

•;;;;skhOiki:,

• • •

•• •

CONsTAN7 RADIAL MENU Peripheral vision

Expands to reveal available rooms

;0050000'

PRE-MAPPED ME, S Based on physical location mapping

Projection based proxy input

PRE-MAPPED ME, S Based on physical location mapping

Virtual touch pad

PRE-MAPPED m::, Li Based on physical location mapping

More detailed navigation menu appears once the specific room is selected

Scenario:

Select application for use while in a specific room

Work Room at Home Specific Application (i.e., Camera)

DMPREHE„Si fE 'H.„„J,„„A HOOP MENU SYSTEM Open SportsCenter while in 'work' room

Access specific app while in entertainment room

Navigate existing rooms to find specific apps

„„.

g 0•0*. g

• ;:f •

Map/copy apps into current room

App becomes permanently mapped to entertainment room

JSE ,PPS Gesture as hot key for the most commonly used apps

Define common use apps; unique and intuitive gestures for each 'common use app'

USER 1NTERA.CTON Rooms

VVHA SAROOM?

A convenient grouping/organization of system tools and applications

Thetools/apps have a relationship that makes sense to the user

(supports the user's m nta

The rooms could be defined by: activity or goal, locationi.e,, work,

home, e c. time of day, etc.

Rooms are defined (created) by he user to support understandin

ease of use, and search efficiency

Rooms support navigation of the d iferent system tools and app !cations

Tools/apps not located within a specific room" shou d be readily

a ai rb e and easy to locate

,NT„„„,R, ,CT1ON Office Room at Home

0: //Av. •

USER ,NTERA...„,./07,0N Entertainment Room at Home

./..W/// ee-- xxxxeeeee effee effeeffeefee xxxxxxeeeee effeeffee

USER ,NTERA,..,„,07,0N Entertainment Room at Home

4,4><4,4.4a0.44Venj,444,07:W

POIV4444r!,//n,04;

?.:40$'44%.,, 4 4;•$-';

7,;41<r:P e'Pr;

444;$P1-

::::gEgESEggg

„„„„„OfloilOtt-

.44,40:47,,,,,m444440:44f444400000

441,44ral ogtve

USER ,NTERA...„,./07,0N Entertainment Room at Home

zezelf/Xeg"

r;r4:4,1

emeememeeeee

V .,,,..•,, A0,,,,,w.,,4,44,,,„,,., , "pop

aSCUSSION Rooms

' ROOMS, EAS:

Users create rooms based on how they think features should be grouped

eature of the system)

-111 system provides pre-populated rooms based on a theme: activity based,

location based, time based, intelligence based, etc.

Combination of system and user defined rooms

,,„„,JSSION Next Steps

NEXT S i,t5dREAS OF Fa US:

Deeper dive on interaction methods for:

Primary and secondary navigation

Set a KA customizatior of menus, dashboards andother content

"Room setup and e-a-= res

Features AND furth r ap enab apps

Exploration and definition of toy B

Create workflows for primary tasks

Determine level of fidelity for next round of deliverables

'frPAgffw,, yew ;4'%gs%oPot,4%

Swipe the side (Sio • Spread hands apart ▪ Bring hands together

wrs;t, movements las ),)nosed to rde arm move

!•%, y

• Al aVe

• Puli hand back Swipe to the side (s ow)

• Hip hand over. sz Close hand • Siie to the sde fr-"-"a ri

Pinch- thumb to fore lint • Pause (hand, .finger,

Stab (Pont)

• we / 6( (“.Ao - Flip hang over

t Plovement

MMERS ,ON ,SRRATION Common Interaction & Input Gestures

Gesture auidethi

Intuitive

Ergonomic for a wide variety of body sizes and abilities

F"laid

Scalable / Discrete (when appropriate-

Cufturally accepted

.00:::.00fti.:00tifOpAvit.

MME, ,SON INSPIRATION The Aeon Project

Expanding radio menu

Icon based main menu

3d helix content management

Pop up 2d alerts

VIDEO: h tp,://v ww,yankodestn.comI2011/08/021 oin

be% ond-au emented-realit-

MK ,E, ,,S ON 7 INSPRATION Mediating Mediums — The digital 3d

2d and 3d objects dl splays

Mapping to 2d sue faces (real and virtual)

Site recognition

Visualizing / manipulating virtual objects

VIDEO: httgit,„vvywyankodesign.com/2011 /09114/virtual-

architecture/

MKERSION f INSP RATION "Sight"

* r=~lo tirng and mapped interfaces

Site recognition

tracking as a means of navigation

VIDEO: http://www.fa stcod esigp .co mil 670420/wa tch-

what-ha ens-ifµ oovie swryiasses-are-evi

ERSJDN / 4NSP RATION Ringo Holographic Interface

Flu a-hoop like interface

Data entry / Game play

VIDEO I: h 2://vommyoutt be.comiwatch?v=t0H I NiNia6zX

3d storage navigation space

Visual grouping by subject and/or color

Organic navigation style

VIDEO I: httg://www.you t be.comiwatch 9 = r 0 ,C4 % 6

VIDEO 2: h (,.;ortilwatc; ?v=!', , xn ip7r

MNE, 3,0, / sPIRATION 3D Navigation with 2D platforms

.464Y ,zzZ,

M ,E, ,S,ON f NSPI RATIO N 3D Organization of 2D Content

Organization of 2d icons l content

F exilD6 ty (maybe too much?)

Personalization

VIDEO: h tp://www,ted.comitalksianand_a.garawala de

,s/oNi INsp RATION The Future of Firefighting

Hand mapped interface

Layered Content

Constant always available, easy to access, corner of user's FOV

On Demand — gestural interaction to initiate, menus to dig deeper

Alerts — pop-up style icons

VIDEO: http://www.youtube.comiwatch?v=QBAnr2g

MK,E,S,ON INSP RATION Other examples

Radial menu

Scalable 3d virtualobjects

2d display of information

Floating interface

VIDEO: h tp:Mmtvw.yo itube,com/wa ch?‘"=Wt,7rnn,

, r 7 7 6'6

Core Technologies Scanning Fiber Projector

• 1 mm x 9mm • Low power consumption • Near zero weight • High-resolution RGB

• Natural 3D Cinematic Reality • Breakthrough technology solves 100+ year

old stereoscopic 3d problem • Proprietary Machine Vision Portfolio

• Breakthrough tech developed at NASA

nfid sri 6

/7 ''. '.ra .::. '.. ' '' ... .:..;:. :- ::?.... , ''''''

4,0 0.44//°4 / e

7. 7 74.: • • / .././##:0

AO 7 • o ••%' 0';,.0 //4.

r 4r „.., im , r , ,„„/„„ , 7 v„

A d A % A /4 A // • r/ z ; , A

r4r,r „‹, ,

r, , , , , //4

M S17•/ V fj2', '/ SS

% r r,e 4, J't • • • • •

7 7,,„ , 7 r 27//, /77/

A /d z / , M

• Complete Wearable Computing Platform & Ecosystem

• Magic Glasstm See-Through Display

• Focus on Gaming/Entertainment • $500b+ Mobile Computing Market • Enabled By Proprietary

Ultralightweight projection And True Lightfield Technology

• Natural Blending Of Digital And Physical Worlds

„, • Overview

. .................................

Additional Game Applications

• 4/ / 4./

• • 4,4

e-55 Z5= OZ555: ////////: Ak/4/444.y.../~/...; /444.4,44.4..../.44/44.4/4,

- „„,,,„„„„, „,„ '' ,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, , , . „..„A

4/11 f'A

•Wee•f(*, /We 7.... .4, '''''' ''''''' '''''''''''' ''''''''' ' ''''' '''''''''''''''''''' '''''''''''''''''''''''''' '''''' A

V;53., ,97///7•/A14,//////////..1.1.14446w. 44, ezeAvir.i.iiikir.,,totototov.e.ow........" %WV', ,

""" '''''''''''''''''' ''''''''''''''''''''''''''''''''''''''''''''''''''''

Virtual Mods Digi/Phys Blend

Dr. Grordborts Invaders • First ever true 3d/ lightfield interactive game • Existing cult fan base around Dr. G's awesome

ray guns • Invaders can expand into massively multi-player

franchise (ex: Halo) • Novel Physical/Digital Experience • Virtual Mods • Novel game engine concept virtual bots use

real Al in the world • User — character interaction is key • Stress tests and helps develop our SDK!

. . . wz. • • %. nyy, • :4;

: • •

„ „ . . . . . . . 4. • • • • • •

VLU N ,,,NsoRywAR

• Setmtrywigre System Attd Seasormetre

%old briitg ti.> life tile ni4c tha you have tway

n't(nit% nrld Ac

• Rod tfie. Averoto, add have tleLof your

yen,' own!

r411.0:,d 6. WEI

ENSORYWAIRE rIASS ES

ic E P S

ENSORY E , TEM

MTN§ IOUS DESIGN STYLE

/„. r;// /4 „„„„„„„„

-....., \

\\— •••••••••••...............:::::::.:::::::.:•: \-:....;,ii:::i::::::.:..i.i.R.,:.:::::::.m

.: \ •

......,..:'.7.:::-ii::.:.

"'" ":,...,:. ''''.'•' '

.....s. ..; ''''

, \ ''\\

...: •:: :;?,.,..: \

• .5 4'.

Strp Oi

Rad aloud from your Book Of Spollint

Sop Um-

Wave &aougyveaNI, Wand % 4.6 dltrigiu

motiom

SKt Thrtz'

Yon •very own tw.,41h wjrat!

The Book Of Spells

• Technology is magic • Wands that work! • Huge Magic Leap tentpole franchise potential • "iTunes" store for digital spells create, share,

sell • Physical and digital sales • Novel Physical/Digital Experience

SENSORY USER NT R CI101 magic lea

e rAP,S4?

0( ...$42, / p. 9 0. „.!. • ...9* • ...

Grocery S opping Scenario Workficr

A mother and her child go grocery shopping together, and decide to use Sensoryware to mak.e their experience more efficient, e f•i3ctive and enjoyable.

Scenario Workflow

Morn, with her daughter in tow, grabs a cart from the entrance of the grocery store.. A series of relevant apps launch automatical including:

Grocery first (or en zed by user defined criteria, dinner recpes)

Coupon book

Recipe book.

Recipe builder

Cost of shopping cart

.... .... . . . . . . ... . . . .

.... . . .. „,. •••:„. .„.„.•

Scenario Workflow

While in the produce section, morn weighs a food item on a scale. The price of the item is automatically entered into the .shopping cart cost totals Additional features of the system are seen in the background

The 'smart grocery list is automatically updated based on location (e.g. focused on fruits and vegetables in the produce section).

Food items on morn's list are visually hi. hiighted in the scene.

her virtLiai food items and Points are added to the child's score as she dentif

Workflow

The child launches a scavenger hunt ,ipp to make b& shopping experience more engaging end educational. The challenge is to locate food items from different countries around the

1 %• • r;" • •.• • • ;. • . ••

;••• eA % . • /

.... . . . . .....

Scene 2b

Scena10 Workflow

In the cereai aisle, mom salads a particular mrea! explore additional meladata, including:

Dietary restriction;:i

t\lutritional information si.ars)

R*of.luct revie,„Ais • odurA comparisons

Customer comments

Available coupons are pref.iented to her by Tbuc

Workflow

At the end of an aisle; a virtual Mario Bataii demonstrates a simple recipe b custorners the necessary ingredients are available in the end dap,

Scenario Workflow

.. . • . •••••••••••••••:,:,:••x,x.x.x

While in the we section of the grocery store, morn decides to search for a specific wine. A virtual map used to navigate to the desired wine..

While -walkng through the aisles, data appears attached to different wines, including

Recommendations from friends

Wines that appear on her personal wine list

.444444444444444444444444444444444444444444444444.144444,,,,,,,,,,,,,

it it it it it it it it it it it it

......66666666666666666666666666666666666666666666666666666666666666666666666666666666666e.466666666666.6.10:0" ...... . Me.,..5 666666666666e

Scenario Workflow

Morn concludes her sno ping experience by walking onto a Magic Leap checkout map, which rings up all the groceries on her list and mentions any items that may have been for

She then czmpletes her checkout through a virtual display ----no crt:3dit card necessary.

,,,,,,,,,,, vs,

• ••••••••• • ss,

Grocery S A A

S‘arAi-AA 7*-0 0." %AI"

Scenes inciuded:

Virtual bookstore (1 scene)

. urgicai procedure (4 scenes)

Yoga .1 scene)

Garnified exercise scene)

Garnifie worker ( scene)

awnwrmw..vz.z.z.z.z.z4mAmr•z4A4.,v,v,vx,,vx.v,z,,v,vx.v..vx,,vx.v..vx,,vx.vx,,vx,

Workflow

Stella operi...3 Up her book totem to reveal an imrnersive virtual bookstore experience.

The virtual environment combines the convenience of an online txyAsiore with the experience of e environment.

;ggittglailik„1„,1_,

Scenario Workflow

A surgeon and his team, including a visiting virtual surgeon, conduct. a pre-operative planning session for an upcomng mitral valve replacement procedure.

The patient's pre-mapped anatomy is available in 3D for the teem to analyze during the planning.

..... ...... ....

Scenario Workflow

Duhng the procedure, the surgeon is able to reference the pre-mapped 3D heart for improving placement accuracy. Meanwhile, a medical student is able to observe virtually from her classroom..

The patient's information is readily available to confirm the pathology; and avoid any critical errors.

4. • 4444.:

Scenario Workflow

DUring a post-operative meetin the surgeon is able to describe how the surgery went using a cross section of Stella's virtual anatomy.

Stella's husband is able to join t meeting virtually whiie et work.

Scenario Workflow

When everyone leaves the hospital room, Steile is be to changer her environment to e more comfortable setting, the beach.

Stella and a friend join a virtual -oga dx.:;F; from the comfort of her

Norkflow

Workflow

Stella enhances her indoor training with a virtual bng experience, where she can feet like she's biking outside on her favorite, route,s.

She is able to track important stat like ride time, distance traveled, and speed. A virtual avatar allow; her to compete with h& own personal best time,

Workflow

A landscaoir enhances hs job with a virtual game, where the is to follow a virtua mapped pattern.

F'onts are received .for accurately following the pattern and 'lifting certain score multipliers before he disappear.

SEs ‘-.A,,,RY\NA.;\E mactiC .

ditr4 a

K EY R D

litutefeW

&e 5 itelik rte

. . ........

MC) USE

fjPER STONE

.,50-0/1 Wheel

R N GS

wh elahn, AAA/

'TINY TOTEMS"

/led- if,

Other ideas

• Plants - For high-dimensional representation of information, map content to familiar nature shapes. Natured encodes vast information in trees, grass, etc. Ex. let each person in an organization have a virtual "plant" they can tweak. They give the plant to the leader, and they encode the color, shape, leaves, flowers, etc. of the plant with their status. If overworked, could be withered, if unhappy leaves could fall, if no resources leaves turn brown, etc. Leader can put all the plants in a "garden." He gets high-bandwidth view of organization through general color of garden. Spotting problem/positive groups is easily graphically. The people

grow their own plants.

Other ideas, cont'd

• Plant as e-mail - Let e-mail be a tree. Branch is a person, leaves are messages. Old messages are brown and eventually fall to ground. Twigs, sub branches are determined by connectivity of CC's or something. User can easily "prune" branches from annoying people, or put those branches on the back of the tree.

Magic Leap: Pocket Totem Concept Virtual Plant

Pocket size (with Sensory Wear) Physical Totem

"Mini Pot"

Virtual Plant will response to: Time Day or Night Sun light direction Temperature Attention -Voice -Virtual Water - Virtual Fertilizer --Tweet or Text messages from distance

Over Time a Virtual Plant will grow out

Magic Leap: Pocket Totem Concept

Virtual Plant

(with Smart Phone/Tablet)

Flower opens with a message when the product is ready. Builds up

anticipation through the process „.. ..„

Card Scenario

Capture Image, on a Card

••••••:‘,

Billboard Scenario

'Building size Giant Flower blooms ee/

Captiitelmage on, a Large fwilding size:

"""""" rd • , ..... • .

Tablet

the uber-spatial web browser • the clickable world lightfield • medical/healthcare ... · swipe...

Documents

clickable peg conjugate obtained by clip photochemistry ......

oligonucleotides with clickable sugar residues: synthesis...

raytrix lightfield camera -...

uno presentation non clickable

add clickable button to digital catalog pages

how to: create a clickable table of contents (toc)...how to:...

clickable documentation

lightfield, inc. is an award winning lighting design

raytrix lightfield camera

lightfield ammunition product catalog

some international charities - clickable tweets

raytrix lightfield camera - gtc on-demand featured...

clickable facebook white paper

clickable” elastins : elastin-like po lypeptides ... ·...

create a clickable title that gets attention

contents (clickable) - cape snake...

uno presentation clickable

lightfield add-ins and automation programming manual ver...

the wedding book 2012 clickable

self myofascial releasemm - lightfield systems