The Value of Now Pervasive Context + Hybrid Awareness

Clark DodsworthProduct strategy, innovation + development

Ambient Intelligence strategy Philips, ‘98

all photos: Philips

© 2002 Elmo Diederiks

Alfred North Whitehead-(1861-1947)First context-aware tools theorist

“Civilization advances by extending the number of important operations which we can perform without thinking of them.”

------ …Context-aware services shouldn’t spike cognitive load.

Sailboat tell-tales

~1900

Rear-view mirrors

1970s

Commercial aviation HUD

“Augmentedenvironments,” sensor nets

1974-8

US DoD air-combat testing

1988

1st car HUD:Cutlass Supreme

Now 20131992+ 2003Horsecarriages

Tom Caudell &David Mizell

CALO project

Prehistory, soon after invention of the sail.

“UbiComp”:Mark Weiser

2007

Hands-up displays

Startups & Acquisitions

Sutherland/Sproull, ‘68: 1st HMDs

Schilit, Theimer, Want, & Adams

1994

1st Context Awareness paper

?

Secretary invented

Context-aware tools begin to

disappear.

Siri founded

Context Awareness Timeline

Constant scenario support

Contextual data

The Value of Now

A.I. =+

Reasons for Context Aware Mobile

1. Diversity of use cases / user.

2. User attention = scarce resource. Tool should learn the user.

Context awareness manages data delivery: What, when, how much, what modality, what priority.

-------------------------------------------------------

Especially when not-to.

Goal of Context Aware Mobile

Adaptively deliver info, hyper-personalized via n dimensions of user + environment states, with high space/time precision, without spiking your cognitive load.

Context + Personal Salience = Value

Good context-aware services require:

1) High-speed, highly parallel hybrid inputs.

2) Fast, highly adaptive hybrid analytics.

3) Distributed, adaptive, hybrid display

methods.

Fortunately, we have models.

Ursi Spaltenstein

The most important rule we can import from biology:

Nature is Always On.

The 2nd most important rule:

Hybrid sensing & hybrid response.

The hardware emulation:

Augmented Reality

Pervasive computing

Context awareness

Semantic Web

Ubicomp & sensor nets Ambient Intelligence

Things that Think

Internet of Things

& Hyper-personalized services…

Your phone is the hybrid Master Sensor for your life; everyone else’s phones help, all the time.

Together, they’re the platform for:

))

• Active only when the brain is not focused on a particular task

• 2 linked brain areas:

A) Empathy re: intent of others,-+ your own state awareness

B) Personal memories + visualization of future scenarios

State & intent awareness

Scenario modeling

Brain photo: Omikron/photoresearchers Network overlay: Olaf Sporns/Indiana Univ. (modified by J. Korenblat)

Human Context-Aware Model: The Brain’s Default Mode Network

“It’s all about long-term, sustaining relationships.”

-Alan Kay (2009), on the trend toward a service-based model.

Context Aware Services: long-term, sustaining, contextually dynamic, hyperpersonalized-relationships between users & info services.

Context Gathering

• Constant autodiscovery of data feeds & sensor feeds.

• Constant 2D & 3D feature I.D. and object recognition.

• Constant motion analysis + evaluation linked to object recognition.

• Constant indoor mapping, 2D & 3D: Ultrasonic & IR-sensing for

position, spatial analysis & modeling.

• Integrated gesture & speech recognition, plus voice ID.

• Constant audio + visual logging with visual & semantic tags.

Context-Driven Use Case

Any licensed character: a useful buddy, a delivery method on top of context-aware, locational, hyper-personalized services. 

The character behavior, persona, & animation: Character Skin.

Entertainment

Genius Loci: The whisper interface

Ad hoc P2P mobile sensor networks, constantly re-forming and informing each other.

• Every phone

• Every moment

• Pooling realtime data • Stored only in the swarm• Hand-off & erase upon exiting• Short-distance wireless• No use of cloud or carriers• Data tied to location

In each locale:

Duration of data retention on any device:A function of # of devices transiting the defined area.

The Ad Hoc Value of Now

All images © Chimera Design 2007-2008

The Ad Hoc Value of Now

Traffic info:Carrier-based + internet

All images © Chimera Design 2007-2008

Traffic info:P2P Ad Hoc realtime locational networks

The Ad Hoc Value of Now

Predictive analytics

Hyper-personalization, relationship mgmt.

Integrated

gesture & voice

Artificial intelligence permeates web svcs.

Data interchange standards.

User monetization of personal data.

Adaptive filtering of realtime data.

Activity awareness & modeling.

Sensor datastream analytics.

QualcommMy6sense, GistAloqua, Xiam

Proximal Labs SemantiStar, HeyZapYour Name Here

Canesta, Apple/Siri Softkinetic, NuanceHunch, Gravity

Sense NetworksCorventis Pachube, Zebek

Autodiscovery: net services &

sensor data

Probabilistic data delivery.

Scarce-resource mgmt..

Constant personal scenario support

Normal Everyday Life

© Clark Dodsworth clark@dodsworth.com

Efficiency & revenue from contextual salience

Transparent Privacy protocols.

Better Security, Better Anonymity.

Context Awareness

Devices & services improve with use.

Data fusion.

‘collaborative sensing’

CALO A. I.

Context Awareness

Full package:Devices,Contextual info services,Retail,Context brokerage & monetization,Support,Billing…

Context Players

clark@dodsworth.com

end OA logo

c. Lynne LaCascia, all rights reserved

Context-driven Use Case: Entertainment

First rule of theme parks: You bring the fun in with you - your friends-& family.

• The attractions you pay for aren’t the experience.

• Now, a new type of friend. For as long as you want.

A licensed character becomes a useful buddy, a delivery method for context-aware, locational, hyper-personalized services. 

Context-Aware Biological Model: The Brain’s Default Mode Network

Functions of consciousness:

1) Constantly evaluate surroundings (physical + human)

2) Constantly judge salience of each aspect of current situation in context of your needs

3) Constantly construct scenarios for next step

Parallel function of context-aware devices:

Assess, select, shape, & deliver salient data (Device awareness augments user’s awareness)

History + current state = basis of decision for next state

Dubailand AR project ’07-‘08

All images © Chimera Design 2007-2008

• Storytelling

• Extension of attractions

• Personal guide/friend

• Contextually customized experiences

• Interaction with park elements

• Wayfinding

• Drill-down for information

• Social networking: local & global

• Database: each user’s interests

• Game play on device & with others

• Marketing: retail opportunities

• Long-Term Relationship:

“follow the visitor

home”

Credits

• First use of term, “context awareness: Schilit, B., Theimer, M. Disseminating Active Map Information to Mobile Hosts. IEEE Network, 8(5) (1994) 22-32

• Schilit, Bill.; Adams, Norman; Want, Roy. Context-Aware Computing Applications. 1st International Workshop on Mobile Computing Systems and Applications. (1994) 85-90

• Default Mode Network paper: Gusnard, DA, Raichle, ME: “Searching for a baseline: the resting human brain from the perspective of functional imaging.” Nature Reviews Neuroscience, 2001

• “iLamps: Geometrically Aware and Self-Configuring Projectors,” Rascar, et al. 2003

• Commercial aviation HUD image courtesy Todd Lapin, cc

• Photo of sail’s tell-tales courtesy Bill Gracey, cc

• Modern helmet-mounted see-through display courtesy Rockwell-Collins: "SIM EYE SR100-A”

• Theme park illustrations © Chimera Design, 2007-2009

• Photo of Dubailand model © Lynne LaCascia, 2009

• Photo of Alfred North Whitehead from Wikipedia.org

Implementation

Contextual mobile broadband services assess, prioritize, & select data to support decisions

• Realtime data mgmt. preserves-focus

• Inverse Content Management System (ICMS)

• Adaptive B2B & B2C service optimization ...the revenue