sentient computing ubiquitous computing vision computing devices everywhere access to applications...

Sentient Computing

Ubiquitous Computing visionComputing devices everywhere

Access to applications anywhere

Whatever is on hand is available

Sentient Computing visionUbiquitous Computing made context-aware

Physical context used for automatic control

Sensors and space are part of computing systems

Programming With Space

The componentsNotions and representations of physical space

Data and computational models

Sensor information

User interface the real world

Components for Programming With Space

Devices

Platforms

Sensors

Networks

+Architecture

Conduits

Components for Programming With Space

Devices

Platforms

Sensors

+Architecture

Sensors: Location Information

Containment– GSM, UMTS, broadband radio– Active badge

Proximity – Bluetooth, IrDA– PICOnet

Co-ordinate– GPS– Active bat

Sensors: Location Information

Containment– GSM, UMTS, Broadband Radio– Active Badge

Proximity – Bluetooth, IrDA– PICOnet

Co-ordinate– GPS– Active bat

Containment: Active Badge

Infra-Red Network 10 meter range

diffuse

room-scale location

Sensors: Location Information

Containment– GSM, UMTS, Broadband Radio– Active Badge

Proximity – Bluetooth, IrDA– PICOnet

Co-ordinate– GPS– Active Bat

Sensors: Location Information

Containment– GSM, UMTS, broadband radio– Active badge

Proximity – Bluetooth, IrDA– PICOnet

Co-ordinate– GPS– Active bat

Ultrasonic Location System

Mobile transmitter (Bat)

Fixed receiversCeiling

Active BatsUltrasonic transponder

Measure pulse time-of-flight

Radio synchronised

DSP Ceiling Array

25,000 MIPS to cover AT&T Laboratories Cambridge!

Components for Programming With Space

Devices

Platforms

Sensors

Networks

+Architecture

Conduits

Telephone318

Computer“Pumpkin”

Computer“Papaya” Person

“Mike”

Person“Pete”

Representing the Real World

Model real world as collection of objects

Computer“Plantain”

Person“Andy”

Follow-mePhonebook

MobileDesktop

Telephone241

Telephone217

CTIswitch

Resourcemonitor

Keyboardmonitor

Locationservice

Applications

Software objects

Sensors

– Objects maintain state using sensor data

– Applications query relevant sets of objects

Data Model Visualisation

Spatial Monitoring

Vague spatial facts formalised as geometric containment and overlapping relationships between spaces

X

M

‘X is holding the microphone M’‘X can be seen by

camera B but not by camera A’

A

B

X

Spatial Indexing

Generates all positive/negative overlapping or containment events

thro

ug

hp

ut

(‘00

0 u

pd

ates

s-1)

1

3

2

4

population (‘000)10 20 30

non-overlapping spaces

overlapping spaces

Putting It All Together

Move user’s desktop to screen in front of them

Visible

A

Visib

le

B

Visible

C

Callbacks

Registration+ve Containment (Andy)-ve Overlapping (Andy)

-ve Overlapping(Andy,”Visible B”)

CLEAR DESKTOP FROM B

-ve Overlapping(Andy,”Visible A”)

CLEAR DESKTOP FROM A

+ve Containment(Andy,”Visible B”)

MACHINE B: NOT IN USEMOVE DESKTOP TO B

+ve Containment(Andy,”Visible C”)MACHINE C: IN USE NO ACTION

Example Applications

Corporate memoryRecord me / what’s around me

Annotate multimedia stream

Camera field-of-view

Flat display

Compositedisplay

“Plonk-and-play” systemsSpatial configuration determines logical

configuration

No need to know device IDs

Automatic personalisation

Sentient Computing: New User Interfaces

Non-user interfaces!

Objects and people are cursors in the real-world of icons

Aural and visual feedback