week 05 - uc berkeley school of...
TRANSCRIPT
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
1
Ambient MediaAt the periphery of our awareness
week
05
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
2
Lecture Outline
• Peripheral Awareness
• Ambient Media
• Signs and Representational Fidelity
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
3
Peripheral AwarenessWhat we are attuned to without attending to explicitly
[Weiser, 1995]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
4
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
5www.chromasia.com
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
6
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
7www.brainsinchains.com
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
8
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
9
Locatedness: Calm Technology
We are connected effortlessly to a myriad of familiar details of the world around us.
[Weiser, 1995]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
10
Calm Technology
Engages both the center and the periphery of our attention, and moves back and forth between the two.
[Weiser, 1995]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
11
[Jeremijenko , 1995]
Live Wire
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
12
Tasks in Foreground and Background[Buxton, 1995]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
13
[Buxton, 1995]
HUMAN-HUMAN
BACKGROUNDFOREGROUND
HUMAN-COMPUTER
persistentbursty
conversation, telephone,video conf.
GUIs
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
14
[Buxton, 1995]
HUMAN-HUMAN
BACKGROUNDFOREGROUND
HUMAN-COMPUTER
persistentbursty
conversation, telephone,video conf.
GUIs
Ob
ject
of C
om
munic
atio
n
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
15
[Buxton, 1995]
HUMAN-HUMAN
BACKGROUNDFOREGROUND
HUMAN-COMPUTER
persistentbursty
“Portholes”conversation,
telephone,video conf.
GUIs
Ob
ject
of C
om
munic
atio
n
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
16
[Dourish & Bly, 1992]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
17
[Buxton, 1995]
HUMAN-HUMAN
BACKGROUNDFOREGROUND
HUMAN-COMPUTER
persistentbursty
“Portholes”conversation,
telephone,video conf.
smart house technologyGUIs
Ob
ject
of C
om
munic
atio
n
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
18
Foreground and background
Calm technology engages both the center and the periphery of our attention, and moves back and forth between the two. [Weiser, 1995]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
19
Operations
Actions
Activity
automatic,unconscious
consciousgoal-oriented
Hierarchical StructureActivity Theory
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
20
Operations
Activity
Hammering, changing gears when driving
Putting the roof up, transporting bricks by truck
Building a house
Hierarchical StructureActivity Theory
Example
Actions
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
21
Operations
Actions
Activity
automatic,unconscious
consciousgoal-oriented
Hierarchical StructureActivity Theory
FOREGROUND
BACKGROUND
Foreground and background in calm computing
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
22
Ambient Media
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
23
Ambient Media
Information conveyed via calm changes in the environment so that users are more able to focus on their primary tasks while staying aware of non-critical but important information that affects them.
[Pousman & Stasko, 2006]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
24
Pinwheels: wind of bits[Ishii et al., 1997]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
25
ambientROOM[Ishii et al., 1997]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
26
Orb[Ambient Devices]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
27
Orb[Ambient Devices]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
28
Orb[Ambient Devices]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
29
Remember your color mixer lab assignment?
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
30
LumiTouch[Chang, Resner et al., 2001]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
31
iCom[Agamanolis , 2003]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
32
Ambient Media:Design Principles 1. Display important but not critical information
2. Can move from the periphery to the focus of attention and back again
3. Focus on physical representation in the environment
4. Provide subtle changes to reflect updates in information (should not be distracting)
5. Are aesthetically pleasing and environmentally appropriate
[Pousman & Stasko, 2006]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
33
Representational Fidelity and Signs
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
34
Representational Fidelity
How the data from the world is encoded into patterns, pictures, words, or sounds.
[Pousman & Stasko, 2006]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
35
Sign
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
36
Sign [Peirce 1931-58]
Signifier
The representation of the object, which could be a word, a picture, or a sound.
Sense
The understanding that an observer gets from seeing or experiencing either the signified or its signifier.
Signified
The physical thing or idea that the sign stands for.
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
37
Sign [Peirce 1931-58]
Signifier
The representation of the object, which could be a word, a picture, or a sound.
Sense
The understanding that an observer gets from seeing or experiencing either the signified or its signifier.
Signified
The physical thing or idea that the sign stands for.
Warm, hot, burn, bright, dangerous, etc.
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
38
Types of Signs
• Iconic
• Symbolic
• Indexical
[Peirce 1931-58]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
39
Iconic Signs
Signs that “resemble” or “look like” that to which they refer to. A preference for “visual resemblance” over all other possible sorts resemblance.
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
40
Iconic signsDrawings and caricatures
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
41
Iconic signsImitative gestures and metaphors
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
42
Symbolic Signs
Based on code or rule-following conventions. Fundamentally arbitrary, so the relationship must be learned.
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
43
Symbolic SignsLanguage characters, numbers
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
44
Abstract visual representations
Symbolic Signs
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
45
Indexical Signs
Directly connected to the signified (physically or causally). The link can be observed or inferred.
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
46
Indexical SignsNatural signs
Jason Courtney http://www.perdador.com/f6update/Oc3.html
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
47
Indexical SignsMeasuring instruments (weathercock, thermometer, clock)
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
48
Indexical SignsMeasuring instruments (weathercock, thermometer, clock)
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
49
Indexical SignsSignals
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
50
Indexical SignsRecordings (a photograph, a film, video or television shot, an audio-recorded voice), maps, photos.
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
51
Signs in Context of Use
to represent “cold weather” == Indexical
to represent “snow flake” == Iconic
to represent “GO for ski” == Symbolic
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
52
ICONICResembling or imitating the signified
SYMBOLICArbitrary, rule-following, must be learned
INDEXICALNot arbitrary and is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
53
ICONICResembling or imitating the signified
SYMBOLICArbitrary, rule-following, must be learned
INDEXICALNot arbitrary and is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
54
ICONICResembling or imitating the signified
SYMBOLICArbitrary, rule-following, must be learned
INDEXICALNot arbitrary and is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
55
ICONICResembling or imitating the signified
SYMBOLICArbitrary, rule-following, must be learned
INDEXICALNot arbitrary and is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
56
ICONICResembling or imitating the signified
SYMBOLICArbitrary, rule-following, must be learned
INDEXICALNot arbitrary and is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
57
ICONICResembling or imitating the signified
SYMBOLICArbitrary, rule-following, must be learned
INDEXICALNot arbitrary and is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
58
ICONICResembling or imitating the signified
SYMBOLICArbitrary, rule-following, must be learned
INDEXICALNot arbitrary and is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
59
ICONICResembling or imitating the signified
SYMBOLICArbitrary, rule-following, must be learned
INDEXICALNot arbitrary and is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
60
ICONICResembling or imitating the signified
SYMBOLICArbitrary, rule-following, must be learned
INDEXICALNot arbitrary and is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
61
ICONICResembling or imitating the signified
SYMBOLICArbitrary, rule-following, must be learned
INDEXICALNot arbitrary and is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
62
ICONICResembling or imitating the signified
SYMBOLICArbitrary, rule-following, must be learned
INDEXICALNot arbitrary and is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
63
ICONICResembling or imitating the signified
SYMBOLICArbitrary, rule-following, must be learned
INDEXICALNot arbitrary and is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
64
ICONICResembling or imitating the signified
SYMBOLICArbitrary, rule-following, must be learned
INDEXICALNot arbitrary and is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
65
ICONICResembling or imitating the signified
SYMBOLICArbitrary, rule-following, must be learned
INDEXICALNot arbitrary and is directly connected to the signified
VISUAL
AUDITORY
TACTILE
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
66
ICONICResembling or imitating the signified
SYMBOLICArbitrary, rule-following, must be learned
INDEXICALNot arbitrary and is directly connected to the signified
VISUAL
AUDITORY
TACTILE
OLFACTORY
TASTE
???
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
67
Beyond ambient displays
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
68
Ambient “input methods”Presence and activity sensors Gestural inputTangible interfaces
[Vogel & Balakrishnan, 2004]
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
69
None Noun VerbNoun
and VerbFull
Full
Nearby
Environ-ment
Distant
Metaphor
Embodiment
Ambient Media?
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
70
None Noun VerbNoun
and VerbFull
Full
Nearby
Environ-ment
Distant
Metaphor
Embodiment
Ambient Media?
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
71
Beyond fore vs. background“Load balancing” of senses to reduce cognitive load
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
72
Assignments due this week
• Midterm project proposal due today Tuesday Sep 23
• Potentiometer lab due Wednesday Sep 24
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
73
For this Thursday
• Sensor 2: Force sensitive resistors and photocells
• Arduino as an interface board: Processing
• Read Intro to Processing at processing.org
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
74
Announcement
Design Futures lecture seriesWednesday September 246:00 - 7:30 pm at BCNM Commons (340 Moffitt)
Jennifer Bove, HUGEBen Fullerton, IDEO
‘We’ll Always Have Paris’: What Makes a Memorable Service Experience?
Jennifer Bove and Ben Fullerton will explore what it takes to design services that keep people coming back for more. They will probe the dynamics of this subject, considering along the way other curious questions, such as: why do people get excited about intangible services in the same way they lust after the latest shiny lump of plastic?
Tuesday Week 5: Ambient Media Theory and Practice of Tangible User Interfaces
75
Thanks!