theory of affect part two ms2306
DESCRIPTION
Theory of Affect Part Two MS2306. From rational machines to affective computing. See IBM film from 1965 (first 2mins) See Royal Society Summer Exhibition (2mins). This week. Defining affect The marketing of affect Affect and HCI. The Atmosphere of Affect. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/1.jpg)
Theory of Affect
Part Two
MS2306
![Page 2: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/2.jpg)
From rational machines to affective computing
• See IBM film from 1965 (first 2mins)
• See Royal Society Summer Exhibition (2mins)
![Page 3: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/3.jpg)
This week
1. Defining affect2. The marketing of affect3. Affect and HCI
![Page 4: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/4.jpg)
The Atmosphere of Affect
Insubstantiality of affect makes it difficult to
touch. It has no substance (form), but it
does have an influence… a force…
![Page 5: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/5.jpg)
Nonrepresentation
What is in the box?
![Page 6: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/6.jpg)
Theories of Affect
• What is Affect? (Thrift, 2008 pp. 175-182)
• No stable definition of affect
• Not just about feeling or emotion, more about motion, social interaction…
![Page 7: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/7.jpg)
Affect is not the opposite of cognition
• Affect is not irrational
• Alternative way of thinking about the world – a different kind of intelligence (Thrift, 2008)
![Page 8: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/8.jpg)
Emotion/Cognition
![Page 9: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/9.jpg)
Four Approaches to Affect
![Page 10: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/10.jpg)
Four Approaches to Affect 1. Darwin’s study of
emotions
• Universal emotion• Affective expression
evolutionary– Preparing humans and
animals for action• Omits communicative
affect
The Expression of the Emotions in Man and Animals in 1872
![Page 11: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/11.jpg)
![Page 12: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/12.jpg)
![Page 13: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/13.jpg)
![Page 14: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/14.jpg)
Slight Sadness Fear mixed with surprise
Happiness and contempt
Sadness and fear
Disgust and contempt
Fear and surprise Questioning surprise
Neutral
![Page 15: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/15.jpg)
Four Approaches to Affect2. Psychoanalytical Affect
• Emotions part of the inner unconsciousness of the individual
• Linked to biological drives
• A biologically-derived affect
Is psychoanalysis dead or just unconscious?
Freud
![Page 16: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/16.jpg)
Four Approaches to Affect3. Bodily States and
Processes
• Criticises idea of subjects “talking about” their emotion
• Source of emotions can come from outside the body
• Blushes, laughs, crying and anger are visceral responses to others
![Page 17: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/17.jpg)
Four Approaches to Affect4. Manifold “Psychology”
of Affect
• Capacity to affect and be affected
• Like insects, swarms
• Emergent interactions driven by sensory environment
![Page 18: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/18.jpg)
Crowd Theory
![Page 19: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/19.jpg)
Feeling, Emotion, Affect
Feeling, Emotion, Affect by Eric Shouse (drawing on Brian Massumi)M/C Journal, Affect. Volume 8, Issue 6 Dec. 2005
![Page 20: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/20.jpg)
Feeling• A sensation
• ‘Checked against previous experiences’
• Labeled (I feel happy, hurt, angry, scared…)
• ‘Personal and biographical’ – ‘every person has a distinct set of
previous sensations from which to draw when interpreting and labeling’
Feeling, Emotion, Affect by Eric Shouse M/C Journal, Affect. Volume 8, Issue 6 Dec. 2005
![Page 21: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/21.jpg)
Emotion• A projection
• Display or broadcast of a feeling
• Can be either genuine or feigned
• Paul Ekman’s experiment
• American and Japanese subjects watched films depicting facial surgery
– When alone - displayed similar expressions
– When in groups - expressions were different
Feeling, Emotion, Affect by Eric Shouse M/C Journal, Affect. Volume 8, Issue 6 Dec. 2005
![Page 22: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/22.jpg)
Affect• A non-conscious experience
of intensity
• A moment of unformed and unstructured potential - Always prior to and/or outside of consciousness (Massumi in Parables of the Virtual)
• The body’s way of preparing itself for action (decision making)
Feeling, Emotion, Affect by Eric Shouse M/C Journal, Affect. Volume 8, Issue 6 Dec. 2005
![Page 23: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/23.jpg)
Putting Affect to Work?
• Thrift locates the “strategic” use of affect in political and corporate arenas…
• He also refers to its location in design
![Page 24: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/24.jpg)
The marketing of affect
Look at how good Apple are at developing affective relations between users (consumers), brands and products
![Page 25: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/25.jpg)
Computer design has not however always considered human emotion
![Page 26: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/26.jpg)
IBM’s Design of Computers
![Page 27: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/27.jpg)
IBM’s Design of Computers
![Page 28: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/28.jpg)
IBM’s Design of Computers
![Page 29: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/29.jpg)
Emotional Design?
![Page 30: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/30.jpg)
The marketing of affectCorporations in the business of making 'hormonal’splashes through increasing contact with consumers
(Thrift p. 247)
![Page 31: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/31.jpg)
The marketing of affect
![Page 32: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/32.jpg)
![Page 33: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/33.jpg)
Affective Computing
![Page 34: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/34.jpg)
Affective Computing
• Field concerns emotions and computers
• A major shift from traditional “rationale” computer research
![Page 35: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/35.jpg)
![Page 36: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/36.jpg)
But Jim, human emotions are irrational
Affective Computing
Main focus on the link between emotion and…
Decision making LearningMemory processes
![Page 37: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/37.jpg)
Neuroscience• Antonio Damasio (1994)
located the importance of emotions in thinking processes
• I think therefore I am• I feel therefore I am
![Page 38: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/38.jpg)
Descartes' Error?
![Page 39: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/39.jpg)
Indecision• Contrary to Spock,
experiments with real people with brain disorders that produce a lack of emotion were found to be terrible at making decisions
• Consider all the possibilities
• Continue analyzing
• Unable to conclude
![Page 40: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/40.jpg)
Affective Computing
1. Can computers express, recognize and understand emotions?
2. Is a computer able to feel?
See Eerik Vesterinen’s literature review - Locates prominent research questions in the field
![Page 41: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/41.jpg)
![Page 42: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/42.jpg)
How do computers express emotions?
• Like an actor controlling facial expressions, stance, voice tone, proximity etc…
![Page 43: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/43.jpg)
Expressing emotions
• A computer can express emotions without really “having” emotions, or without really “feeling”
![Page 44: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/44.jpg)
• Videos of MIT's Nexi MDS Robot: First Test of Expression
• - Official MDS Robot Video - First Test of Expressive Ability (Longer version)
![Page 45: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/45.jpg)
How do computers recognize emotions?
• A computer must have senses
• Audio to hear vocal intonations
• Video to see facial expressions
• Try it out on the Affectiva website
• http://www.affectiva.com/affdex/?#pane_tryit
• Read about it: http://www.npr.org/2012/02/03/146343563/how-did-that-ad-make-you-feel-ask-a-computer
![Page 46: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/46.jpg)
How do computers recognize emotions?
• Reading infrared body temperature and measuring electrothermal skin conductivity
• Measuring heart rate and respiration• Uses these inputs to infer an emotional state
![Page 47: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/47.jpg)
How do computers recognize emotions?
• Testing a computer’s ability to guess the emotional state of a user
Joseph Weizenbaum’s Eliza (Java Version
Article by Noah Wardrip-Fruin
Eliza, Tale-Spin, and SimCity
“Jenn” at alaskaair.com
Alicebot.Org
![Page 48: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/48.jpg)
Can Computers Feel?• Picard (1998) proposes a
model of five components that should all be present in a system if it is to have emotions.
1. Emergent Emotions2. Fast Primary Emotions3. Cognitive Emotions4. Emotional Experience5. Body-Mind Interactions
See also Picard’s AFFECTIVE COMPUTING FOR HCI
![Page 49: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/49.jpg)
Four HCI Goals in Affective Computing
1. Reducing user frustration– Listening– Empathic– Sympathetic
2. Enabling comfortable communication of user emotion– Voice tone– Sense facial expressions
3. Developing infrastructure and applications to handle affective information
– Affective “wearables”4. Building tools that help develop social-emotional skills
– Autism Research
See Picard’s AFFECTIVE COMPUTING FOR HCI
![Page 50: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/50.jpg)
Designing Sensory Environments
• See Neurosky• Affective Gaming• "The Sinking City of
Atlantis“• Firm adds smell to video
games
![Page 52: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/52.jpg)
Tony’s Seminar
![Page 53: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/53.jpg)
Sadness and fear
Slight Sadness
Disgust
Last Week
This week!
![Page 54: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/54.jpg)
Affect Part Two
Textual Analysis of Affective Responses to Open Ended Questions
Watch this video – think of it as an experience
http://www.youtube.com/watch?v=KczxsvVvqGE
![Page 55: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/55.jpg)
Part TwoTASK• Set up a simple user experience (watch a video, play a game, fill in a form…)• Ask at least three (reasonably) open ended questions about the experience and write down
the responses. – What concerns did you have during your experience?– How did you feel during the experience?
• Encourage the user to expand on points relating to how they felt.– Why were you excited?– Was there anything that frustrated you?
• Analyse key parts of the text using (a) a pen to circle positive and negative affective words and (b) using the below free software
• Emotional text recognition using Whissell’s Dictionary of Affective Language (DAL) http://sail.usc.edu/~kazemzad/emotion_in_text_cgi/DAL_app/
![Page 56: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/56.jpg)
Part TwoEmotional text recognition using Whissell’s Dictionary of Affective Language (DAL)
Rating emotional content of words • Positive or Negative Pleasant
(1)>>>In Between (2)>>>Unpleasant (3) • Activation of emotion by size Passive
(1)>>>In Between (2)>>>Active (3)
• Hard to Imagine (1)>>>In Between (2)>>>Easy to Imagine (3)
See Cynthia Whissell academic homepage
![Page 57: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/57.jpg)
distressed distrustful doubtful drowsy dumbfounded eager earnest elated enthusiastic embarrassed embittered envious exasperated excited ecstatic exuberant fascinated fed up forlorn frightened full of contempt full of hatred full of regrets full of reverence furious gloomy grateful grief-stricken guilty happy helpless hesitant homesick hopeful hopeless horrified
scared sensual serene shy sorry stimulated stubborn surprised tender tense tired touched triumphant undecided uneasy unhappy vengeful warmhearted weak worried
affectionate afraid agitated amazed amused angry anguished annoyed anxious apathetic ashamed astonished bored calm carefree cheerful compassionate confident confused contented courageous cowardly curious dejected delighted depressed desirous desperate despondent disappointed discontented discouraged disdainful disgruntled disgusted dismayed
hostile humble ill at ease impatient impressed in high spirits in love indecisive indifferent indignant inspired interested intimidated intolerant jealous joyful jubilant listless lively lonely melancholic nervous nostalgic offended outraged overexcited passionate proud puzzled relaxed relieved repelled resigned respectful sad satisfied
In K. R. Scherer (Ed.) (1988). Facets of emotion: Recent research (pp. 241-243). Hillsdale, NJ: Erlbaum. [Version revised by the members of the Geneva Emotion Research Group]. Copy retrieved [Date] from http://www.unige.ch/fapse/emotion/resmaterial/resmaterial.html
Pleasant (1)>>>In Between (2)>>>Unpleasant (3) Passive (1)>>>In Between (2)>>>Active (3) (activation)Hard to Imagine (1)>>>In Between (2)>>>Easy to Imagine (3)
![Page 58: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/58.jpg)
What can this tell us about the user experience?
What did the user find pleasant?
What did the user find unpleasant?
What affective words elicit active or passive emotional responses?
![Page 59: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/59.jpg)
Part Two
“I was impressed by the interface. However, I felt a little anxious to begin with. A little uneasy at first, kind of nervous, but I became more confident. The bit in the middle made me feel quite tense, but I was excited. Overall I’m very happy with my performance, although I am hated the music.”
Pleasant (1)>>>In Between (2)>>>Unpleasant (3) Passive (1)>>>In Between (2)>>>Active (3) (activation)Hard to Imagine (1)>>>In Between (2)>>>Easy to Imagine (3)
![Page 60: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/60.jpg)
![Page 61: Theory of Affect Part Two MS2306](https://reader035.vdocument.in/reader035/viewer/2022062816/568148f7550346895db61a6a/html5/thumbnails/61.jpg)
Watch
• Don Norman: The three ways that good design makes you happy
• http://www.youtube.com/watch?v=RlQEoJaLQRA