robots and agents that care: social, cognitive & affective ... · theories on social, cognitive...
TRANSCRIPT
![Page 1: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/1.jpg)
Mark Neerincx
Gert Jan van der Burg
Robots and Agents that Care: Social, Cognitive & Affective Support
http://www.pal4u.eu/
![Page 2: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/2.jpg)
![Page 3: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/3.jpg)
Method
Situated Cognitive EngineeringSituated Cognitive EngineeringSituated Cognitive EngineeringSituated Cognitive EngineeringF
ou
nd
ati
on
Operational
Demands
Theories on social,
cognitive & affective
processes
Technological
constraints &
opportunities
Effect /
Claim
Function /
Requirement
Use Case
Sp
eci
fica
tio
n Integrated
prototype
Ev
alu
atio
n
Part1 Part1 …
Needs Analysis
![Page 4: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/4.jpg)
Diabetes Camps
Situated Needs Analysis: Photo Elicitation
![Page 5: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/5.jpg)
Diabetes Camps
Draw-Write-Tell
Story-Telling
Image Theatre
Situated Needs Analysis: Creative Methods
![Page 6: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/6.jpg)
Diabetes Camps
5
Calculation SupportHelp for MeasuringFriendship
Play-fellow
Support
...
Creative methods• Draw-write-tell• Image theatre• Story-telling
• Positive: Support of friends • Negative: Diabetes regime • Have fun activities like
others• ...
Photo-elicitation
Situated Needs Analysis: Outcomes
![Page 7: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/7.jpg)
Diabetes Camps
Comparing Italian and Dutch Children’s Experiences Comparing Italian and Dutch Children’s Experiences Comparing Italian and Dutch Children’s Experiences Comparing Italian and Dutch Children’s Experiences
with the Robot at the Campswith the Robot at the Campswith the Robot at the Campswith the Robot at the Camps
Italian camp:
• learning to live with diabetes & needs analysis
• 34 children, age 10-14
Dutch camp:
• sharing leisure experiences & needs analysis
• 21 children, age 8-11
Child-robot activities (quiz & sorting game):
• Sentiment Analyses on child’s textual answers)
• Observations of speech, gestures and posture
Results
• Children were lenient &
positive
• Emotional expressions differ
per activity
• Italians more expressive, less
eye contact
• User requirements for culture-
aware personalization
![Page 8: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/8.jpg)
Method
Situated Cognitive EngineeringSituated Cognitive EngineeringSituated Cognitive EngineeringSituated Cognitive EngineeringF
ou
nd
ati
on
Operational
Demands
Theories on social,
cognitive & affective
processes
Technological
constraints &
opportunities
Effect /
Claim
Function /
Requirement
Use Case
Sp
eci
fica
tio
n Integrated
prototype
Ev
alu
atio
n
Part1 Part1 …
Needs Analysis
![Page 9: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/9.jpg)
Needs Synthesis
• Use cases
• Values
• Requirements
• Claims
8
• Personas
• Journey maps
• Storyboards
Effect /
Claim
Function /
Requirement
Use Case
• Diabetes camps
• Focus groups
• Interviews
• Stakeholder analysis
Deriving Design SpecificationsDeriving Design SpecificationsDeriving Design SpecificationsDeriving Design Specifications
![Page 10: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/10.jpg)
Involving Parents and Caregivers as PAL -Users
9
PAL Control & Monitor• Child profile• Goal setting• Authoring• Monitoring• …
“Blended Care”• Caregivers are present during
child-robot activities• Policies and agreements on
• Goals• Information sharing (privacy)
![Page 11: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/11.jpg)
![Page 12: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/12.jpg)
Method
Situated Cognitive EngineeringSituated Cognitive EngineeringSituated Cognitive EngineeringSituated Cognitive EngineeringF
ou
nd
ati
on
Operational
Demands
Theories on social,
cognitive & affective
processes
Technological
constraints &
opportunities
Effect /
Claim
Function /
Requirement
Use Case
Sp
eci
fica
tio
n Integrated
prototype
Ev
alu
atio
n
Part1 Part1 …
Needs AnalysisSelf-Determination
Theory
![Page 13: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/13.jpg)
PAL prototype version 0.1
12
![Page 14: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/14.jpg)
Requirements Baseline
HighHighHighHigh----Level RequirementsLevel RequirementsLevel RequirementsLevel Requirements
Autonomy Competence Relatedness
Timeline create (timeline
related) goals
edit activities (e.g.
school, sport, meal)
and measurements
add photo’s, mood and
thoughts
Avatar guides the children
through the selection
process
praises adherence
and progress
discusses activities, matches
child mood, shares stories &
photos of itself
Self-Determination Theory
![Page 15: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/15.jpg)
Method
Situated Cognitive EngineeringSituated Cognitive EngineeringSituated Cognitive EngineeringSituated Cognitive EngineeringF
ou
nd
ati
on
Operational
Demands
Theories on social,
cognitive & affective
processes
Technological
constraints &
opportunities
Effect /
Claim
Function /
Requirement
Use Case
Sp
eci
fica
tio
n Integrated
prototype
Ev
alu
atio
n
Part1 Part1 …
Needs AnalysisSelf-Determination
Theory
![Page 16: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/16.jpg)
Evaluation at Diabetes Camp
Formative Cooperative EvaluationFormative Cooperative EvaluationFormative Cooperative EvaluationFormative Cooperative Evaluation
MyPal (timeline)
PAL Avatar
Recommendations for
• Functions
• Ease of Use
• Attractiveness
• …
Recommendations for
• Personalization
• Behaviours
• Appearances
• …
![Page 17: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/17.jpg)
Evaluation in Hospital and Home
Formative Usage EvaluationFormative Usage EvaluationFormative Usage EvaluationFormative Usage Evaluation
13 participants (age: 7-12; 4 girls, 9 boys)
Patients at Ziekenhuis Gelderse Vallei
Three parts:
• Introduction session at hospital
• Two-week myPAL use at home
• Evaluation session at hospital
![Page 18: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/18.jpg)
Evaluation in Hospital and Home
OutcomesOutcomesOutcomesOutcomes
“Overachievers”
![Page 19: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/19.jpg)
PAL prototype version 1.0
.
4 week experiment period (Home)
Use of PAL system (Quiz, timeline)
1st Appointment (Hospital)
• QOL questionnaire• Interview• Introduction MyPal• Set goals in MyPal• Nao introduction • Play with Nao
3rd Appointment
(Hospital)
• Interview• Play with NAO
2nd Appointment
(Telephone)
• General check-up• Interview
Experiment in Italy and NetherlandsExperiment in Italy and NetherlandsExperiment in Italy and NetherlandsExperiment in Italy and Netherlands
Design and procedureDesign and procedureDesign and procedureDesign and procedure
![Page 20: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/20.jpg)
PAL Year 1: First analysis of individual system usage and knowledge developement.
3 trends
19
![Page 21: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/21.jpg)
PAL Year 1: First analysis of individual system usage and knowledge developement.
3 trends
• Minimal use during whole period
![Page 22: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/22.jpg)
PAL Year 1: First analysis of individual system usage and knowledge developement.
3 trends
• Minimal use during whole period
• Initial use with decrease over time
![Page 23: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/23.jpg)
PAL Year 1: First analysis of individual system usage and knowledge developement.
3 trends
• Minimal use during whole period
• Initial use with decrease over time
• Consistent use during whole period
![Page 24: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/24.jpg)
Evolving Empirical Foundation
![Page 25: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/25.jpg)
Method
Situated Cognitive EngineeringSituated Cognitive EngineeringSituated Cognitive EngineeringSituated Cognitive EngineeringF
ou
nd
ati
on
Operational
Demands
Theories on social,
cognitive & affective
processes
Technological
constraints &
opportunities
Effect /
Claim
Function /
Requirement
Use Case
Sp
eci
fica
tio
n Integrated
prototype
Ev
alu
atio
n
Part1 Part1 …
Needs AnalysisSelf-Determination
Theory
BDI-agent
Ontological Reasoning
![Page 26: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/26.jpg)
Percepts:
• Performance
• Facial expressions
• Heart rate
• …
Actions:
• Choose answer
• Motivational feedback
• Propose activity (switch)
• …Goals:
• Play 4 quiz sessions
• Establish level X
• Share emotions within
boundaries
• …Beliefs:
• Child’s emotion
• Child’s skill level
• Child’s preference
• …
Emotions:
• Valence
• Arousal
Child-Agent Interaction
![Page 27: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/27.jpg)
We kunnen een quiz spelen, dagboekje
invullen en je diabetesdoelen
bekijken
![Page 28: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/28.jpg)
“No machines with self-sustaining long-term goals and intent have been developed, nor are they likely to be developed in the near future”
Stone et al. (Sept 2016). Artificial Intelligence and Life in 2030. One Hundred Year Study on Artificial Intelligence: Report of the 2015-2016 Study Panel, Stanford University, Stanford, CA
![Page 29: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/29.jpg)
Model-based
Data-driven
KnowledgeBase
learnin
g
interactive thing
effectorssens
ors
interactive thing
ontologypolicies simulations
sens
ors effectorsse
nsor
s
effectors
sens
ors
effectors
BC-Strategies
DM-Protocols RelationshipsEmotion
PrivacyGoal-Setting
http://www.pal4u.eu/
Human Values Situated Evolutionary
![Page 30: Robots and Agents that Care: Social, Cognitive & Affective ... · Theories on social, cognitive & affective processes Technological constraints & opportunities Effect / Claim Function](https://reader035.vdocument.in/reader035/viewer/2022062604/5fc079f6bfbcdf3e2d054243/html5/thumbnails/30.jpg)
Partners of the project
Co-funded by the Horizon 2020 Framework Programme of the European Union under grant agreement no 643783
Thank you for your attentionThank you for your attentionThank you for your attentionThank you for your attention