model of the human name stan emotion happy command watch me face location (x,y,z) = (122, 34,...
TRANSCRIPT
Model of the Human
NameStan
EmotionHappy
CommandWatch me
Face Location(x,y,z) = (122, 34, 205)
Hand Locations(x,y,z) = (85, -10, 175)(x,y,z) = (175, 56, 186)
Model of the Human
NameStan
EmotionSad
CommandWatch me
Face Location(x,y,z) = (122, 34, 205)
Hand Locations(x,y,z) = (85, -10, 175)(x,y,z) = (175, 56, 186)
(x, y,z)(x, y,z)
(x, y,z)
Stan
Model of the current human: description of the current human
Human activity: description of what the user is doing
User’s request: the nature of the interaction, the task the user request of the robot
Human Agent Internal Model
Motivated by desire for natural human-robot interaction
Encapsulates what the robot knows about the human
Identity Location Intentions
Human Agent
Detection module
Monitoring module
Identification module
Human Agent Modules
Detection Module
Allows the robot to detect human presence
Uses multiple sensor modalities
IR motion sensor array Speech recognition Skin-color segmentation Face detection
Monitoring Module
Keeps track of the detected human
Localization and tracking algorithms Face tracking Finger pointing gesture Basic speech interface
Identification ModuleUnder development
Attempts to identify detected human based on stored model and current model
Voice pattern comparison Name Height Clothing color
Detects changes in dynamic model Clothing color Height