robotic assistants - intechopen

35
Robotic Assistants: Science meets Fiction Carme Torras @

Upload: others

Post on 16-Jul-2022

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Robotic Assistants - IntechOpen

Robotic Assistants: Science meets Fiction

Carme Torras @

Page 2: Robotic Assistants - IntechOpen

Robots>10

Doctors28

PhD students37

Technicians10

Support staff14

People:

Institut de Robòtica i Informàtica Industrial

Page 3: Robotic Assistants - IntechOpen

Perception and Manipulation Lab

Robot manipulators in human environments

✦ Learning from demonstration ✦ Planning and perception for manipulation

✦ Perception of rigid and non-rigid objects

Page 4: Robotic Assistants - IntechOpen

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

Carme Torras @ / 35

1. From industrial to assistive robotics

2. Research challenges: illustrative projects

3. Ethical and social implications

Institut de Robòtica i Informàtica Industrial

4

Presentation outline

Page 5: Robotic Assistants - IntechOpen

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

Carme Torras @ / 35 5

Assistance to disabled and elderly people

Urban guidance, shopping helpers, cleaning

Co-workers in workshops and factories

Training and education

Industrial robots Assistive robots

Page 6: Robotic Assistants - IntechOpen

Carme Torras @ / 35

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

6

World’s largest civilian robotics programme

Page 7: Robotic Assistants - IntechOpen

Carme Torras @ / 35

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

7

Industrial robots Assistive robots

Easy to program by non-experts

Intrinsically safe for people

Able to perceive and manipulate deformable objects

Tolerant to noisy perceptions and inaccurate actions

Capable of goal-directed execution

Collaborating with people

Programmed by experts

Caged

Rigid objects -

Accurate

Fixed sequences

Non-interactive

Page 8: Robotic Assistants - IntechOpen

Carme Torras @ / 35

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

Challenges

8

Industrial robots

Easy to program by non-experts

Intrinsically safe for people

Able to perceive and manipulate deformable objects

Tolerant to noisy perceptions and inaccurate actions

Capable of goal-directed execution

Collaborating with people

Programmed by experts

Caged

Rigid objects -

Accurate

Fixed sequences

Non-interactive

Page 9: Robotic Assistants - IntechOpen

Carme Torras @ / 35

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

9

Challenges Techniques

Easy to program by non-experts

Intrinsically safe for people

Able to perceive and manipulate deformable objects

Tolerant to noisy perceptions and inaccurate actions

Capable of goal-directed execution

Collaborating with people

Initial guidance + reinforcement

Modelling robot dynamics

Visual learning + task-oriented descriptors

Probabilistic state and action representations / uncertainty

Learning to plan

Learning from demonstrations

Page 10: Robotic Assistants - IntechOpen

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

Carme Torras @ / 35

1. From industrial to assistive robotics

2. Research challenges: illustrative projects

3. Ethical and social implications

Institut de Robòtica i Informàtica Industrial

10

Presentation outline

Page 11: Robotic Assistants - IntechOpen

Carme Torras @ / 35

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

11

Challenges Techniques

Easy to program by non-experts

Intrinsically safe for people

Able to perceive and manipulate deformable objects

Tolerant to noisy perceptions and inaccurate actions

Capable of goal-directed execution

Collaborating with people

Initial guidance + reinforcement

Modelling robot dynamics

Visual learning + task-oriented descriptors

Probabilistic state and action representations / uncertainty

Learning to plan

Learning from demonstrations

Page 12: Robotic Assistants - IntechOpen

Easy to program / safe for people

Page 13: Robotic Assistants - IntechOpen

Carme Torras @ / 35

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

13

Initial guidance + reinforcement learning

Dynamic Movement Primitives (DMP):

Compact, rescalable, intuitive parametrization

IROS'14

Page 14: Robotic Assistants - IntechOpen

Easy to program / safe for people

Page 15: Robotic Assistants - IntechOpen

Easy to program - bimanual skills

Page 16: Robotic Assistants - IntechOpen

Carme Torras @ / 35

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

16

Challenges Techniques

Easy to program by non-experts

Intrinsically safe for people

Able to perceive and manipulate deformable objects

Tolerant to noisy perceptions and inaccurate actions

Capable of goal-directed execution

Collaborating with people

Initial guidance + reinforcement

Modelling robot dynamics

Visual learning + task-oriented descriptors

Probabilistic state and action representations / uncertainty

Learning to plan

Learning from demonstrations

Page 17: Robotic Assistants - IntechOpen

Carme Torras @ / 3617

Garment recognition and pose estimation

Usual approach:

Re-grasping to place garment in a standard configuration eases perception but is slow…

Our approach:

Involved computer vision and machine learning algorithms for informed (task-oriented) one-shot grasping

Page 18: Robotic Assistants - IntechOpen

Carme Torras @ / 35

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

18

Visual recognition for informed grasping

Clothing dataset with labelled parts

ICRA’12 - IROS’13 - EAAI, 2014

(Bag-of-Words + SVM) for part location

Page 19: Robotic Assistants - IntechOpen

Visual recognition for informed grasping

Page 20: Robotic Assistants - IntechOpen

Perceiving and manipulating other deformable objects

Page 21: Robotic Assistants - IntechOpen

Carme Torras @ / 35

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

Easy to program by non-experts

Intrinsically safe for people

Able to perceive and manipulate deformable objects

Tolerant to noisy perceptions and inaccurate actions

Capable of goal-directed execution

Collaborating with people

Initial guidance + reinforcement

Modelling robot dynamics

Visual learning + task-oriented descriptors

Probabilistic state and action representations / uncertainty

Learning to plan

Learning from demonstrations

21

Challenges Techniques

Page 22: Robotic Assistants - IntechOpen

IntellAct: Intelligent observation and execution of Actions and manipulations

Probabilistic representations / Learning to plan

Page 23: Robotic Assistants - IntechOpen

Carme Torras @ / 35

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

23

On-line learning Starts with no previous knowledge Initial demonstration --> rules Adapts to changes --> rule prob. updates

Active requests for teacher help Guide the teacher to minimize interaction Explain planning failures Sketch options: new actions, state changes

Learning to plan: RL + demonstrations

Two options (in red)

ICRA’14, Special Issue "AI and Robotics", 2015

Page 24: Robotic Assistants - IntechOpen

Learning to plan: Teacher help

Page 25: Robotic Assistants - IntechOpen

Learning to plan for goal-directed execution

Page 26: Robotic Assistants - IntechOpen

IntellAct Online Perception

Page 27: Robotic Assistants - IntechOpen

IntellAct Online Monitoring and Execution

Page 28: Robotic Assistants - IntechOpen

Carme Torras @ / 35

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

Easy to program by non-experts

Intrinsically safe for people

Able to perceive and manipulate deformable objects

Tolerant to noisy perceptions and inaccurate actions

Capable of goal-directed execution

Collaborating with people

Initial guidance + reinforcement

Modelling robot dynamics

Visual learning + task-oriented descriptors

Probabilistic state and action representations / uncertainty

Learning to plan

Learning from demonstrations

28

Challenges Techniques

Page 29: Robotic Assistants - IntechOpen

Learning to collaborate from demonstrations

AAAI'13

Page 30: Robotic Assistants - IntechOpen

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

Carme Torras @ / 35

1. From industrial to assistive robotics

2. Research challenges: illustrative projects

3. Ethical and social implications

Institut de Robòtica i Informàtica Industrial

30

Presentation outline

Page 31: Robotic Assistants - IntechOpen

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

Carme Torras @ / 35 31

Moral issues: military, legal liability, digital gap, …

Robotic assistants differ from other technologies in entering the domain of human feelings.

Ethical and social implications

How will human nature change with increasing H-R interaction?

Page 32: Robotic Assistants - IntechOpen

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

Carme Torras @ / 35 32

Artificial retinas, sensorized dresses, exoskeletons, telepresence… robotic prostheses expand our body

Robots and humans… two types of ties

Living with butlers and artificial nannies, learning from robotic teachers, sharing work and leisure with humanoids... will enhance our intellectual and social habits? will develop new ones?

Page 33: Robotic Assistants - IntechOpen

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

Carme Torras @ / 35 33

➢ N. Sharkey & A. Sharkey: "The crying shame of robot nannies: an ethical appraisal". (Pros and cons of robot nannies)

Classic science-fiction stories:

➢ I. Asimov (1950) "I, Robot" (protect vs. freedom) ➢ Ph.K. Dick (1955) "Nanny" (animate vs. inanimate) ➢ R. Bradbury (1969) "I sing the body electric" (acceptance-

immortality, sincerity)

Science meets fiction

2010: Special issue of the journal Interaction Studies

Page 34: Robotic Assistants - IntechOpen

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

Carme Torras @ / 35 34

Can the effects of technology on human evolution be predicted?

Methodological difficulties: ● Appearance of unforeseen uses for devices (Ihde, 2004) ● Limitations of language to describe the future: “it is

through technique that we perceive the sea as navigable” (Heidegger)

● Cannot be studied separately from the socio-cultural context: Social construction of reality (Berger and Luckmann, 1966)

Joint work with F. Ballesté (Humanities, UOC)

Page 35: Robotic Assistants - IntechOpen

CELEBRATING 10 YEARS 33

C

ELEBRATING Y E A R S

Carme Torras @ / 35 35

“It is the relationships that we have constructed which in turn shape us”

Robert C. Solomon, “The Passions”

Robotic assistants: social and ethical implications

Neal Stephenson, “Innovation starvation”

“Science fiction provides coherent scenarios of a technology integrated into a society, into an economy, and into people’s lives”

The future holds exciting technoscientific, ethical and anthropological challenges