tele-operation of a humanoid robot, using operator bio-data

26
#iSAIRAS 2014 tele-operation for humanoid using operator bio-data M. Luciw, A. Förster, J. Schmidhuber istituto dalle molle di studi sull’intelligenza artificiale università della svizzera italiana idsia / usi / supsi Jürgen ’Juxi’ Leitner

Upload: juxi-leitner

Post on 07-Jun-2015

342 views

Category:

Science


4 download

DESCRIPTION

We present our work on tele-operating a complex hu- manoid robot with the help of bio-signals collected from the operator. The frameworks (for robot vision, collision avoidance and machine learning), developed in our lab, allow for a safe interaction with the environment, when combined. This even works with noisy control signals, such as, the operator’s hand acceleration and their elec- tromyography (EMG) signals. These bio-signals are used to execute equivalent actions (such as, reaching and grasp- ing of objects) on the 7 DOF arm.

TRANSCRIPT

Page 1: Tele-operation of a Humanoid Robot, Using Operator Bio-data

#iSAIRAS 2014

tele-operation for humanoid using operator bio-data

!

M. Luciw, A. Förster, J. Schmidhuber !

istituto dalle molle di studi sull’intelligenza artificiale università della svizzera italiana

idsia / usi / supsi

Jürgen ’Juxi’ Leitner

Page 2: Tele-operation of a Humanoid Robot, Using Operator Bio-data

project

!

WAY

http://www.wayproject.eu/results.html

Page 3: Tele-operation of a Humanoid Robot, Using Operator Bio-data

projectIM-CLeVeR

http://robotics.idsia.ch/im-clever/

Page 4: Tele-operation of a Humanoid Robot, Using Operator Bio-data

manipulation

!

aimed at

[Metta et al., 2010]

Page 5: Tele-operation of a Humanoid Robot, Using Operator Bio-data

object manipulationtowards learned

http://robotics.idsia.ch/

Page 6: Tele-operation of a Humanoid Robot, Using Operator Bio-data

avoidancecollision

Page 7: Tele-operation of a Humanoid Robot, Using Operator Bio-data

MoBeE v1[Frank et al., 2011,2012, 2013]

Page 8: Tele-operation of a Humanoid Robot, Using Operator Bio-data
Page 9: Tele-operation of a Humanoid Robot, Using Operator Bio-data

MoBeEv2[Frank et al., 2011,2012, 2013]

Page 10: Tele-operation of a Humanoid Robot, Using Operator Bio-data

hand/armop-space forcing

CSWorld

CSHand

CSR/CSL

[Leitner et al, in prep]

-

Page 11: Tele-operation of a Humanoid Robot, Using Operator Bio-data

!

objectsdetecting

Page 12: Tele-operation of a Humanoid Robot, Using Operator Bio-data

rocksdetecting

e.g. [Leitner et al., i-SAIRAS’12]

Page 13: Tele-operation of a Humanoid Robot, Using Operator Bio-data
Page 14: Tele-operation of a Humanoid Robot, Using Operator Bio-data

http://Juxi.net/media

Page 15: Tele-operation of a Humanoid Robot, Using Operator Bio-data

repertoire[Leitner et al, in prep]

Page 16: Tele-operation of a Humanoid Robot, Using Operator Bio-data

operationtele

Page 17: Tele-operation of a Humanoid Robot, Using Operator Bio-data

acquisitionemg

Page 18: Tele-operation of a Humanoid Robot, Using Operator Bio-data

classificationemg

Page 19: Tele-operation of a Humanoid Robot, Using Operator Bio-data

acquiringemg

Page 20: Tele-operation of a Humanoid Robot, Using Operator Bio-data

iEMGboard

Page 21: Tele-operation of a Humanoid Robot, Using Operator Bio-data

+ acceleration

Page 22: Tele-operation of a Humanoid Robot, Using Operator Bio-data

hand/armop-space forcing

CSWorld

CSHand

CSR/CSL

-

CSHand’

Page 23: Tele-operation of a Humanoid Robot, Using Operator Bio-data

hand/armop-space forcing

Page 24: Tele-operation of a Humanoid Robot, Using Operator Bio-data

hand/armop-space forcing

Page 25: Tele-operation of a Humanoid Robot, Using Operator Bio-data

workfuture

human-robot interaction

variable autonomy

action outcome/prediction

WaY better classification

Page 26: Tele-operation of a Humanoid Robot, Using Operator Bio-data

for listeningthanks

http://Juxi.net/projects !

[email protected]