artificial neural networks for spatial perception: towards visual object localisation in humanoid...

17
#ijcnn 2013 ANNs for spatial perception towards visual object localisation in humanoids S. Harding, M. Frank, A. Förster, J. Schmidhuber istituto dalle molle di studi sull’intelligenza artificiale università della svizzera italiana idsia / usi / supsi Jürgen ’Juxi’ Leitner

Upload: juxi-leitner

Post on 18-Dec-2014

214 views

Category:

Technology


4 download

DESCRIPTION

Presentation at the 2013 IJCNN (Int'l Joint Conference for Neural Networks) of our paper. More info http://Juxi.net/

TRANSCRIPT

Page 1: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

#ijcnn 2013

ANNs forspatial perception

towards visual object localisation in humanoids

S. Harding, M. Frank, A. Förster, J. Schmidhuber

istituto dalle molle di studi sull’intelligenza artificialeuniversità della svizzera italiana

idsia / usi / supsi

Jürgen ’Juxi’ Leitner

Page 2: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

manipulation

our iCubsetup is for

Page 3: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

object manipulationtowards learning

http://robotics.idsia.ch/

Page 4: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

MoBeEframework Frank et al., 2012.

MoBeE

Page 5: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

generationmotionStollenga et al, 2013

Sh

ak

ey 2

01

3 W

inn

er

Page 6: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

perceptionvisual

thanks to G. Metta and IIT for this picture

Page 7: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

objectsdetecting

Harding et al., 2013Leitner et al., ICDL 2012, ARS 2012, BICA 2012, CEC 2013

Page 8: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

localisation approachescurrent

approachlearning=>

Page 9: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

transferringspatial perception

Page 10: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

setuplearning

Page 11: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

trainingset

9DOF

iCubbounding box

6 per eye Carte

sian

Coor

dinate

s

..

.

Page 12: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

spatial perception neural network

...

9DO

FiC

ubbo

undi

ng b

ox6

per e

ye

Cart

esian

Coor

dina

tes

fully

con

nect

ed

fully

con

nect

ed

...

Page 13: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

hidden layerneurons

Page 14: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

resultsANN

-700

-600

-500

-400

-300

-200

-100

0

100

200

300

400

0 200 400 600 800 1000

Y (

mm

)

Sample Index

PredictedExpected

100

150

200

250

300

350

400

450

500

550

600

0 200 400 600 800 1000

X (

mm

)

Sample Index

-1300

-1200

-1100

-1000

-900

-800

-700

-600

-500

-400

-300

-200

0 200 400 600 800 1000

Z (

mm

)

Sample Index

-700

-600

-500

-400

-300

-200

-100

0

100

200

300

400

0 200 400 600 800 1000

Y (

mm

)

Sample Index

PredictedExpected

100

150

200

250

300

350

400

450

500

550

600

0 200 400 600 800 1000

X (

mm

)

Sample Index

-1300

-1200

-1100

-1000

-900

-800

-700

-600

-500

-400

-300

-200

0 200 400 600 800 1000

Z (

mm

)

Sample Index

Page 15: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

resultsANN

Page 16: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

workfuture

eye-hand coordination

different spatial representations

online, continuous learning

Page 17: Artificial Neural Networks For Spatial Perception: Towards Visual Object Localisation in Humanoid Robots #ijcnn2013

for listeningthanks

[email protected] http://Juxi.net/projects