evolutionary robotics tutorial
TRANSCRIPT
![Page 1: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/1.jpg)
Evolutionary Robotics Tutorial
Josh Bongard
Director of the Morphology, Evolution and Cognition LaboratoryDepartment of Computer ScienceVermont Complex Systems CenterVermont Advanced Computing Core
University of Vermont
July 30, 2014
www.reddit.com/r/ludobotswww.uvm.edu/∼mwagy/robots/dotbot/
![Page 2: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/2.jpg)
Boston Dynamics: Big Dog (2005)
![Page 3: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/3.jpg)
Boston Dynamics: Cheetah (2012)
![Page 4: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/4.jpg)
Raffaello D’Andrea’s Quadcopters (2013)
![Page 5: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/5.jpg)
Marc Raibert’s 3D Biped (?)
![Page 6: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/6.jpg)
Marc Raibert’s 3D Biped (1992)
![Page 7: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/7.jpg)
Why Make Robots?
![Page 8: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/8.jpg)
Evolutionary Robotics
Bongard & Pfeifer, 2002, Bongard, Zykov & Lipson, 2006,Procs of the 7th Intl Conf on the Sim of Adapt Beh Science
![Page 9: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/9.jpg)
Why Make Robots?
![Page 10: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/10.jpg)
Different approaches to understanding life/intelligence
![Page 11: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/11.jpg)
Braitenberg Vehicles 2a and 2b
![Page 12: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/12.jpg)
Braitenberg Vehicle 3
?
![Page 13: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/13.jpg)
Evolution of Artificial Neural NetworksCircles=neurons; arrows=synaptic connections
sensor neurons
interneurons
motor neuronsm1m2 mp
i1 i2 in
s1 s2 sm
network 1
fitness: 2.3 meters
Generation 1
![Page 14: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/14.jpg)
Evolution of Artificial Neural NetworksCircles=neurons; arrows=synaptic connections
m1m2 mp
i1 i2 in
s1 s2 sm
m1m2 mp
i1 i2 in
s1 s2 sm
network 1
network n
fitness: 2.3 meters
fitness: 2.8 meters
Generation 1
![Page 15: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/15.jpg)
Evolution of Artificial Neural NetworksCircles=neurons; arrows=synaptic connections
m1m2 mp
i1 i2 in
s1 s2 sm
m1m2 mp
i1 i2 in
s1 s2 sm
network 1
network n
fitness: 2.3 meters
fitness: 2.8 meters
Generation 1
m1m2 mp
i1 i2 in
s1 s2 sm
m1m2 mp
i1 i2 in
s1 s2 sm
network n1
network n2
Generation 2
X
![Page 16: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/16.jpg)
Evolution of Artificial Neural NetworksCircles=neurons; arrows=synaptic connections
fitness: 2.9 meters
fitness: 2.6 meters
m1m2 mp
i1 i2 in
s1 s2 sm
m1m2 mp
i1 i2 in
s1 s2 sm
network 1
network n
fitness: 2.3 meters
fitness: 2.8 meters
Generation 1
m1m2 mp
i1 i2 in
s1 s2 sm
m1m2 mp
i1 i2 in
s1 s2 sm
network n1
network n2
Generation 2
X
![Page 17: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/17.jpg)
Evolution of Artificial Neural NetworksCircles=neurons; arrows=synaptic connections
Generation 3
m1m2 mp
i1 i2 in
s1 s2 sm
m1m2 mp
i1 i2 in
s1 s2 sm
network 1
network n
fitness: 2.3 meters
fitness: 2.8 meters
Generation 1
m1m2 mp
i1 i2 in
s1 s2 sm
m1m2 mp
i1 i2 in
s1 s2 sm
network n1
network n2
Generation 2
X
fitness: 2.9 meters
fitness: 2.6 meters
m1m2 mp
i1 i2 in
s1 s2 sm
m1m2 mp
i1 i2 in
s1 s2 sm
network n1,1
network n1,2
fitness: 3.1 meters
fitness: 1.4 meters
![Page 18: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/18.jpg)
Floreano & Mondada, 1994Automatic creation of an autonomous agent: Genetic evolution of a neural-networkdriven robot
![Page 19: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/19.jpg)
Floreano & Mondada, 1994Automatic creation of an autonomous agent: Genetic evolution of a neural-networkdriven robot
![Page 20: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/20.jpg)
Husbands, Harvey & Cliff, 1994Seeing The Light: Articial Evolution, Real Vision
![Page 21: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/21.jpg)
Husbands, Harvey & Cliff, 1994Seeing The Light: Articial Evolution, Real Vision
![Page 22: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/22.jpg)
What’s Modeled and What Isn’t
I Modeled:
I Heritable genetic variation → differences in reproduction rateI Physical impact of the robot on the environmentI Physical impact of the environment on the robotI Point mutationI Evolved changes in synaptic strength
I Not Modeled:
I Sexual recombinationI DiploidyI Evolution of the architecture of the nervous systemI Evolution of the body planI Evolution of developmentI EpigeneticsI Sexual selectionI Neutral mutationI ...
![Page 23: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/23.jpg)
Evolving the Nervous System and Body Plan
I Modeled:
I Heritable genetic variation → differences in reproduction rateI Physical impact of the robot on the environmentI Physical impact of the environment on the robotI Point mutationI Evolved changes in synaptic strengthI Evolution of the body plan
I Not Modeled:
I Sexual recombinationI DiploidyI Evolution of the architecture of the nervous systemI Evolution of developmentI EpigeneticsI Sexual selectionI Neutral mutationI ...
![Page 24: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/24.jpg)
Karl Sims, 1992
![Page 25: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/25.jpg)
The GOLEM ProjectLipson & Pollack, Science, 2000
d = 59.6cm d = 85.1cm d = 38.5cm
a c e
b d fd = 22.5cm d = 23.4cm d = 38.4cm
![Page 26: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/26.jpg)
The GOLEM ProjectLipson & Pollack, Science, 2000
a b
c d
![Page 27: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/27.jpg)
Tensegrity Robots: Rieffel, Valero-Cuevas & Lipson, 2009[Video courtesy of NASA; 2014]
![Page 28: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/28.jpg)
Evolving Active Categorical PerceptionBongard, 2011, IEEE Trans Evol Comp
![Page 29: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/29.jpg)
Cornell’s Simulated Soft RobotsCheney, MacCurdy, Clune & Lipson. (2013). In Procs. of the Genetic and Evolutionary Computation Conf.
![Page 30: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/30.jpg)
HyperNEAT for Soft RobotsCheney, MacCurdy, Clune & Lipson. (2013). In Procs. of the Genetic and Evolutionary Computation Conf.
![Page 31: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/31.jpg)
Morphological and Environmental ComplexityAuerbach & Bongard, 2014, PLoS Comp Bio.
![Page 32: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/32.jpg)
What’s Modeled and What Isn’t
I Modeled:
I Heritable genetic variation → differences in reproduction rateI Physical impact of the robot on the environmentI Physical impact of the environment on the robotI Point mutationI Evolved changes in synaptic strength
I Not Modeled:
I Sexual recombinationI DiploidyI Evolution of the architecture of the nervous systemI Evolution of the body planI Evolution of developmentI EpigeneticsI Sexual selectionI Neutral mutationI ...
![Page 33: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/33.jpg)
“Robo Evo Devo”
I Modeled:
I Heritable genetic variation → differences in reproduction rateI Physical impact of the robot on the environmentI Physical impact of the environment on the robotI Point mutationI Evolved changes in synaptic strengthI Evolution of Development
I Not Modeled:
I Sexual recombinationI DiploidyI Evolution of the architecture of the nervous systemI Evolution of the body planI EpigeneticsI Sexual selectionI Neutral mutationI ...
![Page 34: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/34.jpg)
Eggenberger, 1997Evo-devo through differential gene expression. Procs of ECAL
![Page 35: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/35.jpg)
Bongard & Pfeifer, 2001Procs of GECCO
![Page 36: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/36.jpg)
Bongard & Pfeifer, 2001Procs of GECCO
![Page 37: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/37.jpg)
Doursat, Sayama & Michel (2012)Morphogenetic Engineering. Springer. “Self-architecturing” systems
![Page 38: Evolutionary Robotics Tutorial](https://reader033.vdocument.in/reader033/viewer/2022050214/626e707196a51343a91c546d/html5/thumbnails/38.jpg)
Robo-Evo-Devo produces more robust controllers faster.Bongard, 2011, PNAS
Robo-Evo:
Robo-Evo-Devo: