an evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 ·...
TRANSCRIPT
![Page 1: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/1.jpg)
IntroductionThe Experiment
Results
An evolved circuit, intrinsic in silicon, entwinedwith physics.Adrian Thompson
Tommy McDaniel
February 20, 2007
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 2: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/2.jpg)
IntroductionThe Experiment
Results
Table of Contents
1 IntroductionFPGAXilinx XC6216Diagram of Device
2 The ExperimentFPGA SetupThe TaskGA ParametersExperimental ArrangementFitness Evaluation
3 ResultsEffect of TemperatureEffect of Moving the Circuit
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 3: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/3.jpg)
IntroductionThe Experiment
Results
FPGAXilinx XC6216Diagram of Device
Introduction
“Intrinsic” Hardware Evolution“Intrinsic” used to indicate that fitness is evaluated for real,not merely in a simulationSpecific hardware: Xilinx XC6216 FPGA (FieldProgrammable Gate Array)
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 4: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/4.jpg)
IntroductionThe Experiment
Results
FPGAXilinx XC6216Diagram of Device
FPGA
What is an FPGA?Programmable hardwareHardware can be designed in Verilog and VHDL
This experiment seemed to use neither
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 5: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/5.jpg)
IntroductionThe Experiment
Results
FPGAXilinx XC6216Diagram of Device
Xilinx XC6216
Was still unreleased at time of experimentArray of 64 × 64 = 4,096 reconfigurable cells
Each cell connected to four neighborsEach cell has a function unit that can perform any booleanfunction of two inputsOutput to each neighbor can be output from function unit orsignal from another neighborInput and output occurs at edges of array
Configuration held in on-chip memoryNo configuration can damage device
Handy feature which allows genetic algorithm to do as itpleases unchecked
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 6: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/6.jpg)
IntroductionThe Experiment
Results
FPGAXilinx XC6216Diagram of Device
Diagram of Device
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 7: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/7.jpg)
IntroductionThe Experiment
Results
FPGA SetupThe TaskGA ParametersExperimental ArrangementFitness Evaluation
FPGA Setup
Fixed input and output positions selected before beginningexperimentUnused I/O points appeared as constant inputOnly used 10 × 10 corner of gate array
Other cells also simply produced a constant valueGenotype encoding was string of 1,800 bits
Didn’t give breakdown of bits
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 8: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/8.jpg)
IntroductionThe Experiment
Results
FPGA SetupThe TaskGA ParametersExperimental ArrangementFitness Evaluation
The Task
Your task, should you choose to accept it: Discriminatebetween 1 kHz and 10 kHz input square waves by settingoutput to +5V for one and 0V for the other
Oh yeah, you get no clock or other external resources tohelp you time anythingAnd by 1 kHz and 10 kHz, we really mean 1.042 kHz and10.416 kHz
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 9: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/9.jpg)
IntroductionThe Experiment
Results
FPGA SetupThe TaskGA ParametersExperimental ArrangementFitness Evaluation
GA Parameters
Population size: 50Genotype encoding: strings of 1,800 bitsElitism of size 1Selection of other 49 offspring: linear rank-based
Such that fittest individual could expect twice as manyoffspring as the median individual
Crossover probability: 0.7Mutation rate: Expected 2.7 mutations per genotype, so0.0015 (0.15%)
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 10: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/10.jpg)
IntroductionThe Experiment
Results
FPGA SetupThe TaskGA ParametersExperimental ArrangementFitness Evaluation
Experimental Arrangement
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 11: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/11.jpg)
IntroductionThe Experiment
Results
FPGA SetupThe TaskGA ParametersExperimental ArrangementFitness Evaluation
Fitness Evaluation
Tone generator generates 10 500ms tones: five of the 1kHz variety, and five of the 10 kHz variety
The 10 tones are generated in a random order, with no gapin between
Analog integrator reset to zero at beginning of each tone,and integrates output voltage over the tone’s 500msAnalog integrator’s value at end of tone is used in fitnessfunctionNote that fitness evaluation took over five seconds
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 12: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/12.jpg)
IntroductionThe Experiment
Results
FPGA SetupThe TaskGA ParametersExperimental ArrangementFitness Evaluation
Fitness Function
110
∣∣∣∣∣∣k1
∑t∈S1
it
−
k2∑
t∈S10
it
∣∣∣∣∣∣Where:
it is analog integrator reading at end of test tone t ,1 ≤ t ≤ 10S1 is set of five 1 kHz test tones, S10 is set of five 10 kHztest tonesk1 = 1
30,730.746 and k2 = 130,527.973
k1 and k2 determined experimentally such that circuit pipinginput directly to output receives zero fitness
Needed because otherwise that useless circuit becomes “aninescapable local optimum”
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 13: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/13.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
Oscilloscope Readings
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 14: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/14.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
Oscilloscope Interpretations
Initial population: best individual produced a constant +5VGeneration 220: best individual basically just copied inputto output, but high part of wave had a high frequencycomponentGeneration 320: same as generation 220, but alsooccasional jumps to 0V when output should’ve been highGeneration 650: much progress for 1 kHz input, with onlyoccasional jumps to low voltage; highs and lows nowmatch inputsGeneration 1,100: 1 kHz works almost perfectly, 10 kHzstill goofing around
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 15: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/15.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
More Oscilloscope Interpretations
Generation 1,400: 1 kHz not so perfect any more, but atleast 10 kHz is mostly low now, while 1 kHz is still mostlyhighGeneration 2,100: same general behavior but betterGeneration 2,550: still the same general behaviorGeneration 2,800: only defect is rapid glitching for 10 kHzinput; high and low output have reversedGeneration 3,500: almost perfect, except for infrequentunseen glitches
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 16: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/16.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
Last Unpictured Generations
Generation 4,100: glitches from generation 3,500eliminated (a.k.a., perfection)Generation 5,100: no observable change over last 1,000generations
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 17: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/17.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
Fitness and Hamming Distance Graphs
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 18: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/18.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
Winning Circuit, Generation 5,000
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 19: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/19.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
After Removing Elements with No Path to Output
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 20: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/20.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
Is This It?
After removing all the cells and wires that have no possiblepath to the output, one might assume that what remains isthe maximum necessary for circuit to work correctlyOne might be wrongExperiments were done where each cell had its functionoutput clamped to a fixed value one by one, to see whichcells were truly irrelevantThere turned out to be five cells which could not beclamped without degrading performance, although theyhad no possible connected path to the output
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 21: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/21.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
Functional Part of Circuit
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 22: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/22.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
Explanation of Functional Part
The gray boxes are the cells that had no path to the output,but which were still important to maintain performance
Cells in top left could be individually clamped, but clampingthem all degraded performance noticeablyLower-right gray cell single-handedly messes upperformance severely if clamped
Possible causes include interaction through the powersupply and other electromagnetic interactionsSmall functional area means that this circuit should betolerant of most hardware faults
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 23: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/23.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
Effect of Temperature
During evolution, temperature was 31.2◦ C, ±5◦ CAt that temperature, output is 0V for ≤ 1.6 kHz, and +5Vfor ≥ 4.5 kHzOne might wonder how temperature affects these rangesof behavior
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 24: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/24.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
Performance at Different Temperatures
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 25: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/25.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
Interpretation
Changing the temperature moves the performance curveleft or rightAt 43◦, 10 kHz is no longer on the flat plateau of stable+5V performanceAt 23.5◦, 1 kHz is in a region that is still a little bumpy (orso we’re told)These effects are because electronic components behavedifferently at different temperatures
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 26: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/26.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
Effect of Moving the Circuit
One might ask oneself: “Self, given the subtle interactionsbetween components that didn’t even have a path to theoutput, how sensitive is this circuit to this particular pieceof hardware?”To find out, the population at generation 5,000 was movedto a completely different piece of the FPGA
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 27: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/27.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
Moving the Circuit
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 28: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/28.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
Results of Moving the Circuit
The individual that performed best at the original locationwas about 7% worse at the new locationHowever, a different individual was within 0.1% ofperfection thereAfter 100 generations of evolution at the new location,perfect performance had been attained againWhen this population was moved back to original position,the best individual at the other position was againdegraded, but there was a different individual thatperformed perfectly
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.
![Page 29: An evolved circuit, intrinsic in silicon, entwined with physics. - … · 2014-09-30 · Introduction The Experiment Results Table of Contents 1 Introduction FPGA Xilinx XC6216 Diagram](https://reader033.vdocument.in/reader033/viewer/2022042012/5e72fa4bdacb2b298d1f8528/html5/thumbnails/29.jpg)
IntroductionThe Experiment
Results
Effect of TemperatureEffect of Moving the Circuit
Questions
Got questions?
Tommy McDaniel An evolved circuit, intrinsic in silicon, entwined with physics.