introduction to genetic algorithms. 2 abstract an introduction to emulating the problem solving...
TRANSCRIPT
![Page 1: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/1.jpg)
Introduction to Genetic Algorithms
![Page 2: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/2.jpg)
2
Abstract
An introduction to emulating the problem solving according to nature's method: via evolution, selective breeding, "survival of the fittest.” We will present the fundamental algorithms and present several examples, especially some problems that are hard to solve otherwise.
![Page 3: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/3.jpg)
3
Dealing with Hard (NP-Complete) Problems
Some Problems We Just Don't Know How to Solve!. . . but we do know how to critique a “solution”.
Coloring graphs is hard, but counting colors and violations is easy
(a violation is two adjacent vertices with the same color).
Finding the shortest salesman's path is hard, but measuring a path is easy.
Scheduling examinations or assigning teachers to classes is hard, but
counting the conflicts (ideally there are none) is easy.
Computer programs are hard to write, but counting bugs is easy.
![Page 4: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/4.jpg)
4
GAs Emulate Selective Breeding
Designing tender chickens is hard; taste-testing them is easy.
Designing thick-skinned tomatoes is hard; dropping is easy.
So, the breeders iterate:• Selection: Cull their population of the inferior
members.• Crossover: Let the better members breed.• Mutation: X-ray them.
![Page 5: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/5.jpg)
5
Darwin’s Theory of Evolution
During reproduction, traits found in parents are passed on to their offspring
Variations (mutations) are present naturally in all species producing new traits.
A process called natural selection, ‘selects’ individuals best adapted to the environment
Over long periods of time, variations can accumulate and produce new species.
![Page 6: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/6.jpg)
6
Natural Selection
Those fittest survive longestCharacteristics, encoded in genes are transmitted to
offspring and tend to propagate into new generations
In sexual reproduction, the chromosomes of offspring are a mix of their parents
An offspring’s characteristics are partially inherited from parents and partly the result of new genes created during the reproduction process
![Page 7: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/7.jpg)
7
Applications I Have Known
Choosing among 1,500 features for OCR.
Scheduling the Chili, NY, annual soccer invitational.
N Queens, Graphs, Salesmen, etc., etc.
![Page 8: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/8.jpg)
8
Subsetting 1,500 OCR Features
The polynet OCR engine trains and executes rapidly.
Performance was competitive.
We wanted to embed it in hardware, but it used 1,500 features.
We could deal with 300 features.
So, we bred high-performance feature subsets.
![Page 9: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/9.jpg)
9
Soccer Scheduling
Bill Gustafson's MS Project, May, 1998
The Chili Soccer Association hosts an annual soccer tournament.
131 teams, 209 games, 14 fields, 17 game times.
a long weekend for a group of schedulers,
. . . . . and then some teams back out. . .
![Page 10: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/10.jpg)
10
Soccer Scheduling Hard Constraints
A field can have one game at a time.
A team can only play one game at a time.
Teams must play on appropriate size fields.
Late games must be played on lighted fields.
A team must rest one game period (two is better) between games.
Teams can only play when they can be present (some cannot come Friday evening.
![Page 11: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/11.jpg)
11
Soccer Scheduling Soft Constraints
A team's games should be distributed evenly over the playing days.
Teams should play in at most two playing areas.
Each team should play at least once in the main playing area.
Teams should play in areas where they have a preference.
Games should finish as early as possible on Sunday.
Etc...
![Page 12: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/12.jpg)
12
Placing N Non-Attacking Queens
Found by my genetic algorithm!
![Page 13: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/13.jpg)
13
Placing N Non-Attacking Queens
Queens attack on chess-board rows, columns, and diagonals.
Any permutation in N rows avoids row & column attacks.
Exhaustive search works for N 10, but N! grows rapidly.
A GA can place 1,000 Queens in 1,344 fitness evaluations.
(This is not an NP-complete problem.)
![Page 14: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/14.jpg)
14
100 Non-Attacking Queens in 130 Fitness Evaluations
![Page 15: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/15.jpg)
15
Graph Coloring: Edge Ends Get Different Colors
![Page 16: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/16.jpg)
16
Graph Coloring = Map Coloring
![Page 17: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/17.jpg)
17
Graph Coloring = Map Coloring
![Page 18: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/18.jpg)
18
Graph Coloring = Map Coloring
![Page 19: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/19.jpg)
19
Traveling Salesman Route Min.
Another classic, hard, NP-complete problem.
We tried cities on a HW grid, so best distance is known.
Perfection is hard to achieve.
A clever algorithm costs O(cities2) to evaluate a fittness.
But, we get pretty good answers.
![Page 20: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/20.jpg)
20
Some GA Application Types
Domain Application Types
Control gas pipeline, pole balancing, missile evasion, pursuit
Design semiconductor layout, aircraft design, keyboardconfiguration, communication networks
Scheduling manufacturing, facility scheduling, resource allocation
Robotics trajectory planning
Machine Learning designing neural networks, improving classificationalgorithms, classifier systems
Signal Processing filter design
Game Playing poker, checkers, prisoner’s dilemma
CombinatorialOptimization
set covering, travelling salesman, routing, bin packing,graph colouring and partitioning
![Page 21: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/21.jpg)
21
History
HollandBagleyCavicchioHollstienDe JongGoldbergMedical image processingPrisoner’s dilemmaHollandOthers
![Page 22: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/22.jpg)
22
Classes of Search Techniques
F inonacci N ew ton
D irect methods Indirect methods
C alculus-based techniques
E volutionary strategies
C en tralized D istrib u ted
P arallel
S tead y-state G en eration al
S eq u en tia l
G en etic a lgorith m s
E volu tion ary a lgorith m s S imulated annealing
G u id ed ran d om search tech n iq u es
D ynamic programming
E numerative techniques
S earch tech n iq u es
![Page 23: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/23.jpg)
23
Comments
Stochastic algorithmrandomness has an essential role in genetic algorithmsboth selection and reproduction needs random
proceduresConsider population of solutions
evaluates more than a single solution at each iterationassortment, amenable for parallelisation
RobustnessAbility to perform consistently well on a broad range of
problem typesno particular requirements on the problems before using
GAs
![Page 24: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/24.jpg)
24
Benefits of Genetic Algorithms
Concept is easy to understand
Modular, separate from application
Supports multi-objective optimization
Good for “noisy” environments
Always an answer; answer gets better with time
Inherently parallel; easily distributed
![Page 25: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/25.jpg)
25
Benefits of Genetic Algorithms (cont.)
Many ways to speed up and improve a GA-based application as knowledge about problem domain is gained
Easy to exploit previous or alternate solutions
Flexible building blocks for hybrid applications
Substantial history and range of use
![Page 26: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/26.jpg)
26
Uses of GAs
GAs (and SAs): the algorithms of despair. Use a GA when
you have no idea how to reasonably solve a problem
calculus doesn't apply
generation of all solutions is impractical
but, you can evaluate posed solutions
![Page 27: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/27.jpg)
27
Outline of This GA Course
The basic frame of genetic algorithm.
More about representation and operators
Theory analysis of GA
Combinatorial Problem
Constraint optimization
![Page 28: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/28.jpg)
28
Outline of This GA Course
Genetic algorithm and Artificial neural network
Parallel GA
Genetic programming
![Page 29: Introduction to Genetic Algorithms. 2 Abstract An introduction to emulating the problem solving according to nature's method: via evolution, selective](https://reader033.vdocument.in/reader033/viewer/2022052701/56649e2b5503460f94b197c9/html5/thumbnails/29.jpg)
29
Famous Problems & Concepts
N Queens
Traveling salesman
Knight's tour
Bin packing
Scheduling
Function optimization
Graph coloring, Ramsey problems
Satisfiability