international doctoral school algorithmic decision theory: … · 2009-05-20 · international...

171
Metaheuristics Finance Transportation Medicine Telecommunication Conclusion International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics and Applications Matthias Ehrgott Department of Engineering Science, The University of Auckland, New Zealand Laboratoire d’Informatique de Nantes Atlantique, CNRS, Universit´ e de Nantes, France MCDA and MOO, Han sur Lesse, September 17 – 21 2007 Matthias Ehrgott MOCO: Applications

Upload: others

Post on 25-Jun-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

International Doctoral School Algorithmic DecisionTheory: MCDA and MOO

Lecture 5: Metaheuristics and Applications

Matthias Ehrgott

Department of Engineering Science, The University of Auckland, New ZealandLaboratoire d’Informatique de Nantes Atlantique, CNRS, Universite de Nantes,

France

MCDA and MOO, Han sur Lesse, September 17 – 21 2007

Matthias Ehrgott MOCO: Applications

Page 2: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Overview

1 Metaheuristics

2 FinancePortfolio Selection

3 TransportationTrain Timetable InformationCrew Scheduling

4 MedicineRadiotherapy Treatment Design

5 TelecommunicationRouting in IP Networks

6 Conclusion

Matthias Ehrgott MOCO: Applications

Page 3: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Overview

1 Metaheuristics

2 FinancePortfolio Selection

3 TransportationTrain Timetable InformationCrew Scheduling

4 MedicineRadiotherapy Treatment Design

5 TelecommunicationRouting in IP Networks

6 Conclusion

Matthias Ehrgott MOCO: Applications

Page 4: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Overview

1 Metaheuristics

2 FinancePortfolio Selection

3 TransportationTrain Timetable InformationCrew Scheduling

4 MedicineRadiotherapy Treatment Design

5 TelecommunicationRouting in IP Networks

6 Conclusion

Matthias Ehrgott MOCO: Applications

Page 5: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Overview

1 Metaheuristics

2 FinancePortfolio Selection

3 TransportationTrain Timetable InformationCrew Scheduling

4 MedicineRadiotherapy Treatment Design

5 TelecommunicationRouting in IP Networks

6 Conclusion

Matthias Ehrgott MOCO: Applications

Page 6: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Overview

1 Metaheuristics

2 FinancePortfolio Selection

3 TransportationTrain Timetable InformationCrew Scheduling

4 MedicineRadiotherapy Treatment Design

5 TelecommunicationRouting in IP Networks

6 Conclusion

Matthias Ehrgott MOCO: Applications

Page 7: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Overview

1 Metaheuristics

2 FinancePortfolio Selection

3 TransportationTrain Timetable InformationCrew Scheduling

4 MedicineRadiotherapy Treatment Design

5 TelecommunicationRouting in IP Networks

6 Conclusion

Matthias Ehrgott MOCO: Applications

Page 8: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Overview

1 Metaheuristics

2 FinancePortfolio Selection

3 TransportationTrain Timetable InformationCrew Scheduling

4 MedicineRadiotherapy Treatment Design

5 TelecommunicationRouting in IP Networks

6 Conclusion

Matthias Ehrgott MOCO: Applications

Page 9: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Heuristics versus Metaheuristics

Heuristic: Technique which seeks near-optimal solutions at areasonable computational cost without being able toguarantee optimality ... often problem specific(Reeeves 1995)

Examples: Multiobjective greedy and local search (Ehrgott andGandibleux 2004, Paquete et al. 2005)

Metaheuristic: Iterative master strategy that guides and modifiesthe operations of subordinate heuristics by combiningintelligently different concepts for exploring andexploiting the search space ... applicable to a largenumber of problems. (Glover and Laguna 1997,Osman and Laporte 1996)

Examples: MOEA, MOTS, MOSA etc.

Matthias Ehrgott MOCO: Applications

Page 10: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Heuristics versus Metaheuristics

Heuristic: Technique which seeks near-optimal solutions at areasonable computational cost without being able toguarantee optimality ... often problem specific(Reeeves 1995)

Examples: Multiobjective greedy and local search (Ehrgott andGandibleux 2004, Paquete et al. 2005)

Metaheuristic: Iterative master strategy that guides and modifiesthe operations of subordinate heuristics by combiningintelligently different concepts for exploring andexploiting the search space ... applicable to a largenumber of problems. (Glover and Laguna 1997,Osman and Laporte 1996)

Examples: MOEA, MOTS, MOSA etc.

Matthias Ehrgott MOCO: Applications

Page 11: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Heuristics versus Metaheuristics

Heuristic: Technique which seeks near-optimal solutions at areasonable computational cost without being able toguarantee optimality ... often problem specific(Reeeves 1995)

Examples: Multiobjective greedy and local search (Ehrgott andGandibleux 2004, Paquete et al. 2005)

Metaheuristic: Iterative master strategy that guides and modifiesthe operations of subordinate heuristics by combiningintelligently different concepts for exploring andexploiting the search space ... applicable to a largenumber of problems. (Glover and Laguna 1997,Osman and Laporte 1996)

Examples: MOEA, MOTS, MOSA etc.

Matthias Ehrgott MOCO: Applications

Page 12: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Heuristics versus Metaheuristics

Heuristic: Technique which seeks near-optimal solutions at areasonable computational cost without being able toguarantee optimality ... often problem specific(Reeeves 1995)

Examples: Multiobjective greedy and local search (Ehrgott andGandibleux 2004, Paquete et al. 2005)

Metaheuristic: Iterative master strategy that guides and modifiesthe operations of subordinate heuristics by combiningintelligently different concepts for exploring andexploiting the search space ... applicable to a largenumber of problems. (Glover and Laguna 1997,Osman and Laporte 1996)

Examples: MOEA, MOTS, MOSA etc.

Matthias Ehrgott MOCO: Applications

Page 13: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

The Quality of Heuristics

z2

z1

Which approximation is best?Matthias Ehrgott MOCO: Applications

Page 14: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

The Quality of Heuristics

Cardinal and geometric measures(Hansen and Jaszkiewicz 1998)

Hypervolumes (Zitzler and Thiele 1999)

Coverage, uniformity, cardinality (Sayin 2000)

Distance based measures (Viana and de Sousa 2000)

Integrated convex preference (Kim et al. 2001)

Volume based measures (Tenfelde-Podehl 2002)

Analysis and Review (Ziztler et al. 2003)

Matthias Ehrgott MOCO: Applications

Page 15: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

The Quality of Heuristics

Cardinal and geometric measures(Hansen and Jaszkiewicz 1998)

Hypervolumes (Zitzler and Thiele 1999)

Coverage, uniformity, cardinality (Sayin 2000)

Distance based measures (Viana and de Sousa 2000)

Integrated convex preference (Kim et al. 2001)

Volume based measures (Tenfelde-Podehl 2002)

Analysis and Review (Ziztler et al. 2003)

Matthias Ehrgott MOCO: Applications

Page 16: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

The Quality of Heuristics

Cardinal and geometric measures(Hansen and Jaszkiewicz 1998)

Hypervolumes (Zitzler and Thiele 1999)

Coverage, uniformity, cardinality (Sayin 2000)

Distance based measures (Viana and de Sousa 2000)

Integrated convex preference (Kim et al. 2001)

Volume based measures (Tenfelde-Podehl 2002)

Analysis and Review (Ziztler et al. 2003)

Matthias Ehrgott MOCO: Applications

Page 17: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

The Quality of Heuristics

Cardinal and geometric measures(Hansen and Jaszkiewicz 1998)

Hypervolumes (Zitzler and Thiele 1999)

Coverage, uniformity, cardinality (Sayin 2000)

Distance based measures (Viana and de Sousa 2000)

Integrated convex preference (Kim et al. 2001)

Volume based measures (Tenfelde-Podehl 2002)

Analysis and Review (Ziztler et al. 2003)

Matthias Ehrgott MOCO: Applications

Page 18: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

The Quality of Heuristics

Cardinal and geometric measures(Hansen and Jaszkiewicz 1998)

Hypervolumes (Zitzler and Thiele 1999)

Coverage, uniformity, cardinality (Sayin 2000)

Distance based measures (Viana and de Sousa 2000)

Integrated convex preference (Kim et al. 2001)

Volume based measures (Tenfelde-Podehl 2002)

Analysis and Review (Ziztler et al. 2003)

Matthias Ehrgott MOCO: Applications

Page 19: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

The Quality of Heuristics

Cardinal and geometric measures(Hansen and Jaszkiewicz 1998)

Hypervolumes (Zitzler and Thiele 1999)

Coverage, uniformity, cardinality (Sayin 2000)

Distance based measures (Viana and de Sousa 2000)

Integrated convex preference (Kim et al. 2001)

Volume based measures (Tenfelde-Podehl 2002)

Analysis and Review (Ziztler et al. 2003)

Matthias Ehrgott MOCO: Applications

Page 20: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

The Quality of Heuristics

Cardinal and geometric measures(Hansen and Jaszkiewicz 1998)

Hypervolumes (Zitzler and Thiele 1999)

Coverage, uniformity, cardinality (Sayin 2000)

Distance based measures (Viana and de Sousa 2000)

Integrated convex preference (Kim et al. 2001)

Volume based measures (Tenfelde-Podehl 2002)

Analysis and Review (Ziztler et al. 2003)

Matthias Ehrgott MOCO: Applications

Page 21: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Timeline for Multiobjective Metaheuristics

Evolutionary Algorithms1984: VEGA by Schaffer

Neural Networks1990: Malakooti

Neighbourhood Search Algorithms1992: Simulated Annealing by Serafini1992/93: MOSA by Ulungu and Teghem1996/97: MOTS by Gandibleux et al.1997: TS by Sun1998: GRASP by Gandibleux et al.

Hybrid and Problem Dependent Algorithms1996: Pareto Simulated Annealing by Czyzak and Jaszkiewicz1998: MGK algorithm by Morita et al.Many more since 2000

Matthias Ehrgott MOCO: Applications

Page 22: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Timeline for Multiobjective Metaheuristics

Evolutionary Algorithms1984: VEGA by Schaffer

Neural Networks1990: Malakooti

Neighbourhood Search Algorithms1992: Simulated Annealing by Serafini1992/93: MOSA by Ulungu and Teghem1996/97: MOTS by Gandibleux et al.1997: TS by Sun1998: GRASP by Gandibleux et al.

Hybrid and Problem Dependent Algorithms1996: Pareto Simulated Annealing by Czyzak and Jaszkiewicz1998: MGK algorithm by Morita et al.Many more since 2000

Matthias Ehrgott MOCO: Applications

Page 23: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Timeline for Multiobjective Metaheuristics

Evolutionary Algorithms1984: VEGA by Schaffer

Neural Networks1990: Malakooti

Neighbourhood Search Algorithms1992: Simulated Annealing by Serafini1992/93: MOSA by Ulungu and Teghem1996/97: MOTS by Gandibleux et al.1997: TS by Sun1998: GRASP by Gandibleux et al.

Hybrid and Problem Dependent Algorithms1996: Pareto Simulated Annealing by Czyzak and Jaszkiewicz1998: MGK algorithm by Morita et al.Many more since 2000

Matthias Ehrgott MOCO: Applications

Page 24: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Timeline for Multiobjective Metaheuristics

Evolutionary Algorithms1984: VEGA by Schaffer

Neural Networks1990: Malakooti

Neighbourhood Search Algorithms1992: Simulated Annealing by Serafini1992/93: MOSA by Ulungu and Teghem1996/97: MOTS by Gandibleux et al.1997: TS by Sun1998: GRASP by Gandibleux et al.

Hybrid and Problem Dependent Algorithms1996: Pareto Simulated Annealing by Czyzak and Jaszkiewicz1998: MGK algorithm by Morita et al.Many more since 2000

Matthias Ehrgott MOCO: Applications

Page 25: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Multiobjective Evolutionary Algorithms

Main principles1 Population of solutions2 Self adaptation (independent evolution)3 Cooperation (exchange of information)

Main problems1 Uniform convergence (fitness assignment by ranking and

selection with elitism)2 Uniform distribution (niching, sharing)

Huge number of publications, including surveys, books, EMOconference series

Few applications to MOCO problems

Matthias Ehrgott MOCO: Applications

Page 26: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Multiobjective Evolutionary Algorithms

Main principles1 Population of solutions2 Self adaptation (independent evolution)3 Cooperation (exchange of information)

Main problems1 Uniform convergence (fitness assignment by ranking and

selection with elitism)2 Uniform distribution (niching, sharing)

Huge number of publications, including surveys, books, EMOconference series

Few applications to MOCO problems

Matthias Ehrgott MOCO: Applications

Page 27: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Multiobjective Evolutionary Algorithms

Main principles1 Population of solutions2 Self adaptation (independent evolution)3 Cooperation (exchange of information)

Main problems1 Uniform convergence (fitness assignment by ranking and

selection with elitism)2 Uniform distribution (niching, sharing)

Huge number of publications, including surveys, books, EMOconference series

Few applications to MOCO problems

Matthias Ehrgott MOCO: Applications

Page 28: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Multiobjective Evolutionary Algorithms

Main principles1 Population of solutions2 Self adaptation (independent evolution)3 Cooperation (exchange of information)

Main problems1 Uniform convergence (fitness assignment by ranking and

selection with elitism)2 Uniform distribution (niching, sharing)

Huge number of publications, including surveys, books, EMOconference series

Few applications to MOCO problems

Matthias Ehrgott MOCO: Applications

Page 29: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Multiobjective Neighbourhood Search Algorithms

Multiobjective Simulated Annealing

Initial solution

Neighbourhood structure

Scalarizing function s(z(x), λ)

Set of weights (directions) λ

Simulated annealing based on s

Merge sets of solutions

Multiobjective Tabu Search

Initial solution

Neighbourhood structure

Scalarizing function s(z(x), λ)

Set of weights (directions) λ

Tabu search based on s

Merge sets of solutions

Matthias Ehrgott MOCO: Applications

Page 30: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Multiobjective Neighbourhood Search Algorithms

Multiobjective Simulated Annealing

Initial solution

Neighbourhood structure

Scalarizing function s(z(x), λ)

Set of weights (directions) λ

Simulated annealing based on s

Merge sets of solutions

Multiobjective Tabu Search

Initial solution

Neighbourhood structure

Scalarizing function s(z(x), λ)

Set of weights (directions) λ

Tabu search based on s

Merge sets of solutions

Matthias Ehrgott MOCO: Applications

Page 31: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Multiobjective Neighbourhood Search Algorithms

Multiobjective Simulated Annealing

Initial solution

Neighbourhood structure

Scalarizing function s(z(x), λ)

Set of weights (directions) λ

Simulated annealing based on s

Merge sets of solutions

Multiobjective Tabu Search

Initial solution

Neighbourhood structure

Scalarizing function s(z(x), λ)

Set of weights (directions) λ

Tabu search based on s

Merge sets of solutions

Matthias Ehrgott MOCO: Applications

Page 32: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Multiobjective Neighbourhood Search Algorithms

Multiobjective Simulated Annealing

Initial solution

Neighbourhood structure

Scalarizing function s(z(x), λ)

Set of weights (directions) λ

Simulated annealing based on s

Merge sets of solutions

Multiobjective Tabu Search

Initial solution

Neighbourhood structure

Scalarizing function s(z(x), λ)

Set of weights (directions) λ

Tabu search based on s

Merge sets of solutions

Matthias Ehrgott MOCO: Applications

Page 33: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Multiobjective Neighbourhood Search Algorithms

Multiobjective Simulated Annealing

Initial solution

Neighbourhood structure

Scalarizing function s(z(x), λ)

Set of weights (directions) λ

Simulated annealing based on s

Merge sets of solutions

Multiobjective Tabu Search

Initial solution

Neighbourhood structure

Scalarizing function s(z(x), λ)

Set of weights (directions) λ

Tabu search based on s

Merge sets of solutions

Matthias Ehrgott MOCO: Applications

Page 34: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Multiobjective Neighbourhood Search Algorithms

Multiobjective Simulated Annealing

Initial solution

Neighbourhood structure

Scalarizing function s(z(x), λ)

Set of weights (directions) λ

Simulated annealing based on s

Merge sets of solutions

Multiobjective Tabu Search

Initial solution

Neighbourhood structure

Scalarizing function s(z(x), λ)

Set of weights (directions) λ

Tabu search based on s

Merge sets of solutions

Matthias Ehrgott MOCO: Applications

Page 35: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Hybrid Algorithms

1 EA components in NSA (to improve coverage)

Pareto Simulated Annealing (Czyzak and Jaszkiewicz 1996)Use set of starting solutionsSA uses information from set of solutionsTAMOCO (Hansen 1997, 2000)Use set of starting solutionsTS uses information from set of solutions

2 NSA strategies inside EAs (to improve convergence)

MGK (Morita et al. 1998, 2001)Use local search to improve solutionsMOGLS (Jaszkiewicz 2001)Use local search to improve solutions

Matthias Ehrgott MOCO: Applications

Page 36: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Hybrid Algorithms

1 EA components in NSA (to improve coverage)

Pareto Simulated Annealing (Czyzak and Jaszkiewicz 1996)Use set of starting solutionsSA uses information from set of solutionsTAMOCO (Hansen 1997, 2000)Use set of starting solutionsTS uses information from set of solutions

2 NSA strategies inside EAs (to improve convergence)

MGK (Morita et al. 1998, 2001)Use local search to improve solutionsMOGLS (Jaszkiewicz 2001)Use local search to improve solutions

Matthias Ehrgott MOCO: Applications

Page 37: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Hybrid Algorithms

1 EA components in NSA (to improve coverage)

Pareto Simulated Annealing (Czyzak and Jaszkiewicz 1996)Use set of starting solutionsSA uses information from set of solutionsTAMOCO (Hansen 1997, 2000)Use set of starting solutionsTS uses information from set of solutions

2 NSA strategies inside EAs (to improve convergence)

MGK (Morita et al. 1998, 2001)Use local search to improve solutionsMOGLS (Jaszkiewicz 2001)Use local search to improve solutions

Matthias Ehrgott MOCO: Applications

Page 38: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Hybrid Algorithms

1 EA components in NSA (to improve coverage)

Pareto Simulated Annealing (Czyzak and Jaszkiewicz 1996)Use set of starting solutionsSA uses information from set of solutionsTAMOCO (Hansen 1997, 2000)Use set of starting solutionsTS uses information from set of solutions

2 NSA strategies inside EAs (to improve convergence)

MGK (Morita et al. 1998, 2001)Use local search to improve solutionsMOGLS (Jaszkiewicz 2001)Use local search to improve solutions

Matthias Ehrgott MOCO: Applications

Page 39: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Hybrid Algorithms

1 EA components in NSA (to improve coverage)

Pareto Simulated Annealing (Czyzak and Jaszkiewicz 1996)Use set of starting solutionsSA uses information from set of solutionsTAMOCO (Hansen 1997, 2000)Use set of starting solutionsTS uses information from set of solutions

2 NSA strategies inside EAs (to improve convergence)

MGK (Morita et al. 1998, 2001)Use local search to improve solutionsMOGLS (Jaszkiewicz 2001)Use local search to improve solutions

Matthias Ehrgott MOCO: Applications

Page 40: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Hybrid Algorithms

1 EA components in NSA (to improve coverage)

Pareto Simulated Annealing (Czyzak and Jaszkiewicz 1996)Use set of starting solutionsSA uses information from set of solutionsTAMOCO (Hansen 1997, 2000)Use set of starting solutionsTS uses information from set of solutions

2 NSA strategies inside EAs (to improve convergence)

MGK (Morita et al. 1998, 2001)Use local search to improve solutionsMOGLS (Jaszkiewicz 2001)Use local search to improve solutions

Matthias Ehrgott MOCO: Applications

Page 41: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

MOMKP n=250, p=2, k=2

7500

8000

8500

9000

9500

10000

10500

7000 7500 8000 8500 9000 9500 10000

z1

EVEGA

Matthias Ehrgott MOCO: Applications

Page 42: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

MOMKP n=250, p=2, k=2

7500

8000

8500

9000

9500

10000

10500

7000 7500 8000 8500 9000 9500 10000

z1

EVEGASPEANSGA

Matthias Ehrgott MOCO: Applications

Page 43: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

MOMKP n=250, p=2, k=2

7500

8000

8500

9000

9500

10000

10500

7000 7500 8000 8500 9000 9500 10000

z1

EVEGASPEANSGAMOGLSMOGTS

Matthias Ehrgott MOCO: Applications

Page 44: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

MOMKP n=250, p=2, k=2

7500

8000

8500

9000

9500

10000

10500

7000 7500 8000 8500 9000 9500 10000

z1

EVEGASPEANSGAMOGLSMOGTSMGK

Matthias Ehrgott MOCO: Applications

Page 45: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Hybrid Algorithms

3 Alternate between EA and NSA

Ben Abdelaziz et al. 1997, 1999Use GA to find first approximationApply TS to improve reults of GADelorme et al. 2003, 2005Use Use GRASP to compute first approximationUse SPEA to improve results of GRASP

Matthias Ehrgott MOCO: Applications

Page 46: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Hybrid Algorithms

3 Alternate between EA and NSA

Ben Abdelaziz et al. 1997, 1999Use GA to find first approximationApply TS to improve reults of GADelorme et al. 2003, 2005Use Use GRASP to compute first approximationUse SPEA to improve results of GRASP

Matthias Ehrgott MOCO: Applications

Page 47: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Hybrid Algorithms

3 Alternate between EA and NSA

Ben Abdelaziz et al. 1997, 1999Use GA to find first approximationApply TS to improve reults of GADelorme et al. 2003, 2005Use Use GRASP to compute first approximationUse SPEA to improve results of GRASP

Matthias Ehrgott MOCO: Applications

Page 48: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Matthias Ehrgott MOCO: Applications

Page 49: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Hybrid Algorithms

4 Combination of EA, NSA and problem dependent components

Gandibleux et al. 2003, 2004Use crossover and population as EA componentUse path-relinking as NSA componentUse XSEm and bound set as problem dependent component

x1 x2

moveneighbor

swap

initiatingsolution

guidingsolution

moveneighbor

Matthias Ehrgott MOCO: Applications

Page 50: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Hybrid Algorithms

4 Combination of EA, NSA and problem dependent components

Gandibleux et al. 2003, 2004Use crossover and population as EA componentUse path-relinking as NSA componentUse XSEm and bound set as problem dependent component

x1 x2

moveneighbor

swap

initiatingsolution

guidingsolution

moveneighbor

Matthias Ehrgott MOCO: Applications

Page 51: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Hybrid Algorithms

5 Combination of heuristics and exact algorithms

Gandibleux and Freville 2000Use tabu search as heuristicUse cuts to eliminate search areas where (provably) no efficientsolutions existPrzybylski et al. 2004Use two phase method as exact algorithmUse heuristic to reduce search space

Matthias Ehrgott MOCO: Applications

Page 52: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Hybrid Algorithms

5 Combination of heuristics and exact algorithms

Gandibleux and Freville 2000Use tabu search as heuristicUse cuts to eliminate search areas where (provably) no efficientsolutions existPrzybylski et al. 2004Use two phase method as exact algorithmUse heuristic to reduce search space

Matthias Ehrgott MOCO: Applications

Page 53: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Hybrid Algorithms

5 Combination of heuristics and exact algorithms

Gandibleux and Freville 2000Use tabu search as heuristicUse cuts to eliminate search areas where (provably) no efficientsolutions existPrzybylski et al. 2004Use two phase method as exact algorithmUse heuristic to reduce search space

Matthias Ehrgott MOCO: Applications

Page 54: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

0

2000

4000

6000

8000

10000

12000

14000

16000

50 55 60 65 70 75 80 85 90 95 100

CP

U_t

(s)

instance size

Results with the bound 2

2ph(PR1)(N1)(PR1)(N2)(PR2)(N1)(PR2)(N2)(PR3)(N1)

Matthias Ehrgott MOCO: Applications

Page 55: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

New Metaheuristic Schemes for MOCO

1 Ant colony optimization (Iredi et al. 2001, Gravel et al. 2002,Doerner et al. since 2001)

2 Scatter search (Beausoleil 2001, Molina 2004, Gomes da Silvaet al. 2006, 2007)

3 Particle swarm (Coello 2002, Mostaghim 2003, Rahimi-Vahedand Mirghorbani 2007, Yapicioglu et al. 2007)

4 Constraint programming (Barichard 2003)

Matthias Ehrgott MOCO: Applications

Page 56: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

New Metaheuristic Schemes for MOCO

1 Ant colony optimization (Iredi et al. 2001, Gravel et al. 2002,Doerner et al. since 2001)

2 Scatter search (Beausoleil 2001, Molina 2004, Gomes da Silvaet al. 2006, 2007)

3 Particle swarm (Coello 2002, Mostaghim 2003, Rahimi-Vahedand Mirghorbani 2007, Yapicioglu et al. 2007)

4 Constraint programming (Barichard 2003)

Matthias Ehrgott MOCO: Applications

Page 57: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

New Metaheuristic Schemes for MOCO

1 Ant colony optimization (Iredi et al. 2001, Gravel et al. 2002,Doerner et al. since 2001)

2 Scatter search (Beausoleil 2001, Molina 2004, Gomes da Silvaet al. 2006, 2007)

3 Particle swarm (Coello 2002, Mostaghim 2003, Rahimi-Vahedand Mirghorbani 2007, Yapicioglu et al. 2007)

4 Constraint programming (Barichard 2003)

Matthias Ehrgott MOCO: Applications

Page 58: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

New Metaheuristic Schemes for MOCO

1 Ant colony optimization (Iredi et al. 2001, Gravel et al. 2002,Doerner et al. since 2001)

2 Scatter search (Beausoleil 2001, Molina 2004, Gomes da Silvaet al. 2006, 2007)

3 Particle swarm (Coello 2002, Mostaghim 2003, Rahimi-Vahedand Mirghorbani 2007, Yapicioglu et al. 2007)

4 Constraint programming (Barichard 2003)

Matthias Ehrgott MOCO: Applications

Page 59: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

New Metaheuristic Schemes for MOCO

1 Ant colony optimization (Iredi et al. 2001, Gravel et al. 2002,Doerner et al. since 2001)

2 Scatter search (Beausoleil 2001, Molina 2004, Gomes da Silvaet al. 2006, 2007)

3 Particle swarm (Coello 2002, Mostaghim 2003, Rahimi-Vahedand Mirghorbani 2007, Yapicioglu et al. 2007)

4 Constraint programming (Barichard 2003)

More information: Ehrgott and Gandibleux 2005, 2007

Matthias Ehrgott MOCO: Applications

Page 60: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Portfolio Selection

Overview

1 Metaheuristics

2 FinancePortfolio Selection

3 TransportationTrain Timetable InformationCrew Scheduling

4 MedicineRadiotherapy Treatment Design

5 TelecommunicationRouting in IP Networks

6 Conclusion

Matthias Ehrgott MOCO: Applications

Page 61: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Portfolio Selection

Stock Exchange, Risk, and Return

Search for “Risk Return Portfolio Stock Exchange” produces 10Mio hits on google

Matthias Ehrgott MOCO: Applications

Page 62: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Portfolio Selection

Stock Exchange, Risk, and Return

Search for “Risk Return Portfolio Stock Exchange” produces 10Mio hits on google

Matthias Ehrgott MOCO: Applications

Page 63: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Portfolio Selection

Portfolio Selection

Markowitz 1952

max f1(x) = µT x

min f2(x) = xTσx

subject to eT x = 1

x = 00

50

100

150

200

250

300

350

0 200 400 600 800 1000 1200 1400 1600

f 1

f2

Matthias Ehrgott MOCO: Applications

Page 64: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Portfolio Selection

Standard and Individual Investors

Why do investors not buyefficient portfolios?

0

50

100

150

200

250

300

350

400

450

500

0 0.2 0.4 0.6 0.8 1 1.2

f2

f1

Markowitz model assumes“standard” investor

Individual investor has moreobjectives (Steuer et al. 2006,Ehrgott et al. 2004)

max f1(x) = µT1 x

min f2(x) = xTσx

max f3(x) = µT3 x

max f4(x) = dT x

max f5(x) = stx

subject to eT x = 1

x = 0

Matthias Ehrgott MOCO: Applications

Page 65: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Portfolio Selection

Standard and Individual Investors

Why do investors not buyefficient portfolios?

0

50

100

150

200

250

300

350

400

450

500

0 0.2 0.4 0.6 0.8 1 1.2

f2

f1

Markowitz model assumes“standard” investor

Individual investor has moreobjectives (Steuer et al. 2006,Ehrgott et al. 2004)

max f1(x) = µT1 x

min f2(x) = xTσx

max f3(x) = µT3 x

max f4(x) = dT x

max f5(x) = stx

subject to eT x = 1

x = 0

Matthias Ehrgott MOCO: Applications

Page 66: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Portfolio Selection

Standard and Individual Investors

Why do investors not buyefficient portfolios?

0

50

100

150

200

250

300

350

400

450

500

0 0.2 0.4 0.6 0.8 1 1.2

f2

f1

Markowitz model assumes“standard” investor

Individual investor has moreobjectives (Steuer et al. 2006,Ehrgott et al. 2004)

max f1(x) = µT1 x

min f2(x) = xTσx

max f3(x) = µT3 x

max f4(x) = dT x

max f5(x) = stx

subject to eT x = 1

x = 0

Matthias Ehrgott MOCO: Applications

Page 67: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Portfolio Selection

Standard and Individual Investors

Why do investors not buyefficient portfolios?

0

50

100

150

200

250

300

350

400

450

500

0 0.2 0.4 0.6 0.8 1 1.2

f2

f1

Markowitz model assumes“standard” investor

Individual investor has moreobjectives (Steuer et al. 2006,Ehrgott et al. 2004)

max f1(x) = µT1 x

min f2(x) = xTσx

max f3(x) = µT3 x

max f4(x) = dT x

max f5(x) = stx

subject to eT x = 1

x = 0

Matthias Ehrgott MOCO: Applications

Page 68: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Portfolio Selection

Mixed Integer Problem

Cardinality constraint on number of assets (Chang et al. 2000)

max f1(x) = µT1 x

min f2(x) = xTσx

max f3(x) = µT3 x

max f4(x) = dT x

max f5(x) = stx

subject to eT x = 1

xi 5 uiyi

xi = liyi

eT y = k

yi ∈ 0, 1

0

50

100

150

200

250

300

0 0.2 0.4 0.6 0.8 1

f2f1

Nondominated points in fiveobjective problem

Matthias Ehrgott MOCO: Applications

Page 69: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Portfolio Selection

Mixed Integer Problem

Cardinality constraint on number of assets (Chang et al. 2000)

max f1(x) = µT1 x

min f2(x) = xTσx

max f3(x) = µT3 x

max f4(x) = dT x

max f5(x) = stx

subject to eT x = 1

xi 5 uiyi

xi = liyi

eT y = k

yi ∈ 0, 1

0

50

100

150

200

250

300

0 0.2 0.4 0.6 0.8 1

f2f1

Nondominated points in fiveobjective problem

Matthias Ehrgott MOCO: Applications

Page 70: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Portfolio Selection

Mixed Integer Problem

Cardinality constraint on number of assets (Chang et al. 2000)

max f1(x) = µT1 x

min f2(x) = xTσx

max f3(x) = µT3 x

max f4(x) = dT x

max f5(x) = stx

subject to eT x = 1

xi 5 uiyi

xi = liyi

eT y = k

yi ∈ 0, 1

0

50

100

150

200

250

300

0 0.2 0.4 0.6 0.8 1

f2f1

Nondominated points in fiveobjective problem

Matthias Ehrgott MOCO: Applications

Page 71: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Portfolio Selection

Mixed Integer Problem

Cardinality constraint on number of assets (Chang et al. 2000)

max f1(x) = µT1 x

min f2(x) = xTσx

max f3(x) = µT3 x

max f4(x) = dT x

max f5(x) = stx

subject to eT x = 1

xi 5 uiyi

xi = liyi

eT y = k

yi ∈ 0, 1

0

50

100

150

200

250

300

0 0.2 0.4 0.6 0.8 1

f2f1

Nondominated points in fiveobjective problem

Matthias Ehrgott MOCO: Applications

Page 72: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Portfolio Selection

Comments

Multiobjective optimization provides explanation ofphenomenon that has no explanation in standard framework

Chapter 20 in Figueira, Greco, Ehrgott “Multicriteria DecisionAnalysis” Springer 2005

Matthias Ehrgott MOCO: Applications

Page 73: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Portfolio Selection

Comments

Multiobjective optimization provides explanation ofphenomenon that has no explanation in standard framework

Chapter 20 in Figueira, Greco, Ehrgott “Multicriteria DecisionAnalysis” Springer 2005

Matthias Ehrgott MOCO: Applications

Page 74: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Overview

1 Metaheuristics

2 FinancePortfolio Selection

3 TransportationTrain Timetable InformationCrew Scheduling

4 MedicineRadiotherapy Treatment Design

5 TelecommunicationRouting in IP Networks

6 Conclusion

Matthias Ehrgott MOCO: Applications

Page 75: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Online Timetable Information

Matthias Ehrgott MOCO: Applications

Page 76: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Computation Times for Biobjective Shortest Path

Known to be NP-hard and intractable

Experiments by Raith 2007

Type Nodes Edges Paths CPU Time

Grid 4,902 19,596 6 <0.01Grid 4,902 19,596 1,594 20.85

NetMaker 3,000 33,224 15 <0.01NetMaker 14,000 153,742 17 0.02

Road 330,386 1,202,458 21 1.10Road 330,386 1,202,458 24 39.07

Matthias Ehrgott MOCO: Applications

Page 77: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Computation Times for Biobjective Shortest Path

Known to be NP-hard and intractable

Experiments by Raith 2007

Type Nodes Edges Paths CPU Time

Grid 4,902 19,596 6 <0.01Grid 4,902 19,596 1,594 20.85

NetMaker 3,000 33,224 15 <0.01NetMaker 14,000 153,742 17 0.02

Road 330,386 1,202,458 21 1.10Road 330,386 1,202,458 24 39.07

Matthias Ehrgott MOCO: Applications

Page 78: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Theoretical Results

Using ratio of first and second objective on arcs

Theorem (Muller-Hannemann and Weihe 2006)

Even if the ratio between first and second length of an arcassumes only 2 values there are exponentially many efficientpaths.

If k different ratios are allowed and the sequence of ratiosswitches only once between increasing and decreasing (bitonicpath) then there are at most O(n2k−2) efficient paths.

Matthias Ehrgott MOCO: Applications

Page 79: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Experimental Results

1.4 million nodes, 2.3 million arcs

84% of efficient paths are bitonic

Distance versus time: average 2, maximum 8

Fare versus time: average 3, maximum 22

Distance, Time, Train changes: average 10, maximum 96

Matthias Ehrgott MOCO: Applications

Page 80: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Experimental Results

1.4 million nodes, 2.3 million arcs

84% of efficient paths are bitonic

Distance versus time: average 2, maximum 8

Fare versus time: average 3, maximum 22

Distance, Time, Train changes: average 10, maximum 96

Matthias Ehrgott MOCO: Applications

Page 81: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Experimental Results

1.4 million nodes, 2.3 million arcs

84% of efficient paths are bitonic

Distance versus time: average 2, maximum 8

Fare versus time: average 3, maximum 22

Distance, Time, Train changes: average 10, maximum 96

Matthias Ehrgott MOCO: Applications

Page 82: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Experimental Results

1.4 million nodes, 2.3 million arcs

84% of efficient paths are bitonic

Distance versus time: average 2, maximum 8

Fare versus time: average 3, maximum 22

Distance, Time, Train changes: average 10, maximum 96

Matthias Ehrgott MOCO: Applications

Page 83: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Experimental Results

1.4 million nodes, 2.3 million arcs

84% of efficient paths are bitonic

Distance versus time: average 2, maximum 8

Fare versus time: average 3, maximum 22

Distance, Time, Train changes: average 10, maximum 96

Matthias Ehrgott MOCO: Applications

Page 84: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Comments

The concept of NP-hardness may not be too relevant inmultiobjective optimization

Worst case estimates may not apply in a particular application

Problem size, structure and cost structure important

Interesting mathematical results to be obtained fromparticular applications

Matthias Ehrgott MOCO: Applications

Page 85: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Comments

The concept of NP-hardness may not be too relevant inmultiobjective optimization

Worst case estimates may not apply in a particular application

Problem size, structure and cost structure important

Interesting mathematical results to be obtained fromparticular applications

Matthias Ehrgott MOCO: Applications

Page 86: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Comments

The concept of NP-hardness may not be too relevant inmultiobjective optimization

Worst case estimates may not apply in a particular application

Problem size, structure and cost structure important

Interesting mathematical results to be obtained fromparticular applications

Matthias Ehrgott MOCO: Applications

Page 87: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Comments

The concept of NP-hardness may not be too relevant inmultiobjective optimization

Worst case estimates may not apply in a particular application

Problem size, structure and cost structure important

Interesting mathematical results to be obtained fromparticular applications

Matthias Ehrgott MOCO: Applications

Page 88: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Airline Crew Scheduling

Sunday, 4 August, 2002, 20:29 GMT 21:29 UK

Delays as Easyjet cancels 19 flights

Passengers with low-cost airline Easyjet are suffering delays after 19 flights in and out

of Britain were cancelled.

The company blamed the move - which comes a week after passengers staged a protest sit-in

at Nice airport - on crewing problems stemming from technical hitches with aircraft.

Crews caught up in the delays worked up to their maximum hours and then had to be allowed

home to rest.

Mobilising replacement crews has been a problem as it takes time to bring people to

airports from home. Standby crews were already being used and other staff are on holiday.

Matthias Ehrgott MOCO: Applications

Page 89: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Airline Crew Scheduling

Partition flights into set of pairings to minimize cost

aij =

1 pairing j includes flight i0 otherwise

min = cT x

subject to Ax = e

Mx = b

x ∈ 0, 1n

Big OR success story, used by all airlines

Matthias Ehrgott MOCO: Applications

Page 90: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Airline Crew Scheduling

Partition flights into set of pairings to minimize cost

aij =

1 pairing j includes flight i0 otherwise

min = cT x

subject to Ax = e

Mx = b

x ∈ 0, 1n

Big OR success story, used by all airlines

Matthias Ehrgott MOCO: Applications

Page 91: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Airline Crew Scheduling

Partition flights into set of pairings to minimize cost

aij =

1 pairing j includes flight i0 otherwise

min = cT x

subject to Ax = e

Mx = b

x ∈ 0, 1n

Big OR success story, used by all airlines

Matthias Ehrgott MOCO: Applications

Page 92: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Airline Crew Scheduling

Partition flights into set of pairings to minimize cost

aij =

1 pairing j includes flight i0 otherwise

min = cT x

subject to Ax = e

Mx = b

x ∈ 0, 1n

Big OR success story, used by all airlines

Matthias Ehrgott MOCO: Applications

Page 93: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Delay Propagation

Cost optimal solutions tend to minimize ground time

Delays easily propagate through schedule

Matthias Ehrgott MOCO: Applications

Page 94: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Delay Propagation

Cost optimal solutions tend to minimize ground time

Delays easily propagate through schedule

Matthias Ehrgott MOCO: Applications

Page 95: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Delay Propagation

Cost optimal solutions tend to minimize ground time

Delays easily propagate through schedule

Matthias Ehrgott MOCO: Applications

Page 96: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Dealing with Delay

Solution 1: Stochasticprogramme with recourse (Yenand Birge 2006)

min cT x + Q(x)

s.t. Ax = e

Mx = b

x ∈ 0, 1

Q(x) =∑

ω∈Ω p(ω)Q(x , ω),where Q(x , ω) is delay underschedule x in scenario ω

Solution 2: Biobjectiveprogramme (Ehrgott and Ryan2002)

min rT x

min cT x

s.t. Ax = e

Mx = b

x ∈ 0, 1

rj is penalty for short groundtime, uses parameters of delaydistribution

Matthias Ehrgott MOCO: Applications

Page 97: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Dealing with Delay

Solution 1: Stochasticprogramme with recourse (Yenand Birge 2006)

min cT x + Q(x)

s.t. Ax = e

Mx = b

x ∈ 0, 1

Q(x) =∑

ω∈Ω p(ω)Q(x , ω),where Q(x , ω) is delay underschedule x in scenario ω

Solution 2: Biobjectiveprogramme (Ehrgott and Ryan2002)

min rT x

min cT x

s.t. Ax = e

Mx = b

x ∈ 0, 1

rj is penalty for short groundtime, uses parameters of delaydistribution

Matthias Ehrgott MOCO: Applications

Page 98: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Dealing with Delay

Solution 1: Stochasticprogramme with recourse (Yenand Birge 2006)

min cT x + Q(x)

s.t. Ax = e

Mx = b

x ∈ 0, 1

Q(x) =∑

ω∈Ω p(ω)Q(x , ω),where Q(x , ω) is delay underschedule x in scenario ω

Solution 2: Biobjectiveprogramme (Ehrgott and Ryan2002)

min rT x

min cT x

s.t. Ax = e

Mx = b

x ∈ 0, 1

rj is penalty for short groundtime, uses parameters of delaydistribution

Matthias Ehrgott MOCO: Applications

Page 99: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Dealing with Delay

Solution 1: Stochasticprogramme with recourse (Yenand Birge 2006)

min cT x + Q(x)

s.t. Ax = e

Mx = b

x ∈ 0, 1

Q(x) =∑

ω∈Ω p(ω)Q(x , ω),where Q(x , ω) is delay underschedule x in scenario ω

Solution 2: Biobjectiveprogramme (Ehrgott and Ryan2002)

min rT x

min cT x

s.t. Ax = e

Mx = b

x ∈ 0, 1

rj is penalty for short groundtime, uses parameters of delaydistribution

Matthias Ehrgott MOCO: Applications

Page 100: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Dealing with Delay

Solution 1: Stochasticprogramme with recourse (Yenand Birge 2006)

min cT x + Q(x)

s.t. Ax = e

Mx = b

x ∈ 0, 1

Q(x) =∑

ω∈Ω p(ω)Q(x , ω),where Q(x , ω) is delay underschedule x in scenario ω

Solution 2: Biobjectiveprogramme (Ehrgott and Ryan2002)

min rT x

min cT x

s.t. Ax = e

Mx = b

x ∈ 0, 1

rj is penalty for short groundtime, uses parameters of delaydistribution

Matthias Ehrgott MOCO: Applications

Page 101: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Dealing with Delay

Solution 1: Stochasticprogramme with recourse (Yenand Birge 2006)

min cT x + Q(x)

s.t. Ax = e

Mx = b

x ∈ 0, 1

Q(x) =∑

ω∈Ω p(ω)Q(x , ω),where Q(x , ω) is delay underschedule x in scenario ω

Solution 2: Biobjectiveprogramme (Ehrgott and Ryan2002)

min rT x

min cT x

s.t. Ax = e

Mx = b

x ∈ 0, 1

rj is penalty for short groundtime, uses parameters of delaydistribution

Matthias Ehrgott MOCO: Applications

Page 102: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Simulation Results

Simulation of schedules obtained by both methods (Tam et al.2007)

39500 40000 40500

100

200

300

400

Stochastic ProgrammingBi-Criteria

Average Crew Induced Delay Minutes

cTx

Matthias Ehrgott MOCO: Applications

Page 103: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Solving Biobjective Set Partitioning Models

Method of elastic constraints

min rT x + ps

s.t. Ax = e

Mx = b

cT x − s + t 5 ε

x ∈ 0, 1n

s = 0

Solutions are weakly efficient

All efficient solutions can befound

Computationally superior

Matthias Ehrgott MOCO: Applications

Page 104: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Solving Biobjective Set Partitioning Models

Method of elastic constraints

min rT x + ps

s.t. Ax = e

Mx = b

cT x − s + t = ε

x ∈ 0, 1n

s = 0

Solutions are weakly efficient

All efficient solutions can befound

Computationally superior

Matthias Ehrgott MOCO: Applications

Page 105: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Solving Biobjective Set Partitioning Models

Method of elastic constraints

min rT x + ps

s.t. Ax = e

Mx = b

cT x − s + t = ε

x ∈ 0, 1n

s = 0

Solutions are weakly efficient

All efficient solutions can befound

Computationally superior

Matthias Ehrgott MOCO: Applications

Page 106: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Solving Biobjective Set Partitioning Models

Method of elastic constraints

min rT x + ps

s.t. Ax = e

Mx = b

cT x − s + t = ε

x ∈ 0, 1n

s = 0

Solutions are weakly efficient

All efficient solutions can befound

Computationally superior

Matthias Ehrgott MOCO: Applications

Page 107: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Solving Biobjective Set Partitioning Models

Method of elastic constraints

min rT x + ps

s.t. Ax = e

Mx = b

cT x − s + t = ε

x ∈ 0, 1n

s = 0

Solutions are weakly efficient

All efficient solutions can befound

Computationally superior

Matthias Ehrgott MOCO: Applications

Page 108: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Unit Crewing

What’s the use of having robust solutions for pilots if cabin crewdo something different?

Solve pairings problem for several crew groups

Minimize cost, maximize unit crewing (Tam et al. 2004)

min cT1 x1 + cT

2 x2

min eT s1 + eT s2subject to A1x1 = e

M1x1 = b1

A2x2 = eM2x2 = b2

U1x1 − U2x2 − s1 + s2 = 0x1 x2 s1 s2 ∈ 0, 1n

Matthias Ehrgott MOCO: Applications

Page 109: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Unit Crewing

What’s the use of having robust solutions for pilots if cabin crewdo something different?

Solve pairings problem for several crew groups

Minimize cost, maximize unit crewing (Tam et al. 2004)

min cT1 x1 + cT

2 x2

min eT s1 + eT s2subject to A1x1 = e

M1x1 = b1

A2x2 = eM2x2 = b2

U1x1 − U2x2 − s1 + s2 = 0x1 x2 s1 s2 ∈ 0, 1n

Matthias Ehrgott MOCO: Applications

Page 110: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Unit Crewing

What’s the use of having robust solutions for pilots if cabin crewdo something different?

Solve pairings problem for several crew groups

Minimize cost, maximize unit crewing (Tam et al. 2004)

min cT1 x1 + cT

2 x2

min eT s1 + eT s2subject to A1x1 = e

M1x1 = b1

A2x2 = eM2x2 = b2

U1x1 − U2x2 − s1 + s2 = 0x1 x2 s1 s2 ∈ 0, 1n

Matthias Ehrgott MOCO: Applications

Page 111: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Unit Crewing

What’s the use of having robust solutions for pilots if cabin crewdo something different?

Solve pairings problem for several crew groups

Minimize cost, maximize unit crewing (Tam et al. 2004)

min cT1 x1 + cT

2 x2

min eT s1 + eT s2subject to A1x1 = e

M1x1 = b1

A2x2 = eM2x2 = b2

U1x1 − U2x2 − s1 + s2 = 0x1 x2 s1 s2 ∈ 0, 1n

Matthias Ehrgott MOCO: Applications

Page 112: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Results

Matthias Ehrgott MOCO: Applications

Page 113: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Comments

Development of new multiojective programming techniquedriven by application

Biobjective model may be an alternative to stochasticprogramming, if recourse can be captured in deterministicobjective

Naturally drives development towards integrated model forairline operations (Weide et al. 2006)

Matthias Ehrgott MOCO: Applications

Page 114: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Comments

Development of new multiojective programming techniquedriven by application

Biobjective model may be an alternative to stochasticprogramming, if recourse can be captured in deterministicobjective

Naturally drives development towards integrated model forairline operations (Weide et al. 2006)

Matthias Ehrgott MOCO: Applications

Page 115: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Train Timetable InformationCrew Scheduling

Comments

Development of new multiojective programming techniquedriven by application

Biobjective model may be an alternative to stochasticprogramming, if recourse can be captured in deterministicobjective

Naturally drives development towards integrated model forairline operations (Weide et al. 2006)

Matthias Ehrgott MOCO: Applications

Page 116: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Overview

1 Metaheuristics

2 FinancePortfolio Selection

3 TransportationTrain Timetable InformationCrew Scheduling

4 MedicineRadiotherapy Treatment Design

5 TelecommunicationRouting in IP Networks

6 Conclusion

Matthias Ehrgott MOCO: Applications

Page 117: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Radiotherapy

Matthias Ehrgott MOCO: Applications

Page 118: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Radiotherapy

Matthias Ehrgott MOCO: Applications

Page 119: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Radiotherapy Treatment Design

Given beam directions findintensity map

such that “good” dosedistribution results

http://www.icr.ac.uk/ncri/liz adams rmt.html

Matthias Ehrgott MOCO: Applications

Page 120: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Optimization Practice Today

(Intensity Modulated Radiotherapy) IMRT represents anadvance in the means that radiation is delivered to the target,and it is believed that IMRT offers an improvement overconventional and conformal radiation in its ability to providehigher dose irradiation of tumor mass, while exposing thesurrounding normal tissue to less radiation.http://www.cancernews.com/data/Article/259.asp

Most popular optimization model given goal dose to target,upper bounds for dose to critical structures and normal tissue

minx=0

ωT‖AT x − TG‖ + ωC

∥∥(ACx − CG )+∥∥ + ωN

∥∥(AN x − NG )+∥∥

Most popular solution technique simulated annealing

Trial and error regarding values of ωT , ωC , ωN

Matthias Ehrgott MOCO: Applications

Page 121: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Optimization Practice Today

(Intensity Modulated Radiotherapy) IMRT represents anadvance in the means that radiation is delivered to the target,and it is believed that IMRT offers an improvement overconventional and conformal radiation in its ability to providehigher dose irradiation of tumor mass, while exposing thesurrounding normal tissue to less radiation.http://www.cancernews.com/data/Article/259.asp

Most popular optimization model given goal dose to target,upper bounds for dose to critical structures and normal tissue

minx=0

ωT‖AT x − TG‖ + ωC

∥∥(ACx − CG )+∥∥ + ωN

∥∥(AN x − NG )+∥∥

Most popular solution technique simulated annealing

Trial and error regarding values of ωT , ωC , ωN

Matthias Ehrgott MOCO: Applications

Page 122: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Optimization Practice Today

(Intensity Modulated Radiotherapy) IMRT represents anadvance in the means that radiation is delivered to the target,and it is believed that IMRT offers an improvement overconventional and conformal radiation in its ability to providehigher dose irradiation of tumor mass, while exposing thesurrounding normal tissue to less radiation.http://www.cancernews.com/data/Article/259.asp

Most popular optimization model given goal dose to target,upper bounds for dose to critical structures and normal tissue

minx=0

ωT‖AT x − TG‖ + ωC

∥∥(ACx − CG )+∥∥ + ωN

∥∥(AN x − NG )+∥∥

Most popular solution technique simulated annealing

Trial and error regarding values of ωT , ωC , ωN

Matthias Ehrgott MOCO: Applications

Page 123: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Optimization Practice Today

(Intensity Modulated Radiotherapy) IMRT represents anadvance in the means that radiation is delivered to the target,and it is believed that IMRT offers an improvement overconventional and conformal radiation in its ability to providehigher dose irradiation of tumor mass, while exposing thesurrounding normal tissue to less radiation.http://www.cancernews.com/data/Article/259.asp

Most popular optimization model given goal dose to target,upper bounds for dose to critical structures and normal tissue

minx=0

ωT‖AT x − TG‖ + ωC

∥∥(ACx − CG )+∥∥ + ωN

∥∥(AN x − NG )+∥∥

Most popular solution technique simulated annealing

Trial and error regarding values of ωT , ωC , ωN

Matthias Ehrgott MOCO: Applications

Page 124: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Evolution of Multiobjective Models

Standard dose based objective is weighted sum ofmultiobjective model

But obvious MOP

minx=0

(‖AT x − TG‖ ,

∥∥(ACx − CG )+∥∥ ,

∥∥(AN x − NG )+∥∥)

only used with pre-selected weights and weighted sumoptimization (Cotrutz et al. 2001, Lahanas et al. 2003)

First multiobjective LP model by Hamacher and Kufer 2000

Matthias Ehrgott MOCO: Applications

Page 125: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Evolution of Multiobjective Models

Standard dose based objective is weighted sum ofmultiobjective model

But obvious MOP

minx=0

(‖AT x − TG‖ ,

∥∥(ACx − CG )+∥∥ ,

∥∥(AN x − NG )+∥∥)

only used with pre-selected weights and weighted sumoptimization (Cotrutz et al. 2001, Lahanas et al. 2003)

First multiobjective LP model by Hamacher and Kufer 2000

Matthias Ehrgott MOCO: Applications

Page 126: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Evolution of Multiobjective Models

Standard dose based objective is weighted sum ofmultiobjective model

But obvious MOP

minx=0

(‖AT x − TG‖ ,

∥∥(ACx − CG )+∥∥ ,

∥∥(AN x − NG )+∥∥)

only used with pre-selected weights and weighted sumoptimization (Cotrutz et al. 2001, Lahanas et al. 2003)

First multiobjective LP model by Hamacher and Kufer 2000

Matthias Ehrgott MOCO: Applications

Page 127: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

A Multiobjective LP Formulation

Theorem (Romeijn et al. 2004)

The MOPs min(f1(x), . . . , fp(x)) : x ∈ X andmin(h1(f1(x)), . . . , hp(fp(x))) : x ∈ X with strictly increasingh1, . . . , hp and convex f1, . . . , fp have the same efficient set.

min(yT , yC , yN )subject to AT x + yT e = lT

AT x 5 uTACx − yCe 5 uC

AN x − yN e 5 uNyN , yT , x = 0

yC = −uC

Matthias Ehrgott MOCO: Applications

Page 128: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

A Multiobjective LP Formulation

Theorem (Romeijn et al. 2004)

The MOPs min(f1(x), . . . , fp(x)) : x ∈ X andmin(h1(f1(x)), . . . , hp(fp(x))) : x ∈ X with strictly increasingh1, . . . , hp and convex f1, . . . , fp have the same efficient set.

min(yT , yC , yN )subject to AT x + yT e = lT

AT x 5 uTACx − yCe 5 uC

AN x − yN e 5 uNyN , yT , x = 0

yC = −uC

Matthias Ehrgott MOCO: Applications

Page 129: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Results

Only 3 objectives, so solve problem in objective space

Benson’s algorithm (Benson 1998)

Dual variant of Benson’s algorithm (Ehrgott, Loehne, Shao2007)

Dose matrix imprecise, delivery imprecise

Calculation to small fraction of a Gy

Approximation versions of primal and dual Benson Algorithm(Ehrgott and Shao 2006, 2007)

Matthias Ehrgott MOCO: Applications

Page 130: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Results

Only 3 objectives, so solve problem in objective space

Benson’s algorithm (Benson 1998)

Dual variant of Benson’s algorithm (Ehrgott, Loehne, Shao2007)

Dose matrix imprecise, delivery imprecise

Calculation to small fraction of a Gy

Approximation versions of primal and dual Benson Algorithm(Ehrgott and Shao 2006, 2007)

Matthias Ehrgott MOCO: Applications

Page 131: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Results

Only 3 objectives, so solve problem in objective space

Benson’s algorithm (Benson 1998)

Dual variant of Benson’s algorithm (Ehrgott, Loehne, Shao2007)

Dose matrix imprecise, delivery imprecise

Calculation to small fraction of a Gy

Approximation versions of primal and dual Benson Algorithm(Ehrgott and Shao 2006, 2007)

Matthias Ehrgott MOCO: Applications

Page 132: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Results

Only 3 objectives, so solve problem in objective space

Benson’s algorithm (Benson 1998)

Dual variant of Benson’s algorithm (Ehrgott, Loehne, Shao2007)

Dose matrix imprecise, delivery imprecise

Calculation to small fraction of a Gy

Approximation versions of primal and dual Benson Algorithm(Ehrgott and Shao 2006, 2007)

Matthias Ehrgott MOCO: Applications

Page 133: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Results

Only 3 objectives, so solve problem in objective space

Benson’s algorithm (Benson 1998)

Dual variant of Benson’s algorithm (Ehrgott, Loehne, Shao2007)

Dose matrix imprecise, delivery imprecise

Calculation to small fraction of a Gy

Approximation versions of primal and dual Benson Algorithm(Ehrgott and Shao 2006, 2007)

Matthias Ehrgott MOCO: Applications

Page 134: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Results

Only 3 objectives, so solve problem in objective space

Benson’s algorithm (Benson 1998)

Dual variant of Benson’s algorithm (Ehrgott, Loehne, Shao2007)

Dose matrix imprecise, delivery imprecise

Calculation to small fraction of a Gy

Approximation versions of primal and dual Benson Algorithm(Ehrgott and Shao 2006, 2007)

Matthias Ehrgott MOCO: Applications

Page 135: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

The Test Cases

Acoustic Neuroma Prostate Pancreatic Lesion

Dose calculation inexact

Inaccuracies during delivery

Planning to small fraction of a Gy acceptable

Matthias Ehrgott MOCO: Applications

Page 136: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

The Test Cases

Acoustic Neuroma Prostate Pancreatic Lesion

Dose calculation inexact

Inaccuracies during delivery

Planning to small fraction of a Gy acceptable

Matthias Ehrgott MOCO: Applications

Page 137: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

The Test Cases

Case AN P PL

Tumour voxels 9 22 67Critical organ voxels 47 89 91Normal tissue voxels 999 1182 986Bixels 594 821 1140

uT 87.55 90.64 90.64lT 82.45 85.36 85.36uC 60/45 60/45 60/45uN 0.00 0.00 0.00zT UB 16.49 42.68 17.07zCUB 12.00 30.00 12.00zNUB 87.55 100.64 90.64

Matthias Ehrgott MOCO: Applications

Page 138: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Numerical Results

ε Solving the dual Solving the primalTime Vert. Cuts Time Vert. Cuts

AC 0.1 1.484 17 8 5.938 27 210.01 3.078 33 18 8.703 47 44

0 8.864 85 55 13.984 55 85PR 0.1 4.422 39 19 14.781 56 42

0.01 18.454 157 78 64.954 296 1840 792.390 3280 3165 995.050 3165 3280

PL 0.1 58.263 85 44 164.360 152 900.01 401.934 582 298 1184.950 1097 586

0.005 734.784 1058 539 2147.530 1989 1041

Matthias Ehrgott MOCO: Applications

Page 139: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Numerical Results

ε = 0.1 ε = 0.01 ε = 0

P:12

1416

18

510

15

60

70

80

90

y2

y1

y 3

1214

1618

510

15

60

70

80

90

y2

y1

y 3

1214

1618

510

15

60

70

80

90

y2

y1

y 3

D:12

1416

18

510

15

60

70

80

90

y2

y1

y 3

1214

1618

510

15

60

70

80

90

y2

y1

y 3

12 14 16 185

1015

60

70

80

90

y2

y1

y 3Matthias Ehrgott MOCO: Applications

Page 140: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Numerical Results

ε = 0.1 ε = 0.01 ε = 0

P:0

2040

−2002040

0

50

100

y2

y1

y 3

020

40−2002040

0

50

100

y2

y1

y 3

020

40−2002040

0

50

100

y2

y1

y 3

D:

0

20

40

−200

2040

0

50

100

y2

y1

y 3

0

20

40

−200

2040

0

50

100

y2y

1

y 3

020

40

−200

2040

0

50

100

y2

y1

y 3Matthias Ehrgott MOCO: Applications

Page 141: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Numerical Results

ε = 0.1 ε = 0.01 ε = 0.0005

P:

0

5

10

15

20

−40−20

020

60

80

100

y2

y1

y 3

0

10

20−40−30−20−1001020

40

60

80

100

y2

y1

y 3

0

10

20

−40−30−20−1001020

60

80

100

y2

y1

y 3

D:

0

10

20

−40−20

020

40

60

80

100

y2

y1

y 3

0

10

20

−40−20

020

40

60

80

100

y2

y1

y 3

0

10

20−40−30−20−1001020

40

60

80

100

y2

y1

y 3Matthias Ehrgott MOCO: Applications

Page 142: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

The Challenge

min(yT , yC , yN )subject to AT x + yT e = lT

AT x 5 uTASx − ySe 5 uS

AN x − yN e 5 uNzN = 0

x = 0x 5 My

eT y 5 ry ∈ 0, 1l

where l is number of candidate beams

Matthias Ehrgott MOCO: Applications

Page 143: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Comments

It may be hard to convince practitioners of the usefulness ofmultiobjective optmization

Exploit application to simplify methods

Multiobjective optimization leads to improved processes

New theoretical developments driven by application

Matthias Ehrgott MOCO: Applications

Page 144: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Comments

It may be hard to convince practitioners of the usefulness ofmultiobjective optmization

Exploit application to simplify methods

Multiobjective optimization leads to improved processes

New theoretical developments driven by application

Matthias Ehrgott MOCO: Applications

Page 145: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Comments

It may be hard to convince practitioners of the usefulness ofmultiobjective optmization

Exploit application to simplify methods

Multiobjective optimization leads to improved processes

New theoretical developments driven by application

Matthias Ehrgott MOCO: Applications

Page 146: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Radiotherapy Treatment Design

Comments

It may be hard to convince practitioners of the usefulness ofmultiobjective optmization

Exploit application to simplify methods

Multiobjective optimization leads to improved processes

New theoretical developments driven by application

Matthias Ehrgott MOCO: Applications

Page 147: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Routing in IP Networks

Overview

1 Metaheuristics

2 FinancePortfolio Selection

3 TransportationTrain Timetable InformationCrew Scheduling

4 MedicineRadiotherapy Treatment Design

5 TelecommunicationRouting in IP Networks

6 Conclusion

Matthias Ehrgott MOCO: Applications

Page 148: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Routing in IP Networks

Routing in IP Networks

Standard: OSPF protocol (openshortest path first)

Dijkstra’s algorithm used tominimize number of hops

Other protocols allowaggregation of several objectives

But still “best effort” ratherthan “Quality of Service”

13

2503 579 607

22501 915 678

22506 977 311

25002 168 901

5004 641 359

2000568 033

7501 099 044

2508 453 025

500420 644

17504 024 195

250226 621

2250443 005

2500456 491

250819 462

2000429 359

1000372 461

1500780 006

4750478 379

15002 248 390

5001 695 546

14 10

11

12

9 15

8

1

2

3

7

6

5

4

16

Euronet PoP

Non PoP node

durée (µs)BPR (Kb/s)

EUROPE2

Matthias Ehrgott MOCO: Applications

Page 149: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Routing in IP Networks

Routing in IP Networks

Standard: OSPF protocol (openshortest path first)

Dijkstra’s algorithm used tominimize number of hops

Other protocols allowaggregation of several objectives

But still “best effort” ratherthan “Quality of Service”

13

2503 579 607

22501 915 678

22506 977 311

25002 168 901

5004 641 359

2000568 033

7501 099 044

2508 453 025

500420 644

17504 024 195

250226 621

2250443 005

2500456 491

250819 462

2000429 359

1000372 461

1500780 006

4750478 379

15002 248 390

5001 695 546

14 10

11

12

9 15

8

1

2

3

7

6

5

4

16

Euronet PoP

Non PoP node

durée (µs)BPR (Kb/s)

EUROPE2

Matthias Ehrgott MOCO: Applications

Page 150: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Routing in IP Networks

Routing in IP Networks

Standard: OSPF protocol (openshortest path first)

Dijkstra’s algorithm used tominimize number of hops

Other protocols allowaggregation of several objectives

But still “best effort” ratherthan “Quality of Service”

13

2503 579 607

22501 915 678

22506 977 311

25002 168 901

5004 641 359

2000568 033

7501 099 044

2508 453 025

500420 644

17504 024 195

250226 621

2250443 005

2500456 491

250819 462

2000429 359

1000372 461

1500780 006

4750478 379

15002 248 390

5001 695 546

14 10

11

12

9 15

8

1

2

3

7

6

5

4

16

Euronet PoP

Non PoP node

durée (µs)BPR (Kb/s)

EUROPE2

Matthias Ehrgott MOCO: Applications

Page 151: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Routing in IP Networks

Routing in IP Networks

Standard: OSPF protocol (openshortest path first)

Dijkstra’s algorithm used tominimize number of hops

Other protocols allowaggregation of several objectives

But still “best effort” ratherthan “Quality of Service”

13

2503 579 607

22501 915 678

22506 977 311

25002 168 901

5004 641 359

2000568 033

7501 099 044

2508 453 025

500420 644

17504 024 195

250226 621

2250443 005

2500456 491

250819 462

2000429 359

1000372 461

1500780 006

4750478 379

15002 248 390

5001 695 546

14 10

11

12

9 15

8

1

2

3

7

6

5

4

16

Euronet PoP

Non PoP node

durée (µs)BPR (Kb/s)

EUROPE2

Matthias Ehrgott MOCO: Applications

Page 152: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Routing in IP Networks

Multiobjective Shortest Paths

Find paths (routes) p with objectives (Gandibleux et al. 2006)

min f1(p) =∑

(i,j)∈p c1(i , j) (delay)

max f2(p) = min(i,j)∈p c2(i , j) (bandwidth)min f3(p) = |(i , j) ∈ p| (number of hops)

Additional constraints

Modification of Martin’s label correcting algorithm

Matthias Ehrgott MOCO: Applications

Page 153: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Routing in IP Networks

Multiobjective Shortest Paths

Find paths (routes) p with objectives (Gandibleux et al. 2006)

min f1(p) =∑

(i,j)∈p c1(i , j) (delay)

max f2(p) = min(i,j)∈p c2(i , j) (bandwidth)min f3(p) = |(i , j) ∈ p| (number of hops)

Additional constraints

Modification of Martin’s label correcting algorithm

Matthias Ehrgott MOCO: Applications

Page 154: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Routing in IP Networks

Multiobjective Shortest Paths

Find paths (routes) p with objectives (Gandibleux et al. 2006)

min f1(p) =∑

(i,j)∈p c1(i , j) (delay)

max f2(p) = min(i,j)∈p c2(i , j) (bandwidth)min f3(p) = |(i , j) ∈ p| (number of hops)

Additional constraints

Modification of Martin’s label correcting algorithm

Matthias Ehrgott MOCO: Applications

Page 155: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Routing in IP Networks

Multiobjective Shortest Paths

Find paths (routes) p with objectives (Gandibleux et al. 2006)

min f1(p) =∑

(i,j)∈p c1(i , j) (delay)

max f2(p) = min(i,j)∈p c2(i , j) (bandwidth)min f3(p) = |(i , j) ∈ p| (number of hops)

Additional constraints

Modification of Martin’s label correcting algorithm

Matthias Ehrgott MOCO: Applications

Page 156: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Routing in IP Networks

Multiobjective Shortest Paths

Find paths (routes) p with objectives (Gandibleux et al. 2006)

min f1(p) =∑

(i,j)∈p c1(i , j) (delay)

max f2(p) = min(i,j)∈p c2(i , j) (bandwidth)min f3(p) = |(i , j) ∈ p| (number of hops)

Additional constraints

Modification of Martin’s label correcting algorithm

Matthias Ehrgott MOCO: Applications

Page 157: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Routing in IP Networks

Multiobjective Shortest Paths

Find paths (routes) p with objectives (Gandibleux et al. 2006)

min f1(p) =∑

(i,j)∈p c1(i , j) (delay)

max f2(p) = min(i,j)∈p c2(i , j) (bandwidth)min f3(p) = |(i , j) ∈ p| (number of hops)

Additional constraints

Modification of Martin’s label correcting algorithm

Matthias Ehrgott MOCO: Applications

Page 158: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Routing in IP Networks

Result

With delay and bandwidth objectives there are 5 efficient pathsfrom 7 to 11

13

2503 579 607

22501 915 678

22506 977 311

25002 168 901

5004 641 359

2000568 033

7501 099 044

2508 453 025

500420 644

17504 024 195

250226 621

2250443 005

2500456 491

250819 462

2000429 359

1000372 461

1500780 006

4750478 379

15002 248 390

5001 695 546

14 10

11

12

9 15

8

1

2

3

7

6

5

4

16

Euronet PoP

Non PoP node

durée (µs)BPR (Kb/s)

EUROPE2

Matthias Ehrgott MOCO: Applications

Page 159: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Routing in IP Networks

Comments

Old dogs can learn new tricks

Multiobjective modelling helps thinking outside the box

Chapter 22 in Figueira, Greco, Ehrgott “Multicriteria DecisionAnalysis” Springer 2005

Matthias Ehrgott MOCO: Applications

Page 160: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Routing in IP Networks

Comments

Old dogs can learn new tricks

Multiobjective modelling helps thinking outside the box

Chapter 22 in Figueira, Greco, Ehrgott “Multicriteria DecisionAnalysis” Springer 2005

Matthias Ehrgott MOCO: Applications

Page 161: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Routing in IP Networks

Comments

Old dogs can learn new tricks

Multiobjective modelling helps thinking outside the box

Chapter 22 in Figueira, Greco, Ehrgott “Multicriteria DecisionAnalysis” Springer 2005

Matthias Ehrgott MOCO: Applications

Page 162: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Overview

1 Metaheuristics

2 FinancePortfolio Selection

3 TransportationTrain Timetable InformationCrew Scheduling

4 MedicineRadiotherapy Treatment Design

5 TelecommunicationRouting in IP Networks

6 Conclusion

Matthias Ehrgott MOCO: Applications

Page 163: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Conclusion

Very hard MOCO problems: (Meta)HeuristicsChallenge 1: Two phase method for more than threeobjectives (Principle: Przybylski et al. 2007)Challenge 2: Multiobjective branch and bound algorithm(Spanjaard and Sourd 2007)Challenge 3: Polyhedral theory for MOCO scalarizationChallenge 4: How to build an exact algorithm for very hardproblemsReal world applications provide opportunities for progress inmultiobjecive optimization methodology and theoryMultiobjective models provide insights in applications thatconventional models cannot revealAdditional benefits derive from improvement of processesMany challenges and new application areas are available

Matthias Ehrgott MOCO: Applications

Page 164: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Conclusion

Very hard MOCO problems: (Meta)HeuristicsChallenge 1: Two phase method for more than threeobjectives (Principle: Przybylski et al. 2007)Challenge 2: Multiobjective branch and bound algorithm(Spanjaard and Sourd 2007)Challenge 3: Polyhedral theory for MOCO scalarizationChallenge 4: How to build an exact algorithm for very hardproblemsReal world applications provide opportunities for progress inmultiobjecive optimization methodology and theoryMultiobjective models provide insights in applications thatconventional models cannot revealAdditional benefits derive from improvement of processesMany challenges and new application areas are available

Matthias Ehrgott MOCO: Applications

Page 165: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Conclusion

Very hard MOCO problems: (Meta)HeuristicsChallenge 1: Two phase method for more than threeobjectives (Principle: Przybylski et al. 2007)Challenge 2: Multiobjective branch and bound algorithm(Spanjaard and Sourd 2007)Challenge 3: Polyhedral theory for MOCO scalarizationChallenge 4: How to build an exact algorithm for very hardproblemsReal world applications provide opportunities for progress inmultiobjecive optimization methodology and theoryMultiobjective models provide insights in applications thatconventional models cannot revealAdditional benefits derive from improvement of processesMany challenges and new application areas are available

Matthias Ehrgott MOCO: Applications

Page 166: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Conclusion

Very hard MOCO problems: (Meta)HeuristicsChallenge 1: Two phase method for more than threeobjectives (Principle: Przybylski et al. 2007)Challenge 2: Multiobjective branch and bound algorithm(Spanjaard and Sourd 2007)Challenge 3: Polyhedral theory for MOCO scalarizationChallenge 4: How to build an exact algorithm for very hardproblemsReal world applications provide opportunities for progress inmultiobjecive optimization methodology and theoryMultiobjective models provide insights in applications thatconventional models cannot revealAdditional benefits derive from improvement of processesMany challenges and new application areas are available

Matthias Ehrgott MOCO: Applications

Page 167: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Conclusion

Very hard MOCO problems: (Meta)HeuristicsChallenge 1: Two phase method for more than threeobjectives (Principle: Przybylski et al. 2007)Challenge 2: Multiobjective branch and bound algorithm(Spanjaard and Sourd 2007)Challenge 3: Polyhedral theory for MOCO scalarizationChallenge 4: How to build an exact algorithm for very hardproblemsReal world applications provide opportunities for progress inmultiobjecive optimization methodology and theoryMultiobjective models provide insights in applications thatconventional models cannot revealAdditional benefits derive from improvement of processesMany challenges and new application areas are available

Matthias Ehrgott MOCO: Applications

Page 168: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Conclusion

Very hard MOCO problems: (Meta)HeuristicsChallenge 1: Two phase method for more than threeobjectives (Principle: Przybylski et al. 2007)Challenge 2: Multiobjective branch and bound algorithm(Spanjaard and Sourd 2007)Challenge 3: Polyhedral theory for MOCO scalarizationChallenge 4: How to build an exact algorithm for very hardproblemsReal world applications provide opportunities for progress inmultiobjecive optimization methodology and theoryMultiobjective models provide insights in applications thatconventional models cannot revealAdditional benefits derive from improvement of processesMany challenges and new application areas are available

Matthias Ehrgott MOCO: Applications

Page 169: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Conclusion

Very hard MOCO problems: (Meta)HeuristicsChallenge 1: Two phase method for more than threeobjectives (Principle: Przybylski et al. 2007)Challenge 2: Multiobjective branch and bound algorithm(Spanjaard and Sourd 2007)Challenge 3: Polyhedral theory for MOCO scalarizationChallenge 4: How to build an exact algorithm for very hardproblemsReal world applications provide opportunities for progress inmultiobjecive optimization methodology and theoryMultiobjective models provide insights in applications thatconventional models cannot revealAdditional benefits derive from improvement of processesMany challenges and new application areas are available

Matthias Ehrgott MOCO: Applications

Page 170: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Conclusion

Very hard MOCO problems: (Meta)HeuristicsChallenge 1: Two phase method for more than threeobjectives (Principle: Przybylski et al. 2007)Challenge 2: Multiobjective branch and bound algorithm(Spanjaard and Sourd 2007)Challenge 3: Polyhedral theory for MOCO scalarizationChallenge 4: How to build an exact algorithm for very hardproblemsReal world applications provide opportunities for progress inmultiobjecive optimization methodology and theoryMultiobjective models provide insights in applications thatconventional models cannot revealAdditional benefits derive from improvement of processesMany challenges and new application areas are available

Matthias Ehrgott MOCO: Applications

Page 171: International Doctoral School Algorithmic Decision Theory: … · 2009-05-20 · International Doctoral School Algorithmic Decision Theory: MCDA and MOO Lecture 5: Metaheuristics

MetaheuristicsFinance

TransportationMedicine

TelecommunicationConclusion

Conclusion

Very hard MOCO problems: (Meta)HeuristicsChallenge 1: Two phase method for more than threeobjectives (Principle: Przybylski et al. 2007)Challenge 2: Multiobjective branch and bound algorithm(Spanjaard and Sourd 2007)Challenge 3: Polyhedral theory for MOCO scalarizationChallenge 4: How to build an exact algorithm for very hardproblemsReal world applications provide opportunities for progress inmultiobjecive optimization methodology and theoryMultiobjective models provide insights in applications thatconventional models cannot revealAdditional benefits derive from improvement of processesMany challenges and new application areas are available

Matthias Ehrgott MOCO: Applications