adaptive pyramid model for the traveling salesman...

56
Adaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo, Emil Stefanov & John Saalweachter Purdue University Acknowledgment: Zheng Li Support: AFOSR Yll Haxhimusa & Walter G. Kropatsch Vienna University of Technology

Upload: others

Post on 13-May-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Adaptive pyramid model for the Traveling Salesman Problem

Zygmunt Pizlo, Emil Stefanov & John SaalweachterPurdue University

Acknowledgment: Zheng Li

Support: AFOSR

Yll Haxhimusa & Walter G. KropatschVienna University of Technology

Page 2: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Traveling Salesman Problem:

Find the shortest tour of N cities.

Page 3: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Traveling Salesman Problem:

TSP is a difficult optimization problem.

Page 4: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Experiment

• 5 subjects• Problem size: 6, 10, 20, 50• 25 random problems per size• Problems were shown on a computer screen

Page 5: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

BSL, ZP

optimalOSK, ZL

1.1%

6 city

Page 6: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

optimal

OSK 2.8%

ZL 1% ZP 2.2%

BSL 0.7%

10 city

Page 7: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

OSK10.7%

ZL

12.9%

ZP

0.4%

optimal BSL

2.7%

20 city

Page 8: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

OSK

optimal

BSL

4.8%

ZL

10.6%

ZP

7%

50 city

Page 9: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,
Page 10: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,
Page 11: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,
Page 12: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,
Page 13: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Model

• Multiresolution pyramid representation• Top-down process of tour approximations

Page 14: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

1D Pyramid architecture

The number of nodes on layer i+1 is b times smaller than that on layer i. Receptive field on layer i+1 is b times larger than that on layer i.

What is local close to the top, is global close to the bottom.

Page 15: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

2D Pyramid Representation

Page 16: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Model

• Multiresolution pyramid representation• Top-down process of tour approximations• Pyramid with the “fovea” and with “eye

movements”

Page 17: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Neuroanatomy of the visual system(Hubel & Wiesel, 1974)

At each retinal location, there is a family of receptive fields with different sizes and resolutions.

The size of the smallest field is a function of eccentricity.

Page 18: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Pyramid with Fovea

Resolution of the finest representation decreases with the distance from the fixation point – this corresponds to the non-uniform density of the receptors on the retina.Prevents from handling too much information at a time.

Page 19: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Model

• Multiresolution pyramid representation• Top-down process of tour approximations• Pyramid with the “fovea” and with “eye

movements”• Local search by means of “cheapest insertion”

Page 20: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Cheapest Insertion

Page 21: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Cheapest Insertion

Page 22: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Cheapest Insertion

Page 23: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Cheapest Insertion

Page 24: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Model

• Multiresolution pyramid representation• Top-down process of tour approximations• Pyramid with the “fovea” and with “eye

movements”• Local search by means of “cheapest insertion”• Adaptive receptive fields

Page 25: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Blurring with Gaussian Filter

Page 26: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,
Page 27: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Min-Max Method for Determining Cluster Boundaries

Page 28: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Bisection Pyramid – Top Layer (8)

Page 29: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Layer 7

Page 30: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Layer 6

Page 31: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Layer 5

Page 32: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Layer 4

Page 33: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Layer 3

Page 34: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Layer 2

Page 35: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Layer 1

Page 36: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Testing the Pyramid Model

• The model was run on the same problems that were used with the subjects

• The size k of the neighborhood for cheapest insertion was a free parameter

• Computational complexity of the model: between O(N) and O(N2).

Demo

Page 37: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Local Search in Cheapest Insertion

0

1

2

3

4

5

6

0 10 20 30 40 50 60

Problem Size

Am

mou

nt o

f Sea

rch

(K)

BSLOSKYHZLZP

Page 38: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,
Page 39: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,
Page 40: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Large Problems

Page 41: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Large Problems

Page 42: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Large Problems

Page 43: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

ZP solving large problems…

Page 44: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Minimum Spanning Tree vs. TSP

MST TSP

Page 45: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Psychophysics: MST vs. TSP

Page 46: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Psychophysics: MST vs. TSP

Page 47: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Psychophysics: MST vs. TSP

Page 48: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

What is MST actually good for?

• Clustering?• What type of clustering?

Page 49: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

MST as line detector

Perfect circle Less-than perfect circle

Page 50: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

MST for a realistic example

Page 51: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

TSP solutionsOptimal Line Pyramid

Page 52: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Summary• Computational complexity of the mental mechanisms is

very low but TSP tours found by the subjects are close to optimal.

• Coarse-to-fine sequence of approximations produced by a pyramid algorithm provides a plausible model of the mental mechanisms involved in solving TSP.

• The TSP model simulates attention (visual acuity), as well as eye movements – this minimizes the use of memory without slowing down the solution process.

• Simulated receptive fields are adaptive.• The line detection mechanism is likely to be based on

MST.

Page 53: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Next Step

• Test the model using TSP with obstacles.

Page 54: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Euclidean TSP with Obstacles(NE-TSP)

Page 55: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Maze – Like Obstacles

Visual spatial relations in the problem representation (proximities, directions) have to be modified by bottom-up verification of availability of moves.

Page 56: Adaptive pyramid model for the Traveling Salesman …psych.purdue.edu/tsp/workshop/files/presentations/pizlo.pdfAdaptive pyramid model for the Traveling Salesman Problem Zygmunt Pizlo,

Metric Always Exists, but May be Difficult to Reconstruct