game-theoretic approaches to multi-agent systems bernhard nebel
Post on 18-Dec-2015
219 views
TRANSCRIPT
![Page 1: Game-Theoretic Approaches to Multi-Agent Systems Bernhard Nebel](https://reader036.vdocument.in/reader036/viewer/2022062407/56649d245503460f949fac77/html5/thumbnails/1.jpg)
Game-Theoretic Approaches to Multi-Agent Systems
Bernhard Nebel
![Page 2: Game-Theoretic Approaches to Multi-Agent Systems Bernhard Nebel](https://reader036.vdocument.in/reader036/viewer/2022062407/56649d245503460f949fac77/html5/thumbnails/2.jpg)
The Setting
• More than one agent in the environment:– Tasks can be solved faster– Sometimes essential (sensor networks,
robotic soccer, …)– Solutions should be robust!– Should tolerate heterogeneous team
structures if possible
• Sometimes, the agents might not be cooperative …
![Page 3: Game-Theoretic Approaches to Multi-Agent Systems Bernhard Nebel](https://reader036.vdocument.in/reader036/viewer/2022062407/56649d245503460f949fac77/html5/thumbnails/3.jpg)
Example 1: Robotic Soccer Team
• Do not interfere with your team mates
• Take over role if it is not filled
• Try to fill the role that optimizes the group utility
![Page 4: Game-Theoretic Approaches to Multi-Agent Systems Bernhard Nebel](https://reader036.vdocument.in/reader036/viewer/2022062407/56649d245503460f949fac77/html5/thumbnails/4.jpg)
Example 2: Robot Exploration
• A group of robots should explore a maze and construct a common map
• Each robot goes to the closest unexplored point
• Can we do better than that?
Thanks to Wolfram Burgard!
![Page 5: Game-Theoretic Approaches to Multi-Agent Systems Bernhard Nebel](https://reader036.vdocument.in/reader036/viewer/2022062407/56649d245503460f949fac77/html5/thumbnails/5.jpg)
Example 3: Office Delivery
• Team of robots
• They all have tasks assigned to them
• They all are selfish and want to minimize their work
• Negotiation:– Reassignment of tasks – Agree on acceptable solution
![Page 6: Game-Theoretic Approaches to Multi-Agent Systems Bernhard Nebel](https://reader036.vdocument.in/reader036/viewer/2022062407/56649d245503460f949fac77/html5/thumbnails/6.jpg)
Game Theory: General Ideas
• Consider sets of agents• Assume that all of them act rationally• Assume that all of them know that the others act
rationally and what they prefer (or there is at least a probability distribution)
Actions have to be selected according to the fact that everybody acts rationally and knows that the others do so
Game Theory is about how to select actions in strategic decision situation
![Page 7: Game-Theoretic Approaches to Multi-Agent Systems Bernhard Nebel](https://reader036.vdocument.in/reader036/viewer/2022062407/56649d245503460f949fac77/html5/thumbnails/7.jpg)
Game Theory: Framework• (Strategic) Games:
– Finite set of players– Set of strategies (can be randomization of basic
actions – so-called mixed strategies)– Utility for each player depends on the chosen strategy
profile
• Solution of a game:– Dominating strategies: Strategies that are better
regardless of what the others do (perhaps after eliminating dominated strategies of other players)
– Nash-Equilibrium: strategy profile where there is no incentive for any individual to deviate.
![Page 8: Game-Theoretic Approaches to Multi-Agent Systems Bernhard Nebel](https://reader036.vdocument.in/reader036/viewer/2022062407/56649d245503460f949fac77/html5/thumbnails/8.jpg)
Example: Prisoner's Dilemma
• Two prisoners are put in separate cells and are questioned. They have the following options:– If they both do not confess,
they are punished only for a minor crime
– If one confesses and the other one doesn't, the former one is freed and the other goes to jail for a very long time
– If both confess, they are sentenced to a moderate amount of time to jail
• Equilibrium: Both confess• Even worse: This is a
dominant strategy
Player 2
confesses
Player 2
doesn't
confess
Player 1
confesses
P1: 2
P2: 2
P1: 10
P2: 0
Player 1
doesn't
confess
P1: 0
P2: 10
P1: 8
P2: 8
![Page 9: Game-Theoretic Approaches to Multi-Agent Systems Bernhard Nebel](https://reader036.vdocument.in/reader036/viewer/2022062407/56649d245503460f949fac77/html5/thumbnails/9.jpg)
Application of Game Theory
• Analysing strategic situations in economy, politics, or war
Problem: Humans often act "irrationally" (e.g., in auctions they change their valuation or they do not assume that the others act rationally)
• Analysing and synthesising multi-agent-systems These are by design rational Game theory as a theoretical basis for MAS Self interest over global optimization
More robustStill satisfies some criteriaMakes everybody happy (when there are different
interests)
![Page 10: Game-Theoretic Approaches to Multi-Agent Systems Bernhard Nebel](https://reader036.vdocument.in/reader036/viewer/2022062407/56649d245503460f949fac77/html5/thumbnails/10.jpg)
The Exploration Game
• At each point of time:– the utility of reaching an unexplored area first
is
C – d• where C is a large constant• and d is the distance to the area
– If the area is not reached first, the utility is -d
![Page 11: Game-Theoretic Approaches to Multi-Agent Systems Bernhard Nebel](https://reader036.vdocument.in/reader036/viewer/2022062407/56649d245503460f949fac77/html5/thumbnails/11.jpg)
Example Situation
b
a
100
100
2
6
5
10
R1
R2
R2: a R2: b
R1: a R1: 98
R2: -5
R1: 98
R2: 90
R1: b R1: 94
R2: 95
R1: 94
R2: -10
![Page 12: Game-Theoretic Approaches to Multi-Agent Systems Bernhard Nebel](https://reader036.vdocument.in/reader036/viewer/2022062407/56649d245503460f949fac77/html5/thumbnails/12.jpg)
General Properties
• Choosing the point, nobody else but oneself is closest, is the dominant strategy– This characterises the Nash equilibrium
• The game theoretic solution corresponds to the greedy algorithm:– Iteratively, we select the pair of location and robots
that have not been chosen yet and are closest to each other
– Is not the optimal solution (i.e. does not maximize social welfare)
• Is more robust and flexible than central control
![Page 13: Game-Theoretic Approaches to Multi-Agent Systems Bernhard Nebel](https://reader036.vdocument.in/reader036/viewer/2022062407/56649d245503460f949fac77/html5/thumbnails/13.jpg)
Result
Game theoretic solution No coordination
![Page 14: Game-Theoretic Approaches to Multi-Agent Systems Bernhard Nebel](https://reader036.vdocument.in/reader036/viewer/2022062407/56649d245503460f949fac77/html5/thumbnails/14.jpg)
Game Theory …
• What happens if two robots are both very close?• What if we can exchange tasks?• What do we do if the cost computation is
computationally very costly?• General theory behind it
– Do we always have a Nash equilibrium?– How do we compute it?– How do we negotiate?– What happens if we can form coalitions?– How can we design games so that the agents achieve
a common goal?