efficiency and the redistribution of welfare milan vojnovic microsoft research cambridge, uk joint...

42
Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

Upload: fay-matthews

Post on 03-Jan-2016

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

Efficiency and the Redistribution of

WelfareMilan Vojnovic

Microsoft ResearchCambridge, UK

Joint work with Vasilis Syrgkanis and Yoram Bachrach

Page 2: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

2

Contribution Incentives

• Rewards for contributions• Credits• Social gratitude• Monetary incentives

• Online services• Ex. Quora, Stackoverflow, Yahoo! Answers

• Other• Scientific authorship• Projects in firms

Page 3: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

3

Que

stion

Topi

c

Site

Page 4: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

4

Another Example: Scientific Co-Authorship

Page 5: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

5

Some Observations

• User contributions create value• Ex. quality of the content, popularity of the generated content

• Value is redistributed across users• Ex. Credits, attention, monetary payments

• Implicit and explicit signalling of individual contributions• Ex. User profile page, rating scores, etc• Ex. Wikipedia – not in an article, but by side means [Forte and Bruckman]• Ex. Author order on a scientific publication

Page 6: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

6

How efficient are simple local value sharing schemes with respect to social welfare of the society as a whole?

Page 7: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

7

Outline

• Game Theoretic Framework

• Efficiency of Monotone Games under a Vickery Condition

• Efficiency of Equal and Proportional Sharing

• Production Costs

• Conclusion

Page 8: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

8

Utility Sharing Game

USG():• : set of players

• : strategy space,

• : utility of a player,

Page 9: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

9

Project Contribution Games

Special: total value functions

1

2

i

n

1

2

j

m

Share of value

Page 10: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

10

Monotone Games

• A game is said to be monotone if for every player and every

• It is strongly monotone, if for every player and every :

, for every

Page 11: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

11

Importance of Monotonicity• ,

• Nash equilibrium condition

• Efficiency =

0 1

1

𝑥

𝑣 (𝑥)concave,

𝑏∗

Page 12: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

12

Vickery Condition

• A game satisfies Vickery condition if for every player and :

• It satisfies k-approximate Vickery condition if for every player and :

]

Rewarded at least one’s marginal contribution

Page 13: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

13

Local Value Sharing

• A project value sharing is said to be local if the value of the project is shared according to a function of the investments to this project:

, for every and

• Equal value sharing:

• Proportional value sharing:

Page 14: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

14

DBLP database• 2,132,763 papers• 1,231,667 distinct authors • 7,147,474 authors

Scientific Co-Authorships

Page 15: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

15

Scientific Co-Authorship (cont’d)

o random

Page 16: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

16

Solution Concepts & Efficiency• Nash Equilibrium (NE)• Unilateral deviations

• Strong Nash Equilibrium (SNE)• All possible coalitional deviations

• Bayes Nash Equilibrium (BNE)• Incomplete information game

• Efficiency• Worst case ratio of social welfare in an equilibrium and optimal social welfare

Page 17: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

17

Outline

• Game Theoretic Framework

• Efficiency of Monotone Games under a Vickery Condition

• Efficiency of Equal and Proportional Sharing

• Production Costs

• Conclusion

Page 18: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

18

Efficiency in Strong Nash EquilibriumTheorem

• Any SNE of a monotone game that satisfies the Vickery condition achieves at least ½ of the optimal social welfare

• If the game satisfies the -approximate Vickery condition, then any SNE achieves at least of the optimal social welfare

Page 19: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

19

Efficiency in Nash Equilibrium

Theorem

• Suppose that the following conditions hold:1) -approximate Vickery condition2) Strategy space of each player is a subset of some vector space3) Social welfare satisfies the diminishing marginal property

• Then, any NE achieves at least 1/() of the optimal social welfare

Page 20: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

20

Local Vickery Condition

• A value sharing of a project is said to satisfy local k-approximate Vickery condition if

• If value sharing of all projects is locally k-approximate Vickery, then the value sharing is k-approximate Vickery

• Local k-approximate Vickery condition

}

𝜕𝑖𝑣 𝑗 (𝒃𝑗)

degree of substitutability

Page 21: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

21

Degree of Substitutability

• If value functions satisfy diminishing returns property, then

• If , then each player is quintessential to producing any value, i.e. , for every

Page 22: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

22

Degree of Substitutability (cont’d)

• Efficiency =

• If , then any local value sharing cannot guarantee a social welfare that is 1/ of the optimum social welfare

1

2

𝑛

1

2

𝑛−1

⋮𝑣1 (𝒃)=𝑛∏

𝑖

𝐼 (𝑏𝑖 ,1=1)

𝑣2 (𝒃 )=(1+𝜖) 𝐼 (𝑏𝑛 , 2=1)

Budget 1

}

Page 23: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

23

Outline

• Game Theoretic Framework

• Efficiency of Monotone Games under a Vickery Condition

• Efficiency of Equal and Proportional Sharing

• Production Costs

• Conclusion

Page 24: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

24

Equal Sharing

• Suppose that project value functions are monotone, then equal sharing satisfies the -approximate Vickery condition

Page 25: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

25

Proportional Sharing

• Suppose that project value functions are functions of the total effort, increasing, concave, and

Then, proportional value sharing satisfies the Vickery condition

Page 26: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

26

Proof Sketch

• concave and , for every

• Take and to obtain

Page 27: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

27

Local Smoothness• A utility maximization game is -smooth iff for every and :

• A utility maximization game is locally -smooth iff with respect with respect to at which are continuously differentiable:

where

Page 28: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

28

Efficiency of Smooth Games

• If a utility sharing game is locally ()-smooth with respect to a strategy profile then utility functions are continuously differentiable at every Nash equilibrium , then

Page 29: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

29

Sufficient Condition for Smoothness• are concave functions of total effort, , and are continuously

differentiable • Proportional sharing of value • For all strategy profiles and and ,

Then, the game is locally -smooth with respect to

if , else

Page 30: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

30

Efficiency by Smoothness:Fractional Exponent Functions

• Suppose that , and

• Then, proportional sharing achieves at least of the optimal social welfare

Page 31: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

31

Efficiency by Smoothness:Exponential Value Functions

• Suppose , and

• Then, proportional value sharing achieves at least of the optimal social welfare

Page 32: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

32

Tight Example

• is a Nash equilibrium where each player focuses all effort his effort on project 1

1

2

𝑖

𝑛

1

2

𝑛

𝑛−1}𝑣1 (𝑥 )=1−𝑒−𝛼𝑥

𝑣2 (𝑥 )=𝑞 (1−𝑒−𝛽𝑥 )

Page 33: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

33

Tight Example (cont’d)• Nash equilibrium:

• Social optimum:

(players invest in distinct projects)

𝑢(𝒃)𝑢(𝒃∗)

→𝛼→∞,𝛽→0𝑛2

2𝑛2−2𝑛+1, large

1

2

𝑖

𝑛

1

2

𝑛

𝑣1

𝑣2}𝑛−1

Page 34: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

34

Efficiency and Incomplete Information• Proportional sharing with respect to the observed contribution

• Concave value functions of the total contribution

• Abilities are private information

Then the game is universally -smooth, hence, in a Bayes Nash equilibrium, the expected social welfare is at least ½ of the expected optimum social welfare

Page 35: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

35

Universal Smoothness

• Game • Value function • Game is -smooth with respect to the function if

for all types and and every outcome that is feasible under

[Roughgarden 2012, Syrgkanis 2012]

Page 36: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

36

Efficiency under Universal Smoothness• Efficiency

• If a game is -smooth with respect to an optimal choice function then the expected social welfare is at least of the optimal social welfare

Page 37: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

37

Outline

• Game Theoretic Framework

• Efficiency of Monotone Games under a Vickery Condition

• Efficiency of Equal and Proportional Sharing

• Production Costs

• Conclusion

Page 38: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

38

Production Costs• Payoff for a player: • Social welfare , total value

production cost

00

𝑐 𝑖 (𝑥 )

𝑥 Budget

constraint(earlier slides)

00

𝑐 𝑖 (𝑥 )

𝑥 Constant

marginal cost

00

𝑐 𝑖 (𝑥 )

𝑥 A convex increasing function

Examples

Page 39: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

39

Elasticity

• Def. the elasticity of a function at is defined by

Page 40: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

40

Efficiency

• Suppose that production cost functions are of elasticity at least and the value functions are of elasticity at most

• If is any pure Nash equilibrium and is socially optimal, then

Moreover

Page 41: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

41

Efficiency (cont’d)

• Constant marginal cost of production is a worst case• But this is a special case: for any production cost functions with a

strictly positive elasticity, the efficiency is a constant independent of the number of players • Budget constraints are a best case

Page 42: Efficiency and the Redistribution of Welfare Milan Vojnovic Microsoft Research Cambridge, UK Joint work with Vasilis Syrgkanis and Yoram Bachrach

42

Conclusion• When the wealth is redistributed so that each contributor gets at least his

marginal contribution locally at each project, the efficiency is at least ½

• The degree of complementarity of player’s contributions plays a key role: the more complementary the worse

• Simple local value sharing• Equal sharing: the efficiency is at least 1/k, where k is the maximum number of

participants in a project• Proportional sharing: guarantees the efficiency of at least ½ for any concave project

value functions of the total contribution

• Production costs play a major function: the case of linear production costs is a special case for which the inefficiency can be arbitrarily small; at least a positive constant for any convex cost function of strictly positive elasticity