those internet users who wish you wellvideos.rennes.inria.fr/espaceconf-inria/annemarie...those...

38
1 Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011

Upload: others

Post on 20-Jun-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

1

Those Internet users who wish you well

Anne-Marie Kermarrec

INRIA

18 mai 2011

Page 2: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

18 mai 2011 2

The new face of the Web

user-generated

social

Page 3: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Search is over…

18 mai 2011 3

The content comes from dedicated channels

Page 4: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Is it equally relevant?

18 mai 2011 4

Page 5: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Is it equally relevant?

18 mai 2011 5

Page 6: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Is it equally relevant?

18 mai 2011 6

Page 7: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Cascading over explicit links

18 mai 2011 7

Page 8: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

What’s wrong with news feed?

Amazon recommends me a fryer

Some of my Facebook friends write in Italian

LeMonde.fr informs me on the Champion’s ligue

18 mai 2011 8

Page 9: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Why is it so difficult?

• Even a space restricted to users’ explicit subscriptions is too large a database

• Dynamic

• Recommendations not always user-centric

• Explicit links not always that relevant

• Classical notification systems do not filter enough

Granularity of a user seems too coarse

18 mai 2011 9

Page 10: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Fine grain tuning requires personalization

18 mai 2011 10

Where does the shoe pinch ?

Page 11: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Scalability and Privacy

18 mai 2011 11

Personalization calls for decentralization

Page 12: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Our approach: WhatsUp

• Decentralized information dissemination channel

• Simple interface: I like it or I don’t

18 mai 2011 12

Page 13: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

18 mai 2011 13

Page 14: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

WhatsUp in a nutshell

18 mai 2011 14

Page 15: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

WhatsUp’s challenges

18 mai 2011 15

• Who are my social acquaintances

• How to discover them?

• How to disseminate news ?

Similarity metric

Through gossip

Biased epidemic

protocol

Page 16: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

The implicit social network

18 mai 2011 16

Page 17: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

WhatsUp’s challenges

18 mai 2011 17

• Who are my social acquaintances

• How to discover them?

• How to disseminate news ?

Similarity metric

Page 18: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

An implicit social network

18 mai 2011 18

Page 19: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Which nodes should be considered as social acquaintances?

Model

• U(sers) × I(tems) (news)

• Profile(u) = vector of liked news

• Minimal information

Similarity metrics

• Overlap

• Cosine similarity

• Anti-spam similarity

18 mai 2011 19

Page 20: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Item cosine similarity

2018 mai 2011

Normalized overlap

Profile(u)= Vector of news Items()

Page 21: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

What’s up challenges

18 mai 2011 22

• Who are my social acquaintances

• How to discover them?

• How to disseminate news ?

Through gossip

Page 22: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Each node maintains a set of neighbors (k entries)

P Q

Data exchange

Data processing

Peer selection

Parameter Space

Gossip-based computing

Random Peer sampling [ACM TOCS 2007] achieves random

topologies

Page 23: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Sampling the network withgossip

Similarity computation

Page 24: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

The Gossple social network

Gossip-based peer sampling service

Copyright: E. Rivière

Gossip similarity protocol.

Page 25: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

WhatsUp in a nutshell

18 mai 2011 26

Page 26: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

WhatsUp’s challenges

18 mai 2011 27

• Who are my social acquaintances

• How to discover them?

• How to disseminate news ? Biased epidemic

protocol

Page 27: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Epidemic dissemination

• The log(n) magic

18 mai 2011 28

Early

adopters

Innovators

Early

majority

Late

majority

Laggards

Broadcast

Contagion

Page 28: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Dissemination

18 mai 2011 29

Heterogeneous

Homogeneous

HeterogeneousHomogeneous

Involvement (fanout)

Expecta

tions

Epidemic

Dissemination

F=log(N)

Heterogeneous

Gossip

F≈ log(N) on

average

Page 29: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

BEEP: orientation and amplification

Orientation: to whom?

18 mai 2011 30

Forward

to

friends

Forward to

Random

users

Amplification: to how many?

Increase

fanout

Decrease

fanout

Page 30: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Tuning BEEP

• Orientation

• Like/dislike-dependent

• News-based orientation

• Amplification

�I like it: large fanout

• F≈ log(N) friends in the social network

�I don’t like it: small fanout

� F≈ 1 or 2 according to the news item profile

• Natural fanout adaptation

18 mai 2011 31

Page 31: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Beep: I like it

18 mai 2011 32

Page 32: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Beep: I don’t

18 mai 2011 33

Page 33: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Evaluation

• User Metrics

• Recall

• Precision

• System metric

• Number of messages

• Redundancy (useless messages)

• Traces

• Real trace from a 480 user survey on 1000 news items

18 mai 2011 34

Page 34: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

WhatsUp in action

Precision Recall Redundancy Messages

Gossip 0.34 0.99 0.85 2.3 M

Cosine-CF 0.64 0.12 0.27 30k

Whatsup 0.53 0.78 0.28 280k

18 mai 2011 35

Page 35: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

WhatsUp in action

18 mai 2011 36

Fanout

WhatsUp

Page 36: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

The more sociable, the better

18 mai 2011 37

F1

-S

core

Sociability

Page 37: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

To take away

Personalization is needed

Decentralization is healthy

Gossip is the way to go

Page 38: Those Internet users who wish you wellvideos.rennes.inria.fr/espaceConf-INRIA/anneMarie...Those Internet users who wish you well Anne-Marie Kermarrec INRIA 18 mai 2011 18 mai 2011

Thank you

39

www.gossple.fr

18 mai 2011

Joint work with A. Boutet (INRIA), D. Frey (INRIA), A. Jégou (INRIA) and

R. Guerraoui (EPFL)