style and influence in social text

50
Style and Influence in Social Text 11-27-29

Upload: quito

Post on 25-Feb-2016

29 views

Category:

Documents


0 download

DESCRIPTION

Style and Influence in Social Text. 11-27-29. Announcement. Project reports next week same drill as midterm reports reverse order as midterm reports W e know you’re not done yet … but you will be by midnight Mon 12/10, right? start with one slide summarizing midterm. FCE’s. Are now open - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Style and Influence in Social Text

Style and Influence in Social Text

11-27-29

Page 2: Style and Influence in Social Text

Announcement

• Project reports next week– same drill as midterm reports– reverse order as midterm reports

• We know you’re not done yet– … but you will be by midnight Mon 12/10, right?– start with one slide summarizing midterm

Page 3: Style and Influence in Social Text

FCE’s

• Are now open• We do read them…and people do care• Especially this year– free-text comments on

assignments/structure/layout of course very welcome

Page 4: Style and Influence in Social Text

Puzzle time

• Ths sntnc hs n vwls• i eee a o osoa

Page 5: Style and Influence in Social Text

Today’s topics

• Summary: there are signals in common words– What can you infer from how people use the most

frequent words in text?

Page 6: Style and Influence in Social Text

Today’s topics

• Summary: there are signals in common words– What can you infer from how people use the most

frequent words in text?

Page 7: Style and Influence in Social Text

Today’s topics

• Summary: there are signals in common words– What can you infer from how people use the most

frequent words in text?

Page 8: Style and Influence in Social Text

Today’s topics

• Summary: there are signals in common words– What can you infer from how people use the most

frequent words in text?– Patterns of usage ”literary style”• predicts: authorship, gender, …

– Style changes according to situation• and is transmitted from person to person

• Outline:– some background and two recent papers

Page 9: Style and Influence in Social Text
Page 10: Style and Influence in Social Text

Background: Authorship attribution

• Mosteller and Wallace, 1964. “Inference and Disputed Authorship”: frequency of function words can be used to classify documents by author.– Function words are not under conscious control– Function word use is independent of content– Histogram of function words is ok

Page 11: Style and Influence in Social Text

Authorship attributionSchlomo Argamon, Schlomo Levitan

SVM on histogramof 200 most frequent words

Page 12: Style and Influence in Social Text

COLING 2006

Page 13: Style and Influence in Social Text
Page 14: Style and Influence in Social Text

LIWC

• 1986: writing about emotional upheavals improved physical health (!)

• Can you refine this statement?– what sort of writings yield the best results?– but: people don’t agree on ratings– and: “judges tend to get depressed when reading

depressing stories.”

– so: design an automatic “instrument” to rate writings (Linguistic Inquiry and Word Count) based on most frequent words

Page 15: Style and Influence in Social Text

LIWC words - cover about 55% of the tokens (not types) in most textCategories are mostly designed by hand, by committee

Page 16: Style and Influence in Social Text
Page 17: Style and Influence in Social Text
Page 18: Style and Influence in Social Text
Page 19: Style and Influence in Social Text
Page 20: Style and Influence in Social Text

Another signal of rank: starting a fashion

Page 21: Style and Influence in Social Text

most frequent 200 words

Page 22: Style and Influence in Social Text
Page 23: Style and Influence in Social Text

People adopt each other’s mannerisms and style in many ways….

Page 24: Style and Influence in Social Text
Page 25: Style and Influence in Social Text
Page 26: Style and Influence in Social Text

Corpus• Pennebaker & Niederhoffer, 2002:

– 98 pairs in the lab + Watergate tapes• Twitter A:

– 1.3M “conversations” between 300k users--many are too short to analyze successfully

• Twitter B: More crawling– all pairs with 2+ conversations– all posts from these pairs– 15M tweets, 7800 users, 215k conversations, 2200 pairs

Page 27: Style and Influence in Social Text

Measuring “cohesion” for a property C

Page 28: Style and Influence in Social Text

Measuring “cohesion”

Tweet T contains word from class C

Reply R contains word from class C

T and R are a “turn”

Page 29: Style and Influence in Social Text
Page 30: Style and Influence in Social Text

Measuring “accommodation” and “influence”

Tb, from b, is a reply to Ta, from a

Page 31: Style and Influence in Social Text

Tb uses word class C in a reply to a

Tb uses word class C in a reply to a after a uses C

Page 32: Style and Influence in Social Text

• Evidence of fashion in linguistic style spreading through a conversation• Time lag suggests influence not associative sorting

• We don’t have anything like direction…..

Page 33: Style and Influence in Social Text

If Acc(a,b)>0:

• Symmetric: Acc(b,a) > 0

• Default asymmetric: Acc(b,a) = 0

• Divergent asymmetric:

• Acc(b,a) < 0

Page 34: Style and Influence in Social Text

Does one party accommodate more than the other?

Accommodation does not correlate with “status” features like #followers, #days on Twitter, ….

Page 35: Style and Influence in Social Text

????

Does one party accommodate more than the other?

Page 36: Style and Influence in Social Text
Page 37: Style and Influence in Social Text

Datasets

• Wikipedia: wikipedia editors talk pages: 240k conversations; plus 32k discussions over who gets promoted to admins.– Status: admin vs non-admin– Dependence: learning to support/reject

• Supreme court: 50k verbal exchanges for 204 cases.– Status: chief justice vs justice vs lawyer– Dependence: leaning to support/learning to reject

Page 38: Style and Influence in Social Text

Experiments

• Similar notion of “coordination” (=accomodation)

• Hypotheses:e.g., you accommodate

more when speaking to a big shot

and he coordinates less with other people

Page 39: Style and Influence in Social Text
Page 40: Style and Influence in Social Text

more coordination with admins than non-admins

admins coordinate more with others than non-admins

Page 41: Style and Influence in Social Text

admins coordinate more with others than non-admins

Why?

Maybe the folks that become admins are different somehow? eg more accommodating?

Page 42: Style and Influence in Social Text

the people that eventually become admins coordinate more than peoplewho eventually fail to become admins

Page 43: Style and Influence in Social Text

revised hypothesis: after you become an admin you will coordinate with others less than you did before

Page 44: Style and Influence in Social Text

What about the court dataset?

Page 45: Style and Influence in Social Text

What about the court dataset?

Page 46: Style and Influence in Social Text

Status prediction

• Given conversation between x,y predict if status(x)>status(y) or vice-versa

• Very easy to do in Supreme Court domain (“your honor,….”)

• Hard for humans in Wikipedia (inter-annotator aggrement ~= 80%, accuracy ~=70%)

Page 47: Style and Influence in Social Text
Page 48: Style and Influence in Social Text

One more observation…

Page 49: Style and Influence in Social Text
Page 50: Style and Influence in Social Text

So to summarize…

• Summary: there are signals in common words– Even though we don’t think about how we use them– Patterns of usage ”literary style”

• predicts: authorship, gender, …– Style changes according to situation

• and is transmitted from person to person• you can observe that transmission (accommodation,

coordination) and determine its direction• the direction of accommodation it tells you something

about the status of the speakers