social media analysis: present and future
DESCRIPTION
presented at Text Analytics Summit 2008TRANSCRIPT
![Page 1: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/1.jpg)
Social Media Analysis: Present and Future
Matthew Hurst
Live Labs, Microsoft
![Page 2: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/2.jpg)
![Page 3: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/3.jpg)
![Page 4: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/4.jpg)
![Page 5: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/5.jpg)
Thesis
• Social media analysis tends to separate out content analysis and structure (link) analysis. A lot of accuracy in analysis is left on the table – it’s time for a theory of social media.
• Industry is focused on the relationship between the consumer and the consumed – a more general goal of business intelligence can help grow the space.
![Page 6: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/6.jpg)
Social Media Analysis: Now
• Sentiment analysis (NLP)
• Topics (keyword analysis)
• Author analysis (text based)
• Community analysis (social network theory)
• Influence/ranking (link analysis)
![Page 7: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/7.jpg)
CONTENT STRUCTURE
TIME
URL
THREADS
WORDS
PHRASES
FRAGMENTS
TOPICS
SENTIMENT COMMUNITY
INFLUENCE
![Page 8: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/8.jpg)
INFLUENCE/AUTHORITY
![Page 9: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/9.jpg)
Definitions
• Influence:– Intentionally or unintentionally affect the actions
or beliefs of the subject.
• Authority:– belief that X’s subjective statements in the area of
T are more likely to (be useful|be accurate|be true) than statements by others.
![Page 10: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/10.jpg)
Application
• Engagement: locating key individuals
• Alerting: at what level of authority or influence do we need to act?
• Weighting: metrics within a system weighted by features of author.
![Page 11: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/11.jpg)
Current Model
![Page 12: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/12.jpg)
Current Model
![Page 13: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/13.jpg)
• And so it went in the US media: silence, indifference, with a dash of perverse misinterpretation. Consider Michael Hirsh's laughably naive commentary that imagined Bush had already succeeded in nailing down SOFA, to the chagrin of Democrats.
• DailyKos – smintheus, Jun 15 2008
![Page 14: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/14.jpg)
• Considerably more recently, a Time Magazine swamp denizen is shocked to find John McCain apparently suggesting that support for withdrawing from Iraq and opposition to The Surge is the same as not supporting the troops.
• BTC News, Jun 15 2008
![Page 15: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/15.jpg)
• While the traditional media is slowly starting to take John McCain’s straight talking image with increasingly large grains of salt, his base isn’t quite ready to give up on their favorite son. Jonathan Alter’s bizarre defense of McCain after he was caught telling an outright lie, perfectly captures that reluctance[.]
• DailyKos – BarbinMD, Jun 15 2008
![Page 16: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/16.jpg)
Subtle Links
• A citation can be described along the following dimensions:– Target: what is the citation intended to refer to?
The page, an entity mentioned on the page, the author, …?
– Rhetorical purpose: why does the author cite? Introduce a topic, support an argument, expand a discussion, …?
– Subjectivity: does the author cite in a positive way, a negative way?
![Page 17: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/17.jpg)
New Model
![Page 18: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/18.jpg)
Solutions
• Some initial research shows promise – this is a solvable problem.– Modeling Trust and Influence in the Blogosphere
Using Link Polarity, Anubhav Kale, Amit Karandikar, Pranam Kolari, Akshay Java, Tim Finin and Anupam Joshi, 2007
– Blog Link Classification, Justin Martineau, Matthew Hurst, 2008
• A solution will involve analysis of the text around the link.
![Page 19: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/19.jpg)
SUBJECTIVE STATEMENTS
![Page 20: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/20.jpg)
Subjectivity Research
![Page 21: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/21.jpg)
Taxonomy of Subjectivity
Subjective Statement:<holder, <belief>, time>
The moon is made of green cheese..
Opinion:<holder, <prop, orientation>, time>
He should buy the Prius..
Sentiment:<holder, <target, orientation>, time>
I loved Raiders of the Lost Arc!.
![Page 22: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/22.jpg)
What is Opinion?
• How are opinions formed and what causes them to be expressed?
• What are the qualities of opinions?– Invariant?– Latent?– Synthetic?
• What are the social/psychological aspects of opinion?– One expresses an opinion either with some
communicative intention, or opinions are implicit in other statements.
![Page 23: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/23.jpg)
Current Approaches
• Text, not person, has opinion.
• Sentence or document level processing.
• Some advances in reference resolution.
![Page 24: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/24.jpg)
Opinion Process
Impetus SynthesisExpression:
s
Interpretation:s’
Re-Expression:s’’
![Page 25: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/25.jpg)
Transmission of Opinion
• John said that this is a great restaurant: do we trust John? Is he an authority? Does he have influence?
• I’ve heard that this is a great restaurant: from whom? Several trusted sources?
• This is a great restaurant: have you experienced it yourself?
![Page 26: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/26.jpg)
Content and Structure
• Opinions surface as statements
• There is social – structural – context to the generation and performance of these statements
• Statements are transmitted through the network.
![Page 27: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/27.jpg)
COMMUNITY
BELIEFS PERSONALITY
INFLUENCE
AUTHORITY
THEORY OF SOCIAL MEDIA
COMMUNITY
BELIEFS PERSONALITY
INFLUENCE
AUTHORITY
WORDS
PHRASES
FRAGMENTS
URL
THREADS
Social Media Analysis 2.0
![Page 28: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/28.jpg)
Summary
• Content (e.g. subjectivity) and structure (e.g. influence) need to be considered in conjunction to provide accurate analyses of social media data.
![Page 29: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/29.jpg)
SOCIAL MEDIA ANALYSIS NEXT
![Page 30: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/30.jpg)
Social Media Analysis 2.0
• Current systems measure the relationship between the consumer and the consumed.
• Current applications are used by marketing departments, brand managers, etc.
![Page 31: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/31.jpg)
PRODUCT
REPORT
![Page 32: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/32.jpg)
Actionability
• Requires modeling of business process– Need to understand who can take action when
• Requires modeling of business domain– Product definition
– Production process
![Page 33: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/33.jpg)
PRODUCT
C1 C2 C3
SUPPLIERLOCATION
MATERIALS
REPORT
REPORT
REPORT
REPORT
![Page 34: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/34.jpg)
Company I work for
Nokia 891
Microsoft 23, 800
Google 12, 100
Virgin Atlantic 111
Apple 5, 760
Samsung 1, 370
Dell 7, 860
![Page 35: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/35.jpg)
Conclusions
• Progress in social media theory required to advance the state of the art for analytics.
• Richer domain modeling will lead to larger markets for social media analysis.
![Page 36: Social Media Analysis: Present and Future](https://reader033.vdocument.in/reader033/viewer/2022060122/5595f0141a28ab6a0e8b460b/html5/thumbnails/36.jpg)