sentinets - acm web science 2014 pecha kucha presentation

10
Just watched cyberbully-- it's annoying. Why would she kill herself? It's not worth it. Life is shit so deal with it :P” coded as negative All the best to the retired players suffering from CTE. Spread the word so we can make the game safer.” coded as positive New LGBT Research Study on same sex weddings [link]” coded as positive

Upload: shubhanshu-mishra

Post on 26-Jun-2015

210 views

Category:

Education


0 download

DESCRIPTION

Full poster abstract at: http://dl.acm.org/citation.cfm?id=2615667

TRANSCRIPT

Page 1: SentiNets - ACM Web Science 2014 Pecha Kucha Presentation

“Just watched cyberbully--

it's annoying. Why would

she kill herself? It's not

worth it. Life is shit so deal

with it :P”

coded as negative

“All the best to the

retired players suffering

from CTE. Spread the

word so we can make

the game safer.”

coded as positive

“New LGBT Research

Study on same sex

weddings [link]”

coded as positive

Page 2: SentiNets - ACM Web Science 2014 Pecha Kucha Presentation

Enthusiastic / Non-Supportive

(E-NS)

Enthusiastic / Supportive

(E-S)

Passive/ Non-Supportive

(P-NS)

Passive/ Supportive

(P-S)

Enthusiastic(E)

Passive(P)

No

n-S

up

po

rtiv

e(N

S)Su

pp

ortive

(S)

Page 3: SentiNets - ACM Web Science 2014 Pecha Kucha Presentation

Create SentiNets DashboardUser Rankings User Networks Word Clouds Geo-location Scores

Test Prediction on new dataLegalize Marijuana Legalize Prostitution

Train ClassifierEnthusiastic/Passive Supportive/Non-Supportive

Annotate Tweets using CodebookEnthusiastic/Passive Supportive/Non-Supportive

Build Codebook

Collect TweetsCTE in NFL Cyberbullying LGBT

Page 4: SentiNets - ACM Web Science 2014 Pecha Kucha Presentation

Category Inter Coder Reliability Accuracy (SVM)

Enthusiastic v/s Passive 93 % 79.0749 %

Supportive v/s Non -

Supportive85 % 76.652 %

1500 Coded Tweets

Refined Codebook for Social Causes

Features used in classifier

# of Emoticons # of URLS # of Mentions # of Hashtags

Word Features# of Double

QuotesLength of

Tweets

Page 5: SentiNets - ACM Web Science 2014 Pecha Kucha Presentation

“Just watched cyberbully--

it's annoying. Why would

she kill herself? It's not

worth it. Life is shit so deal

with it :P”

coded as Enthusiastic& Non-Supportive

“All the best to the

retired players suffering

from CTE. Spread the

word so we can make

the game safer.”

coded as Enthusiastic& Supportive

“New LGBT Research

Study on same sex

weddings [link]”

coded as Passive & Supportive

Page 6: SentiNets - ACM Web Science 2014 Pecha Kucha Presentation

Confusion Matrices for sentiment classes for Legalize Marijuana and Legalize Prostitution

Page 7: SentiNets - ACM Web Science 2014 Pecha Kucha Presentation

Node Color: HashTags or UserNode Size: Occurrence

Label Size: Sentiment Measure

Support

Sentiment based Networks for Global Warming

Enthusiasm

Page 8: SentiNets - ACM Web Science 2014 Pecha Kucha Presentation

Label Type WeightTweetCount

EPCount

SNSCount EP_Class SNS_Class Degree Top in Class

Sorted by Weights

damnitstrue USER 91 0 -91 -91 PASSIVE NON_SUPPORTIVE 92

slone USER 51 0 -51 49 PASSIVE SUPPORTIVE 54 SUPPORTIVE

tcot HASHTAG 50 0 -48 44 PASSIVE SUPPORTIVE 56 SUPPORTIVE

Sorted by Number of Tweets

ElectedMob USER 9 9 -9 1 PASSIVE NON_SUPPORTIVE 2

thomasj17431826 USER 7 6 5 -5 ENTHUSIASTIC SUPPORTIVE 11 ENTHUSIASTIC

NotCMBurns USER 6 6 2 6 ENTHUSIASTIC SUPPORTIVE 4 ENTHUSIASTIC

User Rankings in Sentiment based Networks for Global Warming

Page 9: SentiNets - ACM Web Science 2014 Pecha Kucha Presentation

http://context.lis.illinois.edu

Page 10: SentiNets - ACM Web Science 2014 Pecha Kucha Presentation

SENTINETSEnthusiasm and Support: Alternative Sentiment Classification for Social Movements on Social Media

Shubhanshu Mishra, Sneha Agarwal, Jinlong Guo, Kirstin Phelps, Johna Picco, Jana Diesner{ smishra8, sagarwa8, jguo24, kphelps, picco2, jdiesner }@illinois.edu

iSchool at University of Illinois at Urbana-ChampaignMore details at: http://people.lis.illinois.edu/~smishra8/sentinets.php