Download - An introduction to emoji data science
![Page 1: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/1.jpg)
Hamdan [email protected] // @hamdanazhar
// November 5, 2016
đs, s, & major sđč đan introduction to emoji data science
đđđ
![Page 2: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/2.jpg)
why emoji data science?
![Page 3: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/3.jpg)
http://theislamicmonthly.com/neither-here-nor-there-on-losing-my-snapchat-best-friend/
![Page 4: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/4.jpg)
![Page 5: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/5.jpg)
![Page 6: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/6.jpg)
emojis data science
![Page 7: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/7.jpg)
Overarching goals
â Understanding what emojis mean
â Using emojis to understand the topics we use them to discuss
â Getting past the âso whatâ hurdle and defining good questions to ask
![Page 8: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/8.jpg)
the birth of
![Page 9: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/9.jpg)
My reaction to this article,in emoji
![Page 10: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/10.jpg)
So we decided to look at some actual data
![Page 11: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/11.jpg)
Getting the dataâ Use Twitter API to sample 100,000 tweets for five hashtags related
to Britainâs EU Referendum Hashtags: #NotMyVote, #VoteRemain, #EURef, #Brexit, #VoteLeave Data pulled for June 24, the day after the referendum English language tweets only
After removing retweets, weâre left with 23,989 unique tweets, i.e. the âBrexit datasetâ
Of these, 1,505 tweets (6.3%) contain at least one emoji
![Page 12: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/12.jpg)
Analyzing the data Use regular expressions in R, along with Unicode emoji
dictionaries, to extract emojis from tweets
Compute emoji counts in the Brexit dataset
Compare with counts for all >10B emoji tweets on Twitter since 2013 (from emojitracker.com)
Extract hashtags from tweets and compute hashtag profiles for various emojis
![Page 13: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/13.jpg)
emoji emoji namebrexi
t rank
general
rankbrexit index*
general
index*overinde
x**đ face with tears of joy 1 1 100 100
flag of united kingdom 2 363 87 0.2 400x
đ thumbs up sign 3 18 26 11 2.3xđ clapping hands sign 4 45 24 6 3.9x†heavy black heart 5 3 21 45 đ loudly crying face 6 7 17 29 đ pensive face 7 13 14 18 đ© weary face 8 11 13 22 đą crying face 9 27 12 9 1.3xđ see-no-evil monkey 10 24 12 9 1.3x* Index is an estimate of how prevalent a given emoji is in Brexit tweets and general tweets, with the most common emoji (đ) being
defined as 100
** Reflects how much more likely a given emoji is to be used in a Brexit tweet vs. generally on Twitter (general rank and index obtained from emojitracker.com). An emoji overindexes on Brexit if both brexit rank < general rank AND brexit index > general index.
Which emojis over-index most heavily for Brexit?(above and beyond their usual popularity on Twitter)
![Page 14: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/14.jpg)
Finding the âhashtag signatureâ of a given emoji We know the distribution of
hashtags in our entire dataset We can pick a given emoji and
compute the distribution of hashtags for tweets that use that emoji
By comparing these two distributions, we can estimate which hashtags an emoji is most likely to be used with
15%
17%
20%
29%
19%
![Page 15: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/15.jpg)
![Page 16: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/16.jpg)
Hashtag signatures of the top emojis of Brexit
![Page 17: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/17.jpg)
http://motherboard.vice.com/read/the-emojis-of-great-brexit
![Page 18: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/18.jpg)
![Page 19: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/19.jpg)
Taylor Swift is winning hearts (and minds)
Source: Analysis of 100,000 public tweets
mentioning @taylorswift13 and @kanyewest from
Aug. 1-4, 2016. (PRISMOJI)
equal
higher association with
@taylorswift13
higher association with
@kanyewest
![Page 20: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/20.jpg)
Hearts vs. Snakes:The emoji battle underyling the epic Taylor Swift â Kanye West feud
Source: Analysis of 100,000 public tweets
mentioning @taylorswift13 and @kanyewest from
Aug. 1-4, 2016. (PRISMOJI)
![Page 21: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/21.jpg)
#taylorswiftwhatup is the most common hashtag in tweets about both Taylor and Kanye
Source: Analysis of 100,000 public tweets
mentioning @taylorswift13 and @kanyewest from
Aug. 1-4, 2016. (PRISMOJI)
![Page 22: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/22.jpg)
![Page 23: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/23.jpg)
Our common emoji language of #fanlove
Source: Analysis of 250,000 public tweets
mentioning @beyonce, @justinbieber,
@djkhaled, @drake, and @rihanna from
Aug. 1-4, 2016. (PRISMOJI)
![Page 24: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/24.jpg)
Sometimes love hurtsExamples of in tweets involving #fanlove
Source: Analysis of 250,000 public tweets
mentioning @beyonce, @justinbieber,
@djkhaled, @drake, and @rihanna from
Aug. 1-4, 2016. (PRISMOJI)
![Page 25: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/25.jpg)
http://motherboard.vice.com/read/a-data-scientists-emoji-guide-to-kanye-west-and-taylor-swift
![Page 26: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/26.jpg)
Some more examples
![Page 27: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/27.jpg)
#firstsevenjobs
Source: Analysis of 32,979 public tweets with
the hashtags #firstsevenjobs and
#first7jobs from Aug. 8, 2016. (PRISMOJI)
![Page 28: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/28.jpg)
Understanding gendered emojis on Twitter#wcw vs #mcm: All hearts are not created equal
higher association
with
#mcm
higher association
with
#wcw
Source: Analysis of 100,000 public tweets
with the hashtags #wcw and #mcm from June 27-
29, 2016. (PRISMOJI)
![Page 29: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/29.jpg)
#Rio2016 Olympics
Source: Analysis of 449,680 public tweets mentioning #rio2016
fromAug. 6-22, 2016.
(PRISMOJI)
higher association with
FIRST 3 DAYS
higher association with
LAST 3 DAYS
![Page 30: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/30.jpg)
Third Presidential Debate
Source: Analysis of public tweets during
third presidential debate on
Oct. 20, 2016. (PRISMOJI)
![Page 31: An introduction to emoji data science](https://reader035.vdocument.in/reader035/viewer/2022062822/58824c7e1a28ab37158b5f77/html5/thumbnails/31.jpg)
Three takeaways Iâd like you to leave withâ Understanding emojis as data can yield
interesting insights
â More work is needed to learn more about what emojis mean, and what they reveal about our world
â You can play around with emoji data too