news tweet
Post on 29-Nov-2014
509 Views
Preview:
DESCRIPTION
TRANSCRIPT
NewsTweet Discover what’s
happening anywhere in the world right now.
Kevin Schaeffer Insight Data Science Fellow June 2013
Exciting News Broken on Twitter But… Very Noisy!
NewsTweet
The Algorithm News
(recognized news accounts) Other
(streaming API)
Multinomial Naïve Bayes Classifier
• Tokenize Tweets (anonymize @, #)
• Only English Tweets with >100 characters
• Bag of Words Model • n=6000 training set • 86% cross-validation accuracy
Tools
Kevin Schaeffer Ph.D. in Physics from Berkeley
(String Theory)
What makes a tweet newsworthy?
§ Most informative news words: § U.S.
§ Officials
§ Law
§ Most informative words for other types of tweets: § Lol
§ Ipad
§ U
top related