training in analytics, r and social media analytics
DESCRIPTION
a basic training on analyzing data using R and social media analyticsTRANSCRIPT
![Page 1: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/1.jpg)
Basics of Analysis,
Analytics and R
Ajay Ohri
![Page 2: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/2.jpg)
Why analysis
● Humans can count only till so much
● We understand summarized information
● We understand graphs faster
● We need to take decisions
● Wrong Decisions lead to huge costs
![Page 3: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/3.jpg)
Central Tendency
● What is the difference between mean and
median
● When to use what?
● What is expected value?
● When can mean be misleading?
Exercise- What is the average height of this class
![Page 4: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/4.jpg)
Grouped Means
Exercise-
What is height of class
What is the height of class by gender
What is the height of class by team
What is the height of class by dark-light colored clothing
CROSS TABS-
exercise of mtcars
![Page 5: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/5.jpg)
Variance
What is the range (max - min)
What is a quartile (4 quarters)
What is a decile (10 deciles)
No one really uses standard deviation in
business world
![Page 6: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/6.jpg)
Frequency Analysis
contingency tables
Height range Number of students Cumulative number
less than 5.0
feet
25 25
5.0–5.5 feet 35 60
5.5–6.0 feet 20 80
6.0–6.5 feet 20 100
Dance Sports TV Total
Men 2 10 8 20
Women 16 6 8 30
Total 18 16 16 50
![Page 7: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/7.jpg)
Histogram
![Page 8: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/8.jpg)
What is a distribution
![Page 9: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/9.jpg)
EDA
Exploratory Data Analysis
Box Plot
![Page 10: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/10.jpg)
Analytics
• What is analytics?
• Where is it used?
• How is it used?
• What are some good practices?
![Page 11: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/11.jpg)
Analytics
• What is analytics? – Study of data for helping with decision making using software
• Where is it used?
• How is it used?
• What are some good practices?
![Page 12: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/12.jpg)
Analytics
• What is analytics?
• Where is it used? – Industries (like Pharma, BFSI, Telecom, Retail)
• How is it used? –Use statistics and software
• What are some good practices?
![Page 13: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/13.jpg)
Analytics
• What is analytics?
• Where is it used?
• How is it used?
• What are some good practices? –
– Learn one new thing extra from your competition every day. This is a fast moving field.
– Etc.
![Page 14: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/14.jpg)
What is Data Science
![Page 15: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/15.jpg)
Other Analytics Software
• SAS (Base) et al
• JMP
• SPSS
• Python
• Octave
• Clojure
• Julia(?)
![Page 16: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/16.jpg)
Social Media Analytics
Some examples
http://decisionstats.com/2013/12/04/top-fourteen-interfaces-in-social-media-and-web-analytics-on-
the-internet/
Some use cases
http://decisionstats.com/2014/05/10/analyzing-facebook-networks-using-rstats/
http://decisionstats.com/2013/09/11/using-twitter-data-with-r/
![Page 17: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/17.jpg)
What is R?http://www.r-project.org/
• Language– Object oriented
– Open Source
– Free
– Widely used
the concept of "objects" that have data fields(attributes that describe the object) and associated procedures known as methods. Objects, which are usually instances of classes, are used to interact with one another to design applications and computer programs
![Page 18: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/18.jpg)
Pre Requisites
• Installation of Rhttp://cran.rstudio.com/bin/windows/base/
• R Studio
• R Packages
![Page 19: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/19.jpg)
Pre Requisites• Installation of R
– RTools
• R Studiohttp://www.rstudio.com/products/rstudio/download/
• R Packages
install.packages(),update.packages(),library()Packages are installed once, updated periodically, but loaded every time
![Page 20: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/20.jpg)
Interfaces to R
• ConsoleDefault
Customization
• IDE
• GUI
![Page 21: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/21.jpg)
Demo-Basic Objects on R Console
• +
• -
• Log
• Exp
• *
• /
• ()
Hint- Up arrow gives you lasttyped command
Functions-ls() – what objects are hererm(“foo”) removes object named foo
AssignmentUsing = or -> assigns object names to values
![Page 22: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/22.jpg)
Functions and Loops
• Loops
for (number in 1:5){ print (number) }
![Page 23: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/23.jpg)
Functions and Loops
• Function
functionajay=function(a)(a^2+2*a+1)
Hint: Always match brackets
Each ( deserves a )
Each { deserves a }Each [ deserves a ]
![Page 24: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/24.jpg)
Demo-Basic Objects on R Console
• +
• -
• Log
• Exp
• *
This is made more clear in
next slide
Hint- Up arrow gives you lasttyped command
Functions-class() gives classdim() gives dimensionsnrow() gives rowsncol() gives columnslength() gives length
str() gives structure
![Page 25: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/25.jpg)
Demo-Datasets on R Console
•
Hint- use data() to list all loaded datasets
![Page 26: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/26.jpg)
Demo-Datasets on R Console
•
Hint- use data() to list all loaded datasetslibrary(FOO) loads package “FOO”
![Page 27: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/27.jpg)
Packages in R
• CRAN
• CRAN Views
• R Documentation
![Page 28: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/28.jpg)
Documentation in R
• Help ? And ??
• CRAN Views
• Package Help
• Tips for Googling
– Stack Overflow
– Email Lists
– R Bloggers
![Page 29: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/29.jpg)
Graphical Interfaces to R
• R Commander
• Rattle
• Deducer
![Page 30: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/30.jpg)
Overview of R Commander
![Page 31: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/31.jpg)
DemoR Commander – 3D Graphs
![Page 32: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/32.jpg)
Overview of Rattle
![Page 33: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/33.jpg)
Demo Rattle
![Page 34: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/34.jpg)
Overview of Deducer (with JGR)
![Page 35: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/35.jpg)
Demo Deducer
• data()
• data(mtcars)
![Page 36: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/36.jpg)
read.table()
![Page 37: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/37.jpg)
From Databases
The RODBC package provides access to databases through an ODBC interface.
The primary functions are
• odbcConnect(dsn, uid="", pwd="") Open a connection to an ODBC database
• sqlFetch(channel, sqltable) Read a table from an ODBC database into a data frame
Hint- a good site to learn R http://www.statmethods.net
![Page 38: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/38.jpg)
A Detour to SQL
![Page 39: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/39.jpg)
From Web (aka Web Scraping)
• readlinesHint : R is case sensitivereadlines is not the same as readLines
Hint : Use head() and tail() to inspect objects
Other packages are XML and CurlCase Study- http://decisionstats.com/2013/04/14/using-r-for-cricket-analysis-rstats/
![Page 40: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/40.jpg)
Inspecting Data Quality: Demo
•
![Page 41: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/41.jpg)
Inspecting Data Quality: Demo
•
![Page 42: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/42.jpg)
Data Selection: Demo
Questions- How do I use multiple conditions (AND OR)Can I do away with subset functionHow do I select random sample
Useful Link- http://decisionstats.com/2013/11/24/50-functions-to-clear-a-basic-interview-for-business-analytics-rstats/
![Page 43: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/43.jpg)
Data Exploration
• missing values are represented by NA in R
• Demo
– is.na
– na.omit
– na.rm
![Page 44: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/44.jpg)
Data Visualization
Notes-Explaining Basic Types of GraphsCustomizing GraphsGraph OutputAdvanced GraphsFacets,Grammar of GraphicsData Visualization Rules
![Page 45: Training in Analytics, R and Social Media Analytics](https://reader035.vdocument.in/reader035/viewer/2022070322/5594193d1a28ab7a0d8b4604/html5/thumbnails/45.jpg)
Data Manipulation Demo
Notes-1. gsub2. gsub with
escape 3. as operator4. is operator