introducing big data and visualization tools in business ... · introducing big data and...

32
Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Upload: others

Post on 11-Oct-2020

7 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Introducing Big Data and Visualization Tools in Business Education

Mark Frydenberg

Bentley University,

Waltham, MA

Page 2: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Download the Demos

• http://cis.bentley.edu/mfrydenberg (and look for the NBEA 2015 blog post)

Page 3: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Digital Literacy Current Topics

ComputersOperating

System Basics

Input and Output Devices

Internet

Cloud Computing

Wireless Networking

World Wide Web

Software and Apps

Security and Privacy

Mobile Devices

Databases Storage

Word Excel PowerPoint

Big Data

Page 4: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Big Data

Page 5: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Tech Trends Enable Big Data

Page 6: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA
Page 7: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

3 V's

• Volume - amount of data is larger than those conventional relational database infrastructures can handle

• Velocity - the rate at which data is generated, processed and analyzed in (real) time

• Variety – data formats are unstructured and inconsistent

Page 8: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Volume: How Big is Big Data?

http://www.alphasixcorp.com/images/big-data-infograph.jpg

Page 9: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA
Page 10: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Yottabyte?

Page 11: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

A Variety of Big Data Sources

Page 12: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Twitter

Page 13: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

McKinsey&Company Report 2011)

• Data is part of every industry and business function.

• Data creates value.

• Big data becomes a basis of competition and growth.

• Some sectors will achieve greater gains.

• Shortage of people with analytical skills.

• Need policies related to privacy, security, ownership.

Page 14: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Great Datasets Tell Great Stories – http://gs.statcounter.com

18

Page 15: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Twitter Reverb

21

Page 16: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Wolfram Alpha Facebook Report

Page 17: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Visualizations

Page 18: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

socilab.com

Page 19: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA
Page 20: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Google BigQuery Demo

(You can download steps from http://cis.Bentley.edu/mfrydenberg)

Page 21: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

http://bigquery.cloud.google.com

Page 22: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Turn on BigQuery

Page 23: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Sample Public Databases

Page 24: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Shakespeare Database

Page 25: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Google BigQuery

Page 26: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

A More Complex and Amusing QuerySELECT title,

sum (num_characters) as num_characters

FROM [publicdata:samples.wikipedia]

WHERE

regexp_match(title, r'^G.*o.*o.*g.*l.*e$') and not (title contains 'Google')

GROUP BY title

ORDER BY num_characters DESC

LIMIT 1000

Page 27: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA
Page 28: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Natality Database Query

Page 29: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Download BigQuery Connector

Page 30: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Excel with BigQuery Connector

Page 31: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Data imported from BigQuery

Page 32: Introducing Big Data and Visualization Tools in Business ... · Introducing Big Data and Visualization Tools in Business Education Mark Frydenberg Bentley University, Waltham, MA

Analysis with Pivot Table and Spark lines