5 trends in data - tableau.com · puredata# ibm# big#sql# impala# apache# drill# presto# microso^#...

41
5 TRENDS IN DATA How and Where Data is Shifting to the Cloud

Upload: doquynh

Post on 29-Apr-2018

230 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

5 TRENDS IN DATA

How and Where Data is Shifting to the Cloud

Page 2: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Before we jump in...

Page 3: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Marshall Daly

Cloud @Tableau

Page 4: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Now let’s jump in

Page 5: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

5 Data Trends from The Cloud Data Brief

Page 6: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

114#

Rela%onal(zone(

Non+rela%onal(zone(

Lotus#Notes#

Objec/vity#

MarkLogic#

InterSystems#Caché#

McObject#

Starcounter#

ArangoDB#

Founda/onDB#

Neo4J#

InfiniteGraph#

CouchDB#

Oracle#NoSQL#

Redis#

Handlersocket#

##RavenDB#

RethinkDB#Google#App##

Engine#Datastore#LevelDB#

Accumulo#

Cassandra#

HBase#

Riak#

Couchbase#

Splice#Machine#

Ac/an#Ingres#SAP#Sybase#ASE#

EnterpriseDB#

SQL##Server#

MySQL#

Informix#MariaDB#

SAP##HANA#

#IBM#DB2#

Database.com#

ClearDB#

Google#Cloud#SQL#

Rackspace#Cloud#Databases#

AWS#RDS#

Azure#SQL#Database#

FathomDB#

HP#Cloud#RDB##for#MySQL#

StormDB#

Teradata##Aster#

HPCC#

Cloudera#

Hortonworks#MapR# IBM##BigInsights#

ZeWaset#

NGDATA#

Infochimps#Metascale#

Mortar#Data#

Rackspace#

Qubole#

Voldemort#

Aerospike#

Teradata#

IBM#PureData#for#Analy/cs#

Pivotal#Greenplum#HP#Ver/ca#

SAP#Sybase#IQ#

IBM#InfoSphere#

Ac/an#Vector#

XtremeData#

Kx#Systems#

Exasol#

Ac/an#Matrix#

ParStream#TokuDB#

ScaleDB#

ScaleArc#

Con/nuent#TransLa[ce#

NuoDB#

Drizzle#

JustOneDB#

Pivotal#GemFire#XD#

Galera#

ScaleBase#

Zimory#Scale#

Clustrix#

Tesora#

MemSQL# GenieDB#

Datomic#YarcData#

FlockDB#

Allegrograph#HypergraphDB#

AffinityDB#

Giraph#

Trinity# MemCachier#

Redis#Labs#Memcached#Cloud#

FairCom#

BitYota#

IronCache#

Grid/cache(zone(Memcached#

Ehcache#

ScaleOut#So^ware#

IBM##eXtreme##Scale#

Oracle##Coherence#

GigaSpaces#XAP#GridGain#

Pivotal#GemFire#

CloudTran#

InfiniSpan#

Hazelcast#

Oracle#Exaly/cs#

Oracle#Database#

MySQL#Cluster#

Oracle##Endeca#Server# A[vio#

Elas/csearch#

LucidWorks#Big#Data#

Lucene/Solr#

IBM#InfoSphere##Data#Explorer#

Towards(E*discovery(

Towards(enterprise(search(

Documentum#xDB#

Tamino#XML#Server#

Ipedo#XML#Database#

ObjectStore#

LucidDB#

MonetDB#

Metamarkets#Druid#

Databricks/Spark#

AWS#Elas/Cache#

#

Firebird#

SciDB#SQLite#

Oracle#TimesTen#solidDB#

Adabas#

IBM#IMS#

UniData#

UniVerse#

WakandaDB#

Al/scale#

Oracle#Big##Data#Appliance#

RainStor#

OrientDB#

Sparksee#

Metamarkets#

Treasure#Data#

PostgreSQL#Percona#

vFabric#Postgres#

©#2014#by#451#Research#LLC.##All#rights#reserved##

HyperDex#

TIBCO#Ac/veSpaces#

Titan#

SAP#Sybase#SQL#Anywhere#

JethroData#

CitusDB#

Pivotal#HD/HAWQ#

BigMemory#

Ac/an#Versant#

DataStax#Enterprise#

DeepDB#

Infobright#

FatDB#

Google#Cloud#Datastore#

Heroku#Postgres#

GrapheneDB#

Cassandra.io#

Hypertable#

BerkeleyDB#

Sqrrl#Enterprise#

Microso^#HDInsight#

HP#Autonomy#

Oracle#Exadata#

IBM##PureData#

IBM#Big#SQL#

Impala#

Apache#Drill#

Presto#

Microso^#SQL#Server#

PDW#

Apache#Tajo#

Apache#Hive#

SPARQLBASE#

MammothDB#

Al/base#HDB#LogicBlox#

SRCH2#

TIBCO#LogLogic#

Splunk#

Towards(SIEM(

Loggly# Sumo#Logic#Logentries#

InfiniSQL#

JumboDB#

Ac/an#PSQL#Progress#OpenEdge#

Kogni/o#

Al/base#XDB#

Savvis#

So^layer#Verizon#

xPlenty#

Stardog#

MariaDB#Enterprise#

Apache#Storm#Apache#S4#

IBM#InfoSphere#Streams#

TIBCO#StreamBase#

DataTorrent#

AWS#Kinesis#

Feedzai#

Guavus#Lokad#

SQLStream#

So^ware#AG#

Key:((General#purpose#

Specialist#analy/c#

BigTables#

Graph#Document#Key#value#stores#

easeaeService#

Key#value#direct##access#Hadoop#

MySQL#ecosystem#

Advanced##clustering/sharding#New#SQL#databases#

Data#caching#

Data#grid#

Search#

Appliances#

Inememory#

Stream#processing#

OpenStack#Trove#

1010data#

Google##BigQuery#

AWS#Redshi^#

TempoIQ#

InfluxDB#WebScaleSQL#

MySQL#Fabric#Spider#

2#

E#

D

A

B

C

TeSystems#

E#

D

A

B

C

2# 4#3# 5#

SQream#

SpaceCurve#

PostgreseXL#

Google#Cloud##Dataflow#

Trafodion# Hadapt#

Azure#Search#

Red#Hat#JBoss#Data#Grid#

6#5#4#

MongoDB#

Cloudant#

Iris#Couch#MongoLab#

Compose#

ObjectRocket#

CloudBird#

Azure#DocumentDB#

1# 3#

1# 6#

Data Platforms

Map October 2014

https://451research.com/

dashboard/dpa

CockroachDB#

AWS#DynamoDB#

Redisetoego#

AWS#SimpleDB#

Redis#Labs#Redis#Cloud#

RedisGreen#

AWS#Elas/Cache#with#Redis#

MagnetoDB#

ObjectRocket#Redis#

##TokuMX#

VoltDB#

CortexDB#

CodeFutures#

Oracle#Big##Data#Cloud#

AWS#EMR#

Google##Compute#Engine#

Stra/o#

451 ResearchData Platforms Map

Page 7: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Gartner’sMagic Quadrant for Data Warehouse and Management Solutions for Analytics

Page 8: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

FirstMark’sBig Data Landscape

Page 9: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

RightScale’sState of the Cloud Report

Page 10: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

"This past year was pivotal in both our own transformation and in partnering with our customers who are navigating their own digital transformations.”

Satya Nadella, Chief executive officer at Microsoft

Page 11: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

How do we get an accurate pulse on the market?

Page 12: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#
Page 13: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#
Page 14: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

• 1 million+ anonymous data source connections

• 4,000+ customers spanning nearly every industry and varying from small businesses to enterprise corporations

• A sample indicative of usage patterns and trends in the market

Page 15: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Trend #1Data storage is expanding beyond our traditional concepts of the database

Page 16: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

*Excluding file-based sources like Excel and business-specific web applications like Salesforce and Google Analytics.

All Data Source Connections

Page 17: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

*Excluding file-based sources like Excel and business-specific web applications like Salesforce and Google Analytics.

Databases as a Service

Page 18: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

*Excluding file-based sources like Excel and business-specific web applications like Salesforce and Google Analytics.

Hadoop products

Page 19: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

*Excluding file-based sources like Excel and business-specific web applications like Salesforce and Google Analytics.

Open source

Page 20: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

*Excluding file-based sources like Excel and business-specific web applications like Salesforce and Google Analytics.

Deployed in the cloud

Page 21: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

*Excluding file-based sources like Excel and business-specific web applications like Salesforce and Google Analytics.

Deployed on-premise

Page 22: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Trend #2Data is consistently moving to the cloud

Page 23: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Data Source Connections By Deployment

Page 24: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

What’s driving growth of cloud data sources?

Page 25: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

• New companies born in the cloud

• New sources of data that require highly scalable environments

• Devices like phones and tablets are increasingly used to accomplish business tasks

Page 26: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Trend #3Cloud data is growing, but hybrid options

remain critical

Page 27: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Data Source Connections By Type

Page 28: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Why are hybrid data sources so prevalent?

Page 29: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

• Data demands storage behind a firewall

• Supports an incremental move to the cloud

Page 30: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Trend #4Hybrid data technologies are also moving

towards cloud deployment

Page 31: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Hybrid Data Source Connections By Deployment

Page 32: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

SQL Server

Page 33: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Oracle

Page 34: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

MySQL

Page 35: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

PostgreSQL

Page 36: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Trend #5Analytics are following data to the cloud

Page 37: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Diverging Data Source Connections

Page 38: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Diverging Data Source Connections

Page 39: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

Data Gravity

Image credit: Dave McCrory

Page 40: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

More Resources

• Consider if cloud-based business intelligence is right for you:→ www.tableau.com/learn/whitepapers/why-business-analytics-cloud

• Learn how to moveyour analytics to the cloud: → www.tableau.com/learn/whitepapers/6-strategies-transitioning-cloud

• Stay current on cloud trends:

→ www.tableau.com/learn/whitepapers/top-10-cloud-trends-2016

Page 41: 5 TRENDS IN DATA - tableau.com · PureData# IBM# Big#SQL# Impala# Apache# Drill# Presto# Microso^# SQL#Server# PDW# Apache# Tajo# Apache# Hive# SPARQLBASE# MammothDB# Al/base#HDB#

We help people see and understand their data, including on-premise or in the cloud.

→ Get the full report at: www.tableau.com/CloudDataBrief