big data meets fast data: an scalable hybrid real-time ...€¦ · big data meets fast data: an...

17
Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo & Dan Baskette Speaker: William Markito 01010101

Upload: others

Post on 22-Jul-2020

4 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &

Big Data meets Fast Data: an scalable hybrid real-time transactional and

analytics solution

Authors: Fred Melo & Dan Baskette Speaker: William Markito

01010101

Page 2: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &
Page 3: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &
Page 4: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &
Page 5: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &
Page 6: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &
Page 7: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &

China Railway!Corporation !

5,700 train stations!4.5 million tickets per day !

20 million daily users!1.4 billion page views per day

40,000 visits per second !

Indian Railways!

7,000 stations!72,000 miles of track!

23 million passengers daily!120,000 concurrent users

10,000 transactions per minute !

World: ~7,349,000,000~36% of the world population

GemFire

Page 8: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &

Locator

Up to TerabytesUp to Petabytes

Page 9: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &

Locator

Up to TerabytesUp to Petabytes

Page 10: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &
Page 11: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &

Greenplum

Data Temperature

Hot

Warm

ANSI SQL

Parallel Configurable Data Load

GemFire

Rest / HTTP

Push updates

Transactional data write

behind

Analytical data to cache

Data Science, Analytics & ML

PivotalCloud

Fou

ndry

Web Console

PoS EmulatorPoS EmulatorPoS Emulator

Page 12: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &

Data Temperature

Hot

Warm

ANSI SQL

Parallel Configurable Data Load

Rest / HTTP

Push updates

Transactional data write

behind

Analytical data to cache

Data Science, Analytics & ML

Web Console

PoS EmulatorPoS EmulatorPoS Emulator

Page 13: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &
Page 14: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &
Page 15: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &

Source codehttps://github.com/Pivotal-Open-Source-Hub

Join our communities!

github.com/apache/incubator-geode

Java, Distributed Systems

https://github.com/greenplum-db/gpdb

C/C++, Distributed Systems

Page 16: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &

Referenceshttps://github.com/Pivotal-Open-Source-Hub

http://greenplum.org

http://geode.incubator.apache.org

Come talk to us at booth and grab a sticker

Page 17: Big Data meets Fast Data: an scalable hybrid real-time ...€¦ · Big Data meets Fast Data: an scalable hybrid real-time transactional and analytics solution Authors: Fred Melo &

Thank youhttps://github.com/Pivotal-Open-Source-Hub