spark, nosql and real time processing by oscar mendez at big data spain 2014

39
WELCOME NOTE BDS14 ÓSCAR MÉNDEZ CEO STRATIO AND PARADIGMA TECNOLÓGICO

Upload: big-data-spain

Post on 09-Jul-2015

176 views

Category:

Technology


1 download

DESCRIPTION

Big Data Spain welcomes everyone. The event will be a two-day intense conference. We will meet many people, learn a lot and have fun. Data is value. In this third edition of the conference we talk about real-time processes, machine learning, NoSql databases and how fast we can process the data using Spark technologies. Session presented at Big Data Spain 2014 Conference 17th Nov 2014 Kinépolis Madrid http://www.bigdataspain.org Event promoted by: http://www.paradigmatecnologico.com Abstract: http://www.bigdataspain.org/2014/conference/welcome-keynote https://www.youtube.com/watch?v=1ew-CUH93A4

TRANSCRIPT

Page 1: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

WELCOME NOTE BDS14

ÓSCAR MÉNDEZCEO STRATIO AND PARADIGMA TECNOLÓGICO

Page 2: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

Big Data Spain 2.014

Page 3: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014
Page 4: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

Big Data Spain third edition36 SPEAKERS

10 WORKSHOPS500 ATTENDEES

Page 5: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

DATA = VALUE

Page 6: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

Actualmente el valor de lasempresas se mide por sus datos

Page 7: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

467.142Mill $

373.608Mill $

150.211 Mill $

148.210Mill $

1 3 20 21

Data Value

Page 8: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

DowJones PER2014 = 13

Facebook PER2014 = 48

Differentiation 35

Page 9: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

PER = PER + PDR+

PER = 13 + 35 = 48+

Page 10: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

TECHNOLOGY

Page 11: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

Technology

Page 12: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

At the beginning it was batch

Page 13: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

Then came InteractiveDiscovery of data

< 40 secondsTo analyze petabytes in seconds

Page 14: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

Enable decisions on real-time data

Real time Data Streaming Analysis

Page 15: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

Machine LearningAlgorithms

Future Data

Page 16: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

COMBINATIONPAST DATA > STORED

CURRENT DATA FLOWS > REAL-TIME DATA STREAMING

FUTURE DATA > MACHINE LEARNING & ALGORITHMS

Page 17: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

NoSQL databasesTHE BEST OF BOTH WORLDS

COMBINED

“Two plus two is four? Sometimes… Sometimes it is five.” G. ORWELL

NoSQLdatabases

BD Processing

Page 18: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

SIMPLIFICATION: Visual tools

Simplify Building Process

Page 19: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

Clear Data Visualization

Page 20: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

New ways of Data Visualization

Page 21: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

IT THIRD GENERATION

Page 22: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

CURRENT IT PARADIGM

Page 23: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

CRM

E-COMMERCE

LOGISTIC

SALES

APPLICATION

SPECIALIZED

APPLICATIONS BI

DASHBOARD

REPORTING

R, SPS, SAS

BA

TERADATA

DW

DATA REPLICATION

HUMAN INTERVENTION

Current it paradigm

OPERATIONAL INFORMATIONAL

Page 24: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

NEW IT PARADIGM

Page 25: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

OPERATIONAL

DATA LAYER

INFORMATIONAL

Data layer Integration between Operational and Informational Applications

Page 26: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

The spoon

Page 27: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

Data exists by itself

OPERATIONAL

DATA

INFORMATIONAL

Companies will buy data, sell data, trade data andMake specific deals and partnerships to share or get data

Page 28: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

Already Happening: RTB

Page 29: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014
Page 30: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

THE ORACLE: THE FUTURE OF DATA

Page 31: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

Millions of data analyzed in real time

Page 32: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

Wearables & Mobile: One ring to rule them allThe small heart of the big system

Page 33: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

Wearables: Sensors all around us

Page 34: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

Nano Data Meets Big Data

Page 35: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014
Page 36: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

CONCLUSSIONS

Page 37: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

Take the Red pill and see reality: World is data, and data is your value

Page 39: Spark, NoSql and real time processing by Oscar Mendez at Big Data Spain 2014

17TH ~ 18th NOV 2014MADRID (SPAIN)