sas event stream processing · title: uassouf-sas-esp author: ignacio procopio created date:...
TRANSCRIPT
Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS EVENT STREAM PROCESSING
Sergio UassoufLíder de Práctica de
Gestión de Información e Infraestructura
SAS FORUM ARGENTINA 2015 5 DE MAYO
Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
ANALYTICS AND INSIGHTS ON STREAMING DATASTREAMING
ANALYTICS
Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
RETAILER EL FUTURO DEL SHOPPING
A low-power transmitter that enables a smart phone or
other device to perform actions when in close
proximity.
Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
¿CUAL ES LA
TENDENCIA?INTERNET OF THINGS / INTERNET DE LAS COSAS
40 terabytes/hour
1 gigabyte/second
Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
BIG DATA VACUNA CONTRA EL HUMO
Explíqueme como lo hace.
Muéstreme como funciona.
Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS® EVENT STREAM
PROCESSING ENGINE
3 CARACTERISTICAS CLAVES
TECNOLOGIA
SAS® ESP Engine brinda la arquitectura para procesar flujos de
datos y eventos de negocio, en tiempo real antes de su
almacenamiento.
VELOCIDAD
SAS® ESP Engine puede procesar enormes volúmenes de
información a velocidades muy elevadas (millones de eventos por
segundo) con una latencia minima (< 1 milisegundo).
INTELIGENCIA EN ACCION
SAS® ESP Engine filtra, hace agregaciones y correlaciona los flujos
de datos para detectar eventos específicos, características
particulares y patrones de comportamiento.
Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
COMPLEMENTANDO LAS SOLUCIONES SAS
CON EL ANÁLISIS EN TIEMPO REAL DE FLUJO DE DATOS
SAS Fraud Framework
SAS Security Intelligence
SAS Customer Intelligence
SAS Risk Management
SAS Decision Management
and SAS Analytics
SAS Asset Performance AnalyticsSAS Business Intelligence
SAS Data Management SAS Text Analytics
And all other solutions …
SAS® EVENT STREAM
PROCESSING ENGINE
Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
ESP CONTINUOUS QUERIES – DATA FLOW DIAGRAM
Event Stream Processing Engine
Event StreamSources/Publishers
Processed Event Stream Consumers/Subscribers
Databases
Applications
Workflows
Mobile BI / BAM Alerts
SourceWindow
Venues & Instruments
Applications
SourceWindow
SourceWindow
FilterDerivedWindow
JoinDerivedWindow
JoinDerivedWindow
Event
Stream
Event
Stream
Event
Stream
Event
Stream
Event
Stream
Event
Stream
Event
Stream
Event
Stream
Event
Stream
Event
Stream
Event
Stream
Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
ESP CONTINUOUS QUERIES – DATA FLOW DIAGRAM
Event Stream Processing Engine
Event StreamSources/Publishers
Processed Event Stream Consumers/Subscribers
Databases
Applications
Workflows
Mobile BI / BAM Alerts
Venues & Instruments
Applications
Event
Stream
Event
Stream
Event
Stream
Event
Stream
Event
Stream
Event
Stream
• Publish / subscribe
• Inserts/updates/deletes
• Continuous queries
• Aggregate (group by)
• Correlate (join)
• Compute
• Filter
• Procedural
• User defined functions
• Retention windows
• Pattern matching
• Ad-hoc queries
• Command & control
• Security (Auth, Encrypt, AC)
• Persistence / recovery
• Fail-over
• Distributed services
• Model management
Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
ESP CONTINUOUS QUERIES – DATA FLOW DIAGRAM
Event Stream Processing Engine
Event StreamSources/Publishers
Processed Event Stream Consumers/Subscribers
Databases
Applications
Workflows
Mobile BI / BAM Alerts
Venues & Instruments
Applications
Event
Stream
Event
Stream
Event
Stream
Event
Stream
Event
Stream
Event
Stream
Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS EVENT
STREAM
PROCESSING
VISUAL MODELER (V3.1), MAY 2015
Design Mode
• Window Types
• Window
Configuration
Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS EVENT
STREAM
PROCESSING
VISUAL MODELER (V3.1), MAY 2015
Test Mode
• Deploy and Test
on ESP Server
• Monitor test
results
• Continuous
updates
• Iterative Testing
Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .
SAS EVENT
STREAM
PROCESSING
VISUALIZATION: A CUSTOM EXAMPLE
Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d . www.SAS.com
MUCHAS GRACIAS