sas event stream processing · title: uassouf-sas-esp author: ignacio procopio created date:...

14
Copyright © 2012, SAS Institute Inc. All rights reserved. SAS EVENT STREAM PROCESSING Sergio Uassouf Líder de Práctica de Gestión de Información e Infraestructura SAS FORUM ARGENTINA 2015 5 DE MAYO

Upload: others

Post on 19-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: SAS EVENT STREAM PROCESSING · Title: uassouf-sas-esp Author: Ignacio Procopio Created Date: 5/11/2015 2:45:43 PM

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS EVENT STREAM PROCESSING

Sergio UassoufLíder de Práctica de

Gestión de Información e Infraestructura

SAS FORUM ARGENTINA 2015 5 DE MAYO

Page 2: SAS EVENT STREAM PROCESSING · Title: uassouf-sas-esp Author: Ignacio Procopio Created Date: 5/11/2015 2:45:43 PM

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

ANALYTICS AND INSIGHTS ON STREAMING DATASTREAMING

ANALYTICS

Page 3: SAS EVENT STREAM PROCESSING · Title: uassouf-sas-esp Author: Ignacio Procopio Created Date: 5/11/2015 2:45:43 PM

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

RETAILER EL FUTURO DEL SHOPPING

A low-power transmitter that enables a smart phone or

other device to perform actions when in close

proximity.

Page 4: SAS EVENT STREAM PROCESSING · Title: uassouf-sas-esp Author: Ignacio Procopio Created Date: 5/11/2015 2:45:43 PM

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

¿CUAL ES LA

TENDENCIA?INTERNET OF THINGS / INTERNET DE LAS COSAS

40 terabytes/hour

1 gigabyte/second

Page 5: SAS EVENT STREAM PROCESSING · Title: uassouf-sas-esp Author: Ignacio Procopio Created Date: 5/11/2015 2:45:43 PM

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

BIG DATA VACUNA CONTRA EL HUMO

Explíqueme como lo hace.

Muéstreme como funciona.

Page 6: SAS EVENT STREAM PROCESSING · Title: uassouf-sas-esp Author: Ignacio Procopio Created Date: 5/11/2015 2:45:43 PM

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS® EVENT STREAM

PROCESSING ENGINE

3 CARACTERISTICAS CLAVES

TECNOLOGIA

SAS® ESP Engine brinda la arquitectura para procesar flujos de

datos y eventos de negocio, en tiempo real antes de su

almacenamiento.

VELOCIDAD

SAS® ESP Engine puede procesar enormes volúmenes de

información a velocidades muy elevadas (millones de eventos por

segundo) con una latencia minima (< 1 milisegundo).

INTELIGENCIA EN ACCION

SAS® ESP Engine filtra, hace agregaciones y correlaciona los flujos

de datos para detectar eventos específicos, características

particulares y patrones de comportamiento.

Page 7: SAS EVENT STREAM PROCESSING · Title: uassouf-sas-esp Author: Ignacio Procopio Created Date: 5/11/2015 2:45:43 PM

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

COMPLEMENTANDO LAS SOLUCIONES SAS

CON EL ANÁLISIS EN TIEMPO REAL DE FLUJO DE DATOS

SAS Fraud Framework

SAS Security Intelligence

SAS Customer Intelligence

SAS Risk Management

SAS Decision Management

and SAS Analytics

SAS Asset Performance AnalyticsSAS Business Intelligence

SAS Data Management SAS Text Analytics

And all other solutions …

SAS® EVENT STREAM

PROCESSING ENGINE

Page 8: SAS EVENT STREAM PROCESSING · Title: uassouf-sas-esp Author: Ignacio Procopio Created Date: 5/11/2015 2:45:43 PM

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

ESP CONTINUOUS QUERIES – DATA FLOW DIAGRAM

Event Stream Processing Engine

Event StreamSources/Publishers

Processed Event Stream Consumers/Subscribers

Databases

Applications

Workflows

Mobile BI / BAM Alerts

SourceWindow

Venues & Instruments

Applications

SourceWindow

SourceWindow

FilterDerivedWindow

JoinDerivedWindow

JoinDerivedWindow

Event

Stream

Event

Stream

Event

Stream

Event

Stream

Event

Stream

Event

Stream

Event

Stream

Event

Stream

Event

Stream

Event

Stream

Event

Stream

Page 9: SAS EVENT STREAM PROCESSING · Title: uassouf-sas-esp Author: Ignacio Procopio Created Date: 5/11/2015 2:45:43 PM

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

ESP CONTINUOUS QUERIES – DATA FLOW DIAGRAM

Event Stream Processing Engine

Event StreamSources/Publishers

Processed Event Stream Consumers/Subscribers

Databases

Applications

Workflows

Mobile BI / BAM Alerts

Venues & Instruments

Applications

Event

Stream

Event

Stream

Event

Stream

Event

Stream

Event

Stream

Event

Stream

• Publish / subscribe

• Inserts/updates/deletes

• Continuous queries

• Aggregate (group by)

• Correlate (join)

• Compute

• Filter

• Procedural

• User defined functions

• Retention windows

• Pattern matching

• Ad-hoc queries

• Command & control

• Security (Auth, Encrypt, AC)

• Persistence / recovery

• Fail-over

• Distributed services

• Model management

Page 10: SAS EVENT STREAM PROCESSING · Title: uassouf-sas-esp Author: Ignacio Procopio Created Date: 5/11/2015 2:45:43 PM

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

ESP CONTINUOUS QUERIES – DATA FLOW DIAGRAM

Event Stream Processing Engine

Event StreamSources/Publishers

Processed Event Stream Consumers/Subscribers

Databases

Applications

Workflows

Mobile BI / BAM Alerts

Venues & Instruments

Applications

Event

Stream

Event

Stream

Event

Stream

Event

Stream

Event

Stream

Event

Stream

Page 11: SAS EVENT STREAM PROCESSING · Title: uassouf-sas-esp Author: Ignacio Procopio Created Date: 5/11/2015 2:45:43 PM

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS EVENT

STREAM

PROCESSING

VISUAL MODELER (V3.1), MAY 2015

Design Mode

• Window Types

• Window

Configuration

Page 12: SAS EVENT STREAM PROCESSING · Title: uassouf-sas-esp Author: Ignacio Procopio Created Date: 5/11/2015 2:45:43 PM

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS EVENT

STREAM

PROCESSING

VISUAL MODELER (V3.1), MAY 2015

Test Mode

• Deploy and Test

on ESP Server

• Monitor test

results

• Continuous

updates

• Iterative Testing

Page 13: SAS EVENT STREAM PROCESSING · Title: uassouf-sas-esp Author: Ignacio Procopio Created Date: 5/11/2015 2:45:43 PM

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d .

SAS EVENT

STREAM

PROCESSING

VISUALIZATION: A CUSTOM EXAMPLE

Page 14: SAS EVENT STREAM PROCESSING · Title: uassouf-sas-esp Author: Ignacio Procopio Created Date: 5/11/2015 2:45:43 PM

Copyr i g ht © 2012, SAS Ins t i tu t e Inc . A l l r ights reser ve d . www.SAS.com

MUCHAS GRACIAS