tibco streaming analytics overview and roadmap

This document (including, without limitation, any product roadmap or statement of direction data) illustrates the planned testing, release and availability dates for TIBCO products and services. It is for informational purposes only

and its contents are subject to change without notice. © Copyright 2000-2017 TIBCO Software Inc. All rights reserved. TIBCO Proprietary Information.

TIBCO Streaming Analytics

Lou Bajuk-Yorgan

Sr. Director, Product Management,

Streaming and Advanced Analytics



DISCLAIMERDuring the course of this presentation, TIBCO or its representatives may make forward-looking statements regarding future events,

TIBCO’s future results or our future financial performance. Although we believe that the expectations reflected in the forward-looking

statements contained in this presentation are reasonable, these expectations or any of the forward-looking statements could prove to

be incorrect and actual results or financial performance could differ materially from those stated herein.

TIBCO could experience factors that could cause actual results or financial performance to differ materially from those contained in

any forward-looking statement made in connection with this presentation. TIBCO does not undertake to update any forward-looking

statements that may be made from time to time or on its behalf.

This document (including, without limitation, any product roadmap or statement of direction data) illustrates the planned testing,

release and availability dates for TIBCO products and services. This document is provided for informational purposes only and its

contents are subject to change without notice. TIBCO makes no warranties, express or implied, in or relating to this document or any

information in it, including, without limitation, that the information is error-free or meets any conditions of merchantability or fitness for a

particular purpose. This document may not be reproduced or transmitted in any form or by any means without our prior written

permission.

The material provided is for informational purposes only, and should not be relied on in making a purchasing decision. The

information is not a commitment, promise or legal obligation to deliver any material, code, or functionality. The development, release,

and timing of any features or functionality described for our products remains at our sole discretion.



People &

Processes

Data &

Systems

APIs

Visual

Analytics

Streaming

Analytics

Predictive

Analytics



AUGMENT INTELLIGENCE

Visual

Analytics

Streaming

Analytics

Predictive

AnalyticsModel business and system behavior

using data big and small

Deliver recommendation driven insight

to business and operations

Sense and take action in the right moment to

improve business outcomes



Traditional Data Processing

• Data is collected from a variety of sources, and placed in a persistent store.– Relational database.

– NoSQL store.

– Hadoop environment.

• Analytical processes are executed against the stored data to detect opportunities or threats.

• Actions are identified, delivered, and executed across various business channels.

Store

Analyze

Act



Traditional Data Processing: Challenges

Store

Analyze

Act

• Introduces too much “decision latency” into the business.

• Responses are delivered “after-the-fact”.

• Maximum value of the identified situation is lost.

– Cross-sell / up-sell opportunities are lost, impending equipment failure is missed, business processes are slow to respond and lack timely context.

• Decisions are made on old and stale data.



Event Value Decreases Over TimeV

alu

e

Time

• Events are often most valuable “close to” the point of collection.

• As time passes, events tend to lose their value.• The ability to proactively

identify “threats” or “opportunities” will typically decrease.

• Real-time capability is needed to maximize event value.



Streaming Analytics

• Events are analyzed and processed in real-time as they are generated.

• At the edge and in the data center.

• Decisions are timely, contextual, and based on fresh data.

• Decision latency is eliminated, resulting in:

Superior Customer Experience

Operational Excellence

Instant Awareness and Timely Decisions

Act &

Monitor

Analyze

Store



BATCH ANALYSIS REAL-TIME ANALYSIS

PROCESS ZONE STRATEGIC TACTICAL OPERATIONS EXECUTION

TIME INCREMENTQuarters/

Years

Months/

Quarters

Hours/

Days/Weeks

Seconds/

Minutes

Evolution of Analytics



Evolution of Predictive Analytics

Insight Discovery• TIBCO Spotfire

• R, TERR®, Python

• H2O, Matlab, SAS, KNIME

Insight Execution• PFA, PMML

• POJOs

• Proprietary formats (SAS, TIBCO, ...)

Insight Execution Services• Microservice with containers

• Devops / Data Science handshake



Evolution of Streaming Analytics

Complex Event

Processing

~ 2000 - 2010

FSI, Transportation

and Logistics, Retail,

Airlines, Telco,

Manufacturing

Event

Processing

~ 2011 - 2014

Big Data as DW,

open source as

toolkit.

Clickstream, Social.

Convergence of Streaming and

Analytics

~ 2017+

IoT, Insight

Platform

Streaming

Analytics

~ 2015+

Big Data & open

source as platform,

IoT, Cloud, Self-

Service, Sensor,

Telemetry, ML & AI,

revisit old use cases.



Insight Action



Insight Action

MONITOR

PREDICT

ACT

DECIDE

MODEL

ACCESS

ANALYZE

WRANGLE

TIBCO Insight Platform



Streaming Analytics Overview



TIBCO Streaming Analytics Summary

TIBCO® Live Datamart Accelerators: Enable common use cases

▪ BusinessEvents: Rules, Caching, Entity relationships and state

▪ StreamBase: Visual IDE, Streaming Analytics, 150+ Connectivity points, Cloud Enabled

▪ Unified Suite▪ Predictive analytics

Real-time datamart, continuous query and aggregation

LiveView Web: Modern web client, real-time graphics, alerts, actions

Leverages SB runtime and 150+ Streaming Data Connectors

Enterprise, IOT, Spark Integration

Pre-packaged production-quality solution templates

Streaming Analytics focused, leverages Predictive Analytics

Extensible GUIs Extensible business logic Connectivity

$

TIBCO® BusinessEvents &

TIBCO® StreamBase



TIBCO BusinessEvents

Build Event-Driven Apps with Ease and Speed

Developer Highlights• Integrated development environment• Graphic editors and model-driven environment• Non-linearity in the form of declarative rules

Business User Highlights• Defining and implementing rules and logic in a web browser• Decision tables and rule templates

Runtime Highlights• Multi-protocol channel support• Event-driven rule evaluation and execution• Stateful for reasoning across time and space• Multiple deployment topology options• Horizontal scalability• Memory management strategies• Data grid security• Cross Datacenter ReplicationTIBCO® BusinessEvents

Studio



TIBCO StreamBase

Build Streaming Analytics Apps with Ease and Speed

Developer Highlights

• Eclipse-based IDE

• Visual programming language

• Integrating predictive models via TERR/R, PMML, H2O, SparkML

• Data connectivity with numerous integration points

Business User Highlights• Defining and implementing rules and logic in a web

browser

Runtime Highlights• Immense throughput at extremely low latencies• Big Data and IoT connectivity • Enterprise Ready – Distributed Shared Memory

provides High Availability, Fault Tolerance• Cloud Enabled

TIBCO® StreamBase Studio UI



TIBCO Live Datamart

Provide Insight and Instant Command and Control

Business User Highlights• On-the-fly action on detected opportunities and threats

• Interacting with live data: ad-hoc queries, alerts

• Live drill down with preferred visualizations

• Multiple client options: desktop, web, custom UIs

TIBCOTM LiveView Server Highlights• Ultra-fast, continuous querying • IoT ready: OSI PI, MQTT, …• Connectivity via sensors, GPS, and others

TIBCOTM LiveView Web



Zero install, streaming ready

WebSockets-powered HTML5

Highcharts-powered visualizations

display your data as it changes

Real-time Visualizations

Fine-tune your experience by

authoring or downloading from the

community exchange JavaScript

extensions to TIBCO LiveView Web

JavaScript Plug-ins

TIBCO LiveView Web



TIBCO Solution Accelerators

Intelligent Equipment Accelerator

Accelerator for Apache SPARK

Connected Vehicle Accelerator

Learn Faster, Innovate Faster

FX Dealing Accelerator, Smart Inventory Accelerator, Energy Drilling, etc…



What we’ve been up to ... (in production today)

DevOpsAPIs, CI/CD

StreamBase®

TIBCO Business Events

High Availability

Artifact Management

(Rules)

Accelerators

Cloud DeploymentAWSTM, PCF,

Docker®

Predictive:TERR, PMML, H2O, SparkML

FlexibleData Grid

Deployments

CustomizationAPIs

Cross DataCenter

Replication

Ease of useWeb

Studio

Accelerators Visualizationsvia TIBCO LiveView

IOTIntegration

Docker



Insight Action

MONITOR

PREDICT

ACT

DECIDE

MODEL

ACCESS

ANALYZE

WRANGLE

TIBCO Insight Platform



Key Analytics Interoperability Points

Spotfire to TIBCO LiveView data connectorSelf-service snapshotsAlternative connection to big data persistence, as loaded from StreamBase

Streambase to Spotfire Automation Services operatorRemotely call Spotfire engineParameterized analytic tasksCreate event-driven content

TERR Engine &Statistics ServicesUnique, high performance engine for REmbedded in Spotfire® & StreamBase, TIBCO Business Events

TIBCO LiveViewdashboard mashupPlug streaming dashboards into analytic appsData driven alerts with actions

VisualAnalytics

PredictiveAnalytics

Persistence

Mart / Grid

VisualAnalytics

StreamingAnalytics

VisualAnalytics

StreamingAnalytics

Command & Control



Use Cases



Optimize Pricing Prevent

Fraud

Smart cross-sell offers

Real-Time inventory

ManagementOptimize Routes

Deliver proactive customer service

Predict impending equipment failure

Anticipate and handle disruptions

Analytic AppsS

© Copyright 2000-2017 TIBCO Software Inc.



Request from Website Targeted Analytics Offer to Website

Customer Data

Product Data

Real-Time Customer Interactions / Offers

Login: Customer Propensity

No Login: Product Association



Real-Time Customer Interactions / Offers

No Login = No Customer History => Offer based on Product Association

Sarah Login = Sarah’s Customer History => Offer based on Propensity Model scored for Sarah



Use Case Example: Manufacturing Optimization

• Problem• Producing defective,

unreliable or poor performing product.

• Shorter lifecycles faster new

product ramps.

• Value• Increase Yield / % Good

product

• Reduce Defects & Rework

• Improve Reliability

• Use Cases• Quality Monitors and

Dashboards

• Root Cause Analyses

Root Cause: Machine

Effects

Monitor Product Quality KPIs and flag

outliers.



Use Case Example: Retail / Real-Time Inventory

• Problem:• Lack of visibility into inventory levels across all

channels.

• Difficulty allowing shoppers to buy anywhere, fulfill from anywhere, and return anywhere.

• Difficulty identifying the best fulfillment locations.

• Value:• Increased customer satisfaction.

• Reduction in excess inventory.

• Improved inventory visibility across all channels.

• Use Cases:• “Order Online, Pick-up In Store”

• Beacons / Contextual Offers

• Endless Aisle

• Personalized Shopping Experience



Fraud Applications

Anti-Money Laundering

▪ Identify / trace unknown and suspect transactions across

context e.g. business lines and geographies

▪ Set thresholds, define segments and automate alert scoring

▪ Comply with OCC guidelines

Credit Card Fraud

▪ Identify fraudulent transactions by vendor, location

▪ Highlight patterns, context and identify root cause

Regulatory Compliance

▪ Identify violations, patterns

▪ Expose a clear methodology and workflow

© Copyright 2000-2016 TIBCO Software Inc.



• FSI: Algorithmic pricing and execution, foreign exchange (FX) trading, market data

management

• Retail: In-store promotions, campaign optimization, real-time inventory tracking, fraud

detection

• Entertainment: Zero-latency betting, decision support over concurrent games, online

fraud and phishing detection

• Telecommunication and Networking: Real-time SLA management, network monitoring and

protection, fraud detection

• Transportation and Logistics: Flight operations, train-to-shore communication, passenger

experience management, parcel tracking, route optimization

• Energy: Production, fuel exploration, predictive equipment maintenance Manufacturing:

Process optimization, order-to-inventory management, supply chain monitoring

• Healthcare: Patient flow monitoring, bed inventory management, procedure optimization,

real-time disease detection

• IoT: Airline operations, locomotive operations, connected cars, smart homes

More Use Cases



StreamBase®

TIBCO Business Events

Model Deployment

andGovernance

Easier TIBCO LiveView/Spotfire Mashup

More PredictiveModel Options (PFA)

DevOpsAPIs, CI/CD

Accelerators StreamlinedVisualizations

via TIBCO LiveView

What’s next ... (not necessarily this order)

6-18mo

Streaming Data

in Spotfire

Web-based Workflow Authoring

Accelerators

Extensibility andAPIs

Tighter Ecosystem

Integration

Cloud Deployments

ArtifactManagement



Summary