tibco data science team july 2019 tibco analytics meetup · tibco analytics meetup opportunities to...

TIBCO Analytics Meetup

July 2019

TIBCO Data Science Team

The following information is confidential information of TIBCO Software Inc. Use, duplication, transmission, or republication for any purpose without the prior written consent of TIBCO is expressly prohibited.

CONFIDENTIALITY

© Copyright 2000-2019 TIBCO Software Inc.

This document (including, without limitation, any product roadmap or statement of direction data) illustrates the planned testing, release and availability dates for TIBCO products and services. This document is provided for informational purposes only and its contents are subject to change without notice. TIBCO makes no warranties, express or implied, in or relating to this document or any information in it, including, without limitation, that this document, or any information in it, is error-free or meets any conditions of merchantability or fitness for a particular purpose. This document may not be reproduced or transmitted in any form or by any means without our prior written permission.

The material provided is for informational purposes only, and should not be relied on in making a purchasing decision. The information is not a commitment, promise or legal obligation to deliver any material, code, or functionality. The development, release, and timing of any features or functionality described for our products remains at our sole discretion.

During the course of this presentation TIBCO or its representatives may make forward-looking statements regarding future events, TIBCO’s future results or our future financial performance. These statements are based on management’s current expectations. Although we believe that the expectations reflected in the forward-looking statements contained in this presentation are reasonable, these expectations or any of the forward-looking statements could prove to be incorrect and actual results or financial performance could differ materially from those stated herein. TIBCO does not undertake to update any forward-looking statement that may be made from time to time or on its behalf.

DISCLAIMER


4

TIBCO Analytics Meetupopportunities to learn and network

Meetup group keeps growing and now has 765+ members!

Join this TIBCO Analytics Meetup group and receive automatic invites to future TIBCO Analytics Meetups

And you’ll get the links to slides Youtube recordings!

http://www.meetup.com/TIBCOSpotfireOnlineusergroup/

https://bit.ly/2Jm4iOn

https://www.meetup.com/TIBCOSpotfireOnlineusergroup/

https://www.meetup.com/TIBCOSpotfireOnlineusergroup/

http://www.meetup.com/TIBCOSpotfireOnlineusergroup/

https://bit.ly/2Jm4iOn

5

Agenda

• Welcome and TIBCO update by Michael O’Connell

• AutoML and Spotfire Data Function for TIBCO Data Science by Dan Rope

• Image Recognition Demo by Colin Gray

• TIBCO Community update by Heleen Snelting

• Live Q&A

Please submit your questions at any time via Q&A option

We will answer at the end or will get back to you via email

6

Analytics & Data Science

TIBCO Update

Michael O’ConnellChief Analytics Officer

7

TIBCO: Turn your data into innovation

Event-driven Applications

API-led Integration

InformationManagement

DataFabric

Data Science

AnalyticsAUGMENT

CONNECT UNIFY

8

Digital Transformation platform

Enterprise Application 1

Enterprise Application n

Streaming Sources

In-memoryData Grid

...

REPORTING/VIZDATA SCIENCEANALYTICS

Data Science(Model/Algo Dev)

Dashboards, Reports, Visualizations, etc

INFORMATION MANAGEMENT

Metadata (Data Governance, Data Catalog)

MDM/RDM

DATA OPERATIONS

Data Virtualization Master and Reference Data Management

Data Store 1 Data Store n EDW/Lake

Metadata

Master & Reference Data

Transactional Data

Legend

Powered by shared data assets

EVENTS

Streaming / Events

INTEGRATION

Hybrid Integration

APIManagement

Spark Compute & Store

9

Spotfire Analytics Experience

AugmentedAI-Powered Insights

Start in seconds, instant insights

AutomatedAutomagical Dataflows

Author & audit with automatically recorded dataflow steps

AgileReimagined User Interface

Agile exploration made even easier

AcceleratedReal-time Insights

Real-time awareness and action


10

We’ve been busy

CHICAGO DENVER SAN FRANCISCO


Blog - https://bit.ly/2OwRpYjnow.tibco.com Summary of presentation - https://bit.ly/322qG8q

https://bit.ly/2OwRpYj

http://now.tibco.com

https://bit.ly/322qG8q

11

Coming soon

WESTIN GALLERIA, HOUSTON, OCT 28-29


TIBCO ANALYTICS FORUM - analyticsforum.tibco.com

TIBCO NOW LONDON - now.tibco.com

http://analyticsforum.tibco.com

http://now.tibco.com

12

SOM on Multivariate Seismic Data


13

GeoAnalytics – Current Well Spacing


14

GeoAnalytics – Petrophysical

15

GeoAnalytics – Current Well Spacing


16

GeoAnalytics – Optimal Drill Region


17

Today’s MeetupAutoML in TIBCO Data Science

Spotfire + AWS for Image Recognition


18

Real-Tim

e (BW

)

Data Sources

Data Marts

Streaming

Transactional Stores

External Sources

Manage

Execute

EDWs & Analytics

Sandboxes

TIBCO Data Science

Analytics Platform

Visual Analytics

TIBCO Spotfire

AP

Is and

Microservices

Operational Systems

TIBCO Live Apps

Con

tainers/

Cod

e

AWS Deployments

Federated Services

TIBCO Streaming

AWS SageMaker

TIBCO Flogo

Model Management

TIBCO Analytics and Amazon

ComputeDB

Visual UI / Notebook

Batch

(TIBC

O D

V)

Collaboration / Project Mgt

Automation

Spark

Python Boto3 SDK

Amazon Redshift

Amazon EMR

Amazon Simple Storage Service (S3)


SageMaker

19

Dan RopeDirector, Data Science

AutoML and Spotfire Data function for TIBCO Data Science - Demo


Swap Logoif neededIn master slide


Automation and optimization of common steps to train a machine learning model

Efficiency for Data Scientists• Rapid start using auto-generated workflows

• Improve productivity by automating common steps

• Easily try feature engineering and ML algorithms

AutoML: Benefits

Self-Service for Citizen Data Scientists• Get started with feature engineering and ML faster

• Guidance on the best practices

• Rapidly try out different models

• Quickly explore wider range of use cases



Automation and optimization of common steps to train a machine learning model

Algorithm Characteristics• Automatically generate features from the data via techniques used by data scientists• Automatically select candidate features for modeling• Automatically execute a variety of modeling algorithms with hyper-parameter search for ‘best’

performing model

Project Goals• Transparency: Visibility, modification, and collaboration across data science process• Scalability: AutoML execution in-db and at-scale• Understanding: Visual model interpretability & explainability

AutoML

https://drive.google.com/open?id=1woi8iXgfBjjpaaGi8RLAZa_EmYWIUS0t


AutoML for TIBCO Data Science - Team StudioFoundation• New nodes: feature engineering--including

separate encoding nodes, variable selection and automated model selection

• Meta-learning step that determines how to engineer features and assemble the nodes into a workflow

• Workflow generation fully parameterized and ready-to-run, only need data source and target variable

Primary Differentiation• Lego blocks vs black box • Editable workflow allows for refinement and

optimization by a data scientist• Everything runs at-scale, in-database



Demo



Spotfire Data Function for TIBCO Data Science - Team Studio


• Spotfire data function that executes Team Studio workflows

• Data function input parameters supply Team Studio workflow variables

• Spotfire and Team Studio share the same big data source

• Support long running workflow executions

• Import of Team Studio ‘result tables’ as Spotfire data tables

• Available now on TIBCO Community Exchange

https://bit.ly/2GGraIl

https://community.tibco.com/modules/data-function-tibcor-data-science-team-studio-tibco-spotfirer

https://community.tibco.com/modules/data-function-tibcor-data-science-team-studio-tibco-spotfirer

25

Image Recognition with Spotfire, Python and AWS Rekognition - Demo


Colin GrayData Scientist

blog: https://bit.ly/2OyjqhU

https://bit.ly/2OyjqhU

26

Image recognition is the ability for machines to identify objects and patterns in imagery. The imagery could be photographs, satellite imagery, medical screens, video footage for example.

Machine Learning algorithms are taught to detect labels of interest, and then applied to new images.

Image Recognition

Sectors:

● Security and intelligence

● Medical and healthcare

● Retail

● Insurance

● Manufacturing

● Environmental and

agriculture


27

All the major cloud providers have pre built image recognition models:

• Amazon (AWS) - Rekognize• Microsoft (Azure) - Computer Vision API• Google Cloud - Vision AI

Possible to build your own custom models in Python, SageMaker (AWS) etc.

Image Recognition Models


28

TIBCO Community Update


Heleen SneltingDirector Data Science


29

Spotfire Customer Success

https://www.linkedin.com/groups/12253057/

Get updates on new videos, Dr Spotfire Quick Tips Vlogs and more

Post your own Tips&Tricks as well

Reddit https://www.reddit.com/r/spotfire/

Facebookhttps://www.facebook.com/groups/651751391967838/


https://www.linkedin.com/groups/12253057/

https://www.reddit.com/r/spotfire/

https://www.facebook.com/groups/651751391967838/

https://www.facebook.com/groups/651751391967838/


30

Spotfire Youtube

https://bit.ly/2fyknq6

Make sure to subscribe!

Includes the TIBCO Analytics Meetup recordings

And this new series: Dr. Spotfire Quick Tips - https://bit.ly/2Yuis64


https://bit.ly/2fyknq6

https://bit.ly/2Yuis64


33

Learn: TIBCO Community Blog by Steven Hillion

https://bit.ly/2ZiPtU0

Get started NOW: Download on TIBCO Community Exchange

https://bit.ly/333A9gz

Get Involved: on TIBCO LABS

https://community.tibco.com/wiki/tibco-labs

AutoML: more info


https://community.tibco.com/feed-items/real-power-automl

https://www.tibco.com/blog/2019/06/13/the-real-power-of-automl/

https://www.tibco.com/blog/2019/06/13/the-real-power-of-automl/

https://bit.ly/2ZiPtU0

https://community.tibco.com/modules/automl-tibcor-data-science-team-studio

https://community.tibco.com/modules/automl-tibcor-data-science-team-studio





34

TIBCO Community Exchangehttps://community.tibco.com/exchangeuse filters on page to help select items


https://bit.ly/2GGraIl


https://bit.ly/2EPx4Z8

https://community.tibco.com/exchange


35

1. Guidance on getting access to your products and setting them up.

2. Recommendations and best practices for starting usage.

3. Awareness of the many additional resources available to help you and your

organization achieve your goals.

Spotfire Customer Orientation

https://community.tibco.com/wiki/tibco-spotfire-customer-orientation




36

Dr. Spotfire - Hands-on with Analytics


● Free 30-minute webinar● For all Spotfire users ● Includes Feature Demonstration and User Q&A● Hosted by our top Data Scientists and Spotfire

Expertshttps://community.tibco.com/wiki/doctor-spotfire-office-hours

1st Tuesday of every month at 9AM PT

37

What’s new in… for example TIBCO Data Virtualization

https://community.tibco.com/wiki/whats-new-tibco-data-virtualization

Customer Orientation and Customer Success Center - ideal for on-boarding and staying up to date

https://community.tibco.com/wiki/tibco-spotfire-customer-orientation https://community.tibco.com/wiki/tibco-spotfire-customer-success-center

AI on Demand: Data Science in Operations - TIBCO Data Science latest work and Meetup Tour 2019

https://community.tibco.com/wiki/ai-demand-data-science-operations

Dr Spotfire

https://community.tibco.com/wiki/doctor-spotfire-office-hours

TIBCO Geo-Analytics capabilities

https://community.tibco.com/wiki/tibco-spotfire-location-analytics-mapping-geoanalytics-and-spatial-statistics

TIBCO Analytics Meetup pages with recordings and presentations

https://community.tibco.com/wiki/tibco-analytics-meetup

Data Literacy

https://community.tibco.com/wiki/data-literacy

Top TIBCO Community links to bookmark

© Copyright 2000-2019 TIBCO Software Inc. © Copyright 2000-2019 TIBCO Software Inc.

https://community.tibco.com/wiki/whats-new-tibco-data-virtualization


https://community.tibco.com/wiki/tibco-spotfire-customer-success-center

https://community.tibco.com/wiki/ai-demand-data-science-operations

https://community.tibco.com/wiki/doctor-spotfire-office-hours

https://community.tibco.com/wiki/tibco-spotfire-location-analytics-mapping-geoanalytics-and-spatial-statistics

https://community.tibco.com/wiki/tibco-analytics-meetup

https://community.tibco.com/wiki/data-literacy

38

Questions & Contact

Thank you!Michael O’[email protected]

@MichOConnellH

Heleen Snelting [email protected]@HeleenSnelting

TIBCO Communitycommunity.tibco.com

TIBCO Exchangecommunity.tibco.com/exchange

Spotfire Trialspotfire.tibco.com/trial


mailto:[email protected]

mailto:[email protected]

https://community.tibco.com/wiki/tibco-spotfire-community-wiki

http://community.tibco.com/exchange

https://spotfire.tibco.com/trial

tibco data science team july 2019 tibco analytics meetup · tibco analytics meetup opportunities to...

Documents