accelerating digital transformation with€¦ · accelerating digital transformation with...

#vmworld

Accelerating Digital Transformation with

InterSystems IRIS and vSANMurray Oldfield, InterSystems

Andreas Dieckow, InterSystemsChristian Rauber, VMware

HCI2501BU

#HCI2501BUVMworld 2018 Content: Not for publication or distribution

Disclaimer

2©2018 VMware, Inc.

This presentation may contain product features orfunctionality that are currently under development.

This overview of new technology represents no commitment from VMware to deliver these features in any generally available product.

Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind.

Technical feasibility and market demand will affect final delivery.

Pricing and packaging for any new features/functionality/technology discussed or presented, have not been determined.

VMworld 2018 Content: Not for publication or distribution

Accelerating Digital Transformationwith InterSystems IRIS and vSAN

Christian Rauber

Andreas Dieckow

Murray Oldfield


Digital Transformation Requirements

Successful Digital Transformation Initiatives Require New Applications That…

• Are Smarter

• Are Faster

• Incorporate More Data From More Sources

• Work Seamlessly With Existing Infrastructure

• Scale On Demand

• Are Simpler to Build and Manage


Complexity in Infrastructure


Complexity in Software


Relational DBMS

Object Store

Document Store

Key-Value Store

In Memory DBMS

Business IntelligenceReal-Time

Data Integration

Application Integration

Orchestration

Workflow

Natural Language Processing

Advanced Analytics

Data Warehouse

API Management

Cloud Provisioning

Normalized Data Lake

Data Platform


A Unified Platform for Accelerating Digital Transformation Initiatives

InterSystems IRIS Data Platform

Multi - Model• Relational

• Document

Multi - Workload

• HTAP with Isolated Workload Processing

• Unique Approach to Big Data Analytics

• ACID Transactions + Real-Time Indexing

Open Analytics

• Analytic SQL

• Business Intelligence

• Natural Language Processing

Interoperability

• Languages and Tools

• Data Integration

• Application Integration

• Multidimensional

• Object

• Predictive Model Runtime

• Connector Architecture

• Composite Business

Process Orchestration

Flexible Cloud | Hybrid | On Premises Deployment Options


• Global investment bank with 50,000 employees and $1 trillion (USD) assets under management

• Replaced in-memory operational DBMS

• Eliminating near term and historical DWs

• Zero issues even during peak trading periods

Customer Use Case: Finance

Traditional Siloed

Architecture

InterSystems IRIS

A Unified Data PlatformInterSystems IRIS

TransactionProcessingDatabase

Near Term Analytic

Database

HistoricalAnalytic

Database

Archive / Data Lake


Big Data at ScaleDatabase Configuration Days of Data Dataset Size (GB) Dataset Size (Rows)

InterSystems IRIS4 VMs: 8 cores, 96GB RAM, 400GB

local storage135 320 2,000,000

Vendor A(In Memory DBMS)

8 VMs: 16 cores, 256GB RAM, 400GB local storage

14 33 207,400

Vendor B(In Memory DBMS with Column

Store)

8 VMs: 16 cores, 256GB RAM, 400GB local storage

14 33 207,400

Vendor C(Column Store Data Warehouse)

3 dedicated physical servers, each with 24 cores and 256GB RAM,

2TB shared SAN storage20 47 296,200

0

1000

2000

3000

4000

5000

6000

7000

8000

9000

1 10 25 50 100Que

ry R

esp

ons

e T

ime

(in m

s)

# Concurrent Users

Query Returning 19 Rows

IRIS Vendor AVendor B Vendor C

0

1000

2000

3000

4000

5000

6000

7000

8000

9000

1 10 25 50 100Que

ry R

esp

ons

e T

ime

(in m

s)

# Concurrent Users



0

1000

2000

3000

4000

5000

6000

7000

8000

9000

1 10 25 50 100Que

ry R

esp

ons

e T

ime

(in m

s)

# Concurrent Users



0

1000

2000

3000

4000

5000

6000

7000

8000

9000

1 10 25 50 100Que

ry R

esp

ons

e T

ime

(in m

s)

# Concurrent Users

Query Returning 984Rows


RESULTS• Better Performance• On ~10X More Data• Using Less Infrastructure• Zero Query Failures


• 5th largest shipbuilder in Europe

• Manages 65,000 different real-time signals from a wide variety of sensors

• Combines real-time and non-real-time data

• Reduced development time for additional projects by 80%

“We have been able to develop a better system than anybody else in the world. Itdifferentiates us from all competitors. In some cases we have been able to sell shipsthanks specifically to our integrated ship information system; sometimes it has beenmore important than the ship itself.”

Customer Use Case: IoT


• 2nd largest shipping company in the world• Transports 12 million smart containers among

270 shipping ports worldwide

• InterSystems-based Track & Trace Application• Provides customers with accurate, real-time visibility into location, status, expected arrival• Real-time processing and analytics to route – and re-route ships – to ensure containers arrive

on time• Incorporates real-time events (weather, strikes, …) • Eliminates errors and omissions in processing and documentation

“This unique technology is the best-kept secret in the IT industry….…and the support from InterSystems is excellent.”

-Rumen Lilov, eBusiness Development Manager

Customer Use Case: Logistics


Customer Use Case: Retail

• Integrates 120 subsidiaries and partners in 40 countries• Backbone for 80 shopping malls selling 30,000 products• Backbone for a new ecommerce channel• Self service (NLP) digital help desk• Automated financial reporting processes


• Automated information collection, monitoring, control and analysis of all information for local and federal police

• Integrated legacy policing applications

• Embedded database and analytics improves situational awareness and investigations

• Continuous operation even when disconnected

• All data and communications are encrypted for security 3

Customer Use Case: Public Sector


InterSystems IRIS Data Platform® combines a transactional-analytic processing engine optimized for all types of data – big, small, structured, unstructured, centralized, decentralized, historical, and real-time

with native interoperability for connecting and creating business processes among disparate applications and data sources

and an open analytics platform for applying real-time and batch analytics including business intelligence, predictive models, machine learning, and natural language processing.


InterSystems IRIS Technical Architecture

• Architecture and Benchmarks

• Getting the best from IRIS on vSAN

• Simple Proof of Concepts and Deployment


IRIS vSAN Production Loads Benchmark

6x Dell R640s 2x Intel 6132 2.6GHz, 672GB RAM

- 28 Physical cores/host

- Large VM 24 vCPU

2x disk groups per host, each disk group;

- 1x NVMe for the cache tier

(HGST SN260 3.2TB PCIe NVMe –HHHL)

- 4 x12G SAS SSDs for the capacity tier.

(HGST SS300 1.9TB 12Gb SAS – 2.5”)

Dual X550 10Ge NIC for vSAN/VM/vMotion

Single I350 1Ge NIC for ESXi management


IRIS Architecture Choices – Scale UP

24 vCPU cores/host

96 GB Memory


IRIS Benchmark on vSAN – Scale Up- Large Database Random 8K Reads


IRIS Architecture Choices – Scale Out Horizontally

24 vCPU cores/host

96 GB Memory

24 vCPU cores/host

96 GB Memory

24 vCPU cores/host

96 GB Memory


IRIS Benchmark on vSAN – Scale Out Throughput

Application Benchmark

24 vCPU cores/host

96 GB Memory


IRIS Architecture Choices – HA Mirror


IRIS Architecture Choices – Sharding for SQL Queries

24 vCPU cores/host

96 GB Memory

24 vCPU cores/host

96 GB Memory

24 vCPU cores/host

96 GB Memory

24 vCPU cores/host

96 GB Memory


IRIS Benchmark on vSAN – Sharding Query Results

Query Benchmark

24 vCPU cores/host

96 GB Memory


Is vSAN Supported?


Q: Are there any Special Considerations for HCI?

A:YES!VMworld 2018 Content: Not for publication or distribution


Minimum Requirements for Production IRIS on vSAN

Must be on the HCL Must be on the HCL

Networking

Must be on the HCL

Compute Storage



Minimum Requirements for Production IRIS on vSAN

IRIS & VMware Best Practice Rules First

10% extra CPU

6-node cluster

IRIS Best Practice Rules First

All Flash

2+ Disk Groups/host

NVMe for cache tier

LVM PE striping

Networking

10 or 25Gb NIC

Non-blocking switch

25GB or 100Gb networks

Compute Storage


Default vSAN Placement vs PE Striping - Reads

Your Mileage Will VaryVMworld 2018 Content: Not for publication or distribution

InterSystems Cloud Manager (ICM) for Deployment

Deploys Containers (or not)

Deploys to cloud and vSphere

Scripting simplifies deployments

An intelligent wrapper for HashiCorp Terrafom


ICM Public and Private Cloud Options


Getting the best from VMware, vSAN and IRIS

community.intersystems.com

capacity planning and performance series indexVMworld 2018 Content: Not for publication or distribution

https://community.intersystems.com/

Data Platform + HCI => Simplicity


Q & A

Thank you, please complete the survey


Thank You!www.InterSystems.com/IRIS


PLEASE FILL OUTYOUR SURVEY.Take a survey and enter a drawingfor a VMware company store gift card.

#vmworld #HCI2501BUVMworld 2018 Content: Not for publication or distribution

THANK YOU!

#vmworld #HCI2501BUVMworld 2018 Content: Not for publication or distribution

accelerating digital transformation with€¦ · accelerating digital transformation with...

Documents