data fabric and vmware

© 2009 VMware Inc. All rights reserved

Data Fabric and VMware

2

The Changing World of Applications

New Types of Interactions• Mobile, social networking interactions

New Devices• Smart phones, Tablets, Smart TVs, future

devices, software delivered as a service

New Frameworks• Developer productivity through increasing

abstraction

Data Growth & New Data Types• Data growing at 60% per year, Big Data,

new data models

New Infrastructures & Platforms• Virtualization, cloud

• Increasing number of cores, larger memory, flash storage

Time

Abs

trac

tion

3

Data Renaissance

VMware Confidential

The explosive growth of data and an increasing need to get a greater return on those data assets

New types of applications' evolving data demands

• scale, multi-site, real-time, social, mobile, SaaS

Big shifts in underlying infrastructure changed database system design assumptions

• In software (virtualization) and

• In hardware (multi-core, large memory, flash storage)

Cloud-inspired IT-as-a-Service delivery model both inside and outside enterprise firewalls

As a result, there has been a “Data Renaissance”, the boom in new techniques and technologies for managing data that aims to satisfy these new demands

4

Customer Challenges around Databases Today

• Thousands of under-managed and under-secured databases

• Difficult to enforce policy and compliance

Control Database Sprawl

Corporate IT Shadow IT

Provision & Manage

Provision & Manage

Databaseprovision or clone request

Lead time of weeks

Improve Operational AgilityGet More out of

Virtual Infrastructure

• More workloads in virtual machines than in physical machines

• Database accounts for ~15%-20% of the total workloads

• Database operations not fully automated

• Long lead time for database services for developers

…


Customer Insights from NYSE Technologies

Feargal O’Sullivan, VP of Platform Development, NYSE Technologies

7

Historical Trade and Quote Volumes

On average – in August 2011 – an entire trading day of US Equities and Options trade and quote data requires over 200GB of database storage

8

Historical Trade and Quote Use Cases

Post-trade Risk Applications

Continually validate that holdings meet all fund and regulatory requirements

Strategy Back Testing

Run complex analytical studies on portfolios of instruments, over periods of time, looking for ‘alpha’ tradeable moments

Regulatory Reporting

Process all transactions and validate regulatory compliance e.g. Best Execution Rule under Regulation NMS

9

User Database Requirements

Ease of UseTraders are Developers – Developers are Traders

AgilityRegulations constantly change

New trading opportunities arise and old ones sink as rapidly as the news hits the web

ReliabilityUsers must be shielded from Infrastructure issues


Introducing Data Fabric

11

Cloud Infrastructure

Data Fabric

Existing Applications New Applications

Existing

PrivatePublic

Cloud Era

Platform as a Service

Reduce cost,minimize disruption

Ready for new apps to deliver differentiation

Cloud Platforms for Today’s and Tomorrow’s Apps

12

Data Fabric

VMware Confidential

Database engine technology is going from one-size-fits-all to let-100-flowers-bloom

Create to common deployment and operational model for diverse database technologies

Fully leverage the underlying cloud infrastructure platform

Supplement traditional RDBMS with new elastic data technologies

13

Introducing vFabric Data Director

•Database provisioning and operations platform

•Enables enterprises to offer “database as a service” to their organizations

• Reduce “database sprawl” through automation and consistent policy enforcement

• Streamline application development with self-service database provisioning

• Increase datacenter efficiency by bringing virtual infrastructure benefits to the database tier

•Built on vSphere 5

•First database enabled is PostgreSQL database

•Sybase, Greenplum announced future support

•Other databases to follow

New

14

vFabric Data Director

Powering DBaaS for Your Cloud

VMware vSphere

ProvisioningBackup/Restore

CloneOne click

HA

ResourceMgmt

Security Mgmt

Database Templates

Monitor

DBA App Dev

IT Admin

AutomationSelf-Service

Policy BasedControl

DBA


15

vFabric Postgres

First database enabled on vFabric Data Director Based on PostgreSQL 9.0• Fully ACID compliant, ANSI SQL compliant relational database• Proven architecture known for reliability and wildly used across industries

Added vSphere-Optimization include• Elastic database memory • Self-tuning and automatic configuration• Database-aware high availability

•Live on cloudfoundry.com on 8/29•Soon to be included in Micro Cloud Foundry

16

Control Database Sprawl

• Enable IT to provide DBaaS for their users• Centralized management of 1000s of databases• Order of magnitude saving on OPEX and CAPEX• Consistent standardization and policy enforcement

After

• Thousands of under-managed and under-secured databases

• Difficult to enforce policy and compliance

Before

Corporate IT Shadow IT …App App AppAppApp App


Policy based Control

VMware vSphere

Self Service & Automation

17

Increase Operational Agility

Provision

Backup

Restore

Clone

Monitor

Before After

• Long lead time for database services• Manual provisioning, tuning, cloning• Frustrated developers and overworked DBAs

• Empower developer to self-service database needs• Database provisioning and cloning in minutes• Less time waiting, more time coding

Provision & Manage

Provision & Manage

provision orclone

Lead time of weeks

Shadow IT


VMware vSphere

18

Getting More out of Virtual Infrastructure

After

• Protect against hardware, OS, database failures• One-click Database-aware High Availability• Lowers OPEX and better service level

• Dedicated hardware with unchanging resources

• DBA tunes databases to specific setup

• No resource pooling or sharing

Before

• Database HA is expensive and complex• Many databases without HA

…XHAHA

XHAHA

XHAHA

XHAHA

XHAHA

XHAHA

…App App AppAppApp App


Policy based Control

VMware vSphere

Self Service & Automation

HAHA HAHA HAHA

19

vFabric Data Director Delivers…

Lower total cost of ownership for databases

Accelerate application development cycle

Enforce IT policy and control

20

Meet Data Challenges for the Cloud Era

Elastic scalability/Low-latency

• How do I architect my data tier for highly variable application usage? My app has 10,000 users on a normal day but 10,000,000 on Mother’s Day.

Multi-Site / Multi-Cloud

• How do I distribute data efficiently to my compute clouds? I have applications and users in multiple places that need access to the same data in real-time.

Data-Centric Computing

• How do I process these large quantities of data in an efficient manner to allow for better real-time decision-making?

21

vFabric Gemfire and SQLfire

*Fire Node

Client

*Fire Node

Client

*Fire Node

Client

WAN

Object interface: GemFireSQL interface: SQLFire

Co-locate compute with data

Memory-oriented database with elastic scalability and lightning-fast performance

22

Elastic Scalability / Low Latency

Before After

App Server

AppServer

App Server

Web Server

Web Server

Web ServerAs load increases,

virtualization allows stateless web and app tier to be rapidly scaled

But stateful Database tier must be over-provisioned in advanced – and sit idle

App Server

AppServer

App Server

Web Server

Web Server

Web ServerAs load increases,

virtualization allows stateless web and app tier to be rapidly scaled

Pushing data into memory-Reduces databases required-Allows for linear application scalability

In-Memory tier

23

Multi-Site / Multi-Cloud

Before After

Batch load to ODS

Nightly replication

System of record

WAN

GemFire Node

GemFire Node

WAN

Object interface: GemFireSQL interface: SQLFire

Real-time

24

Look Ahead

Data Director

Cloud Infrastructure

• Address the needs of today’s problems while providing path to tomorrow’s

• Extend support to traditional and new databases

• Fully leverage virtual infrastructure benefits

• Integrate with Cloud Foundry


SQLFirevPostgres Add. DB Add. DB … …

Cloud Foundry

Public Cloud Private Cloud Hybrid Cloud

data fabric and vmware

Technology