vmworld 2014: databases in a virtualized world

15
1 © Violin Memory, Inc. 2014 CONFIDENTIAL CONFIDENTIAL © Violin Memory, Inc. 2014 Databases in the Virtualized World By Matt Henderson Director, Microsoft Solutions

Upload: violin-memory

Post on 30-Jun-2015

91 views

Category:

Technology


3 download

DESCRIPTION

Application sprawl, server sprawl and a world of different databases presents a challenge to any modern database administrator. In this presentation you will learn how a modern architecture model can help you improve performance and cut costs.

TRANSCRIPT

Page 1: VMworld 2014:  Databases in a Virtualized World

1© Violin Memory, Inc. 2014 CONFIDENTIAL CONFIDENTIAL © Violin Memory, Inc. 2014

Databases in the Virtualized World

By Matt HendersonDirector, Microsoft Solutions

Page 2: VMworld 2014:  Databases in a Virtualized World

2© Violin Memory, Inc. 2014 CONFIDENTIAL

Application Sprawl

Application Sprawl• CRM• Billing• ERP• Sales• Engineering• Monitoring• Manufacturing

Real World• 3rd Party apps• Old versions

Page 3: VMworld 2014:  Databases in a Virtualized World

3© Violin Memory, Inc. 2014 CONFIDENTIAL

Server Sprawl

Page 4: VMworld 2014:  Databases in a Virtualized World

4© Violin Memory, Inc. 2014 CONFIDENTIAL

Databases: 31 flavors

• Databases• MySQL• Oracle• MSFT SQL• Hadoop

• Workloads• BI / DW• OLTP

• Resources• RAM• CPU• Storage

Page 5: VMworld 2014:  Databases in a Virtualized World

5© Violin Memory, Inc. 2014 CONFIDENTIAL

Dynamic & Shifting Workloads

Unique and changing• Per Server• Per Application• Per Day/Hour• Week day versus

weekend• Adhoc reporting• Administration

Designed for Peak• Not optimal

Page 6: VMworld 2014:  Databases in a Virtualized World

6© Violin Memory, Inc. 2014 CONFIDENTIAL

Databases

Persistent data storage

Data access engine

Application logic processor

Page 7: VMworld 2014:  Databases in a Virtualized World

7© Violin Memory, Inc. 2014 CONFIDENTIAL

Many Databases – Many Data Sets

• Not all data can fit in memory

• Tiering works only if patterns well defined

• Caching is for reads• Access patterns change• Dedicating resources is

inefficient & wasteful

Page 8: VMworld 2014:  Databases in a Virtualized World

8© Violin Memory, Inc. 2014 CONFIDENTIAL

RAM versus Storage

Architectural ConceptsRAM based:

• Invest in memory tier. Dedicate resources to applications. Over allocate to ensure consistent performance. “Distributed” model as performance is reliant on local resources.

Storage based• Invest in high performance storage. Reduce memory to

minimal amounts. Data needed will almost always come from storage. “Central” model as performance is reliant on shared storage.

Page 9: VMworld 2014:  Databases in a Virtualized World

9© Violin Memory, Inc. 2014 CONFIDENTIAL

RAM versus Storage

Memory Challenges• Hard cap in OS (~2TB)• Size limitations per server• More expensive $ per GB• Disruptive to upgrade• Not shareable (dedicated)

Database Buffer / Virtualization• Buffers don’t deallocate• Buffers don’t dedup• Inefficient to virtualize

Storage Challenges• Disk massively slower

than memory • Complex to setup• Needs frequent tuning• Over provisioning is key

New Technology Needed• Bridge gap in speed• Easier to manage

Page 10: VMworld 2014:  Databases in a Virtualized World

10© Violin Memory, Inc. 2014 CONFIDENTIAL

Visualizing I/O Wait

• Applications wait for I/O to return = I/O Wait

• Time slices missed while waiting are lost

• Faster CPUs and more cores only increase lost time slices between I/O returns

• Solve actual bottleneck, don’t shoot from the hip

→ Your applications now spend more time doingand less time waiting

CPU Cycle with Disk

I/O Wait I/O Wait

20%Work

80%Wait

CPU Cycle with Violin

5%Wait

95%Work

Page 11: VMworld 2014:  Databases in a Virtualized World

11© Violin Memory, Inc. 2014 CONFIDENTIAL

Optimizing Architecture – Performance & Cost

• CPU’s are faster than hard drives

• Adding cores does not correct issue

• 8 cores @ 10% = 1 core @ 80%

• 40% utilization = 60% over paying

Page 12: VMworld 2014:  Databases in a Virtualized World

12© Violin Memory, Inc. 2014 CONFIDENTIAL

Visualizing latency - I/O Wait Infrastructure

I/O W

ait

HDD StorageMany milli-second

latency

PowerEdge M1000e

9 101 2

11 123 4

13 145 6

15 167 8

0

1

00

1

0 0

1

00

1

0 0

1

00

1

0 0

1

00

1

0

0

1

00

1

0 0

1

00

1

0 0

1

00

1

0 0

1

00

1

0

PowerEdge M1000e

9 101 2

11 123 4

13 145 6

15 167 8

0

1

00

1

0 0

1

00

1

0 0

1

00

1

0 0

1

00

1

0

0

1

00

1

0 0

1

00

1

0 0

1

00

1

0 0

1

00

1

0

I/O W

ait

SSD StorageFew milli-second

latency

SSD

SSD

SSD….

Or

SSD

SSD

SSD….C

on

tro

llers

Cac

he

Flash StorageMicro-second latency

Fully optimal system

PowerEdge M1000e

9 101 2

11 123 4

13 145 6

15 167 8

0

1

00

1

0 0

1

00

1

0 0

1

00

1

0 0

1

00

1

0

0

1

00

1

0 0

1

00

1

0 0

1

00

1

0 0

1

00

1

0

Page 13: VMworld 2014:  Databases in a Virtualized World

13© Violin Memory, Inc. 2014 CONFIDENTIAL

Legacy Architecture Model

• Large batches to SSDs• SSDs in disk chassis = bottlenecks• Stranded space and speed

64k

64k

64k

Page 14: VMworld 2014:  Databases in a Virtualized World

14© Violin Memory, Inc. 2014 CONFIDENTIAL

Modern Architecture Model

• Small batches to custom cards• Data spread evenly

• 100% usable space• 100% performance on every I/O

4k 4k 4k 4k

4k 4k 4k 4k

4k 4k 4k 4k

4k 4k 4k 4k

64k 4k data+

1k parity

5kD

ata

Dat

aD

ata

Dat

aP

arit

y

1k

1k

1k

1k

1k

++

++

=5

k

VIM

MV

IMM

VIM

MV

IMM

VIM

M

flash flash flash flash flash flash flash flash

controller

1k

bitsbits

VIMM

Parallel and distributedfor lowest latency

Page 15: VMworld 2014:  Databases in a Virtualized World

15© Violin Memory, Inc. 2014 CONFIDENTIAL

RAM versus Storage

Take Aways:

• Architectures should be optimal across all tiers• I/O latency is currency of performance• Centralized performance, through fast storage =

always works• Licensing is the highest expense, optimize for

CPU usage• Violin performance optimizes IT spend.