itzik reich-emc world 2015-best practices for running virtualized workloads on emc xremio
TRANSCRIPT
1© Copyright 2015 EMC Corporation. All rights reserved. 1© Copyright 2015 EMC Corporation. All rights reserved.
2© Copyright 2015 EMC Corporation. All rights reserved.
BEST PRACTICES FOR RUNNING
VIRTUALIZED WORKLOADS ON AN ALL
FLASH ARRAY ITZIK REICH, FIELD CTO, XTREMIO
SHANE VAN BENTUM, OPERATIONS MANAGER, VMware
2© Copyright 2015 EMC Corporation. All rights reserved.
3© Copyright 2015 EMC Corporation. All rights reserved.
XtremIO: Leading By All Measures
1,400customers
451 GROUPEMC takes the lead in strategic AFA technology
GARTNERMagic Quadrant for Solid-State Arrays
#1
IDCWorldwide All-Flash Array Revenue by Vendor, 1H14
40% OF TOP 100 & top 200
own XtremIO
#1
4© Copyright 2015 EMC Corporation. All rights reserved.
• Scale-out architecture
• Metadata management
• Data Services & Management
• Space reclamation in VM workload
• Virtualization efficiencies driven by AFA
BEST PRACTICES - SUMMARY
5© Copyright 2015 EMC Corporation. All rights reserved.
Go Fast(maybe solve economics)
WHAT PROBLEM ARE YOU SOLVING?
= +
Get SmarterUse Flash
6© Copyright 2015 EMC Corporation. All rights reserved.
Thousands of VMs = I/O blender
Provisioning & Cloning new VMs
VMotionOperations
A DAY IN THE LIFE OF A VIRTUAL DATA CENTER
7© Copyright 2015 EMC Corporation. All rights reserved.
LET ME TAKE YOU A FEW YEARS BACK
8© Copyright 2015 EMC Corporation. All rights reserved.
“EVERYTHING SHOULD BE MADE AS SIMPLE AS POSSIBLE BUT NOT
”SIMPLER
9© Copyright 2015 EMC Corporation. All rights reserved.
THE EVOLUTION OF “FLASH” ARRAYS
Performance• Dual Controller• Single Workloads• No Data Services
• High TCO• High Performance
Gen 2 - 2008
• (Sometime) Data Services• Dual Controller• Single Workloads (VDI)• Post-Process Data Services
• Lower TCO• Lower Performance
Gen 3 - 2011
• Scale Out Architecture
• Mixed Workloads
• In-Line All the Time Data
Services - Guaranteed
• Lower TCO
• High Performance
Gen 4 - 2013
Gen 1
Fla
sh S
yste
ms
Hybrid A
rrays
World of Compromise
No Compromise
10© Copyright 2015 EMC Corporation. All rights reserved.
A SIMPLER WAY TO LOOK AT SCALE UP VS
SCALE OUT
11© Copyright 2015 EMC Corporation. All rights reserved.
WHY ARE YOU BUYING THE LATEST
What’s wrong with a year old architecture, it can still run your email app, right?
12© Copyright 2015 EMC Corporation. All rights reserved. 12© Copyright 2015 EMC Corporation. All rights reserved.
WHAT IS METADATA?
13© Copyright 2015 EMC Corporation. All rights reserved.
CONVENTIONAL METADATA
1GB Data Chunk
Metadata record (~30 bytes)
1PB = 1,000,000 x 1GB chunks of data
1PB = 1,000,000 x 30 byte metadata records = 30MB of metadata
1PB Array1M x 1GB data chunks30MB metadata
14© Copyright 2015 EMC Corporation. All rights reserved.
WHY GRANULAR METADATA?
• Vastly improved space allocation
• Important for inherent load balancing
• Important for data reduction effectiveness
• Critical for effective copy data management
• Why Content Based Metadata?
PROVIDES SHORTHAND FOR WHAT’S ON THE ARRAY
15© Copyright 2015 EMC Corporation. All rights reserved.
METADATA DE-STAGING
Dual Controller arrays don’t have enough memory to hold granular metadata in memory So they de-stage most
metadata to the array
AND MUST ACCESS THE ARRAY TO RETRIEVE IT AS NEEDED
METADATA
METADATA
METADATA
METADATA
16© Copyright 2015 EMC Corporation. All rights reserved.
METADATA IN A SCALE OUT ARCHITECTURE
17© Copyright 2015 EMC Corporation. All rights reserved.
XTREMIO IN-MEMORY CLONING PROVISIONING
VM Provisioning in seconds!
X-COPY / ODX COMMAND
IN-MEMORYMETADATA
DATA ON SSDBLOCK BLOCK BLOCK BLOCK
18© Copyright 2015 EMC Corporation. All rights reserved.
19© Copyright 2015 EMC Corporation. All rights reserved.
AGILEWRITEABLESNAPSHOTS
INLINEDATA AT RESTENCRYPTION
XTREMIO DATAPROTECTION
INLINEDEDUPLICATION
INLINECOMPRESSION
ALWAYS-ONTHIN
PROVISIONING
XTREMIO DATA SERVICESALWAYS-ON, INLINE, ZERO PENALTY, FREE
20© Copyright 2015 EMC Corporation. All rights reserved.
VMware’s Private CLOUD
Shane van Bentum,
Operations manager, VMware
21© Copyright 2015 EMC Corporation. All rights reserved.
VMware’s PRIVATE CLOUD
VMware’s Private Cloud
Agile Global Support Geo Management
Over 220,000 VM Units deployed globally
Dedicated global team
running with VMware IT
as a customer with a
“Cloud First” policy
Current availability
maintained at 99.9%
75+ person worldwide
team with solid
experience and part of
VMware R&D
24x7 monitoring
and global support
with VMware
certified engineers
22© Copyright 2015 EMC Corporation. All rights reserved.
Scale & Growth
LaunchedBuilt on
vCloud Suite
10,000 VM units
65,000 VM units
120k VM Units
Timeline Capacity Run Rate
150k VM Units
200k VM Units
June 2012
January 2013
END June 2014
September 2014
December 2014
23© Copyright 2015 EMC Corporation. All rights reserved.
MAJOR TENANTS/USE CASES
VMware’s Private Cloud
Agile Global Support Geo Management
Field Ops
VMware Customer
Labs, PSO, etc.
Technical
Marketing
Hands-on-Labs
For customers
Corporate IT
App teams
Moving all IT
Test/Dev
GSS – Training
Reference
Environments
and Customer
Reproduction
Management Business Unit
Functional and scale testing
of our management products
Education
Extended labs and
Self-paced training
TechOps
Aggregating smaller
cloud environments for
various R&D/product
teams for Testing
purposes
24© Copyright 2015 EMC Corporation. All rights reserved.
Private Cloud Case Study: Education Services – Instructor Lead Training
• These workloads are typically very IO
intensive in very short bursts
• Direct user interaction with the UI therefore
requires a desktop like experience.
• Virtual machines generally only have 1 week
life span
• One Template, many Clones
25© Copyright 2015 EMC Corporation. All rights reserved.
100% SLA
Direct VM Console interaction
Nested Workloads
PRIVATE CLOUD CASE STUDY: VMware HANDS ON LABS
VMs Provisioned over 4 days: 100,000+
LAB Count: 10,000+
500+ concurrent users
Short vApp life
High VM Curn rate
26© Copyright 2015 EMC Corporation. All rights reserved.
Why XtremIO
Ability to support multiple mixed workloads that have disparate storage needs on a single consolidated platform
Consolidate 700 spindle array into only 2 x-bricks by leveraging In Memory De-dupe and Compression
Increase end user adoption of Private cloud by providing consistently superior performance, highly available and reliable solution
Integrate with monitoring and management tools to simplify operations
27© Copyright 2015 EMC Corporation. All rights reserved.
Successes
VMworld 2014
• 10,000+ Labs with over 100,000
VMs created over 4 days
-A VM was created every 1.6 seconds
which equals a full complex lab every
14.8 seconds!
• Very low latency
• Efficient use of Physical storage.
-Avg overall efficiency 16:1
EDU – ILT• 100 or more classes running
per week with over 1100 students
• Lab performance has increased by 3x
• Reduced classroom preparation time
28© Copyright 2015 EMC Corporation. All rights reserved.
Future
• XtremIO has allowed us to offer high IOPS
storage tier at relatively low cost per GB
• Formalizing this storage tier and will be
offering it to our internal tenants to run IO
intense workloads outside of the use cases
previously mentioned.
29© Copyright 2015 EMC Corporation. All rights reserved.
ALL FLASH ARRAY
GOTCHAS!
30© Copyright 2015 EMC Corporation. All rights reserved.
ACHIEVING QUALITY OF SERVICE
31© Copyright 2015 EMC Corporation. All rights reserved.
SPACE RECLAMATION UNMAP
QUESTIONUpon a deletion of a VM and /
or File(s) inside a VM, you would
expect the capacity to return
back to the array, right?
YES NO
32© Copyright 2015 EMC Corporation. All rights reserved.
In-Guest
Datastore
When using Virtual
Provisioning Storage
Array, The deletion of a
VM doesn’t cause the
array to claim back the
storage.
It’s a two layer issue,
inside the guest VM and
outside the guest VM (at
the datastore level)
SPACE RECLAMATION
33© Copyright 2015 EMC Corporation. All rights reserved.
34© Copyright 2015 EMC Corporation. All rights reserved.
YOUR CHOICE
Microsoft sdelete RAXCO Virtualization
35© Copyright 2015 EMC Corporation. All rights reserved.
THE NUMBER OF VOLUMES QUESTION
36© Copyright 2015 EMC Corporation. All rights reserved.
EMC VSI Plugin
vCenter plugin that can offload much of the array day to day tasks
37© Copyright 2015 EMC Corporation. All rights reserved.
INTEGRATED MANAGEMENT CONSOLE
38© Copyright 2015 EMC Corporation. All rights reserved.
ARRAY BASED INSIGHT USING OTHER TOOLS
39© Copyright 2015 EMC Corporation. All rights reserved.
THINK DIFFERENTLY ABOUT VM REPLICATION
• Software Only - Hypervisor based replication solution
• Disaster Recovery and Operational Recovery in VM-level granularity
• Test, failover, failback and production recovery to any point-in-time per VM
• Integrated Management & Orchestration with VMware’s vCenter GUI
40© Copyright 2015 EMC Corporation. All rights reserved.
SUMMARY
VM level replication - any PIT
• Easier OR & DR
• Flexible RPO – up to Zero Data Loss (Sync)
• No Single Point of Failure
• Batch Protection & Multi-Site
Built-in Orchestration
• Automated Discovery & Provisioning
• Resilient to HW changes
• VM power-up order
• Pre/Post Prompt & External Scripts
• VMs Re-IP
41© Copyright 2015 EMC Corporation. All rights reserved.
• Scale-out architecture
• Metadata management
• Data Services & Management
• Space reclamation in VM workload
• Virtualization efficiencies driven by AFA
BEST PRACTICES - SUMMARY
43© Copyright 2015 EMC Corporation. All rights reserved.
THE NUMBER OF VOLUMES QUESTION
44© Copyright 2015 EMC Corporation. All rights reserved.
USE EZT (EAGER ZEROED THICK)
45© Copyright 2015 EMC Corporation. All rights reserved.
WHAT ABOUT REPLICATION AND VMWARE SRM
vSphere
vCenter ServerSite Recovery
ManagervCenter Server
Site RecoveryManager
vSphere
Production Site Recovery Site
46© Copyright 2015 EMC Corporation. All rights reserved.
AVOIDING THE LAST PIT ISSUE
47© Copyright 2015 EMC Corporation. All rights reserved.
SPACE RECLAMATION IN
VM WORKLOAD