ibm storage solutions for vmware environments - 2010 #vintage
TRANSCRIPT
SVC & VMware - kombinacija za
efikasno korištenje sistema podataka
Klemen Bačak
System Storage FTSS, IBM Slovenija
X
IBM Storage Infrastructure
Solutionsfor
Klemen Bačak
System Storage FTSS, IBM Slovenija
Some Words about
ESX Server Host
VMware Value Proposition
< 20%
VMware virtualization layer
Virtual Machine Virtual Machine Virtual Machine Virtual Machine
~ 80%
Resource Utilization
Cost
Internal Storage
External Storage
VMware Market Overview
VMware Operational Flexibility
X
Automated ResourceAssurance & DRS
Dynamic Balancing
Continuous Optimization
Increased Availability
Automated
Across Applications+
On Demand Capacity
Non Disruptive Scaling
Flexible, Reconfigurable
+
External Storagem a n d a t o r y
VMware Storage Architecture
NAS/NFSFibreChannel
FibreChannel
iSCSI
iSCSI
DS3300
DS5100
DS5300 DS8000
N Series
SONASDS3400 TS3100 TS3310
TS3200
TS3500
TS7530
TS7560G
Backup
IBM has simple, easy-to-use solutions that integrate with and extend all VMware advanced functions (VMotion, VM HA, DRS, Storage VMotion, & SRM).
IBM solutions for VMware include iSCSI, FC, and NFS. Every protocol VMware needs.
Proven scaling, proven replication, proven availability, and proven Tier 1 application solutions
Unique capabilities in VMware environments
Capacity Optimization
/ VMFS / VM_1 / VM_1.vmdk . . . . . . . . . . . . . 100GB/ VM_2 / VM_2.vmdk . . . . . . . . . . . . . 200GB/ VM_3 / VM_3.vmdk . . . . . . . . . . . . . 100GB/ VM_4 / VM_4.vmdk . . . . . . . . . . . . . 300GB
Storage assigned to Virtual Machine is allocated on underlying storage subsystem (when using default allocation policy)
Expansion of .vmdk file requires Virtual Machine Shutdown
Data of different Virtual Machines is very similar
How storage capacity is allocated to Virtual Machines with the default allocation policy (zeroedthick):
VMware virtualization layer
Virtual Machine 1 Virtual Machine 2 Virtual Machine 3 Virtual Machine 4
ESX Server Host
IBM Systems Storage
Data Protection
Maintain access to information throughout its useful life
Service Delivery
Understand what you have, improve service, beat expectations
Storage Efficiency
Reduce cost, improve performance, increase flexibility
Critical Success FactorsManaging Information Growth without Complexity
Virtualized Storage
Tiered Storage
ConsolidatedStorage
Storage EfficiencyGetting the most from your Storage Resources
Efficiently use solid state disk to Increase performance up to 300% on critical apps.
Reduce costs by migrating less critical data to less expensive media.
Build out an automated tiered storage architecture to maximize performance and reduce operating expenses
Consolidate storage to reduce administrative costs and improve cycle time
Increase utilization of existing storage by up to 30%.
Reduce TCO up to 66% by deploying automated, virtualized storage.
Quickly provision storage, support virtualized servers and increase flexibility
Scale out storage to manage billions of files from a single, consolidated system.
Scale up storage with systems that can scale to store petabytes of structured data.
Data ProtectionMeeting Recovery Objectives Reliably & Efficiently
Retention and Compliance
Backup and Recovery
Continuous Operations
Significantly reduce the risk of extended downtime with multi-site mirroring
Shift operations to alternate facilities in seconds with automated failover
Provide continuous access to information from any location
Reduce the risk of data loss by automating classification, retention policy management, and migration
Reduce compliance costs and mitigate risks by indexing information efficiently and securely.
Easily migrate data to new media to ensure long term accessibility
Improve backup performance and shrink backup windows.
Improve backup and restore performance and reduce the complexity of recovery procedures
Apply data deduplication and virtual tape to lower backup storage costs by up to 70%
Improve utilization of existing disk systems by up to 30%
Increase performance up to 300%
Reduce physical storage requirements up to 50%
IBM Has Helped 1000s of Clients Solve Storage IssuesControl Costs, Improve Cycle Times, and Mitigate Risks
XIV
Solid State Disk
DS8700 and Easy Tier
Scale Out NAS
SAN Volume Controller
Storage Optimization Services
ProtecTIER
MetroMirror, Global Mirror
Information Archive
LTO-5 and Enterprise tape
Tivoli Storage Manager
Data Protection Service DeliveryStorage Efficiency
Maintain or improve performance levels while information grows
Reduce backup windows
Failover to remote site in seconds
Reduce compliance audit risk
Protect data for decades
Tivoli Storage Productivity Center
IBM Cloud Solutions
XIV self-managed storage
Tivoli Storage Manager
IBM Systems Director
IBM System Storage – Offering Matrix
Storage Solutions
IBM Information Archive
IBM Scale Out Network Attached Storage (SONAS)
Grid Access Manager, GMAS
Smart Business Storage Cloud (SBSC)
Storage Encryption Solutions (TKLM)
Comprehensive Data Protection Solution (CDPS)
IBM Virtualized Disk Solution (VDS)
Storage Software
SAN Volume Controller
Tivoli Storage Productivity Center
IBM Tivoli Storage FlashCopy Manager
Disk Systems
XIV
DS8000
DS5000
DS3000
Tape Systems
Tape Virtualization
Tape Libraries
LTO Tape Drives
Enterprise Tape Drives
Network Attached Storage (NAS)
N series
Deduplication
ProtecTIER Deduplication Appliances
ProtecTIER Deduplication Gateway
IBM Disk Storage Portfolio
Over 50 Years of Disk Innovation
DS3000
Entry Level
DS8700
Midrange Disk
Family
Enterprise Disk
Enterprise Storage Continuum
DS5000 XIV
High-end Distributed Systems Disk
IBM System Storage DS family and XIV
IBM XIV Storage System hardware
From 6 to 15 modules with up to 180 1TB or 2TB drives
Scale performance
Scale capacity
Scale connectivity
Up to 24 FC and 6 iSCSI host connections
Exceptional Functionality Built-in to Standard System Software
Snapshots (Read and Write – Clone, Always Differential)
Synchronous mirroring and Asynchronous
Thin provisioning with space reclamation
Data migration
Self-healing and Self-Tuning after hardware changes
Non-disruptive code load
Access Control
Event management, Statistics and Performance Management
Amazingly simple and intuitive GUI
IBM XIV is “Next Generation”
Storage Reinvented
What is XIV storage?
IBM Enterprise Grid Storage Solution: 27-161TB USABLEUSABLE Capacity Capacity
– Higher effective utilization through virtualization, thin provisioning, no raid/spare configuration
Cost Effective | Unmatched TCO
– Built from industry standard hardware components, leveraging larger capacity drives
Ground-breaking Innovations in Ease of Use, Flexibility and Manageability
Innovative, All Inclusive Design– No Additional Software License Fees
– Functionally Integrated Software Design
Drive out Drive out cost while cost while exceeding exceeding
existing existing SLAs.SLAs.
AVAILABILITY
Multiple levels of redundancy
Autonomous self-healing
Ultra-fast fault recovery
AVAILABILITY
Multiple levels of redundancy
Autonomous self-healing
Ultra-fast fault recovery
PERFORMANCE
Self-tuning
Automatic load balancing eliminates bottlenecks
Performance scales with capacity
PERFORMANCE
Self-tuning
Automatic load balancing eliminates bottlenecks
Performance scales with capacity
EASE OF USE
Provision new storage in <1 minute
Dynamically resize/adapt
Easily managed by junior staff
EASE OF USE
Provision new storage in <1 minute
Dynamically resize/adapt
Easily managed by junior staff
Simplicity, flexibility, economy
IBM System Storage Easy Tier
Two data relocation functions that enable smart data placement to optimize SSD deployments with minimal costs
Automatically migrate sub-volume data to right tier
Manually migrate full volumes non-disruptively
New Storage Tier Advisor tool provides guidance for existing client workloads
DS8700
DS8700
IBM N-Series NAS Product Line
IBM® System Storage™ N series Hardware
Delivering value across the datacenter…
N3300
68TB
N3600
104TB
Entry level pricing, Enterprise Class Performance
Centralize Storage in Remote & Branch Offices
Easy-to-Use Back-up and Restore Processes
N7900
1,176TB
Highly-scalable storage systems designed to meet the needs of large enterprise data centers.
Lower acquisition and administrative costs than traditional large-scale enterprise storage systems
Seamless scalability, mission critical availability, and superior performance for both SAN and NAS operating environments
Excellent performance, flexibility, and scalability all at a proven lower overall TCO
N series Unified Storage Architecture provides unmatched simplicity
N6040
420TB
Highly efficient capacity utilization
Comprehensive set of storage resiliency features including RAID 6 (RAID-DP™) N6060
672TB
N6070
840TB
N series Gateways
Leverage existing Storage Assets while introducing N series Software. Gateway functionality is achieved by adding a gateway feature code to the N6000 or N7000 appliance
N3400
136TB
NEW!NEW!
Optimizing Disk Capacity with Deduplication
IBM N Series - Advanced Single Instance Storage
By design VMware environments are very redundant
-Clones are 100% identical-Including OS and
applications-Clones consume storage
equal to size of template
Dedupe removes redundant data
- Reduce OS and applications to a single copy
- VMs only consume storage for their unique data
- Supports FCP, iSCSI, & NFS- 50% – 70% storage
reduction!
N Series
N Series Filer or Gateway
Optimizing Disk Capacity with Thin Provisioning
SAN Volume Controller Cluster
5 TB
2 TB
2 TB
2 TB
2 TB
Thin provisioning when using VC and default allocation policy for VM allocation
Thin provisioning overhead offloaded to storage subsystem
Minimize need for disruptive VM Disk Resizing
Significantly increase storage capacity utilization
N Series Gateway
SVC Space efficient VDISKs
N Series FlexVol
XIV
IBM SAN Volume Controller
What is Virtualization?
Logical representation of resources not constrained by physical limitations
– Create many virtual resources within single physical device
– Reach beyond the box – see and manage many virtual resources as one
– Dynamically change and adjust across the infrastructureIBM Virtualization
A comprehensive platform tohelp virtualize the infrastructure
Storage Virtualization is . . .
Technology that makes one set of resources look and feel like another set of resources, preferably with more desirable characteristics…
A logical representation of resources not constrained by physical limitations
Hides some of the complexity
Adds or integrates new function with existing services
Can be nested or applied to multiple layers of a system
Virtualization
Logical Representation
Physical Resources
Combine the capacity from multiple arrays into a single pool
of storage
Apply common copy services
across the storage pool
Manage the storage pool from a central point
Make changes to the storage without disrupting host
applications
Virtual
Disk
Virtual
Disk
Virtual
Disk
Virtual
Disk
SAN
SAN Volume Controller
Advanced Copy Services
Storage Pool
HP
EMCDS4000
DS8000
HDS
SAN Volume Controller (SVC)
SVC: Innovative Scale-Out SSD Implementation
Add SSDs to SVC engines for more capacitySSDs may be added without disruption to engines
Add SVC engines for more capacity and throughputAdditional engines provide more processing power, more bandwidth, more SAN attachments
SVC designed to deliver maximum I/O capability of SSDs
Up to 50,000 read IOPS per SSD
Up to 200,000 read IOPS per SVC I/O Group
Up to 800,000 read IOPS per SVC cluster
Add SSDs to scale capacity
Add SVC I/O Groups to scale throughput and add capacity
Non-disruptive Data Migration with SVC
Traditional SAN
1. Stop applications
2. Move data
3. Re-establish host connections
4. Restart applications
SAN Volume Controller
1. Move data
Host systems and applications are not affected.
SANSAN
Volume Controller
SAN VirtualDisk
High Availability with IBM Storage
SANVolume Controller
SVC Cluster
SVC stores two copies of a virtual disk, usually on separate disk systems
-SVC maintains both copies in sync and writes to both copies
If disk supporting one copy fails, SVC provides continuous data access by using other copy
-Copies are automatically resynchronized after repair
Intended to protect critical data against failure of a disk system or disk array
-A local high availability function, not a disaster recovery function
Copies can be split-Either copy can continue as production
copy
Either or both copies may be space-efficient
SVC VDISK Mirroring
VMFSSVC
VDISK
…High Availability
VDISK Mirroring…and straightforward Disaster Recovery
SANVolume Controller
VMFS
SVC Cluster
Cost effective multi-site high availability
Separate redundant storage controllers across distance
Separate redundant ESX servers across distance
Shared storage access across sites
Rapid failover between sites with no reconfiguration required
N Series Metrocluster Solution
VMFS
LUN/File Share remainsavailable even withsite disasters
manual intervention required in case of site failure
no quorum, no third site
use of ISLs possible
dedicated SAN infrastructure required when using filers instead of GatewaysN Series Metrocluster
Backup Concepts
VMware Backup Methods
Datastore
/VMFS/VM_1
/VMFS/VM_2
/VMFS/VM_3
VMwareService Console
san
ESX Server Host
TSMClie
nt
TSMClie
nt
TSMClie
nt
TSM Server
Install Backup Client into each Guest OS
Backup load on ESX Server impacts ESX Server significantly since it is cumulative
– 5% CPU load is OK… until you have 20 virtual machines backing up at once
Backup load is very difficult to virtualize
– Intense Disk I/O coupled with intense Network I/O
No LAN free Backup supported
TSM Client has to be installed and maintained on each VM
File level Restore available, VM Restore difficult
VMware Backup Methods
Datastore
/VMFS/VM_1
/VMFS/VM_2
/VMFS/VM_3
VMwareService Console
san
ESX Server Host
TSMClie
nt
TSM Server
Install Backup Client into the Service Console
Backup load on ESX Server impacts ESX Server significantly since it is cumulative
– 5% CPU load is OK… until you have 20 virtual machines backing up at once
Backup load is very difficult to virtualize
– Intense Disk I/O coupled with intense Network I/O
No LAN free Backup supported
ESX Console has limited resources, can starve guests
File level Restore difficult, VM Restore straightforward
Not recommended
VMware Consolidated Backup - VCB
VMwareService Console
san
ESX Server Host
Integrated supported product-based solution to protect VMware with TSM
FC, iSCSI, NFS
TSM ServerTSM Server
VCB Proxy Server
VCBFramework
TSMClie
nt
VMware SnapshotDatastore
/VMFS/VM_1
/VMFS/VM_2
/VMFS/VM_3
Fast online (hot) backup into TSM
‘Near Zero Impact Backup’ on ESX Servers by using proxy backup server
Coordinated backup of multiple virtual machines into TSM
User-transparent file-level restore from TSM Client from within virtual machine
Disaster Recovery from TSM via Full-VM restore
VM Level Backup for all OS
File Level Backup for Windows
IBM Tape Storage Portfolio
IBM System Storage TS family
Entry Level Midrange Enterprise Class
TS1030 (LTO-3)TS1040 (LTO-4)TS1050 (LTO-5)
TS1130 (3592)
3494
TS3200
TS3100TS3310
TS7530(distributed)
TS7740(mainframe)
Tap
e dr
ives
Tap
e au
tom
atio
nT
ape
virt
ualiz
atio
n
TS3400
TS3500
TS2230/40/50TS2340/50
TS2900LTO-3 & LTO-4
TS7650 andTS7650G
(distributed)
TS7720
Pre-configured for rapid deployment into existing backup environments
Extremely powerful solutions, featuring:– IBM ProtecTIER software with patented
HyperFactor™ deduplication technology
– IBM System x Server – multi-core server for enterprise-level performance
– IBM Storage Controller with Fibre Channel drives - Proven reliability and performance
Complete solution that includes rack, cables, switches, and everything that is needed
IBM TS7650 ProtecTIER® Dedupe Appliance
Powerful and Flexible solution, featuring:– IBM ProtecTIER software with patented
HyperFactor™ deduplication technology
– IBM System x Server – multi-core server for enterprise-level performance
Supports both IBM & Non-IBM disk– IBM DS4000, DS5000, DS8000 and XIV
– HDS, EMC and others
And delivers:– Up to 500 MB/sec or more performance
– Up to 25 times or more data reduction
– Scalable to 1PB physical capacity
– Enterprise-class data integrity
TS7650G ProtecTIER Deduplication Gateway
TS7650G ProtecTIER Dedupe Gateway
Our most Powerful and Flexible solution:– IBM ProtecTIER software with patented
HyperFactor™ deduplication technology
– 2 IBM System x Servers – multi-core servers for maximum performance & availability
Supports both IBM & Non-IBM disk– IBM DS4000, DS5000, DS8000 and XIV
– HDS, EMC and others
And delivers:– Up to 1000 MB/sec or more performance
– Active-active cluster technology
– Two nodes working together as one repository
– Easily manageable yet highly scalable
TS7650G ProtecTIER Deduplication Cluster
TS7650G ProtecTIER Dedupe Cluster
Deduplication with IBM 7650G - ProtecTIER
FC Switch TS7650G
Backup Servers
Disk Arrays
New Data Stream
Repository
MemoryResident
Index
HyperFactor™ De-duplication Technology Pattern recognition algorithm (not hash) designed to reduce storage needs by up to a factor of 25, radically reducing costs and enterprise class data integrity
Scalable to 1 PB of physical storage—over 25 PB of user data
Clustering Allows two nodes to be clustered within a single system for higher performance and availability
Sustained in-line throughput rates up to 900 MB/s per clustered ProtecTIER system
Involves no client or host agents Improved backup success rates allowing more time for critical applications
VMware Consolidated Backup - VCB
VMwareService Console
san
ESX Server Host
enhanced with Enterprise Class Deduplication
VCB Proxy Server
VCBFramework
BUClie
nt
VMware Snapshot
Datastore
/VMFS/VM_1
/VMFS/VM_2
/VMFS/VM_3
Backup Server
TS7650GProtecTIER
ProtecTIERRepository
Reduce physical
capacity by factor
25
N Series Snapmanager for Virtual Infrastructure
N Series
Primary System
N Series
Secondary System
Snapmirror
Remote Replication
Snapmanager forVirtual Infrastructure
Backup individual virtual machines or complete NFS and VMFS datastores.
Set up schedules and retention policies for those backups.
Replicate backup data to remote locations with Snapmirror
Recover virtual machines and complete datastores in the same location or to a new location.
Integrate tightly in VMware Virtual Infrastructure
Flush VMOS IOs
Backup VM3
Create N Series
Snapshot
Summing Up…
Storage Solutions which can make a difference
+
IBM offers a complete and flexible portfolio of Storage Solutions for VMware covering all flavors of customer requirements
Our VMware Storage Solutions effectively address our customer’s requirements with their VMware infrastructure
Some of those solutions are UNMATCHED and UNIQUE in the entire storage industry
Pitanja ?
H V A L A !