managing the information explosion with open, software ... · managing the information explosion...
TRANSCRIPT
MANAGING THE INFORMATION EXPLOSIONWITH OPEN, SOFTWARE-DEFINED STORAGE
Gerald SternaglBU Manager Storage, EMEAEmail: [email protected], 6th 2013
Session title2RHS: Managing the Information Explosion
AGENDA
● Changes in the storage market● Open, Software-defined● Red Hat Storage Overview● Use Cases● TCO & Customer example● Gluster Community● Q&A
Session title3RHS: Managing the Information Explosion
THE INFORMATION EXPLOSION
Main growth drivers:Virtualisation, Cloud, Mobile Computing and Big Data
Source: IDC's Digital Universe Study, Dec 2012
Session title4RHS: Managing the Information Explosion
CORNERSTONE OF THE NEW SOFTWARE DEFINED DATACENTER
COMPUTECOMPUTE
SOFTWARE- DEFINED / BASED COMPUTE
(Virtualization)
SOFTWARE- DEFINED / BASED COMPUTE
(Virtualization)
STORAGESTORAGE
SOFTWARE-DEFINED / BASED STORAGE
SOFTWARE-DEFINED / BASED STORAGE
NETWORKINGNETWORKING
SOFTWARE-DEFINED / BASED NETWORKING
SOFTWARE-DEFINED / BASED NETWORKING
ENVIRONMENTALENVIRONMENTAL
SOFTWARE-DEFINED / BASED FACILITIES
SOFTWARE-DEFINED / BASED FACILITIES
DATA CENTER FABRIC DATA CENTER FABRIC
DATACENTER EVOLUTION
Session title5RHS: Managing the Information Explosion
ENTERPRISEMOBILITY
INCREASE DATA, APPLICATION AND INFRASTRUCTURE AGILITY
CLOUD APPLICATIONS
CONVERGED COMPUTE AND STORAGE
FILE SERVICES OPEN OBJECT APIs
OPEN, SOFTWARE-DEFINED STORAGE PLATFORM
SCALE-OUT STORAGE ARCHITECTURE
PHYSICAL
Standard x86 systemsScale-out NAS solutions
VIRTUAL
Include idle or legacy resources
CLOUD
EBSEBS
BIG DATA WORKLOADSENTERPRISE APPLICATIONS
DATA SERVICES
PERSISTENT DATA STORES
Session title6RHS: Managing the Information Explosion
RED HAT STORAGEFOR ON-PREMISE
SERVER (CPU/MEM)
1TB
• Global namespace
• Aggregates CPU, memory,network capacity.
• Deploys on Red Hat-supported servers and underlying storage: DAS, JBOD.
• Scale out linearly.
• Scale out performance and capacity as needed.
• Replicate synchronouslyand asynchronously.
RED HAT STORAGE DEPLOYMENT ON-PREMISE
RED HAT STORAGEFOR ON-PREMISE
1TB
Scale out performance, capacity, and availability
Sca
le u
p c
apac
ity
SINGLE GLOBAL NAMESPACE
...
...SERVER(CPU/MEM)
............ ... ...
Session title7RHS: Managing the Information Explosion
RED HAT STORAGE SERVER FOR PUBLIC CLOUD
RED HAT STORAGEFOR PUBLIC CLOUD
EBS
Scale out performance, capacity, and availability
Sca
le u
p c
apac
ity
• GlusterFS Amazon Machine Images (AMIs)
• The only way to achieve high availability of Elastic Block Storage (EBS)
• Multiple EBS devices pooled
• POSIX compatible (no application to rewrite required to run on Amazon EC2)
• Scale out capacity and performance as needed
SINGLE GLOBAL NAMESPACE
RED HAT STORAGE DEPLOYMENT ON AMAZON CLOUD
...
...EC2
............ ... ...
Now available as AWS test-driveNow available as AWS test-drive
Session title8RHS: Managing the Information Explosion
CIFS HADOOP ENABLEMENT
REPLICATION
MULTI-SITE DR
MULTI-TENANT:NAMESPACE AND ENCRYPT
MULTI-TENANT:QoS (CGROUPS)
VOLUMESNAPSHOT
CLIENT/ PRESENTATION
BACKEND/ PERSIST
SAMBA USER APP QEMU
SWIFT
MANAGE
FUSE NFS
TRANSLATORS
TRANSLATORS
GLUSTERFS FRAMEWORK
GLUSTERFS
NETWORK STACK
NETWORK DEVICE PLATFORM BLOCK DEVICE
HARDWARE ENABLEMENT
LOCAL FILESYSTEM
LOGICAL VOLUME MANAGEMENT
XFS OTHER
RED HAT ENTERPRISE LINUX
PL
AT
FO
RM
MA
NA
GE
AB
ILIT
Y
RED HAT STORAGE TECHNOLOGY STACK
Session title9RHS: Managing the Information Explosion
RED HAT STORAGE SCALABILITY
2 4 6 8 10 12 14 160
2000
4000
6000
8000
10000
12000
14000
Sequential Read Transfer Rates
glusterfs,repl=1 glusterfs,repl=2
Gluster-NFS,repl=1 Gluster-NFS,repl=2
Servers
MB/s
2 4 6 8 10 12 14 160
2000
4000
6000
8000
10000
12000
14000
Sequential Write Transfer Rates
glusterfs,repl=1 glusterfs,repl=2
Gluster-NFS,repl=1 Gluster-NFS,repl=2
Servers
MB/s
Session title10RHS: Managing the Information Explosion
DESIGNED FOR MANAGING UNSTRUCTURED DATA
SUPPORTING A WIDE RANGE OF ENTERPRISE AND EMERGING WORKLOADS
Session title11RHS: Managing the Information Explosion
RED HAT STORAGE FOR OPENSTACK
Session title12RHS: Managing the Information Explosion
ENSURE GLOBAL DATA PROTECTION AND AVAILABILITYTRANSPARENTLY DISTRIBUTE DATA GLOBALY
SITE A SITE B
REMOTE SITE / DR
Session title13RHS: Managing the Information Explosion
BRING APPLICATIONS CLOSER TO THE DATA
CONVERGING COMPUTE AND STORAGE
INCREASE AGILITY
REDUCE LATENCY
PROCESS DATA LOCALLY
REDUCE COSTS
STORAGE RESIDENT APPLICATIONS
Session title14RHS: Managing the Information Explosion
HIGHLY AVAILABLE CLOUD STORAGE FOR AMAZON EC2LEVERAGE THE ELASTICITY OF THE CLOUD WITHOUT RE-WRITING YOUR APPLICATIONS
US East (N. Virginia)US East (N. Virginia) Ireland (Cork)
CREATING HIGHLY AVAILABLE, SCALEABLE EBS STORAGE POOLS - ACROSS ZONES
Session title15RHS: Managing the Information Explosion
DELIVER COST EFFECTIVE ELASTIC CAPACITY AND PERFORMANCE53% - 78% REDUCTION IN COSTS
SOURCE: IDC REPORT – THE ECONOMICS OF SOFTWARE BASED STORAGE
YEAR
Session title16RHS: Managing the Information Explosion
“Red Hat worked with us the entire way as we designed and built our architectures, helping with best practices, design considerations and layout, performance testing, and migration.”
MOHIT ANCHLIAARCHITECT, INTUIT TURBO TAX
PROBLEM NEEDED A FAST, RELIABLE, AND COST-EFFECTIVE STORAGE SOLUTION
TO MEET GROWING SAAS LINE OF BUSINESS
TAX RETURNS AND OTHER DATA WERE BEING STORED AS BLOBS IN AN EXPENSIVE ORACLE DB
SOLUTION RED HAT STORAGE SERVER 2.O FOR ON-PREMISE OBJECT STORAGE
HP DL2000s AND APACHE CASSANDRA
BENEFITS SCALEABLE ON-DEMAND STORAGE FOR UNSTRAUCTURED DATA
COST EFFECTIVE SOLUTION THAT LEVERAGES COMMODITY HARDWARE
MEET GROWING CAPACITY AND PEAK PERFORMACE NEEDS
ACHIEVE MULTI-SITE DISASTER RECOVERY
MANAGING SPRAWLING UNSTRUCTURED FINANCIAL DATA
Session title17RHS: Managing the Information Explosion
WHAT DO THE ANALYSTS SAY?
Session title18RHS: Managing the Information Explosion
DELIVERING AGILITY AND COST ADVANTAGE
FOUNDATION FOR HYBRID CLOUD AND BIG DATA
DEPLOY DATA ANYWHERE PHYSICAL, VIRTUAL CLOUD
ELASTIC CAPACITY AND PERFORMACE
MODERN, SECURE FILE AND OBJECT STORAGE
ENSURE DATA PROTECTION AND AVAILABILITY
CONVERGE COMPUTE AND STORAGE
RED HAT STORAGESERVER
DELIVERING THE NEXT GENERATION OF OPEN SOFTWARE-DEFINED STORAGE TODAY
DESIGNED FOR TODAYS IT & DATA ECONOMICS
MANAGING UNSTRUCTUREDDATA AT SCALE
Session title19RHS: Managing the Information Explosion
COMMUNITY INNOVATION
SNAPSHOTTING
CHANGE DETECTION
COMPRESSION
pNFS AND NFSv4 SUPPORT
GLUSTER.ORG COMMUNITY FORGE ENHANCEMENTS AND PROJECTS
FILE VERSIONING
3-WAY REPLICATION
ERASURE CODING
SMB 3.0 SUPPORT
TRANSLATORS EXTENSION FOR PYTHON
PUPPET MANAGEMENTMODULE
GTOP - MONITORING
GLUSTER PROFILING
NDMP SERVER
SELINUX SUPPORT
PMUX – LIGHTWEIGHT MAP REDUCE
MULTI-MASTER GEO-REPLICATION
20
Session title
Non confidential 2121 RHS: Managing the Information Explosion
SKILL UP AND CERTIFY ON RED HAT STORAGE SERVER ADMINISTRATION (RH236)
New 2-Day Emerging Technology Workshop to learn how to install, configure, and maintain a cluster of Red Hat Storage servers.
Prepares you for the Storage Admin exam (EX236) and to achieve the Red Hat Certificate of Expertise in Hybrid Cloud Storage.
Note: Red Hat Storage Server Administration is part of our new emerging technology series of courses. Emerging technologies courses are feature- and functionality-focused and are conducted like guided labs, with little lecture
Audience: Senior System Administrators and Storage Administrators interested in deploying scalable, highly available storage on off-the-shelf hardware or in the cloud.
Length: 2 Days
Training units: 7
Price: varies per region
TRAINING CERTIFICATION
Red Hat Storage Server Administration (RH236)
Red Hat Certificate of Expertise in Hybrid Cloud Storage
Session title
Non confidential 2222 RHS: Managing the Information Explosion
RED HAT STORAGE INFORMATION RESOURCES
RED HAT STORAGE PRODUCT INFORMATION
HTTP://WWW.REDHAT.COM/PRODUCTS/STORAGE-SERVER/
RED HAT STORAGE SOLUTIONS
HTTP://WWW.REDHAT.COM/PROMO/LIBERATE/SOLUTIONS.HTML
RED HAT STORAGE CUSTOMER SUCCESS STORIES
HTTP://WWW.REDHAT.COM/PROMO/LIBERATE/RESOURCES.HTML
RED HAT STORAGE SERVICES
HTTP://WWW.REDHAT.COM/PROMO/LIBERATE/SERVICES.HTML
GLUSTER COMMUNITY FORGE
HTTP://FORGE.GLUSTER.ORG
GLUSTER COMMUNITY HTTP://WWW.GLUSTER.ORG