red hat ceph storage customer presentation
TRANSCRIPT
THE POWER OF RED HAT CEPH STORAGE
And how it’s essential to your software defined datacenter
Rodrigo MissiaggiaPrincipal Solutions Architect28/07/2016
WHY YOU SHOULD CARE
Essential – Critical component of software-defined datacenterElastic – Massively scalable for next generation workloadsEconomical – Runs on standard servers and disksEfficient – Unifies infrastructures to support different data typesElegant – Sophisticated & powerful – designed for IT practitionerEasy – Now included with Red Hat OpenStack Platform / Cloud Suite
AGENDA● Requirements and trends● Software-defined storage● Red Hat Ceph Storage 101● OpenStack integration● Product features, benefits, and
differentiation● Service offerings● Where to go next
REQUIREMENTS, TRENDS, AND SOFTWARE-DEFINED STORAGE
CUSTOMER REQUIREMENTS● Greater cost-efficiencies (30-40% annual data growth, while 60%
storage budgets flat or declining)
● Control of data growth with flexible multi-workload architectures
● Freedom from worsening labor constraints of proprietary storage
● Better day-to-day maintenance of complex storage infrastructures
● Enterprise-readiness: resilience, performance, data protection
● Agile infrastructure to match capabilities of cloud services
Traditional Open, software-defined
Standardcomputersand disksSt
anda
rdH
ardw
are
Ope
n So
urce
Soft
war
e
Ceph Gluster +++
Control Plane (API, GUI)
ADMIN USER
THE FUTURE OF STORAGE
ADMIN
USER
ADMIN
USER
ADMIN
USER
Interface de AdminsitraçãoSoftware e Hardware proprietários
FOUNDATIONAL SHIFTS
PROPRIETARY HARDWARE
HARDWARE-BASED INTELLIGENCE
SCALE-UP ARCHITECTURE
CLOSED DEVELOPMENT PROCESS
Standards-based, interoperable hardware
Lower cost, standardized supply chain
Scale-out architectureIncreased operational flexibility
Software-based intelligenceMore programmability, agility, and control
Open development processMore flexible, well-integrated technology
RISING TIDE OF SOFTWARE-DEFINED STORAGE
“By 2020, between 70-80% of unstructured data will be held on lower-cost storage
managed by SDS environments.”
“By 2016, server-based storage solutions will lower storage hardware costs by 50% or more.”
Gartner: “IT Leaders Can Benefit From Disruptive Innovation in the Storage Industry”
Innovation Insight: Separating Hype From Hope for Software-Defined Storage
~20% CAGR between 2015 and 2019
2013 2014 2015 2016 2017 2018 2019
$1,349M
$1,195M
$1,029M
$859M
$706M$592M
SDS MARKET SIZE BY SEGMENT
$457M
Block StorageFile StorageObject StorageHyper converged
Source: IDC
“By 2019, 70% of existing storage array products will also be available as software only versions”
Innovation Insight: Separating Hype From Hope for Software-Defined Storage
THE RED HAT STORAGE MISSIONTo offer, with our partners, a unified, open
software-defined storage portfolio for next generation workloads thereby accelerating the
transition to modern IT infrastructures.
RED HAT CEPH STORAGE 101
RED HAT CEPH STORAGE
12
Distributed, enterprise-grade object storage, proven at web scale
Open, massively-scalable, software-defined Flexible, scale-out architecture on clustered commodity hardwareSingle, efficient, unified storage platform (block, object, file) User-driven storage lifecycle management with 100% API coverage Integrated, easy-to-use management consoleDesigned for cloud infrastructure and emerging workloads
BUSINESS BENEFITS● Open source - no proprietary lock-in, large ecosystem, community backing
● Lower cost - than traditional NAS/SAN, particularly petabyte workloads
● Peace of mind - decade of development, production proven, overwhelmingly preferred, supported and integrated by Red Hat
TECHNICAL BENEFITS OF CEPH
● Massive scalability, to support petabytes of data
● Maximum uptime, with no single point of failure
● Reduced maintenance, via self-management and self-healing
● Operational efficiency, by distributing data dynamically among servers and disks
RED HAT CEPH STORAGE FEATURES AND BENEFITS
COMPLETE, DEEPLY INTEGRATED STORAGE FOR OPENSTACK● Deeply integrated with modular architecture and components for ephemeral
& persistent storage Nova, Cinder, Manila, Glance, Keystone, Swift
● Optimized for Database as a Service (DaaS) with MySQL workloads● Bundled in Red Hat OpenStack Platform
ADVANTAGES FOR OPENSTACK USERS● Instantaneous booting of 1 or 100s of VMs● Instant backups via seamless data migration between Glance, Cinder, Nova● Tiered I/O performance within single cluster● Multi-site replication for disaster recovery or archiving
SCALABILITYHundreds of nodesCRUSH algorithm (placement and rebalancing)No single point of failure
SCALABILITYHundreds of nodesCRUSH algorithm (placement and rebalancing)No single point of failure PROTOCOLS
S3, SwiftCinder block storagePOSIX (Tech preview - TP)NFS to S3 gateway (TP)iSCSI (2.1)
PROTOCOLSS3, SwiftCinder block storagePOSIX (Tech preview - TP)NFS to S3 gateway (TP)iSCSI (2.1)
SECURITYPool-level authenticationActive Directory, LDAP, Keystone v3At-rest encryption
SECURITYPool-level authenticationActive Directory, LDAP, Keystone v3At-rest encryption DATA SERVICES
Snapshots, cloning, and copy-on-writeGlobal clusters for S3/Swift storage (New)Disaster recovery for block storage (New)
DATA SERVICESSnapshots, cloning, and copy-on-writeGlobal clusters for S3/Swift storage (New)Disaster recovery for block storage (New)
PERFORMANCEClient-side cachingServer-side journalingBlueStore (TP)
PERFORMANCEClient-side cachingServer-side journalingBlueStore (TP)
EFFICIENCYStandard (commodity) hardware Erasure coding (reduced footprint)Thin provisioning
EFFICIENCYStandard (commodity) hardware Erasure coding (reduced footprint)Thin provisioning
FEATURES, NO FLUFF
Red Hat Ceph Storage 2
WHAT’S NEW IN 21. New storage management platform, “Red Hat
Storage Console 2” 2. RGW geo-clusters with single namespace3. RBD Mirroring to enable multi-site replication for
disaster recovery and archival4. Support for Active Directory, LDAP, and Keystone v3 5. Improved S3 and Swift protocol API support 6. Tech preview of CephFS7. Tech preview of NFS to S3 gateway 8. Tech preview of BlueStore turbocharge
NEW INTEGRATED MANAGEMENT WITH RED HAT STORAGE CONSOLE 2
• Easy to use graphical interface to manage storage cluster life cycle
• Ansible-based deployment tools for installation, importation, and granular configuration from CLI or GUI
• Monitoring and troubleshooting with statistical and graphical information about cluster components
RADOS. RGW, RBD, CALAMARI
RED HAT STORAGE CONSOLE 2
CLUSTER OF STANDARD SERVERS AND MEDIA
CLIENTSADMINS
RED HAT STORAGE CONSOLE 2BENEFITS
• Ease of use Integrated on-premise management console and service dashboard Easy installation, management, and monitoring from modern UI
• Comprehensive visibility Unified view of storage infrastructure Enhanced discovery, insight, and management
• Operational intelligence Proactive health management, capacity and performance utilization
through advanced monitoring and diagnostic information
Great improvements to RGW, Ceph’s object storage interface:• Support for authentication using Active
Directory, LDAP & OpenStack Keystone v3• Greater compatibility with the Amazon S3
and OpenStack Swift object storage APIs• AWS v4 signatures, object versioning, bulk deletes
• New NFS gateway for bulk import and export of object data (tech preview)
OBJECT STORAGE IMPROVEMENTS
Global object storage clusters with single namespace• Enables deployment of clusters across
multiple geographic locations• Clusters synchronize, allowing users to
read from or write to the closest oneMulti-site replication for block devices• Replicates virtual block devices across
regions for disaster recovery and archival
NEW MULTISITE CAPABILITIES
USERUSER
CEPH OBJECT GATEWAYCEPH OBJECT GATEWAY
USERUSER
CEPH OBJECT GATEWAYCEPH OBJECT GATEWAY
STORAGE CLUSTERUS-EAST
STORAGE CLUSTERUS-WEST
PERFORMANCE BOOST WITH BLUESTORE
• New storage backend optimized for modern media - Tech preview in RHCS 2
• Replaces FileStore, optimized for HDDs – file system for object data management impacted performance
• Benefits of BlueStore:• 2-3X performance • Mitigates need for underlying file system or dedicated journal device• Flexible media topologies (SSDs, K/V drives, persistent memory
devices) to help optimize data or metadata I/O• Native checksumming to detect data corruption on media
OPENSTACK FILE SUPPORT WITH CephFS• POSIX-compliant file system to store data in accordance
with OpenStack Manila Project• Tech Preview RHCS 2 – Manila Tech Preview OSP 7, 8• FUSE or kernel clients (RHEL 7.2) • CephFS Manila driver (tech preview) with OSP 9 • Roadmap: robustness, hardening, then scalability
November 2015: Manila Tech
Preview in OSP 7
July 2016: CephFS tech preview in RHCS 2 and clients
August 2016: CephFS Manila
driver tech preview in OSP 9
November 2016: Manila production support in OSP 10
2017: CephFS production
support RHCS 2.x
Timeline is Red Hat Confidential
The other guys
Description Software-defined, unified storage and distributed object store
Traditional NAS & SAN appliance (still requiring two storage systems)
Capacity 1000s of nodes, limitless petabytes ~6 PBs
Scalability Easy to add and manage- via single nodes on standard servers and disks
Difficult - via forklift installation of additional appliances
VM migration and backups
Live, instantaneous, for high agility in cloud environments
Cumbersome and slow: Image pulled from Swift for each instance
Design process Open source Proprietary
Maintenance Nodes added and removed on fly Appliance replacement impacts data migration and downtime
Cost Pay-as-you-go OPEX, economical at scale Large upfront CAPEX, much (75%+) more expensive on PB+ workloads
COMPARING AND CONTRASTING THE OPTIONS
SERVICE OFFERINGS
SERVICES AVAILABLE FROM RED HATSpanning Red Hat Ceph Storage and Red Hat OpenStack Platform
Subscription Benefits – Streamlined product and resource access, lifecycle management, Knowledgebase and deployment resources, security and accountability
Jumpstart - 3 day consulting for pre-production cluster implementation at customer site Health Check - 3-5 day evaluation of total solution best practice engagement Red Hat Storage Consulting Services - recommended for initial storage design and set-up Global Services and Support - production subscriptions for smooth lifecycle deployments Red Hat Storage training – 2 and 5 day for storage or cloud admins, including OpenStack
REFERENCE ARCHITECTURES
http://www8.hp.com/h20195/v2/GetPDF.aspx/4AA5-8638ENW.pdf
REFERENCE ARCHITECTURES Performance and Sizing Guide: Red Hat Ceph Storage on Supermicro Storage Performance and Sizing Guide: Red Hat Ceph Storage on QCT Servers Deploying Red Hat OpenStack Platform 7 with Red Hat OSP director 7.1 (Access via customer portal)
Guidelines and Considerations for Performance and Scaling your Red Hat OpenStack Platform 7 Cloud (Access via customer portal)
Guidelines and Considerations for Performance and Scaling your Red Hat OpenStack Platform 6 Cloud (Access via customer portal)
Deploying Highly Available Red Hat OpenStack Platform 6 with Red Hat Ceph Storage Deploying Red Hat OpenStack Platform 6 with Ceph Storage Dell Red Hat Cloud Solutions Reference Architecture Guide Cisco UCS C3160 High-Density Rack Server with Red Hat Ceph Storage
CLOSING TIME
WHERE TO GO NEXT? Red Hat Subscriptions: https://access.redhat.com/subscription-value
Evaluation, Pre-production, and Production contracts available through Red Hat sales Red Hat Consulting: http://www.redhat.com/en/services/consulting/storage Red Hat Storage training: https://www.redhat.com/en/services/training Red Hat Storage test-drive: http://red.ht/cephtestdrive
Web: www.redhat.com/storage Blog: http://redhatstorage.redhat.com/ Twitter: www.twitter.com/redhatstorage Facebook: www.facebook.com/RedHatStorage/ YouTube: www.youtube.com/user/redhatstorageSlideshare: www.slideshare.net/Red_Hat_Storage
THANK YOU,and please stay in touch!