![Page 1: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/1.jpg)
DUSTIN L. BLACK, RHCA
OPEN STORAGEIN THEENTERPRISEwith GlusterFS and Ceph
Dustin L. Black, RHCAPrincipal Technical Account ManagerRed Hat Strategic Customer Engagement
2014-10-13
![Page 2: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/2.jpg)
![Page 4: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/4.jpg)
Wouldn't you like to have...a single named support contactwho know's your business,your technology,and your needs?
![Page 5: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/5.jpg)
A trusted advisor and technicalexpert
to analyze your configuration,advise on your architecture,
and collaborate on your strategy?
![Page 6: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/6.jpg)
An advocate and liaisonconnecting you with engineers
and maintainers,within Red Hat and upstream,
ensuring your priorities are alsotheirs?
![Page 7: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/7.jpg)
A partner who livesand breathes open
source andtransparency?
![Page 8: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/8.jpg)
RED HATTechnical AccountManagementPremium named-resource proactivesupportfrom your leading experts in opensolutionsContact your sales team or visit redhat.com
Supporting success. Exceeding expectations.
![Page 9: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/9.jpg)
Let's TalkDistributed Storage
Decentralize and Limit FailurePointsScale with Commodity Hardwareand Familiar OperatingEnvironmentsReduce Dependence onSpecialized Technologies andSkills
![Page 10: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/10.jpg)
GlusterFSClustered Scale-out GeneralPurpose Storage PlatformFundamentally File-Based &POSIX End-to-End
Familiar Filesystems Underneath(EXT4, XFS, BTRFS)Familiar Client Access (NFS, Samba,Fuse)
No Metadata ServerStandards-Based – Clients,
![Page 11: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/11.jpg)
![Page 12: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/12.jpg)
![Page 13: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/13.jpg)
Red Hat StorageServer
Enterprise Implementation ofGlusterFSIntegrated Software ApplianceRHEL + XFS + GlusterFSCertified Hardware CompatibilitySubscription Model24x7 Premium Support
![Page 14: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/14.jpg)
CephMassively scalable, software-defined storage systemCommodity hardware with nosingle point of failureSelf-healing and Self-managing
Rack and data center awareAutomatic distribution of replicas,
Block, Object, FileData stored on common backendfilesystems (EXT4, XFS, etc.)
![Page 15: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/15.jpg)
Fundamentally distributed as objects
![Page 16: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/16.jpg)
![Page 17: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/17.jpg)
![Page 18: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/18.jpg)
Inktank CephEnterprise
Enterprise Implementation ofCephCombined with management anddeployment toolsEnterprise-level support with bugescalation and hot patchesBare metal and OpenStackdeployments
![Page 19: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/19.jpg)
Use Case:Media Storage via Object Interface
![Page 20: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/20.jpg)
GoalsMedia file storage for customer-facing appDrop-in replacement for legacyobject backend1PB plus 1TB/day growth rateMinimal resistance to increasingscaleMulti-protocol capable for futureservicesFast transactions for
![Page 21: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/21.jpg)
Implementation12 Dell R710 nodes +MD1000/1200 DAS
Growth of 6 -> 10 -> 12 nodes~1PB in total after RAID 6GlusterFS Swift interface fromOpenStackBuilt-in file+object simultaneousaccessMulti-GBit network withsegregated backend
![Page 22: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/22.jpg)
Use Case:Self-Service Provisioning withAccounting and Chargeback
![Page 23: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/23.jpg)
GoalsAdd file storage provisioning toexisting self-service virtualizationenvironment
Automate the administrative tasksMulti-tenancy
Subdivide and limit usage by corporatedivisions and departmentsAllow for over-provisioningCreate a charge-back model
Simple and transparent scaling
![Page 24: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/24.jpg)
ImplementationDell R510 nodes with local disk~30TB per node as one XFSfilesystemBricks are subdirectories of theparent filesystem
Volumes are therefore naturally over-provisioned
Quotas* placed on volumes tolimit usage and provide foraccounting and charge-back
![Page 25: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/25.jpg)
Use Case:NoSQL Backend with SLA-Bound
Geo-Replication
![Page 26: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/26.jpg)
GoalsReplace legacy database key/blobarchitectureDivide and conquer
NoSQL layer for key/pointerScalable storage layer for blob payload
Active/Active sites with 30-minute replication SLAPerformance tuned for small-fileWORM patterns
![Page 27: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/27.jpg)
ImplementationHP DL170e nodes with local disk~4TB per nodeCassandra replicated NoSQL layerfor key/pointerGlusterFS parallel geo-replication* for data payload sitecopy exceeding SLA standardsWorked with Red Hat Engineeringto modify application datapatterns for better small-file
![Page 28: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/28.jpg)
Use Case:Storage & Compute Consolidation
for Scientific Research
![Page 29: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/29.jpg)
![Page 30: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/30.jpg)
GoalsScale with storage needs
Eliminate need to move data betweenbackendsKeep pace with exponential demand
Reduce administrative overhead;Spend more time on the scienceControl and predict costs
Scale on demandSimple chargeback model
Efficient resource consumption
![Page 31: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/31.jpg)
ImplementationDell PowerEdge R720 ServersOpenStack + Ceph
HPC and Storage on the samecommodity hardwareSimple scaling, portability, and trackingfor chargeback and expansion
400TB virtual storage poolAmple unified storage on a flexibleplatform reduces administrativeoverhead
![Page 32: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/32.jpg)
Use Case:Multi-Petabyte RESTful Object
Store
![Page 33: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/33.jpg)
![Page 34: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/34.jpg)
GoalsObject-based storage forthousands of cloud servicecustomersSeamlessly serve large media &backup files as well smallerpayloadsQuick time-to-market and pain-free scalabilityHighly cost-efficient with minimalproprietary reliance
![Page 35: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/35.jpg)
ImplementationModular server-rack-row "pod"system
6x Dell PowerEdge R515 servers perrack10x 3TB disks per server; Total 216TBraw per rack10x racks per row; Total 2.1PB raw perrow
700TB triple-replicated customerobjects
![Page 37: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/37.jpg)
Do it!Build a test environment in VMs injust minutes!Get the bits:
has GlusterFS and Cephpackages nativelyRHSS 2.1 ISO available on the
Go upstream: /
Fedora 20
Red HatPortal
gluster.org ceph.com
![Page 38: Red hat, inc. open storage in the enterprise 0](https://reader034.vdocument.in/reader034/viewer/2022052622/559513021a28ab91598b460f/html5/thumbnails/38.jpg)
RED HATTechnical AccountManagementPremium named-resource proactivesupport from your leading experts inopen solutionsContact your sales team or visit redhat.com
Supporting success. Exceeding expectations.