2/23/16
1
Reliable Object Storage SystemFor Software Defined Storage and Cloud
Mi-ROSS
LukeJingYuanMohd Bazli AbKarimWongMingTatStorageSystemsAdvanced Computing Lab
Agenda• Motivations
• Ceph?
• Why Ceph as Backend? Some Use Cases
• Some Little Annoyances
• What’s Mi-ROSS
• Features
• Demo???
2/23/16
2
Agenda• Motivations
• Ceph?
• Why Ceph as Backend? Some Use Cases
• Some Little Annoyances
• What’s Mi-ROSS
• Features
• Demo???
Motivations
The Hype Cycle forStorage Technologies 2014
2/23/16
3
Motivations (cont’d)
AverageCostper100TB(raw)? ~RM10M++
Morefeaturesrequired? RMxk <+y <RMxxxkMorespacerequired? Mostlikelyonlyfromsamevendor
StorageNetwork(SAN)? RMxxk <+z <RMxxxk
Consider thenormal“branded” way Goingcommodityandopenplatform
+OpenSourceStoragePlatform/Software
2Ux86based12x4TB(raw)~RM50k/unit
1/10GbpsEthernetSwitch<RM100k/unit
Morespacerequired?Justgetanyx86boxanddisksFeatures?Mostlyalreadyavailableintheopensourcestoragesoftware
=144TB(raw)@<RM350k
CanwegoCommodity andOpenPlatform?
Aftersomestudies…Ceph ischosen
Agenda• Motivations
• Ceph?
• Why Ceph as Backend? Some Use Cases
• Some Little Annoyances
• What’s Mi-ROSS
• Features
• Demo???
2/23/16
4
Ceph?• Its an open source scalable and reliable
distributed object storage• Stores data by stripping/chunking those data into
smaller objects and store the objects across different storage elements (disks)
• Objects can be replicated multiple times for redundancy or using Erasure Code techniques if storage capacity is desired
• Clients access the distributed storage via RADOS Block Device (RBD), CephFS, RADOS Gateway (RGW), Ceph/RADOS libraries.
• KVM (Qemu-KVM), Libvirt and OpenNebula have Ceph support
Ceph? (cont’d)
APP HOST/VM CLIENT
Source:PatrickMcGarry,Inktank
2/23/16
5
Agenda• Motivations
• Ceph?
• Why Ceph as Backend? Some Use Cases
• Some Little Annoyances
• What’s Mi-ROSS
• Features
• Demo???
Why Ceph as Backend? A Use Case• Let’s consider a typical DR deployment scenario:
DataCenter
DisasterRecoverySite(s)
SAN/NAS$$$
SAN/NAS$$$R/W
2/23/16
6
• What if?
11
Use Case (cont’d)
DataCenter
SAN/NAS$$$
DisasterRecoverySite(s)
SAN/NAS$$$
DataCenter2
Local/DAS $
DataCenter1
Local/DAS $
Mi-ROSS[One/Multiple Virtual
Volume(s)]
R/W
R e p l i c a t i ons
D a t a S t r i p i ng a n d P a ra l le l R / W
Software-Defined Networking
F Programmable
F Redundancy
F Availability/Reliability
F Performance
Use Case #2
• Initial POC simulates both KHTP and TPM with 3 zones using existing but slightly different hardware configuration (different disk specs).
• For actual implementation, replicate POC setup but with similar hardware configurations.– KHTP zones setup is all in a
single data center – TPM zones setup uses both
DC1 and DC2
12
3
MIMOS TPMHPCC2 HPCC1
32
1
MIMOS KHTP
2/23/16
7
Use Case #3: VDI
• Due to project requirement, we needed a controlled environment where users remotely access a windows desktop/client for development
• Solution – Open Nebula + Ceph (Emperor)– 60+ Windows 7 VMs
with RDP– 30+ development VMs– Additional attached
storage
Agenda• Motivations
• Ceph?
• Why Ceph as Backend? Some Use Cases
• Some Little Annoyances
• What’s Mi-ROSS
• Features
• Demo???
2/23/16
8
Some Little Annoyances• Command line driven management• How to ease management of pools and other
capabilities?• What if I need to access the storage differently?
– NFS– SAMBA– Etc.
• Is there a way to orchestrate or provide a management interface to other cloud management platform, e.g. OpenNebula, etc.– Register pools– Configure Libvirt– Etc.
Agenda• Motivations
• Ceph?
• Why Ceph as Backend? Some Use Cases
• Some Little Annoyances
• What’s Mi-ROSS
• Features
• Demo???
2/23/16
9
What’s Mi-ROSS
• To provide a simple access and management to a distributed storage that can be both implemented in a LAN as well as in a WAN/Campus network.
• Leveraging on the strength of the availability and redundancy provided by its chosen backend, i.e. Ceph.
• Mi-ROSS – MIMOS Reliable Object Storage System, is an initiative in Software-Defined Storage.
Agenda• Motivations
• Ceph?
• Why Ceph as Backend? Some Use Cases
• Some Little Annoyances
• What’s Mi-ROSS
• Features
• Demo???
2/23/16
10
Mi-ROSS Dashboard/Simple Monitoring
Mi-ROSS Pools & Block Devices Management
2/23/16
11
Mi-ROSS NFS Management
Mi-ROSS Samba Management
2/23/16
12
Agenda• Motivations
• Ceph?
• Why Ceph as Backend? Some Use Cases
• Some Little Annoyances
• What’s Mi-ROSS
• Features
• Demo???
Disclaimer: We are running from a Production Environment
DEMO
2/23/16
13
What’ Next?
• Additional management features• Hierarchical Storage and Data
Management• New export option(s) (e.g. iSCSI, etc.)• Web Services• Better integration to OpenNebula/Mi-Cloud
