ceph and openstack at the boston meetup
DESCRIPTION
There have been heaping piles of buzz surrounding Ceph and OpenStack lately. Similar amounts of work have been going in to the integration between Ceph and OpenStack in recent versions. We'll take a look at how this work is making all the awesomeness of Ceph available to users in a simple, intuitive, and powerful way. The world of Havana and beyond is certainly no different, and promises to continue the trend of both functionality and buzz-worthiness. This talk given at the OpenStack meetup in Boston (Aug 14, 2013) gives a brief introduction to Ceph for the uninitiated and take a look at what's coming down the road. The short term of Havana has plenty to keep fans of both platforms happy and busy, but there are plenty more interesting problems that we can tackle. In addition to the concrete of the short term we'll take a look at how less-oft-used pieces of the Ceph platform can help augment your OpenStack setup, some general blue sky thinking, and what the community can do to get involved.TRANSCRIPT
Ceph & OpenStack;
Going Plaid!
OpenStack Meetup | Boston, MA | 14 AUG 2013
2
•Patrick McGarry
•Community monkey
•Inktank / Ceph
•/. > ALU > P4
•@scuttlemonkey
•patrick@inktankcom
Accept no substitutes
C’est Moi
3
•Ceph in <30s
•Ceph & OpenStack
•Distro Wars?
•Orchestration
•What’s Next?
•Questions
The plan, Stan
Welcome!
4
On commodity hardware
Ceph can run on any infrastructure, metal or virtualized to provide a cheap and powerful storage cluster.
Object, block, and file
Low overhead doesn’t mean just hardware, it means people too!
Awesomesauce
Infrastructure-aware placement algorithm allows you to do really cool stuff.
Huge and beyond
Designed for exabyte, current implementations in the multi-petabyte. HPC, Big Data, Cloud, raw storage.
…besides wicked-awesome?
What is Ceph?
Software All-in-1 CRUSH Scale
5
Find out more! Ceph.com
…but you can find out more
Use it today Dreamhost.com/cloud/DreamObjects
Get Support Inktank.com
That WAS fast
6
Good together
OpenStack && Ceph
7
Come for the block Stay for the object and file
Cinders and Glances and …bears?
Reduced Overhead Easier to manage one cluster
“Other Stuff” Identity with Keystone, CephFS prototypes,
Gateway Drug
8
Squash Hotspots Multiple hosts = parallel workload
But what does that mean?
Instant Clones No time to boot for many images
Live migration Shared storage allows you to move instances between compute nodes transparently.
Blocks are delicious
9
Speak SWIFT Native support for SWIFT
And less filling!
Keystone Integration with identity
Horizontal Scaling Easy with HAProxy or others
Objects can juggle
1
0
Neat prototypes Image distribution to hypervisors
You can dress them up, but you can’t take them anywhere
Still early You can fix that!
Outside uses Great way to combine resources.
Files are tricksy
1
1
OBJECTS VIRTUAL DISKS FILES & DIRECTORIES
CEPH
FILE SYSTEM
A distributed, scale-out
filesystem with POSIX
semantics that provides
storage for a legacy and
modern applications
CEPH
GATEWAY
A powerful S3- and Swift-
compatible gateway that
brings the power of the
Ceph Object Store to
modern applications
CEPH
BLOCK DEVICE
A distributed virtual block
device that delivers high-
performance, cost-effective
storage for virtual machines
and legacy applications
CEPH OBJECT STORE
A reliable, easy to manage, next-generation distributed object
store that provides storage of unstructured data for applications
#DREAMCON2013
1
2
NOM NOM NOM
Not just a theory…
1
3
No incendiary devices please…
Linux Distros
1
4
Where the metal meets the…software
Deploying this stuff
1
5
Procedural, Ruby
Written in Ruby, this is more of the dev-side of DevOps. Once you get past the learning curve it’s powerful though.
Model-driven
Aimed more at the sysadmin, this procedural tool has a very wide penetration (even on Windows!).
Agentless, whole stack
Using the built-in OpenSSH in your OS, this super easy tool goes further up the stack than most.
Fast, 0MQ
Using ZeroMQ this tool is designed for massive scale and fast, fast, fast. Unfortunately 0MQ has no built in encryption.
The new hotness
Orchestration
Chef Puppet Ansible Salt
1
6
Canonical Unleashed
Being language agnostic, this tool can completely encapsulate a service. Can also handle provisioning all the way down to hardware.
Dell has skin in the game
Complete operations platform that can dive all the way down to BIOS/RAID level.
Others are joining in
Custom provisioning and orchestration, just one example of how busy this corner of the market is.
Doing it w/o a tool
If you prefer not to use a tool, Ceph gives you an easy way to deploy your cluster by hand.
MOAR HOTNESS
Orchestration Cont’d
Juju Crowbar ComodIT Ceph-deploy
1
7
This Ceph thing sounds hot.
What’s Next?
1
8
All about RBD! CLI -> Librbd
No, not that one…
Nova Better boot support from Nova
Backups Including incremental backups for RBD
Havana
1
9
Live migration Improve Nova’s checks
Delightfully frosty
Bug Fixing New features from Havana
And you! The community does a lot to drive direction, we love input (especially when it looks like code)!
Icehouse
2
0
An ongoing process
While the first pass for disaster recovery is done, we want to get to built-in, world-wide replication.
Reception efficiency
Currently underway in the community!
Headed to dynamic
Can already do this in a static pool-based setup. Looking to get to a use-based migration.
Making it open-er
Been talking about it forever. The time is coming!
Hop on board!
The Ceph Train
Geo-Replication Erasure Coding Tiering Governance
2
1
Quarterly Online Summit
Online summit puts the core devs together with the Ceph community.
Not just for NYC
More planned, including Santa Clara and London. Keep an eye out: http://inktank.com/cephdays/
Geek-on-duty
During the week there are times when Ceph experts are available to help. Stop by oftc.net/ceph
Email makes the world go
Our mailing lists are very active, check out ceph.com for details on how to join in!
Open Source is Open!
Get Involved!
CDS Ceph Day IRC Lists
2
2
Comments? Anything for the good of the cause?
Questions?
E-MAIL [email protected]
WEBSITE Ceph.com
SOCIAL @scuttlemonkey @ceph Facebook.com/cephstorage