presentation title goes here neil levine inktank...17 2014 data storage innovation conference. ©...

PRESENTATION TITLE GOES HERE

Building open source products with Ceph

Neil Levine Inktank

2 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

CEPH

3 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

CEPH UNIFIED STORAGE

FILE SYSTEM

BLOCK STORAGE

OBJECT STORAGE

Keystone

Geo-Replication

Native API

Multi-tenant

S3 & Swift

OpenStack

Linux Kernel

iSCSI

Clones

Snapshots

CIFS/NFS

HDFS

Distributed Metadata

Linux Kernel

POSIX

4 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

ARCHITECTURE

APP HOST/VM CLIENT

5 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

COMPONENTS

6 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

OPENSTACK

7 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

CLOUD STORAGE

S3/Swift S3/Swift S3/Swift S3/Swift

8 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

WEBSCALE APPLICATIONS

Native Protocol

Native Protocol

Native Protocol

Native Protocol

9 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

DEVELOPMENT

10 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

DEVELOPMENT SCHEDULE

Planning

11 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

0.67 0.68 0.69 0.70 0.71 0.72

DEVELOPMENT SCHEDULE

2 weeks 2 weeks 2 weeks 2 weeks 2 weeks 2 weeks

Planning

Development

12 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

0.67 0.68 0.69 0.70 0.71 Firefly

DEVELOPMENT SCHEDULE

2 weeks 2 weeks 2 weeks 2 weeks 2 weeks 2 weeks

Planning

Development

13 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Teuthology: Ceph Test Suite

VM Management

Job Scheduling Unit Testing Functional

Testing Reporting

14 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Where it happens

github.com/ceph

tracker.ceph.com

ceph-devel, #ceph

15 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

THE PRODUCT

16 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Specialized Device Opinionated Software Professional Services

THE MODELS

HW or SW Curation Development

Optimization

Support

SERVICES ONLY VALUE ADD DISTRO APPLIANCE

User Experience

Tools

Pre-built

Proprietary

17 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

INKTANK CEPH ENTERPRISE 1.1

Ceph Object and Ceph Block Calamari Management Platform

Enterprise Plugins (2014) Support Services

18 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

1.2

1.3

Ceph Ceph-Deploy

2.1

2.2

2.3

3rd Party

0.67

0.68

0.69

Upstream Projects

3.12

3.13

3.14

3rd Party

Curated Packages

19 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Curated Packages

Ceph Ceph-Deploy

0.67

Upstream Projects

Product

3rd Party

1.3 2.3

3.12

3rd Party

20 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

LONG TERM SUPPORT

2014 2015

Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2

21 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

EXPERIENCE AND TOOLS

22 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

LESSONS

23 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Difference #1: The Cruft

FILE SYSTEM

BLOCK STORAGE

OBJECT STORAGE

Keystone

Geo-Replication

Native API

Multi-tenant

S3 & Swift

OpenStack

Linux Kernel

iSCSI

Clones

Snapshots

CIFS/NFS

HDFS

Distributed Metadata

Linux Kernel

POSIX

24 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Difference #1: The Cruft

Keystone

Geo-Replication

Native API

Multi-tenant

S3 & Swift

OpenStack

Linux Kernel

iSCSI

Clones

Snapshots

CIFS/NFS

HDFS

Distributed Metadata

Linux Kernel

POSIX

Bucket Quotas

User Quotas

Pool Quotas

Multi-Part

ACLs

Waldo

RBD FUSE

Striping

BTRFS Support

JAVA bindings

FS FUSE

Messaging

FreeBSD port

ZFS Support

Snapshots

25 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Difference #2: The Clients

KVM librbd

Linux krbd

OpenStack cinder

Ceph Storage Cluster (RADOS)

Ceph Native Protocol

26 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Difference #2: The Clients

Ceph Storage Cluster (RADOS)

Ceph Native Protocol

27 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Difference #2: The Clients

Ceph Storage Cluster (RADOS)

Ceph Native Protocol

28 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Difference #3: The Community

“What’s on your roadmap?”

CUSTOMER

“Err.. Stuff”

ME

29 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

The Same, but Different

QA

Reference Architectures

Performance

30 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

THE OPPORUNTIES

31 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

What if ONTAP had been open source?

32 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Hardware Differentiation

33 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Hardware Differentiation

34 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Security Differentiation

35 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

Storage Aware Applications

36 2014 Data Storage Innovation Conference. © Insert Your Company Name. All Rights Reserved.

ROADMAP

PRESENTATION TITLE GOES HERE

Thanks!

@neilwlevine @inktank

@ceph