emcw2015 - containers and data persistence

11
1 © Copyright 2015 EMC Corporation. All rights reserved. CONTAINERS AND DATA PERSISTENCE CLINT KITSON – DEVELOPER ADVOCATE - @CLINTONSKITSON

Upload: clinton-kitson

Post on 29-Jul-2015

681 views

Category:

Technology


3 download

TRANSCRIPT

1© Copyright 2015 EMC Corporation. All rights reserved.

CONTAINERS AND DATA PERSISTENCECLINT KITSON – DEVELOPER ADVOCATE - @CLINTONSKITSON

2© Copyright 2015 EMC Corporation. All rights reserved.

A TYPICAL MICROS-SERVICE

APPLICATION ARCHITECTURE

Low Latency Please

Load Balancing

Routing

Services

Persistence

Non-Persistence

VM Cloud

12-Factor AppWithout Persistence

Persistence is Evolving

3© Copyright 2015 EMC Corporation. All rights reserved.

PERSISTENCE IS EVOLVING

VM CONTAINERCLOUD

4© Copyright 2015 EMC Corporation. All rights reserved.

“LIBRARY” CONTAINERS W/ DATA??

5© Copyright 2015 EMC Corporation. All rights reserved.

A DATABASE IS AN APP

- EASY FOR DEV & TEST- STORAGE IS ORCHESTRATED OUTSIDE OF CONTAINER ENGINE- TYPICALLY AN OPS ASSISTED WORKFLOW- DOCKER EXTENSIONS WILL HELP CREATED HOOKS FOR EXTENSIBILITY

6© Copyright 2015 EMC Corporation. All rights reserved.

TODAYS APPROACH TO PERSISTENCE

CONTAINER OS

CONTAINER CONTAINER with MOUNT

/var/lib/docker/graphdriver/.. /mnt/PersistentData

- MOUNT A DIRECTORY TO A CONTAINER

- TYPICAL ECO-SYSTEM APPROACH

Block/NAS

7© Copyright 2015 EMC Corporation. All rights reserved.

BUT..- CAN A CONTAINER LIVE ON PERSISTENT STORAGE AND/OR INCLUDE A MOUNT- CAN WE DEFINE A STORAGE POLICY WITH A CONTAINER- CAN WE DIFFERENTIATE STORAGE SERVICE AT A CONTAINER LEVEL

..HENCE, CAN CONTAINER ENGINE TO INDEPENDENTLY MANAGE STORAGE

8© Copyright 2015 EMC Corporation. All rights reserved.

DOGGED & REXRAY

Block, NAS

CoreOS, Atomic, Photon

vCloud,OpenStack,

EC2, vSphere,KVM,

Xen, Physical

Storage

Docker, Rocket, Garden, Photon

Kubernetes, Mesos, Swarm

Agnostic of the stack

1) Apply Storage Policies to Containers

2) Provide Container level Data Services

9© Copyright 2015 EMC Corporation. All rights reserved.

PROJECT MUTT CUTTS

Container Storage Requirements Embedded in Container Manifestor Requested with Container or Container Volume creation

Container Engine uses Storage Driver to Create/Map/Mount Storage from Rexray for Persistent use cases

DVOL

github.com/emccode/dogged

Container Engine determines underlying storage capabilities from Hypervisor/SDS

github.com/emccode/rexray

10© Copyright 2015 EMC Corporation. All rights reserved.

VIDEO – DOGGED+DOCKER

- CONTAINER DATA VOLUME MANAGEMENT- DATA VOLUME STORAGE POLICY- DATA VOLUME SNAPSHOTS- DATA VOLUME REPLICATION