emcw2015 - containers and data persistence
TRANSCRIPT
1© Copyright 2015 EMC Corporation. All rights reserved.
CONTAINERS AND DATA PERSISTENCECLINT KITSON – DEVELOPER ADVOCATE - @CLINTONSKITSON
2© Copyright 2015 EMC Corporation. All rights reserved.
A TYPICAL MICROS-SERVICE
APPLICATION ARCHITECTURE
Low Latency Please
Load Balancing
Routing
Services
Persistence
Non-Persistence
VM Cloud
12-Factor AppWithout Persistence
Persistence is Evolving
5© Copyright 2015 EMC Corporation. All rights reserved.
A DATABASE IS AN APP
- EASY FOR DEV & TEST- STORAGE IS ORCHESTRATED OUTSIDE OF CONTAINER ENGINE- TYPICALLY AN OPS ASSISTED WORKFLOW- DOCKER EXTENSIONS WILL HELP CREATED HOOKS FOR EXTENSIBILITY
6© Copyright 2015 EMC Corporation. All rights reserved.
TODAYS APPROACH TO PERSISTENCE
CONTAINER OS
CONTAINER CONTAINER with MOUNT
/var/lib/docker/graphdriver/.. /mnt/PersistentData
- MOUNT A DIRECTORY TO A CONTAINER
- TYPICAL ECO-SYSTEM APPROACH
Block/NAS
7© Copyright 2015 EMC Corporation. All rights reserved.
BUT..- CAN A CONTAINER LIVE ON PERSISTENT STORAGE AND/OR INCLUDE A MOUNT- CAN WE DEFINE A STORAGE POLICY WITH A CONTAINER- CAN WE DIFFERENTIATE STORAGE SERVICE AT A CONTAINER LEVEL
..HENCE, CAN CONTAINER ENGINE TO INDEPENDENTLY MANAGE STORAGE
8© Copyright 2015 EMC Corporation. All rights reserved.
DOGGED & REXRAY
Block, NAS
CoreOS, Atomic, Photon
vCloud,OpenStack,
EC2, vSphere,KVM,
Xen, Physical
Storage
Docker, Rocket, Garden, Photon
Kubernetes, Mesos, Swarm
Agnostic of the stack
1) Apply Storage Policies to Containers
2) Provide Container level Data Services
9© Copyright 2015 EMC Corporation. All rights reserved.
PROJECT MUTT CUTTS
Container Storage Requirements Embedded in Container Manifestor Requested with Container or Container Volume creation
Container Engine uses Storage Driver to Create/Map/Mount Storage from Rexray for Persistent use cases
DVOL
github.com/emccode/dogged
Container Engine determines underlying storage capabilities from Hypervisor/SDS
github.com/emccode/rexray
10© Copyright 2015 EMC Corporation. All rights reserved.
VIDEO – DOGGED+DOCKER
- CONTAINER DATA VOLUME MANAGEMENT- DATA VOLUME STORAGE POLICY- DATA VOLUME SNAPSHOTS- DATA VOLUME REPLICATION