container orchestration wars

© 2016 Mesosphere, Inc. All Rights Reserved. 1

CONTAINER ORCHESTRATION WARS


KARL WHO?

Where?

- Mesosphere- Pivotal- Williams-Sonoma

What?

- DC/OS- Kubernetes- CloudFoundry- BOSH- Spring Ecommerce Platform

- github.com/karlkfi

- twitter.com/karlkfi

- linkedin.com/in/karlkfi

- karl.isenberg.us


Revisionist History of Distributed Computing

Container Orchestration

Container Platforms

Platform as a Service

Distributed Operating Systems

Competitive Landscape

AGENDA


IN THE BEGINNING...

© 2016 Mesosphere, Inc. All Rights Reserved.

Hardware

Operating System

Application

5

COMPUTERS


Hardware

Operating System

Web Application

6

INTERNET


Web App

Hardware

Operating System

7

SCALE &HIGH AVAILABILITY

Operating System

Operating System

Hardware Hardware

Web App Web App


Service Service Service

Web App Web App Web App

Hardware

Operating System

8

SERVICE-ORIENTEDARCHITECTURE

Operating System

Operating System

Hardware Hardware


Service Service Service

Web App Web App Web App

Machine

Operating System

9

HARDWAREVIRTUALIZATION

Operating System

Operating System

Infrastructure

Machine Machine


Operating System

Operating System

Operating System

ServiceApp ServiceServiceAppApp

10

MICROSERVICES

Machine

Infrastructure

Machine Machine

ServiceService ServiceServiceServiceService


ServiceApp ServiceServiceAppApp

OS

11

CONTAINERIZEDMICROSERVICES

OS OS

Machine

Infrastructure

Machine Machine

Container Runtime Container Runtime Container Runtime

ServiceService ServiceServiceServiceService


Service

Container Runtime Container Runtime Container Runtime

OS

12

CONTAINERORCHESTRATION

OS OS

Container Orchestration

Machine

Infrastructure

Machine Machine

App ServiceServiceAppApp


“The automated arrangement, coordination, and management of complex computer systems, middleware and services.”

- Wikipedia

ORCA-WHAT-NOW?


“Continuous automated scheduling, coordination, and management of complex systems of containerized components and the resources they consume.”

- Karl

CONTAINER ORCHESTRATION


Orc

hest

ratio

n

15

Machine Infrastructure

Web Apps & Services

Scheduling

Resource Management

Container Runtime

Machine & OS

Service Management


Machine & OS Machine & OS

Container Runtime Container Runtime

Revised


SCHEDULING- Placement- Replication/Scaling- Resurrection- Rescheduling- Rolling Deployment- Upgrades- Downgrades- Collocation

RESOURCE MANAGEMENT

- Memory- CPU- GPU- Volumes- Ports- IPs

SERVICE MANAGEMENT

- Labels- Groups/Namespaces- Dependencies- Load Balancing- Readiness Checking

FUNCTIONAL CAPABILITIES


SCALABILITYPerformance, Responsiveness, Efficiency

AVAILABILITYFault Tolerance, Robustness, Reliability, Resilience, Disaster Recovery

FLEXIBILITYFormat Support, Portability, Interoperability, Extensibility

USABILITYFamiliarity, Maintainability, Compatibility, Debuggability

PORTABILITYContainer Runtimes, Host OS, Hosted, Cloud, Bare-Metal

SECURITYAuditability, Secrets Management, Encryption, Isolation

NON-FUNCTIONAL QUALITIES


“A platform is any base of technologies on which other technologies or processes are built.”

- Some Guy on the Internet

CLOUD PLATFORM?


“Platform as a service (PaaS) is a category of cloud computing services that provides a platform allowing customers to develop, run, and manage applications without the complexity of building and maintaining the infrastructure typically associated with developing and launching an app.”

- Wikipedia

PAAS?


“A distributed system on which users develop, run, and manage containerized applications and services.”

- Karl

CONTAINER PLATFORM


APPLICATION DEVELOPMENT LIFECYCLESource Repo, Continuous Integration, Artifact Repo

CONTAINER ORCHESTRATIONScheduling, Resource Management, Service Management

DAY 2 OPERATIONSDebugging, Maintenance

22

CONTAINER OPERATIONS


APPLICATION DEVELOPMENT LIFECYCLECONTAINER OPERATIONS

Code Build, Test, Package Publish Deploy


Applications & Services

24


Source Control Continuous Integration

Artifact Repository Orchestration





Artifact Repository

Orchestration


DEBUGGING- Logging & Metrics

- Emitting- Aggregation- Search- Reporting- Alerting- Dashboards

- Shell Access

MAINTENANCE- Package Management- Upgrading- Cluster Resizing- Application Autoscaling- Capacity Planning- Software Defined Networking- Backups- Disaster Recovery

DAY 2 OPERATIONSCONTAINER OPERATIONS


System Space

Orchestration

User Space


Artifact Repository

27

CONTAINER OPERATIONS

Load Balancer Package Manager

SecurityNetworking Logging &

MetricsStorage


Kernel

28

OPERATING SYSTEM

System Space

Hardware

User Space


DISTRIBUTEDOPERATING SYSTEM

Hardware Hardware Hardware

User SpaceCirca 1992

Microkernel

System Space

Microkernel Microkernel


DYSEAC &MOBIDICCirca 1954


PLAN 9Circa 1992


THEN- Rewrite your Applications- Concurrent Programming Language- Virtual Machine Environment- UNIX-like, POSIX-like- Custom Kernel- Process-level Fault Tolerance

NOW- BYO Applications- BYO Programming Language- BYO Container Operating System- BYO Container Runtime- BYO Machine Operating System- System-level Fault Tolerance

DISTRIBUTED OPERATING SYSTEM


Machine Infrastructure


Orchestration

Container Runtime

System Services

DISTRIBUTEDOPERATING SYSTEM

Container Runtime Container Runtime

Revised

OS OS OS

Machine Machine Machine

Dist

ribut

ed O

S


SECURITYCONCERNS - End-To-End Encryption

- Secrets- Certificate Management- Public Key Infrastructure- Service Accounts- User Accounts- User Groups- Directory Service Integration- Multitenancy- Permissions- Security Policies- License Management


SERVICE CATALOG - Distributed Storage

- Databases- Message Bus- Stream Processing- Machine Learning- API Brokers- Autoscalers- Log Search- Version Control- Continuous Integration- Container Repositories


WHO ARE TODAY’S CONTESTANTS?


TODAY’SCONTESTANTS

- Docker Swarm

- ECS

- Kontena

- Nomad

- Kubernetes

- Rancher

- OpenShift

- DC/OS

Non-Exhaustive List


CONTAINER ORCHESTRATION- Scheduling- Resource Management- Service Discovery

CONTAINER PLATFORM- Container Lifecycle Management

PLATFORM AS A SERVICE- Application Lifecycle Management

DISTRIBUTED OPERATING SYSTEM- Container Operations- Distributed System Services- Services Catalog & Application Ecosystem

What’s What?


Docker Swarm


Amazon EC2 Container Service (ECS)


Kontena


Nomad by HashiCorp


Nomad by HashiCorp

ORCHESTRATION


Kubernetes


Kubernetes

CONTAINER PLATFORM


Rancher


Rancher

CONTAINER PLATFORM


OpenShift


OpenShift

PaaS


DC/OS


DISTRIBUTED OPERATING

SYSTEM57

DC/OS


ORCHESTRATIONFUNCTIONALCOMPARISON


SCHEDULINGORCHESTRATION FUNCTIONAL COMPARISON (06/2016)

Placement

Kubernetes Mesos/Marathon ECS Swarm Nomad Cattle Kontena

Replication/Scaling

Readiness Checking

Resurrection

Rescheduling

Rolling Deployment

Collocation

Included External/Partial


RESOURCE MANAGEMENTORCHESTRATION FUNCTIONAL COMPARISON (06/2016)

Memory


CPU

GPU

Disk Space

Persistent Volumes

Ports

IPs


Volumes


SERVICE MANAGEMENTORCHESTRATION FUNCTIONAL COMPARISON (06/2016)

Labels


Groups/Namespaces

Dependencies

Load Balancing

Readiness Checking



"Let's face it, the universe is messy. It is nonlinear, turbulent, and chaotic. It is dynamic. It spends its time in transient behavior on its way to somewhere else, not in

mathematically neat equilibria. It self-organizes and evolves. It creates diversity, not uniformity. That's what

makes the world interesting, that's what makes it beautiful, and that's what makes it work."

Donella H. Meadows

(Thinking in Systems: A Primer)

container orchestration wars

Technology