paris container day 2016 : how cluster managers affect the landscape of modern distributed...

@ContainerDay16

How cluster managers affect the landscape of modern distributed computing—why we decided to open source DC/OS

Alex Rukletsov <[email protected]>June 2016

mailto:[email protected]

@ContainerDay16

On this CD:

(1) Why containers? as seen by a Mesos guy

(2) What about Apache Mesos, DC/OS? and your business

(3) What’s ahead? free prophecies from that Mesos guy

(4) Bonus track: Beware of DC/OS? no, it is not Skynet (yet)

@ContainerDay16

Containers are great because...

@ContainerDay16

Containers are great because...

Isolation Packaging

@ContainerDay16

All problems solved?

© c

reat

ivem

arke

t.co

m

@ContainerDay16

That’s how we run datacenters:

© u

nkno

wn

@ContainerDay16

Treat a cluster as one big computer

@ContainerDay16

Apache Mesos vs. DC/OS

@ContainerDay16

“Every business will be asoftware business”

we are helping by

letting companies focus on things that are

differentiators to their business instead of

investing lots of resources into setting up

and maintaining the infrastructure.

© Satya Nadella

@ContainerDay16

Autodesk’s report

� A 66% reduction in AWS Instances

� Cost Improvements up to 57%

� An impressive 40 sec time to deploy a new build

with zero downtime

� 100% Uptime

� Total Resources needed: 1 DevOps Engineer

Source: http://cloudengineering.autodesk.com/blog/2016/04/autodesk-is-forging-ahead-with-dcos.html

after one year of runnig event streaming and big data ingestion pipeline services in production on DC/OS

@ContainerDay16 © d

avid

npro

gres

s.co

m

@ContainerDay16

(1) Security & isolation

� XSA-156, 2015: A bug which allows any VM to DoS its host due to a bug in the exception delivery mechanism

� AMD 0x06000836, 2016: A bug which not only allows a VM to crash its host, it also allows a VM to take over the host

Source: http://danluu.com/cpu-bugs/

@ContainerDay16

(1) Security & isolation

� Priorities for tasks, applications, frameworks

� Quality of resources, i.e. revocable, scarce, etc.

� Improve multi-tenancy, i.e. CPI^2

� Smarter, tailored allocator algorithms, remember

Autodesk?

@ContainerDay16

(2) Competition

© apple.wikia.com; droid-life.com; youtube.com

@ContainerDay16

(3) Growing the community

� MESOS-1478, slave → agent rename� Kubernetes:

� In mid-2015, goes V1 with 14,000 commits from 400 contributors

� Docker:� In 2015, 58% of pull requests submitted to the

Docker Engine were authored by people who are neither maintainers nor Docker employees

@ContainerDay16

(4) Unified stable APIs

� Storage� REX-Ray� Flocker

� Networking� CNI� VxLAN

� Authentication & Authorization� …

@ContainerDay16

(4) Unified stable APIs

© n

uber

lin.c

om;

indi

amar

kt.c

om

@ContainerDay16

container

(5) Simplified architecture

container

DC/OS

VM

Your Task

Borg

Hardware

container

VMcontainer

VMcontainer

VM

container

Your Task

container

Your Task

container

Your Task

container

Your Task

infra

cloud

app

@ContainerDay16

container


container

DC/OS

VM

Your Task

Borg

Hardware

container

VMcontainer

VMcontainer

VM

container

Your Task

container

Your Task

container

Your Task

container

Your Task

infra

cloud

app

Seriously?

@ContainerDay16

© NASA; 3media.com

Reduce the skill and effort

required to operate clusters


@ContainerDay16

(6) Higher utilization

No. of servers Agility Automation Cost Savings

10 000 + < 5 ~ 10 < 5

1 000 – 10 000 ~ 10 20 + ~ 5

100 – 1 000 ~ 70 100 + ~ 20

10 – 100 100 + ~250 ~ 40

Source: Mesosphere survey, 2016

Q: What do you value most?

@ContainerDay16

Will DC/OS kill Apache Mesos?Bonus Q1:

@ContainerDay16

Bonus Q2: Will Mesosphere kill Mesos?

@ContainerDay16

Will DC/OS kill Mesosphere?Bonus Q3:

paris container day 2016 : how cluster managers affect the landscape of modern distributed...

Technology