mesos-devoxx14

ROOM 9 #devoxx #DV14 #mesos #docker @samklr

Kernel for Distributed

Applications

Sam BESSALAH

@samklr

#Devoxx #DV14 #mesos #docker @samklr


Example of a statically partionned cluster


Akka/Play Jenkins Spark/Hadoop RedisStorm


Issues with static partitionning

- Increased Complexity : Machines/vm sprawlSoftware failures gets harder to handle as machines number grow

- Huge overheard, on development,- Planning for failure and maintenance gets harder- Not really developer friendly. Long cycles to

deployments.


Resources utilisation under static partitionning

Play/Akka Redis Hadoop


Resources utilisation under static partitionning

Play/Akka RedisHadoop

Put together, we would get


Enters Google stage left ...

Google “Borg” .Unofficial name.Moved to a new system called OmegaBundles all the cluster’s machines into a single pooledview of resources.

Evolved to Omega.


Mesos : Level of indirection

1. Run multiple types of distributed systems on the same cluster of machines, and dynamically share resources more eficiently.

2. Provide failure detection, task distribution, task tracking, task monitoring, low level resources management, and fine grained resources sharing. And scale to the thousands of nodes.


Quick View.


Mesos Architecture


http://mesos.apache.org/documentation/latest/mesos-architecture/


Mesos Framework

A framework is an application that runs distributed applications on Mesos.

It has two components : The Scheduler : Interacts with Mesos, to book resources and

launch tasks within the mesos slaves.Executors : gets information from the framework like

environmental variables,configuration informationand run tasks inside the mesos slaves.


Mesos Framework



launch tasks within the mesos slaves.Executors : run tasks in mesos slaves.

Mesos provides an API to build its own frameworks. And there are SDKs in mulitple languages.


Resources allocation process

- Mesos allocate resources via “resources offers”

- Resources are a snapshot of available resources that a scheduler will use to runtasks on mesos slaves.


1- resourceOffers()


1- resourceOffers() 2. launchTasks()



3. lauchTask()



3. lauchTask() 4. statusUpdate()


1- resourceOffers()

2. launchTasks()

3. lauchTask() 4. statusUpdate()

5. statusUpdate()


Mesos slaves


Mesos slaves

Linux Containers


Mesos uses Linux Containers for resource isolation.

Mesos containers are built around cgroups , to provide isolation of

CPU, memory, disk … and namespaces for network isolation.

Started leveraging containerirsation since 2010


Linux Containers


Linux ContainersLXC


Linux ContainersLXC

Cgroups


Mesos provides a native support for DockerContainers since 0.20


Fault recovery & HA

- Mesos Master uses Zookeeper for leader election and leader discovery.

- Mesos Master have a Registrar to log all the tasks and slaves info, implemented as a replicated log using MultiPaxos for consensus


Fault recovery & HA



- Mesos has a slave recovery mechanism. So user’s tasks keep running whenever a slave proces goes under.


Fault recovery & HA



- Mesos has a slave recovery mechanism. So user’s tasks keep running whenever a slave proces goes under. Slaves checkpoint information to their local disks (task info, status updates, etc ), they recover checkpointed data and reconnect with old tasks when they restart.


Mesos Framework



launch tasks within the mesos slaves.Executors : run tasks in mesos slaves.

Mesos provides an API to build its own frameworks. And there are SDKs in mulitple languages.


Marathon


- A generic mesos framework to run long running services (web apps, etc …)

- A distributed Init.d for the cluster.- Runs any linux binary without modification (Tomcat, Play, …)- Cluster wide process supervisor

-Private PaaS - Service discovery- Provide a self service Rest API for deployment - Authentification & SSL- Placement constrainst (nodes, racks, etc. (Like with Spark) )- Service discovery and load balancing via HAProxy

What is Marathon ?


Marathon workflow


POST /v2/apps {“id” : “IPython Notebook”“container “ : {

“image “ : “docker://ipython/notebook” “options” : [ . . . ]}

}

Marathon Rest APi


Wants to scale by addind more instances ..

PATCH /v2/apps {“instances” : 4

}

Marathon Rest APi


Conclusion


Conclusion

Aurora


Conclusion

Kubernetes


speakerdeck.com/samklr

mesos-devoxx14

Technology

mesos slaves

mesos architecture

resources utilisation

resources viaresources

resources andlaunch

single pooledview of

snapshot ofavailable

low level resources