lessons from netflix mesos clusters
Post on 19-Feb-2017
720 Views
Preview:
TRANSCRIPT
81 Million subscribers worldwide and growing
Scale
○
○
○○
○
○○
○
○
vs.
For long running stateful services
Fitness
Pending
Assigned
Urg
ency
N tasks to assign from M possible agents
○
○
MasterMasterMaster
Agent
ENI 1
ENI 2
Compute focused Agent GroupASG-11: Active
Compute focused Agent GroupASG-10: Inactive
Network focused Agent GroupASG-21: Active
Network focused Agent GroupASG-20: Inactive
Fenzo autoscaling sets ASG’s “desired” count, honors “min” and “max”
AWS EC2 can rate limit API calls
○○
○○
○
○○○
+ <
○○
○○
○
○
○
○
○○
○
“user”: … ,
“application”: … ,
“labels”: … ,
“Containers”: {
“C1”: { … }
},
“engine”: {
“jobspec”: { … }
}
○
○○
○
○○
top related