making sense out of amazon ec2 container service
TRANSCRIPT
MAKING SENSE OUT OF AMAZON ECS
Swapnil DahiphaleDevOps Engineer
13 Feb 2016, DevOps Meetup Banglore
WhiteHedge
2
INTRODUCTION - HELLO
Hello! Welcome to WhiteHedge
WhiteHedge is an Agile Software Product Development company. But what reallydescribes us is what we think about Our Work , Our Clients.
We have deep experience in some of the most sought-after technology domains in theindustry today: Mobile Development, Big Data Analytics, Cloud Computing, andDevOps. Having deep knowledge in these domains make us stand out as the best andthe coolest provider of services. Our DevOps will bring you a single team that workstogether with continuous development, continuous testing, continuous deployments,logging, monitoring and security.
WhiteHedge
3
WHITEHEDGE - AN OVERVIEW
Global Presence
Agile + Flexible
Thorough + Quick Learner
Competitive + Comprehensive
Honest + Transparent
Young + Mature
Innovative + Creative
More about us …What defines us ?
California
New Jersey Rotterdam
Pune
Envision Products |
Convert into businesses
100+ employees | 50+ live
products world-wide
The best of the Talent and
InfrastructureStarted 2003 | Focused Agile
Product Development
Self funded | Well funded |
Profitable
WhiteHedge
4
TABLE OF CONTENTS - OUR AGENDA
Containers
1
Use case
2
Orchestration
3
Introduction to ECS
4
Key Components
6
Architecture
7
Overview of Build Process
8
Why ECS?
5
CONTAINERS
WhiteHedgeWHAT ARE CONTAINERS?
OS virtualization
Process isolation
Images
Automation
Bins/Libs
Docker Engine
Bins/Libs
App2App1
Host OS
Server
Guest OS
Hypervisor
Guest OS
Bins/LibsBin/Libs
Host OS
Server
App1 App2 Container 1 Container 2
VM 1 VM 2
WhiteHedge
“auto mat es the deployment of anyapplicat ion as a lightweight, portable,self-sufficient container that will runvirtually anywhere”
CONTAINERS
USE CASE
WhiteHedgeUSE CASE
A highly available RESTful API server which fetchesdata from third-party services and serves its clients.
WhiteHedgeARCHITECTURE
WhiteHedgeCONTINUOUS DELIVERY WITH JENKINS
Build Image
Push Image
CodeDeploy
WhiteHedgeTHE PROBLEM
• A large monolithic application that was difficult to run, deploy, and scale.
• We were deploying a single docker container to run multiple processes.
• Docker was monitored and we were redeploying docker instance if the docker instance runs into problems.
• We used to evaluate capacity of EC2 instance manually and are running one container per instance
WhiteHedgeTHE CHALLENGE
• Use microservices architecture using docker
• Orchestration of dockers
• Replicate infrastructure to many regions
ORCHESTRATION
WhiteHedgeORCHESTRATION
Bins/Libs
Docker Engine
App1
Host OS
Server
Bins/Libs
App2
WhiteHedgeORCHESTRATION
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Docker Engine
Host OS
Server
Why EC2 Container Service?
WhiteHedgeWHY ECS?
• It is a managed service!
•Easy to integrate with other AWS services
• It is great for storing and enforcing task state
•Designed with custom schedulers in mind
•The agent code is available on a public GitHub repo and … it is in GO!
WhiteHedgeWHAT ELSE DID WE LOOK AT?
Home-grown Tech
Tried, but proved to be unreliable
Difficult to handle coordination and synchronization
Powerful but hard to productionize
Needs developers with Experience
Not a managed service, higher Opsload
“Amazon ECS enabled us to focus on releasing new software rather than spending time managing clusters”
Introduction to ECS
WhiteHedge
“a highly scalable, high performance containermanagement service that supports docker containersand allows you to easily run and manage Docker-enabled applications across cluster of EC2 instances”
WHAT IS ECS?
WhiteHedgeWHAT IS ECS?
• Building Block Service
• Easily Manage Clusters for Any ScaleNothing to runComplete stateControl and monitoringScale
• Flexible Container Placement• Designed for use with other AWS services• Secure• Extensible - Comprehensive APIs
WhiteHedgeKEY COMPONENTS
Container Instances
Clusters
Tasks
Run a task
Create a service
WhiteHedgeKEY COMPONENTS
• Amazon EC2 Instances
• Docker daemon
• Amazon ECS agent
Container Instances
Clusters
Tasks
Run a task
Create a service
WhiteHedgeKEY COMPONENTS
• Grouping of Container
Instances
• Resource pool
• Regional
• Start empty, dynamically
scalable
Container Instances
Clusters
Tasks
Run a task
Create a service
WhiteHedgeKEY COMPONENTS
• Unit of work
• Grouping of related
Containers
• Run on Container Instances
Container Instances
Clusters
Tasks
Run a task
Create a service
WhiteHedgeKEY COMPONENTS: TASK DEFINITIONS
{"environment": [],"name": "simple-demo","image": "my-demo", "cpu": 10,"memory": 500, "portMappings": [
{"containerPort": 80,"hostPort": 80
}],"mountPoints": [
{"sourceVolume": "my-vol", "containerPath":"/var/www/my-
vol"}
],"entryPoint": [
"/usr/sbin/apache2", "-D","FOREGROUND"
],"essential": true
},
{"name": "busybox","image":"busybox", "cpu": 10,"memory": 500, "volumesFrom": [{"sourceContainer": "simple-demo"}],"entryPoint"
: [ "sh","-c"
],"command": [
"/bin/sh -c \"while true; do/bin/date > /var/www/my-vol/date; sleep 1;done\""
],"essential": false
}
WhiteHedge
{"environment": [],"name": "simple-demo","image": "amazon/amazon-ecs-sample", "cpu": 10,"memory": 500, "portMappings":[
{"containerPort": 80,"hostPort": 80
}],"mountPoints": [
{"sourceVolume": "my-vol", "containerPath":"/var/www/my-
vol"}
],"entryPoint": [
"/usr/sbin/apache2", "-D","FOREGROUND"
],"essential": true
},
KEY COMPONENTS: TASK DEFINITIONS
Essential to ourtask
10 CPU units (1024 is full CPU), 500 megabytes ofmemory
Expose port 80 in containerto port 80 on host
Create and mount volumes
WhiteHedge
{"name": "busybox","image":"busybox", "cpu": 10,"memory": 500, "volumesFrom": [{"sourceContainer": "simple-demo"}],"entryPoint"
: [ "sh","-c"
],"command": [
"/bin/sh -c \"while true; do/bin/date > /var/www/my-vol/date; sleep 1;done\""
],"essential": false
}
KEY COMPONENTS: TASK DEFINITIONS
[{
"image": "tutum/wordpress-stackable", "name": "wordpress","cpu": 10,"memory": 500,"essential": true, "links": [
"db"],"entryPoint": [
"/bin/sh","-c"
],"environment": [
…],"portMappings": [
{"containerPort": 80,"hostPort": 80
}]
},]
From Docker Hub
Mount volume from othercontainer
Command toexec
WhiteHedgeKEY COMPONENTS
Good for short-lived containers,
e.g. batch jobs
Container Instances
Clusters
Tasks
Run a task
Create a service
WhiteHedgeKEY COMPONENTS
Good for long-running
applications and services
Container Instances
Clusters
Tasks
Run a task
Create a service
Typical user workflow
WhiteHedgeTYPICAL USER WORKFLOW
I want to run aservice
WhiteHedgeTYPICAL USER WORKFLOW
Run Instances AmazonEC2
Use custom AMI with Docker support and ECS Agent. Instances will register with default cluster.
WhiteHedgeTYPICAL USER WORKFLOW
Create Task Definition
Declare resourcerequirements forcontainers
Shared DataVolume
Node.jsApp Time of day App
WhiteHedgeTYPICAL USER WORKFLOW
Create Service
Declare resourcerequirements forservice
Shared DataVolume
Node.jsApp Time of day App
Elastic Load
Balancing
X 3
WhiteHedgeTYPICAL USER WORKFLOW
Describe Service
Architecture with ECS
WhiteHedgeARCHITECTURE
WhiteHedgeCONTINUOUS DELIVERY WITH JENKINS
Build Image
Push Image
Update ECS service
WhiteHedge
Features Without ECS Using ECS
High availability If any of the container dies, we
have to redeploy on all servers.
Restarts that container itself.
(Its a cluster management
system so it will always be in
desired state)
Managing number of
containers on a given EC2
instance
It will be complicated to run
and manage multiple
containers effectively.
Can manage multiple
containers.
Deployment method Handle deployments using
various methods.
(CodeDeploy, chef etc.)
ECS manages deployment of
new revision.
COMPARISON OF ARCHITECTURES
WhiteHedge
42
FOLLOW US
Questions?
http://www.whitehedge.com/devops.html
Swapnil [email protected]
- SOCIAL NETWORKS / PHONE
