alexpapadimoulis_racingthruthelastmileclouddeliverywebscaledeployment

8/22/2019 AlexPapadimoulis_RacingThruTheLastMileCloudDeliveryWebScaleDeployment

1/55

Racing Thru the Last Mile

Qcon London 2013

Alex Papadimoulis

@apapadimoulis

Cloud Delivery & Web-Scale Deployment


2/55

My 3 Bullet Point Rsum

Been in software for a while

Worked on a bunch of different systems

Worked at a bunch of different places


3/55

I founded

BuildMaster

DevOps in a box ProGet

NuGet for the enterprise


4/55


5/55

What is the Cloud?

EC2

Web SitesCloud Services

Virtual Machines

BeanstalkCloud Formation


6/55

What is Web Scale?


7/55

What is Web Scale?


8/55

What is Web Scale?


9/55

Scale of Web Scale

0

100000

200000

300000

400000

500000

600000

Google Facebook Twitter Wikipedia Growing Emerging

Number of Servers


10/55

Scale of Web Scale

1

10

100

1000

10000

100000

1000000

Google Facebook Twitter Wikipedia Growing Emerging

Number of Servers


11/55

Deployment Matters


12/55

Web-scale Deployments

Fast

Often

Reliable


13/55

Googles Secret Weapon

Same as Facebook

Same as Twitter


14/55


15/55


16/55

Twitters Murder


17/55


18/55


19/55


20/55

Applications

Services Auth

API UserAccount

Web Logon Search Uploader

User Files

CDNProxy

DataAccess


21/55

Environments

Int Test Staging Prod


22/55

ReleasesInitial Release Perfect


23/55

ReleasesInitial Release

Emergency Fix Crashes when Credit

Card is submitted


24/55


Emergency Fix

Another Emergency Fix

Orders randomly gomissing


25/55


Emergency Fix


New Features

RSS Feed

Sub-categories

Newsletter


26/55


Emergency Fix


New Features

More New Features

One-click Buy

Renewals

Favorites List


27/55

Releases1.0 - Initial Release

1.1 - Emergency Fix

1.2 - Another Emergency Fix

2.0 - New Features

2.5 - More New Features


28/55

Builds

Build 1 Integration Test Staging Prod


29/55

Builds




30/55

Builds





31/55

Promotions

Integration Test Staging Prod

Before Staging: Automated Acceptance Test Passed

Manual Smoke Test Passed

Release Issues Resolved


32/55

Deployments

Integration Test Staging Prod

Before Staging: Automated Acceptance Test Passed

Manual Smoke Test Passed

Release Issues Resolved

Staging Deployment:1. Transfer Files to tmpDir

2. Stop Web Services

3. Swap tmpDir and liveDir

4. Start Web Services


33/55

Common Terminology

Applications

Releases

Builds

Promotions

Deployments


34/55

Deployment

Distribution Delivery


35/55

Abstracting Delivery


36/55

Deliverables

Files

Database

Environmental


37/55

File Components

Staging Directory

Changed Files Only

Assets on CDN


38/55

Database Components

Cant Rollback

Backwards Compatibility (Deploy First)

Test via Staging


39/55

Environment Components

Reallycant rollback

Minimize

Application-only


40/55

Delivery Mechanism


41/55

Push Basics

servers = ["appsv1", "appsv2", "appsv3"];

for each (s in servers) {

transfer_files(s);

copy_config_file(s);

deploy_database(s);

set_environment(s);

}


42/55

Pull Basics

There are no basics


43/55

Pull Challenges

Instruction Complexity

Orchestration

Monitoring


44/55

Pull Helpers


45/55

Rollout Techniques


46/55

Live


47/55

Rolling


48/55

Rolling


49/55

Parallel


50/55

Parallel


51/55

Not Rollouts

Piloting

Feature Toggle


52/55

Cloud Delivery

Not Much, Really

Simplifies Environments

Simplifies Mistakes


53/55

Build Your Own Plan Application Segregation

Environments

Release Workflow

Delivery

Components

Push vs Pull Rollouts

Cloud Application


54/55

Build Integration Test Staging Prod

Build Test Staging Prod


55/55

Deployment Matters

@apapadimoulis

[email protected]

alexpapadimoulis_racingthruthelastmileclouddeliverywebscaledeployment

Documents