The fundamentals of EC2 Spot

On-Demand

Pay for compute capacity by the hour with no long-term commitments For spiky workloads, or to define needs

AWS EC2 Consumption Models

Reserved

Make a low, one-time payment and receive a significant discount on the hourly charge For committed utilization

Spot

Bid for unused capacity, charged at a Spot Price which fluctuates based on supply and demand For time-insensitive or transient workloads

EC2  Best  prac-ces  

Fault  tolerance  

for  Spot

Stateless   Mul/-­‐AZ   Loosely  coupled   Instance  Flexibility  

¢

Spare capacity at scale

AWS has mil l ions of active customers in 190 countries. On average, every week, AWS customers are using more compute capacity on Amazon EC2 Spot than customers in 2012 were running across all of Amazon EC2.

With Spot the rules are simple

Markets where the price of compute changes based on

supply and demand

You’ll never pay more than your bid. When the market exceeds your bid you get 2 minutes to

wrap up your work

Capacity pools

AZ1

AZ2

Frankfurt Region

C3 C4 M4 I3 R4 D2

Shared

Dedicated

Shared

Dedicated

$0.27 $0.29 $0.50

1b 1c 1a

8XL

$0.30 $0.16 $0.21 4XL

$0.07 $0.08 $0.08 2XL

$0.05 $0.04 $0.04 XL

$0.01 $0.04 $0.01 L

C3

$1.76

On Demand

$0.88

$0.44

$.22

$0.11

Show me the markets!

Each instance family

Each instance size

Each Availability Zone

In every region

Is a separate Spot Market

50% Bid

75% Bid

You pay the market price

Bid Price Vs Market Price

25% Bid

¢

Amazon EC2 Spot – in the wild

1)  We make this easy using the Spot bid advisor

2)  With deliberate pool selection and bidding, you will keep your Spot instance as long as you need to.

3)  And with new features like Spot fleet diversified we do the heavy lifting for you...

¢

Spot Bid Advisor – aws-spot-labs ¢

Spot fleet helps you

Launch Thousands of Spot Instances with one RequestSpotFleet call.

Get Best Price Find the lowest priced horsepower that works for you. or Get Diversified Resources Diversify your fleet. Grow your availability. And Apply Custom Weighting Create your own capacity unit based on your application needs

¢

Using a single additional Parameter

Run continuously for up to 6 hours

Save up to 50% off On-Demand pricing

EC2 Spot block

$1 ¢

Example customer cases

Customer examples – Yelp

•  Seagull is Yelp’s distributed system for concurrent task execution

•  Seagull’s infrastructure costs were reduced by 85% by moving to Spot instances

Sea

gull

Infra

stru

ctur

e C

ost

Timeline (May 2015-April 2016)

55% reduction in costs after initial transition to spot instances

Additional 60% savings after transition to spot+autoscaling complete

Why use Spot – customer examples

Scaling up as many as 1000 Spot instances a day to handle real time ad delivery Petabyte-Scale Data Pipelines with Docker, Luigi and Elastic Spot Instances