10 tips to improve the performance of your aws application

© 2014 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.

10 Tips to Improve the Performance of Your AWS Application

Ran Tessler, AWS Solutions Architect

([email protected])

September 17, 2014

Agenda

• Why Performance Matters?

• Defining Performance Goals

• Identifying Performance Bottlenecks

• 10 Performance Tips

performance/pəˈfɔːm(ə)ns/

The capabilities of a machine, product, or vehicle…

Why Performance Matters?

• Better user experience– E.g., Page load time, Report generation

• Meeting required performance threshold – E.g., Real Time Bidding, Online media

• Improve cost-performance ratio– TCO

– Business model validity

Defining Performance Goals

We need X to perform Y

given restriction Z

We need our online video engine to generate videos

faster than being consumed

We need our e-commerce websiteto handle up to 1,000 transactions

per second

Identifying Performance Bottlenecks

Is my workload bound by…

• CPU

• Memory

• Disk I/O

• Network I/O

• System architecture, design

Use Amazon CloudWatch metrics

Bound by CPU

Bound by IOPS

And finally for our …

10 TIPS

Improving COMPUTE Performance

Match EC2 instance type to workloadTIP #1

• Choose EC2 instance family– M3, T2 General Purpose

– C3 Compute Optimized

– R3 Memory Optimized

– G2 GPU

– I2, HS1 Storage Optimized

• Use current generation instances– Migrate previous generation instances.

– E.g., m1.large -> m3.large: 50% CPU performance, 20% price per hour

• Tune instance size– micro, small, medium, large, xlarge, 2xlarge, 4xlarge, 8xlarge

Use burstable compute for burstable workload

• Need occasional bursts• Average CPU utilization is low

Web servers Developer environments Build servers Small databases …

Underutilized CPU

TIP #2

Use burstable compute for burstable workloadTIP #2

T2 - New Low-Cost General Purpose EC2 instances

Jul 1, 2014

Baseline level of CPU performance

Ability to burst above the baseline


• Hourly CPU Credit Allowance

• CPU Credit = 1 minute 100% Core


Jul 1, 2014


• Hourly CPU Credit Allowance


• CPU Credit Balance:24 hour accumulation


Jul 1, 2014



Jul 1, 2014 • Hourly CPU Credit

Allowance


• CPU Credit Balance:24 hour accumulation

Improving STORAGE Performance

Use EBS General Purpose (SSD) by defaultTIP #3

Volume TypeEBS Magnetic

Storage Media Magnetic-backed

Max IOPS 40-200

Max Throughput 40-90 MBps

Latency (random read) 20-40 ms

API Name standard

Price* $.05 /GB - Month

$.10 /million I/O

* Prices shown in US East (N Virginia)



EBSProvisioned IOPS (SSD)

Storage Media Magnetic-backed SSD-backed

Max IOPS 40-200 4,000

Max Throughput 40-90 MBps 128 MBps

Latency (random read) 20-40 ms 1-2 ms

API Name standard io1


$.10 /million I/O

$.125 /GB – Month

$.065 /provisioned IOPS




EBS General Purpose (SSD)

EBSProvisioned IOPS (SSD)

Storage Media Magnetic-backed SSD-backed SSD-backed

Max IOPS 40-200 3,000 (burst) 4,000

Max Throughput 40-90 MBps 128 MBps 128 MBps

Latency (random read) 20-40 ms 1-2 ms 1-2 ms

API Name standard gp2 io1


$.10 /million I/O

$.10 /GB - Month $.125 /GB – Month

$.065 /provisioned IOPS



• 3 IOPS per GB per second• Unused IOPS accumulate up to 5.4M• Burst up to 3,000 IOPS• Initial credit of 5.4M IOPS = 30 minutes 3,000 IOPS

How It Works


• EBS Magnetic– 40-200 IOPS– $0.40+ IO /month

• General Purpose (SSD)– 3,000 IOPS for 30 minutes– 24 IOPS baseline (8 GB x 3)– $0.80 /month

8 GB - Boot Volumes

Faster boot time!


• Provisioned IOPS– 3,000 IOPS– $323 /month

• General Purpose (SSD)– 3,000 IOPS (1,024 GB * 3 > 3,000)– $102.4 per month

1 TB - Large Data Volumes

68% cost reduction

Use Instance Store volumes for temporary data

• Temporary block-level storage • Physically attached to host machine• Available to most EC2 instance types• No additional cost

TIP #4

Temporary file storage Tmp folder Swap space …

Host Computer 1 Host Computer 2

With Amazon S3 – Think ParallelTIP #5

• Single OP bound by transfer rate• Parallel work



• With Multiple Objects … Parallel GETs



• With Multiple Objects … Parallel GETs Parallel PUTs


?



• With Large Objects …




• With Large Objects … Multipart Upload




• With Large Objects … Multipart Upload Parallel range GETs


TransferManager tm = new TransferManager(new ProfileCredentialsProvider());

// TransferManager processes all transfers asynchronously.Upload upload = tm.upload(bucketName, keyName, new File(filePath));try {

// You can block and wait for the upload to finishupload.waitForCompletion();

} catch (AmazonClientException amazonClientException) {...

}

Use AWS CLI and SDKs

Improving NETWORK Performance

Use Enhanced Networking

• Single root I/O virtualization (SR-IOV)• Significantly higher Packets Per Second (PPS)• Lower network jitter• Lower latency

Requirements • R3, C3 & I2 instances• HVM instances• VPC

TIP #6

SR-IOV

Use EBS Optimized instances for EBS dedicated throughput

• Network traffic and EBS throughput use same

bandwidth

TIP #7

web appserver

EBS



bandwidth

• Disk and Network intensive I/O workloads may lead to

contention

TIP #7

web appserver

EBS



bandwidth

• Disk and Network intensive I/O workloads may lead to

contention

• EBS Optimized EC2 instances deliver dedicated EBS

throughput

TIP #7

web appserver

EBS

Improving SYSTEM WIDE Performance

Website Performance

LONG DISTANCE + POOR NETWORK =

SLOW LOAD TIME

TIP #8

Dynamic Content

or

Custom OriginElastic LoadBalancing

Amazon EC2

Static Content

or

Custom OriginAmazon S3

www.example.com/*.php

static.example.com/*.jpg

Accelerate Websites using Amazon CloudFront

TIP #8

Dynamic Content

or


Amazon EC2

Static Content

or


www.example.com/*.php

cdn.example.com/*.jpg

Amazon CloudFront


TIP #8

Dynamic Content

or


Amazon EC2

Static Content

or


www.example.com

Amazon CloudFront


TIP #8

Dynamic Content

or


Amazon EC2

Static Content

or


www.example.com

Amazon CloudFront


Lower Latency

Higher Throughput

TIP #8

Dynamic Content

or


Amazon EC2

Static Content

or


www.example.com

Amazon CloudFront


Persistent Connections Monitored Network Paths

Lower Latency

Higher Throughput

TIP #8

Static Content

or


Amazon CloudFront



Lower Latency

Higher Throughput

SHORT DISTANCE

TIP #8 Accelerate Websites using Amazon CloudFront


Lower Latency

Higher Throughput

SHORT DISTANCE

OPTIMIZED NETWORK

TIP #8 Accelerate Websites using Amazon CloudFront


Lower Latency

Higher Throughput

SHORT DISTANCE

OPTIMIZED NETWORK

= FASTER

LOAD TIME

Offload SSL terminationTIP #9

Elastic LoadBalancing Amazon EC2

SSL

https://https://

Offload SSL terminationTIP #9

Elastic LoadBalancing Amazon EC2

SSL

https://

Reduce load on EC2 instances Easier management

ELB SSL Termination

Last but not least…

Optimize for what matters

• Optimize against performance goals• Optimize for most important use cases

TIP #10


• Amazon Redshift for online reports

TIP #10

Example:

1 TB


• Amazon Redshift for online reports• Data is growing fast

TIP #10

Example:

5 TB


• Amazon Redshift for online reports• Data is growing fast• Over 10 TB of compressed data … and …

TIP #10

Example:

10 TB


• Amazon Redshift for online reports• Data is growing fast• Over 10 TB of compressed data … and …

TIP #10

Example:

Dense StorageHDD

Fast

$1,000 / TB / Year

Dense ComputeSSD

Faster

$5,500 / TB / year?

* 3 Year Reserved Instance Pricing


• Data goes back 3 years• 95% of queries are on last 1 month

TIP #10

Example:

Dense StorageHDD

Fast

$1,000 / TB / Year

Dense ComputeSSD

Faster

$5,500 / TB / year?

* 3 Year Reserved Instance Pricing



TIP #10

Example:

Hot Cluster Dense Compute

500 GB

Last month (95%)



TIP #10

Example:

Hot Cluster Dense Compute

500 GB

Cold Cluster Dense Storage

10 TB

Over a months (5%)

Key Takeaways• Match EC2 instance type to workload • Use burstable compute for burstable workload

• Use EBS General Purpose (SSD) by default • Use Instance Store volumes for temporary data• With Amazon S3 – Think Parallel

• Use Enhanced Networking• Use EBS Optimized instances for EBS dedicated throughput

• Accelerate Websites using Amazon CloudFront• Offload SSL termination• Optimize performance for what matters to your business

Compute

Storage

Network

Architecture

Thank You!

Ran [email protected]

10 tips to improve the performance of your aws application

Technology

storage media

instance store

ebs general

ebs optimized

online reports

multiple objects

matters amazon

tip 8accelerate