cost optimisation on aws
TRANSCRIPT
How to make your funding go further
LOWER COSTS WITH THE AWS CLOUD
2 31 4Replace up-front
capital expense with low variable cost
Save more money as you grow bigger
Economies of scale allow AWS to continually
lower costs
Pricing model choice to support variable &
stable workloads
LOWER COSTS THAN ON-PREMISES
On-PremisesTraditional
Data Centre
On-PremisesVirtualised
Data Centre
AWS
CAPEXCAPEX
OPEX
OPEX
OPEX
Cost savings from running internal IT more efficiently
Cost savings from moving to a cloud provider
AWS Scale • Multiple new data centres built each year• Volume purchasing, highly automated
supply chain optimisation
Utilisation fundamentally higher in the AWS Cloud
• Aggregating non-correlated workloads, scale, spot market
Amazon specific hardware designs • OEM acquisition of custom servers and
networking equipment• Direct purchasing of memory, disk & CPU• AWS controlled hypervisor and network
protocol layers
AWS PRICING PHILOSOPHY
More AWS Usage
More Infrastructure
More Customers
Lower Infrastructure
Costs
Economies of Scale
Reduced Prices
EcosystemGlobal FootprintNew FeaturesNew Services
InfrastructureInnovation
47PRICE REDUCTIONS
We pass the savings along to our customers in the form of low
prices and continuous reductions
Flipboard Example: Handling objection AWS gets expensive as you grow big…
COST OPTIMISATION TIPS & TRICKS
1. CHOSE THE RIGHT INSTANCE TYPES
Choose an instance that best meets your basic
requirements
Start with memory & then choose closest virtual cores
Assess peak IOPS storage requirements
Run multiple instances in multiple Availability Zones
Change instance size up or down based upon
monitoring
Use CloudWatch & Trusted Advisor to assess
START DEPLOY & SCALETUNE
2. USE AUTO SCALING
LAUNCH CONFIGURATION
Describes what Auto Scaling will create when adding Instances
Only one active launch configuration at a time
as-‐create-‐launch-‐config -‐-‐image-‐id ami-‐54cf5c3d -‐-‐instance-‐type m1.small -‐-‐key mykey -‐-‐group webservers -‐-‐launch-‐config 101-‐launch-‐config
AUTO SCALING GROUP
Auto Scaling managed grouping of EC2 instances
Automatically scale the number of instances by policy
as-‐create-‐auto-‐scaling-‐group 101-‐as-‐group -‐-‐availability-‐zones us-‐east-‐1a us-‐east-‐1b -‐-‐launch-‐configuration 101-‐launch-‐config -‐-‐load-‐balancers myELB -‐-‐max-‐size 5 -‐-‐min-‐size 1
AUTO SCALING POLICY
Parameters for performing an Auto Scaling action
Scale Up/Down and by how much
as-‐put-‐scaling-‐policy 101ScaleUpPolicy -‐-‐auto-‐scaling-‐group 101-‐as-‐group -‐-‐adjustment=1 -‐-‐type ChangeInCapacity -‐-‐cooldown 300
00:00 01:00 02:00 03:00 04:00 05:00 06:00 07:00 08:00 09:00 10:00 11:00 12:00 13:00 14:00 15:00 16:00 17:00 18:00 19:00 20:00 21:00 22:00 23:00
UTILISATION & AUTO SCALING GRANULARITY
00:00 01:00 02:00 03:00 04:00 05:00 06:00 07:00 08:00 09:00 10:00 11:00 12:00 13:00 14:00 15:00 16:00 17:00 18:00 19:00 20:00 21:00 22:00 23:00
UTILISATION & AUTO SCALING GRANULARITY
41 Instance Hoursm3.large @ $0.154/hr
= $6.314/day
00:00 01:00 02:00 03:00 04:00 05:00 06:00 07:00 08:00 09:00 10:00 11:00 12:00 13:00 14:00 15:00 16:00 17:00 18:00 19:00 20:00 21:00 22:00 23:00
UTILISATION & AUTO SCALING GRANULARITY
70 Instance Hourst2.small @ $0.028/hr
= $1.96/day
69% SAVING
3. TURN OFF UNUSED INSTANCES
Development/test instances
Simple instance stop/start
Tear down & build rapidly
Treat resources as disposable
Deployment & Management
Containers
Dev/ops Tools
Resource Templates
Usage Tracking
Monitoring and Logs
00:00 01:00 02:00 03:00 04:00 05:00 06:00 07:00 08:00 09:00 10:00 11:00 12:00 13:00 14:00 15:00 16:00 17:00 18:00 19:00 20:00 21:00 22:00 23:00
4. USE RESERVED INSTANCES
100%
75%
58%
38%
13%
8%
On Demand Instance
Reserved Instance
AWS SERVICES OFFERING RESERVATIONS
Amazon EC2
up to 75% savings
Amazon RDS
up to 76% savings
Amazon DynamoDB
up to 76% savings
Amazon Redshift
up to 73% savings
Amazon ElastiCache
up to 70% savings
5. USE SPOT INSTANCES
Pricing Up to 92% discount
Elastic Capacity not otherwise available
Tradeoff Potential for interruption
USING SPOT INSTANCES FOR HPC WORKLOADS
Case Study
Building a Top500 HPC Cluster on AWS
0
18
35
53
70
On-Premises AWS
$68M
$33K
Cost Comparison
1.21 PFLOPS, 16,788 EC2 Instances in 8 Regions, 264 years of computing in 18 hours
6. MAKE USE OF APPROPRIATE STORAGE CLASSES
AWS Cloud
Amazon Glacier
Gateway Appliance/ AWS Storage Gateway
Amazon S3
Block File
On-premises Data Center
Archive Backup Disaster Recovery
Amazon EBS
Amazon S3 Reduced Redundancy • 99.99% durability vs. 99.999999999% • Up to 20% savings • Great for everything that is easy to
reproduce
Amazon Glacier • Same durability as S3 • 3 to 5 hours restore time • Up to 67% savings • Great for archiving, long-term
backups and cold or old data
7. OFFLOAD FROM YOUR ARCHITECTUREThe more you can offload, the less infrastructure you need to maintain, scale and pay for
• Offload traffic to Amazon CloudFront and S3
• Introduce Caching
No CDN
Res
pons
e Ti
me
Inst
ance
Loa
d
Res
pons
e Ti
me
Inst
ance
Lo
ad
CDN for Static
Content
Res
pons
e Ti
me
Inst
ance
Lo
ad
CDN for Static & DynamicContent
8. USE SERVICES, DON’T REINVENT THE WHEEL
Infrastructure Regions Availability Zones Points of Presence
Enterprise
ApplicationsVirtual Desktops Sharing & Collaboration
Core Services Storage (Object, Block and Archival)
Compute (VMs, Auto-scaling and Load Balancing)
Databases (Relational, NoSQL, Caching)
Networking (VPC, DX, DNS)
CDN
Access Control
Usage & Resource Tracking
Monitoring and Logs
Administration & Security
Key Storage & Management
Identity Management
Service Catalog
Platform Services
Deployment & ManagementOne-click web app deployment
Dev/ops resource management
Resource Templates
Push Notifications
Mobile Services
Identity
Sync
Mobile Analytics
App ServicesQueuing & Notifications
Workflow
App streaming
Transcoding
Search
Analytics
Hadoop
Data warehouse
Data Pipelines
Real-time Streaming Data
Code Deploy
Code Pipeline
Code Commit
AVOID UNDIFFERENTIATED HEAVY LIFTING
Amazon Relational Database Service (RDS)
Elastic Load Balancing
Amazon Simple Queue Service (SQS)
Amazon ElastiCache Amazon Elastic MapReduce
Amazon Simple Notification Service (SNS)
9. USE CONSOLIDATED BILLING
• Receive a single bill for all charges incurred across all linked accounts• Share RI discounts• Combine tiering benefits
10. TAKE ADVANTAGE OF AWS TOOLS
AWS Trusted Advisor AWS EC2 Usage Reports
Follow us fo
r more
events
& webina
rs
@AWScloud for Global AWS News & Announcements
@AWS_UKI for local AWS events & news
@IanMmmmIan Massingham — Technical Evangelist