deployment checkup: how to regularly tune your cloud environment - rightscale compute 2013

45
april25-26 sanfrancisco cloud success starts here Deployment Checkup: How to Regularly Tune Your Cloud Environment Brian Adler, Sr. Services Architect, RightScale

Upload: rightscale

Post on 09-Jul-2015

144 views

Category:

Technology


0 download

DESCRIPTION

Speaker: Brian Adler - Sr. Services Architect, RightScale Periodic reviews of your cloud deployments are as important as a regular oil change and tune up at your mechanic. We will cover our RightScale deployment checklist to root out issues with server utilization, cost optimization, multi-zone balancing, auto-scaling, high-availability configuration, security groups, IP address assignment, security patching, and manual changes. You will leave with an easy-to-follow maintenance schedule for your cloud environment.

TRANSCRIPT

Page 1: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

april25-26

sanfrancisco

cloud success starts here

Deployment Checkup: How to Regularly

Tune Your Cloud Environment

Brian Adler, Sr. Services Architect, RightScale

Page 2: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#2#2

#RightscaleCompute

Tune Ups - Why They Make Sense

• Over time, deployments grow organically

• Some things are done quickly to solve an immediate issue and

are never readdressed

• “If it ain’t broke, don’t fix it”

• Squeaky wheels get the grease. But over-greased wheels tend

to get ignored – and can be costly

Page 3: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#3#3

#RightscaleCompute

Whys and Whats

• Deployment Checkups (the “why”)

• Cost

• Performance

• Best Practices

• Deployment Considerations (the “what”)

• Cost Optimization

• Server Utilization

• High Availability and Disaster Recovery (HA/DR) Implementation

• Security

• Best Practices

Page 4: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#4

#rightscalecompute

Deployment Checkup

Cost Optimization

Page 5: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#5#5

#RightscaleCompute

Cost Optimization

• Unused/Unneeded Resources

Page 6: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#6#6

#RightscaleCompute

Cost Optimization

• Unused/Unneeded Resources

Page 7: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#7#7

#RightscaleCompute

Cost Optimization

• Unused/Unneeded Resources

Page 8: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#8#8

#RightscaleCompute

Cost Optimization

• Unused/Unneeded Resources

Page 9: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#9#9

#RightscaleCompute

Cost Optimization

• Unused/Unneeded Resources

• EBS Volumes

Page 10: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#10#10

#RightscaleCompute

Cost Optimization

• Unused/Unneeded Resources

• EBS Snapshots

Page 11: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#11#11

#RightscaleCompute

Cost Optimization

• Unused/Unneeded Resources

• EIPs

Page 12: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#12#12

#RightscaleCompute

Cost Optimization

• Unused/Unneeded Resources

• S3 objects

Page 13: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#13#13

#RightscaleCompute

Cost Optimization

• Storage

• Don’t over-allocate initially. Increase capacity when needed.

Page 14: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#14#14

#RightscaleCompute

Cost Optimization

• Bandwidth

• Cross-AZ• Generally acceptable/recommended for HA configurations

• Cross-region/cloud• Compress/Optimize

Page 15: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#15

#rightscalecompute

Deployment Checkup

Server Utilization

Page 16: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#16#16

#RightscaleCompute

Server Utilization

• Choose the right sized instance for the task at hand

• Utilize Reserved Instances (PlanForCloud can be of great

benefit here)

Something odd happened around this time…use alerts to

be notified and load testing to find the right instance size for the task

Page 17: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#17#17

#RightscaleCompute

Server Utilization

• CPU affinity

• taskset

• irqbalance

Spread the load

if/when possible

Page 18: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#18#18

#RightscaleCompute

Server Utilization

• Memory

• Numerous different memory options – find the right fit• 613 MiB instances through 244 GiB instances

Page 19: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#19#19

#RightscaleCompute

Server Utilization

• Load average

• Good indicator of overall capacity utilization

• 1.0 x Number of Cores = fully utilized

Page 20: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#20#20

#RightscaleCompute

Server Utilization

• Monitoring and Alerts

• Use them! Find small problems before they become big problems

• Look for trends and act on them (not on spikes or anomalies)

• Look for underutilization as well as overutilization

Page 21: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#21

#rightscalecompute

Deployment Checkup

High Availability and Disaster Recovery

Page 22: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#22#22

#RightscaleCompute

HA/DR Considerations

• Avoid single points of failure (SPOF)

• Use Availability Zones (AZ) to your benefit

• Always place one of each component (load balancers, app servers,

databases) in at least two AZs

• Replicate data across AZs (HA) and backup or replicate across

regions/clouds for failover (DR)

• Setup monitoring, alerts and operations to identify and

automate problem resolution or failover process

Page 23: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#23#23

#RightscaleCompute

HA/DR Implementation

• Availability Zone Distribution

Page 24: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#24#24

#RightscaleCompute

HA/DR Implementation

• Availability Zone Distribution

Page 25: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#25#25

#RightscaleCompute

HA/DR Implementation

• Availability Zone and Regional Distribution

Page 26: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#26#26

#RightscaleCompute

HA/DR Implementation

• Availability Zone and Regional Distribution

Page 27: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#27#27

#RightscaleCompute

HA/DR Implementation

• Availability Zone and Regional Distribution

Page 28: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#28#28

#RightscaleCompute

HA/DR Implementation

• Availability Zone and Regional Distribution

Page 29: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#29#29

#RightscaleCompute

HA/DR Implementation

• Availability Zone and Regional Distribution

Page 30: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#30#30

#RightscaleCompute

HA/DR Implementation

• Availability Zone and Regional Distribution

Page 31: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#31#31

#RightscaleCompute

HA/DR Implementation

• Availability Zone and Regional Distribution

Page 32: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#32

#rightscalecompute

Deployment Checkup

Security

Page 33: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#33#33

#RightscaleCompute

Security

• Security Groups

Page 34: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#34#34

#RightscaleCompute

Security

• iptables

Page 35: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#35#35

#RightscaleCompute

Security

• iptables

Page 36: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#36#36

#RightscaleCompute

Security

• iptables

Page 37: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#37#37

#RightscaleCompute

Security – OS Patching

• Upcoming ServerTemplate release (v13.4) will have recipes to:

• Unfreeze Security repos on Ubuntu

• Unfreeze Upstream repos on CentOS

• Perform security update

Page 38: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#38

#rightscalecompute

Deployment Checkup

Best Practices

Page 39: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#39#39

#RightscaleCompute

Best Practices

• Image Bundling - Friends don’t let friends bundle

• Use ServerTemplate with base RightImage

• Configure server at boot time

• Use EBS-backed images to speed boot times if needed

• Rare case where bundling is recommended• Manual install of software required

• Boot time is unacceptably long to respond to dynamic event

Page 40: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#40#40

#RightscaleCompute

Best Practices

• No SPOF

• Distribute servers in each tier across multiple AZs

• Use Deployments as Application containers

Page 41: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#41#41

#RightscaleCompute

Best Practices

• Commit your ServerTemplates (don’t use HEAD)

Page 42: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#42#42

#RightscaleCompute

Best Practices

• Use Credentials for all sensitive inputs

Page 43: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#43#43

#RightscaleCompute

Best Practices

• Use autoscaling in combination with right-sized instances for

the task at hand

• Automate all operations – no manual changes

• Reboot – all is lost

• Automation is documentation

Page 44: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

#44#44

#RightscaleCompute

Summary

• Deployment sprawl can lead to cost and operational

inefficiencies

• Cost Optimizations can be found hiding in many places

• Find the right size resource for the job

• Don’t use a hammer if it ain’t a nail

• High Availability should be designed in from the start

• Look for SPOF and find ways to eliminate them

• Disaster Recovery can be affordable

• Security – open up only what you have to

• Best Practices promote operational efficiencies

Page 45: Deployment Checkup: How to Regularly Tune Your Cloud Environment - RightScale Compute 2013

april25-26

sanfrancisco

cloud success starts here

Questions?