scalability delivering the promise of the cloud

27
Scaling the Cloud with Scaling the Cloud with PaaS PaaS John Wetherill Ho Ming Li June 26, 2013

Upload: activestate

Post on 05-Dec-2014

508 views

Category:

Technology


0 download

DESCRIPTION

View the webinar recording here: http://www.activestate.com/webinars/scalabilitypromise Don't you wish you could do more than one thing at a time? The same goes for your cloud. What's the use of all this great raw computing power if your applications can't adapt to load requirements as demand fluctuates? Now, with Platform-as-a-Service, elastic scalability is not only possible in the cloud, but practical and necessary as well. In this webinar, John Wetherill and Ho Ming Li will address some of the challenges involved in scaling applications today and show how Stackato Private PaaS alleviates many of these issues. They will also cover: - Auto-scaling vs. manual scaling (semi-auto) - Scaling up or down - Costs of scaling - Resource planning - Monitoring and metrics - Designing to scale

TRANSCRIPT

Page 1: Scalability   delivering the promise of the cloud

Scaling the Cloud with PaaSScaling the Cloud with PaaS

John WetherillHo Ming LiJune 26, 2013

Page 2: Scalability   delivering the promise of the cloud

Today’s Speakers

John Wetherill Developer Evangelist

Ho Ming Li Cloud Engineer

Page 3: Scalability   delivering the promise of the cloud

Topics

Scaling in the Cloud

Scaling with PaaS

Measurement Tools

Best Practices/Antipatterns

Scaling in the Hybrid Cloud

Page 4: Scalability   delivering the promise of the cloud

Recent Events

Page 5: Scalability   delivering the promise of the cloud
Page 6: Scalability   delivering the promise of the cloud
Page 7: Scalability   delivering the promise of the cloud

often painfulnot always necessaryfrequently overdone

prerequisite: understanding

Scaling

Page 8: Scalability   delivering the promise of the cloud

scale from day onescale early and often

always profile before optimize

Practices

Page 9: Scalability   delivering the promise of the cloud

Scaling with Stackato

Page 10: Scalability   delivering the promise of the cloud

Using PaaS to Scale

Resource limits/management

load balancing

instant app scaling

auto-scaling

clustering and role distribution

performance monitoring

log aggregation

lxc containers

Page 11: Scalability   delivering the promise of the cloud

Resource Management

resources can be capped

per user and per app

memory/disk/URIs

log drains

services

Page 12: Scalability   delivering the promise of the cloud

Demo: resource caps

Page 13: Scalability   delivering the promise of the cloud

Load Balancing

automatically configured/enabled

round-robin between app instances

handles udp and tcp traffic

any port or protocol

Page 14: Scalability   delivering the promise of the cloud
Page 15: Scalability   delivering the promise of the cloud

Instant App Scaling

one-click spawn multiple instances

rapid launch by copying existing instance

adjust resource allocation too

scriptable, can be automated

can trigger “autoscaling” events

Page 16: Scalability   delivering the promise of the cloud

Demo: app scaling

Page 17: Scalability   delivering the promise of the cloud

Clustering / Role Distribution

multiple coordinating nodes

scale out

can be configured by CLI, API, or web ui

roles are assigned to individual nodes

multiple role instances (eg 3 routers)

Page 18: Scalability   delivering the promise of the cloud

Demo: Clustering

Page 19: Scalability   delivering the promise of the cloud

Log Aggregation

collect all logs from all app instances

forward to aggregation service

no SPOF

logs available via web ui, command line, and REST API

log streams can be filtered and formatted

can generate json logs

Page 20: Scalability   delivering the promise of the cloud

Demo: Logging to Loggly

Page 21: Scalability   delivering the promise of the cloud

Performance and Health Monitoring

monitor performance data

transactions / applications / websites

simple integration with third-party tools like New Relic

graphical view of cloud performance and resource usage

can trigger REST calls based on performance characteristics

scriptable, customizable

Page 22: Scalability   delivering the promise of the cloud

Demo: Stackato and New Relic

Page 23: Scalability   delivering the promise of the cloud

LXC Containers

safe isolation between applications

namespaces: processes, network, mount-points, hostname

port uniqueness, isolation, iptables

allows packing as many app instances into a VM as possible

Page 24: Scalability   delivering the promise of the cloud

Thank you!Thank you!

Any questions?Any questions?

John WetherillJohn Wetherill

Developer Evangelist, ActiveStateDeveloper Evangelist, [email protected]

@bcferrycoder

Ho Ming LiHo Ming Li

Cloud Engineer, Cloud Engineer, [email protected]

@HoReaL

Page 25: Scalability   delivering the promise of the cloud

Today’s Presenters:

Page 26: Scalability   delivering the promise of the cloud

Scaling Practices

measure

stateless

websockets

REST

Page 27: Scalability   delivering the promise of the cloud

Scaling Practices

meter monitor measure

quantify

session store - but no sticky session

scale out

mature optimization