apica presentation, cloud & hosting theatre

1

Protect yourself through scaling in the Cloud

How to survive the perfect storm

Web Performance as a Cloud Service

Test, Analyze, Monitor and Improve Web Performance

3

Industry Expertise

Gaming eRetail Finance

Telecom

Travel

MediaCloudPublic Sector

4

Load testing Service Scales via Amazon Cloud and Apica’s own ISP Resources

Dynamic scaling in Amazon Cloud Inside agents monitoring vital signs together with Amazon Cloudwatch Loadtest execution and result collection integrated with Amazon AWS API

More then 100,000 concurrent users2,000,000 users in 15 minutes

5

Monitoring Network

Worldwide Monitoring Network > 200 locations

In most big clouds and data centers, run rate > 500,000,000 total checks in 2012

US

Egypt

UK/Europe

Brazil

Australia

Singapore

Russia Moscow

BeijingBostonBoston

Portugal

Spain

Ireland

United Kingdom

Norway

Sweden

Finland

Poland

GreeceItaly

France

Russia

UkraineBelgium

Seattle

San Francisco

Los Angeles

Phoenix

Houston

Dallas

Denver

Miami

Atlanta

New York

ClevelandChicago

Minneapolis

WASHINGTON D.C

PortlandBoston

Canada

6

Planning for Unlimited Website Loads

7

Business challenge – handling peak web loads

Many sites unprepared for: Holiday sales spikes New product launches Extreme weather events Major announcements

Response time

No. of users

Lost business

Time

Time

PeakHour

8

Can you handle the perfect storm?

9

Key Challenges

How to Scale ?– Need for quick ramp up in

capacity – Cloud & Physical Backend

  How to work with fixed capacity ?– Fixed capacity on DB or

backend  What to do when peak load is

unlimited ?– No way to control overload vs. capacity

10

Scaling with Cloud

11

Scaling

12

How much capacity do you actually need?

Large

Medium

Small

13

Why LoadTest Cloud

Planning proactive cloud scaling– A capacity test provides the metrics to identify

the infrastructures limits

– Cloud application managers can act proactively

before performance is degraded

Actual capacity of adding new servers – Doubling server capacity doesn’t mean the

application can handle double the load.

– Capacity testing shows what the new user capacity is.

Test failover procedures – During peak loads and in multi-tenancy

environments– “Work out the kinks” of their failover procedures

before they really need it.

14

Dynamic Queing

All applications have a maximum load level– Load start page

– Deliver dynamic content

– Database transactions

Exceeding limits typically lead to a crash

Implement Queing

15

Case:

16

How it works

Customer site

1

2

Apica Connection Control

3

Cloud FarmWait page/Emergency

Site

Web front

User

17

Key Features Unlimited Capacity – designed to handle the largest possible

unexpected event loads, beyond 100,000 concurrent users per minute

Flexible subscription – ready to take over on a moments notice, or use it 24/7/365 ongoing operation

Dynamic Queuing Management – reroutes excess users to “wait page”; reroutes queued users to a separate network

Real Time Monitoring – displays user response times and application performance

Easy Setup – can by used by any website or service regardless of its host location or ISP.

18

To sum it up

Perform a pre-event load test

1

Analyse Optimize Capacity

planning

2

Plan for worst case scenarios

Scaling rules Failover

3

Handle overload

Fire drill Monitoring

4

All systems have weak points – Where are yours?

19

Thank You!