how to run a 1,000,000 vu load test using apache jmeter and blazemeter

785 Castro Street, Mountain View, CA 94041 | 1.855.445.2285 | [email protected]

How to Run a Test for 1M Users Backend Tes6ng (Mobile, Web & API)

Alon Girmonsky Founder & CEO

@blazemeter 785 Castro Street, Mountain View, CA 94041|1.855.445.2285|[email protected]

Are You Sure?

•  Question: Do you really need to test a concurrency level of 1M users?

Answer: a.  I only need 1M named users b.  I really expect to have 1M concurrent open

sessions c.  I don’t know


Things to Consider

•  The Script •  The Performance Lab •  Running the Test •  Understanding the Results •  Test Iterations


Comprehensive ScripGng at Your FingerGps

How Do I Write the Script?

JMeter is the most commonly used open source web, mobile and API backend tesGng soluGon. BlazeMeter is 100% compaGble with JMeter

HTTP / HTTPS

Login / Signup

Form POSTing / Credit Card Transac6ons

Rest / Web Services / JSON

Parameters Extrac6on ( JSON / RegEx / Xpath )

Mobile

Mongo, MSSQL, Oracle SQL, MySQL

Mul6ple User Profiles


Apache JMeter


Things to Consider

ü The Script •  The Performance Lab • Running the Test • Understanding the Results •  Test Iterations


Challenges (1/3)

The Performance Lab

•  Resources. Are they: –  Sufficient? –  Strong? –  Dedicated?

•  Bandwidth –  Can I saturate my system? –  Is the load network stable?

•  Throughput –  Can I generate enough hits per second?


Challenges (2/3)

The Performance Lab

•  Load Distribution – Will the load be evenly distributed across

resources? •  CDNs

–  Am I testing a CDN (e.g. Akamai)? –  Is the test realistic? – Will I avoid traffic shaping?


Challenges (3/3)

The Performance Lab

•  DDOS –  Can I avoid triggering DDOS mechanisms?

•  Load Balancers –  Can I handle the load balancers properly (e.g.

close TCP connections on time)?


4,400 CPU Cores & 16.5 TB of Memory

The JMeter Super Computer

Load Engine Type: m3.xlarge CPU: 4 Cores Memory: 15 GB BW: 100Mbps Max TPS: 1K

1,000 X

= 1M Users


Load Cluster = Console + 10 Engines

1+10 X




CPU: 44 Cores Mem: 165 GB BW: 1 Gbps M/TPS: 10K

1,000 X

= 1M Users


Super Cluster = 100 X Load Clusters

Load Cluster = Console + 10 Engines

1+10 X




CPU: 44 Cores Mem: 165 GB BW: 1 Gbps M/TPS: 10K

CPU: 4,400 Cores Mem: 16.5 TB BW: 100 Gbps M/TPS: 1M

100 X

= 1M Users


Up to 1M Users, Mul6 GEO, 100% Apache JMeter Compa6ble

Performance Lab in a Box


Things to Consider

ü The Script ü The Performance Lab • Running the Test • Understanding the Results •  Test Iterations


Challenges

Running the Test

•  Time-to-test should be minutes •  Synchronizing all the servers to start at once •  Crunching the data

–  4GB of data per hour


Time-‐to-‐Test < 2 Minutes

Running a Test With 1M Users


Things to Consider

ü The Script ü The Performance Lab ü Running the Test • Understanding the Results •  Test Iterations


What To Look For

"We'd like to squeeze in a load test for XXXX's biggest event of the year, the Fantasy Football season. Our best opportunity to execute this is tonight at 3-7am EST. We'd like to generate a constant 40,000 hits/sec for about 1 hour. .."

Tradi6onally this would have taken weeks and cost $$$

“This would have been a disaster for our most important day of the year. BlazeMeter really saved our bacon here. …. and kudos on the success!"


Time-‐to-‐Test < 2 Minutes

Running a Test With 1M Users


The Load Sensi6vity Point

What To Look For


NewRelic Integra6on

Capture Monitoring Data Capture Load Testing Data Ask the Test Data any Question


Things to Consider

ü The Script ü The Performance Lab ü Running the Test ü Understanding the Results •  Test Iterations


Run Load Test

Analyze Client Performance

Analyze Server

Performance

Update Back End Code /

Infrastructure

Run as Many Itera6ons as Needed – and More!

Performance Op6miza6on

•  Load + Results •  Look outside & within

–  App KPIs –  Load KPIs

•  Run hundreds of iterations


Made for Developers, Time-‐to-‐Test < 2 min

Tes6ng Can Save Your Day!

•  Run dozens to hundreds of test iterations •  Run once, then automate •  Test continuously

Ø  A Superior Product Ø  A Faster Release Cycle

THANK YOU FOR YOUR TIME!

Q & A

For more information: BlazeMeter.com/blog/ [email protected] @BlazeMeter

how to run a 1,000,000 vu load test using apache jmeter and blazemeter

Technology