agile, cloud computing, open source and …...agile performance testing cloud computing + open...

18
Jenkins User Conference Israel #jenkinsconf Alon Girmonsky @alongir July 16, 2014 AGILE, CLOUD COMPUTING, OPEN SOURCE AND WHAT’S IN BETWEEN (backend testing in the agile-age) #jenkinsconf

Upload: others

Post on 28-May-2020

18 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

Alon Girmonsky @alongir July 16, 2014

AGILE, CLOUD COMPUTING, OPEN SOURCE AND WHAT’S IN BETWEEN (backend testing in the agile-age)

#jenkinsconf

Page 2: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

Hands-On Developer for the Past 20 Years Expertise

–  Large-Scale Web and Mobile Applications

–  IP & Internet

Founder & CEO of

A Load Testing Platform as a Service –  100% Compatible with Apache JMeter

ABOUT THE SPEAKER

Alon Girmonsky c

c

c

c

USERS

50,000

TESTS

500,000

Page 3: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

THE AGILE ENTERPRISE

All organizational divisions - not just R&D

It’s about survival in a highly competitive business environment

Innovate in short Iterations – a MUST!

New DNA

New IT Infrastructure (a.k.a Devop)

c

c

c

c

c

Page 4: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

AGILITY ENABLERS

Open Source

Cloud Computing

E.G E.G

Page 5: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

Agile? What it Means?

"We'd like to squeeze in a load test for XXXX’s biggest event of the year, Fantasy Football season. Our best opportunity to execute this is tonight 3-7am EST. We'd like to generate a constant 40,000 hits/sec for about 1 hour. .." * Traditionally this would have taken weeks and cost $$$

An Example from a Large Media Company

Page 6: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

Agile? What it Means? Network Bottleneck Identified

* Traditionally this would have taken weeks and cost $$$

Page 7: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

PERFORMANCE TESTING In The Agile Age

Waterfall Agile

Front-end

Back-end

Functional

Load E.G API

E.G Java Script

2005 2010 2014

Page 8: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

100% BACKEND TESTING

API

PERFORMANCE (Response Time, Errors)

Mobile Web

UNIT (Troubleshooting)

INTEGRATION (Regression, CI)

PRE PROD (Load, SOAK)

POST PROD (Monitoring)

FUNCTIONALITY (API)

STABILITY (System)

WHAT CAN YOU TEST?

WHAT DO WE TEST FOR?

WHAT TYPE OF TESTS?

Page 9: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

Meet Apache JMeter (The Open Source Choice for Backend Testing)

•  API •  Web services •  Mobile •  HTTP / HTTPS •  Login / Signup •  Form POSTing / Credit card

transactions •  Parameters extraction •  Mongo, MSSQL, Oracle SQL, MySQL •  Multiple user profiles

» Any script » Any scenario » Any protocol

Page 10: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

Performance 1-on-1

Page 11: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

Load Performance Types

Time

Sensitive

Bad

Perfect

Page 12: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

Load Performance Types The Perfect Load

Time

Page 13: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

Load Performance Types Sensitive to Load

Time

Page 14: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

Load Performance Types Bad Performance

Time

Page 15: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

CONTINUOUS DELIVERY

Continuous Integration Continuous Deployment

Continuous Testing

Page 16: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

JMeter Plugin to Jenkins

Page 17: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

Agile Performance Testing

Cloud Computing + Open Source = Agile

Any Protocol, Any Scenario, Any Scale

Self-Service, On-Demand, TTS < 10m

For Dev, Devop, Performance Engineer and Ops

Test Driven Development

VBetter Quality + Faster = Competitive !

Conclusions

c

c

c

c

c

c

Page 18: AGILE, CLOUD COMPUTING, OPEN SOURCE AND …...Agile Performance Testing Cloud Computing + Open Source = Agile Any Protocol, Any Scenario, Any Scale Self-Service, On-Demand, TTS < 10m

Jenkins User Conference Israel #jenkinsconf

Thank You To Our Sponsors Platinum

Gold

Silver