continuous load testing inside and out
TRANSCRIPT
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Continuous Load Testing Inside and Out
Complete load and performance
testing from the lab to live
production
Webinar
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Load testing is a team sportIn This Webinar
TODAY’S SOASTA PRESENTERS
Connie Quach Mike Ostenberg
VP Product Management Dir. Solutions Engineering
Agenda: • Performance testing as a continuous process• Test types across the lifecycle• CloudTest capabilities for Dev into Ops
Questions: Submit in chat box during event
Poll Question
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Testing In GeneralLinear approaches include delays between testing
UtUnit
Testing
FtFunctional
Testing
Development Testing Operations
PtPerformance
Testing
MoMonitoring
Legacy Approach: Silos and waiting
TIME
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Eliminating Delays Compresses TimeEnabling more testing to be done earlier and more often
UtUnit
Testing
FtFunctional
Testing
Testing
PtPerformance
Testing
MoMonitoring
Legacy Approach: Silos and waiting
Agile Approach: Automation and Continuous Testing
OperationsDevelopment
Dev OpsTesting
TIME
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Retest
Continuous Delivery presents new opportunities
Test Development Infra setupRepeat
?Fix
Test
Analyze
The Legacy Approach
TIME
Load Testing is Not a Singular Event
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Eliminate HW costs & compress time-to-fix with real time analytics
/
TIME
The Legacy Approach
TestAnalyz
e
Fix
Test Dev
Load Testing is Not a Singular EventContinuous Delivery presents new opportunities
Test Development Infra setupTest
Analyze Retest
The SOASTA Approach
FixRepeat
?
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Continuous Delivery presents new opportunities
The SOASTA Approach
TIME
The Legacy Approach
Run more tests in less time.Start earlier.Cover more ground.xn
/ TestAnalyz
e
Fix
Test Dev
Load Testing is Not a Singular Event
Test Development Infra setupTest
Analyze RetestRepeat
?Fix
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Load Testing with Specific ObjectivesTests at different stages deliver higher coverage
Component scalability
Performance baseline
Integration testing
End to End w/ ServiceVirtualization
Unit scalability
Database testing
3rd party services
Live E2E tests
Stress testing Soak test
(reliability)
Failover
Capacity
Latency
PerformanceRegression (smoke tests)
Network
Testing (staging) Operations (prod)Development (sandbox)
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
CloudTest from Lab to ProductionTests at different stages delivers higher coverage
API Testing(REST/SOAP
& now WebSockets)
Testing (staging) Operations (prod)Development (sandbox)
Run smoke tests with
Continuous Integration frameworks
Run larger tests sooner with Virtual
Private Clouds
Introduce external
load sources with the
cloud
Test to beyond
peak expectation
s
Establish true user SLA’s
(and monitor them)
Directly test your
databases to scale
Newer capabilities
Test the “hard to
test”(Java custom
modules)
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Mike Ostenberg
(Demonstration)CloudTest from Dev to Ops
© 2013 SOASTA CONFIDENTIAL - All rights reserved.
Summary
✓ Load and performance testing spans delivery
✓ When you test more often, coverage increases and risk decreases
✓ SOASTA CloudTest is built for today and the future
Thanks
Contact SOASTA:www.soasta.com/cloudtest/
Follow us:
twitter.com/cloudtest
facebook.com/cloudtest
RESOURCES
Our next webinar – Weds. Aug. 27Compete Continuous Testing with Jenkins
- Watch for details in email -
Webinars future and past: http://www.soasta.com/knowledge-center/webinars/
Want more information?email [email protected]
- You’ll hear from us tomorrow (maybe today)
www.SOASTA.com