devopsguys performance testing with apm tools workshop
DESCRIPTION
A set of static slides that accompanied a "Live Demo" of using APM tools (AppDynamics) during load testing to isolate a performance issue, fix it, de-deploy and compare the improvement. This presentation accompanies the workshop held at the NCC Group Web Performance event in March 2014. Videos should be available on the NCC Group Community website - http://community.nccgroup-webperf.com/TRANSCRIPT
DevOpsGuys
@DevOpsGuys www.devopsguys.com 1
DevOpsGuysPerf Testing with APM
WorkshopLive demo without a safety net!
DevOpsGuys
@DevOpsGuys www.devopsguys.com 2
Workshop agenda
• Intro – Steve – 10mins• Load Testing Portal – Gareth – 10 mins• APM Analysis – Steve – 10 mins• Deploy Fix & Re-Test – Steve – 5 mins• APM Demo + Q&A – Steve – 10 mins• Test #2 Analysis – Steve – 10 mins• Result Comparison – Gareth – 10 mins• Wrap up Q&A – Steve & Gareth
DevOpsGuys
@DevOpsGuys www.devopsguys.com 3
Test Environment
Web #1
Web #2
MS SQL Server
Loa
d B
alan
cer
NCC Test
Servers
DevOpsGuys
@DevOpsGuys www.devopsguys.com 4
Cloud Servers
DevOpsGuys
@DevOpsGuys www.devopsguys.com 5
Load Balancer
Only one node active (for now)
DevOpsGuys
@DevOpsGuys www.devopsguys.com 6
Test Application
• Online Art Shop Demo App• .Net MVC Application• http://spark.devopsguys.com/
DevOpsGuys
@DevOpsGuys www.devopsguys.com 7
The Art Shop
DevOpsGuys
@DevOpsGuys www.devopsguys.com 8
APM Weapon of Choice
• AppDynamics APM– Gartner Magic Quadrant Leader
• SaaS Portal• Agent install– 15 minutes to install on 2 web servers
• OOTB Configuration– 2 minor instrumentation changes– Create a dashboard (~1hr)
DevOpsGuys
@DevOpsGuys www.devopsguys.com 9
OctopusDeploy
DevOpsGuys
@DevOpsGuys www.devopsguys.com 10
NCC GROUP LOAD TESTING
A brief overview of the Portal & Test setup
DevOpsGuys
@DevOpsGuys www.devopsguys.com 11
WORKSHOP DEMO PART 1Where we break stuff live, for your viewing pleasure!
DevOpsGuys
@DevOpsGuys www.devopsguys.com 12
AppDynamics Portal
DevOpsGuys
@DevOpsGuys www.devopsguys.com 13
Failure in Minute 8(ish)
DevOpsGuys
@DevOpsGuys www.devopsguys.com 14
What went wrong?
DevOpsGuys
@DevOpsGuys www.devopsguys.com 15
SQL Client Exceptions
DevOpsGuys
@DevOpsGuys www.devopsguys.com 16
Slow Connection Open?
DevOpsGuys
@DevOpsGuys www.devopsguys.com 17
Code Bug (Thread.Sleep)
DevOpsGuys
@DevOpsGuys www.devopsguys.com 18
WORKSHOP DEMO PART 2Fix it problems, deploy & re-test
DevOpsGuys
@DevOpsGuys www.devopsguys.com 19
Fix the Bugs…
DevOpsGuys
@DevOpsGuys www.devopsguys.com 20
Deploy it…
DevOpsGuys
@DevOpsGuys www.devopsguys.com 21
#3Faster Iteration= Better Value
DevOpsGuys
@DevOpsGuys www.devopsguys.com 22
Maximise Testing Value
Test
AnalyseFix
Deploy
DevOpsGuys
@DevOpsGuys www.devopsguys.com 23
MORE ON APM… While we wait for the load to ramp up…
DevOpsGuys
@DevOpsGuys www.devopsguys.com 24
SHOW THE IMPROVEMENTComparing the two releases
DevOpsGuys
@DevOpsGuys www.devopsguys.com 25
10,000 vs 45,000
DevOpsGuys
@DevOpsGuys www.devopsguys.com 26
Summary
1. See the Big Picture (systems thinking)
2. Drill down to the details3. Faster Iteration = Better Value4. Stop the “Blame Game”– aka “There’s your Problem!”
DevOpsGuys
@DevOpsGuys www.devopsguys.com 27
DevOpsGuys
Thank You
AppDynamics Free Trialhttp://ow.ly/ubW6r operations | availability | performance | scalability | migration | strategy
DevOpsGuys
@DevOpsGuys www.devopsguys.com 28
DevOpsGuys provide development & operations support (DevOps) services
for your online applications.
You run your business. We run your website.
It’s as simple as that.
What We Do
DevOpsGuys
@DevOpsGuys www.devopsguys.com 29
Our service portfolio
• 24 x 7 Application-Centric web operations
• DevOps Transformation & Training
• Continuous Delivery implementation
• Infrastructure Automation & “Infrastructure as Code”
• Application Performance Management
• AppDynamics Implementation & Consultancy
• Web Performance consulting
• Web monitoring• Load Testing• Test Automation and
scripting• JetBrains Product
Implementation & Consultancy
• Octopus Deploy implementation
DevOpsGuys
@DevOpsGuys www.devopsguys.com 30
James Smith (@TheDevMgr)
• 16 years of software delivery experience.
• Proven track record– Pizza Hut– KFC– Dell– RAC– Aviva– Fujitsu Siemens– Whitbread
Steve Thair (@TheOpsMgr)
• 25 years of IT Operations experience.
• Proven track record– Vodafone– Credit Suisse Group– IBM– BNP Paribas– Zurich Financial Services– Totaljobs Group– TSL Education
The Leadership Team
DevOpsGuys
@DevOpsGuys www.devopsguys.com 31
Contact UsVisit us at www.devopsguys.com
Call our team on +44 (0)20 8798 3079
Email our engineers at [email protected]