continuous innovation through devops pipelines · 1 5 2kb 70ms 1 35 5kb 120ms use case tests and...
TRANSCRIPT
![Page 1: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/1.jpg)
Continuous Innovation through DevOps Pipelines
Andreas Grabner: @grabnerandi, [email protected]: http://www.slideshare.net/grabnerandiPodcast: https://www.spreaker.com/show/pureperformance
![Page 2: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/2.jpg)
@grabnerandi
The Story started in 2009
![Page 3: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/3.jpg)
@grabnerandi
![Page 4: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/4.jpg)
@grabnerandi
“The stuff we did
when we were a Start Up
and we All were
Devs, Testers and Ops”Quote from Andreas Grabner back in 2013 @ DevOps Boston
![Page 5: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/5.jpg)
@grabnerandi
![Page 6: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/6.jpg)
Goal: Optimize Lead Time
timeFeature Lead Time
minimize Users
![Page 7: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/7.jpg)
24 “Features in a Box” Ship the whole box!
Very late feedback
![Page 8: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/8.jpg)
„1 Feature at a Time“
„Optimize before Deploy“„Immediate Customer Feedback“
Continuous Innovation and Optimization
![Page 9: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/9.jpg)
DevOps Adoption
![Page 10: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/10.jpg)
700 deployments / YEAR
10 + deployments / DAY
50 – 60 deployments / DAY
Every 11.6 SECONDS
Innovators (aka Unicorns): Deliver value at the speed of business
![Page 11: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/11.jpg)
![Page 12: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/12.jpg)
@grabnerandi
![Page 13: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/13.jpg)
“We Deliver High Quality Software,
Faster and Automated using New Stack“
„Shift-Left Performance
to Reduce Lead Time“ Adam Auerbach, Sr. Dir DevOps
https://github.com/capitalone/Hygieia & https://www.spreaker.com/user/pureperformance
“… deploy some of our most critical production
workloads on the AWS platform …”, Rob Alexander, CIO
![Page 14: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/14.jpg)
2 major releases/year
customers deploy &
operate on-prem
26 major releases/year
170 prod deployments/day
self-service online sales
SaaS & Managed
2011 2016
![Page 15: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/15.jpg)
Confidential, Dynatrace, LLC
mobile
browser
network
multi-geo
3rd parties cloud
containers
services
codehosts
synthetic
logs
businesstransaction
applications
sdn
relax
full-stack, broad, hyper-scale
![Page 16: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/16.jpg)
@grabnerandihttps://dynatrace.github.io/ufo/
“In Your Face” Data!
![Page 17: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/17.jpg)
@grabnerandi
Availability dropped to 0%
#1: Availability -> Brand Impact
![Page 18: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/18.jpg)
@grabnerandi
New Deployment + Mkt Push
Increase # of unhappy users!
Decline in Conversion Rate
Overall increase of Users!
#2: User Experience -> Conversion
Spikes in FRUSTRATED Users!
![Page 19: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/19.jpg)
@grabnerandi
#3: Resource Cons -> Cost per Feature
4x $$$ to IaaS
![Page 20: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/20.jpg)
@grabnerandi
#4: Performance -> Behavior
![Page 21: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/21.jpg)
@grabnerandi
Not every Sprint ends without bruises!
![Page 22: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/22.jpg)
@grabnerandi
![Page 23: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/23.jpg)
Understanding Code Complexity
• 4 Millions Lines of Monolith Code
• Partially coded and commented in
Russian
From Monolith to Microservice
• Initial devs no longer with company
• What to extract withouth breaking it?
Shift Left Quality & Performance
• No automated testing in the pipeline
• Bad builds just made it into production
Cross Application Impacts
• Shared Infrastructure between Apps
• No consolidated monitoring strategy
![Page 24: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/24.jpg)
@grabnerandi
Scaling an Online Sports Club Search Service
2015201420xx
Response Time
2016+
1) 2-Man Project 2) Limited Success
3) Start Expansion
4) Performance
Slows Growth Users
5) Potential Decline?
![Page 25: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/25.jpg)
@grabnerandi
Early 2015: Monolith Under Pressure
Can„t scale vertically endlessly!
May: 2.68s 94.09% CPU Bound
April: 0.52s
![Page 26: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/26.jpg)
@grabnerandi
From Monolith to Services in a Hybrid-Cloud
Front End in
Geo-Distributed
Cloud
Scale Backend
in Containers
On Premise
![Page 27: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/27.jpg)
@grabnerandi
Go live – 7:00 a.m.
![Page 28: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/28.jpg)
@grabnerandi
Go live – 12:00 p.m.
![Page 29: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/29.jpg)
What Went Wrong?
![Page 30: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/30.jpg)
@grabnerandi
26.7s Load Time
5kB Payload
33! Service Calls
99kB - 3kB for each call!
171! Total SQL Count
Architecture ViolationDirect access to DB from frontend service
Single search query end-to-end
![Page 31: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/31.jpg)
Understanding Code Complexity• Existing 10 year old code & 3rd party
• Skills: Not everyone is a perf expert or born architect
From Monolith to Microservice• Service usage in the End-to-End Scenarios?
• Will it scale? Or is it just a new monolith?
Understand Deployment Complexity• When moving to Cloud/Virtual: Costs, Latency …
• Old & new patterns, e.g: N+1 Query, Data
Understand Your End Users• What they like and what they DONT like!
• Its priority list & input for other teams, e.g: testing
![Page 32: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/32.jpg)
@grabnerandi
The fixed end-to-end use case“Re-architect” vs. “Migrate” to Service-Orientation
2.5s (vs 26.7)
5kB Payload
1! (vs 33!) Service Call
5kB (vs 99) Payload!
3! (vs 177)
Total SQL Count
![Page 33: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/33.jpg)
@grabnerandi
![Page 34: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/34.jpg)
@grabnerandi
You measure it! from Dev (to) Ops
![Page 35: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/35.jpg)
@grabnerandi
Build 17 testNewsAlert OK
testSearch OK
Build # Use Case Stat # APICalls # SQL Payload CPU
1 5 2kb 70ms
1 35 5kb 120ms
Use Case Tests and Monitors Service & App Metrics
Build 26 testNewsAlert OK
testSearch OK
Build 25 testNewsAlert OK
testSearch OK
1 4 1kb 60ms
34 171 104kb 550ms
Ops
#ServInst Usage RT
1 0.5% 7.2s
1 63% 5.2s
1 4 1kb 60ms
2 3 10kb 150ms
1 0.6% 3.2s
6 75% 2.5s
Build 35 testNewsAlert -
testSearch OK
- - - -
2 3 7kb 100ms
- - -
4 80% 2.0s
Continuous Innovation and Optimization
Re-architecture into „Services“ + Performance Fixes
Scenario: Monolithic App with 2 Key Features
![Page 36: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/36.jpg)
Where to Start?
Where to Go?
![Page 37: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/37.jpg)
@grabnerandi
![Page 38: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/38.jpg)
„Always seek to Increase Flow“
Ensure Success in The First Way
Removing Bottlenecks
Eliminating Technical Debt
Enable Successful Cloud & Miroservices Migration
Shift-Left Quality
Reduce Code Complexity
![Page 39: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/39.jpg)
Manual Code/Architectural Bottleneck Detection
• Blog & YouTube Tutorial: • http://apmblog.dynatrace.com/2016/06/23/automatic-problem-detection-with-dynatrace/
• http://bit.ly/dttutorials
• Metrics• # SQL, # of Same SQLs, # Threads, # Web Service/API Calls # Exceptions, # of Logs
• # Bytes Transferred, Total Page Load, # of JavaScript/CSS/Images ...
![Page 40: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/40.jpg)
Automatic Bottleneck Root Cause Information
![Page 41: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/41.jpg)
Manual Database Bottleneck Detection
• Blog & YouTube Tutorial: • http://apmblog.dynatrace.com/2016/02/18/diagnosing-java-hotspots/
• http://bit.ly/dttutorials -> Database Diagnostics
• Patterns• N+1 Query, Unprepared SQL, Slow SQL, Database Cache, Indices, Loading Too Much Data ...
![Page 42: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/42.jpg)
Automated Database Bottleneck Detection
![Page 43: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/43.jpg)
Automated Code/Archiecture Bottleneck Detection
![Page 44: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/44.jpg)
“To Deliver High Quality Working Software Faster“
„We have to Shift-Left Performance to Optimize Pipelines“http://apmblog.dynatrace.com/2016/10/04/scaling-continuous-delivery-shift-left-performance-to-improve-lead-time-pipeline-flow/
![Page 45: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/45.jpg)
= Functional Result (passed/failed)+ Web Performance Metrics (# of Images, # of JavaScript, Page Load Time, ...)+ App Performance Metrics (# of SQL, # of Logs, # of API Calls, # of Exceptions ...)
Fail the build early!
![Page 46: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/46.jpg)
Reduce Lead Time: Stop 80% of Performance Issues in your Integration Phase
CI/CD: Test Automation (Selenium, Appium, Cucumber, Silk, ...) to detect functional and
architectural (performance, scalabilty) regressions
Perf: Performance Test (JMeter, LoadRunner, Neotys, Silk, ...) to
detect tough performance issues
![Page 47: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/47.jpg)
Shift-Left Performance results in Reduced Lead Timepowered by Dynatrace Test Automation
http://apmblog.dynatrace.com/2016/10/04/scaling-continuous-delivery-shift-left-performance-to-improve-lead-time-pipeline-flow/
![Page 48: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/48.jpg)
Faster Lead Times to User Value!Results in Business Success!
![Page 49: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/49.jpg)
QuestionsSlides: slideshare.net/grabnerandiGet Tools: bit.ly/dtpersonalWatch: bit.ly/dttutorialsFollow Me: @grabnerandiRead More: blog.dynatrace.comListen: http://bit.ly/pureperfMail: [email protected]
![Page 50: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/50.jpg)
Andreas GrabnerDynatrace Developer Advocate
@grabnerandi
http://blog.dynatrace.com
![Page 51: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/51.jpg)
@grabnerandi
„Always seek to Increase Flow“
„Understand and Respond to Outcome“
„Culture on Continual Experimentation“
![Page 52: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/52.jpg)
@grabnerandi
Increased Flow of High Quality Value
Test Driven Development
Automated Deployments
Shift-Left Performance
Break the Monolith
Infrastructure as Code
Migrate to Virtual/Cloud/PaaSRemove
Bottlenecks
![Page 53: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/53.jpg)
@grabnerandi
Fast Response to Outcome: Address Deployment Impact
User Experience, Conversion Rate
Costs and EfficiencyAvailability
![Page 54: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/54.jpg)
@grabnerandi
Real User Feedback: Building the RIGHT thing RIGHT!
Experiment &
innovate on
new ideas
Optimizing what is
not perfect
Removin
g what
nobody
needs
![Page 55: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/55.jpg)
Remove Database Bottlenecks
cite the database as the most
common challenge or issue
with application performance
88%
![Page 56: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/56.jpg)
Automatic Bottleneck Root Cause Information
![Page 57: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/57.jpg)
Manual Service Bottleneck Detection
• Blogs: • http://apmblog.dynatrace.com/2016/06/08/diagnosing-common-bad-micro-service-call-patterns/
• http://apmblog.dynatrace.com/2015/08/26/monolith-to-microservices-key-architectural-metrics-to-watch/
• Patterns• N+1, High Payload, Lack of Caching, Thread & Connection Pool Shortage, Excessive Async Calls
![Page 58: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/58.jpg)
Automated Service Bottleneck Detection
![Page 59: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/59.jpg)
Automated Large Scale Service Monitoring and Bottleneck Detection
![Page 60: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/60.jpg)
Automatic Bottleneck Root Cause Information
![Page 61: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/61.jpg)
Manual Deployment Bottleneck Detection
• Blogs: • http://apmblog.dynatrace.com/2016/07/07/measure-frequent-successful-software-releases/
• http://apmblog.dynatrace.com/2015/08/04/hybris-performance-review-10-system-health-checks/
• Patterns• Load Distribution, # HTTP 3xx/4xx/5xx, # of Exceptions, Stuck Threads, Timeouts, ...
![Page 62: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/62.jpg)
Automated Deployment Bottleneck Detection
![Page 63: Continuous Innovation through DevOps Pipelines · 1 5 2kb 70ms 1 35 5kb 120ms Use Case Tests and Monitors Service & App Metrics Build 26 testNewsAlert OK testSearch OK Build 25 testNewsAlert](https://reader033.vdocument.in/reader033/viewer/2022050718/5e17131283a7fe547317998b/html5/thumbnails/63.jpg)
Automatic Bottleneck Root Cause Information