![Page 1: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/1.jpg)
Monitoring Nightmares for DevOps(AKA What we learnt about Monitoring from talking to over 60 companies)
![Page 2: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/2.jpg)
Our Story
Steven Acreman(CTO)
David Gildeh(CEO)
Colin Hemmings(Chief Architect)
![Page 3: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/3.jpg)
Our Monitoring Nightmare
Application
MySQL Database
OpsView (Nagios)
Logstash ElasticSearch Kibana
AppDynamicsPingdom
GraphiteCollectD
PagerDuty
Amazon AWS
Alfresco JVM
SOLR
Transformations
BrowserGoogle Analytics
Custom ScriptsReporting SystemSQL DB’s
Mixpanel GoSquared
Geckoboard
![Page 4: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/4.jpg)
![Page 5: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/5.jpg)
Lets start a monitoring company and dress like
The Apprentice!
![Page 6: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/6.jpg)
#MONITORINGSUCKS
Sooooo 2011…
![Page 7: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/7.jpg)
![Page 8: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/8.jpg)
Our Sample
![Page 9: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/9.jpg)
The Results
http://blog.dataloop.io/2014/01/30/what-we-learnt-talking-to-60-companies-about-monitoring/
![Page 10: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/10.jpg)
Still Dominated by Nagios & Open-Source
![Page 11: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/11.jpg)
How Tools Change with No. of Servers
![Page 12: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/12.jpg)
Typical Monitoring Stack
Is my site up or down? (External)
What happened? (Logs)
How is my application performing? (APM)
What’s my app actually doing?(Custom Metrics)
Is everything working as expected?(Service)
Dashing(Custom Dashboards)
![Page 13: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/13.jpg)
Nightmare 1: Everyone’s building a Kit Car
StatsD
![Page 14: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/14.jpg)
Nightmare 2: Scaling the Kit Car
![Page 15: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/15.jpg)
Solution 1: SaaS Monitoring Tools
![Page 16: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/16.jpg)
Nightmare 3: Too Many Metrics
![Page 17: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/17.jpg)
Solution 2: Anomaly Detection
![Page 18: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/18.jpg)
Nightmare 4: Spammy Alerts
![Page 19: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/19.jpg)
Solution 3: Alert Best Practices
• Only alert on actionable metrics• Multi-Condition Alert Rules
• Alert Handlers• Con!gurable Nagging
![Page 20: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/20.jpg)
Nightmare 5: Continuous Deployment
![Page 21: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/21.jpg)
Solution 4: Agile Monitoring
• AUTOMATION!• Con!guration Management• Tagging
GOAL: Minimize time/complexity to add & edit checks & alerts
![Page 22: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/22.jpg)
Nightmare 6: Data Silos
![Page 23: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/23.jpg)
Solution 5: Make Data Visible
![Page 24: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/24.jpg)
Nightmare 6: Monitoring Micro-Services
![Page 25: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/25.jpg)
Nightmare 7: Adoption outside Ops
AnythingElse
![Page 26: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/26.jpg)
Solution 6: Self-Service Monitoring
• Nice UI/pretty web interfaces• Simple – no manual required• Account Model
![Page 27: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/27.jpg)
![Page 28: David Gildeh (CEO of Dataloop) - Monitoring Nightmares for DevOps at #DOXLON](https://reader031.vdocument.in/reader031/viewer/2022020410/58f114901a28abd5458b45c9/html5/thumbnails/28.jpg)
#MONITORINGBLISS