why visibility into your stack matters
TRANSCRIPT
![Page 1: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/1.jpg)
Why visibility into your
stack mattersor, Do you see it all?
![Page 2: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/2.jpg)
Mike Fiedler
Operations
Datadog.comTwitter: @mikefiedler
GitHub: @miketheman
OpsSchool.org
Chef Community
Roller Derby Referee
Skydiver
©Alex Erde
![Page 3: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/3.jpg)
–CEO calling your cellphone at 03:00
“The site is slow.”
![Page 4: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/4.jpg)
![Page 5: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/5.jpg)
What?
• typical monitoring implementation story
• an alternative approach
![Page 6: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/6.jpg)
(CC BY 2.0) http://www.gotcredit.com/ https://flic.kr/p/6439SA
![Page 7: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/7.jpg)
LB
Data
User
Web
![Page 8: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/8.jpg)
![Page 9: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/9.jpg)
(CC BY 2.0) www.futurealpha.com https://flic.kr/p/8PhF4g
![Page 10: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/10.jpg)
(CC BY 2.0) Aristocrats-hat https://flic.kr/p/6qdTC1
–W. Edwards Deming, The Elements of Statistical Learning
“In God we trust; all others bring data.”
![Page 11: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/11.jpg)
![Page 12: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/12.jpg)
![Page 13: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/13.jpg)
You want more?
![Page 14: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/14.jpg)
• graphite
• ganglia
• mongodb
• mysql
• influxdb
• socket.io
• datadog
• …
![Page 15: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/15.jpg)
Time is a Cruel Master
![Page 16: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/16.jpg)
(CC BY-SA 2.0)
https://www.flickr.com/theilr/
https://flic.kr/p/8MC5YM
![Page 17: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/17.jpg)
Have
• systems
• applications
• services
• developers
• operators
• customers
![Page 18: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/18.jpg)
Have
• systems
• applications
• services
• developers
• operators
• customers
![Page 19: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/19.jpg)
Polyglot Platforms
![Page 20: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/20.jpg)
Complex Systems
![Page 21: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/21.jpg)
Disparate Locations
![Page 22: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/22.jpg)
Information Overload
![Page 23: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/23.jpg)
–CEO calling your cellphone at 03:00
“The site is slow.”
![Page 24: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/24.jpg)
(CC BY 2.0) www.futurealpha.com https://flic.kr/p/8PhF4g
![Page 25: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/25.jpg)
What exactly are we
monitoring, anyhow?
![Page 26: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/26.jpg)
Top-down
• work metrics
• resource metrics
• events
![Page 27: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/27.jpg)
Work Metricsthroughput, success vs error, performance
![Page 28: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/28.jpg)
Resource Metricsutilization, saturation, errors, availability
![Page 29: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/29.jpg)
Eventschange/build/deploy, alerts, etc
![Page 30: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/30.jpg)
Trend resource metrics,
notify on changes
![Page 31: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/31.jpg)
Wake people up when
work metrics go awry
![Page 32: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/32.jpg)
![Page 33: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/33.jpg)
![Page 34: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/34.jpg)
Slice and Dice
![Page 35: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/35.jpg)
![Page 36: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/36.jpg)
Set-and-Forget
![Page 37: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/37.jpg)
![Page 38: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/38.jpg)
Just-In-Time
Information
![Page 39: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/39.jpg)
![Page 40: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/40.jpg)
Does it scale?
![Page 41: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/41.jpg)
Customer Stats
• AdRoll, ~2m transactions/second
• SimpleReach, ~7b measurements/day
• MercadoLibre, ~18k hosts monitored
• AirBnB, 3000+ monitors defined
![Page 42: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/42.jpg)
–M. Fiedler
“If you don’t measure, you don’t know.”
![Page 43: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/43.jpg)
Questions?
![Page 44: Why Visibility into Your Stack Matters](https://reader030.vdocument.in/reader030/viewer/2022032506/55cd23d8bb61ebba378b47ac/html5/thumbnails/44.jpg)
Mike Fiedler
OperationsTwitter: @mikefiedler
GitHub: @miketheman
OpsSchool.org
Chef Community
Roller Derby Referee
Skydiver
©Alex Erde