denver, co cloud foundry logging and metrics kira combs · © 2014 pivotal software, inc. all...
TRANSCRIPT
1© 2014 Pivotal Software, Inc. All rights reserved.
Whose Metric is it Anyway
Kira CombsCloud Foundry Logging and Metrics
Denver, CO
2© 2014 Pivotal Software, Inc. All rights reserved.
What you’re in for- Loggregator lesson
- Types of metrics
- Examples of important metrics
- ComponentMetrics app demo
@kicombs
3© 2014 Pivotal Software, Inc. All rights reserved.
Loggregator
- Sources- Metron- Doppler- Traffic Controller
@kicombs
4© 2014 Pivotal Software, Inc. All rights reserved.
Loggregator
@kicombs
5© 2014 Pivotal Software, Inc. All rights reserved.
Firehose (Demo)
@kicombs
6© 2014 Pivotal Software, Inc. All rights reserved.
Types of Metrics
@kicombs
7© 2014 Pivotal Software, Inc. All rights reserved.
HttpStart HttpStop HttpStartStop
Client GoRouter
HTTPStart
Request
Response
HTTPStop
HTTPStartStop
@kicombs
8© 2014 Pivotal Software, Inc. All rights reserved.
Log Events- STDOUT or STDERR
- AppID
- Message
@kicombs
9© 2014 Pivotal Software, Inc. All rights reserved.
Error Event
- Source
- Error Code
- Description
@kicombs
10© 2014 Pivotal Software, Inc. All rights reserved.
Container Metric- App Information
- CPU Percentage- Disk Space- Memory
@kicombs
11© 2014 Pivotal Software, Inc. All rights reserved.
Counter Event Value Metric
- Numerical count- Incremented or
Decremented
- Numerical representation of a value
http://metrics20.org/spec/#units
@kicombs
12© 2014 Pivotal Software, Inc. All rights reserved.
Metric Structure
app_benchmarking.rest_of_time
datadog.nozzle.DopplerServer.TruncatingBuffer.DroppedMessages
datadog.nozzle.DopplerServer.messageRouter.numberOfDumpSinks
datadog.nozzle.routing_api.total_routes
diego.canary.app.instance
datadog.nozzle.router__0.routed_app_requests
@kicombs
13© 2014 Pivotal Software, Inc. All rights reserved.
datadog.nozzle.DopplerServer.TruncatingBuffer.DroppedMessages
Origin
Next traveled to Ended
up at
Final, emitted metric (CounterEvent)
@kicombs
14© 2014 Pivotal Software, Inc. All rights reserved.
Masters of Metrics(Not Really)
@kicombs
15© 2014 Pivotal Software, Inc. All rights reserved.
Metric Logging Tools
APM (please enjoy aworking demo)
@kicombs
16© 2014 Pivotal Software, Inc. All rights reserved.
Metric Logging Tools
Datadog
@kicombs
17© 2014 Pivotal Software, Inc. All rights reserved.
Some Interesting Metrics
@kicombs
18© 2014 Pivotal Software, Inc. All rights reserved.
Reservable Stagers
(cf.collector.reservable_stagers)
@kicombs
19© 2014 Pivotal Software, Inc. All rights reserved.
Log Message Marshalled
(datadog.nozzle.MetronAgent.dropsondeMarshaller.logMessageMarshalled)
@kicombs
20© 2014 Pivotal Software, Inc. All rights reserved.
CPU Percentage(bosh.healthmonitor.system.cpu.user)
@kicombs
21© 2014 Pivotal Software, Inc. All rights reserved.
Router Bad Requests
(cf.collector.router.bad_requests)
@kicombs
22© 2014 Pivotal Software, Inc. All rights reserved.
Demo (ComponentMetrics)
@kicombs
23© 2014 Pivotal Software, Inc. All rights reserved.
Questions?
@kicombs
24© 2014 Pivotal Software, Inc. All rights reserved.
Thank You
Kira Combs
PCF Denver, CO
@kicombs
@kicombs
We are hiring!! (London and Berlin)pivotal.io/careers
25© 2014 Pivotal Software, Inc. All rights reserved.
Additional Resources
- Hiring: http://pivotal.io/careers- Metric Types: https://github.com/cloudfoundry/dropsonde-
protocol/tree/master/events- Value Metric Units: http://metrics20.org/spec/#units- Cloud Foundry Release: https://github.com/cloudfoundry/cf-release- Loggregator: https://github.com/cloudfoundry/loggregator- Firehose Metrics Catalog: https://github.
com/cloudfoundry/loggregator/wiki/Firehose-Metric-Catalog- (other wiki pages contain more component-specific metrics)- Not a complete resource