automated and adaptive infrastructure monitoring using chef, nagios and graphite

Automated and

Adaptive

Infrastructure

Monitoring

using Chef, Nagios

and Graphite.

- Pratima

Singh

Automated?

... and Adaptive?

MO

NIT

OR

ING

…

CO

MPO

NEN

TS…

CH

EF…

Ove

rvie

w

Configuration Management Tool written

in RubyClient Server setupManage nodes using code

(Cookbooks)Perform specialized searches (search)

Create scalable infrastructure

Central distribution point

for cookbooksManagement and authentication of nodes

Enabling searchComponentsAPI serviceManagement webui

(http://chef-server-fqdn:4040

)

Search indexerRequest queuing server

Datastore

CH

EF…

Chef-

Serv

er

CH

EF…

Chef-

Clie

nt

Nodes registered with the

Chef server.Compiles and executes

cookbooks set it its run list.

Node-name.json

CH

EF…

Cookb

ooks

Fundamental units of

distribution.Execute resources.Cookbooks containAttributesLibrariesFiles TemplatesRecipesMetadataDefinitions

CH

EF…

Role

s

Enable setting up nodes

based on functionality.

Consist of attributes and

run_list.run_list includes the cookbooks required to create

a node with the functionality

that the role is set to

achieve.

NA

GIO

S…

Ove

rvie

w

Scalable infrastructure

monitoring.Consolidated, Central

Visibility via dashboard.

Outage detection based

on custom warning and

critical levels.Outage alerts.Problem acknowledgement.Alert Escalations.

NA

GIO

S…

Configura

tion

Nagios reads its configuration

data from text files.These files are located in

/etc/nagios directory.The primary config file is the

nagios.cfg file.Specific configuration files are

located under /etc/nagios/objects which

include commands.cfg contacts.cfg hosts.cfg localhost.cfg services.cfg timeperiods.cfg templates.cfg

NA

GIO

S…

Tem

pla

tes

NA

GIO

S…

NR

PE

Nagios Remote Plugin Executor.

Retrieve status of remote

services.Consists of chef_nrpe plugin and

NRPE daemon.Config file is stored at /etc/nrpe

NR

PE…

Sam

ple

Plu

gin

NR

PE…

Plu

gin

Set

up

Nrpe.cfg

/etc/nrpe.d/custom.cfg

NA

GIO

S…

Sam

ple

Config

NA

GIO

S…

Sam

ple

Config

CH

EF

& N

AG

IOS…

SetU

p N

agio

s Serv

er

Default.rb

Hosts.cfg.erb

CH

EF

& N

AG

IOS…

SetU

p N

agio

s Serv

er

Services.cfg.erb

CH

EF

& N

AG

IOS…

SetU

p N

agio

s Serv

er

hosts.cfg

services.cfg

Gra

phit

e…

Ove

rvie

w

Real-time graphing server.

Frontend : Webapp.Backend : Storage

application (Carbon).Carbon-agent.pyCarbon-cache.pyCarbon-persister.py

CH

EF,

NA

GIO

S &G

RA

PH

ITE

CH

EF,

NA

GIO

S &G

RA

PH

ITE