the experience of inheriting a nagios monitored environment anna-sofia lejman...

32
The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman [email protected]

Upload: gabriella-goodman

Post on 17-Dec-2015

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

The experience of inheriting a Nagios monitored environment

Anna-Sofia Lejman

[email protected]

Page 2: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

About me

From Sweden

Been into IT since 1999

Works at VIX Technology

Supporter of Nordic Garrison

CRazy cat lady

Page 3: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Starter Kit

Page 4: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Agenda

Page 5: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Agenda

Implementing Nagios

Conclusions

Tips and tricks

Questions

Page 6: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Implementing Nagios

-The background

Page 7: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Vix Technology

Page 8: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Ticket validation

• Current Range of iValTM Devices

• Processor Boards– Viper Processor Board

• Bus Computers– DC Range (Driver Console)– TP Range (Ticket Processor)– EB Range (Bus Computer)

• Patron Devices– CP Range (Card Processor)– CR Range (Card Reader)– V Range (Combination Validator)– ST Range (Platform Validator)– PCP Range (Platform Validator)

Page 9: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Why Nagios?

Automation of manual checks

Measuring service uptime

Monitoring 24/7

Automatic incident

Creation

Page 10: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Implementing Nagios

-The Project

Page 11: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Implementation

Developing testing

Implementing Intoproduction

Oops!

Page 12: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

What happened next?

Page 13: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Ok, not that bad

errors in Checks

Errors in Specs

Thresholds too low

Incidents!

Page 14: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

What to do?

Troubleshoot

Call the developer

Request help from developer teamsManager

Page 15: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

OK NOW What?

Servicedesk hero

Incident levels Down Access To

A developer

Page 16: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Fixed it - all good nao

GOT IT Working!

happily everafter!

Set &Forget

Or…???

Page 17: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

maintenance

Page 18: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Conclusions

Page 19: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

What did we Learn?

START with firewall ports / VPN connections.

access to a test environment

experienced tester.

Test thoroughly.

Page 20: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Think the checks through

very clear specifications

Remember: Every 5 minutes

Page 21: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

More lessions learned

A good programmer

Plan for THE aftermath,

log book & Script Repository

Plan for improvements

Page 22: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

But most important

of all

Page 23: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

No 1

Page 24: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Tips & tricks

Page 25: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Basic troubleshooting

Run check locally on host( In solaris : as nagios USER + root )

RUN “Test check command” in console

Check HOST config filesSolaris: /etc/nagios/nrpe.cfgWindows: C:\Program Files\NSClient++\NSC.ini

Check HOST logs Solaris: /var/adm/nrpe

Windows: C:\Program Files\NSClient++\nsclient.log

 /etc/nagios/nrpe.cfg  /etc/nagios/nrpe.cfg

Page 26: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Heeelp!!!

where to find info as a beginner:

FAQs

Nagios Library

NSClient++

Page 27: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

FAQ

Nagios FAQs http://support.nagios.com/knowledgebase/faqs/

Page 28: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

The Library

Nagios XI Library http://library.nagios.com/library/products/nagiosxi

Nagios support forum

Nagios Documentation

User and Administratormanuals

Page 29: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Nsclient++

NSClient++ http://www.nsclient.org/

Page 30: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

The internetz

Google is your friend

( just doublecheck the Nagios version )

Page 31: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Questions?

All typo:s are attributed to lolcat lingo!

Page 32: The experience of inheriting a Nagios monitored environment Anna-Sofia Lejman anna-sofia.lejman@vixtechnology.com

Thank you!

Anna-Sofia Lejman

[email protected]