assembla airbrake webinar - production monitoring and continuous delivery - slides - may 2013

40
Production Monitoring The Key Step Towards Continuous Delivery

Upload: assembla

Post on 15-Jan-2015

5.993 views

Category:

Technology


2 download

DESCRIPTION

Slides for Assembla and Airbrake webinar: If you can only do one thing to help implement Continuous Delivery it should be production monitoring. Presented by Michael Chletsos, CTO of Assembla and Justin Mares, Director of Growth at Airbrake (Rackspace). May 22, 2013.

TRANSCRIPT

Page 1: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Production MonitoringThe Key Step Towards Continuous Delivery

Page 2: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

PresentersMichael Chletsos● CTO @ Assembla.com● Previously DevOp for Assembla● Heavy interest in Continuous Delivery

Workflows

Justin Mares● Director of Growth @ Airbrake (acquired

by Rackspace)● Co-author of Traction Book ● Former co-founder of CloudFab

Page 3: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Questions & CommentsThere will be a Q&A session at the end.

To Submit Questions:● use the "Questions" area on the

GoToWebinar side panel-OR-

● use Twitter (hashtag: #assemblaQA)

Page 4: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Continuous Delivery is not a process that I can define for you, rather its a goal.

The Goal of being able to continuously deliver your code to QA/UAT or Production and react in real time to the results of the release.

How to perform this is dependent on your Ecosystem.

What is Continuous Delivery?

Page 5: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

CD at Assembla

Page 6: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

CD at Assembla

Iteration Planning

Page 7: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

CD at Assembla

Continuous Delivery

Page 8: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Traditional Iteration Plans

Planning Coding Release

Stress Level Scope of Work

Page 9: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Traditional Iteration Plans

Planning Coding Release

Stress Level Scope of Work

Add More Requirements

Bug Fixes

Page 10: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Traditional Iteration Plans

Planning Coding Release

Stress Level Scope of Work

Add More Requirements

Bug Fixes& More Work

Page 11: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

CD at Assembla

Page 12: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Problems of IterationsJust admit it -

Planning is Hard

Priorities Change

Unforeseen Problems Occur

Page 13: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Why Continuous Delivery?● More Frequent Releases

● Faster Issue Resolution

● Improved Productivity

● Better Quality of Code

● Less Stress on the Team

● Better Customer Experience

Page 14: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

What's the Secret Key?If you want to start anything today that will help you immediately:Monitor Errors in Production

If you want to do nothing else but one thing to be able to Continuously Deploy:Monitor Errors in Production

Page 15: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Why Monitor?

Working software is the primary measure of progress.

- Agile Manifesto

Page 16: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Monitoring● Monitor Everything

● Monitor Everything

● Monitor Everything

● React to Anomalies not Thresholds

Page 17: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Errors in Production

Page 18: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Assembla Deploys● Automated

● Click of a Button Deploys

● Reliable

● Consistent

● Monitored

Page 19: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Assembla Process

Page 20: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Barebones CD

Code Production

Page 21: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Barebones CD

Code Production

That's Just Cowboy Coding!

Page 22: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Barebones CD

Code Production

Production MonitoringBugs

Page 23: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Barebones CD

Production

Production MonitoringBugs

Page 24: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Assembla Process

Page 25: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Assembla Process

Bad Release

Page 26: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Any Process

Production

Production MonitoringBugs

Page 27: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Airbrake.io

Page 28: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Airbrake.io

Page 29: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Why Monitor?

Page 30: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Airbrake

Page 31: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

It's a Process

Code Production

Production MonitoringBugs

Must understand what's happening in production

Page 32: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

ADD

Page 33: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Need Insight!Key Question: what broke??

Backtrace

Environment

Parameters

Page 34: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Bug Triage

If you only have a few tests (or even none at all), don't despair. Simply set up the CI server and agree to one simple rule: we'll add a new automated test every time we fix a bug.

- Eric Ries, author of the Lean Startup

Page 35: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Too Many Errors!

Page 36: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Too Many Errors!Prioritization is critical

● How many similar errors have occurred?● How often does this happen?● Who knows most about issue?

Page 37: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Too Many Errors!Track:● Errors since last deploy● Critical errors● Error rate (increasing or decreasing?)● Repeating errors

Page 38: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Stickermule

Implemented monitoring:● Permanent 3% conversion uptick

Page 39: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

Deploy with Confidence

Page 40: Assembla Airbrake webinar - Production Monitoring and Continuous Delivery - Slides - May 2013

What To Do Now● Airbrake.io

● Assembla.comMichael ChletsosCTO [email protected]

Justin MaresGrowth at [email protected]