2015

Agility & Continuous Deployment:

Mint’s Journey

Aravinda Gollapudi

October 16, 2015

#GHC15

2015

2015

Who Am I?

Group Engineering Manager, Intuit

− QuickBooks, Mint, Payments

Director of Engineering, Rearden Commerce

Sr. Engineering Manager, Sidestep & VeriSign

MS in Computer Engineering & MS in Physics

2015

Evolution of Agile at Mint

How we moved from the slowest Agile deployment to something no text book

would cover

2015

What is Mint?

2015

Sprint or Trot?

Web, platform (business logic, async, notifications) bundled in deployment

Trains planned to leave on time every 4 weeks

Wk1 Wk2 Wk3 Wk4

Development

QA

Wk5 Wk6

Deploy

Simple UI changes took 4 weeks or more to deploy

2015

Testing and Deployment

Defects Days Slipped

0

5

10

15

20

25

0

10

20

30

40

50

60

70

80

90

100

1 2 3 4 5 6

Bugs to Verify # of Days Slipped

Sprints

Release predictability impacted by finding defects late

2015

Site Down to Deploy!

2015

Frustration!

2015

How Did We Fix This?

Process

Mindset

Quality

Tools

Architecture

2015

Rethink Architecture

Decompose web layer. Deploy it to production sooner!

2015

Split Presentation & Platform

Web Content

Business Logic + Persistence

Web Browser

Business Logic + Persistence

Static Content

Services Data Interchange

Web Browser

2015

Performance Improvement

0

0.5

1

1.5

2

2.5

3

3.5

4

4.5

0

1

2

3

4

5

6

9/30/12 12/31/12 3/31/13 6/30/13 9/30/13 12/31/13 3/31/14 6/30/14 9/30/14 12/31/14 3/31/15

Req

ues

ts/W

eek

(Mill

ion

s)

TP5

0 S

eco

nd

s

Overview Page

Latency Volume

2015

Invest in Tools

2015

Quality Investments?

Speed up tests!

Integrate them into developer environment.

Code cannot be checked in if unit tests and automation fail.

Do not ignore fragile, flaky/unmaintainable tests … do something about them!

2015

Engineer Role Shift

Developer

QE

Operations

Tools

2015

Deployment Rate > 1000%

Before

After

Weeks

2015

Mint Dashboards New Relic: Browser Latency Splunk: Volume and Latency Excel: CtCF and SLAs

Graphiti: Business Metrics AWS: CloudWatch Icinga: Tactical Overview

2015

Takeaways

Set clear goals

− Rapid customer feedback

− Automated, independent, frequent deployments of small chunks

Don’t be afraid to challenge process

It’s not only about technology – culture matters

− Change, ownership, craftsmanship

Invest in continuous improvements

2015

Got Feedback?

Rate and review the session on our mobile app

Download at http://ddut.ch/ghc15

or search GHC 2015 in the app store