case study: ing builds highly available continuous delivery pipeline with microservices and...

22
Case Study: ING Builds Highly Available Continuous Delivery Pipeline with Microservices and Containers Taco Bakker DevOps: Continuous Delivery ING Continuous Delivery Specialist DO4T18S #CAWorld

Upload: ca-technologies

Post on 16-Apr-2017

3.832 views

Category:

Technology


3 download

TRANSCRIPT

Case Study: ING Builds Highly Available Continuous Delivery Pipeline with Microservices and Containers

Taco Bakker

DevOps: Continuous Delivery

ING

Continuous Delivery Specialist

DO4T18S

#CAWorld

2 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Agenda

INTRODUCTION

THE AGILE JOURNEY OF ING

CONTINUOUS DELIVERY PIPELINE ANALYTICS

CONTINUOUS DELIVERY PIPELINE WITH APIS, MICROSERVICES, AND CONTAINERS

SUMMARY

1

2

3

4

5

3 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

About Me

Certified Scrum master

Continuous Delivery specialist

Lean Six Sigma Black Belt

CD tooling geek

Chairman Release Automation user groupTACO BAKKER

The Agile Journey of ING

5 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

About ING

ING IS A GLOBAL FINANCIAL INSTITUTIONWITH A STRONG EUROPEAN BASE

THE PURPOSE OF ING BANK IS TO EMPOWER PEOPLE TO STAY A STEP AHEAD IN LIFE AND IN BUSINESS

Customers Countries Employees

more than

33Mprivate, corporate and institutional customers

more than

40in Europe, North America, Latin America and Australia

more than

52,000

6 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

ING’s Continuous Delivery Journey

SEP2014

MAY2013

NOV2011

MAY2011

OCT2010

OCT2009

MAY2010

Google IO

The will to change

New IT mgt team

1st Scrum team and start agile development

Start of mobile app development

Clear demarcation responsibilities infra and app

Discussion – who runs production

Need full automationinfra & scalable systems

Build private cloud

Engineers hunger totake responsibility

Full reorganization (180 full DevOps teams)

Continuous delivery pipeline – Jez Humble

Start full automationof IT processes

Engineering culture

Start of our ownJava community

COMMON GOALS Higher quality Higher productivity Frequent releases

7 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

We Have Achieved Continuous Delivery

PRACTICES AND PEOPLE:

Agile scrum or kanban for all our changes

Continuous delivery for all our releases

DevOps and skilled IT engineers for our complete organization

AUTOMATE EVERYTHING:

Provisioning ofvirtual machines

Builds

Code quality checks

Security checks

TOTAL NUMBER OF RELEASES

THE RESULTS SO FAR ARE GREAT:

Faster time to market (<6wks cycle time)

Lower number of incidents (>50% reduction)

Higher frequency of releases (>12,000 releases per month)

Deployments

Tests

Acceptance criteria

Metrics & analysis

Monitoring

8 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

TEAM MATURITY TOOL STANDARDS INSIGHTS RESILIENCY

But How Can We Get to the Next Level?

Continuous Delivery Pipeline Analytics

10 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Our Continuous Delivery Pipeline Collects Metrics from All Parts of the Process

CA Release Automation

GitLab ArtifactoryJenkins Test tooling

METRICS TOOLS

EVENTBUS

SOURCE BUILD REPOSITORY DEPLOYMENT TESTING DTAP

11 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

The Collected Data Is Used to Determine Release Maturity and Team Maturity

BEFORE A RELEASE CAN BE DEPLOYED INTO PRODUCTION IT NEEDS TO COMPLY TO ALLTHE ACCEPTANCE CRITERIA.

WE COLLECT DATA IN A DATABASE SYSTEM AND MAKE COMPARISON WITH OTHER TEAMS POSSIBLE, TO HELP TEAMS TO IMPROVE!

App 1

App 1 App 2

12 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

THIS MEANS THE CD PIPELINE BECOMES TOO IMPORTANT TO FAIL!

The CD Pipeline Is Becoming the Single Point of Control for the IT Landscape

Build new releases

Get feedback on the quality of the release

Deploy releases

Ensure built in quality of releases

Insight in the maturity of DevOps teams

Insight in the quality and costs of systems

What can be released to the customers

ENGINEERS MANAGERS

Continuous Delivery Pipeline with APIs, Microservices and Containers

14 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

USER PORTAL

We Improve Resilience with Microservices andDocker Containers

CA Release Automation

GitLab ArtifactoryJenkins Test tooling

METRICS TOOLS

EVENTBUS

SOURCE BUILD REPOSITORY DEPLOYMENT TESTING DTAP

APIs

Container Platform (Mesos, Marathon, Chronos, Zookeeper)

Run Microservices ina Docker container

Run tools ina Docker container

15 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

New Techniques Maximize the Resilience of the CD Pipeline

PRINCIPLES OFMAXIMIZING RESILIENCY

MICROSERVICESOF CD PIPELINE

CONTAINERSFORMICROSERVICESAND TOOLS

DATA OUTSIDE CONTAINERS

REDUNDANTSERVICES

CONTINUOUS IMPROVEMENT

16 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Summary

The last 6 years ING has been transforming itselfto an Agile organization.

A Continuous Delivery Pipeline has been developedfor IT engineers to improve their software delivery.

Now we have to roll this out globally within INGto enable collaboration.

To make this pipeline more resilient, we run a lot ofsolutions in containers.

We split our custom build software in microservices,and run them in a High Availability mode.

We use APIs to connect standard tooling to portals,to enhance user experience.

1

2

3

4

5

6

17 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Recommended Sessions

SESSION # TITLE DATE/TIME

DO4T31TTech Talk: Harness the Power of Innovations Like Microservice Architecture and Containers

11/18/2015 at 3:45 pm

DO4T152S

Tech Primer: Exploit New Levels of Insight, Orchestration and Governance for Complex Application Releases, End-to-End, with New Continuous Delivery Solution

11/18/2015 at 4:30 pm

DO4X213LHands-On Lab: Complement CA Release Automation with a New Continuous Delivery Solution Offering A Visual Approach for Complex Application Releases

11/19/2015 at 2:00 pm

18 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Must See Demos

CA Release AutomationCA Release Automation

Theater 4

Cloud & SaaS DeploymentsCA Release Automation

Theater 4

CA RA Rapid Dev. Kit, SDKCA Release Automation

Theater 4

Integrations

CA Release Automation

Theater 4

19 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Follow On Conversations At…

Smart Bar

CA Release Automation

Theater 4

Tech Talks

CA Release Automation

Theater 4

20 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

Q & A

21 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

For Informational Purposes Only

© 2015 CA. All rights reserved. All trademarks referenced herein belong to their respective companies.

The content provided in this CA World 2015 presentation is intended for informational purposes only and does not form any type

of warranty. The information provided by a CA partner and/or CA customer has not been reviewed for accuracy by CA.

Terms of this Presentation

22 © 2015 CA. ALL RIGHTS RESERVED.@CAWORLD #CAWORLD

For More Information

To learn more, please visit:

http://cainc.to/Nv2VOe

CA World ’15