Driving DevOps Transformation at Scale

Driving Global Transformation in Banking

Brian Timmeny

BBVA – brian.timmeny@bbva.com

BBVA Global Presence

1

BBVA´s Client Focus

2

“Our goal is to be leaders in customer satisfaction across our global footprint”

Digital Customer Experience Scores

BBVA´s as a Service Mission

3

Capabilities as a Service

DevOps Suiteas a Service

Front Office, Channels

Front Office, Channels

Enable our developers through a reusable, easy to consume DevOps ecosystem …

… automate our processes within the delivery ecosysstem

Simplify our processes, andensure lean delivery throughoutour global and county deliveryecosystem

Automated,Streamlined

Processes

Streamlined Processes

4

BBVA DevOps Delivery Principles

Accountable for end-to-end product delivery

Deliver value for our customers today

Constantly deliver value in small increments

Measure our customer level impact & improve

Our Objectives & Focus

5

Velocity: Improve Delivery Time to Market

Drive a system with the ability to improve overall speed of the

application delivery lifecycle. The objective is to drive applications more

quickly directly into the hands of our clients, both internal and external.

Quality: Improve Application Reliability

Within the development and operations system, constantly improve

application stability through improved unit tests, dependency and

integration test coverage, performance test execution, and real

time/constant application fragility test case implementation.

BBVA DevOps Transformation Drivers

6

Driving a Single Automated Framework

7

Single, Automated Framework

• Move from externally sourced to internally sourced teams• Ensure all teams comprised of development and operations delegates• Define required end-to-end processes• Optimize end-end-delivery delivery process approvals• Define automated approval criteria• Automated processes within delivery and DevOps ecosystem

SingleAutomatedFramework

Driving a Common Developer Experience

8

Operate

OnboardPlan &

Design

Build &

TestRelease

ComponentDeploy

Devploy DevOpsDeveloper Suite

Deploy component pattern& associated infrastructure

Permissions & Security

Verification

Verify general, individual access, and global security patterns

Validate policiesupon each commit

Enforce componentfunctional & technology

dependencies

Validate monitoring& response support models

Determine & allocatedesign dependencies

& and test components

Approve Build ReleasePlan

CI/CD Deploy

Project Approval

Driving a Common Developer Experience

9

Operate

OnboardPlan &

Design

Build &

TestRelease

ComponentDeploy

Devploy DevOpsDeveloper Suite

Deploy component pattern& associated infrastructure

Permissions & Security

Verification

Verify general, individual access, and global security patterns

Validate policiesupon each commit

Enforce componentfunctional & technology

dependencies

Validate monitoring& response support models

Determine & allocatedesign dependencies

& and test components

Approve Build ReleasePlan

CI/CD Deploy

Project Approval

Automated Component Deploy

The barrier to entry must be constantly lowered … we must offer our tools and suites “as a service”.

Driving Delivery Visibility

10

Highly Visible Delivery & Objectives Metrics

• Drive highly visible delivery metrics, both physically and operationally• Show team level continuous delivery progress• Expose all behaviors compliance metrics• Enable objective based leadership visibility (against speed and quality)• Drive constant flow/bottleneck reports• Keep visibility and dashboards simple and limited in scope

VisibleMetrics

Driving Automation

11

Highly Automated Delivery Ecosystem

• Establish ecosystem components as a service• Automate regulatory processes into the delivery and DevOps ecosystem.• Establish (visibility metrics) flow & bottleneck discovery.• Automate continuous delivery bottlenecks relentlessly.• Relentlessly discover and automate approvals within the delivery chain.• Enforce minimum automated testing at each phase.• Automate behavior enforcement throughout the delivery value chain.• Automate test suite processes from unit through orchestrated deployment.• Automate integrated testing over time (through incident discovery model)

AutomateEverything

MVP “as a Service” Tool Suite Focus

12

Establishing Our DevOps Community Framework

13

Drive Global Collaboration

• Establish Framework discipline responsible within each geography (scaled teams).

• Establish DevOps discipline responsible within each geography (system teams).

• Drive common improvement roadmap across disciplines in order to drive synergy and focus across geographies.

• Drive a community framework utilizing constant improvement to drive enhancements and automation to the system.

• Drive constant improvements to the visibility dashboards through collaborate value utilization.

EstablishOpenSourceCommunities

DevOps at Scale: Discipline Leadership

14

Establish Discipline Leader by Geography

• Establish country specific roadmap and maturity pace• Establish early pilot definition candidates• Establish ongoing pilot candidates• Drive synergy between local focus and global roadmap

(framework, DevOps ecosystem)• Drive global input improvements into local geography

(framework, DevOps ecosystem)• Drive local improvements into global agenda (framework,

DevOps ecosystem)• Determine long-term group federation strategy

15

Establish Framework Common Capability Hubs

• Establish core capabilites ecosystem early incubation within three geographic hubs (Spain, Mexico, USA).

• Drive early innovation ecosystem pilots.• Execute improvement capability pilots with assistance from DevOps

CoE staff.• Implement roadmap to drive common capability pilots across all

geographies.• Utilize pilot feedback to drive constant improvement of the

ecosystem.• Solicit pilot takeover from countries as capabilities improve.• Serve as early System Team Support.• Serve as Open/InnerSource Project Managers.

DevOps Center of Excellence

DevOps at Scale: DevOps Center of Excellence

16

Establish DevOps Common Capability Hubs

• Drive early automation candidates from three process excellence hubs (Spain, Mexico, Colombia).

• Establish core delivery continuous process streamline early incubation within hubs.

• Establish core delivery continuous process approval streamline early incubation.

• Drive early process innovation ecosystem pilots.• Execute framework improvement and streamline pilots with

assistance from Framework CoE staff.• Implement roadmap to drive common capability pilots across

all excellence centers.• Utilize pilot feedback to drive constant improvement of the

framework.• Solicit pilot takeover from countries as capabilities improve.

DevOps Framework/Agile

Center of Excellence

DevOps at Scale: Methodology Leadership

Automating & Enforcing our Policies

17

Automated Event Based Enforcement

Infrastructure Deployment PoliciesDefine the container and package strategy for our infrastructure deployment as a basis for our platform and applicationimplementation.

Platform & Application Deployment PoliciesDefine our container and reuse strategy for creating a catalogue equivalent for deployment of common platform andapplication suite reference architectures.

Security PoliciesImplement common event based security implementation policies to ensure security of our data and application suiteposture.

Financial & Revenue Affected PoliciesImplement common event based financial protections to ensure appropriate behaviors and account level financialmanagement tool suites.

Cloud Operations & Management PoliciesDefine appropriate cloud management required policies and implement across the suite of all migrated application suites.

Behavior Based Policy Enforcement

Policy Store BasedCommon Policy Store to define and drive behaviors, consequence framework.

Event Based Behavior EnforcementEnforce behaviors via event based framework to ensure real time compliance.

Cloud Based FunctionalityDrive real time execution through cloud-native capabilities

Policy Store

Policy Execution

Cloud Driven Implementation

EstablishAutomated

BehaviorEnforcement

Driving Our Maturity Through Pilots

Execute Pilot Based CulturePilot Framework & Engineering Process Pilots ConstantlyConstantly search for ways to improve the delivery framework globally, and pilotthose tests constantly. As they are ready, implement on a broader scale.

Pilot DevOps Ecosystem Pilots ConstantlyConstantly search for ways to improve the ecosystem globally, and pilot thosetests constantly. As they are ready, implement on a broader scale.

Drive Improvement Roadmap by Geography & GloballyConstantly search for synergies globally, drive targeted pilots, and search forwide scale rollouts of improving framework and ecosystem capabilities.

Pilot Minimum Viable Products ConstantlyDrive a culture of constantly driving framework andecosystem changes on small scale to build a enterprisemuscle of continuous improvement.

Reward ExperimentationEnsure that successful pilots are both recognized and rolledout on a global scale.

Drive Constant Improvement Via Pilots

18

Mature viaContinuous Pilots

From Pilots to Self Service

19

From: Pilot Assisted Delivery To: Auto Self-Service Adoption

SelfService

• Methodology assistance• On site training and adoption assistance• Ongoing team support

• Begin team & community assistance to drive adoption• Video and self-study adoption tool kits• Easy to provision and adopt tool suites

Our Results

20

• We have begun to publish our ecosystem OpenSource …

https://github.com/BBVA/mirrorgate

• DevOps community lead framework established in eleven countries• Framework delivery model deployed within eight countries and three

thousand team members.• Global development product delivery tool suite delivered within six countries,

490+ product teams, and 5,400+ team members.• Global repository as a service delivered within ten countries with over 3,000+

users• Deployment of our pipeline as a service in three countries to eight product

teams.• Visibility tool framework delivered within two countries and twenty two

product teams.• Policy enforcement framework delivered within ten product teams

Our Journey Continues

21

• Continue to evolve our devops suite ecosystem and deployment methods

• Continue to evolve our metrics & visibility framework (https://github.com/BBVA/mirrorgate)

• Continue to evolve our ability to deploy “invisible updates” across our delivery ecosystem

THANK YOU!

Biography & Company Highlights

23

As a highly skilled IT professional with the ability to create and manage complex execution plans, Brian Timmeny is an experienced delivery leader that has consistently streamlined organizations to effectively implement complex solutions, and rise the tide of advanced engineering in the organizations he serves. Brian brings proven experience aligning business and IT organizations to deliver upon value driven execution strategies.

Brian presently serves as the Head of DevOps & Engineering Processes at Banco Bilbao Vizcaya Argentaria, a global financial services company. Brian is currently working toward the transformation of global engineering to next generation DevOps and Advanced Engineering Delivery, driving continuous deployment to the majority of application suites within the global engineering portfolio.

Prior to his current assignment, Brian served as the DevOps and Delivery Leader at Capital One, UnitedHealth Group and Cigna Corporation.

Brian resides in Madrid, Spain with his wife, and two children. Although busy with his career, he also serves on several local and industry boards related to DevOps and Advanced Engineering Maturity.

Company: Role:

BBVAHead of Advanced Engineering, DevOps & Engineering Processes

BBVA, #1 Banking Mobile Application Globally