devops transformation in the rational collaborative lifecycle organization

22
Robbie Minshall Nov 11 th , 2014 Transformation day – 590 Madison Ave, NYC CLM Development Self Improvement and Transformation

Upload: robbie-minshall

Post on 18-Jan-2017

248 views

Category:

Software


0 download

TRANSCRIPT

Page 1: Devops transformation in the Rational Collaborative Lifecycle Organization

Robbie Minshall

Nov 11th, 2014

Transformation day – 590 Madison Ave, NYC

CLM Development Self Improvement and Transformation

Page 2: Devops transformation in the Rational Collaborative Lifecycle Organization

2

Market shifts are fundamentally changing the way businesses approach software driven innovation

Macro Business EnvironmentIncreasing regulatory environments

drive the need to reduce riskEmpowered Users

Consumerization of IT drivesthe need for apps with high quality customer experience

Technology TrendsMobile, social, big data, cloud, intelligent/connected systems

drive the need for agility

Mobile

Cloud

Intelligent/Connected Systems 

Social

Big Data

Inhibitors Complexity: Acquisitions, disparate technology, teams, culture, integrations

Culture: Geographically disperse team; cross organizational complexities; cross discipline collaboration, skills

Business: KLO spending outpacing innovation, Processes based on traditional approaches, Failure with clients is not an option but speed is essential, new business

modelsTools: Siloed and perpetuate culture and traditional organizational structures

Multi-sourcingIncreasing outsourcing drive

the need for governance

Page 3: Devops transformation in the Rational Collaborative Lifecycle Organization

Systems of Record

Systems of Interaction

Continuousclient

experiencePartner value

chainCloud-based

Services

Systems of Engagement of customers

experience production delays

>45%

of outsourcedprojects fail to meet

objectives

>50%

of budgets devoted to maintenance and

operations

>70%

to deliver even minor application changes to

customers

4-6 weeks

DEVELOPMENT/TESTSpeed mismatch between faster moving front office and slower moving back office systems, delaying time to obtain feedback

SUPPLIERSDelivery in the context of agile

OPERATIONSRapid app releases impact system stability

and compliance

LINE-OF-BUSINESSTakes too long to introduce or make changes to

mobile apps and services

CRM HR

DB ERP

Inefficient software delivery impacts the entire business

3

Page 4: Devops transformation in the Rational Collaborative Lifecycle Organization

Acceleratesoftware delivery

–for faster time to

valueBalance speed,

cost, quality and risk –

for increased capacity to innovate

Reduce time to customer

feedback – for improved customer

experience

ContinuousMonitoring

Collaborative Development

Continuous Release and Deployment

ContinuousCustomer

Feedback and Optimization

ContinuousBusiness Planning

ContinuousTesting

Operate Develop/ Test

Deploy

Steer

DevOps –Continuousfeedback

DevOps: IBM Point of ViewDevOps: Enterprise capability for continuous service

delivery that enables clients to seize market opportunities and reduce time to customer

feedback.

People Process Technology+ +

Page 5: Devops transformation in the Rational Collaborative Lifecycle Organization

• We will apply DevOps models of Solution Development to two distinct kinds of Application or Solution models

• Legacy Solutions – Updates to solutions already in place, or some new development under constraints that require traditional models

• Next Gen Solutions – Greenfield solutions developed without traditional constraints

• In both cases there is value in applying DevOps models, techniques, and capabilities to enhance IBM software products

Two Models of Development of Next Generation Solutions

Legacy Solutions

Next Gen Solutions

5

Use DevOps to reduce cost and

risk

Use DevOps to increase speed

Page 6: Devops transformation in the Rational Collaborative Lifecycle Organization

Our DevOps Practices

6

Next Gen Solutions

Legacy Solutions

Goals Business Benefits

Collaborate across the entire development lifecycle

Reduce Rework and establish priorities across the product stack through SPC.

Experiment with Software as a Service and work with customers on requirements through the delivery of IBM DevOps Services and Cloud Platforms.

Automate to boost development/deployment productivity

Automated Quality assurance (tests) and deployment automation in all areas reduce cost and free up resources with UCD.

Delivery new capabilities to production in hours through DevOps processes using IBM Urbancode Deploy and Softlayer.

Measure and Optimizecontinuously

Measure and improve planned outages, performance and deployment failures improving stability and trust.

Measure active engagement of our offerings and responses to new features such as Quick Planner.

Reduce costs and risk of Legacy Solutions to enable growth and experimentation

Page 7: Devops transformation in the Rational Collaborative Lifecycle Organization

IBM Rational CLM team adopts DevOps to deliver innovative solutions

Increased releases by 300% by reducing 12-month

delivery cycles to quarterly cycles

Automated deployments projected to save 2+ million per year

Continuous self hosting (jazz.net) deployments provide

constant feedback

Reduced deployment timesby 92% with IBM Deploy

capabilities

Refocused resources from 58 to 80% of development

focused on innovation and delivering new capabilities like

IBM Bluemix Solution Components

• IBM® Rational® Requirements Composer™

• IBM® Rational® Team Concert™• IBM® Rational® Quality Manager™• IBM® Infosphere® Optim Test Data

Management™• IBM® Security AppScan Enterprise™ • IBM® Rational® Focal Point™

• IBM® Worklight™• IBM® UrbanCode Deploy™

Page 8: Devops transformation in the Rational Collaborative Lifecycle Organization

Lifecycle Measurements 2008 2010 2012 – 2014 Total Improvement

Project Initiation 30 days 10 days 2 days 28 days

Groomed Backlog 90 days 45 days On-going 89 days

Overall Time To Development 120 days 55 days 3 days 117 days

Composite Build Time 36 hours 12 hours 5 hours 700 %

BVT Availability N / A 18 hours < 1hour 17 hours

Iteration Test Time 5 days 2 days 14 hours 4 days

Total Deployment Time 2 days 8 hours 4 hours -> 20 minutes

2 days

Overall Time To Production 9 days 3 days 2 days 7 days

Time Between Releases 12 Months 12 Months 3 Months 9 Months

Innovation / Maintenance 58% / 42% 64% / 36% 78% / 22% +20% / -20%

Double-digit revenue growth, increased client adoption, improved client satisfaction

8

How IBM Rational Products have improved!

Page 9: Devops transformation in the Rational Collaborative Lifecycle Organization

Summary of Practices from CLM transformation

1) Expand agile practices beyond development and test to include clients, business stakeholders and operations to breakdown silos and improve outcomes.

2) Continuously test using automation and virtualization to eliminate long backend test cycles and increase quality.

3) Build a delivery pipeline leveraging tools-as-a-service that enables developers to commit code, test, and deploy to a production environment in minutes reducing the need for rework and maximizing productivity.

4) Experiment rapidly by delivering instrumented capabilities which enable the team to make fact-based decisions and quickly evolve towards an optimal solution.

5) Create a culture of continuous improvement leveraging measures of effectiveness and efficiency to ensure you’re getting better.

9

Page 10: Devops transformation in the Rational Collaborative Lifecycle Organization

Continuous Delivery Pipeline

10

Page 11: Devops transformation in the Rational Collaborative Lifecycle Organization

Continuous Delivery Pipeline

DevelopTest (continuous) Interactive

TestingUsability Test

Security Pen testing

Unit Test

Production(on demand)

Production Environment

System Test

Performance Test

Integration Test

Function Test

Build

BuildProduction-Like Environment Production-Like

Environment

• Ship ready at the end of every sprint• Shift testing left and automate as much as possible• Use the same deployment mechanisms everywhere• Strive to maintain a constant state of ship-readiness• Treat Infrastructure as Code

DeploymentsDeploy Golden Topology

Develop DevOps Services

11

Developers launch test from their

workspace

Executes 10000s of Junits

Rapid install and smoke Tests

Functional and systems tests on Golden Topologies

BVT

Continuous Integration and Test

Page 12: Devops transformation in the Rational Collaborative Lifecycle Organization

As applications get more complex, test environment set up becomes a key inhibitor • Increasing expense of

standing up complex environments

• Delays caused by lack of system availability

• Third-party services can be especially costly

• Testers spend more time setting up tests than testing

30-50%The average amount of time testing

teams spend on setting up test environments, instead of testing  

$5-30 millionThe typical investment to build a single

test lab for a Fortune 500 company. Most have dozens  …

Page 13: Devops transformation in the Rational Collaborative Lifecycle Organization

Software Defined EnvironmentsTreating Topology Patterns as code

Standardized Golden Topologies evolve over time. How are these patterns managed?

Treat topology definitions and automation as code Version everything Automate deployment Manage Versions Automate Testing Avoid Sprawl

13

Page 14: Devops transformation in the Rational Collaborative Lifecycle Organization

IBM Confidential14

Best practices

Capture golden topologies using Infrastructure as a Service and Virtualization

Automate fast moving pieces (applications) on top of Golden Topologies

Provide barrier free access to provisioned topologies

Focus governance on monitoring and usage patterns not restrictions

Standardize Test Automation inputs (properties) targets (golden topologies) outputs (results)

Page 15: Devops transformation in the Rational Collaborative Lifecycle Organization

What is The PureApplication System?

System InfrastructureInherits the

capabilities of PureFlex System

Application Platform

Integrated Server, Storage, Network

Power Management Storage & VM Optimization

Virtualization Integrated System Management

Provisioning Security

Monitoring IT Lifecycle Management

System design

Application Optimization System wide Management

Automation & Scaling Caching & Elasticity

Application Centric Provisioning Usage Metering

Security Monitoring

App Lifecycle Management License Management

Self-service Data management

Integrates an application platform

optimized for enterprise

applications

Application patterns from IBM and partners

• 100+ ISV business applications• Business intelligence

• Business process management• Web experience (Portal)

Patterns of Expertise

PureApplication System adds deep application-aware value to its PureFlex foundation!

15

Page 16: Devops transformation in the Rational Collaborative Lifecycle Organization

Reduce test deployment costs by 92%

SCM Build Automation

IBM Endpoint Manager

QA PROD

Provision platformExecute application deployment and manage settings

across environments

Patch/update

Publish build

Pull changes

OpenStack

Platform Config Management

Environments

Deploy early and often to ensure

higher quality and faster releases using repeatable, reliable,

and managed automationDEVDEVDEVDEV

IBM PureApplication System

IBM UrbanCode Deploy with Patterns

16

Page 17: Devops transformation in the Rational Collaborative Lifecycle Organization

Development cycle

FEATURE / RUN REPO

‘PIP

ELIN

E’

BUILDAUTOMATED INTEGRATION

TEST

UNIT TEST

FEATURE/RUN

SVT

PERFORMANCE

SELF HOST STAGING PROD

IBM IINTERNA

LCUSTOMER

QA and Self Hosting Customer Deployment

IBM Common Cloud Stack

Deploy Golden Topology

Traditional Infrastructure

Deploy and manage Golden Topology

Wants instant access to

topology w/ latest build or to reproduce issue

Easily provision and manage build

infrastructure

Can dynamically provision Golden

Topology to provide a scalable regression Can

automatically deploy to

production servers

based on test results

Can get Golden Topologies for latest builds and focus on

real test engineering

IBM is investigating providing our automation in open source

project via JazzHub

17

Page 18: Devops transformation in the Rational Collaborative Lifecycle Organization

IBM Confidential

Build Confidence with a Single View of Quality

18

Ready to deliver?Single view of completenessAbility to quickly drill down on problems

Page 19: Devops transformation in the Rational Collaborative Lifecycle Organization

Self Hosting

JAZZ is the production system There are 2 staging systems

BLUES is the continuous upgrade system SOUL is the testfix and pre-prod upgrade system

Staging1 Staging2 Production

Copy back to Staging every 6 months (latest data)

JAZZ.NET SPRINT PROCESS

Upgrade Staging 2 (SOUL)Deploy to production

Copy production to Staging 2

Page 20: Devops transformation in the Rational Collaborative Lifecycle Organization

IBM Confidential20

Savings and innovations

Page 21: Devops transformation in the Rational Collaborative Lifecycle Organization

21

What is Docker

Simple APIs and readable Dockerfiles promote forking and sharing of code GIT/maven style repositories

Layered images promote Continuous Delivery processes and sharingLight weight images lend themselves to productive local environments to test

distributed scenarios

Page 22: Devops transformation in the Rational Collaborative Lifecycle Organization

Wouldn’t it be nice if ….

You never manually installed again You never had any more issues where it “works on my desktop”

Software engineers had self service access to production like topologies Software engineers could write automated tests that could validate production

environments Your software engineers to actually do Behavior and Test Driven Development

You could TRUST your ability to Continuously Deploy your application You could KNOW when issues where introduced and what introduced them

Deployment choices where based on delivering value, not the cost of the deployment

22