not actually a devops talk
TRANSCRIPT
Not actually a DevOps talkOr, better software with Pivotal
@coteNov 2016Slides: https://cote.io/not-devops/1
• @cote – Director, Marketing at Pivotal
• Industry analyst at 451 Research and RedMonk
• Corporate strategy and M&A at Dell
• Software developer• More: cote.io/podcasts,
http://cote.io, [email protected], The Register DevOps column.
Hello!
2
Why we need better software
44
Expected BigCo Lifespan
1960s: 60 years on S&P 5002020s: 12 years on S&P 500
Source: “Fortune 500: it’s do-or-die time for digital disruption,” 2015.
5
“In order to grow Citi, we first have to grow our own perspective, skills and capabilities… Our curiosity, our openness to learning and trying new things, our ability to adjust and adapt quickly and our willingness to fail fast and fail small are the essence of a culture that innovates and exposes new value to our clients in real time.”
Stephen Bird, CEO Citi Global Consumer Group
Source: “A Transformation Journey,” Brad Miller, 2016.
What is your IT
organization's role in business
innovation?
Source: Cutter Consortium, July 2015.
Organizations are held back by an IT agility gap
6
7
Agile practices and collaboration for product and culture transformation
• World class application development services
• Proven transformational methodology
Big Data & Analytics
Modern, open, highly parallelized platform
• Big data, in-memory, and database software
• Industries most complete big data analytics offering
Cloud Native PlatformModern, open, highly
automated cloud platform
• Platform-as-a-Service (PaaS) software with multi-cloud support
• Record-breaking sales growth and adoption
Agile Product Development
Pivotal helps organizations do better software
10
Increasing paint and tools rental revenue
Source: story from interviews, picture from Wikipedia.11
Sources: “Cloud Foundry for the Internet of (Really Important) Things,” Harel Kodesh, 2015. predix.io; IoT Keynote at TiECon, Harel Kodesh, May 2016.
GE: “No offense to the toothbrushes and rice cookers.”
12
Incenting healthy behavior increases revenue
• Vitality drove engagement from 3% to 30%+
• Cue Apple Watch app: “Two people built the app and got it into the AppStore in five weeks.”
Source: Humana keynote, CF Summit 2015. "Application Modernization, Service By Microservice," Forrester, Dec 2015. See also BMC Software case study in The Concise Executive Guide to Agile and Cutter Executive Report, Vol. 9, No. 9, 2008.
"We did an analysis of hundreds of projects over a multi-year period. The ones that delivered in less than a quarter succeeded about 80% of the time, while the ones that lasted more than a year failed at about the same rate. We're simply not very good at large efforts.”
-Dev leader, large financial institution
13
Stacks for better software
The meatware stack for better software
15
Design
Small batches
Agile
DevOps
The technology for better software
16
CI/CD
Cloud Platform
Dev Test Prod
17
What’s in the box?
Digital transformation.
18
2016 Edition, WIP2015 Edition
Both are free at http://cote.io/cloud2
CoreMeatware
Use small batch thinking, at all levels
Inception
Hypothesize
Validate w/real use(r)s
Did it work?
Sources: “Good Software is a Series of Little Failures,” Coté, April 2016; The Lean Startup, Eric Ries, 2011. The Lean Enterprise, Barry O'Reilly, Jez Humble, and Joanne Molesky. See also overview of this approach at the IRS from Dec 2015. "Application Modernization, Service By Microservice," Kurt Bittner and Randy Heffner, Forrester, Dec 2015; "Best Practices For Agile-Plus- Architecture," Randy Heffner, Forrester February, 2015.
20
“We did an analysis of hundreds of projects over a multiyear period. The ones that delivered in less than a quarter succeeded about 80% of the time, while the ones that lasted more than a year failed at about the same rate. We’re simply not very good at large efforts.”
Large financial institution
How much do I owe the IRS?
Source: "Minimum Viable Taxes: Lessons learned building an MVP inside the IRS,” slides , Andrea Schneider & Lauren Gilchrist, 2015.
Before After
21
If you’re doing 30 minute weekly “standups” while sitting down, you’re not doing agile
Source: “Town Hall: Agile in the Enterprise,” Mike West, Nathan Wilson, Thomas Murphy, Dec 2015, Gartner AADI US conference; “Pair programming – you’ll never guess what happens next.” Coté, Oct 2016.22
DevOps, the word defines itself(1.)
DevOps is the practice of operations and development engineers participating together in the entire service lifecycle, from design through the development process to production support.
(2.)DevOps is also characterized by operations staff making use of many of the same techniques as developers for their systems work.
Source: “What Is DevOps?,” The Agile Admin, Dec 2011. For more: Effective DevOps, Jennifer Davis, Katherine Daniels, May, 2016.23
Goals, practices, and process are more durable
24 Source: 2016 DevOps Study, and various Nicole Forsgren joints.
Goals, practices, and process are more durable
25 Source: 2016 DevOps Study, and various Nicole Forsgren joints.
Supporting Meatware
Management will be the first to fail
“I can’t tell you what having a leader stand-up in front of an organization with a hoodie and t-shirt does to cultural change. It all the sudden makes it OK for everyone within that organization to participate in change.”
-Matt Curry, Allstate
27Sources: Leading the Transformation, 2015; “Management’s Job is orchestrating the 'why,'” Coté, 2015; The Concise Executive Guide to Agile, 2010. See also “largile” column from Nov 2016.
Two pizza teams with end-to-end involvement“Typically our developers, or business analysts or designer, work on five projects at the same time, and if you are good you work on ten. That is tremendously inefficient. So the first task was to get them out of their traditional environment and put them into the garage, concentrating on one project.”
Dr Andreas Nolte, CIO, Allianz
Source: “Why Britain banned mobile apps; Interview with Ben Terrett, former design chief at the GDS,” GovInsider, June 2016. See also “From Aristotle to Ringelmann,” June 2016. Picture from Pivotal SafeMeds scrapbook; “Roles and Responsibilities for DevOps and Agile Teams,” Coté, May 2016; Comcast’s Christopher Tretina at SP1 2016.28
The emerging cloud native organization shape
29
INFRASTRUCTURESITE RELIABILITY
PLATFORM
Innovation: Plan, design, develop and test business capabilities as deployable artifactsServices: develop, test, QA, and evolve shared middleware and services Platform: upgrade platform, capacity planning, service mgmt., scale platformInfrastructure: Rack and stack, networking, data storage, etc.
ROLESApplication Developers
(Prod. Owner, UX, Dev, QA)Platform Developers
Platform OperatorsEngineering
(Storage, Security, Network, etc.)
AREAS OF FOCUS
BUSINESS CAPABILITY
Source: based work from Pivotal Cloud Foundry Solution team, discussions with GSA’s Diego Lapiduz.
“You can type anything you want in a Word doc!”, or, auditors
30
• Include auditors & security staff from the start
• Use pipeline and platform logs to prove auditability
• Re-visit processes and controls that no longer apply or need to be manual
Sources: IRS project with Pivotal Labs; US EPA; Pivotal customers; "Software devs' new mantra: Zen dogs dream of small-sized bones," Coté, Feb 2016. “Good Software is a Series of Little Failures,” Coté, April 2016; Mark Ardito, HCSC, at SP1.
Security also needs to be invited to the party
31
“[W]e estimate that fewer than 20% of enterprise security architects have engaged with their DevOps initiatives”
Neil MacDonald and Ian Head, Gartner, 2016
Sources: “DevSecOps: How to Seamlessly Integrate Security Into DevOps,” Gartner, 2016; “The Three R’s of Enterprise Security: Rotate, Repave, and Repair.” Pivotal’s Justin Smith, 2016.
Dealing with legacy: the stuff that makes all the money
Quarantine
• Low impact applications
• Lacks good testing, risky to change
• Change resistant priorities
Migration Strategies
• Virtualize & re-platform to control costs and maximize management
• API gateways combined with the strangler pattern
• Portfolio management (cf. The Three Horizons)
Sources: “DevOps isn't just about the new: It's about cleaning up the old, too,” Coté, April 2016; The Cloud Native Journey, Coté, 2016; Escape Velocity, Geoffrey Moore, Sep 2011 and "To Succeed in the Long Term, Focus on the Middle Term," Geoffrey Moore, August 2007. 32
“Pilot low-risk apps, and ramp-up”
33
Picking your initial apps, according to Comcast and Home Depot
Sources: Home Depot meetup, Oct 2015; Humana at CF Summit 2015; EU payday loan company; Pivotal Labs on large auto company; “Getting started,” Coté, Oct 2016; Comcast’s Christopher Tretina at SP1 2016. See also a general pattern applied to analytics from BCG, July 2016.
Get a pipeline
40% of orgs have CI in place: don’t be the other 60%!
35Sources: “A Guidance Framework for Continuous Integration,” Gartner, 2016; Start and Scaling DevOps in the Enterprise, Gary Gruver, 2016.
A build pipeline enables quality, speed, & trust
36
“I think that’s one of the biggest things that needs to be built up over time when you’re talking about deep ingrained cultures around managing risk by slowing everything down. To speed things up you need to have trust and complete transparency through that process which you get through enforcing continuous delivery pipelines.”
Dave Ehringer, Liberty Mutal
Sources: Liberty Mutual's Ehringer at SP1 2016; HCSC’s Mark Ardito at SP1 2016.
A cloud platform automates the low value work
Sources: "The cloud-native future," Casey West, O'Reilly Radar, Aug 2015; "Technical Dive into Cloud Native Application Platforms," Brian Gracely, Wikibon, Sep 2015.38
“We have Cloud Foundry, and we have the Spring Cloud Spring Boot stuff. It’s just there. If you’re doing Java, there isn’t really anything else out there that’s got this level of support. That’s just going to give you all of this stuff. You don’t need to go build it yourself anymore. You need to build on top of it. You need to go build something interesting that is your product, that is going to be the next generation thing that adds your business value.” –Adrian Cockroft
Pivotal Cloud Foundry, layers & capabilities
39
Application Framework
Runtime Platform
Infrastructure Automation
Infrastructure
Dev
Dev
Ops
BOSH
Contract: 12 factor app
Contract: BOSH Release
Contract: Cloud Provider Interface
IT Ops
Culture Cloud Native Framework Tools
Go
Source: “Get Started on Pivotal's Cloud Foundry Stack,” Coté/The New Stack, Jan 2016.
Thanks!@cote | [email protected]: https://cote.io/not-devops/
“We are uncovering better ways of developing software by doing it and
helping others do it.”- The Agile Manifesto, 2001
40