moving to a devops mode – easy, hard or just plain terrifying?

@spoole167 @danielbryantuk @spoole167 @danielbryantuk #DevOps#DevOps

MOVING TO A DEVOPS MODE: EASY, HARD OR JUST PLAIN TERRIFYING?

Daniel Bryant Steve Poole@danielbryantuk @spoole167Daniel Bryant Steve Poole@danielbryantuk @spoole167

Your Guides for Today’s Journey into DevOps…Your Guides for Today’s Journey into DevOps…

Daniel Bryant

Principal Consultant, OpenCredo

Full-Stack Developer

Open Source Advocate

Agile, Continuous Delivery and DevOps

Aspiring Software Craftsman

Steve Poole

IBM Developer

Making Java Real Since Version 0.9

Open Source Advocate

DevOps Practitioner (whatever that means!)

Driving Change

Our Goals…Our Goals…

• DevOps is about extending ‘agility’ across your IT organisation

• Implementing this is not going to be easy…

• … some things will be hard, some things terrifying

• However, there are real benefits

@YourTwitterHandle#DVXFR14{session hashtag} @spoole167 @danielbryantuk @spoole167 @danielbryantuk #DevOps#DevOps

Once upon a time the universe was staticOnce upon a time the universe was static

Design, Code Unit test

Functional TestSystem test

Stage Configure

Fix bugsFix bugsHelpline

Monitor, backupupgrade, support,

repairsecurity, compliance

Usesreality chasm

This was called “Waterfall” This was called “Waterfall”

Reinforced team separation

Long feedback cycles Long time-to-market

Tended to increase ‘Release Panic’

BIGRealityChasmDEVDEV OPSOPS

Waterfall - more a roller-coaster ride…Waterfall - more a roller-coaster ride…

Start to panichere

DEVDEVOPSOPS

ClientClient£

Value here

Really panichere

Reality Chasm

If you fell into the reality chasm…If you fell into the reality chasm…

Start to panichere Really

panichere

DEVDEVOPSOPS

ClientClient

NoValue here

Agile helps reduce the chasm Agile helps reduce the chasm

Feedback here

OPSOPS

ClientClient

DEVDEV

Feedback here

QAQA£

Value here

But now clients say…But now clients say…

OPSOPS

ClientClient

DEVDEV

I want valuehere

And here

The new challenge – we can’t afford the gapThe new challenge – we can’t afford the gap

OPSOPS

ClientClient

DEVDEV

Move LeftMove Left

How to bring Dev, QA & Ops together?How to bring Dev, QA & Ops together?

Culture

Common goals

Shared responsibility

Education

Standard technology

Netflix are not Unicorns!Netflix are not Unicorns!

Neither are Amazon, etsy, Spotify…

and besides…

Change your mindset…Change your mindset…

Culture is VitalCulture is Vital

• Culture drives behaviour, drives culture…

• “Communication, simplicity, feedback, courage”

• Everyone is responsible for delivery

• Continuous experimentation and learning

• Not easy to change culture

• The hardest part of DevOps…

• …but you will learn new things

Changing CultureChanging Culture

• Greenfield

• Flickr’s story (slidesha.re/sHpYV)

• “Why other people don’t get it”

• Sandro Mancuso (slidesha.re/1bcStpe)

• Enterprise

• “The Phoenix Project” (Gene Kim et al)

Changing CultureChanging Culture

• Create an effective team…

• “Habits of highly effective technical teams” • Martijn Verburg (bit.ly/1aF9SnK)

• “Patterns of Effective Teams”• Dan North (vimeo.com/68226771)

• Buy some doughnuts… • Andrzej Grzesik (http://www.youtube.com/watch?

v=OFr0PoIIdvk)

We’ve all got issues…We’ve all got issues…

Great, so how does this work for individual teams?

…CD a

DevOps

Continuous Delivery and DevOps go hand-in-hand…Continuous Delivery and DevOps go hand-in-hand…

• Create a build and deployment pipeline

• Adopting Continuous Delivery • Jez Humble (http://bit.ly/1oEReUM)

• Implementing Continuous Delivery• Rachel Laycock (http://bit.ly/1l1qMPf)

Start with automated build & unit testStart with automated build & unit test

Continuous IntegrationContinuous Integration

JUnitJUnit

SCM BuildBuild Orchestration

UnitTest

Add staging for automated QAAdd staging for automated QA

JUnitJUnit

Continuous DeliveryContinuous Delivery

Repository

Performance & QA

Deployment tools

Add “automatic(ish) deployment to production™” Add “automatic(ish) deployment to production™”

JUnitJUnit

Continuous DeliveryContinuous Delivery

Continuous DeploymentContinuous Deployment

Hosting

Deployment tools

Base it on virtualization technologiesBase it on virtualization technologies

Continuous Deployment PipelineContinuous Deployment Pipeline

External CloudExternal CloudOn premises cloudOn premises cloud

rJUnitJUnit

The imperative of DevOpsThe imperative of DevOps

Startups through to big businesses are demanding the value that DevOps & Cloud Technologies can offer

1. Production deployment pipeline up and running in days

2. Updates published in hours

DevOps helps transition an organization into this new world…

Helps to remove the ‘reality chasm’

The imperative of DevOpsThe imperative of DevOps

The cost?

1. Standardized pipelines

2. Dev and Ops teams working together

3. Greatly expanding your horizons and your technical

skills

4. Leaving your comfort zone

Developers…Developers…

Contribute to the pipelineContribute to the pipeline

• Continuous Integration

• Unit / Integration Tests

• Automate all the things

• Stop throwing stuff over the wall…

• …or we’ll throw you over it too!

Moving closer to OpsMoving closer to Ops

• Design patterns

• Asynchronous communication

• Timeouts / retries

• Bulkheads / circuit-breakers

• Metrics are your friend

• Technical and business data

• Logging (centralised)

Thinking/Acting like a sysadminThinking/Acting like a sysadmin

• Learn Linux fundamentals

• Diagnostic skills

• top, iotop, iostat, netstat, vmstat

• Java utils: jps, jstat, jmap, jhat

• “DevOps Troubleshooting” by K. Rankin

• Maybe grow a beard…

QA…QA…

Automating QAAutomating QA

• Automate all the things…

• Tests can be specifications• Specifications can be tests…

• Make it easy for everyone to execute• Make it fast (and conditional)

• Contribute to the build pipeline• If you want people to care, then fail the build!

Automating QAAutomating QA

• Unit and Intra-component integration testing• Spock is awesome • Utilise embedded datastore/middleware

• Performance• JMeter + plugins • Gatling

• Website• Geb (Groovy + Selenium)

Operations…Operations…

Ops should be operational…Ops should be operational…

• Learn about coding (pair program!)

• Python, Ruby, Groovy

• Get closer to Dev & QA

• Provide constant feedback

• Embrace chaos for testing

• Simian army…

Monitoring is mandatoryMonitoring is mandatory

• Infrastructure monitoring

• Nagios

• Zabbix

• Splunk

• AppDynamics

• Several trail-blazers

• Etsy (www.codeascraft.com)

• Netflix (techblog.netflix.com)

Graphing…Graphing…

Say No To Snowflakes!Say No To Snowflakes!

• “Infrastructure as Code”• Version control everything

• Automate all provisioning• Chef, Puppet, SaltStack, Python, AWS CLI

• Play with Vagrant (www.vagrantup.com)

• Docker and Packer are also interesting

Who here ‘does’ Agile?Who here ‘does’ Agile?

Are you personally ready?Are you personally ready?

• Do you use Agile techniques?

• Can you spell “Continuous Integration”?

• Are the advantages of DevOps clear?

• Could you communicate them to your Dev & Ops teams?

SummarySummary

Businesses need to be able to react faster… …DevOps and the Cloud are key enablers

DevOps is as much a game changer as Agile was……this is a Developer, QA and Ops “renaissance”

Don’t be afraid to learn and experiment……you’ll benefit even if the tech doesn’t survive

Agile moved you closer to the customer……DevOps moves you closer to the IT team

Moving to a DevOps Mode…Moving to a DevOps Mode…

You should be terrified

The transition will be hard

But it’s easy to get started

moving to a devops mode – easy, hard or just plain terrifying?

Technology

slightly less adorable…more terrifying!

11 terrifying workplace facts

moving to a devops mode - easy, hard or just plain...

can you survive the dark terrifying passageways?

openstack and devops - devops meetup

why upnp is awesome and terrifying

devops - plain concepts...azure devops estrategias de...

paul gilbert - terrifying guitar trip guitar tabs

a terrifying terrorist!

devops devops devops, at froscon

hate and guns: a terrifying combination

paul gilbert - terrifying guitar trip.pdf

terrifying technique for guitar

devops(1) : what's devops - (mosg)

terrifying technique

paul gilbert - terrifying guitar 101

terrifying beauty of 20thcentury- rem koolhas

devops oxford- devops + bigdata @ realtime

the non-terrifying intro to semantic content

rd terrifying technique for guitar