@_AlexYates_#GroupBy

DevOps 101 for Data Professionals

How your job will change

Alex Yates

@_AlexYates_#GroupBy

DLM Consultant

workingwithdevs.com

alex.yates@dlmconsultants.com

Alex Yates

@_AlexYates_

@_AlexYates_#GroupBy

@_AlexYates_ | #GroupBy

@_AlexYates_#GroupBy

AgileScrumLeanIterativeContinuous Delivery

Developers

@_AlexYates_#GroupBy

MonitoringDeployment

IntegrityPerformance

DBAs

@_AlexYates_#GroupBy

2009: A regular session, at a regular conference, that changed everything

https://www.youtube.com/watch?v=LdOe18KhtT4/

@allspaw

@ph

@_AlexYates_#GroupBy

A brief history of DevOps

• 2008: Agile Toronto “Agile Infrastructure”• 2008: “Agile System Administrators” Google group• 2009 (June): “10+ Deploys Per Day”• 2009 (October): DevOps Days Ghent• #DevOps• 2013: The Phoenix Project• 2016: The DevOps handbook

@littleidea @patrickdebois

@allspaw

@ph

@realGeneKim

@jezhumblehttps://www.amazon.co.uk/d/Books/Phoenix-Project-DevOps-Helping-Business/0988262509/https://www.amazon.co.uk/Devops-Handbook-World-Class-Reliability-Organizations/dp/1942788002/

@_AlexYates_#GroupBy

Things that aren’t DevOps…Tools

People, job roles or teams

Processes or task lists Floating masses of visible, condensed water vapour

http://itrevolution.com/the-three-ways-principles-underpinning-devops/

@_AlexYates_#GroupBy

CALMS

C ultureA utomationL eanM easurementsS haring

@_AlexYates_#GroupBy

The three ways

Systems thinking

Amplify feedback loops

Culture of continual experimentation and learning

http://itrevolution.com/the-three-ways-principles-underpinning-devops/

@realGeneKim

@_AlexYates_#GroupBy

The automated deployment pipeline

@_AlexYates_#GroupBy

Databases are hard

@_AlexYates_#GroupBy

Farm Credit Services of America (FCSA)

• 100 person IT team, 14 sub-teams• Database version control inconsistent

• Deployment process manual• Delivery was slow and

unreliable

@_AlexYates_#GroupBy

• Standardised source control and delivery process

• Automated manual deployment tasks

Farm Credit Services of America (FCSA)

• Deployments easier to review

• Delivery faster and more reliable

@_AlexYates_#GroupBy

Farm Credit Services of America (FCSA)

http://www.codeaperture.io/2016/09/13/how-redgate-helped-define-our-process/

@_AlexYates_#GroupBy

There’s more than one way to skin a cat

@_AlexYates_#GroupBy

There’s more than one way to skin automatea cat

@_AlexYates_#GroupBy

V1 V2

Migrations vs state

@_AlexYates_#GroupBy

V1 V2

Migrations vs state

@_AlexYates_#GroupBy

V1 V2

Migrations vs state

@_AlexYates_#GroupBy

@_AlexYates_#GroupBy

“There's nothing more reliable than keeping track of exactly the scripts you intend to run, and running them, without trying to compare state and guess.”

@_AlexYates_#GroupBy

“There's nothing more reliable than keeping track of exactly the scripts you intend to run, and running them, without trying to compare state and guess.”

Paul Stovell, Octopus Deploy

http://docs.octopusdeploy.com/display/OD/SQL+Server+databases

@_AlexYates_#GroupBy

“As soon as you have multiple changes on a single aspect of an object, ordering and the ability to detect which change needs to be made gets very complicated.”

@_AlexYates_#GroupBy

“As soon as you have multiple changes on a single aspect of an object, ordering and the ability to detect which change needs to be made gets very complicated.”

Gert Drapers, built DataDude

https://blogs.msdn.microsoft.com/gertd/2009/06/05/declarative-database-development/

@_AlexYates_#GroupBy

Migrations vs state

http://workingwithdevs.com/delivering-databases-migrations-vs-state/

@_AlexYates_#GroupBy

Migrations vs state

http://workingwithdevs.com/delivering-databases-migrations-vs-state/

@_AlexYates_#GroupBy

Migrations vs state

http://workingwithdevs.com/delivering-databases-migrations-vs-state/

@_AlexYates_#GroupBy

Migrations vs state

http://workingwithdevs.com/delivering-databases-migrations-vs-state/

@_AlexYates_#GroupBy

Migrations vs state

http://workingwithdevs.com/delivering-databases-migrations-vs-state/

@_AlexYates_#GroupBy

Migrations vs state

http://workingwithdevs.com/delivering-databases-migrations-vs-state/

@_AlexYates_#GroupBy

Migrations vs state

http://workingwithdevs.com/delivering-databases-migrations-vs-state/

@_AlexYates_#GroupBy

11

2 Alter view: kittenTrainersNrLdn

Alter table: kittenTrainers

Both work!Same changes, versioned and deployed two ways

@_AlexYates_#GroupBy

Demo

@_AlexYates_#GroupBy

http://thenextweb.com/insider/2013/12/12/dba-dead/

@kennygorman

@_AlexYates_#GroupBy

http://www.scarydba.com/2015/02/24/devops-dba-word-no/ @GFritchey

@_AlexYates_#GroupBy

http://www.devopsdba.com/devops-dba/

@DevOpsDBA

@_AlexYates_#GroupBy

What you can do• Don’t be the bottleneck – be the fix• Embrace co-operation, automation and DLM• (Learn Git, tSQLt, NuGet and PowerShell etc)

• Pick a technical solution that suits your database/team• Design for deployability and testability• Data Platform, Cloud (not just on-prem SQL Server)• Be careful with the word “no”

@_AlexYates_#GroupBy

DLMConsultants.com/DevOps-101/

@_AlexYates_#GroupBy

Questions? Links: DLMConsultants.com/DevOps-101/ Rate me: GroupBy.org/go/session7Contact me: alex.yates@dlmconsultants.com

@_AlexYates_#GroupBy

Image sourcesAuthor Source Information

Chiltepinster Wikimedia Commons Mocking Bird Argument.jpg – Wikimedia Commons. This file is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported license. Source on Wikimedia Commons: “Own work”

Bit Boy Flickr The elephant in the room – Flickr. This file is licensed under the Creative Commons Attribution 2.0 Generic license.

Nils Rinaldi Flickr Hippo fight 2/3 – Flickr. This file is licensed under the Creative Commons Attribution 2.0 Generic license.

My own collection Taken by/property of Alex Yates Kitten, “There’s more than one way to skin a cat!”

Memegenerator.net Memegenerator.net I don’t always edit database. Content designed to be shared and delivered with credit to memegenerator.net.

BagoGames Flickr NBC takes another Whack at the IT crowd. This file is licensed under the Creative Commons Attribution 2.0 Generic license.

Biso Wikimedia Commons Rusty tools.jpg – Wikimedia Commons. This file is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported license.

Omnisource5 Wikimedia Commons Lenticular Cloud over Harold's Cross Dublin Ireland taken at 11:30AM, 30th June 2015 – Wikimedia Commons. This file is licensed under the Creative Commons Attribution-Share Alike 4.0 International license. Source on Wikimedia Commons: “Own work”