accelerating devops via data virtualization | delphix

© 2015 Delphix. All Rights Reserved

Session ID:

Prepared by:

Accelera'ngDevOpsUsingDataVirtualiza'onandMasking

HowitallWorks:SomeInternalsandUseCases

1227

@TimothyJGorman

TimGormanTechnicalConsultantDelphix


Foralmost25years,I’vebeenanOracledeveloperandDBA

Asadeveloper,thejobistocreatenew

funcMonalityandfixbugs

AsaDBA,thejobistocreatedatabases,protectthem,andkeepapplicaMonsrunning

opMmally

ThispresentaMonisaboutallthesethings,butmostlyitisaboutchange


DatavirtualizaMon(DataAsAServiceorDaaS)isfastbecomingthenewnorm

NobodycanjusMfyprovisioningnon-prodenvironmentsforDEV/QA/etcthewaywe

diduptonow

AndsupporMngDevOpsbeYeristhewaygoingforward


IntroducingDevOps•  IntegraMngdevelopment,tesMng,andoperaMonstoincreasedeliveryfrequency–  Fasternewfeaturestomarket–  LowerleadMmeforfixes–  Lowerrateoffailure

•  Ge\ngthererequires…–  End-to-endintegraMonofso^waredevelopment,tesMng,andoperaMons

–  CulturalreorientaMontowardcooperaMonandempathy–  Toolsandprocesses

4


IntroducingDevOps•  IntegraMngdevelopment,tesMng,andoperaMonstoincreasedeliveryfrequency–  Goal:Fasternewfeaturestomarket–  LowerleadMmeforfixes–  Lowerrateoffailure



5


IntroducingDevOps•  IntegraMngdevelopment,tesMng,andoperaMonstoincreasedeliveryfrequency–  Goal:Fasternewfeaturestomarket–  Goal:LowerleadMmeforfixes–  Lowerrateoffailure



6


IntroducingDevOps•  IntegraMngdevelopment,tesMng,andoperaMonstoincreasedeliveryfrequency–  Goal:Fasternewfeaturestomarket–  Goal:LowerleadMmeforfixes–  Goal:Lowerrateoffailure



7





8



•  Ge\ngthererequires…–  End-to-endintegraMonofso^waredevelopment,funcMonalandperformancetesMng,andoperaMons


9





10





11





12


IntroducingDevOpsUsingDevOpstoachieveConMnuousDeliverytakes

morethansheerwill

Ittakesnewtoolsandnewprocesses

Andbreakingdownsilosbuiltupovertheyears

ItisnotthewaythatDevelopment,QA/TesMng,andOperaMonshavedonethingsbefore

13



morethansheerwill




14



morethansheerwill




15



morethansheerwill



ItisnotthewaythatDevelopment,QA/TesMng,andOperaMonshavedonethingspreviously

16


Ops:“Butwejustfinishedbuildingthesesilos!”

17



18

Regulatorycompliance–separaMonofduMes



19


Systemcomplexity–administerbycomponent



20


Datasecurity–leastprivileges




21


Datasecurity–leastprivileges


Frompeopletoprocesses–newtoolsarethesoluMon


IntroducingDevOps•  IworktodeployatoolinorganizaMonsjustbeginningto

embraceDevOps–  SomeMmestheseorganizaMonsdon’tknowtheyare

•  Buttheyare…yestheyare…

•  Ifthechallengestodeploymentweremerelytechnical–  Itwouldtaketwohours,tops

•  ButthebiggestchallengesareculturalandpoliMcal–  Somanyofmydeploymentstakemonths

•  Thegoodnewsis:onlythefirstdeploymentisthatpainful

22



embraceDevOps–  SomeMmestheseorganizaMonsdon’tknowtheyareembracing

anything•  Buttheyare…yestheyare…




23








24








25








26








27







•  Thegoodnewsis:onlythefirstdeploymentisthatpainfu

28








29


Whatisdatavirtualiza'on?•  Servervirtualiza'onhashadanextraordinaryimpactonIT

–  ConverMnghardwareintoso^ware–  ControllingvirtualizedhardwarethroughorchestraMonscripts

•  ButservervirtualizaMonisnotacompletesoluMon–  VirtualizingCPU,memory(RAM),andnetwork–  Butwhataboutstorage???

•  Fromahigh-levelperspecMve,servervirtualizaMonhascausedthewhite-hotstoragemarkettosuper-nova–  Soeasytocreatevirtualmachines,andstorageischeap

•  Butisstoragecheapenough?

•  Dataneedstobevirtualized,justlikeservers

30


Whatisdatavirtualiza'on?•  ServervirtualizaMonhashadanextraordinaryimpactonIT



•  Fromahigh-levelperspecMve,servervirtualizaMonhascausedthewhite-hotstoragemarkettosuper-nova–  Soeasytocreatevirtualmachines,andstorageischeap



31





•  Fromahigh-levelperspecMve,servervirtualizaMonhascausedthewhite-hotstorageindustrytosuper-nova–  Soeasytocreatevirtualmachines,andstorageischeap



32








33







•  Dataneedstobevirtualized,justlikeserversButfirst,let’sstartfromthebeginning…

34


AreyoutoobusytoInnovate?

Iner'a35


TheGoal:TheoryofConstraints

•  Longbuildcyclesarewasteful

•  QA/Tes'ngisthefirstvicMm

•  Improvementnotmadeattheconstraintisanillusion

36






37






38


Factoryfloor

39


Factoryfloor

constraint

40


Tunebeforeconstraint

constraint

Tuninghere

Stockpiling

41


Tunea[erconstraint

constraint

Tuninghere

Starva'on

42


Factoryfloor:op'mizingattheconstraint

constraint

Goal:findconstraintandopMmizeit43


DoestheTheoryofConstraintsworkforIT?

•  GoalsClarify•  MetricsDefine•  ConstraintsIdenMfy•  PrioriMesSet•  IteraMonsFast

•  CI•  Cloud•  Agile•  Kanban•  Kata

“ITisthefactoryfloorofthiscentury”44


ThePhoenixProject:“TheGoal”appliedtoIT

“ITisthefactoryfloorofthiscentury”

WhatistheconstraintinIT?

45


ThePhoenixProject:top5constraintsinIT?

1. QAsetup2. Dev/Buildsetup3. CodeArchitecture4. Development5. Productmanagement

-GeneKim,authorof“ThePhoenixProject”

“OneofthemostpowerfulthingsthatorganizaMonscandoistoenabledevelopmentandtesMngtogetenvironmenttheyneedwhentheyneedit“

46


Dataistheconstraint

60% Projects Over Schedule

85% delayed waiting for data

Data is the Constraint

CIOMagazineSurvey:

…onlyge\ngworse…

Gartner:DataDoomsday,by20171/3rdITincrisis47


•  DataConstraint•  AYemptedsoluMons•  SoluMon•  UseCases

Inthispresenta'on:

© 2015 Delphix. All Rights Reserved 49

•  PRODiswhatwecaremostabout…

Theproblem

PROD


•  PRODiswhatwecaremostabout…–  ButbehindeveryPROD…

•  ThereisQATEST…

Theproblem

PROD QATEST



•  ThereisQATEST,DEV…

Theproblem

PROD QATEST UAT



•  ThereisQATEST,DEV…•  …andotherproject-specificenvironmentstosupport

Theproblem

PROD QATEST UAT


•  Also,asPRODgrows…

Theproblem

PROD PROD


UATQATEST

•  Also,asPRODgrows…–  ThensodothesupporMngnon-PRODenvironments…

Theproblem

PROD


Theproblem

CEO

COO

CFO CMO CSO CIO

•  AndsoinevitablythesituaMonshi^sfromthis…


Theproblem

CEO

COO

CFO CMO CSO CIO

StorageAdministrator

•  Tothis…

*InspiredbyConnorMcDonald(hYp://connormcdonald.wordpress.com/)


ITindustryisgenerallyunawareoftheproblem

57


Companiesunawareoftheproblem

TesterorDeveloperBoss,StorageAdmin,DBA

58


•  Inbuild…

1.  BoYlenecksbetweenprojects

2.  ExpensiveSlowQA/Test3.  WaiMngforenvironments4.  MoreMmespentinsetup

thantes'ng5.  ProducMonBugs6.  ExpensiveSlowQA

WhatProblemsdoestheDataConstraintCause?

•  InoperaMons…

1.  StorageexhausMon2.  NetworksaturaMon3.  Admincycles4.  Unabletofixproblems5.  Alwaysbehind


Produc'onWall

60

Produc'on


LifeinITwithoutQA/Test…silos

61


•  Dataconstraint•  AYemptedsoluMons•  SoluMon•  UseCases

Inthispresenta'on:


•  SometrytomiMgatetheproblembycopyingsubsetsofPROD…

•  …butitisdifficultandMme-consumingandexpensivetocreatereferenMally-correctsubsetsofdatabases.

Leadstobuggycode…

A^emp'ngtosolvetheproblem…

PROD QATEST DEV UAT




Leadstobuggycode…


PROD QATEST DEV UAT


•  CloningproducMontonon-productinevitablyperformedinfrequently…

…meaningthatschemasanddataareolder,dirMerduetoprevioustesMng,andtoosmalltoaccuratelyrepresentreality


PROD QATEST DEV UAT


•  CloningproducMontonon-productinevitablyperformedinfrequently…

•  …meaningthatschemasanddataareolder,dirMerdueto

previoustesMng,andtoosmalltoaccuratelyrepresentreality


PROD QATEST DEV UAT


PROD

•  CreaMngsnapshotswithmirrorsplits…–  Mirrorthevolumeoneextracopy


PRODPROD


PROD

•  CreaMngsnapshotswithmirrorsplits…–  Mirrorthevolumeoneextracopy–  ThenceasewritestothatextracopyataspecificMmeandmakeitseparately

addressableasaseparatevolume


PRODPROD


PROD


addressableasaseparatevolume–  Tocreateanothersnapshot,“re-silver”thevolumeintothemirrorset


PRODPROD


PROD


addressableasaseparatevolume–  Tocreateanothersnapshot,“re-silver”thevolumeintothemirrorset–  Andit’sreadytosplitagain


PRODPROD


PROD



–  Whilewe’vesolvedtheproblemofquicklycreaMngnewcopies


PRODPROD


PROD



–  Whilewe’vesolvedtheproblemofquicklycreaMngnewcopies•  Wehaven’tsolvedtheproblemofusingafullimage


PRODPROD


PROD



–  Whilewe’vesolvedtheproblemofquicklycreaMngnewcopies•  Wehaven’tsolvedtheproblemofusingafullimage•  Andre-silveringisnotafastoperaMon,soweneedMmeto“reload”


PRODPROD



CEO

COO

CFO CMO CSO CIO


We’resMllatsquareone…

…anditgetsevenworseBecausenowwehavetopredictthesizeofeverythingwithperfectaccuracy

andthenpre-allocateforcopiesaswellasvolumes



CEO

COO

CFO CMO CSO CIO






So,inaperfectworldwhatwe’dliketoseeissomethinglikethis…


PROD

QATforTom

QATforDick

UATforSally

DEVforHarry

QATforBecky



PROD

DEV/QAT/UAT

Tom Dick Sally Harry Becky

…but,intherealworldweseethis…


•  It’snoteasyfordevelopersandtesterstoshareenvironmentssimultaneously–  Changesmadebyeachuserconflictwithoneanother

•  Soitbecomesnecessarytoserializeaccesstothelimitednumberofenvironments–  Eachuserqueuesattheresource,sotheirprojecttakesmore'me

elapsed–  EachuserdestrucMvelychangestheresource

•  Andnowweneedawaytoresetorcleanuptheenvironmentbetweeneachuse–  ResetorcleanuptakesMme,whichcausesfurtherdelaysbetween

uses







uses




•  Soitbecomesnecessarytoserializeaccesstothelimitednumberofenvironments–  Eachuserqueuesattheresource,sotheirprojecttakesmoreMme



uses







uses



•  Dataconstraint•  AYemptedsoluMons•  SoluMon•  UseCases

Inthispresenta'on:


•  ThebiggestproblemwithcloningenvironmentsanddatabasesisalltheduplicaMonMost(ifnotall)oftheblockscomprisingthedatabaseorfile-systemexactlythesame

Whatifwestoreonlyonecopyofeachversionofablock?Copy-on-write(COW)

Nevermodifyablock,butinsertanewversioninstead

Thenletthestoragefigureoutwhatwe’resupposedtobeseeing?ThestoragemaintainstherelaMonshipsandversionsonretrieval

AndthenmakeitportablesothatANYplatorm(Unix/Linux,Windows)canuseit?

NFS(networkfilesystem)

Asolu'on…


•  ThebiggestproblemwithcloningenvironmentsanddatabasesisalltheduplicaMon–  Most(ifnotall)oftheblockscomprisingthedatabaseorfile-system

exactlythesame

Whatifwestoreonlyonecopyofeachversionofablock?Copy-on-write(COW)





Asolu'on…



exactlythesame

•  Whatifwestoreonlyonecopyofeachversionofablock?Copy-on-write(COW)





Asolu'on…



exactlythesame

•  Whatifwestoreonlyonecopyofeachversionofablock?–  Copy-on-write(COW)

•  Nevermodifyablock,butinsertanewversioninstead




Asolu'on…



exactlythesame



•  Thenletthestoragefigureoutwhatwe’resupposedtobeseeing?ThestoragemaintainstherelaMonshipsandversionsonretrieval



Asolu'on…



exactlythesame



•  Thenletthestoragefigureoutwhatwe’resupposedtobeseeing?–  ThestoragemaintainstherelaMonshipsandversionsonretrieval



Asolu'on…



exactlythesame




•  AndthenmakeitportablesothatANYplatorm(Unix/Linux,Windows)canuseit?NFS(networkfilesystem)

Asolu'on…



exactlythesame




•  AndthenmakeitportablesothatANYplatorm(Unix/Linux,Windows)canuseit?–  NFS(networkfilesystem–Unix/Linux),iSCSI(Windows)

Asolu'on…


•  Cloningtheoldway…

Asolu'on…

PROD QAT


•  Cloningthesmartway…

Asolu'on…

PROD QATdSource


•  Cloningthesmartway…–  Aschangesaremadetotheclone,onlythosechangedblocksarestored…

Asolu'on…

QATdSourcePROD



•  Takeslessstorage,fastertocopy•  Thecostoftheclonehasgonewaydownintermsofstorageand'me

Asolu'on…

QATdSourcePROD




Asolu'on…

CapEx

QATdSourcePROD




Asolu'on…

CapEx OpEx

QATdSourcePROD


•  Overallarchitecture•  Internalfile-system

Howdoesitwork?


Overallarchitecture

Delphix

PROD1

PROD2

PROD3

<50msnetwork

SSHJDBCDSP


Overallarchitecture

Delphix

PROD1

PROD2

PROD3

<50msnetwork

SSHJDBCDSP

NotreplicaMon(currentpoint-in-7me),buta'meflowwithconfiguredretenMon


Overallarchitecture

Delphix

PROD1

PROD2

PROD3

<50ms

Virtualmachine•  4,8,12,16vCPUs•  32-512GBvRAM•  <8-10msI/O

latencytounderlyingstorage

network

SSHJDBCDSP



VDB4

VDB3

VDB2

Overallarchitecture

Delphix

PROD1

PROD2

PROD3

VDB1

network

<50ms <1ms

Virtualmachine•  4,8,12,16vCPUs•  32-512GBvRAM•  <8-10msI/O

latencytounderlyingstorage

UNIX/Linux:NFSWindows:iSCSI

network

SSHJDBCDSP



Snapshot1–ini'alload

a b c d e f g h i

We start with a full backup. Includes transaction logs needed for recovery.

JonathanLewis©2015

Sn#1

110


Snapshot2–incomingnewchanges

b' c'

a b c d e f g h i

A^eriniMallink/load,Delphixisincrementalforever

JonathanLewis©2015111

Sn#1


ApplySnapshot2

a b c d e f g h ib' c'

The Delphix appliance unpacks the backup and "overwrites" the initial backup with the changed blocks. DxFS makes new copies of the changed blocks, never updates a block

112JonathanLewis©2015

Sn#1 Sn#2


Snapshot3–moreincomingchanges



i'

Sn#1 Sn#2


ApplySnapshot3



i'

Sn#1 Sn#2 Sn#3


Reten'onpolicies–droppingsnapshots



i'

Sn#1 Sn#2 Sn#3


Reten'onpolicies–droppingsnapshots

a d e f g h ib' c'


i'

Sn#2 Sn#3


Crea'ngaVDB

a d e f g h ib' c'


i'

Sn#2 Sn#3VDB#1


ChangestoaVDB

a d e f g h ib' c'


i'

Sn#2 Sn#3VDB#1

a‘'


OpenZFSfeaturesemployedwithinDxFS•  Copy-On-WritetransacMonmodel•  128-bitfile-system•  L1ARC–RAM-basedadapMvereplacementcache(ARC)•  Dynamicstriping•  Lightweightfile-systemcreaMon(snapshotsandclones)•  ChecksumsandMerkleTreefile-system•  Block-leveldeduplicaMon•  Transparentblockcompression•  Variableblocksizes•  ReplicaMon•  AdapMveendianness

121


Changingreality

122


Changingreality

123


Changingreality

124


DatabaseVirtualiza'on

125


•  Dataconstraint•  AYemptedsoluMons•  SoluMon•  Usecases

Inthispresenta'on:


WorkingwithVirtualData•  Unlimited•  Fullsize•  SelfService•  Secure•  Cloudonramp Developing

Tes'ngDebugging


WorkingwithVirtualData:Unlimited

GIFbySteveKaram 128


WorkingwithVirtualData:Fullsize

129


WorkingwithVirtualData:SelfService

130


WorkingwithVirtualData:Secure

131

•  Encryp'onreversiblychangesdataatrest,authenMcatedandauthorizedusersmayview

•  Redac'onchangesdataonretrieval

•  Maskingirreversiblychangesdataatrest–  maintainingrelaMonalintegrityacrossdatadistribuMonpaYerns


WorkingwithVirtualData:cloudonramp

132

Thecloudislargelyano-flyzoneforproprietaryUNIX.MigraMngfromUNIXtoLinux(U2L)iso^enthefirststepofacloudmigraMon.DatavirtualizaMonmakesU2Leasierforcross-platormdevelopmentandtesMngandmigraMon


TesMngwithVirtualData•  Fast,parallel•  Rewind•  A/BtesMng•  Sharing


Dev

QA

Instance

Prod

DVA

•  Low Resource •  Find bugs Fast

Tes'ngwithVirtualData:Fast,Parallel

Produc'onTimeFlow

134


Tes'ngwithVirtualData:Rewind

Instance

QA

Prod

Produc'onTimeFlow

135


Tes'ngwithVirtualData:A/Btes'ng

Instance

Instance

Instance

Index1

Index2

Produc'onTimeFlow

136


Tes'ngwithVirtualData:versioncontrol

137

Dev

QA

2.1

Dev

QA

2.2

2.1 2.2

Instance

Prod

DVA Produc'onTimeFlow


Tes'ngwithVirtualData:sharing

Instance Jane’sVDB'meflow

138

DialoguebetweenQAtester(Jane)anddeveloper(Mary)…

Jane:Mary,I’vefoundadataprobleminversion3.2.2a.Mary:Canyoubookmarkthatandshareit?Jane:Itisnamed“Jane3.2.2a3pm”,lookfordupsintablesABCandXYZ.Mary:Hmm,IrestoreditandIseetheproblem.Thanks!

Instance Mary’sbranch

Jane3.2.2a3pm


•  Projects “12 months to 6 months.” –  New York Life

•  Insurance product “about 50 days ... to about 23 days” –  Presbyterian Health

•  “Can't imagine working without it” –  State of California

VirtualDataquotesfromcustomers


•  Problem:Dataistheconstraint•  SoluMon:Virtualizethedata•  Results

• HalftheMmeforprojects• Higherquality,beYertesMng• Increaserevenue

Summary


Pleasecompletethesessionevalua'onWeappreciateyourfeedbackandinsightYoumaycompletethesessionevaluaMon(session#1227)usingthemobileapp

Email: [email protected]’lquesMons: hYp://Community.Delphix.comBlog:hYp://EvDBT.com Mobile:+1(303)885-4526“TheGoal:AProcessOfOngoingImprovement”in1984byEliyahuGoldraY“ThePhoenixProject:ANovelAboutIT,DevOps,AndHelpingYourBusinessWin”in2012byGeneKim,KevinBehr,GeorgeSpafford

accelerating devops via data virtualization | delphix

Data & Analytics