intelligent devops - driving continuous delivery by harnessing the power of analytics and autonomics
TRANSCRIPT
World®’16
Pre-ConEducation:IntelligentDevOps–DrivingContinuousDeliverybyHarnessingthePowerofAnalyticsandAutonomicsShamimAhmed- Sr.DirectorPreSales- CATechnologies
DO5X48E
DEVOPS
2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.
Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.
ForInformationalPurposesOnlyTermsofthisPresentation
3 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Abstract
Digitaltechnologiesarerapidlytransformingbusinesses.Thesesystemsneedtobeextremelyresponsivetoficklecustomersentiment,workacrossavarietyofdevices(fromlaptopstowearables)andnetworkconditions.SuchscenariosputevenmorepressureonITsystemsandprocessestobenotonlymoreresponsive,butadaptivetomeetdigitalbusinessneeds.WhileautomationsolutionswithincurrentDevOpsimplementationshelptoaddressagilityneed,suchautomationistypicallydrivenbystaticrulesusingconventionalscriptingandorchestrationtechniques.
Suchtechniquesincurhighmaintenanceoverheadstokeepthemupdatedrelativetochangingcircumstances.Therecentemergenceofpredictiveanalyticsandcognitivetechnologies(suchasautonomics)haveopenedthepossibilitytodriveadaptiveautomationwithinContinuousDeliveryimplementations.Suchautomationisabletoself-healandself-configurebasedonchangingsituations.
JointhissessionandlearnhowCAishelpingtopowerthenextgenerationofsuchintelligentDevOpsimplementations.
ShamimAhmedCATechnologiesSr.DirectorPreSales
4 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DIGITALTRANSFORMATIONIMPACT
CHALLENGESFORDEVOPS
SOLUTIONFOUNDATIONS:ANALYTICSANDAUTONOMICS
WHATINTELLIGENTDEVOPSLOOKSLIKE
CASOLUTIONSFORINTELLIGENTDEVOPS
Agenda
1
2
3
4
5
6 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
AUTONOMICS GENOMICS
ROBOTICS
INTERNETOFTHINGS AV/VR
OMNICHANNEL
DigitalTransformation
7 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
TheDigitalEcosystem
"Theexplosionofdatasourcesandcomplexityofinformationmakesmanualclassificationandanalysisinfeasibleanduneconomical"
- Gartnertop10StrategicTechnologyTrendsfor2016
8 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
IntelligentAnalyticsistheNewBattleground
>50%largeorganizationsgloballywillcompeteusingadvancedanalytics&proprietaryalgorithms
40%enterprises'net-newanalyticsinvestmentwillgotopredictive/prescriptive
75%technology-orientedbusinessintelligencecompetencycenterswillevolvetofocusoninformationvaluegeneration
Source:Gartner
11 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
KeyChallengesPosedbyAdaptiveDigitalSystems
AUTOMATIONMAINTENANCE
STATICRULES BIG(un-structured)DATA
IOT,IOE
CX SECURITY
STRUCTUREDAUTOMATION
12 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Whatweneedfornext-genDevOps
AUTOMATED&SELF-HEALINGAUTOMATION
DYNAMIC/ADAPTIVERULES
BIGDATAANALYTICS
IOT-Ops
CX-Ops SEC-Ops
INTELIGENT/ADAPTIVE/COGNITIVEAUTOMATION
+ +
+
+
+
+
+
13 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ClassicDevOpstechniquesdonotfullyexploitdataoneithersideofthe“releaseboundary”
People
Process
Tools
Data
14 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
TheKeyTransformationsNeeded
TRADITIONALDEVOPS
INTELLIGENTDEVOPS
Focusonautomation,efficiencies,metrics,
speed,quality
FocusonCX,adaptiveautomation,predictiveoutcomesandinsight
15 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CONTINUOUSDE
LIVE
RYM
ATURITY
ManualScripted
Orchestrated
Continuous
Intelligent
BUSINESSVALUE
LEVEL1 LEVEL2 LEVEL3 LEVEL4 LEVEL5
?
Organizationdepthandbreadthof
agilepractice
*Applicationreleaseautomationview
ContinuousOptimization
End-to-EndConnection
Consistency&Collaboration
Heroes&HeavyLifting
IntelligentDevOpsExtendstheMaturityJourney
MAT
URITY
17 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
SystemofIntelligenceforDevOps
FoundationforIntelligentDevOps
DevOpsInsight/Analytics
DevOpsAutonomics
19 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
SystemsofIntelligence
SOI
Visualization
(Big)Data
Analytics
Inference
IntelligentProcess
Automation
DigitalTechnologyIntegrations
20 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
AnalyticsOverview
Whatishappening?
Whyisthishappening?
Whatwillhappenandwhy?
Whatshouldwedo?
Areweaskingtherightquestions?
Predictiveanalytics
DescriptiveAnalytics
DiagnosticAnalytics
PrescriptiveAnalytics
DeepLearning
21 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ExamplesofAnalyticsUsecases
Whatarethepastdefecttrends?
Whatweretherootcauseofthepastdefects?
Whatdefectsarewelikelytofind?
Whatpreventivemeasuresshouldwetake?
Haveweoverlookedanythingfordefectprevention?
Predictiveanalytics
DescriptiveAnalytics
DiagnosticAnalytics
PrescriptiveAnalytics
DeepLearning
22 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
AutonomicsOverview
DO THINK LEARN
StructuredData Un-StructuredData
23 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ExamplesofAutonomicsUseCases
DO THINK LEARN
Scripting Orchestration Autonomic Cognitive
• Self-healingvirtualservices
• Self-healingtests/suites
• Self-healingtestdata• Self-healing
topologies• Autonomousrelease
decisionmaking
• Buildautomation• TestAutomation
scripting• Environment
provisioningscripting• Deployment
automationscripting
• Buildsofbuilds• Model-based
topologydeployment• E2EContinuous
Delivery
• Automatedtestautomation
• NLP-basedtestreverseengineering
• Dynamicbuildpromotion
24 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
HowAnalyticsandAutonomicsworktogether
Model Progressive Refinement
26 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
IntelligentDevOpsCharacteristics
§ Failuredetectionandprevention
§ Scriptedautomation
§ Limitedprocessautomationbasedonstaticrules
§ Individualmetricsbasedonstructureddatainlifecyclesilo
§ Limitedinsightandperspectives
§ Reactive:dealswith“Past”
§ Failureprediction
§ Automatedautomation
§ Intelligentprocessautomationbasedondynamicinference
§ Analyticsbasedonlargescalestructuredandunstructureddataacrossthelifecycle
§ FocusonInsights
§ Predictive:from“Whatdidhappen?”to“Whatwouldhappen?
TRADITIONALDEVOPS
INTELLIGENTDEVOPS
27 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
PortfoliobacklogprioritizationandvalueanalysisImproved
schedulingandcapacity
Validatedrequirementsin
backlogImprovedestimates
Predictfailuresbasedoncode
commitsDynamiccodepromotioncriteria
Predictdefects/failuresOptimizedTests
Scenarioidentificationbasedontrends
CXScoresAnomalydetectionBetterloadbalancing
ExamplesofDevOpsIntelligence
PLAN DEFINE DEVELOP TEST RELEASE OPERATEProcess
IntelligentDevOpsbasedonContinuousInsight
ExamplesofDevOps
Intelligence
ExamplesofOutcomes
Investmentdecisionanalytics
Codequalityanalytics
TestOptimization&Defectprediction
A/BTesting
Log&CXAnalytics
CX-basedrequirements
28 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DefineIntelligenceExample
OMNI-CHANNELFEEDBACKINGESTION
FEATUREREQUESTS
HATEDFEATURES USABILITY NPS
ReqValidation UXFixes Remediation
BIGDATAPROCESSING
INSIGHTS
SOLUTIONS A/BTestScenarios
SOI
29 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DevelopIntelligenceExample
Code
Coveragedata
CodeQualitydata
Builddata Unittestdata
SOISCMdata
§ Failuremodeanalytics
§ Qualityriskprediction
§ Promotiondecisionanalytics
§ Teamperformanceanalytics
30 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
SOI
§ Identifymissingtestcases
§ Performancescenarios
§ Testdata
§ Defect/scheduleprediction
§ Appstabilityprediction
§ Testoptimization
§ Fixrateprediction
§ Rootcaseprediction
§ Self-healingtests/testdata
§ Self-healingvirtualservices
TestIntelligenceExample
Testexecutiondata
Defectdata
Testscheduledata
Testenvironmentdata
Productionlogdata
31 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
SOI
§ Correlatingdata(requirementsthrurelease)acrosslifecycle
§ Deploymentfailureprediction
§ Self-healingtopologies/workflows
§ Deploymentworkflowoptimization
§ A/Bscenarioidentification
Release/DeployIntelligenceExample
Testexecutiondata
Builddata
Topologydata
Releasepayloadandscheduledata
Deploymentdata
32 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
SOI
§ Capacityallocation
§ Anomalydetection
§ Automatedeventcorrelation
§ CX/NPSscores
§ Testscenarios/data
§ Mobileanalytics
OpsIntelligenceExample
Logdata Ticketdata
CXData Incidentdata
Monitoringdata
33 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
HowWeCandoBetterX-LifecycleIntelligence:DataHubIntegration
DevHub TestHub OpsHub
DEPLOYMENTHUB
34 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ExampleofDevelopmentHub
IDE
Build
CodeTest
Testing
Backlog
CI
SCM
Data
Virtualization
TestData
Topology
Deployment
35 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
WhyweNeedaHub
IntegratedOrchestration:
FocusofControl
IntegratedChangemanagement:
UnderstandImpact
Scale:
SupportAgileatScale
IntegratedReporting:
OneSourceofTruth
IntegratedAnalytics:
IntelligentInsight
36 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
BeyondHubs– DevOpsDataLake
PLAN DEVELOP TEST RELEASE OPERATEPROCESS
X-LIFECYLEINSIGHT
DATAHUBS
LIFECYCLEDATALAKE
37 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ExampleofX-LifecycleIntelligence:ContinuousAdaptiveTestOptimization
ExistingManualTestCases
StaticallyOptimizedTestCases
OptimizerwithNLP
UnstructuredPartialcoverage
TestbloatLoweffectiveness
Analog–difficulttomaintain
Dynamically-OptimizedTestCasesbasedonContinuousInsight
NewRequirementsandBizProcesses
Fewestteststeps(reduceby>30%)Greatercoverage
HighereffectivenessFullydigitized–easytomaintain
ContinuousoptimizationHighesteffectivenessReduction>50%
PLAN OPSDEV RELEASE
39 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CASolutionsAcrosstheDevOpsLifecycle
Define Develop Build DIT QA Release OperatePlan
Process
Stage
CAAPIM
CADevTest (SV+AppTest +CAI),Blazemeter
CATDM
CAARD
CARA/CDE
CAUnifiedMonitoringCAITSM
CAPPM,AgileCentral
40 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
AnalyticsasPartofCA’sDNA
REALTIME,BIGDATAANALYTICSEMBEDDEDTHROUGHOUTOURPORTFOLIO
AGILEMANAGEMENT AGILEOPERATIONS DEVELOPERPRODUCTS
CONTINUOUSDELIVERY MAINFRAME SECURITY
APIanalyticsReleasemanagementanalytics AccessincidentresponseIntelligentOperations
41 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAAnalyticsisaCommonTechnologyComponentembeddedinourproducts
BestofBreedOpenSourceTechnologies
(Hadoop,Spark,Kafka,Elasticsearch)
IndustryProvenArchitecture
(Lambda&MicroServices)
SingleCodeLine,MultipleDeploymentOptions
(Cloud,OnPrem,Mainframe)
EncapsulatedComplexTechnologythroughSimpleConsumableInterfaces
(RESTfulAPIs)
CAAnalytics
42 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Jarvis:CAReferenceArchitectureforSOIDATACOLLECTORS
DataAggregator
Agents
…
Probes
Machine/LogFileData
DATA-DRIVENAPPS
ExistingCAApps
Custom-buildApps
NewCAApps
PartnerApps
ANALYTICSENGINE
DataIn
jectionAP
I
DataAccessA
PI
ServiceLayer
DataExtraction
DataProcessing(Speed)
DataProcessing(Batch)
DataBus
SessionIET03T:“AnalyticsatCA– What’sCooking?ProjectJarvis”Wednesday,November16:04:30PM- 05:15PMCAAcceleratorZone
43 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
§ Realtimeadvisorforcodedelivery
§ Architecturalmodeling
§ Riskreporting
§ Teamoptimizer
CADevelopIntelligence:CodePilot.ai
CodeDeepmachinelearningNeuralmapofcode
SessionIET07TV:“UnlockDeveloperProductivitywithCodePilot.ai”Thursday,November17:04:30PM- 05:15PM,CAAcceleratorZone
44 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAAppsHubusingAgileCentral
IDE
Build
CodeTest
Testing
Backlog
CI
SCM
Data
Virtualization
TestData
Topology
Deployment
AgileCentral
Studio Visual
Eclipse
IntelliJ
Electric Cloud
CloudBees
Junit
Nunit
TestNG CA AppTest
ALM,UFT
CA TDM
CA SV
CA Rally CA
RA
CA RA
45 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Plan Define Unittest Code Checkin Build Provision Test Release
ScalingAgileDevelopmentwithaCAEnterpriseAppsHub
IntegratedanalyticsDecisionengine
IDE BuildUnittestAgilePod
2
SCM
Unittest BuildAgilePod
N
IDE SCM
Unittest IDE BuildAgilePod
1
SCM
IntegratedtoCAACHub
IntelliJ
…
AgileCentral
46 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CATestIntelligence:LearningVirtualService
BRINGSTRUEARTIFICIALINTELLIGENCE(AI)TOSERVICEVIRTUALIZATION§Virtualizeserviceswithoutrequiringanyknowledgeordecodingoftheserviceprotocols§Appliesagenomesequencealignmentalgorithm,discoversbyte-levelpatternsinmessageprotocols§NowvirtualizeamuchwiderrangeofprotocolswithoutrequiringanewDPH
HIGHACCURACY:99.6– 100%§IncreasedspeedandaccuracywithEntropyWeighting+MessageClustering§Themoredataaserviceobservesthedata,moreintelligentitbecomes§Perfectforperformancetestingwherewedealwithtonsofdata
47 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CATestIntelligence:Self-HealingVirtualService
§ Automaticallylearnthedifferencesbetweentestandliveenvironments
§ Self-heal asneeded
48 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CATestIntelligence:ReverseEngineeringofLegacyTests
ExistingManualTestCases
StaticallyOptimizedTestCases
CAAgileReq.Designer(NLP)
OptimizedcoveragepathsIdentifytestdatacoverage
SessionD05X275:“What'sNewinCAAgileRequirementsDesigner?”Thursday,November17:12:45PM– 1:30PM,LagoonL(L2)
49 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAApplicationInsightforActionableIntelligence
AUTOMATETHEAUTOMATION
MineDefectsinLive
App
AutomateTest
Creation
AutomateVirtualServiceCreation
Provision Configure Deploy Test
EnvironmentApp,MW,DB
Build/CIDevelop
DevTestProd
Environments
50 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Numerous,uncoordinatedtoolsandtechnologiesalongtheSDLC
CARelease/DeploymentHubwithCARA+CDE
CAReleaseAutomationDeploymentHub
125Out-of-boxintegrationsworkseamlesslywithanyenvironment
CommunityForintegrationinfo&community-supportedactionpacks
RDK(RapidDevelopmentKit)toadapttonewtools&technology
1800Actionstoorchestratetheentirereleasepipeline
InfrastructureProvisioning
ConfigurationManagement
ApplicationPlatforms/PaaS
vSphere
VersionControl/ ArtifactRepository
Planning&Requirements
ChangeManagement
TestAutomation
DatabasesCI/BuildAutomation
51 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ScalingEnterpriseDeploymentacrossapps
ReleaseA
ReleaseB
ReleaseC
Manageand monitormulti-applicationcontentthrough thereleasecycle
CACDEDeploymentHub
Feature1
Story2
Feature3
Feature4
Featuren
§ Releaseandtrackfeaturesindependentlyorgroupedbasedonbusinessrequirements
§ Mapcustomerfeedbacktouserstories,featuresandbugfixesmovingthroughthereleasepipeline
§ Gainvisibilityofandreconciledependencies
53 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAAppExperienceAnalytics
USERBEHAVIOR&EXPERIENCEOutside-InView
OPERATIONALPERFORMANCEInside-OutView
CAAppExperienceAnalytics
Optimizecustomerjourney
Designfortheexperience
Improvedigitalperformance
54 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MobileAnalytics
CAAppExperienceAnalyticsKeyCapabilities
UserExperienceAnalyticsacrossweb,mobile,wearables
PerformanceAnalytics
DataStudio&Blueprints
FlexibleDynamicDashboards
§ CrashAnalytics§ UserSessionPlayback§ AppFlows§ HeatMaps
SaaS&onpremise
end-to-endencryption,
flexibleofferings
55 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Example:CNNPoliticsApp– PoweredbyCATechnologies
CAMobileAppAnalyticswillenabletheCNNPoliticsappwith–
§ Visibilityintoreal-timeusageandappbehavior
§ Proactivealerting
§ Symbolication – Showsreasonforcrashincludinglinenumberandclass/methodwithoutneedtotroubleshoot
§ Captureuserfeedback,sessionreplayandrealtimeappperformanceanalytics
CAAPIManagementtoolswillenabletheCNNPoliticsappwith–
§ AllowingdeveloperstoeasilyandquicklybuildAPIsusingCALiveAPICreatortomultiplepollingandelectionfundingdatasets
§ HelpingCNNstreamlinetheprocessingofthevariouselectionrelateddatastreamsintousablecontentbyorchestratingCNN’suseofAWSLambdacapabilitiesusingCAMobileAPIGateway
§ ManagingandsecuringthedataAPIsaswellasotherfunctionalAPIsusingCAMobileAPIGateway,forconsumptionbyvarioususersglobally
57 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
RecommendedSessions
SESSION# TITLE DATE/TIME
DO5T01SKeynote:End-to-EndIntegratedContinuousDeliveryEcosystem:HowtoDriveInnovationandDifferentiation 11/16/2016at10:30am
DO5T02PLeadershipPanel:DevOpsLeadersDiscusstheJourneytoContinuousDelivery 11/16/2016at01:45pm
DO5T14SAnalystKeynote: ContinuousDelivery:MakingDevOpsAwesome 11/17/2016at10:30am
58 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MustSeeDemos
ModernizeAppDelivery
IntegratedCDTheater5- DOV501P
DeliverTestDataFaster
TestDataManagerTheater5- DOV513P
DeliverBetterApps
ServiceVirtualizationTheater5- DOV510P
OrchestrateYourReleaseReleaseAutomationTheater5- DOV512P