pre-con ed: exploiting operational intelligence within database management tools
TRANSCRIPT
![Page 1: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/1.jpg)
World®’16
ExploitingOperationalIntelligenceWithinDatabaseManagementToolsRonColmone,Sr ConsultingArchitectArunVijayaraghavan,Sr PrincipalProductManagerCATechnologies
MAINFRAMEANDWORKLOADAUTOMATION
MFX76E
![Page 2: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/2.jpg)
2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Abstract
Attendthissessiontogetaclose-uplookatcurrentlyembeddedoperationalintelligenceindatabasemanagementutilities.Discoverhowtoexploittheseavailablecapabilitiesaswellasthepossibilitiesforyoutobuildyouown!Youwilllearnhowadvancedautomationrequiresuniqueoperationalintelligencethatcanfurtherevaluatewhichadditionaltaskscanbeautomatedandtowhatdegree.Additionally,learnhowtosimplifyyourdaytodaydecisionmakingtominimizethetimerequiredtoeffectivelymanageandrunanefficientdatabasesystem.Theeffectsofallthis?HowabouthelpingtolowerDB2operatingcostsandimproveuserproductivity,includingmanualeffortandspecifically“specializedorexpert”manualrequirements.
RonColmone
ArunVijayaraghavan
Sr.ConsultingArchitectCATechnologies
Sr.PrincipalProductManagerCATechnologies
![Page 3: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/3.jpg)
3 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Agenda
USINGDATABASEANALYZERFORAUTOMATINGOBJECTMAINTENANCE
IDENTIFYINGSQLTOANALYZEFORIMPROVINGAPPLICATIONPERFORMANCE
IMPROVINGQUERYPERFORMANCEWITHPLANANALYZER
IDAAACCELERATIONWITHRC/QUERYANDSYSVIEW FORDB2
FUTUREOFOPERATIONALINTELLIGENCEINDB2
1
2
3
4
5
![Page 4: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/4.jpg)
4 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CADatabaseManagementPortfolioVisionManagingGrowthandComplexitytoAddressEvolvingDataManagementNeeds
Planned Available
IMS DB2
CAAdministrationSuite
CAPerformanceSuite
CAUtilitiesSuite
CARecoverySuite
ExperiencedDBA
WebAppServer
MobileDeveloper
BigDataAnalyst
RESTAPI
NextGenDBA
CAAnalyticsfor
DB2
NextGenDBA
ExternalApps
![Page 5: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/5.jpg)
5 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DatabaseAnalyzerProvidesOperationalIntelligenceforDB2ObjectMaintenance
![Page 6: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/6.jpg)
6 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DatabaseAnalyzer– PastandPresent
STATISTICSEVOLUTIONINDB2
QUICKOVERVIEWOFDATABASEANALYZERPROCESSING
TRADITIONALSTATISTICSCOLLECTIONANDANALYSIS
OBJECTMAINTENANCEUSINGDB2REALTIMESTATISTICS(RTS)
PRIORITIZEDOBJECTMAINTENANCE
1
2
3
4
5
![Page 7: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/7.jpg)
7 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Statisticsevolution– let’sstepbackandremember
§ RUNSTATSSinceDay-1– Collectedstatisticsfortheoptimizer– CollectedstatisticsfortheDBAtodeterminewhenREORGneeded
§ ExtentsaloteasiertotriggerthanCLR,LEAFDIST,FAROFF,NEAROFFetc.
§ Someissues/problemswiththisapproach– DB2cataloggotupdatedwithpotentially“bad”statistics– BIND’sandREBIND’sshouldbepostponeduntilstatisticsfixedby
REORGandanotherRUNSTATS
![Page 8: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/8.jpg)
8 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Statisticsevolution– let’sstepbackandremember
§ REPORTYESandUPDATENONE– Greatimprovementtoverifyobjectshealthcondition– NoneedtoworryaboutBIND,REBIND,dynamicSQLdueto“bad”
statistics– HadtochangeapplicationstointerpretRUNSTATSSYSOUTasopposed
tousingSQLagainsttheDB2catalogdeterminingREORGetc.
§ Objectskeptgrowinginnumberandsize– RUNSTATSexpensive– Samplingintroducedlateinthegame– Inlinestatscanbeusedwhenloading/reorganizingobject- Limited
![Page 9: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/9.jpg)
9 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Statisticsevolution– let’sstepbackandremember
§ RTSintroducedinDB2V7– fromDB29mandatory– Newchallengesintroduced(morelater)
§ Manywaystotriggerthereorgofanobject?– Performancemetrics– whenapplicationperformancestarttodegrade– Fixedschedule– Weekly,Monthly,etc.basedonobjectsize/type– Partitionedobjects- EntireTableSpaceoraPartitionatatime?
§ RTSiscommonlyusedtodayforObjectMaintenance
§ ToolslikeDatabaseAnalyzerorDB2’sDSNACCOXSP
![Page 10: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/10.jpg)
10 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
RTSDrivenREORGsandSpaceAdministration
§ Somelimitationstothinkaboutbasedonrequirements– Istheobject(orpartition)over- orunderallocated?– DoyouwanttoalterQTYbasedoncurrentconditions/metrics?– CanyousaveanINDEX-LEVELbydoingareorg
(oneRTScolumnmighthelp)– Doyouneedtoprovideaccuratespacetrending/forecasting– DoyouhaverequirementstogenerateyourownSQLbasedconditions
todrivetheprocess– DoyouhaveaneedforIF-ELSElogicdrivingtheprocessesor
dynamicallydecidehowtheutilityshouldbegenerated– Slidingscalealgorithmresolvesmanyspaceallocationconcerns
![Page 11: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/11.jpg)
11 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DatabaseAnalyzerProcessOverview
DatabaseAnalyzerExtractandActionProcessing
DB2UtilityJOBs
DatabaseStatisticsExtract
ActionsConditions
![Page 12: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/12.jpg)
12 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DatabaseAnalyzer– Traditional(OldStyle)Space/Reorg
§ VerycommontobuildanExtractProcedureononeormoreDatabases(couldprocessentiresubsystem)
§ ActionProcedurescanbecreatedorselectedfromlistofbestpracticeDB2maintenanceoptions(Reorg,RUNSTATS,ImageCopy,etc.)
§ ProblemwithTraditionalDatabaseAnalyzerAutomation– Toomanyobjectstoprocess,onlysubsetmayneedattention– CPUintensivecollectingallthestatsneededtodoReorgorAlter– RTShasbeenavailableforsometimeandcanprovidenecessarystats
![Page 13: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/13.jpg)
13 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DatabaseAnalyzer– PreferredMethodisRTOS
§ RealTimeObjectSelection(RTOS)usesDB2RTS– NewwithR19- ObjectSelectionProfile(OSP)linkedtoExtractprocedure
tofilterobjectstobeprocessed(DatabaseandTablespacemasks)– CangenerateactionJCLforselectedUtilityprocessingbasedonRTS
conditions(Bestpracticearevaluesavailable)– OrcangenerateDatabaseAnalyzerStatisticsonthesubsetofobjectsand
continuetotakeadvantageoftheextensive“traditional”actionconditions– NewwithR19– PrioritizedObjectMaintenance(POM)profilescanbe
linkedtoExtractProcedurestoenabletheActionJCLgeneratedtobeprioritizedbasedonPrioritizedObjectConditions(POC)
![Page 14: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/14.jpg)
14 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
OperationIntelligencewithDetectorSQLCollection
![Page 15: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/15.jpg)
15 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Detector– SQLCollectionforAcceleratedPerformance
§ AnalyticsAcceleratorUsageScenarios– Rapidlyacceleratebusinesscriticalqueries
§ OftenchallengingtotunequeriesthatalsosupportOLTPworkload– Improveaccesstohistoricaldata– Newbusinessintelligenceusecases
§ UseCADetectortohelpidentifylongrunningqueries– SortQueriesbyHighIN-DB2time– IdentifyDB2Tablesassociatedwiththeselongrunningqueries
§ IfrunningSubsystemAnalyzer,OptionTinDetectorwillshowtablesassociatedwithQuery
![Page 16: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/16.jpg)
16 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
PlanAnalyzertoDeterminePotentialAcceleratedPerformanceImprovements
![Page 17: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/17.jpg)
17 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
PlanAnalyzer- ACCELProfileSupport- ProfileServices
§ CreateanduseACCELprofilesusingtheDB2ProfileServicesfacility.ThefacilityusestheseDB2tables:– SYSIBM.DSN_PROFILE_TABLE– SYSIBM.DSN_PROFILE_HISTORY– SYSIBM.DSN_PROFILE_ATTRIBUTES– SYSIBM.DSN_PROFILE_ATTRIBUTES_HISTORY
§ ACCELprofilecostingisonlyappliedwhenDSNZPARMQUERY_ACCELERATIONisoneoftheseoptions:– ENABLE– ENABLEWITHFALLBACK
![Page 18: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/18.jpg)
18 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
PlanAnalyzer:IBMDB2AnalyticsAcceleratorsupport
ThresholdvaluesdetailstobeusedwhenAcceleratoraccessisconsidered
19.0 ---------- PPA DB2 Profile Services Create --------- 2016/04/05 03:32COMMAND ===>
PROFILEID ===> 5000 FUNCTION ===> ACCEL ENABLED ===> Y REMARKS ===> AIG DEMO >----------------------------------------------------------------- RASST02
ACCELERATOR THRESHOLDS: TABLE CARDINALITY ===> 2000000 N/A | -1 | 1 thru 2,147,483,647 RESULT SIZE ===> 1 N/A | -1 | 1 thru 2,147,483,647 TOTAL COST ===> +.0E+00 N/A | -1 | 0 thru +7.2E+75
![Page 19: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/19.jpg)
19 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
PlanAnalyzer:IBMDB2AnalyticsAcceleratorsupport
STARTPROFoncommandlinewillactivatenewDB2Profile
19.0 -------------- PPA DB2 Command Display ------------- 2016/04/05 03:36COMMAND ===> SCROLL ===> PAGE
LINE 1 OF 24DSNT741I !DB2G DSNT1SDV START PROFILE IS COMPLETED. DSN9022I !DB2G DSNT1STR 'START PROFILE' NORMAL COMPLETION
Profile Services Status Report
Profile ID: 5000 Function: ACCEL Status TS: 2016-04-05-03.36.11.397468 Status : ACCEPTED BY DB2G
Attribute : ACCEL_RESULTSIZE_THRESHOLD Value : 1 Status : ACCEPTED
Attribute : ACCEL_TABLE_THRESHOLD Value : 2,000,000 Status : ACCEPTED
Attribute : ACCEL_TOTALCOST_THRESHOLD Value : 0 Status : ACCEPTED
Profile ID: 8661 Function: ACCEL Status TS: 2016-04-05-03.36.11.397468 Status : REJECTED BY DB2G - DUPLICATED SCOPE SPECIFIED
ID=8661wasalreadyactive.
TogglecommandonProfileServicespanelcanbeusedtoenable/disable
![Page 20: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/20.jpg)
20 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
PlanAnalyzer:IBMDB2AnalyticsAcceleratorsupport
§ PossiblevaluesforQUERYACCELERATIONareobtainedfromSYSACCELERATEDPACKAGESandassignedtothespecialregister– (ENABLEWITHFAILBACK)BehaveslikeENABLE,butifanerroroccursonthefirstOPENof
theacceleratedstaticqueryDB2preventsthequeryfromfailing.Instead,DB2performsatemporarystatement-levelincrementalbindofthequery,andthequeryexecutesinDB2.
– (ELIGIBLE)Indicatesthatstaticqueriesareboundforacceleration,butareacceleratedonlywhentheymeetallaccelerationcriteriawiththeexceptionofcostandheuristicscriteria.QueriesthatdonotmeetthiscriteriaareboundforexecutioninDB2.
– (ALL)Indicatesthatallstaticqueriesareboundforacceleration,androutedtotheDB2Accelerator.IfDB2determinesaquerycannotbeacceleratedandthequeryreferencesauserbasetableorview,thebindorrebindpackagefailswithanerror.
SupportfornewBIND/REBINDcardsforpackages
![Page 21: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/21.jpg)
21 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAPlanAnalyzer:IBMDB2AnalyticsAcceleratorsupport
§ EXPLAINwithQUERYACCELERATION– Generatetheaccesspathinformationforpackagesthatwerebound
withthisoption,withoutissuingaREBIND.– FUTUREexplainwillSETthespecialregisterCURRENTQUERY
ACCELERATIONbeforethedynamicexplaintoreflectthevalueboundinthecatalogforthepackage.
– IfDSNZPARMACCELMODEL=YES,FutureExplainoverridesthevaluethatisspecifiedintheQUERYACCELERATIONbindoptiontoNONE.Thisactionallowstheaccesspathtogeneratesuccessfully.(nextslidewillillustrate)
![Page 22: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/22.jpg)
22 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAPlanAnalyzer:IBMDB2AnalyticsAcceleratorsupport
ACCESStypeillustratesthequerycanbeexecutedontheIBMDB2Analytics
Accelerator
ViewDSN_QUERYINFO_TABLEwhenusingExplainProfile– PLAN_TABLEOption===>ALL
![Page 23: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/23.jpg)
23 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
AccelerateandMonitorIDAATableswithRC/Query,BatchProcessorandSysview forDB2
![Page 24: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/24.jpg)
24 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CADatabaseAdministrationforDB2forz/OS
§ CARC/Query &BatchProcessor(canusewithautomation)– Noneedtonavigatebetweenmultiplesolutions– ManageDB2AnalyticsAcceleratorwithinyourCADB2solutions
§ Display/Start/StopAccelerator§ Add/RemovetablestoDB2AnalyticsAccelerator§ Loadtabletotheaccelerator§ Enable/Disabletableacceleration/replication§ AlterAcceleratedtableDist.&OrgKeys§ ArchiveAcceleratedtable§ ForceRemoveTablefromDB2AnalyticsAccelerator§ Restorethearchivedmovedpartitionsdata
NewwithR19
![Page 25: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/25.jpg)
25 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ManageDB2AnalyticsAcceleratorUseCARC/QueryforIDAAadministration
Use“?”linecommandtoseeavailablecommands.
IDAATablelevelfunctionsareavailabletoDefine,Alter,Remove,Load,etc.
![Page 26: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/26.jpg)
26 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ManageDB2AnalyticsAccelerator
§ LoadDB2TableintoIDAA– RC/QALOADCommand
– CanloadrangeofpartitionsorentireTable
– UsesIDAALoaderutility
– MostcommandssuchasALOADareavailableusingBatchProcessorScripts
UseCARC/QueryforIDAAadministration
![Page 27: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/27.jpg)
27 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
SYSVIEWforDB2– IDAASubsystemStatistics
§ Newacceleratorrelatedfieldswereaddedtorecords:– Databasestatistics(IFCIDs2and1002)– DB2systemparameters(IFCIDs106and1006)
§ Updatedreports:– SYSACCEL/SYSACDTL:AcceleratorList/Detail– HSACCLST/SYSCCDTL:AcceleratorServerList/Detail(history)– HSUACLST/HSUACDTL:AcceleratorServerList/DetailSummary(history)– BTSTATR1:StatisticsDataTrace(batch)– BTSTASM2:SummaryofDB2databaseaddressspacestatistics(batch)– SYSSTATS/SYSTATA,GRPSTATS/GRPSTATA:SystemOverview
![Page 28: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/28.jpg)
28 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DB2AnalyticsAccelerator
§ Subsystemstatistics:AcceleratorDetails– SYSACDTL:
AcceleratorDetails– HSACCDTL/
HSUACDTL:AcceleratorServerDetails/Summary
CASYSVIEW®PerformanceManagementforDB2
![Page 29: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/29.jpg)
29 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DataDrivenDBPerformanceManagementMainframeOperationalIntelligence
![Page 30: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/30.jpg)
30 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
EXPERTSYSTEMS&MACHINELEARNING§ AnalysisofHistorical,Near
Real-timeplusLivedata§ DataMining,MachineLearning
&Autonomics§ SelfDrivingCars
DATAMINING&DECISIONSUPPORT§ AnalysisofHistorical&NearReal-timeData§ DataMining,Aggregations&Decision
Support§ NavigationToolswithTrafficUpdates
BI&STATISTICALANALYSIS§ AnalysisofHistoricalData§ BIReporting,Slicing/Dicing§ BasicNavigationTools
EvolutionofOperationalIntelligenceActionableanalyticswithsignificantadvancestowardszerotouchoperations
ANALYTICS1.0BUSINESSINTELLIGENCE
ANALYTICS3.0DATA-DRIVENAPPLICATIONS
ANALYTICS2.0BIGDATA
TechnologyTrend
![Page 31: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/31.jpg)
31 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
55%ofapps
dependonmainframe
70%world’scorporate
dataisonamainframe
70%oftransactionsflowthroughmainframe
64%Increaseinmainframeworkloads
ANOMALYDETECTION
BUSINESSSERVICEMANAGEMENT
EXPERTSYSTEMS
SECURITYBREACH
DETECTION
IndustryOpportunityDataAnalyticsandtheMainframeOpportunity
![Page 32: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/32.jpg)
32 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MainframeOperationalIntelligenceLeveragetechnologytrendtosolveanimportantMainframeproblem
ANOMALYDETECTION
REPORTINGMODERNIZATION
BUSINESSSERVICEPERSPECTIVES
EXPERTSYSTEMS
• Reacttothresholdevents
• Selfserviceviews• ModernU/X
• Predictanomalies• Proactiveresponse
• Topologydiscovery• Businessserviceperspectives
• Predictbusinessservicedisruption
• Rootcausehypothesis• Resolution guidance• Automateresponse
DataAnalyticsBI/StatisticalModeling
USERS
Generalist
MAINFRAM
EOPERA
TIONS
Experts
Specialists
Automation
ENTERP
RISE
SUPP
ORT
MTTR&FirefightingOptimizedPerformance&Efficiency
AutomationDataDrivenOperations
![Page 33: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/33.jpg)
33 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
IntelligentMainframeOperations- LiftingtheBurden
DATA-DRIVENAPPLICATIONS
ANALYTICALTOOLS&SKILLS
IN-HOUSEDATASCIENCE
IN-HOUSEDOMAINEXPERTISE
+
+
YOURBURDEN MainframeTeamCenter
LettheDATAdotheWORKforyou
DoMOREwithLESS!
Fueledby:§ advancedanalytic
algorithms§ machinelearning
![Page 34: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/34.jpg)
34 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MainframeOperationalIntelligenceKeycapabilitiesbeingdevelopedtomanagethelifecycleofyourdataassets
AnalyticsProcessing Multi-ChannelDelivery
Multi-ChannelDataCapture
DistributedDB2,Oracle,MySQL,
Cassandra...
MainframeVSAM,DB2,IMSDB,IDMS,DATACOM,
SMF,Syslogs,Vtape,CICS
Itsyourdata,leverageittodotheworkforyou!
DataLifecycleManagement
• ReportDistribution• AnomalyAlerts• Ad-HocAnalysisTools• APIbaseddataaccess• Automationframeworks
ExpertSystemsAutonomics
Transport&Integration ScalableData
Storage
DataScienceandAnomalyDetection
BusinessIntelligence
ITOperationsIntelligence
APIManagement
MasterDataManagement
![Page 35: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/35.jpg)
35 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DataDrivenDBPerformanceManagementProblem,OpportunityandProposedSolution
![Page 36: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/36.jpg)
36 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
INCREASINGCOMPLEXITY REACTIVETOPROACTIVE EARLYWARNING
CompaniesaredevelopingcomplexSQL applicationsonDB2.Performanceoftendegradesovertimewithoutanyonenoticing(thecreepingtrend).
AnintelligentsystemthatcanrecognizeandprioritizesignificantchangesinSQLperformancebeforeitstartstoimpactresourceoverheadsand servicelevelagreements
ADBAoftendoesnotrecognizedegradationuntilcustomerscomplain orservicelevelagreementshavebeenmissed.
TheSituationEverincreasingapplicationvolumesandcomplexity
![Page 37: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/37.jpg)
37 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
§ Howdoyoudeterminewhenperformancestartedtodegrade?§ HowlongdoesittaketoidentifytheproblematicSQLstatements?§ Doyouknowhowthestatementsexecutedbeforetheperformance
degraded?§ Doyouhavealogofapplicationperformanceproblemsand
resolutions?– Canyoucomparethislogwithcurrentproblems?
§ ManycustomersoffloadCADetectordatastoreintoDB2tables– Queryheaviestplans/packages&manuallycompareto“baselines”– Noefficientmethodtore-evaluatebaselineswhen“theworldchanges”
– Howtomonitor“standarddeviation”and“creepingtrend”iscomplexandcumbersome
TheChallengeHowdoyouresolveperformanceproblems?
![Page 38: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/38.jpg)
38 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Capture CADetectorcollectsSQL
intervalperformancemetricsforanalysis.Createsan historicalviewofapplicationperformance,whichwillbestoredinthecloud.
Baselin
e BaselinesarecreatedthatcontainastatisticalanalysisofapplicationSQLperformanceforachosen,representative,period-in-time.Baselinerepositorycanbeupdatedwhenbaselinesaredeterminedtonolongerberepresentative.
Analyze Analyzesapplication
performancedeviationsfromnormalexecutionbehavior(i.e.,deviationsfrombaselines)andlogsinaneventsrepository. N
otify
DuringtheAnalyzestep,notificationsofperformancedeviationscanbesenttokeypersonnelviaemail.
Review
InadditiontooutputfromCapture,Baseline,andAnalyzetheapplicationwillallowyoutoreviewapplicationperformancehistorythroughawebbrowserinterface.Deeperanalyticsandvisualizationareavailablethroughthebrowserdashboard.
Mainframe
TheSolutionMainframeTeamCenter–OperationalIntelligence
![Page 39: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/39.jpg)
39 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
USECASE:Sherman,Debbie,andFredhavedeepexperienceandskillsintheirrespectiveareas.Theyhatebeingcalledafterasystemproblemhasoccurredandbeingaskedtoprovethattheirareawasatfaultorinnocent.Theywouldlikeasystemthattellsthemwhentheirareaisbehavingabnormally,sothattheycanaddressitbeforeitcomestotheattentionoftheSystemsPerformanceEngineer.
• Operations,SystemsProgrammer,• NetworkEngineer,ApplicationDBA
PERSONA:
PROBLEM§ “Avoid,detectandpredictissuesthatmightbeaproblem”§ “Thresholdsarehardtomaintainandgeneratelargeamountoffalsepositives”§ “Abilitytoseemultipleviewsofdata”§ “Abilitytocreateviewsofinformationfaster”§ “ThecurrentU/Xpreventseasycollaborationandaccesstoanalytics”
AnomalyDetection– ProblemAvoidance/Prediction
![Page 40: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/40.jpg)
40 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
AnomalyDetection– ProblemAvoidance/PredictionSOLUTION§ Detectanomalies&predictissuesreal-time,alertbasedonpredefinedrules
§ Leveragehistoricaldataandmachinelearningfordynamicthresholds
§ SimplifiedU/X– browseraccess&designedforcollaboration
BOTTOMLINE§ HighAvailability
§ Problemavoidance§ ReducedMTTR
§ ReduceSMEdependenceforissuedetection
![Page 41: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/41.jpg)
41 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
AnomalyDetection– DeepDive
§ UtilizeHistoricaldata§ DefinebandsofLikelyandunlikelyvalues
§ Maprealtimemetricstreamsagainstsystemdefinednormal
§ Multi-pointalertsgeneratedusingindustry-standardWestern-Electricrules
§ Makestaticthresholdsoptional!
Letdatadotheworkforyou
Unlikely
MostLikely
Metric
Time
TypicalVolatility
Anomaly
Tasksready
tobedispatched
LessLikely
![Page 42: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/42.jpg)
42 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
USE CASE:As someone owning IT operations and responsible for technology progress, my MF systems should exploitplatforms like Linux (X86 & Z) to offload data processing and non essential management capabilities. Lack of thiscapability limits the ability to extend the strengths of the mainframe with next generation technology that issupported on Linux.
• BusinessOwner• TechnologyOwner
PERSONA:
PROBLEM§ “Helpmedeployyouranalyticssolutioninhoursnotdays”§ “Nosignificantincreaseonmyteamsworkload,wearenotlinux experts”§ “WeplantoexpandourzecosystemtoincludeLinuxandrequiretoolstoleverageourstrategy”§ “Ensuringtechnologyprogresswithoutlosingthereliability/securityofMFishighvaluegoal”§ ”Ensureanalyticssolutiondonotincreasemyoperationscostssignificantly”
SimplifiedDeployment– MinimizeCostandRisk
![Page 43: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/43.jpg)
43 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
SimplifiedDeployment– MinimizeCostandRisk
Web-basedUI
RestAPI
z/OS
PerformanceManagement
DatabaseManagement
RestAPIs
StorageManagement
SoftwareVirtual
Appliance
BENEFITS§ LowCostcomputing§ Non-Invasive§ RetainsSecurity§ SetupinMinutes
ANALYTICSSTREAM
EXISTINGPRODUCTS
Browser
SOLUTION§ Virtualappliance§ ContainerizedPlug-n-play§ SimpleConfig GUI
MetricBaseline
AnomalyDetection
Correlations
Aggregation
HistoricalData
![Page 44: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/44.jpg)
44 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
BusinessServicePerspectives&TopologyViewsSOLUTION§ Monitorservicelevelmetrics
§ Analyzemetricswithabilitytodrilldownacrossentiretopology
§ Trackandprioritizeeventsaffectingservices,consolidatealerts
§ Correlatemetricsviamachinelearning
§ QuickrootcauseanalysisandreducedMTTR
BOTTOMLINE§ ReducedMTTR
§ ReduceSMEdependenceforissuetriage/investigation
§ Improvedenduserexperience
![Page 45: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/45.jpg)
45 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
ExpertSystems– IntelligentMainframe
SME
•SOLUTION§ AssistedtriagethathelpsfasterRCA,reduced
MTTRandfacilitatesbetterdecisions§ Utilizecorrelationdatasciencetofindclusters
ofalertsandrelationships
§ Leveragemachinelearning&yourdatatothesystemtriageandisolatetheproblem
§ Systemlearnsfromexperts,helpsonboardjuniorstafffaster
BENEFITS§ ReducedMTTR
§ Higherproductivityofjuniorstaff§ TransferofTribalknowledgetoanexpertsystem
§ Lowercostsofoperations,noincreaseinrisks
1
2
3
41 3
2
4
![Page 46: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/46.jpg)
46 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
LEVERAGEDATAITSYOURASSET
MOVEFROMREACTIVETOPROACTIVE
DETECTANOMALIESAVOIDPROBLEMS
WrapUpandKeyTakeawayMainframeOperationalIntelligence&DB2Tools
Expertuserswithdecadesofexperience
Highlycustomizable,flexibletoolkits
Basicsoftwareintelligence
InexperiencedusersnewtoMainframe
Toolsthatguideuserstodecisions
Predictivesoftware
intelligence
WeInviteyoutoparticipateinDesign@CAandTechPreview!
![Page 47: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/47.jpg)
@CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.47 @CAWORLD#CAWORLD
MainframeandWorkloadAutomation
FormoreinformationonMainframeandWorkloadAutomation,pleasevisit:http://cainc.to/9GQ2JI
![Page 48: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/48.jpg)
48 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
RecommendedSessions
SESSION# TITLE DATE/TIME
MFX79E ProtectingandTappingIntoyourDataGoldmine:leveragingwhatresidesinyourmainframe 11/15/2016at9:00am
MFX80EIntelligentMainframeManagement- DataDrivenDatabase PerformanceManagement 11/15/2016at10:00am
MFX81EHowtoGettheMostoutofYourDB2,DB2Management,andAnalyticsInvestment 11/15/2016at11:00am
MFX88S StrategyandVisionforCADB2DatabaseManagement 11/17/2016at12:45pm
MFX90S DrivingDownCostsforDB2Management 11/17/2016at1:45pm
MFX91S BirdsofaFeather/StumptheTechieforCADB2Tools! 11/17/2016at3:00pm
![Page 49: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/49.jpg)
49 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MustSeeDemos
DemoNameServicesYTheater#location
DemoNameSolutionYTheater#location
DemoNameProductXTheater#location
DemoNameProductXTheater#location
![Page 50: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/50.jpg)
50 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Questions?
![Page 51: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/51.jpg)
51 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Thankyou.
Stayconnectedatcommunities.ca.com
![Page 52: Pre-Con Ed: Exploiting Operational Intelligence within Database Management tools](https://reader036.vdocument.in/reader036/viewer/2022062503/58f0f5c91a28ab55388b4579/html5/thumbnails/52.jpg)
52 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.
Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.
ForInformationalPurposesOnlyTermsofthisPresentation