hands-on lab: ca workload automation advanced integrations and agents
TRANSCRIPT
World®’16
CAWorkloadAutomationAdvancedIntegrationandAgents
GreggRask:CATechnologies,SeniorPrincipalConsultantLeeRoberson:CATechnologies,SeniorPrincipalConsultant
MFX142EL
MAINFRAMEANDWORKLOADAUTOMATION
2 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
©2016CA.Allrightsreserved.Alltrademarksreferencedhereinbelongtotheirrespectivecompanies.
Thecontentprovidedinthis CAWorld2016presentationisintendedforinformationalpurposesonlyanddoesnotformanytypeofwarranty. The informationprovidedbyaCApartnerand/orCAcustomerhasnotbeenreviewedforaccuracybyCA.
ForInformationalPurposesOnlyTermsofthisPresentation
3 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Abstract
Thishands-on-labwillprovidetheabilityforyoutostrengthenyourskillsandbecomeveryfamiliarwiththeCAWorkloadAutomation(CAWLA)AdvancedIntegrationforHadoop,aswellastheadvancedCAWLAAgentsforInformatica,MSSQLServer,andDatabaseswhichareusedtocreatehighlyautomatedandintelligentbusinessprocesses.
GreggRaskCATechnologiesSeniorPrincipalConsultants
LeeRobersonCATechnologiesSeniorPrincipalConsultants
4 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Agenda
INTRODUCTIONTOTHEAGENT’SCAPABILITIES
ARCHITECTUREREVIEW
Q&A
SOLUTIONARCHITECTURE
HANDS-ONLABOVERVIEW
PLAYTIME
1
2
3
4
5
6
5 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAWLAAgentJobTypes- Out-of-the-box
SystemTasks ApplicationServices Application Hadoop
WebServicesMonitoring
DatabaseIntegrations
AgentlessWindowsEventLog DatabaseStoredProcedureWindowsServices SQL
HDFSHiveOoziePigSqoop
RemoteExecution
CPU InformaticaPowerCenterDisk DatabaseMonitor MicroFocusIP DatabaseTrigger
TextFile ProcessAutomation PeopleSoftPeopleToolsProcess MicrosoftSQLServer
SingleRequestRPC/Encoded RequestSet
FileTrigger/Watcher Document/Literal CopySingleRequest
HPIntegrityNonStop MBean ProcessMonitoriSeries ●OracleE-BusinessSuite
ManualJob MBeanCreate/Remove BatchInputDataSetTrigger MBeanGet/Set EventMonitor
●z/OS SessionBean BWInfoPackageBatchJob EntityBean DataArchiving
SNMP RMI JobCopyWake-on-LAN JMSPublish/Subscribe BWProcessChain
Command HTTP ●SAPFTP/SFTPandSecureCopy POJO R/3
6 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAWLAAgentJobTypes- Hands-onLab
SystemTasks ApplicationServices Application Hadoop
WebServicesMonitoring
DatabaseIntegrations
AgentlessWindowsEventLog DatabaseStoredProcedureWindowsServices SQL
HDFSHiveOoziePigSqoop
RemoteExecution
CPU InformaticaPowerCenterDisk DatabaseMonitor MicroFocusIP DatabaseTrigger
TextFile ProcessAutomation PeopleSoftPeopleToolsProcess MicrosoftSQLServer
SingleRequestRPC/Encoded RequestSet
FileTrigger/Watcher Document/Literal CopySingleRequest
HPIntegrityNonStop MBean ProcessMonitoriSeries ●OracleE-BusinessSuite
ManualJob MBeanCreate/Remove BatchInputDataSetTrigger MBeanGet/Set EventMonitor
●z/OS SessionBean BWInfoPackageBatchJob EntityBean DataArchiving
SNMP RMI JobCopyWake-on-LAN JMSPublish/Subscribe BWProcessChain
Command HTTP ●SAPFTP/SFTPandSecureCopy POJO R/3
7 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAWLAAgentPlug-InsDatabases
DatabasesDBMonitor • Monitoradatabase tableforaddedordeletedrows;checksatintervals
DBTrigger • Monitoradatabasetable foradded,changed(ingeneralormatchingaspecifictrigger)ordeletedrows;forexample,waitforarowwheredept=75tobedeleted
DBStored Procedure • Invokeaprocedure orfunctionstoredwithinadatabase;criteriacanbeaddedtotesttheprocedure’soutput
SQL • ExecuteaSQLstatementandcapturetheoutput; criteriacanbeaddedtotestthestatement’soutput
8 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAWLAAgentArchitecture- Database
WAServer
DatabasePlug-in
Database Database‘N’
JDBC JDBC
9 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAWLAAgentPlug-InsMSSQLServer
MSSQLServer• Executeanypre-definedSQLServerAgentjob.
• WillmonitoreachstepintheSQl ServerAgentjobandenabletheabilitytorestartfromanindividualstep.
• Foreachagentlicense,theMSSQLServerAgentPlug-IncanconnecttouptotenSQLdatabases.
Ajobstepmustbeofoneoffollowingtypes,• MicrosoftActiveXScript• OperatingSystem(CmdExec)• PowerShell• ReplicationDistributor• ReplicationMerge• ReplicationQueueReader• ReplicationSnapshot• ReplicationTransactionLogReader• AnalysisServicesCommand• AnalysisServicesQuery• SSISpackageexecution• T-SQLScript(Transact-SQL)
10 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAWLAAgentArchitecture- MSSQL
WAServer
MSSQLAgent/Plug-in
MSSQLDatabase- Active
MSSQLAgent MSSQL
Database- Passive
MSSQLAgent
JDBC/CLI JDBC/CLI
SP SP
11 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MSSQLAuthenticationInformation- Example
#databaseauthentication
db.url=[jdbc url.forexample,jdbc:jtds:sqlserver://localhost:1433/msdb]
db.username=[username]
db.password=[encryptedpassword]
db.domain=[windowsdomainifwindowsauthenticationisused]
12 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MSSQLAuthenticationInformation
#authenticationproperties
db.url=jdbc:jtds:sqlserver://SQLMATICA:1433/ForwardInc
db.username=sa
db.password=9C11675F9ED8322327
13 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAWLAAgent- SQLPropertiesFile§ db.classname=net.sourceforge.jtds.jdbc.Driver
§ GetJobList=job_id|name|description
§ GetJobDetail=job_id|originating_server|name|enabled|description|category|owner|date_modified
§ GetJobStep=step_id|step_name|subsystem|command
§ GetJobTargetServer=server_id|server_name|enlist_date
§ GetJobHistory=job_name|step_id|step_name|sql_message_id|sql_severity|message|run_status|run_date|run_time|run_
duration
14 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAWLAAgent- SQLPropertiesFile(continued)
§ GetJobStepLog=*ALL
§ GetJobStatus=job_id|originating_server|name|last_run_date|last_run_time|last_run_outcome|current_execution_status|
current_execution_step|current_retry_attempt|type
§ max.retry=2
§ Retry.interval=60
§ monitor.poll.interval=60
§ appendRunLog=*FAILURE
15 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAWLAAgentPlug-InsInformatica
Informatica• Executeanypre-definedworkflowinInformatica.
• Youcanalsoselectindividualtaskstoexecuteaswellastorestartfrom.
• Youcanmonitortheexecutionaswellasretrievetheoutput(spoolfile)fromitsexecution.
• Jobanderrorlogging,history,etc.
• Foreachagentlicense,theRemoteExecutionAgentPlug-Incanconnecttouptothreeremotesystems.
16 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
§ NativeInformaticaauthenticationandsecurity
§ EncryptedpasswordsandcommunicationviatheSystemAgent
§ Retrievelistsofdefinedworkflows,listsoftasksanddependenciesinagivenworkflow
§ Defineworkflowsuccess
§ Informaticadebuginformation
CAWLAAgentforInformatica
17 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAWLAAgentArchitecture- Informatica
WAServer
Informatica Agent/Plug-in
DefaultDatabase
DatabaseRepository
InformaticaServer
18 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
DatabaseConnectionInformation
#DBconnectionproperties
informatica.db.type=SqlServer
informatica.db.user=sa
informatica.db.password=9C11675F9ED8322327
informatica.db.url=jdbc:jtds:sqlserver://SQLMATICA:1433/PC_repository
19 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
InformaticaConnectionInformation
#Informaticaconnectionproperties
informatica.domain.name=Domain_SQLMATICA
informatica.service.name=ForwardInc_BIS
informatica.repository.name.default=ForwardInc
informatica.user.id.default=administrator
informatica.password.default=9C11675F9ED8322327
20 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAWLAAgentPlug-InsHadoop
HadoopHDFS Createzerosizefile(TOUCH):Path/paths
CopyfileordirectorywithinHDFS(COPY)CopyfileordirectorytoHDFS(COPYFROMLOCAL)CopyfileordirectoryfromHDFS(COPYTOLOCAL)Makedirectory(MKDIR)MovefileordirectorywithinHDFS(MOVE)MovefileordirectoryfromlocalfilesystemtoHDFS(MOVEFROMLOCAL)Removefile(REMOVE)
Hive RunaHivejobCancelaHivejob
Oozie RunanOozieworkflowTerminateanOozieworkflowineitherasuspendedorrunningstateSuspendanOozieworkflowResumeanOozieworkflow
Pig Define,run,andcontrolPigjobsCancelrunningPigjobs
Sqoop ImportandExportdatainto/fromHDFSCancelarunningSqoop job
21 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
CAWLAAdvancedIntegrationArchitecture
WAServer
AIforHadoop
Oozie HiveDB SqoopDBHadoopEdgenode
HTTP JDBCSSH
Port22 JDBC
22 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Hands-onLabOverview
§ Createbusinessprocessusingagentjobtypes
§ Initiatebusinessprocess
§ Troubleshootfailure(s)
23 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
PlayTime!!!
24 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Questions?Informatica
25 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
RecommendedSessions
SESSION# TITLE DATE/TIME
MFX121SCaseStudy:AmerenImprovesResponseTimetoGridOutageswithCAWorkloadAutomationAgents
11/17/2016at12:45pm
JasmineB
MFX180SHowtoHaveaVoiceinProductEnhancementsthroughCACommunitiesIdeationandValidation
11/17/2016@3:00pm
JasmineB
26 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
MustSeeDemos
ModernWorkloadAutomation
CAWLADEMFandWorkloadAutomation
SeamlessApplicationAutomationAgents&AdvancedIntegrationsMFandWorkloadAutomation
CAConversionasaService
CAWorkloadAutomationMFandWorkloadAutomation
Innovations:CrossEnterpriseWorkloadAutomationCAWLAAE&DEMFandWorkloadAutomation
27 ©2016CA.ALLRIGHTSRESERVED.@CAWORLD#CAWORLD
Thankyou.
Stayconnectedatcommunities.ca.com
@CAWORLD#CAWORLD ©2016CA.AllRIGHTSRESERVED.28 @CAWORLD#CAWORLD
MainframeandWorkloadAutomation
FormoreinformationonMainframeandWorkloadAutomation,pleasevisit:http://cainc.to/9GQ2JI