InterConnect2017

HDZ-2965 : Cognitive DevOps: Get Rid of the Guesswork to Improve Software Delivery

Rami KatanADDI Architect, IBM

1 3/23/17

2 3/23/17

Please noteIBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion.

Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision.

The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract.

The development, release, and timing of any future features or functionality described for our products remains at our sole discretion.

Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming inthe user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.

Rami Katan• ADDI Architect, IBM

• Co-founder, EZSource, founded 2003 and acquired by IBM on June 2016

• 19 years of experience with delivering advanced application discovery solutions, using compilers automation and algorithms

• Rich customer-facing experience and a track record of providing solutions and consulting.

3 3/23/17

Why would you listen to me?

4 3/23/17

The challenge for Software Development Organizations

Applications are being more complex.Applications span over multiple environments

including Z, web, cloud and mobile.Businesses need to react faster

There is a strong need for tools that can help organizations be smarter and help make decisions based on data available

+

How big of a challenge is it?How many lines are in an average book page?

An un-named search engine answers : 35

IF Program = book THENNO-OF-PAGES=300

CHPATER-REFERENCE-COUNT=50

PAGE-JUMPS=50

STORY-LOOPS =18

END-IF

How programs connect to each other?

Authors digitally edit the programs and copybooks and affect the bigger schema…

That big of a challenge !!

1 Transaction = 40 programs =

How many transactions you have?

How Many applications do you have?

Batch jobs? Schedules? APIs that access the code?

This is what your “IT librarians” faces every day:

So how do you get rid of the must-have guesswork

• Automated application understanding• Interactive up to date documentation• Quick access to all component cross-reference across

applications• Combining code analysis with operational analysis• Have the analysis data trended over time• Merge data from many information sources using

automated solutions

• Have cognitive computing help• Please!

ADDI Cognitive Computing Video - Link

8 3/23/17

ADDI Cognitive Computing Video

9

Application Discovery

• Understand the structure of your business-critical applications across languages and environments

• Reduce risk and time and increase quality of changes through visual impact analysis integrated with your IDE

• Prioritize changes by understanding operational performance of most frequently used applications

• Synchronize ADDI with latest changes in your source code management systems for a single source of truth

• Up-to-Date Documentation• Application Knowledge Base

Analyzeandvisualizerelationshipsbetweenapplicationcomponents,dataandjobs

ADDIApplicationRepository

ADDI:Build

ADDI:Analyze

GraphicalAnalysis

Reports ‘WhereUsed’

Analysis

ADDI:DeliveryIntelligence(ADI)

ADDI:IDz

ApplicationHeallth

IDEIntegration

z/OS 3rd Party

DB2CICSIMSSMFTWSCA7CAEndevorCALibrarianChangeManPDSNatural

PDFExcelJPEGXMLVisioJSONCSVEMF

MainframeAgents

ADDI:Connect

Java

Knowledge Database

What is in Application Discovery?

• Application flow graphs, program Flow graphs, Program flowcharts• Schedule flow charts, Job flow charts• Cross platform analysis• Resource usage impact analysis• Field usage impact analysis• Field expansion analysis• Interactive visualization of resource usage• Application Inventory reports• Complexity metrics• Dead code analysis• Compare the same application in its different stages: Prod/Dev/SIT/other• Application documentation which is easy to produce and up to date.• Application knowledge database driven by annotations contributed by all users• Application education that speeds the learning curve of new developers

Near future:• Expose application logic to mobile/cloud/Front-end• Identify dependencies of datasets and tables across platforms.

• Automation, Automation, Automation – using advanced technologies and visualizations

11 3/23/17

Application Discovery and Delivery Intelligence

Unlock• Rapidly analyze and

visualize your applications to make changes quickly, safely and efficiently

Empower• Improve productivity of new

and existing resources through knowledge transfer and automated documentation

Appraise• Continuously assess and

improve quality against consistent metrics and enforcement of coding standards

• Unlock The Value In Your Business-critical Applications

1 2 3

12 3/23/17

ADDI: How does it work?

• Build application analysis from the source code

• Run algorithms and advanced analysis to gain application understanding

• Document and share application knowledge, improving learning curve and communication

• Correlate application analysis with operational data and test coverage data to gain deeper insights

1 2

3 4

13 3/23/17

A few glimpses at AD analysis : Cross application analysis

14 3/23/17

AD analysis: Top clustering view on applications

15 3/23/17

AD analysis: Down to statement flow chart level analysis

AD analysis: Annotations and application knowledge database

Application Delivery IntelligenceA dashboard for Dev Ops data correlating data from many

products which applies cognitive insights

ADI

Application Discovery

OMEGAMON SMF Data

Code Coverage

System Logs

Bug Tracking

RTC

Dev Opsproducts

API Catalog

???

Easy-to-use web-based graphic interface providing accurate, unified view of

entire application landscape

Optimize development and test by combining static and

operational analysis to accelerate delivery and

improve quality

Correlate project metrics from the AD repository, performance information from OMEGAMON for CICS, and code coverage data for targeted insights into

application health

The Intelligence in ADI

Correlate static code analysis with operational and test data to provide comprehensive view of application health and to optimize development and test

ADI - Current set of Data Providers

OMEGAMON for CICS Integration Application Discovery (AD) Integration Code Coverage

1

2

3

Identify potential performance bottlenecks early

Transaction execution and failure frequency

Trend analysis of performance and resource consumption

metrics

1

2

3

Insight into application maintainability

Insight into application inventory and complexity

Trend analysis of the software quality and complexity metrics

1

2

3

Optimize testing

Improve test efficiency

Trend analysis of the code coverage

Cognitive DevOps: Get rid of the Guesswork

Drive DevOps improvement with Analysis, Insight, and Optimization

Analysis: Rapidly identify areas of

concern in your application portfolio, then assess the impact, scope, risk and

actions required

Insight: Improve the accuracy of your planning and estimating with

insights gained from data collected and correlated from

DevOps activities

Optimization: Cut waste by executing

the optimum actions required to build, test

and deploy your applications

21 3/23/17

A few glimpses at ADI analysis: OMEGAMON data

22 3/23/17

ADI analysis: Transaction performance statistics

23 3/23/17

ADI analysis: VB11 Transaction performance in resolution of hour/day/week

24 3/23/17

ADI analysis: AD analysis data summarized and trended over time

25 3/23/17

ADI analysis: AD analysis data summarized and trended over time

26 3/23/17

ADI analysis: Code Coverage data per version of VB11

27 3/23/17

ADI: Modified members for a specific version of VB11

28 3/23/17

ADI : Program change statistics and suggested minimal test suite for unit test

29 3/23/17

ADI analysis: Code Coverage data

ADDI Use Cases

Day to day Integration with other environments Application management

1

2

3

Helping Maintenance and Business As Usual with graphic analysis, Impact analysis,

Batch and online analysis

On-board new developers into the team with an improved learning curve

Root Cause Analysis

1

2

3

Identify the code related to a business logic required to be exposed outside as an API or service

Add new business logic to existing tables in the best low-cost and efficient way.

Use application analysis to support complex architecture decisions

1

2

3

Manage application source inventory:Componentize source collections by identifying

Identify source clusters

Manage the quality and delivery of SIs and 3rd party outsourcing parties

Compare versions of the same application (New/Old, Prod/Dev)

4

Code Review

The future of ADDI

Day to day Integration with other environments Cognitive

1

2

3

Support more languages and custom macros and preprocessors using extensibility features

Tighter integration with IDz, zD&T, Endevor ChangeMan, RTC

Improved Root Cause Analysis, correlating performance with application changes

1

2

3

Maintain a catalog of existing services and APIs

Assess the impact a change on the Z environment has on the open side

Use application analysis to support complex architecture decisions

1

2

3

Use Watson services on many input data sources of ADI.

Train Watson to grasp the relations and insights on the analysis data.

Then gain answers to free text questions

Tradeoff analytics to support application management and architecture decision making

Launching the IBM Digital Transformation Model for z SystemsWhere are you on your Digital Transformation Journey?

• Reduced MIPS cost• Shortened batch windows• Secure, flexible host access with support for the

latest clients

• Increased predictability and reduced risk of change efforts

• Higher productivity and quality• Additional capacity for development, test, and

education on x86 hardware

• Easy access to business critical data and services for Mobile, Web and Social workloads

• Effective governance of APIs• Improved performance and reduced MIPS

consumption

• Increased speed of development and deployment for hybrid cloud architectures

• Improved quality through shift-left testing and automated delivery pipeline

• Lower cost of quality

BUSINESS BENEFITS

2

3

APPLICATION NEEDS BY LEVEL

LEVEL

LEVEL

01LEVEL

LEVEL

EVOLVE

EXPOSE

MAINTAIN

RUNAppropriate for applications that in practice have no changes.

Just keep them running, efficiently.

Appropriate for applications that have moderate amount of changes.

Appropriate for applications with moderate changes that require mobile / Web access.

Appropriate for applications requiring frequent changes.

32

Launching the IBM Digital Transformation Model for z SystemsWhere are you on your Digital Transformation Journey?

33

How it works

1. Select an enterprise application or group of applications to transform

2. Fill out a short assessment to determine the capabilities you need for those applications

3. Get a report with personalized insights and recommendations to progress your digital transformation journey

To get started, visit http://ibm.biz/DTModel

• ADDI on IBM website• AD on IBM website• ADI on IBM website• ADDI Cognitive Video• IBM System Z - YouTube channelFor more information contact:

Mark Indermaur (Offering Manager): indermaur@us.ibm.com

Rami Katan: Rami.katan@il.ibm.com

34 3/23/17

On-line Resources

ADDI – Accelerate your digital transformationInterConnect Sessions: #2965, #5522, #5617, #5806 34

Questions?

36 3/23/17

Notices and disclaimersCopyright © 2017 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written permission from IBM.

U.S. Government Users Restricted Rights — use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM.

Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. This document is distributed “as is” without any warranty, either express or implied. In no event shall IBM be liable for any damage arising from the use of this information, including but not limited to, loss of data, business interruption, loss of profit or loss of opportunity. IBM products and services are warranted according to the terms and conditions of the agreements under which they are provided.

IBM products are manufactured from new parts or new and used parts. In some cases, a product may not be new and may have been previously installed. Regardless, our warranty terms apply.”

Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice.

Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have used IBM products and

the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary.

References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business.

Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation.

It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer’s business and any actionsthe customer may need to take to comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer is in compliance with any law.

37 3/23/17

Notices and disclaimers continuedInformation concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM’s products. IBM expressly disclaims all warranties, expressed or implied, including but not limited to, the implied warranties of merchantability and fitness for a particular, purpose.

The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right.

IBM, the IBM logo, ibm.com, Aspera®, Bluemix, Blueworks Live, CICS, Clearcase, Cognos®, DOORS®, Emptoris®, Enterprise Document Management System™, FASP®, FileNet®, Global Business Services®,Global Technology Services®, IBM ExperienceOne™, IBM SmartCloud®, IBM Social Business®, Information on Demand, ILOG, Maximo®, MQIntegrator®, MQSeries®, Netcool®, OMEGAMON, OpenPower, PureAnalytics™, PureApplication®, pureCluster™, PureCoverage®, PureData®, PureExperience®, PureFlex®, pureQuery®, pureScale®, PureSystems®, QRadar®, Rational®, Rhapsody®, Smarter Commerce®, SoDA, SPSS, Sterling Commerce®, StoredIQ, Tealeaf®, Tivoli® Trusteer®, Unica®, urban{code}®, Watson, WebSphere®, Worklight®, X-Force® and System z® Z/OS, are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml.

InterConnect2017

38 3/23/17