automated testing with qualibrate - nzsug...business separation, data migration, and full sap...

DXC Proprietary and Confidential

August 26, 2019

Automated Testing with QualibrateA real world example at Net Express

August 26, 2019 2DXC Proprietary and Confidential

Introduction

What is Qualibrate?

Real world example: Net Express Procurement

Qualibrate in action

Next level automation

Questions and answers

DXC Proprietary and Confidential August 26, 2019 3

Introduction


DXC Oxygen

Fast Facts

• 600+ DXC employees in New Zealand

• Offices in Wellington, Auckland and

Christchurch

• Largest independent technology services provider contributing to the

New Zealand economy

The ability to balance local knowledge and resources with deep technical and business knowledge across a wide range of industries and organisations.

DXC Oxygen is the leading SAP Enterprise and Digital Solutions company across Australia and New Zealand.

WE LET

BUSINESS

THRIVE

People Focused | Business Driven | Technology Enabled

$25B 20+ YEARS OF EXPERIENCE

IN DELIVERING SAP INFRASTRUCTURE

SOLUTIONS & SUPPORT

EMPOWERED

SAP SPECIALISTS

700+

280+ CLIENTS in ANZ

300+ PARTNER

CERTIFICATIONS


The Challenge

DXC Oxygen were asked to help NXP to build and execute and E2E regression test repository

The test work stream kicked off on November 6th and the team (~4 FTE) ran the first

fully automated regression test cycle 15 business days later on November 26th

In total 558 level 3 SAP processes (transactions) were tested, recorded and automated

This represents a 95% coverage of the 631 identified level 3 processes in SAP

The daily regression test cycles included 91 end-to-end business scenarios

We used Qualibrate to record transactions, build scenarios and create the automation

15

558

95%

91

How?


What is Qualibrate?


“Quality is never an accident; it is always

the result of intelligent effort.”

John Ruskin


The concept behind Qualibrate is simple

Qualibrate is a 3-in-1 cloud solution that transforms and accelerates

the way teams test, document and train end-users


From weeks to hours in one click

Better Quality & Test Coverage

User Satisfaction

Value from your investment

Value for your customers

Traceability

Agility

Resource Costs (people, infra)

Time to market

Time to solve issues

Time on manual activities

Overhead

Complexity

Achieve More Spend Less


Real world example: Net Express


Net Express Procurement Qualibrate case study Business separation, data migration, and full SAP implementation on Azure in 4 Months

• Net Express Procurement (NXP) was sold by its parent company in a 3 month sale process.

• All HQ functions required decentralising by the new owners in less than 6 months, including the IT & SAP infrastructure.

• Apart from the extremely complex IT environment and time spans, what made the situation even more challenging is that the two separated entities were to become competitors, this created a high degree of focus on ensuring data confidentiality between the entities. This dramatically complicated the data carve-out and testing requirements of the project which more than doubled the effort of the SAP transition.

• The objective of the program was to transition all new IT systems including customer integration, hire and train 50 new staff capable of operating the new SAP environment within 6 months, all without affecting revenue or customer experience.

• There was a 4 month project timeline available to enact the separation, including the negotiation of the SAP contract/Licenses (completed in 2 weeks) establishment of business operations, all IT systems (including SAP, Networks, Hosting, Desktops, Telephony, etc), and to transfer all customers / suppliers across to the NXP’s new environment.

• The SAP environment included ECC6, CRM, BW, BOBj, Ariba, Enterprise Portal, Solution Manager, Content Server, WebMethods, Stibo, Adobe Document Server and NXP’s custom built website.


Many partners we approached declined to partake – they said it couldn’t be done. NXP went live 5 days

ahead of schedule, with no customer disruption and volumes traded more than 10% up during Q1.

- Joe Taylor, CEO NXP


Qualibrate proved to be a ‘lifesaver’ for NXP

• The test work stream kicked off on November 6th and the team (~4 FTE) ran the first fully automated regression test cycle, only

15 business days later on November 26th.

• In total 558 level 3 SAP processes (transactions) were tested, recorded and automated.

• This represents a 95% coverage of the 631 identified level 3 processes in SAP.

• We identified 25 defects during these test cycles which have been resolved before go-live.

• We ran 20 fully automated E2E regression test cycles, including:

• 2 cycles in the pre-production environment.

• 1 cycle in the UAT environment after all final transports were imported.

• 30 virtual machines running 89 E2E scenarios simultaneously.

• In addition we managed all manual tests that were planned across the landscape in Qualibrate to provide a single, auditable

view on all test activities and results.


5-step approach to automation

Load and

validate

BPR

1 day

Step 1

Flow

recording

2 weeks

Step 2

Scenario

building

1 week

Step 3

Scenario

validation

1 week

Step 4

Regression

test

execution

1 night

Step 5


E2E scenarios matrix as blueprint


Risk-based flow recordings

In Design

On Hold

Ready

0 100 200 300 400 500 600

Critical Important Nice to have

Design Status Critical Important Nice to have Grand Total

In Design 3 19 13 35

On Hold 1 27 10 38

Ready 82 353 123 558

Grand Total 86 399 146 631


Flow recording burn-down/up


Number of process steps per E2E scenario

5

1 1 1

3 3

1

32

12

1

7

5

9

3

19

13

9

2

3

3

7

5

2

2

0

5

10

15

20

25

0 2 4 5 6 7 8 9 10 11 12 13 14 15 16 19

In Design Ready


0

11

6

1215 16

38

52

47 47 47 47 4751 50 50 50 50 50 50

2

79

1819 19

19

20 25

20 20 20 2020 20 20 20 20 20 20

0

00

0

35

4

4 4

4 4 4 33 3 3 3 3 3 3

0

10

7

9

77

7

10 10

10 10 10 109 9 10 10 10 10 10

0

0

0

0

0

8

8

8 8

8 8 8 88 8 8 8 8 8 8

0

10

20

30

40

50

60

70

80

90

100

04. Order to Cash (OTC) 06. Procure to Pay (P2P) 07. Manage Warehouse & Distribution (MWD) 08. Manage Finance (MF) 09. Human Resources & Payroll (HRP)

E2E scenarios per daily test cycle


Non-automated test coverage

17

38

28

9

12

0

5

10

15

20

25

30

35

40

Ariba BW CRM Non-Functional WebMethods


NXP loves Qualibrate because…

It’s agile It’s simple It’s efficient


Qualibrate in action


Qualibrate demo


Next Level Automation


Continuous integration in an ABAP environmentStatement of Direction SAP S/4HANA 1909

SAP aims to support continuous integration in an ABAP environment to allow

development processes in ABAP to be aligned with development processes that

are commonly used for other, digital development environments and languages.

SAP plans to provide options to use state-of-the-art processes and tools for ABAP

development and software distribution. This has two main components:

• Git-based versioning, including branch and merge support

• Options to connect your ABAP processes with continuous integration (CI) tools

SAP plans to ship this functionality in the SAP Cloud Platform ABAP Environment

in different releases. On premise, SAP plans to provide a first subset of features

with the next SAP S/4HANA 1909 release. This will be provided by extending the

ABAP Change and Transport System (“CTS”). This new set of CTS features is

referred to as “git-enabled CTS” (“gCTS”).

DEV

QAS

PRD


Next level automation is an end-to-end CI/CD workflowFor other customers we have setup a suite of digital tools to realise a true DevOps framework. By doing this we have realised true CI/CD in any ABAP system landscape, today.

abapGit GitHub Jenkins Qualibrate

DXC Proprietary and Confidential

Thank you

More info: Theo van Dijk+64 21 221 [email protected]/nz/oxygen


BUTNOT

NEW.BORN

YESTERDAY.

automated testing with qualibrate - nzsug...business separation, data migration, and full sap...

Documents