Renaissance Hotel 1 West Wacker Drive Chicago IL 60601

Speaker(s): Jessica Paddock When: April 22, 2016

Company: Orasi Software Time: 11:15 am - 12:15 pm

CHICAGO April 18th — April 22th

Data, Data Everywhere! Understand Your Data

& Maximize Test Coverage

Title of Presentation (Edit in Slide Master) Jessica Paddock, Director of Data Services presented by:

TDM: Improving the QA process

TDM: Improving the QA process

Why do I need Test Data Management?

Efficiency: Testers frequently spend 50-75% of their time looking for or creating test data.

Coverage: Production data only has 10-20% of the data combinations possible.

Skills: TDM requires database-centric knowledge and the ability to comprehend the solution data model.

TDM: Improving the QA process

Current Challenges Lack of a central system of record/tool to track test data requests Extremely manual process to support the provisioning of test data

Process

Data

Defects

• Engage external teams for data delivery

• Lack of traceability • Little/No reusability of test scripts

• Lacking data from production

• Overuse of data

• Defects in data cause testing delays

TDM: Improving the QA process

Key Benefits Automated provisioning of “fit for purpose” data

Efficiently execute the right test cases against requirements

• Fewer Data Incidents: Reduces risk of incorrect test data • Focused Productivity: Improves efficiency throughout SDLC • Engineered Solution: Provides a robust solution for delivering test data

Quality

• Efficiency: Better time to market with improved application reliability • Reduced Risk: Tools and processes to quickly and easily manage test data

Value

• Responsibility Matrix: Defines roles and responsibilities for managing test data

• Mature Methodology: Delivers data on time and on budget • Improved Data Consistency: Provides the right test data across all test

environments every time

Process

TDM: Improving the QA process

Common Challenges by the Numbers

~56% of defects due to

ambiguous requirements

40 times over-testing is common

10-20% data coverage in production

Up to 60% of SDLC can be attributed to

Change Requests

TDM: Improving the QA process

Test Data Management Process

Production

QA

Subset

De-identify / Mask

QA’

Virtualized Dev, QA, Train Full Copy

Dev

QA

Train

Environments

Profile/Coverage/ Data Assignment/ Test Case Design/

Data Creation

Supplement Coverage / Data Bulking

Train Dev

QA

Environments New Development

Test Data Management

TDM: Improving the QA process

How to best plan for TDM within SDLC Plan for the IDEAL

With the Application Design phase is complete, code development starts, and ideally, test case and test data design as well.

Once a test case is created, then a Test Data Request(TDR) can be submitted for the data to be created

Streamline your test case design process

The Application Design phase will have the data model for the TDM team to use to create the data

The intent is to have the test data created before a test cycle begins. This eliminates waiting for data to be created and speeds up QA by enabling testers to start testing on the first day of the cycle and spend zero time looking for/creating data. The data is ready when testing is ready to start.

TDM: Improving the QA process

Industry & Customer Metrics

Over to 20% to 50% of the testing process is lost looking for and/or waiting for test data

Customers have reported over 95% time reduction in test data provisioning when implementing synthetic data creation

Customers consistently reduce test cycles by over 30% by removing redundant tests cases when implementing test case optimization practices

Customers reduce storage costs by using the correct and complete set of data for systems of record and virtual services

Decrease the risk of a data breach

TDM: Improving the QA process

The Importance of Data Coverage

100% Coverage

Data Creation

Coverage Analysis

Existing Data

TDM: Improving the QA process

What Does Coverage Look Like?

TDM: Improving the QA process

VIEW TOTAL ROWS 11,514,160

Possible Combinations: 1.24E+26

Total Coverage Factor: 42.76%

69.81% 81.00%

72.73% 59.11%

90.75% 53.09%

93.34% 80.21%

30% 19%

27% 41%

9% 47%

7% 20%

0% 20% 40% 60% 80% 100%

BUS_FUNC_STS_TYP…ENTTL_TYP_NMENTTL_UNT_DS

ENTTL_UNT_PROC_C…EXTNL_REF_TYP_SR…

EXTNL_REF_VLPRMY_EXTNL_REF_IN

PROC_CHRCTR_NM

Average Paired Coverage

Actual Goal

2.73%

0.15%

18.69%

81.90%

50%

46.14%

BUS_FUNC_STS_TYP_…ENTTL_TYP_NMENTTL_UNT_DS

Weaker Columns

Real Expected

REFERED COLUMNS DISTINCT VALUES

BOOL_CNDTN_NM 1

BUS_FUNC_STS_TYP_ID 22

BUS_FUNC_UNT_TYP_ID 1

ENTTL_TYP_NM 2

ENTTL_UNT_BOOL_CNDTN_VL 1

ENTTL_UNT_DS 13

ENTTL_UNT_PROC_CHRCTR_VL 29,258

EXTNL_REF_TYP_SRC_ID 4

EXTNL_REF_VL 524,920

PRMY_EXTNL_REF_IN 2

PROC_CHRCTR_NM 8

RECUR_TYP_NM 1

UOM_TYP_NM 1

UPDT_USR_ID_CD 1

Orasi | Coverage Pilot Results

Client Example of Coverage

TDM: Improving the QA process

Coverage Analysis Benefits

Discover the weak and strong points

in your data

Enable expansion of your testing by

using all areas of the data

Reduce production defects by

expanding your testing

Increase user satisfaction by

enabling an error free application

experience

TDM: Improving the QA process

How to best plan for TDM within SDLC No matter how good your production data is you will always

need data to be created. Therefore, the earlier the data can be created, the less your testing team has to wait for test data.

Creating data early, so your test phases are not impacted is always the best methodology.

Planning for TDM when the requirements are designed is most advantageous in keeping the testing on schedule and even ahead of schedule.

The faster errors can be found, the less costly they will be and a greater amount of time will be saved.

Having test data available at the start of a test phase can literally save a project from missing the deadline.

TDM: Improving the QA process

Orasi Software Inc. at a Glance Corporate Overview Orasi is a leading provider of end-to-end software quality management services using many test management tools, production

monitoring and automation software solutions, as well as complementary Orasi and vendor software. 20+ years of award winning experience in the quality industry. $80M Revenue and 300 employees, 225 Software Engineers.

Customer Value Accelerating Our Customers’ Software Quality Return on Investment (ROI), Partnership Innovations Software Quality Management Best Practices and Standards Implementer, Assessments/Workshops/Benchmarks, Health Checks Serving as a visionary in the quality and emerging technology space. Trusted advisor to our customers providing options and research

around current industry trends

Serv

ices

Foc

us Software Implementation

HPE Customer Support Product and Process Training 3-Tier Consulting Services Model

•On-Site Testing •Rural Testing •Offshore Testing

Project Work Workshops Open Source Delivery and Support, Subject Matter experts Best Practices with Certified Engineers QA process experts on Standards

Com

pete

ncy

Focu

s ALM Experts Visionary in Providing emerging Technologies Functional Testing/Manual Testing Performance and Cloud Testing Mobile Device Testing, Continuous Delivery, Automation Test to Build Process Test Data Management Service Virtualization Network Virtualization Pre-Prod and Production Monitoring Agile Testing, Scrum Master Support

Prod

uct F

ocus

HPE Software Platinum Partner HPE Software Support Partner SAP Gold Service Partner APM-App Intelligence Test Data Management Test Case Optimization Data as Service Mobile Solutions JIRA Bridge/Remedy Bridge Orasi Proprietary - ODA, OARS, OPTIC Cloud Offerings Spike and Performance Tuning