case study - devops qa helps leading event management company reduce post-production defects by 40%

4
www.cigni.com | Unsolicited Distribuon is Restricted. Copyright © 2015 - 16, Cigni Technologies Ltd DevOps QA Helps Leading Event Management Company Reduce Post-production Defects by 40% The Client is a leading provider of face to face markeng services ranging from Pre-event Planning, On-Site Execuon, extending the experience to Audio Visual Soluons with a presence in North America, Europe, and Asia. About the Client CASE STUDY CCS-US003-1215

Upload: cigniti-technologies-ltd

Post on 09-Jan-2017

155 views

Category:

Software


1 download

TRANSCRIPT

www.cigniti.com | Unsolicited Distribution is Restricted. Copyright © 2015 - 16, Cigniti Technologies Ltd

DevOps QA Helps Leading Event Management Company Reduce Post-production Defects by 40%

The Client is a leading provider of face to face marketing services ranging from Pre-event Planning, On-Site Execution, extending the experience to Audio Visual Solutions with a presence in North America, Europe, and Asia.

About the Client

CASE STUDY

CCS-US003-1215

www.cigniti.com | Unsolicited Distribution is Restricted. Copyright © 2015 - 16, Cigniti Technologies Ltd

Key Business ChallengesDelayed receipt of user stories in every sprint

Lack of clarity in user story requirements

Parallel sprints, each with a rigid schedule

Lack of standardized QA processes and best practices

Unstable Test Environment with configuration and access issues

Critical defects leaked into post-production after regression testing

Testing Tools

Types of Testing

Functional Testing Regression Testing Compatibility Testing

www.cigniti.com | Unsolicited Distribution is Restricted. Copyright © 2015 - 16, Cigniti Technologies Ltd

Solutions ProvidedLeveraged Cigniti’s Static Requirement Analyzer to improve requirements review process and hence the quality of user stories.

Mandated the use of sprint demos to hasten understanding of functionality being added in every sprint.

Worked with client team to resolve test environment issues.

Introduced reusable process templates to accelerate and standardize QA processes across applications and sprints.

Published detailed test execution reports for the compatibility matrix defined to enable easier and fast sprint sign-off.

Key BenefitsReduced Requirement Ambiguity Index (RAI) from 35% in sprint 1 to 12% in sprint 3 by improving the clarity of user stories.

Increased test coverage by leveraging Cigniti’s Static Requirements Analyzer.

Reduced post-production defects by 40%.

Met aggressive sprint schedules with the help of reusable process templates.

Introduced industry standard Agile and QA best practices to ensure that every sprint stays on schedule.

Value Add

Formal Test Life Cycle » Defined testing life cycle, end-to-end testing approach that aligns with application

development. Significant focus and collaboration of all QA teams to perform integration testing across systems to ensure that critical workflow are testing prior to release .

Visibility into Test Coverage and Detailed Test Cases

» QA team used the test case template to provide the detailed test cases and ensure that the test coverage for the requirements using test requirement traceability matrix. Test cases are reviewed and formally signed off by BA and Dev before test execution.

Formal Requirements early in Application Development

» QA started involving early in the requirements phase and validated the requirements through SRA process for testability.

Standard Defect Management » Defects posted are daily triaged in the daily defect triage and triage of complete backlog defects

for the release. Defined specific process to prioritise the defects, to decide what is important and what is not important for the release.

Visibility into Testing Progress and Quality » QA team provided transparency on daily/weekly updates about the status, quality, risks, andupcoming milestones of different projects.

Gaps Services/Solutions Provided

Formal Test Summary Reporting» QA team provided test summary reports for both sprints and release that provided visibility to

product quality. Metrics like Requirement Ambiguity Index, Test Coverage, Test Execution Results, Defect metrics.

Cigniti Technologies Limited (BSE: 534758, www.cigniti.com), Global Leaders in Independent Software Testing (IST) Services, is headquartered at Hyderabad, India. Cigniti’s 1800+ career testers are spread across US, UK, India, Australia, and Canada. Cigniti is the world’s first IST Services Company to be appraised at CMMI-SVC v1.3, Maturity Level 5, and is also ISO 9001:2008 & ISO 27001:2013 certified. Cigniti’s test offerings include Quality Engineering, Advisory & Transformation, Next Generation Testing, and Core Testing. Over the last decade, Cigniti has helped Enterprises and ISVs build quality software while improving time-to-market and reducing cost of quality. Cigniti has translated its R&D into SMART Tools™ that accelerate testing and help improve the quality of services delivered to clients. Cigniti has India's first of its kind Robotics Test Lab, a Mobile Cloud Test Lab with HP & Experitest, a Cloud-enabled Performance Test Lab, and an IoT & Smart Meter Lab. Gartner has positioned Cigniti as a Challenger in its Magic Quadrant for Application Testing Services Worldwide, 2015. Forrester cites Cigniti among the 9 services firms and systems integrators working to enable Quality at Speed. NelsonHall ranks Cigniti Technologies as a Leader in Software Testing NEAT Charts. Everest Group recognizes Cigniti as a Major Contender with a “Best in Class” rating for Buyer satisfaction in the PEAK Matrix™ for Independent Testing Services, while Forbes recognizes Cigniti as Asia’s 200 best under-billion companies. Cigniti has been awarded a place on the Crown Commercial Service latest G-Cloud 6 framework for providing Lot 4: Specialist Cloud Services that will provide public sector enterprises better access to Cigniti's expertise. Cigniti is also a recipient of the prestigious Frost and Sullivan Customer Value Leadership Award for Global Automated Software Testing Services category consecutively in 2014 and 2015. Cigniti’s CSR initiative, Project Cignificance, aims to impact 1 million+ lives through education as an enabler.

About Cigniti

www.cigniti.com | Unsolicited Distribution is Restricted. Copyright © 2015 - 16, Cigniti Technologies Ltd

Global Leaders in Independent Software Testing Services

USCigniti Inc.

433 E Las Colinas Blvd,

Suite 1300,

Irving, TX 75039

972.756.0622

IndiaCigniti Technologies Ltd.

6th Floor, ORION Block, “The V” (Ascendas)

Plot #17 Software Units Layout

Madhapur, Hyderabad-500081

040-4038 2255

040-3070 2255

AustraliaCigniti Technologies (Australia) Pty Ltd

Sydney

Level 13, 135 King Street

Sydney, NSW 2000

+61 2 8973 7579

Canberra

Tower A, Level 5, 7 London Circuit

Canberra, ACT, 2601

+61 2 6169 4145

UKCigniti Technologies (UK) Limited

9 Devonshire Square

London

EC2M 4YF

+44 (0)20 36911385

CanadaCigniti Inc

2425 Matheson Boulevard East,

7th floor, Suite 731

Mississauga, Ontario

L4W 5K4

647.951.5943

Melbourne

Level 28, 303 Collins Street

Melbourne, VIC 3000

+61 3 9678 9111

For Other [email protected]

facebook.com/cignititechnologies

linkedin.com/company/cigniti-inc

youtube.com/cignititechnologies

slideshare.net/cigniti cigniti.com/blog

twitter.com/cigniti