be agile, test! a partnership to implement testing in agile · life of a sct agile tester tomorrow...

© 2019 Sogeti. All rights reserved.

Be agile, test!A Partnership to Implement Testing in Agile


AirFrance-KLM Service Center Test Testimony

© 2019 Sogeti. All rights reserved. 3

AF-KLM Context

AF-KLM: An alliance born in 2004

Group priority was to make use of existing synergies

between Air France and KLM

AF-KLM launched a transformation plan in 2012 to cope with the air transport crisis: “Transform

2015” aimed to improve customer service, increase competitiveness and return to a balanced

budget

In 2015, AF-KLM continues its transformation with a new plan based on the previous one:

“Perform 2020” aims to reduce costs by 1.5% every year over the period

“Perform 2000” harnesses IT service centres with requests for synergies, productivity gains and

implementation of Agile methodologies


“Perform 2020” impact on Service Center Test (SCT)

AF-KLM test organisation in 2015:

• 2 independent test centres in Valbonne, Toulouse and Paris for Air France and Schiphol for KLM

• Providing testers to the projects but with some test projects in Toulouse

• V-Cycle almost everywhere

• No obligation for the projects to use the test centres

SCT AF-KLM created in 2016:

• Including the 2 previous test centres

• With a single manager

AF-KLM goals are:

• Standardise testing practices between Air France and KLM to get a real European test centre

• Get an entity with strong testing expertise to secure the transition to agile (SAFe compliant)

• Control cost for testing by providing fix price services to the projects

• Optimise the efficiency of testing activities by 15% within 2 years


Partnership AF-KLM / Sogeti

AF-KLM selected Sogeti France and Sogeti Netherlands in 2016 as exclusive partners

to help it in its transformation on testing and creation of the SCT

Why Sogeti?

• Sogeti demonstrated capabilities to handle test projects in Toulouse during more than 4 years:

An industrial approach of testing including the use of Model Based Testing and a Test Data Management process supported by tools

A cost reduction of testing on some projects with fix price activities

• Sogeti was the major provider of testing resources in Valbonne and Toulousealready organised in test centre since 2013

• Sogeti testing offer was available in France and in the Netherlands

• Sogeti had available several assets to speed up the transformation:

A complete testing offer

An industrial testing delivery center located in Bordeaux (ESTC)

A proven service catalogue that can be customised to stick to the context

A reputed knowledge in implementing testing in agile projects


An innovative way of doing a partnership

Partnership cornerstones:

• A contract built together during workshops

• A relationship where both parties are considered as equal

• The ambition to bring together fix price and agility

Translated into:

• A limited set of KPIs to measure the efficiency improvementand the projects satisfaction linked to a financial Bonus/Malus

• A common selling approach of the test service catalogue to the projects

• 7 months forecasted to transform the SCT activities from Time & Material to Service

• A SCT service catalogue created from the proven Sogeti service catalogue

• ESTC (Sogeti Test Delivery Centre in Bordeaux) usage for test on demand, flexibility and cost optimisation


From T&M to Service

T0 – V-cycle & Agile test service catalogue set up

• Services stem from the Sogeti standard service catalogue

• Services are adjusted to fit AF-KLM context

• Pricing and financial model tuned regarding AF-KLM context

• Co-selling of services as soon as they are made available

T1 – AF-KLM service catalogue implemented for existing

activities

• T0 + 7 months

• Abacus trial run

T2 – AF-KLM service catalogue and pricing approved

• T1 + 3 months

• New services added to the AF-KLM service catalogue

Top AFKL Service Lines

LS-1.1.1 – Functional Skill Development

LS-2.2.3 – Agile – Sprint Test Strategy

LS-3.1.1 – Customize Test Tool

LS-6.1.2 – Design/Execute Physical Test Data

LS-3.2.4 – Design Customer Acceptance Tests Cases

LS-3.2.5 – Design Automated Test Cases

LS-3.2.6 – Design Regression Test Cases

LS-3.1.5 – Design Web Services Test Cases

LS-4.2.4 – Execute Customer Acceptance Test Cases

LS-4.2.5 – Execute Automated Test Cases

LS-4.2.5 – Execute Regression Test Cases

LS-4.2.6 – Execute Web Services Test Cases

LS-3.1.6 – Test cases design rework


SCT Offer to the Projects


SCT support to Agile Projects


Contracting Services for Projects

Signature of a “Service Agreement” between SCT and

the projects:

• Commitment of SCT

• Duration / Number of sprints

• List of services to be delivered / price for these services

• Deliverables

For new projects, we start by providing one or two testers

that are part of the team and located with the team

or a test manager to study the needs

When a project is mature enough in agility (“Aware” or “Mature”) and the trust is there with

our testers, a test mentor is assigned to the project and part of the testing activities is

outsourced to Bordeaux:

• Test automation

• GUI testing

• Mobile compatibility testing

• Performance testing


Outsourcing Activity to ESTC (Bordeaux)

A “Core Team” is created in Bordeaux to be ready to handle new projects

• A stock of testers equal to 20% of the SCT workforce that can be made quickly available

• Trained to SCT context, processes and tools

• AF-KLM accreditation process done (one month delay)

• AF-KLM credentials and emails created

Outsourcing process: A tester from ESTC is incorporated to the agile team on site during one

or two sprints to bring the confidence and get the knowledge:

• Perimeter

• Services to deliver

• Repositories

A Checklist is signed by the tester and the Project Manager at the end of the acquisition period


Project Sample – Distributed Agile with Bordeaux

Valbonne Bordeaux

Agile Dev Team

TestersDevelopers

Service

Manager

SOGETI

Scrum

Master

Test Manager AFKL


Communication

A common set of tools on every location

• Chat and screen sharing: Skype Enterprise with a comfortable headset

• Written communication: Outlook

• Team communication: Microsoft Teams with channels per community (Cucumber, RF, …)

• Collaborative tool: Confluence

• Repositories: Xray, ALM, Jira, Git-Stash

SAFe ceremonies done with Skype entreprise (Retro, Refinement…) but PIs which take place on-site


Team Building

Team Building activities

• Share & Care – Team building and experience sharing

• Steering committee taking place alternatively on each location

• Testing Day twice a year with technical demos and a roadmap review

• Service Demo to share innovative subjects (BDD, Mobile Testing, Continuous Testing)


2018 Achievements

80% increase of SCT usage by projects

100% of activity delivered in service mode

20% of perimeter outsourced to Bordeaux

9% of test cost reduction

3 years renewal for the partnership

1 team of 70 Sogeti testers in France and in The Netherlands to go along with AF-KLM


Life of a SCT Agile Tester



Steven - 25 years old

Graduated from Engineer National School

this year

6 month of experience

He is « connected » all the day

He is a frequent traveller

Extrovert personality



Steven starts its day by a

connection via Webex to

the Daily meeting

He’s involved and an active

actor in all Agile

ceremonies of the teamActively acquire information

from stakeholders



During the last

Retrospective, it has been

decided to follow up one

time by week the unit test

coverage. He’s the owner

of the action

He gets from Carole(dev) during the

daily that this afternoon a new US will

be ready for test

No matter for him, design and

implementation are ready (Gherkins),

only last review by the BA is missing.

He planned to phone him in 5 min to

close it definitely

Plan and organize his

own work

Respond to change quickly,

including changing, adding, or

improving test cases


Life of a SCT Agile TesterTomorrow is the day of the

Sprint Review and Retro in

AMS

He’s preparing the Test

report, the Scrum Master

has planned a slot of

20min to let Steven

presenting it

It is each time a

good moment to see

the whole team and

share directly their

feelings with all other

colleagues

Communication / Interaction



Steven démarre sa

journée par une connexion

via Skype pour

le Daily meeting

Il est intégré et un acteur

actif dans toutes les

cérémonies agiles

Agile Tester role at SCT:

Understanding and implementing the Agile Test Strategy

Participating actively to all Agile ceremonies

Measuring and reporting test coverage

Configuring, using, and managing test environments, test data and testing tools

Designing, Writing and executing automated/manual tests

Reporting defects and working with the team to resolve them



In 2 month, the project of

Steven is joining the Safe

Train OPS

The Test Strategy of this

Train is BDD oriented using

Cucumber

What should

happened now:

Adaptation?

Reorganisation ?


About Sogeti

Learn more about us at

www.sogeti.com

This message contains information that may be privileged or confidential and is the property of the Capgemini Group.

Copyright© 2018 Sogeti. All rights reserved.

Sogeti is a leading provider of technology and engineering services. Sogeti deliverssolutions that enable digital transformation and offers cutting-edge expertise in Cloud,Cybersecurity, Digital Manufacturing, Digital Assurance & Testing, and emergingtechnologies. Sogeti combines agility and speed of implementation with strong technologysupplier partnerships, world class methodologies and its global delivery model,Rightshore®. Sogeti brings together more than 25,000 professionals in 15 countries,based in over 100 locations in Europe, USA and India. Sogeti is a wholly-owned subsidiaryof Capgemini SE, listed on the Paris Stock Exchange.

http://www.capgemini.com/about/how-we-work/rightshorer

http://www.capgemini.com/about/how-we-work/rightshorer

http://www.capgemini.com/

http://www.capgemini.com/

https://www.sogeti.com/

https://www.sogeti.com/

http://www.linkedin.com/company/capgemini

http://www.linkedin.com/company/capgemini

http://www.twitter.com/capgemini

http://www.twitter.com/capgemini

http://www.youtube.com/capgeminimedia

http://www.youtube.com/capgeminimedia

be agile, test! a partnership to implement testing in agile · life of a sct agile tester tomorrow...

Documents