people behind the testing tools and frameworks · people behind the testing tools and frameworks...

29
People Behind the TestingTools and Frameworks Christoph Preschern [email protected]

Upload: others

Post on 24-Mar-2020

9 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

People Behind the Testing Tools and Frameworks

Christoph [email protected]

Page 2: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

Who we are…    … Ranorex Mission

Page 3: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

3

Focus: FunctionalUI Test Automation

API

Page 4: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

4

User Base

2,000+ Customers

10,000+ Users

Page 5: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

5

Ranorex Offices

Page 6: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

Ranorex Mission

Page 7: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

“Enable testers rising to meet their everyday challenge

of automated testing.”

Page 8: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

Drivers for Test Automation

Page 9: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

9

Drivers forTest Automation

Project Timeline

Analysis RequirementSpecification Design Imple‐

mentation

Testing

Delivery & Maintenance

Waterfall Approach

Page 10: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

10

Drivers forTest Automation

» Software is already delivered

» Bad quality feedback from client

» „We haven‘t tested well enough…

» … because of time pressure.“

» „No time? –Automation Helps!“Driver: Management

Page 11: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

11

Drivers forTest Automation

Implemen‐tation

Design

Specifi‐cation

Analysis

Shippable

Product

Testing

Agile

Page 12: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

12

Drivers forTest Automation

Project Timeline

Implementation

Design

Specification

Analyse

ShippableProduct

Testing

Sprint 1

Implementation

Design

Specification

Analyse

ShippableProduct

Testing

Sprint 2

Implementation

Design

Specification

Analyse

ShippableProduct

Testing

Sprint n

Agile Approach

Driver: DevTeam

Page 13: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

13

Roles in Test Automation

Test Manager

Test Director

Test Automation Specialist

Support Engineer

Software Architect

Test EngineerTest Analyst

Development Lead

Product Manager

Release Manager

Project ManagerTeam Lead Automation

Page 14: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

14

RolesBetweenTwoExtremes?

Domain Tester

Technical Tester

User Base

Waterfall/V‐Model

Agile

„Water‐gile“

Page 15: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

15

Technical Tester

» Test automation on code level

» Ranorex API power user

» „I‘m a frameworker –I don‘t want to depend on anything“

» Deeply integrated with SW development process

» Ranorex Studio often not in use

» Nearly no Ranorex support needed‐> Community‐driven

Page 16: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

16

Domain Tester

» Domain Knowledge – Representing theUser 

» Often separated from dev team and processes

» „In love“ with „Record“ button –Capture & Replay

» Afraid of code

Page 17: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

17

RolesBetweenTwoExtremes

Domain Tester

Technical Tester

User Base

Waterfall/V‐Model

Agile

Level ofAutom

ationHIGH

MEDIUM

LOW

Page 18: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

18

Real Life Customer Situation

Scope: Internal IT(SAP, HTML5, .NET)

Dev‐Approach: Multiple vendorsno in‐house dev‐team

Tools forQA: Ranorex, HP QCMicrosoft TFS

TA‐Approach: Ranorex Module Framework + Ranorex Recorder

TA‐Team: Internal + External

30% Technical Tester

70% Domain Tester

Scope: Tomography‐Software(.NET, MFC)

Dev‐Approach: in‐house, „Watergile“

Tools forQA: Ranorex, Microsoft TFS, in‐house solutions

TA‐Approach: Ranorex Code Module Framework, No‐Recorder, but Visual Studio

TA‐Team: Internal

90% Technical Tester

10% Domain Tester

Page 19: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

19

ChallengesforTool Vendors

#1: Multiple UI technologies,multiple suppliers + shorter release cycles

#2: Test maintenance

#3: Finding the right people

Page 20: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

20

Technologies

Page 21: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

21

Multiple Technologies

Desktop Web

Mobile

BUILD?

BUY?

OUTSOURCE?

How to control software quality? 

Page 22: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

22

Multiple Technologies

» What‘s needed?

» Tools assisting with „Design forTestability“(for in‐house development)

» Automation frameworks delivered with solutions(outsourced development)

Page 23: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

23

Test Maintenance

Page 24: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

24

Test Maintenance

» What‘s needed?

» Smart ways to create out of the box UI maps at design time

Page 25: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

25

Finding the Right People

Page 26: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

26

Automation Expert –Skill‐Set

» Scripting/Development Background

» Ranorex Knowledge

» Tools & Processes

» Continuous Integration

» Test Management

» Communication Skills

Page 27: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

27

Who uses Ranorex

Page 28: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

Questions?

Page 29: People Behind the Testing Tools and Frameworks · People Behind the Testing Tools and Frameworks Christoph Preschern cpreschern@ranorex.com

Thank you for your attention!

Christoph [email protected]