Turbo boost your digital app test automation with Jenkins

Step-by-Step TutorialMay, 2018

Speakers

2

Sheli AshkenaziSr. Product Manager

Experitest

Jonathan AharonSr. Sales Engineer

Experitest

Agenda

3

The need for high speed test automation

The continuous testing environment

Step-by-step demo

01

02

03

Q&A04

15 min

30 min

5 min

10 min

4

Business strategy triggers SDLC Paradigm shift

Speed, agility and risk reduction

5

Agile CI/CDDevOps

“Develop smaller chunks - we will probably change our mind”

“get your team talking…”

“make sure you didn’t break anything… automatically and often”

6

Short cycles imply more tests

Continuous Integration Continuous Testing

Image source: Forrester

Large scale execution

Part of CI/CD pipeline and toolchain

High level of automation

Rapid result analysis and feedback

Throughout development cycle –development & test

Digital platform segmentation growing Global data, April 2018

7

Mobile,

51.2%

Tablet, 4.1%

Desktop,

44.7%

Platform

Windows,

81.73OS X, 13.18

Unknown, 2.45Linux, 1.66 Chrome OS, 0.98

Desktop OS

Chrome, 66.2%

Firefox,

11.8%

IE, 7.2%

Safari, 5.5%

Edge, 4.3%Opera,

2.3%

Other,

2.8%

Desktop browsers

Source: Statcounter

Samsung, 30.8%

Apple,

19.2%Others, 29.9%

Unknown, 7.8%

Huawei,

6.2%

Xiaomi,

6.1%

Mobile device vendor

Android, 75.66%

iOS, 19.2%

Unknown, 3.05%

Other, 2.06%

Mobile OS

The dev-test process

Epic Story thinning PrototypeAcceptance

Criteria

Code (incl. White box Test)

Build & DeployAutomated

testingAcceptance

testingShowcase /

Demo Sign-off

Dev Engineer

Dev & Test EngineerDevOps EngineerDev & Test Engineer

Functional Spec

Product Owner

Analyst Product Owner

Analyst Designer Analyst Tester Test Engineer

TesterProduct Owner

CI/CD cycle

Agenda

9

Why do we need continuous testing?

The continuous testing environment

Step-by-step demo

01

02

03

Q&A04

Development Engineer

The Continuous Testing process

Commit tests

Trigger test execution

Load app to cloud

Test Engineer

Commit app code

Consolidate test results

Continuous Integration

reporttest

build Version approved?

no yes

Debug / update test suite

1Pull app source2

Build app3

Pull test source4

Build test project5

6 7 8

9

10

Trigger build

Today’s demo environment

• Appium & Selenium tests

• JUnit framework

• Jenkins server

Pre-prepared

• Appium* Studio for Eclipse

• Eclipse*

• Jenkins*

• Git

• Maven

• Experitest Digital Device Lab

• Experitest Reporter

Tools used

• Configure project & build using Jenkins

• Upload application to the cloud - Jenkins (shell script)

• Run Tests (Jenkins + Digital Device Lab)

• Link test results to Jenkins

What we will do

* Any test framework, IDE and CI tools can be used

Agenda

12

Why do we need continuous testing?

The continuous testing environment

Step-by-step demo

01

02

03

Q&A04

Writing a test using Appium Studio for Eclipse

Project structure in Eclipse

Required Jenkins plug-ins

Test parallelization using Jenkins

Application uploading to Digital assurance lab

Running test suites from Jenkins

Accessing test results from Jenkins

Automating execution timings using different approaches

What we will see

13

14

Demo

Recap

• Appium*

• JUnit*

• Eclipse*

• Jenkins*

• Git

• Maven

• Appium Studio for Eclipse

• Experitest Digital Assurance Lab

• Experitest Reporter

Tools / frameworks used

• Used CI server to build a test project from repository

• Used CI to upload application to digital device lab

• Used CI and digital device lab to install the application on numerous devices and run tests in parallel on

• Used Jenkins plugin to link test results to Reporter and analyzed test results

What we did

* Any test framework, IDE and CI tools can be used

Agenda

16

Why do we need continuous testing?

The continuous testing environment

Step-by-step demo

01

02

03

Summary & QA04

How the SeeTest platform support hands free continuous testing

17

Epic Story thinning PrototypeAcceptance

Criteria

Code (incl. White box Test)

Build & DeployAutomated

testingAcceptance

testingShowcase /

Demo Sign-off

Dev Engineer

DevOps EngineerDev & Test Engineer

Functional Spec

Product Owner

Analyst Product Owner

Analyst Designer Analyst Tester Test Engineer

TesterProduct Owner

Dev-Test Feedback cycle – 1 hour

Dev & Test Eng.

Digital assurance Lab (SeeTestCloud)

Test development

Grid Execution

Test Analytics

Manual Testing Grid Execution Dev & DebugTest Analytics Test Analytics

RESTful API to mass deploy application on targeted devices

Web / Mobile

19

Questions?

20

Thank You!

21