Transcript
Page 1: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Feb 2015

Tech Mahindra & Experitest Co-webinar:

Selenium vs UFT:

Which is Better for Your Mobile Testing Strategy?

Page 2: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Speakers

Guy ArieliCTO

Experitest

Mahendra SinghProject Manager (MATE)

Tech Mahindra

Page 3: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Demo

Seleinum vs UFT for Mobile -Which

one is right for your testing team?

Case studies

Agenda

What is UFT?

UFT for Mobile

What is Selenium?

Selenium for mobile

1

2

3

4

5

6

7

Page 4: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

UFT and Selenium - Tool Assessment

Page 5: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

What is UFT, QTP?

Runs on VB script

A UI based automation tool.

Focus on Web and desktop technologies

UFT is the HP solution (previously called QTP) for Test Automation

..

Page 6: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

UFT for MobileExperitest Mobile Add on for UFT

Mobile Menu – Devices & Applications Managing

Full & complete integration into HP UFT software

Record a test, edit it, run it, and view results (report)

Integration of object repository (mobile object properties)

Object Spy include Native & Web identification methods

Integration into HP’s Quality Center & Performance Center

Page 7: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Competitive Landscape- Plug in for UFT

Mobility

Capabilities Enterprise

readiness

Support all OS.

Support all

Mobile devices

Support all app

types

Integration to all CI

stability

scalability

Remote capabilities

End to End solution

HP

Experitest

Mobile

Add on

for UFT

Page 8: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

What is Selenium ?

Selenium is an open source test automation framework that

support cross browser test automation

Selenium 2 also known as WebDriver

Selenium supports perl, php, python, objective-c, java,

Microsoft.net, ruby, and more.

It is not a tool with a UI – it uses a programming language to

use it specifically

This project gain extremely high popularity and support due

to HP pricing and luck of support for SMBs

Page 9: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Selenium for Mobile

Experitest provide enterprise grade solution based on WebDriver API called

MobilWebDriver

Providers interface to interact with Mobile Application

All function of Seetest Automation Tool can be executed in Java Selenium environment

using MobilWebDriver

Experitest Mobile Plug in for Selenium

Page 10: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Competitive Landscape- Plug in for Selenium

Support all OS.

Support all

Mobile devices

Support all app

types

Integration to all CI

stability

scalability

Remote capabilities

End to End solution

Experitest

plug in for

selenium

Mobility

Capabilities Enterprise

readiness

Selenium

Page 11: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

UFT Vs Selenium –

Which is better for your testing team

Page 12: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

UFT vs Selenium – Which is better for Mobile Strategy?

Experitest Mobile Plugin for

SeleniumMobile Add on for UFT

JAVAVB Script Supported language

Page 13: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Language Supported

Java

Using IDEs like Eclipse made writing Java

easier then working with any other

scripting language.

Every student that graduate BSC in

computer science knows Java.

Java is Object Oriented, it can be very

important in large automation projects.

Easy to integrate with your

enviourment backend

Microsoft VbScript

Scripting Language.

Lack full features of a programming

language.

Interpreted

Considered to be easier to learn

Vbscript cannot run on MAC.

Page 14: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

UFT vs Selenium – Which is better for Mobile Strategy?

Experitest Mobile Plugin for

SeleniumMobile Add on for UFT

JAVAVB Script Supported language

√√Object Identification

√√Descriptive

Programing

Page 15: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Object Repository vs. Descriptive programming

UFT uses Object Repository (by default). ***

Selenium uses 'descriptive programming' (by default).

With Experitest Mobile plugin for Selenium you can use object repository or descriptive

programming in your WebDriver project.

Object Repository- cons

Hard to source control.

Hard to merge.

Can reduce the test visibility.

Can cause inconsistency in behavior.

Object Repository- Pros

When identification of an object changed,

the update is done in a single place.

Support internal tools like 'Object Spy'.

Page 16: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

UFT vs Selenium – Which is better for Mobile Strategy?

Experitest Mobile Plugin for

SeleniumMobile Add on for UFT

JAVAVB Script Supported language

√√Object Identification

√√Descriptive Programing

√√Test Recording

capabilities

√√Xpath

√√Object Spy

Page 17: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Programing skills? Yes / NO

To build a successful automation project you

will need to have programing capabilities

No coding, approach is very limited

and in many cases will fail

Recording capabilities can ease the

tool learning curve

Many testing team has programing

knowledge in Vbscript

Most of the computer science graduates has

good Java knowledge

<!!!>

Page 18: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

UFT vs Selenium – Which is better for Mobile Strategy?

Experitest Mobile Plugin for SeleniumMobile Add on for UFT

JAVAVB Script Supported language

√√Object Identification

√√Descriptive Programing

√√Test Recording capabilities

√√Xpath

√√Object Spy

√xParallel Execution

Page 19: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Parallel Execution

UFT can only perform

one test per machine.

Selenium can perform multiple &

simultaneous tests

Page 20: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Demo

Page 21: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

End-to-End Product Suite - Manual, Automation, Monitoring, Load, Network Virtualization, Manager

• Manual testing tool

• Mini-recorder for automating short,

repetitive, manual scenarios

• Report with screenshots of each step

• Manual to Automation Script Convertor

• Device Lab located onsite (in the customer VPN)

• Devices can be reserved and accessed by any remote user

• Used in conjunction with SeeTestAutomation/Manual for testing of remote devices

SeeTestManual

SeeTestCloud

• Automation tool

• Same test runs on different devices

• Plugs into all testing & CI environments:

SeeTestAutomation

SeeTestNetworkVirtualization

• Device performance under varying network conditions

• Simulating mobile network bandwidth latency and reception while on the move

SeeTestLoad

• Real device generated mobile load

• Full integration to LoadRunner, Jmeter, etc.

Mobile Add-On for UFT• Full & complete integration into HP UFT:

• Record a test, edit it, run it, and view results

• Integration of object repository and more…

SeeTestManager

Free

Tool!

N

L

G

U

Page 22: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Case StudyBanking

Page 23: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Headquartered in UK

Spans over 50 countries across Europe,

America, Africa & Asia

~150,000 employees

Mobile applications in tens of languages

Ranked in top 10 largest banks worldwide

Revenue of ~$30 Bn.

Customer Profile: Multinational banking and financial services company

Major global financial services provider engaged in personal

banking, credit cards, corporate and investment banking and

wealth and investment management.

The bank’s personal and business

account management apps

What needed to be tested?

Page 24: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Implementation

Years working with the tool: 1

Over 25 SeeTestAutomation stations

Number of Automation engineers working on the project: 25

2 geographical locations around the world (US, Europe, Africa and China)

Number of tests before: 0

Number of tests today: ~2,000

Number of executed tests: ~200,000 (each test can run on more than one device)

Build single test that can run on Chrome / IE / Firefox and Safari for Desktop

And Chrome / Safari / IE for mobile (iOS, Android and WP8.1).

Page 25: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Coverage

Total coverage: ~90%.

Number of executions of the full cycle: Once a day

Full app test coverage for all OS-Cross platform testing of

Android

iOS

WindowsPhone8

Full end-to-end coverage of test scenario

Support for multiple languages (including English, Spanish, French)

Page 26: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

What if we did it manually?

A single QA engineer: 56 man years to finish the cycle (lifetime).

For one day we would need 20,000 trained manual QA engineers.

Another Advantage

The R&D engineers can work faster and take more risks

According to the bank R&D managers the development speed is

ROI

3-4 times faster!

Page 27: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Case StudyTransportation

Page 28: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Customer Profile: Major National Railroad

Passenger Corporation

5

Headquartered in Washington DC, USA

More than 20,000 employees

Revenue: ~3 Bn

US national rail operator operating over 300 trains

and an average of 85,000 passengers a day in USA &

Canada. Last year served more than 30 million

people.

Page 29: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

The needs

Amtrak mobile website

Amtrak mobile native application

Many user flows such as

Book one-way and round-trip tickets

Search for station information

Check train status, board using eTicket

And more

Save tickets to your phone calendar

Integration with Apple Passbook™

or Samsung Wallet™

Testing User’s Applications Testing Integration with 3rd Parties

Page 30: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

The Requirements

Test the Android, iOS and WindowsPhone8 mobile application

Have a full testing environment deployed onsite for end-to-end system

testing including the integration with Apple Passbook™ or Samsung Wallet™

Monitoring capabilities (such as memory and CPU usage) of the Android/iOS devices

to ensure large quantities of data do not hamper the app’s functionality

Page 31: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

SeeTestAutomation Deployment - DescriptionWithin 3 Months of Project Kick-Off

~10 floating licenses SeeTest Automation+

Experitest Mobile Add on for UFT

Over 20 test machines running on iOS ,

Android and WindowsPhone8

Onsite deployment with integration to the

existing UFT/QC test environment

Parallel execution of tests

Onsite mobile lab using SeeTestCloud

80% Automation; 20% manual

On Premise Mobile Device Lab located in USA

Implementation Coverage

Coverage of customer’s app & website

including the integration with Apple

Passbook™ or Samsung Wallet™

Support for multiple languages

(including English, Spanish)

Page 32: Tech Mahindra & Experitest Co-webinar: Selenium vs UFT ...d242m5chux1g9j.cloudfront.net/PDFs/Co-webinaR-PPT-TechMFeb25.pdf · What is UFT, QTP? Runs on VB script A ... Selenium is

Thank you


Top Related