1

TEST AUTOMATION – TOOLS AND FRAMEWORKS

2

TOPICS COVERED

Test Automation Introduction

Test Automation – Learning Opportunities

Test Automation Practice - Overview

Test Automation – An understanding

Test Automation Framework

Test Automation Framework Types

Test Automation Strategy Guideline

3

TEST AUTOMATION: INTRODUCTION

Automation: Facts Manual scripts needed

Ideal for regression testing

Benefits come from discipline in analysis and planning

Causes significant schedule impact at introduction

Require more programming and design skills from testers

Require continuous maintenance

Automation: Myths High immediate ROI from automation

One tool that fits perfectly

Need to substitute skilled manual testers

Preclude manual testing

100% Automation of all existing manual tests

4

MATURITY OF AUTOMATION TESTING

5

Test Automation Tools – Market Trends

6

VENDOR BASED TOOLS

7

FREEWARE TOOLS

FEATURES/Tools Selenium Sahi Watij/r/n

Open Source Yes Yes Yes

OS Supported Windows, Linux orMac

OS Independent.Needs Java 1.4+

windows

Ease of Use Good Good Very good

Scripting language

Java/.net/Ruby Java Java/.net/Ruby

Documentation Average Average Average

Support User Group User Group User Group

8

BUILDING A TEST AUTOMATION FRAMEWORK

9

BASICS FOR A SUCCESSFUL FRAMEWORK

Environment independent

Modularized scripts/test data to increase robustness

Reusable generic functions and applications specific functions libraries.

Defined folder structure

Scripting guidelines and review checklists

Error handling and recovery techniques

Defined maintenance process

Collection and analysis of the metrics

10

TEST AUTOMATION FRAMEWORK: APPROACH

11

AUTOMATION TEST STRATEGY GUIDELINES

In order to make the most of our test strategy, we need to make it reusable and manageable. To that end, there are some essential guiding principles we should follow when developing our overall test strategy:

Test automation is a fulltime effort, not a sideline.

The test design and the test framework are totally separate entities.

The test framework should be application-independent.

The test framework must be easy to expand, maintain, and perpetuate.

The test strategy/design vocabulary should be framework independent.

The test strategy/design should remove most testers from the complexities of the test framework.

12

TEST AUTOMATION FRAMEWORK: COMPONENTS

13

SUCCESSFUL AUTOMATION FRAMEWORK -

POINTERS Environment independent – implemented through global data table

Modularized scripts/test data to increase robustness

Reusable generic functions and applications specific functions libraries.

Defined folder structure

Scripting guidelines and review checklists

Error handling and recovery techniques

Defined maintenance process

Collection and analysis of the metrics

Test Result Report Generation Criteria

Naming Convention and Standard

14

AUTOMATION FRAMEWORK TYPES

Test automation framework is a set of assumptions, concepts, and practices that provide support for Automated Software Testing.

Basic Test automation frameworks specifically are following:

Test Script Modularity Test Library Architecture keyword-Driven/Table-Driven Testing Data-Driven Testing Hybrid Test Automation.

15

TEST LIBRARY ARCHITECTURE FRAMEWORK

The Test Library Architecture framework is very similar to

the test script modularity framework and offers the same

advantages, but it divides the application-under-test into

two part Procedures Functions These library function from the library files are then

called

directly to the test case script.

16

SUMMARY: CRITICAL FACTORS FOR AUTOMATION SUCCESS

Treated as a critical process and supported by senior management Robust and extendable automation framework Clear ownership and integration of test technology and process Rigorous measurement program to capture progress Skilled test engineering professionals deployed with the right tools

17

AUTOMATION TESTING RISKS

Frequent changes in the Application and Regression test suite.

Major technology changes impacting the scripts

Absence of process/implementation/continuous improvement.

Resource knowledge on applications

Lack of Knowledge of Automation Programming

Implementation of the Framework

18

Professor In charge - Ms. Deepika Sharma

Presented by - 5056 – SAPNA HAJARE

5058 - SAYLI JADHAV

5065 – DEEPALI

5095 - VRUSHALI

5085 – SWATI

THANK YOU