© copyright inc., 2010 1 © copyright inc., 2012 testing of a net banking application using...

© Copyright Inc., 2010 1 © Copyright Inc., 2012© Copyright Inc., 2012

Testing of a Net Banking Application using Selenium Framework

MBT in BFSI

Document No : IBSIPL-016/2012

http://www.ideabytes.com/

© Copyright Inc., 2010 2 © Copyright Inc., 2012

Agenda

Evolution in Software TestingChallenges in Test AutomationChallenges Back at HomeModel Based TestingMBT with Selenium ArchitectureCase study on Banking ApplicationSummary


Evolution of Software Testing

Manual

Scripts-BasedCapture/Replay

FrameworksKeyword Driven

MBT

More advanced approach in testing where we create a test-framework to automatically execute the automated test cases/scripts, without manual intervention, & get test results. Lower test – reusability and maintainability

Latest Test Design approach, where we feed in functional requirements/business-logic to get automatically generated test design models, test cases, automation scripts and test documentation. 100% test reusability and Req. coverage with 50% less time/effort, higher defect tracking, higher maintainability

Advanced approach of recording and replaying test automation scripts (e.g. Visual Studio etc.) using Record/Play feature. The challenges include maintaining test data, data-source connectivity and identifying functional defect, . lower test – reusability and maintainability

Traditional approach of writing test manually, with higher efforts & resource allocation. Significant efforts on test collaboration documentation,, higher Fault-Slip-Throughs (FST), higher efforts in regression testing, absence of test reusability


Challenges in Test Automation


Challenges in Test Automation

Initial investment of creating the test scriptsAutomation is long term strategy : Investment is justified when product is evolving and Market penetration is growingMaintainability of volume Test cases/Test scriptsDemands for different types of test suites (Build Sanity test, Regression suites, Priority based test suites) with little or no additional effortFaster test cycles with scripting demands due to Faster product builds, Agile processMigrating between framework/scripting language


Challenges back at Home


Want to take a ride !??!


Test Incorrectness…


Release Deadline…


Invalid Test Case…


Higher Maintenance…


Coverage… What !??!#$*


An evening of one Mr. Tester


Model Based Testing

Automated Test Design TM

Automates ”thinking” of test cases based on a system model

Integrates with existing test execution automationProvides

Faster test designBetter test coverageHigher test qualityEasier test maintenance

CONFORMIQ DESIGNER

Fig: Test flow, with Manual Test Design replaced by MBT


Automated Test Design flow

DevelopSystem Model

Conformiq Modeler

Manually capture system functionality

Direct & ReviewTest Design

ConformiqDesigner

Generate and verify test case completeness and correctness

Use Test Scripts& Documentation

ConformiqPublisher

Output reports and executable scripts


Paradigm Shift in Test Automation

Input: Customer requirements,Function Specifications, Function Descriptions, Interwork Descriptions, etc.Model

design

(UML) Modeling tool

Input

MBT tool(e.g. Conformiq)

Generate

Automated test scripts

Test automationtool/framework

Test cases

Generate

Test documentation

Test Management tool

Test resultsExecute

Import

Test Development Test Execution


**Note: This is a suggestive list. Ideabytes can create plug-ins for any scripting language output

MBT Test scripts

Scripting Backend Languages1 Excel 14 FitNesse2 Word (OpenDocument Scripter) 15 JUnit3 PDF (OpenDocumentScripter) 16 SOATest4 HTML 17 TTCN with call flow5 C Language 18 TCL6 C++ 19 Python7 C# 20 Ruby8 QTP(VBScript) 21 TTCN9 AutoIT (VBScript) 22 SIPp

10 Perl 23 XML11 Test Partner(VBScript) 24 PHP12 JavaScript 2513 SQL scripter 26

Others proprietary scripters can be obtained on demand within couple of weeks


Model at a Glance - Sample

• Modeling can be done using Conformiq Modeler, Rational RSA, Rational Rhapsody, Enterprise Architect.

• The Models can be given as input to Conformiq Designer to derive automatic test cases, scripts and documentation


Reusable Test Architecture


Benefits of Choosing Selenium

Platform, Browser IndependentScripting possibility in popular programming languages:C#, Java, Groovy, Perl, PHP, Python and RubyOpen Source – Cost advantageReusable components and LibrariesOpen Source community ContributionsSeveral variants ( IDE, RC, Web Driver, Grid) depending on the test environment


SUT – Banking Application

MySQL

Banking Application

Testing:- GUI Operation- Banking Functionality

…Web Browser


Tested Functionality

Login, LogoutCreate New AccountModify Account InformationFunds TransferReports


MBT Architecture with Selenium

System Model of NetBanking App

C#Test Scripts

Test Plans and Documentation

(Word/Excel/HTML)

NetBanking App

Test Harness(Framework APIs)

Scripting Plugin

Selenium Server

Test Reports(Test Mgmt)


System Interfaces

Banking Application

FromUser:”Login”,”Click”,

ToUser:Show Home Page,Show Account page

UI

FromDBHandler:QueryResponse

ToDBHandler:Query


Demo

Please visit our booth for a Short Demo of Banking application test automation using MBT using Selenium framework


Motivate Testers to efficiencyMBT is a revolutionary technology

Well managed introduction of Test Automation and MBT motivates adoption by testersCompanies achieve immediate benefits Kick-start plan with ramp-up with Competence build-up planning

MBT is suited to all software testing domainsItem Domain Time/Test Case Effort

1 Enterprise (IT, Web Services) 20 mins Low

2 BFSI 20 mins Low

3 Health care – DICOM, HL-7 75 mins Medium

4 Embedded, ERP, Workflow 50 mins Low - Medium

5 Telecom Protocol Testing 120 mins Medium - High

Table: Typical end -2- end automation results from active and completed projects at Tier - 1 Customers


MBT Advantages in BFSISurvey at 2011 MBT User Conference in Berlin (ETSI)

Fault Slip Through (FST) reduction: 59% Testing duration reduced by 25%Testing costs reduced by 17%Usage spans application stackssoftware processes, application domainsMBT is accessible and practical

Other AdvantagesEarly detection of specification faultsNo Dependence on scripts, and Test Infrastructure ( Leads to Future proof technology)Documentation : 100% automatically generated and its by-product of Model - Always in synchSignificant reduction in Effort for regression test cyclesOne Model – Many test suites ( Functional, Regression, Sanity, Priority)

http://www.robertvbinder.com/blog/real-users-of-model-based-testing/


[email protected]© Copyright Inc., 2012

THANK YOU

Development Centre, IndiaIdeabytes Software India Pvt. Ltd

Jayabheri Enclave, HyderabadPhone : +91 40 6453 5959

Corporate Office, CanadaIdeabytes Inc.

Ottawa, OntarioPhone : +1 613 692 9908

South East Asia Kuala Lumpur, Malaysia

Phone: +60 16 220 1365

USA3389, Napoli pl,

San Jose, CA - 951 35Phone: +14086238278

Srinivas Reddy Katta /

Mrinal Chatterjee

Ideabytes Software India Pvt. Ltd.

email: [email protected] /

[email protected]

Website: www.ideabytes.com

© copyright inc., 2010 1 © copyright inc., 2012 testing of a net banking application using...

Documents