quality with selenium (rz)

7/23/2019 Quality With Selenium (RZ)

http://slidepdf.com/reader/full/quality-with-selenium-rz 1/80

Automated TestingWeb Testing using Selenium

Prepared by : Rizwana Zahoor



Contact at : [email protected]

About Miss Rizwana Zahoor

• Quality Assurance Analyst @ Intelligentsia (Ph # 7, Bahria) (2

• Ranked 1

st

positon in Testathon Event for “Identifying the besvaluable bug” among 25 to 30 people Organized by FAST in C

with Knowledge Tester in August, 2015

• Obtained MS (SE) in the area of Software Engineering from SZA

• QA Trainer @ TrainingsPK

• Member of Pakistan Agile Development Society.

• Attended several workshops and conferences via knowledge teand others.

• Research Area : Agile Software Development



What to Automate???

Choosing an automation tool

Creating a testinginfrastructure for automation

Designing of test cases

Development of scripts

ExecutionAnalysis o

Sharing Maint




Automation Testing

• A process of writing a computer program to do testing t

would otherwise need to be done manually.

• Use of software to control the execution of tests.

• It is a development activity not a test activity.


http://slidepdf.com/reader/full/quality-with-selenium-rz 5/80Contact at : [email protected]

Mind Status

Activity



Automation Required Why?

Reduced testing time.

Reduce QA cost.

Eliminate manual testing Errors.

Proof of adequate testing.

Consistent test data procedures ensures the process repeatabili

resource independence.



Automated Software Testing

For complete automated testing, all of the

following tasks should be automated:

• Test Path/Sequence Generation

• Test Data Generation• Test Oracle (Verdict) Generation

• Test Execution



Identifying Test Sequences

What sequences of function calls to test?

– Out of billions of possible function call sequences for a class,

Which call sequences to select?

– Important Decision

* A number of heuristics can be used, e.g., – Important function sequences based on application logic

– Data-flow sequences

– Checking the use-case flows / Prototypes

– Checking the misuse-cases (Data Validation)



Identifying Test Data

What test data to execute?

Consider a program taking two integers as input

• Possible number of input combinations: 264 * 264

Which combinations to test?

Decision can be based on test data generation strategies

– To maximize code’s control flow coverage

– To maximize code’s data flow coverage Test based on

equivalence classes and boundaries.




Equivalence Class Portioning

• To reduce the number of test cases to a necessary minimum.

• To select the right test cases to cover all possible scenarios




Identify equivalence classes

• Input, output: clue from requirement

• Equivalence classes are of 2 types: valid and invalid• Ex: identify equivalence classes for this requirement “ if a

pupil has total score >= 75, he will pass the exam, otherwise

will fail (total score is an integer)”




Equivalence classes Test cases

• Define the test cases for both valid and Invalid Equivalence Clas

• Example: write test case for “ if a pupil has total score >= 75, he past the exam, otherwise will fail ”, using equivalence partitionin




Boundary Value Testing

Example:

• “ if a pupil has total score >= 75, he will pass theexam, otherwise will fail (total score must be

integer )”




Computing Test Oracle

How to obtain a test oracle (expected results)?

– Computing test oracle can also be challenging

– Simpler at unit testing level

– Expected outputs are based on test data and is typically manually




Automated Test Execution

How to execute test cases without manual intervention?

• A number of frameworks support automated test

execution

• Record and replay tools (e.g., for web applications)

• xUnit framework tools (J-Unit, N-Unit)




Benefits of Automation

• Reliable : Tests perform precisely the same operations each time

run, thereby eliminating human error

• Repeatable : You can test how the software reacts under repeat

of the same operations.

• Reusable : You can reuse tests on different versions of an applic

if the user interface changes.

• Better Qual i ty Software : Rapid feedback to developers during t

development process as a result of frequent regression testing.• Speed : Run tests significantly faster than human users.

• Cost Reduc t ion : As the number of resources for regression test

reduced.




Categories of Automated Testing Too

Record & Replay

– Web application testing

– GUI testing

– Mobile Application Testing

– xUnit Testing

– Junit

– Google Test – Nunit

– Non-Functional Testing, e.g., Load

Testing

– Load Runner

Record & Replay Tools

• Selenium

• Sahi

• Test Complete

• Watir

• QTP (Quick Test Profe

• QF-Test




Selenium

Web Testing Using Selenium




Testing with Selenium IDE

Introduction to Selenium

Recording Test scripts

Utilization of Recorded Scripts in Java

Assertion for multiple Test Cases / Scenarios on single page

Selecting Page elements

Debugging Tests

Creating Test Suits and Saving them for later use.




Who developed?

Primarily, Selenium was created by Jason Huggins in 2004. An e

Thought Works, he was working on a web application that required

testing. Having realized that the repetitious manual testing of their a

was becoming more and more inefficient, he created a JavaScript p

would automatically control the browser's actions. He named this pr

the "JavaScriptTestRunner .“

Seeing potential in this idea to help automate other web applicationJavaScript Runner open-source which was later re-named as Selen

http://www.guru99.com/introduction-to-selenium.html












Why Selenium ?

Best Option in Open source

Popularity Increasing

Works for GUI and Functionality

Also can do Unit Testing




Selenium Automation Testing

What are components?

Selenium IDE (Integrated Development Environment )

Selenium Remote Control (RC)

WebDriver

Selenium Grid

The scope of training focuses on

Selenium IDE and Web driver.

Selenium C




Arrival of Selenium 2




Selenium Test Packages

Selenium IDE – A Firefox extension to record test cases and suit

Selenium RC – Used to run tests on different browsers and syste

Selenium Grid – Runs multiple instances of Selenium RC at once




Selenium IDE

1. Recording play back tool.

2. It is a plugin to Fire fox browser.

3. It will support only FF (browser); no other browsers are supported.4. There is no any scripting language used to write a program.

5. HTML based script.

6. Can be used by developers with little to no programming experience to w

tests quickly and gain familiarity with the Selenese commands.

7. Has a recording feature that records a user’s live actions that can be expo

of many programming languages.

8. After recording the selenium IDE we can transfer or format the different lalike Java , C# , Rubby, Python & Perl.

9. Developed tests can be run against other browsers, using a simple

command-line interface that invokes the Selenium RC server.

10. Can export WebDriver or Remote Control scripts




Pros & Cons of Selenium IDE




Activity

Installing Selenium




Is Fire fox Installed?

Click on the Mozilla Firefox

• Go to Help -> About as shown below:

• Check the version name

• What is your version?




To check Is Selenium Installed?




Is Selenium IDE Installed?

• Open the Firefox browser window (*1)

• Go to Tools -> Check whether Selenium IDE already exist there (*2)

• If you see “Selenium IDE” then you already having Selenium • IDE plug-in installed in Firefox browser.

• If not installed then follow the instruction on the next slide.




Installing Selenium IDE

• Open the Firefox browser window

• In the navigation tool bar type the below URL:http://seleniumhq.org/download/

• Click the Download link next to Selenium IDE project name.

http://seleniumhq.org/download/







Installing FireBug

Firebug is one of the add-ons of Firefox.

• It is widely used to inspect HTML elements on a webpage.

• You can get Firebug from the following link: https://getfirebug.com

https://getfirebug.com/






Firebug UI




Installing FirePath

Extension of Firebug

• Used to get XPath and CSS values of an HTML elementon a web page.

• You can download FirePath from the following location:

https://addons.mozilla.org/en-US/firefox/addon/FirePath/









Selenium IDE Basics




Selenium IDE Test cases

• Selenium saves all information in an HTML table

format:

Each record consists of:

– Command – tells Selenium what to do (e.g. “open”, “type”,

“click”, “verifyText”) – Target – tells Selenium which HTML element a command

refers to (e.g. textbox, header, table)

– Value – used for any command that might need a value of

some kind (e.g. type something into a textbox)

H d/ l i h l i IDE?




How to record/replay with selenium IDE?

1. Start recording in Selenium IDE

2. Execute scenario on running web application

3. Stop recording in Selenium IDE4. Verify / Add assertions

5. Replay the test.



{1Exercise

Recording first script in Selenium

R di A A t t d T t




Recording An Automated Test

• Open Firefox browser

• Navigate to

http://hrm.seleniumminutes.com (*1)• Go to Tools à Selenium IDE (*2)

D T t




Demo Test

Make sure Record button is ON!

• Go to the Browser window• Login using (*2):

Login Name: admin

Password: Password

• Click Login button

D T t ( t 2)




Demo Test (part 2)

• Hold your mouse over “Welcome Admin” text

• Right-click and select verifyText

• Click logout link

STOP recording




STOP recording

• Go to Selenium IDE.

• Stop Recording.

• Click the red button to stop recording.• All your actions are recorded and displayed sequentially

under Command Table Tab.

What did we accomplish?




What did we accomplish?

R nning Seleni m A tomated Test case




Running Selenium Automated Test case

Interpreting colors




Interpreting colors

• If you see all the command line rows turn

Green color, then the test has passed.

• Light Green means the code executedwithout problems.

• Dark Green means the test result of the

command evaluated to true.

• If any part of the test failed it will be shown

with Red color.

Debugging




Debugging

Examine the result of the script.

Time is needed to validate the login information…

The test must WAIT for the next web page to load

before proceeding

Editing




Editing

• Click the 3rd to last row

• Modify the command field

• Replace “click” with “clickAndWait” command



{2ExerciseRecording your first script in Selenium



Record a script for creating Gma

signup account. And see the resuby playing the recording. Submit y

results at :

[email protected]




Selenium GUI Interface



Contact at : rizwana zahoor@gmail com




Selenium IDE GUI Log View




• Provides current test case execution details

• Contains each step processed result

• Failed step will have a red text• Log is filtered into four different categories:

* Debug – Debugging information

* Info – Execution information

* Error – Error Information (for failed test steps)

* Warn – Any warnings




File Menu à Export Test Case As…




p

Available for the following languages:

• HTML

• Java• C#

• Python

• Ruby

Perl and PHP formatters canbe added separately.




Options Menu > Locator Builders




Locators (Selenium)




1. ID

2. Name

3. X Path4. CSS

5. Tag Name

6. Link text

7. Partial Link Text

8. DOM : Java Script

Using by .name( )




Using by .Id( )




Using by .tagName( )




Using by .class ( )




Using by .link Text ( )




Using by .partial Link( )




Using by.X Path




There are two types of path

1- Absolute X path

2- Relative X path

Absolute X path: starts from html body

.//*[@id=':0']/div/div/div/div/div/p

Relative X path: short from of absolute

.//*[@id='gmail-create-account']

Using by .cssSelector




Selenium Commands




1. Actions: It is used to perform the operations and interactions w

elements.

• Click• Click and Wait

• Select

• Type

• Check

• Open etc.

2. Assertions: It is used as check points. Check points are nothingmatch the expected result to actual result.

Web Driver tool




Assertions can be of three types:

1. Assert: When assert is failed; the test will be aborted. If you aretest suite, the next state case will start.

2. Verify: When verify fails, the test will continue execution logging

3. Accessors: It will be used for storing values and elements.

Some commands are : Store , Store text etc

Selenium IDE Drawback




1. It won’t handle multiple windows.

2. Alerts

3. Popups4. Loops

5. If Conditions

6. Parameterization (Data from excel file, xml file)

Selenium Commands




open: Opens a page using a URL.

click: Clicks the element/object on the page.

clickAndWait: Performs a click operation, and optionally waits for a new page to load.

verifyTitle: Verifies the expected title and continues to run if it fails.

assertTitle: Verifies an expected page title and stops the execution if it fails.

verifyTextPresent: Verifies that the expected text is present somewhere on the page.

verifyElementPresent: Verifies an expected UI element, as defined by its HTML tag.

verifyText: Verifies that the expected text and its corresponding HTML tag are present on the page.

waitForPageToLoad: Pauses execution until an expected new page loads.

waitForElementPresent: Pauses execution until an expected UI element, as defined by its HTML tag, is present on the



{3Exercise

Heuristics for test case desig

Heuristic (/hjʉˈrɪstɨk/; Greek: "Εὑρίσ

http://en.wikipedia.org/wiki/Help:IPA_for_English



http://en.wikipedia.org/wiki/Polytonic_Greek







Heuristic ( / hjʉ rɪstɨk / ; Greek: Εὑρίσ"find" or "discover") refers to

experience-based techniques forproblem solving, learning, and discothat find a solution which is notguaranteed to be optimal, but good

enough for a given set of goals.

From: Wikipedia

TEST C SE DESIGN HEURISTICS











• CRUD (Create, Read, Update, Delete)

• SFDiPOT (Structure, Function, Data, Interfaces, Platform, O

Time)

• HICCUPPS (History, Image, Comparable Products, Claimsneeds, Product, Purpose, Statutes)

• RCRCRC (Recent, Core, Risky, Configuration, Repaired, C

Draw a Test Case Diagram for your project by applying any

Heuristics?



References



[1] http://www.guru99.com/introduction-to-selenium.html

[2] http://seleniumhq.org/download/

[3] https://getfirebug.com/

[4] https://addons.mozilla.org/en-US/firefox/addon/FirePath/

[5] https://hrm.seleniumminutes.com

[6] http://www.softwaretestingclass.com/

[7] Trainings material from Knowledge Tester.

Thanks To ...





https://hrm.seleniumminutes.com/

http://www.softwaretestingclass.com/



https://hrm.seleniumminutes.com/


















Air University

Management

Prof Dr. Ehsan AhmedStudents

Mr. Majd-Uddin

Sr. Quality Manager @ Bentley Systems

Running most famous blog www. knowledgetester.org

FAQs

quality with selenium (rz)

Documents