good practices on test automation

Good practices on test automation

Gustavo Labbate Godoy

Where are test automation on agile environments?

Several agile methodologies:

Scrum, Extreme Programming (XP), Lean Development, Feature-Driven Development (FDD), Kanban, RUP and OpenUP.

Software Development by interactive and incremental way.

TDD, Data-Driven Testing, Regression Testing.

Automation is one of the three pilars of agile methodology.

Delivery on time, with all tested and approved.

“Working software is the primary measure of progress.” (http://agilemanifesto.org)

Junit is unit test ?

What is unit test andwhat is Junit ?

Unit test

Test the smaller of the components in a isolated way.

Test methods must be independent.

Functional test

Test the behavior of the sistem, from data inputs, processing and data outputs.

assertEquals( ExpectedResult, returnProcessedData(entryData) );assertEquals( ExpectedResult, returnProcessedData(entryData) );

returnedObject = insertData(entryData);

assertNotNull(returnedObject); //Validating if insert was sucessfull

consultedObject = consultData(returnedObject);

assertEquals( consultedObject, expectedObject ); //Validating if insert was sucessfull through system query

returnedObject = insertData(entryData);

assertNotNull(returnedObject); //Validating if insert was sucessfull

consultedObject = consultData(returnedObject);

assertEquals( consultedObject, expectedObject ); //Validating if insert was sucessfull through system query

Correctly specify your tests

Correctly specify your tests

Don't say test, be more specific ...

TestCalculate - testCalc1 = shouldSumTwoInt

- testCalc2 = shouldSubtractFromSum

Test all functionality inside your method (avoid alphabetical ordering).

expectedObjects = testParameters;

expectedObjects = includeData(entryData);

assertNotNull(returnedObject); //Validating if insert was sucessfull

consultedObject = consultData(returnedObject);

assertEquals( consultedObject, expectedObject ); //Validating if insert was sucessfull through system query

expectedObjects = testParameters;

expectedObjects = includeData(entryData);

assertNotNull(returnedObject); //Validating if insert was sucessfull

consultedObject = consultData(returnedObject);

assertEquals( consultedObject, expectedObject ); //Validating if insert was sucessfull through system query

Correctly specify your tests

But ...

@Testpublic void shouldSucessfulyInclude() { … }

@Testpublic void shouldSucessfullyConsultAfterInclude() { … }

@Testpublic void shouldSucessfulyInclude() { … }

@Testpublic void shouldSucessfullyConsultAfterInclude() { … }

@FixMethodOrder(MethodSorters.NAME_ASCENDING)@FixMethodOrder(MethodSorters.NAME_ASCENDING)

@Testpublic void aShouldSucessfulyInclude() { … }

@Testpublic void bShouldSucessfullyConsultAfterInclude() { … }

@Testpublic void aShouldSucessfulyInclude() { … }

@Testpublic void bShouldSucessfullyConsultAfterInclude() { … }

Alphabetically ordering methods:

Every test method must be independent.

Execution order is random.

Parameterize test data

Read from a spreadsheet (or another external file … )

@RunWith(Parameterized.class)public Class UserInsert

@Parameterspublic static Collection<Object[]> data() {

return Arrays.asList(new Object[][] {{"ParameterA"}, {"ParameterB"}} );}

public UserInsert(String[ ] parameters) { /* Add parameters to variables ... */ }

@RunWith(Parameterized.class)public Class UserInsert

@Parameterspublic static Collection<Object[]> data() {

return Arrays.asList(new Object[][] {{"ParameterA"}, {"ParameterB"}} );}

public UserInsert(String[ ] parameters) { /* Add parameters to variables ... */ }

https://bitbucket.org/wakaleo/jxlunit/src/6eb465c848c8/src/main/java/com/wakaleo/training/jxlunit/SpreadsheetData.java

@Parameterspublic static Collection spreadSheetData() throws IOException {

InputStream spreadSheet = new FileInputStream(“mySheet.xls”);return new SpreadSheetData(spreadSheet).getData();

}

@Parameterspublic static Collection spreadSheetData() throws IOException {

InputStream spreadSheet = new FileInputStream(“mySheet.xls”);return new SpreadSheetData(spreadSheet).getData();

}

Selenium

Selenium IDE or Core ?

IDE

• Record & Playback

• Export to several languages (C#, Java, Perl, PHP, Python, Ruby).

• In browser test execution.

• Code refactoring: Re-record your tests...

• To avoid: use plugins (do a little programming … )

• Record only on firefox, but run on others (the script, not in IDE … )

• Don't need advanced knowledge on exported code.

Core (coding)

• API to several languages (C#, Java, Perl, PHP, Python, Ruby).

• Build your own test framework, extending selenium.

• Test execution on several browser.

• Code refactoring: update only affected test code (Page Object Model)

• Knowledge of choosen language is essential.

Promote maintainability

Promote maintainability

Use fixtures

WebDriver driver

@BeforeClass public static void runBeforeClass() throws Exception { driver = new FirefoxDriver(); selenium = new WebDriverBackedSelenium(driver, url);

capability = DesiredCapabilities.firefox(); capability.setBrowserName("firefox"); capability.setCapability(CapabilityType.TAKES_SCREENSHOT, true);}

@After public void runAfterEachTest() {

printScreen();}

@AfterClass public static void runAfterClass() {

driver.quit();}

WebDriver driver

@BeforeClass public static void runBeforeClass() throws Exception { driver = new FirefoxDriver(); selenium = new WebDriverBackedSelenium(driver, url);

capability = DesiredCapabilities.firefox(); capability.setBrowserName("firefox"); capability.setCapability(CapabilityType.TAKES_SCREENSHOT, true);}

@After public void runAfterEachTest() {

printScreen();}

@AfterClass public static void runAfterClass() {

driver.quit();}

Promote maintainability

PageObjectsObject that represents a web system screen.

public Class LoginPO

@FindBy(id="user") WebElement user; @FindBy(id="password") WebElement password; @FindBy(id="btnClose") WebElement closeButton; @FindBy(id="btnLogin") WebElement loginButton; String userAcessApp = "automation"; String passwordAcessApp = "selenium"; public void typeAndEnter(String user, String pass) { usuer.sendKeys(user); password.sendKeys(pass); loginButton.click(); }

public Class LoginPO

@FindBy(id="user") WebElement user; @FindBy(id="password") WebElement password; @FindBy(id="btnClose") WebElement closeButton; @FindBy(id="btnLogin") WebElement loginButton; String userAcessApp = "automation"; String passwordAcessApp = "selenium"; public void typeAndEnter(String user, String pass) { usuer.sendKeys(user); password.sendKeys(pass); loginButton.click(); }

Organize …

Organize ...

Using Junit Test Suite

@RunWith(Suite.class)@SuiteClasses({

TestClass1.class,TestClass2.class,TestClass3.class

})public class AllMyTests{

}

@RunWith(Suite.class)@SuiteClasses({

TestClass1.class,TestClass2.class,TestClass3.class

})public class AllMyTests{

}

Solid foundations ...

Solid foundations ...

Guarantees data integrity

Spring's configuration:

<bean id="dataSource" class="org.springframework.jdbc.datasource.DriverManagerDataSource"> <property name="driverClassName" value="${hibernate.connection.driver_class}" /> <property name="url" value="${hibernate.connection.url}" /> <property name="username" value="${hibernate.connection.username}" /> <property name="password" value="${hibernate.connection.password}" /></bean>

Spring's configuration:

<bean id="dataSource" class="org.springframework.jdbc.datasource.DriverManagerDataSource"> <property name="driverClassName" value="${hibernate.connection.driver_class}" /> <property name="url" value="${hibernate.connection.url}" /> <property name="username" value="${hibernate.connection.username}" /> <property name="password" value="${hibernate.connection.password}" /></bean>

DBUnit's dataSet to setup and prepare a data base

<dataset><schema.USER LOGIN="User" PASSWORD="781b4ea1d8" NAME="Test User"PASSWORD_EXPIRATION_DATE="2013-03-01 00:00:00.0" LOGIN_COUNT="0" EMAIL="user@test.com" />

</dataset>

DBUnit's dataSet to setup and prepare a data base

<dataset><schema.USER LOGIN="User" PASSWORD="781b4ea1d8" NAME="Test User"PASSWORD_EXPIRATION_DATE="2013-03-01 00:00:00.0" LOGIN_COUNT="0" EMAIL="user@test.com" />

</dataset>

Orchestrate ...

Orchestrate ...

Manage automated executions

Orchestrate ...

Manage test execution results

References

Arquillian

http://arquillian.org/

Junit

http://junit.sourceforge.net/

Selenium

http://seleniumhq.org/

DBUnit

www.dbunit.org/

Page Objects

https://docs.jboss.org/author/display/ARQGRA2/Page+Objects

http://code.google.com/p/selenium/wiki/PageObjects

Jenkins

http://jenkins-ci.org/

TestLink

http://www.teamst.org/

Thanks!

gustavolabbate@gmail.com

linkedin.com/in/gustavolabbate

@gustavolabbate