san jose selenium meet-up pushtotest testmaker presentation

16
Scalable Selenium Frank Cohen, +01 408-871-0122, [email protected] May 16, 2012 San Jose Selenium Meetup PushToTest, TestMaker, TestCards Are Trademarks of PushToTest Contents (c) 2012 PushToTest. Ok to publish/distribute with attribution to PushToTest

Upload: appvance-inc

Post on 11-Nov-2014

2.154 views

Category:

Technology


3 download

DESCRIPTION

With the Selenium project team's focus on making the WebDriver APIs a W3C standard, this is a good time to talk about where Selenium is going and the support it is getting from commercial open source companies. Frank Cohen, CEO at PushToTest, will discuss Selenium tools - record/playback utilities, deploying Selenium scripts to the Cloud, results analysis tools to surface functional issues and performance bottlenecks, and operational test database repositories - needed to be productive and successful with Selenium.

TRANSCRIPT

Page 1: San Jose Selenium Meet-up PushToTest TestMaker Presentation

Scalable SeleniumFrank Cohen, +01 408-871-0122, [email protected]

May 16, 2012

San Jose Selenium Meetup

PushToTest, TestMaker, TestCards Are Trademarks of PushToTestContents (c) 2012 PushToTest. Ok to publish/distribute with attribution to PushToTest

Page 2: San Jose Selenium Meet-up PushToTest TestMaker Presentation

Good Outcomes For Servicing The Crowd

About PushToTest‣Our Mission: Test, To Make A More Reliable World

‣Make It Easier To Move From Manual To Automated Testing

‣Support Advanced Testing, including Agile, Load, Integration

‣Open Source Testing (OST) For Everyone

Page 3: San Jose Selenium Meet-up PushToTest TestMaker Presentation

Good Outcomes For Servicing The Crowd

W3C and WebDriver‣Browser Testing and Tools Working Group

‣Spec and Standardize the WebDriver API

‣First Draft Edited by Simon Stewart

‣First Meeting was January 2012 in London UK

‣Mailing List http://lists.w3.org/Archives/Public/public-test-infra/

‣Spec http://tinyurl.com/7br83uw

‣PushToTest and Sauce Labs Become Tools Vendors

‣Browser Vendors Provide WebDriver Implementation

‣Selenium Project Focuses on WebDriver APIs

Page 4: San Jose Selenium Meet-up PushToTest TestMaker Presentation

Good Outcomes For Servicing The Crowd

2012 Selenium Investments

4

Test Authoring(Record/Playback)

Deploy To Grid and

Cloud Environments

Continuous Integration

and Testing

Functional Testing

(Smoke Test, Regression)

Reports Root Cause Analysis

Test Management

Data Driven Tests

Load and Performance Testing

Test Authoring Unit Tests

TestMaker

Web Access and Controls

Page 5: San Jose Selenium Meet-up PushToTest TestMaker Presentation

Good Outcomes For Servicing The Crowd

A Selenium Infrastructure‣Test Authoring In MS IE

‣Operating Tests In A Grid and Cloud

‣Test Management To Scale-Up Selenium Use

Rally

AUT

TestMaker

TestNode

Jenkins

Git

LDAP

MySQL

Test Process AutomationGlobal Access, Security, Management

Results Analysis

TestCards

Page 6: San Jose Selenium Meet-up PushToTest TestMaker Presentation

Good Outcomes For Servicing The Crowd

TestMaker Object Designer‣Record tests in Internet Explorer, Chrome, Firefox, Safari, and

Opera

‣Data-enable tests

‣Assertions and check-points

‣If-then, looping

‣Object Repository

‣On-line Help

‣Ajax and Javascript

Page 7: San Jose Selenium Meet-up PushToTest TestMaker Presentation

Good Outcomes For Servicing The Crowd

Why Run Tests In The Cloud‣Larger Scale - Up To Millions of Virtual Users

‣Geographic Testing - Multiple Locations from California to Sidney

‣Remote Testing - Console in Deli and TestNodes in Seattle

‣Browser Compatibility Testing - Easy To Manage Profiles

Page 8: San Jose Selenium Meet-up PushToTest TestMaker Presentation

Good Outcomes For Servicing The Crowd

TestMaker Architecture

8

PTTMonitorCPU, Net, Memory

Application Under TestWeb, RIA, BPM, SOA

TestMaker Console

RepositoryMySQL RDBMS

Results AnalysisBusiness Intelligence Tool

DesignerRecord/Playback

Grid and CloudTest Deployment

TestNode

BundlesMySQL, HtmlUnit

ScriptRunnersSahi, Selenium, SoapUI, Java

Data Production Librariescsv files, rdbms queries

Page 9: San Jose Selenium Meet-up PushToTest TestMaker Presentation

Good Outcomes For Servicing The Crowd

Machine Instancec1.medium

TestNode

PTTMonitor

OnDemand Cloud Architecture

9

http://sahi.co.in/demo

HtmlUnittest.dsCredentials

AMI IDCount

TestMaker Console

Cloud Client

test.ds

Page 10: San Jose Selenium Meet-up PushToTest TestMaker Presentation

Good Outcomes For Servicing The Crowd

Machine Instancec1.medium

TestNode

PTTMonitor

OnDemand Cloud Architecture

10

HtmlUnittest.ds

TestMaker Console

Cloud Client

Machine Instancec1.medium

Repository

MySQLOracle

MS SQL Server

http://sahi.co.in/demo

Report

Transaction, Step, Time

Page 11: San Jose Selenium Meet-up PushToTest TestMaker Presentation

Good Outcomes For Servicing The Crowd

Scalable Selenium‣The everyday way to access and operate large-scale agile software

testing efforts

‣Fast Real-time Visibility: Requirements, Test Cases, Results

‣Measure SDLC and Quality Progress and Effectiveness

‣Standardizes Test Coverage, Architecture, Results Presentation

Page 12: San Jose Selenium Meet-up PushToTest TestMaker Presentation

Good Outcomes For Servicing The Crowd

TestMaker TestCards

AUT

TestMakerJenkins

TestCards

Page 13: San Jose Selenium Meet-up PushToTest TestMaker Presentation

Good Outcomes For Servicing The Crowd

Agile Stories, Use Cases

AUT

TestMakerJenkins

TestCardsRally

Page 14: San Jose Selenium Meet-up PushToTest TestMaker Presentation

Good Outcomes For Servicing The Crowd

Selenium In Cloud

AUT

TestMakerJenkins

TestCardsRally

TestNode

Page 15: San Jose Selenium Meet-up PushToTest TestMaker Presentation

Good Outcomes For Servicing The Crowd

Test Process Automation

Test Objects RepositorysoapUI TestSuiteCSV Data File

Story Use Case Test Use CaseResults Summary

Rally

AUT

Results Repository

soapUI Script RunnerCSV Data Production Library

Continuous Integration

Test Operation Dashboard

TestMaker

Application Under TestSOAP, REST

MobileWeb, SOA, RIA

TestNode

Jenkins

Git

LDAP

MySQL

User AuthenticationRoles and Security

Test Process AutomationGlobal Access, Security, Management

Results Analysis

TestCards

Page 16: San Jose Selenium Meet-up PushToTest TestMaker Presentation

Good Outcomes For Servicing The Crowd

Try It Yourself‣Learn TestMaker

‣http://www.pushtotest.com

‣Watch A Screencast and Tutorial

‣http://www.pushtotest.com/screencastcentral

‣Attend An Open Source Test Workshop

‣http://workshop.pushtotest.com

‣Ask For A Proposal on Licenses, Training, Support, Consulting

‣Call +01 408 871 0122, [email protected]