ondemand cloud testing
DESCRIPTION
introduction Cloud Testing using PushToTest TestMaker, the Open Source Test Automation tool. The is the slide deck for a video showing how to deploy to the Cloud Selenium, Sahi, soapUI, and unit tests to run as functional tests, load and performance tests, and production monitors.TRANSCRIPT
OnDemand Cloud Testing
Frank Cohen, +01 408-871-0122, [email protected] 4, 2011
Deploying Tests To A Cloud
Open Source Test Automation
About PushToTest‣Our Mission: We Test, For A More Reliable World
‣Make It Easier To Move From Manual To Automated Testing
‣Support Advanced Testing, including Agile, Load, Integration
‣Open Source Testing (OST) For Everyone
2
Open Source Test Automation
Why Run Tests In The Cloud‣Larger Scale - Up To Millions of Virtual Users
‣Geographic Testing - Multiple Locations from California to Sidney
‣Remote Testing - Console in Deli and TestNodes in Seattle
3
Open Source Test Automation
TestMaker Architecture
4
PTTMonitorCPU, Net, Memory
Application Under TestWeb, RIA, BPM, SOA
TestMaker Console
RepositoryMySQL RDBMS
Results AnalysisBusiness Intelligence Tool
DesignerRecord/Playback
Grid and CloudTest Deployment
TestNode
BundlesMySQL, HtmlUnit
ScriptRunnersSahi, Selenium, SoapUI, Java
Data Production Librariescsv files, rdbms queries
Open Source Test Automation
Machine Instancec1.medium
TestNode
PTTMonitor
OnDemand Cloud Architecture
5
http://sahi.co.in/demo
HtmlUnittest.ds
test.ds
CredentialsAMI IDCount
TestMaker Console
Cloud Client
Open Source Test Automation
Machine Instancec1.medium
TestNode
PTTMonitor
OnDemand Cloud Architecture
6
HtmlUnittest.ds
TestMaker Console
Cloud Client
Machine Instancec1.medium
Repository
MySQLOracle
MS SQL Server
http://sahi.co.in/demo
Report
Transaction, Step, Time
Open Source Test Automation
Try It Yourself‣Download the Tutorial
‣http://twitter.com/fcohen
‣Please retweet
‣Please follow me
‣Request OnDemand Credentials From [email protected]
‣Add Credentials To config.ec2
‣Click Start
‣Let’s See It In Action...
7
Open Source Test Automation
Amazon Web Services (EC2)‣High-CPU Medium Instance
1.7 GB of memory5 EC2 Compute Units (2 virtual cores, 2.5 EC2 Compute Units each)350 GB of instance storage32-bit platformI/O Performance: ModerateAPI name: c1.medium
8
Open Source Test Automation
Test Authoring and Test Scale
9
TestMaker Approach Advantages and Disadvantages Scale
Protocol Level Testing
Large volume of virtual users per TestNode (1000+ VUs)Script-level coding effort for Web apps with client-side business logicExtra coding to test Web page resources (CSS, Javascript, Images)Test message-oriented services (BPM, MOM, ESB)
1000+ virtual users per TestNode
HTTP Archive (HAR)
Large volume of virtual users per TestNode (1000+ VUs)Scriptless test authoring, create HAR files using point-and-click Firefox with FirebugAutomatic testing of Web page resources (CSS, Javascript, Images)Does not support Ajax, Javascript functions within Web pages
1000+ virtual users per TestNode
HTMLUnit (SeleniumHtmlUnit, SahiHtmlUnit)
Scriptless test authoring using record/playbackOperates client-side business logic automaticallySmall volume of virtual users (50 VUs)Possibly extra test coding for Javascript incompatibility
20-200 virtual users per TestNode
Browser Functional (Selenese RC TestNode or Sahi with Browser)
Browser compatibility testing with the same test scriptVisual test operation for test debuggingVery small volume of virtual users (2 VUs)Slow test operation
2-4 virtual users per TestNode
Open Source Test Automation
Where To Go From Here‣Learn TestMaker
‣http://www.pushtotest.com
‣Watch A Screencast and Tutorial
‣http://www.pushtotest.com/screencastcentral
‣Attend An Open Source Test Workshop
‣http://workshop.pushtotest.com
‣Ask For A Proposal on Licenses, Training, Support, Consulting
‣Call +01 408 871 0122, [email protected]
10