planning your testing & automation environment
DESCRIPTION
Planning your TESTING & AUTOMATION Environment. Viranand Strout, MANDIANT (NOVATAIG 7/13/2011). A Little About Me…. Shameless Recruiting. Software Testers (Automation ++) Capacity and Performance Engineers Software Engineers …and much more! - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/1.jpg)
PLANNING YOUR TESTING & AUTOMATION ENVIRONMENTViranand Strout, MANDIANT
(NOVATAIG 7/13/2011)
![Page 2: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/2.jpg)
A Little About Me…
![Page 3: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/3.jpg)
Shameless Recruiting
Software Testers (Automation ++) Capacity and Performance Engineers Software Engineers …and much more!
Alexandria (HQ) and a new Reston office (Summer 2011)
is hiring!(http://jobs.mandiant.com)
![Page 4: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/4.jpg)
What’s the problem?
The environment drives the test coverage.
![Page 5: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/5.jpg)
How about this?
The tests drive the environment.
![Page 6: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/6.jpg)
Head Scratching
I like software but that network and machine configuration stuff is boring.
What’s the deal with it happening in production but not in QA?
I’m the only one who can run my automation
Developer who? You can use that machine… but don’t
mess it up! It only happens on my machine
![Page 7: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/7.jpg)
Where Do I Start?
• Test Requirements
• PriorityTest
Requirements
• Budget• Resources• Priority
Environment Requirement
s • Who?• What?• How?
Process
• Tie it together
• Test• Refine
Build
![Page 8: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/8.jpg)
Test Requirements
• Test Requirements
• PriorityTest
Requirements
• Budget• Resources• Priority
Environment Requirement
s • Who?• What?• How?
Process
• Tie it together
• Test• Refine
Build
![Page 9: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/9.jpg)
Breaking it Down
Installation/Deployment Functional System Configuration Mgmt Scale/Performance Security/Communication Automation Continuous Integration Others…
![Page 10: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/10.jpg)
Example: Configuration Management
I need to be able to test my software on 10 operating systems in any given build
How do I quickly pull up those configurations and make sure that they are ready for test?
What I need: I need x bare metal environments and and x virtual environments at my disposal. These environments need to be stood up and reverted in a clean way.
![Page 11: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/11.jpg)
Environment Requirements
• Test Requirements• Priority
Test Requirements
![Page 12: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/12.jpg)
What is the SA Worried About?
Virtualization Firewalls Network Servers Backup/Restore Uptime Throughput Environment
Bloat
![Page 13: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/13.jpg)
Example: Network Architecture Subnets, routing Active Directory Firewall traffic Need to know: How do we anticipate
different components within a system to be installed in production or on a customer site and how do they communicate to each other?
![Page 14: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/14.jpg)
Process
• Test Requirements• Priority
Test Requirements
![Page 15: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/15.jpg)
We Don’t Need No Stinkin’ Process
Who will use it? How often? How will they use it?
Ease of use Accountability Recoverability Speed
![Page 16: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/16.jpg)
Example: Deployment Strategy
Backup
test environment
Initialize environmen
t
Run deployment
Validate
Restore
![Page 17: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/17.jpg)
Build the Environment
• Test Requirements• Priority
Test Requirements
![Page 18: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/18.jpg)
Tie it Together
Installation/DeploymentFunctional
SystemConfiguration MgmtScale/Performance
Security/CommunicationAutomation
Continuous Integration
VirtualizationFirewallsNetworkServers
Backup/RestoreUptime
ThroughputEnvironment Bloat
QA SA
![Page 19: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/19.jpg)
Pretty Pictures
Sample Software Test Environment
![Page 20: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/20.jpg)
Security and Network
Subnet 1 Subnet 2
Subnet 3
Port 1433 Port 80
![Page 21: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/21.jpg)
Templates and Cloning
Template Environment
Initialization Scripts
Virtualized Environment
![Page 22: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/22.jpg)
Templates and Cloning
Template Environment
Virtualized Environment
QA Environment
Development EnvironmentAutomation Environment
![Page 23: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/23.jpg)
Automation and Continuous Integration
Template Environment
Virtualized Environment
Automation Environment
Virtualization API
CI Server
Test AutomationServer
![Page 24: Planning your TESTING & AUTOMATION Environment](https://reader035.vdocument.in/reader035/viewer/2022070408/568143cc550346895db059f0/html5/thumbnails/24.jpg)
Templates and Cloning
Template Environment
Virtualized Environment
QA Enviro Config 1QA Enviro Config 2
Virtualization API
Test AutomationServer