Download - CSCE 181 Test Automation at Schlumberger
![Page 1: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/1.jpg)
CSCE 181Test Automation at Schlumberger
Glen Accardo, HTC Test Automation LeadJohn Wanke, HQ Test Automation Engineer
![Page 2: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/2.jpg)
Agenda
Introduction Overview of Schlumberger A footnote about your degree program What is automated testing, and why do it? Challenges in test automation
![Page 3: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/3.jpg)
Glen Accardo
Started at Schlumberger in 2005 Tested drilling, real-time, and production applications Currently I manage the test automation function at
the Houston Technology Center
![Page 4: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/4.jpg)
Glen Accardo
Studied at University of Southwestern Louisiana– Computer Science, Mathematics, English
Held the following positions before Schlumberger– Technical writer– Web master/application developer– Developer/Tester for database performance
monitoring/tuning, and backup/recovery http://www.linkedin.com/pub/glen-accardo/0/905/904
![Page 5: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/5.jpg)
Agenda
Introduction Overview of Schlumberger A footnote about your degree program What is automated testing, and why do it? Challenges in test automation
![Page 6: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/6.jpg)
What is Schlumberger? The leading provider of
technology and project management to the upstream oil and gas industry for over 80 years
Over 110,000 employees, 140 nationalities in 80 countries
25 research & engineering facilities worldwide-2010 invested $919 million in R&D
The only true multinational corporation in the composition of its workforce, management team and Board of Directors
![Page 7: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/7.jpg)
Agenda
Introduction Overview of Schlumberger A footnote about your degree program What is automated testing, and why do it? Challenges in test automation
![Page 8: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/8.jpg)
Anyone Recognize This Phrase?
…a sound preparation in science, mathematics, English, statistics and computing.
Program Overview
The computer science curriculum is designed to prepare students to enter the rapidly expanding computer field. It is based upon the Institute of Electrical and Electronic Engineer Computer Society and the Association for Computing Machinery recommendations for curricula and courses. The four-year undergraduate curriculum in computer science includes a sound preparation in science, mathematics, English, statistics and computing. Students majoring in computer science at Texas A&M will take a 12-hour area of concentration in another department. Electives are available in the areas of: algorithms, languages and computability, software systems, networking, computer systems and architecture, artificial intelligence and cognitive modeling, vision, graphics and robotics and computational science and engineering. Advanced undergraduates may take graduate courses in these areas.
![Page 9: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/9.jpg)
Why is English in the List?
Nearly all jobs require “Excellent communications skills” Employers will probably see your writing before your
programming—laziness or ineptitude in one will be applied to the other
Not just for technical writers Not just for a job interview Clear writing will distinguish you from people with equal
technical skills
![Page 10: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/10.jpg)
Agenda
Introduction Overview of Schlumberger A footnote about your degree program What is automated testing, and why do it? Challenges in test automation
![Page 11: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/11.jpg)
What is Testing?
“Testing is an infinite process of comparing the invisible to the ambiguous in order to avoid the unthinkable
happening to the anonymous.”
- James Bach
![Page 12: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/12.jpg)
Problem Number 1
Development Effort
Testing Effort
Incremental
Cumulative
Which Leads To:- Risks for customers- Risks for product team- Increased support cost
Debate the finish criteria:- Remove features- Extend deadlines- Add resources
Take short cuts:- Don’t test features- Don’t test configurations- Don’t do non-functional tests
![Page 13: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/13.jpg)
Solution: Add Test Automation
Test Automation Effort
What if we eliminate repetitive tests?
Development Effort
We can refocus manual test efforts on important, new testing.
Manual Test Effort
![Page 14: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/14.jpg)
What Must Automated Tests Do?
Mimic behavior of a user or application in an environment
Validate the results ofthis behavior
Maintain or improve upon standards of otherforms of testing.
![Page 15: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/15.jpg)
What is Test Automation Not?
Not record and playback Not a cheap alternative
to other methods of testing
![Page 16: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/16.jpg)
Example
The TestComplete version of “Hello World.”
![Page 17: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/17.jpg)
Impact?
Application exists (is installed?) Application starts without error Application accepts input without error Application saves file without error Application exits without error
![Page 18: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/18.jpg)
Basic Metrics
Metric ValueTime to Develop 15 minutes
Time to run 16 seconds
Time to run manually 2 minutes
Metric ValuePerformance Improvement 86%
Can run 7.5x as often
Cost Cost of computer for 16 seconds vs.Cost of person for 2 minutes
Expandability Can run simultaneously on any number of configurations
Repeatability Near perfect
![Page 19: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/19.jpg)
Problem Number 2
Question: “Should add feature X?”Answer: “Hmmm.”
Question: “Should we support configuration X?”Answer: “Yes.”
![Page 20: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/20.jpg)
Testing Effort Grows on Multiple Dimensions
Features
Configurations
Data Sets
![Page 21: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/21.jpg)
Two Part Solution
All Pairs Testing http://en.wikipedia.org/wiki/All-pairs_testing
Run automated tests in parallel
![Page 22: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/22.jpg)
WebCam of HTC Automation
![Page 23: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/23.jpg)
Impact
Product Automated Tests Equivalent Manual TestsStudio 20 hours * 4 platforms 8 person weeks
Matira 5 hours * 3 platforms 4 person weeks
Tupai 3 hours * 9 platforms 5 person weeks
PIPESIM 40 hours * 5 platforms ?????
Seabed 4 platforms * 1 hour 1 person week
OFM TBD TBD
Merak TBD TBD
MEP TBD TBD
IAM TBD TBD
![Page 24: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/24.jpg)
Problem Number 3
![Page 25: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/25.jpg)
Agenda
Introduction Overview of Schlumberger A footnote about your degree program What is automated testing, and why do it? Challenges in test automation
![Page 26: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/26.jpg)
John Wanke
Started at Schlumberger in 2010 Tested economics, asset management, and enterprise planning
applications Currently I lead the test automation effort for the Production
Solutions group (services-based products)
![Page 27: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/27.jpg)
John Wanke Studied at Wichita State University
– Electrical Engineering, Mathematics Held the following positions before Schlumberger
– Lead Systems Analyst / Software Engineer– Lab Systems Administrator– Web master/application developer– I/T Manager– Software Quality Assurance Engineer/Developer for
message queueing administration and monitoring http://www.linkedin.com/in/johnwanke
![Page 28: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/28.jpg)
Management, Marketing, and Machiavelli
Well-known
Established
Easily understood
Simple operation
Alien and foreign
Newcomer
Complex
Requires skill to use
![Page 29: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/29.jpg)
Challenges of Test Automation:Manage ExpectationsMetric ValueTime to Develop 15 minutes
Time to run 16 seconds
Time to run manually 2 minutes
Reality MeaningDevelopment Skills Much more than “hello world”
I/T skills Computers don’t magically appear and operate
Application Knowledge Not all applications are == notepad
Automation tool skills The application doesn’t run itself, does it?
Testing skills What can be tested? How?
Collaboration Dev aware of how to test. Tester must show results.
![Page 30: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/30.jpg)
Merak Enterprise Planning (MEP) Solution Overview
Collaborate
Provide Visualize
Generate
Calculate
Integrate
Synchronize
Quality Control Staging
area
Data Warehouse
Merak Cube
Asia B.U.
N. America B.U.
EuropeB.U.
OFMExcel DBVOLTS
External Systems
Merak Peep databases
Calc NodeCalc Node
Calc Node
Calc Node Calc
Node
Secure role-based web or
desktop access
Intelligent oil & gas dimensions
![Page 31: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/31.jpg)
MEP Product Architecture
![Page 32: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/32.jpg)
The Technical Challenge
“The challenge you face is gaining automated / deterministic control of your test environment.” -- Jonathan Lee
![Page 33: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/33.jpg)
The Technical Challenge, Part 1:Known Test Platforms
![Page 34: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/34.jpg)
Merak Enterprise Planning Test Environment
![Page 35: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/35.jpg)
The Technical Challenge, Part 2:Known Testware
Test Automation Effort
Development Effort
Manual Test Effort
Software written to test software
Subject to same controls as any other software asset
– Versioned to be in sync with app
![Page 36: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/36.jpg)
The Technical Challenge, Part 3:Find a Tester or Make One
![Page 37: CSCE 181 Test Automation at Schlumberger](https://reader036.vdocument.in/reader036/viewer/2022081422/5681615c550346895dd0e7bc/html5/thumbnails/37.jpg)
Q & A