automated load testing test and web performance test on jobstreet.com using microsoft visual studio...
TRANSCRIPT
7/30/2019 Automated Load Testing Test and Web Performance Test on Jobstreet.com Using Microsoft Visual Studio 2010
http://slidepdf.com/reader/full/automated-load-testing-test-and-web-performance-test-on-jobstreetcom-using 1/9
1
1.0 Introduction
Jobstreet.com.my is a Malaysian web portal which offers the services of job recruitment via
Internet in the Asia-Pasific. JobStreet.com.my offers a comprehensive suite of interactiverecruitment services. International and local Asian corporations recruit from JobStreet.com's
ever-increasing pool of top talent and manage their recruitment process through uniquely
developed software applications via the Internet. As the website is accessed by thousands of
user simultaneously, it is important that the site function correctly and is able to maintain its
load. Below are the site info gained from http://www.jobstreet.com.my/ .
Figure 1.1: Main Page of Jobstreet.com.my
2.0 Test Item
This test plan intended to test the website accessed capacity which include the item: webpage
and its link redirection.
3.0 Features to be tested
Among the feature to be tested are:
a. User load
b. Average Response Time for each Page in second
7/30/2019 Automated Load Testing Test and Web Performance Test on Jobstreet.com Using Microsoft Visual Studio 2010
http://slidepdf.com/reader/full/automated-load-testing-test-and-web-performance-test-on-jobstreetcom-using 2/9
2
However, there are several feature is ignored during the testing:
a. Login into the system.
b. Registration feature of the website.
4.0 Approach
Microsoft Visual Studio 2010 provides a dynamic and user-friendly test facility in the suite.
Firstly, test that are to be conducted are web performance testing. Web performance testing is
a type of testing intended to determine the responsiveness, throughput, reliability, and/or
scalability of a system under a given workload.
4.1 Web Performance Testing
Purpose:
Verify the functionality or performance of the Jobstreet.com.my
Process:
a. Done by recording the interaction between user and website in a browser (Internet
Explorer is chosen).
b. Only perform the test at HTTP layer and doesn’t run any additional script. For
example, Java Script, ActiveX Controls or Flash Player.
c. Internet connection is set to Local Area network (LAN).
Secondly, result gathered from web performance testing will be used to perform load testing
on the website.
4.2 Load Testing
Purpose:
a. Identify the maximum user capacity in the website (Jobstreet.com.my).
b. Stimulate situation where many users visiting the website at the same time.c. Verify that an application will still perform adequately while under stress.
d. Analyze the results for further integration or development of the website.
Process:
a. Automatic testing is done using Microsoft Visual Studio 2010 which provides the
tools to test the web in its Integrated Development Environment (IDE).
b. Test is set to be on a load of 25 users accessing the website at the same time.
c. Internet connection is set to Local Area network (LAN). Browser is set to Internet
Explorer7 and the test is performing for 2 minute without any warm-up time.
7/30/2019 Automated Load Testing Test and Web Performance Test on Jobstreet.com Using Microsoft Visual Studio 2010
http://slidepdf.com/reader/full/automated-load-testing-test-and-web-performance-test-on-jobstreetcom-using 3/9
3
5.0 Item Pass or Fail Criteria
For web performance test, the Pass and Fail Criteria is set to the:
Pass Criteria: Link redirection open correct site link on-click basisFail Criteria: Link redirection open wrong site link on-click basis
For load test, the Pass and Fail Criteria is set to the:
Pass Criteria: Site is able to support maximum number of 25 users for 2 minute.
Fail Criteria: Site is unable to support maximum number of 25 users for 2 minute.
6.0 Test Deliverables
Test Deliverables are the item(s) which are the final product of the testing. In this automation
testing, there are several items delivered to the tester.
a. User load – how many users are opening the pages at one time.
b. Page/Sec – page load per second.
c. Average Page/Time – average page load per second.
d. Top 5 Slowest Page – slowest page.
e. Request Count – total request sent by Visual Studio to the web page.
f. Pages Request Count – total request sent by Visual Studio for each page define from
Web Performance Test.g. Error – Error encountered such as unavailable resource to return data requested.
h. Threshold Violation – Violation of threshold whereby number of system down than
average.
i. Processor Time – Processor / server processing time.
j. Available Mbyte – Data available delivered by processor / server.
7.0 Testing Task
Since this test is an automated test, no special skills are required. As for interdependency,
Web Performance Test must be done before Load Test as Web Performance Test data will be
used as test basis for Load Test.
7/30/2019 Automated Load Testing Test and Web Performance Test on Jobstreet.com Using Microsoft Visual Studio 2010
http://slidepdf.com/reader/full/automated-load-testing-test-and-web-performance-test-on-jobstreetcom-using 4/9
4
8.0 Environmental need
8.1 Web Performance Test
Since the test is recorded using default browser associated with Visual basic 2010 is InternetExplorer, thus Internet Explorer must be installed beforehand.
8.2 Load Testing Test
For load testing, there are several requirement needs to be fulfilled. The think time is set to 0.
Think time gives a time for the website to loading before the tools analyze its data. It’s
minimizing the integrity of the testing process. For this test is set to be on constant load of 25
users at the same time. The Internet connection is set to Local Area Network (LAN). Browser
is set to Internet Explorer7.0. Test is performing for 2 minute without any warm-up time.
9.0 Test Result
9.1 Web Performance Test Result
Using the Internet Explorer as a player, Visual Studio 2010 capture the interaction of the user
and the website. Which website that the user enter, the tools will record and keep the data.
Figure 9.1: The environment during the recording process in Internet Explorer.
7/30/2019 Automated Load Testing Test and Web Performance Test on Jobstreet.com Using Microsoft Visual Studio 2010
http://slidepdf.com/reader/full/automated-load-testing-test-and-web-performance-test-on-jobstreetcom-using 5/9
5
Figure 9.2: Recording session. Each action of the user during recording can be check at Web
Test Recorder panel at the left-side of the windows.
Figure 9.3: Each web page visited by the user is recorded. Tester can choose which item to be
tested.
Based on the result showed above, the test result is a pass as the pages opened are correct and
according to the link redirection URL. For example, if the user click on the option Learning,
the user will be bring to the website http://www.jobstreet.com.my/learning/ . Four URL’s are
tested and the link redirecting to the pages are correct. The four URL’s are:
i. Main Page: http://www.jobstreet.com.my/
ii. Search Jobs: http://job-search.jobstreet.com.my/malaysia
iii. MyJob Street: http://www.jobstreet.com.my/myjobstreet/default.htm
iv. Learning: http://www.jobstreet.com.my/learning/
7/30/2019 Automated Load Testing Test and Web Performance Test on Jobstreet.com Using Microsoft Visual Studio 2010
http://slidepdf.com/reader/full/automated-load-testing-test-and-web-performance-test-on-jobstreetcom-using 6/9
6
9.2 Load Testing Test Result
For load testing, the results of testing are as followed. Figure 9.4 shows the summary of test
after the testing is done according to the preferences in process section 4.0, Approach.
Figure 9.4: Load Test Result (Page 1)
Figure 9.5: Load Test Result (Page 2)
7/30/2019 Automated Load Testing Test and Web Performance Test on Jobstreet.com Using Microsoft Visual Studio 2010
http://slidepdf.com/reader/full/automated-load-testing-test-and-web-performance-test-on-jobstreetcom-using 7/9
7
Figure 9.6: Load Test Result (Graph Mode)
Key indicator shows the counter for each properties in graph view.
Key Indicators
CounterInstanc
eCategory
Compute
r
Colo
r
Rang
eMin
Ma
xAvg
User Load _TotalLoadTest:Scenari
oIME-PC 100 25 25 25
Pages/Sec _Total LoadTest:Page IME-PC 1003.8
017.8 11.9
Avg. Page Time _Total LoadTest:Page IME-PC 100.9
64.00 1.61
Errors/Sec _Total LoadTest:Errors IME-PC 1 0 0.200.008
3
Threshold
Violations/Sec
_Total LoadTest:Errors IME-PC 1 0 0.40 0.017
Figure 9.7: Load Test Result – Key indicator
7/30/2019 Automated Load Testing Test and Web Performance Test on Jobstreet.com Using Microsoft Visual Studio 2010
http://slidepdf.com/reader/full/automated-load-testing-test-and-web-performance-test-on-jobstreetcom-using 8/9
8
Controller and Agents
Counter Instance Category Computer Color Range Min Max Avg
% Processor Time 0 Processor IME-PC 100 34.7 59.4 40.1
Available MBytes - Memory IME-PC 10,000 980 1,117 1,033
Figure 9.8: Load Test Result – Controller and Agents (Graph Mode)
Processor time and available Mbytes are based on Figure 7.
Based on all the test result, Load Test result is a pass even though there is one error
encountered.
Based on Figure 9.4 and 9.5, the results gained are:
Table 9.1: Properties of the results
No. Properties Results1 Total Tests conducted Total: 279, Fail: 1 (0.36%)
2 Maximum user load 25
3 Time for accessing each Page (Second) 11.9
4 Average Page Time (Second) 1.61
5 Average Response Time (Second) 0.29
6 Average Time for each Test (Second) 9.06
7 Error Detected 1
8 Threshold Violation 1
Error detected during this testing is “500-Internal Server Error” that resulting the web page to
view the page not properly. The page involved in this error is http://job-
search.jobstreet.com.my/malaysia. Error encountered could be caused by the system error
handling mechanism by which it will prevent the server from crash or defence from
Distributed Denial of Attack (DDoS).
Figure 9.9 shows the error properties.
7/30/2019 Automated Load Testing Test and Web Performance Test on Jobstreet.com Using Microsoft Visual Studio 2010
http://slidepdf.com/reader/full/automated-load-testing-test-and-web-performance-test-on-jobstreetcom-using 9/9
9
Figure 9.9: Error properties
10.0 Conclusion
As a conclusion, both tested are successfully performed with satisfying results. Both tests
give positive result. As both test gives desirable result and does not encounter any error, we
can conclude that the website could handle many user at one time and will not result in faulty
URL redirection and many more given that the user are 25 person and below. It is also
important to keep that in mind that this test are only a small portion of overall test that could
be done thus the result gained from this test might not cover all test result. As a precautionand additional recommendation for future test, number of user and number of test to be
conducted should also be increased. Among other test are Coded UI Test, Database Unit Test,
Generic Test and Ordered Test.