new approaches to real-time application testing and performance monitoring: a holiday guide for the...
DESCRIPTION
According to the online retail research firm comScore, this year’s Cyber Monday sales surpassed the $1.25 billion mark, breaking all previous records and setting the pace for the busiest online retail season in history. The key to many of this year’s success was deep insight into how web systems would handle realistic user traffic coupled and where issues would occur. Firms must adopt the correct application testing and performance monitoring methodologies to ensure revenues and avoid disaster. Join SOASTA and Correlsense for this engaging webinar, which will give you an executable plan for your IT operations team. You will learn:Best Practices in planning, executing, and closing out your holiday performance testing campaignHow to test and monitor mission critical applications leading into and during the holiday seasonPerformance testing and monitoring techniques that will guarantee a satisfying end user experienceTechnologies which will allow you to quickly determine the most important tests to run based on what real users are doingCase studies and demonstrations showing how the combination of deep transactional data and cloud-based testing deliver confidence in holiday retail readinessTRANSCRIPT
![Page 1: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/1.jpg)
New Approaches to Real-Time Application Testing and Performance Monitoring
December 15, 2011
![Page 2: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/2.jpg)
Agenda
• Best practices for holiday performance testing• New testing and monitoring techniques• Demo• Q&A
![Page 3: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/3.jpg)
Housekeeping
• Presentation will last 45 minutes• Submit questions via the chat window• Slides will be made available
![Page 4: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/4.jpg)
Featured Speakers
Oren EliasCEOCorrelsense
Dan BartowVP, Chief EvangelistSOASTA
Brad JohnsonVP, Product MarketingSOASTA
![Page 5: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/5.jpg)
BEFORE, DURING AND AFTER THE HOLIDAYS
![Page 6: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/6.jpg)
The Online Market
You are here!
![Page 7: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/7.jpg)
Cyber Monday 2011
• $1.3B • 33% y/y growth in traffic• 10.8% is Mobile (3.9% last year)
![Page 8: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/8.jpg)
iCommerce: Biggest Mobile Influence
![Page 9: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/9.jpg)
The IT Landscape Has Changed
What is “Peak Load”?• 100%, 200%...500%+?• How much mobile traffic should we prepare for…and how?
What Are The Most Important Transactions?• What are the most profitable paths users follow?• What is the affect of non-buying “browsing” on paying customers?
What System Do You Test In?• Is the lab good enough?• Production testing is taboo (isn’t it)?
How Will You Find The Issues?• Complexity reigns • How do we see where issues are at load?
![Page 10: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/10.jpg)
The IT Landscape Has Changed
What is “Peak Load”?• You must to test to new limits with a mix of web and mobile traffic
What Are The Most Important Transactions?• Those that you determine as profitable, complex and/or risky
What System Do You Test In?• Testing is a continuous process from the lab to live production
How Will You Find The Issues?• Monitoring during tests for the the end-to-end view while tests run
![Page 11: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/11.jpg)
BEST PRACTICES
![Page 12: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/12.jpg)
Monitoring best practice 1“Assume Nothing”
Oops. A production server!
UAT Environment topology autodetected
![Page 13: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/13.jpg)
Monitoring best practice 2Visibility explains REAL phenomenas
Specific transaction type is failing
Specific location is failing
![Page 14: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/14.jpg)
Monitoring best practice 2Visibility explains REAL phenomenas
When compared to % Time spent within the Data Center
Or the %Time spent rendering on the user’s device
You can see that the % Time spent between User and Data Center is the issue here
It is pretty easy to see the load balance mismatch
![Page 15: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/15.jpg)
Monitoring best practice 3Baseline and compare
Compare application model of 100% load vs. 150% of load
![Page 16: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/16.jpg)
Testing best practice 1
• Start early & test progressively.– Begin in development
– Run many iterative tests that address performance from code though infrastructure
– Finish in production (Live prod to really be sure)
![Page 17: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/17.jpg)
Testing best practice 2
• Test realistically.– Model users acting like humans
– Stress & measure at a realistic pace
– Run at true scale
– From different locations and devices
![Page 18: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/18.jpg)
Testing best practice 3
• Seek a single source of performance truth.– Get Dev & Ops on the same page. (Is 2 seconds okay?)
– Measure with the same tools in Dev, Test & Ops
– Correlate monitoring data with test data as tests run
![Page 19: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/19.jpg)
Thankfully, There is a Solution
SharePath identifies critical transactions to test what matters most
CloudTest enables testing to any level with web or mobile traffic – in lab or production environments
Monitor critical metrics during and after tests to isolate and prevent production outages
![Page 20: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/20.jpg)
Demo
![Page 21: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/21.jpg)
Summary
• The IT Landscape has changed • Start your testing early, test progressively, and
test realistically• When monitoring critical applications, assume
nothing, look for root cause phenomena, use baselines, and compare
• SharePath and CloudTest provide an integrated solution
![Page 22: New Approaches to Real-Time Application Testing and Performance Monitoring: A Holiday Guide for the Retail Industry](https://reader035.vdocument.in/reader035/viewer/2022062614/546e9e6baf795971298b5723/html5/thumbnails/22.jpg)
Questions
Get your free copy SharePath RUM!
http://www.real-user-monitoring.com/
Contact SOASTA:www.soasta.com/cloudtest/[email protected] us:
twitter.com/cloudtest
facebook.com/cloudtest
Contact Correlsense:www.correlsense.com/[email protected] us:
twitter.com/correlsense
facebook.com/correlsense
Download CloudTest Lite - FREE!
www.soasta.com/cloudtest/lite/
GET STARTED TODAY!