what retailers know about performance and user experience

24
1 © 2013 SOASTA CONFIDENTIAL - All rights reserved. Sharing the keys to retail performance success TODAY’S SOASTA PRESENTERS Peter Galvin : Brad Johnson : Mike Ostenberg SVP Marketing VP Product Marketing Dir. Systems Engineering Agenda: Retail case studies Key considerations gleaned from retail performance optimization SOASTA’s solutions for measuring and testing user performance Questions: Submit in chat box during event

Upload: soasta

Post on 19-May-2015

360 views

Category:

Technology


1 download

TRANSCRIPT

Page 1: What Retailers Know About Performance and User Experience

1 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

Sharing the keys to retail performance success TODAY’S SOASTA PRESENTERS

Peter Galvin: Brad Johnson: Mike Ostenberg SVP Marketing VP Product Marketing Dir. Systems Engineering

Agenda: •  Retail case studies •  Key considerations gleaned from retail performance optimization •  SOASTA’s solutions for measuring and testing user performance Questions: Submit in chat box during event

Page 2: What Retailers Know About Performance and User Experience

Poll Question

Page 3: What Retailers Know About Performance and User Experience

3 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

Page 4: What Retailers Know About Performance and User Experience

4 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

o  Inspection to Prevention

o  Approximation to Reality

o  Periodic to Continuous

Page 5: What Retailers Know About Performance and User Experience

5 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

Page 6: What Retailers Know About Performance and User Experience

6 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

Page 7: What Retailers Know About Performance and User Experience

7 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

Tested to 7x Initial load test goals

Reached 9x previous year’s peak Validated dynamic caching investment Reduced hardware capacity needs Validated Akamai to 4x beyond peak

“One of the best investments to our website this year .”

Nancy Jordan, IT Middleware

& Integration Manager

Page 8: What Retailers Know About Performance and User Experience

8 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

Page 9: What Retailers Know About Performance and User Experience

9 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

“We are 100% focused on our consumer

satisfaction…Given the revenue it’s protecting for

us, it’s money very well spent.”

Michael Hart, Bonobos CTO

Iterative testing of purchase cycle Easy test creation and results

Systematically tuned app to infrastructure Compares test/test, year/year Revenue Protection 64x normal traffic, 15X sales, no issues

Page 10: What Retailers Know About Performance and User Experience

10 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

Page 11: What Retailers Know About Performance and User Experience

11 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

Tests for flash sales with unknown spikes mPulse analyzes real user performance

Continuous tests of mobile and web traffic

50% mobile traffic – 160% more visitors $5M AUD in one flash sale – zero issues

“SOASTA was very easy to work with

and could accommodate our requirements in a

four-week timeframe.” Gavin Cliffe,

OZSale CTO.

Page 12: What Retailers Know About Performance and User Experience

12 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

Page 13: What Retailers Know About Performance and User Experience

13 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

“Website performance really affects your brand image

when you have problems…The inherent savings to our

brand by using CloudTest is priceless.”

—Cheryl Davis, digital technical

operations manager Hallmark Cards, Inc.

Tested to 120% of expected load

Saved 50% on testing expenses

Reduced staff costs by 66% Eliminated test software and hardware costs

Page 14: What Retailers Know About Performance and User Experience

14 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

2008 2013

Page 15: What Retailers Know About Performance and User Experience

15 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

Page 16: What Retailers Know About Performance and User Experience

16 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

Meaningful scale & appropriate concurrency

Most accurate models of real user behavior

Control to start, stop & modify tests without delays

Test on your schedule

Page 17: What Retailers Know About Performance and User Experience

17 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

Failover Scenarios

Success Disasters

End to End

Page 18: What Retailers Know About Performance and User Experience

18 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

Page 19: What Retailers Know About Performance and User Experience

19 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

Page 20: What Retailers Know About Performance and User Experience

20 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

s

Memory leaks

Test Scale

Sta

ge /

Team

Dev & Test

Release & Deploy

Network & Ops

CDN file placement

Load Balancer configuration

Network bandwidth

Network configuration

DNS routing

Inadequate server resources Default configuration settings

Unbalanced web servers Auto-scaling failures

Latency between systems

Slow third-party plug-ins

Garbage collection

Database thread counts

Inefficient database queries Slow pages

Conflict with other apps

Test Lab Staging Production (100% +++)

Search technology limits

Method-level tuning

Max sockets exceeded

Firewall max capacity

Global latency variance

Security bottlenecks

Continuous tuning for full-scale…and well beyond

Page 21: What Retailers Know About Performance and User Experience

21 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

ü Build and modify your tests based on real usage ü Test for spikes with the cloud ü Test what you don’t think you need to ü Measure, test and act in real time ü Test more (compress processes) ü Test in production

Page 22: What Retailers Know About Performance and User Experience

22 © 2013 SOASTA CONFIDENTIAL - All rights reserved.

Mike Ostenberg

Page 23: What Retailers Know About Performance and User Experience

Thanks

Contact SOASTA: www.soasta.com/cloudtest/

[email protected] 866.344.8766

Follow us:

twitter.com/cloudtest facebook.com/cloudtest

RESOURCES

Retail Readiness Page: http://www.soasta.com/retail-readiness/

Case studies: http://www.soasta.com/customers/ecommerce/

Webinars future and past: http://www.soasta.com/knowledge-center/webinars/

Need a test, fast? CloudTest On-Demand. - email [email protected]

- You’ll hear from us by tomorrow

Page 24: What Retailers Know About Performance and User Experience

www.SOASTA.com