2013 - svcc - intuit continuous performance testing

19
people Intuit Continuous Performance Testing Thiru – Principal Engineer Ramki – Staff Engineer in Quality

Upload: thirugnanam-subbiah

Post on 27-Jan-2015

112 views

Category:

Technology


6 download

DESCRIPTION

 

TRANSCRIPT

Page 1: 2013 - SVCC - Intuit continuous performance testing

people

Intuit Continuous Performance Testing

Thiru – Principal EngineerRamki – Staff Engineer in Quality

Page 2: 2013 - SVCC - Intuit continuous performance testing

•Takeaway•Context & overview•Solution details•Samples•Q & A

Agenda

Page 3: 2013 - SVCC - Intuit continuous performance testing

Takeaway

•Performance Testing Landscape•Building blocks•Achieve automation•Available tools•Benefits of automation

Page 4: 2013 - SVCC - Intuit continuous performance testing

Overview

Page 5: 2013 - SVCC - Intuit continuous performance testing
Page 6: 2013 - SVCC - Intuit continuous performance testing

Build

• What: – Code to artifact

• Challenges:– Wait time– Failures

• Technology:

Page 7: 2013 - SVCC - Intuit continuous performance testing

Deploy

• What: – Artifacts to system

under test– Setup

• Challenges:– Multiple subsystems– Configuration change

• Technology:

Page 8: 2013 - SVCC - Intuit continuous performance testing

Test

• What: – Simulate load and

observe system under test

• Challenges:– Too many systems and

parameters to watch for– Babysitting to detect

failures– Decide test

• Technology:

Page 9: 2013 - SVCC - Intuit continuous performance testing

Metrics collection and Monitoring

• What: – CPU, load average, JVM

heap, Memory, swap, disk IO, network IO, sockets, DB connections etc

• Challenges:– Too many systems and

parameters to watch for– Babysitting to detect

failures– Decide test

• Technology:–Twiddle –Oracle AWR (automatic workload repo)

Page 10: 2013 - SVCC - Intuit continuous performance testing

Analyze

• What: – Gather measurements

and extract meaning information

• Challenges:– Too many systems and

parameters– Consolidation– Volume

• Technology:

Page 11: 2013 - SVCC - Intuit continuous performance testing

Report

• What: – Meaning information

to easy to digest form

• Challenges:– Make reports

available– Communication out– Format/Layout– Consolidated graphs– Volume

• Technology:

Page 12: 2013 - SVCC - Intuit continuous performance testing

Solution

Page 13: 2013 - SVCC - Intuit continuous performance testing

CPU graph

Tool: gnuplot (open source)

Page 14: 2013 - SVCC - Intuit continuous performance testing

14

Page 15: 2013 - SVCC - Intuit continuous performance testing

Challenges

Page 16: 2013 - SVCC - Intuit continuous performance testing

Challenges

• Collecting system resources usage

• Grouping of system resource graphs for all servers

• Multiple subsystems/technologies

Page 17: 2013 - SVCC - Intuit continuous performance testing

Benefits

• Quick Turnaround• Reduce resource cost• Effectively using hardware• No human errors• Accurate • Multiple iterations on demand• History and trend

Page 18: 2013 - SVCC - Intuit continuous performance testing

Q & A

Want to talk more?We’ll be at the Intuit booth today 11:30am-3:30pm.

[email protected][email protected]

Page 19: 2013 - SVCC - Intuit continuous performance testing

Intuit Speakers @ Silicon Code Camp 2013:SATURDAY9:45 a.m. - Ramakrishna Kollipara – “Complete Automation of Performance Testing” 1:45 p.m. - Joe Wells - “QBO: Journey From legacy Java app to a Client-side HTML5 app”3:30 p.m. - Naga Addagadde & Sangeeta Narang – “Intuit APIs for Financial Transaction Aggregation”5:00 p.m. Ted Drake –“Hitting the Accessibility High Notes with ARIA”

SUNDAY9:15 a.m. - Eugene Krivopaltsev –“Building Native Mobile Apps with Custom Views” 1:15 p.m. - Tim Hobson – “Developing Highly Instrumental Applications with Minimal Effort”

You don't want to miss out on a chance to win this cool headset. Stop by our booth to enter!

For more information about joining our organization visit our booth or connect with our onsite recruiter:

[email protected]