using jira for test case management
TRANSCRIPT
September 25, 2015
Introduction to QASymphony for [INSERT
COMPANY NAME]
Using JIRA for Test Case Management
March 9, 2016
#JIRATesting @RyanYackAttack
• Audio for this webinar is delivered through your computer. Make sure your speakers are turned up or use a set of headphones.
• If your audio quality is choppy, it could be your internet connection.
• You can customize your webinar viewing experience by increasing, decreasing or minimizing the size of the widgets on your screen.
• If you have questions, enter them in the widget on the left.
HOW TO WATCH THIS WEBINAR
#JIRATesting @RyanYackAttackRobust testing platform purpose-built to help agile teams create
higher quality software
ABOUT QASYMPHONY
#JIRATesting @RyanYackAttack
Creating Visibility and Speed with Automation and Test ManagementThursday, March 24th at 2pm ET
Guest Speaker: Joe Colantonio• A test automation architect for a large
Fortune 100 company with more than 15 + years of test automation and performance testing experience.
• Founder of the popular test automation blog, joecolantonio.com and the host of TestTalks, a podcast dedicated to all things test automation related.
UPCOMING WEBINAR
#JIRATesting @RyanYackAttack
QUALITY JAM 2016 – APRIL 13TH IN ATLANTA
Learn more at qualityjam.com
Speakers Include:
• Scott Berkun, Best Selling Author
• Keith Klain, Software Testing Thought Leader
• Michael Cooper, Chief Quality Officer, Healthcare IT Leaders
• Ian Culling, CIO of VersionOne
#JIRATesting @RyanYackAttack
• Early bird pricing of $100. Pricing will go up to $200 on March 15st.
• For a limited time, you can get an additional $20 off using the promo code QASVIP when you check out.
• For the first 5 people who send an email to [email protected], you will get a complimentary pass to the event.
QUALITY JAM 2016
#JIRATesting @RyanYackAttack
• This webinar will be recorded and available on-demand tomorrow. You will get an email when it is available.
• Join the conversation on Twitter using the hashtag #JIRATesting.
• Use the Q&A widgets to ask questions during the webinar.
• At the end of the webinar, you will be asked to take a short survey.
HOUSEKEEPING
#JIRATesting @RyanYackAttack
Ryan YackelSenior Sales Engineer, QASymphony
• Serves as the “customer voice” for all QASymphony products.
• Comes to QASymphony from Macy’s, where he managed testing on large enterprise initiatives.
• Certified scrum master from Scrum Alliance and holds a Bachelor of Arts degree from Covenant College.
OUR PRESENTER
How JIRA is setup for testing
Pros and cons of customizing JIRA as a test case management solution
Pros and cons using add-ons with JIRA for test case management
Pros and cons of external integrations with JIRA for test case
management
How to get the best of both worlds using JIRA, plugins and integrations
WHY ARE WE HERE?
JIRA ADOPTION
10
The #1 software development tool used by agile teams
Agile Adoption Rate
September 25, 2015
Introduction to QASymphony for [INSERT
COMPANY NAME]
HOW JIRA IS SETUP FOR
TESTING
12
HOW JIRA IS SETUP FOR TESTING
Where is the Test Issue
Type?
13
DEFAULT PROJECT ISSUE TYPES
Basic software
development
Kanban
Scrum
MANUAL AND AUTOMATED TESTING
14
Manual Testing
(Acceptance, Integration, Functional,
Automated Testing
(Continuous Integration Server)
RegressionSession BasedReuse, Configurations
Other Automation FrameworksUsing Jenkins
September 25, 2015
Introduction to QASymphony for [INSERT
COMPANY NAME]
OPTION A: CUSTOMIZE JIRA ISSUES
16
CUSTOMIZE JIRA: SAMPLE WORKFLOW
Test Case
Test Run Affects Version
Actual Outcome
Result
Assignee
Parent Issue
Subtask
Only latest subtask status history
How are you going to reuse the subtask? How will we group these?
Where do we see the coverage report?
Test Run
Test Run
17
CUSTOMIZE JIRA: SAMPLE WORKFLOW
User Story
Test Case / Run Affects Version
Actual Outcome
Result
Assignee
Parent Issue
Subtask
Only latest subtask status history
What happens when the user story is moved to DONE?
How will I configure the test run?
CUSTOMIZING JIRA: PROS & CONS
18
Custom issue types such as test case
Workflow controls QA, devs and tester actions
Existing Reporting / Customisable
Uses an existing and known tool - JIRA Only
New Manual Execution
No testing-specific functionality
Only integrates with testing frameworks via CI server
Test Cycle, Suite execution
Test step Execution Status
Version control
Environment Configuration
Is JIRA built for testing or does this seem like we are forcing the issue? - No pun intended :-)
If workflows are created to getting issues DONE, what about regression testing and reuse?
What about Test Coverage reporting (Manual, Automated, Session Based)?
Obvious traceability limitations between issues and test case coverage
September 25, 2015
Introduction to QASymphony for [INSERT
COMPANY NAME]
OPTION B: INTEGRATIONS
OPTION B: INTEGRATIONS
20
Add-ons (Internal Integration)
Dedicated Test Case Management (External Integration)
OPTION B: ADD-ONS
21
OPTION B: ADD-ONS
22
Test Case Steps
Test Issue Type
OPTION B: ADD-ONS
23
Gherkin Style Test Scripting
Feature / Scenario
Issues
OPTION B: ADD-ONS
24
Test Grouping
Latest Execution
Result
25
Test Case
Version 1
Test Run Version 1
Test Case
TEST EXECUTION
Test Run Version 1
Test Run Version 1
JIRA Issue
Project Limited
Version Limited
JIRA Infrastructure
ADD-ONS: PROS & CONS
26
Zero or limited ability to reuse test cycles
No logical folder structures
Unknown change history for Test Case Versions and Limited visibility into Test Execution History
Test Case Duplication
No ability to share test case objects across JIRA projects
Look and feel similar to JIRA
Dashboards within JIRA
Atlassian Market $ Model
Adding Test Specific Functionality
Link test objects with other issues
Inherited limitations of JIRA infrastructure
What about sharing tests cases and steps within multiple projects?
Running same test, different variables
Think about how your teams are going to scale
OPTION B: EXTERNAL TEST CASE MANAGEMENT
27
28
OPTION B: EXTERNAL TEST CASE MANAGEMENT
Automated and Manual Execution
OPTION B: EXTERNAL TEST CASE MANAGEMENT
29
Enhanced Execution
Setup Test Run
Configuration
OPTION B: EXTERNAL TEST CASE MANAGEMENT
30
Test Run Log
Test Run
TEST EXECUTION
31
Test Case
Version 1
Version 2
Version 3
Project A
Project B
Project C
Results Assignee
ConfigConfig
Test Run
Test Log
Test Log
Test Run
Test Log
Test Log
Test Run
Test Log
Test Log
Results Assignee
ConfigConfig
Results Assignee
ConfigConfig
EXTERNAL TEST CASE MANAGEMENT: PROS AND CONS
32
Constant Database Synchronizations
Artifact Mapping - Permissions
Browser restrictions (ex Internet Explorer only)
Not fulling integrated with JIRA
Open Source Friendly Varies
Fully dedicated test case management
Enterprise Test Features - Configuration Manager - Automated Testing - CI Integrations (ect)
Customized Test Repositories
Easy Reuse and Object Sharing
Multiple Test Strategy Support
Enterprise features, without sacrificing real time integration
Does your team have a wide range of testing methodologies?
Does your test strategy warrant an enterprise test tool?
BEST OF BOTH WORLDS
33
BEST OF BOTH WORLDS
34
BEST OF BOTH WORLDS
35
CONCLUSION MATRIX
36
Very Smallto Small
Smallto Medium
Mediumto Large
Large to Enterprise
Manual TestingNo Regression
JIRA Only
BDDManual Testing
qTest, Zephyr for JIRA,
Manual, ExploratoryAutomationCI
qTest
qTest
Manual TestingSome Automation
Manual, ExploratoryAutomationCI
Spreadsheets
qTest ScenarioBehavepro, XRAY
Zephyr Enterprise
HPQC or Borland
Team Size Testing Types Tools
QUESTIONS?
37
Ryan Yackel
linkedin.com/in/ryanyackel
@ryanyackattack
Thank You