qa in sakai - a practical guide to getting involved
DESCRIPTION
Come learn how to become involved in Sakai's Quality Assurance initiatives. This session will detail the different aspects of involvement, explain how to get involved, and provide a practical overview and best practices of important community tools like JIRA. Lastly, participants will leave equipped with a strong argument for participation in this important initiative.TRANSCRIPT
QA in Sakai A Practical Guide to Getting Involved
Alan Berg – QA Director, SakaiMegan May – QA Lead & Project Coordinator, IU
Agenda
11th Sakai Conference - June 15-17, 2010
• What is QA?• The QA WG & QA Network• The basics of the current lifecycle• Resources
• Jira, Confluence, Distribution lists• Hudson, Automation
• How to get involved?• Hear from someone involved• Automation, peer code review• Problem owner (Example Internationalization)
• Making the Argument back home• Questions?
“What is Quality Assurance?”
“Those who don't know the [past] are destined to repeat it.”
Edmund Burke
The QA WG
11th Sakai Conference - June 15-17, 2010
QA WG
11th Sakai Conference - June 15-17, 2010
• History of QA in Sakai
• Who
• QA Network
The basics of the current lifecycle
11th Sakai Conference - June 15-17, 2010
The basics of the lifecycle
11th Sakai Conference - June 15-17, 2010
WORK IN PROGRESSYOUR VIEWS COUNT
We’re Walking about at the Conference
SAY THINGS ON LIST
We are a DO-OCRACRY looking for activeMembers.
The basics of the lifecycle
11th Sakai Conference - June 15-17, 2010
2.7 as an example• Boundaries (In theory]
o Alpha Beta -- Functional freeze – Differences in product documented
o Beta Release Candidate – No Known blockerso Release Candidate Production – All Jira’s in
known state• Tags every two weeks
o QA server’s for biodiversity• Release Management once a week
o What is playing out in the fieldo Where are our priorities.o Interaction with other WG’s (Internationalization, MT]
The basics of the lifecycle
11th Sakai Conference - June 15-17, 2010
2.7 as an example – More• Cross cutting concerns
o Static code sweepo Security sweepo Internationalization sweep – David R.Mo Jira sweepo Need QA leads – We need talented doer’s
• New infrastructureo Hudson CI + Blame mechanism (more soon)
• Maintenance Team is born
Resources
11th Sakai Conference - June 15-17, 2010
Be informed!
11th Sakai Conference - June 15-17, 2010
• Important Distribution Lists http://collab.sakaiproject.org/mailman/listinfo
• QA WG• Management
• Help Documentation• Confluence
• QA WG Space: http://confluence.sakaiproject.org//x/RYApAQ• Release Management Space: http://confluence.sakaiproject.org//x/IQAiAQ • Individual Project Spaces
Confluence
11th Sakai Conference - June 15-17, 2010
http://confluence.sakaiproject.org
JIRA
11th Sakai Conference - June 15-17, 2010
http://jira.sakaiproject.org/secure/Dashboard.jspa
Resources
11th Sakai Conference - June 15-17, 2010
• Hudson (sakaiproject.org:8080) Show around if Internet connection
• Continuous Build Server• Blame mechanism• Includes Indie projects – Busy part of the infrastructure• Expect much more [TIME ALLOWING]
-Looking at integration tests and automated functional testing o Sakai 3 – Stuart Freeman leading the charge, people like Carl
Hall and the Cambridge UI teamo JavaScript Unit Testso Ruby Integration testso Good old hand testingo Automated Functional testing – Corey from rSmarto Jmeter tests
How to get involved
11th Sakai Conference - June 15-17, 2010
Personal Experience
11th Sakai Conference - June 15-17, 2010
Only certainties in life: Death, taxes and bugs in code!
How to Get Involved
11th Sakai Conference - June 15-17, 2010
• Code Review [catch things early]o Whats new via static code review – Keep an eye on defects
moving into trunko New patches – Need to look at Jira best practices.o MT working efficiently and need supporto Review around code that breaks trunk - Blame mechanism
• Automation [If only I had time]o GUI side Sakai 3 is difficult to defend – Brainstorming
welcomed – this might save embarrassment latero Jira Reports / Jira pluginso Help with pushing from Hudson testso Fitnes – Looking at writing and running automated Functional
tests via a WIKIo YOUR OWN IDEA’s HERE
How to Get Involved
11th Sakai Conference - June 15-17, 2010
• Can have more than one hat per QA expert• Problem owners – Will be difficult to find
o Expert in field, Has driveo Links to associate WG (if it exists) – But who guards
the guardo Evangelist as well as consistent coordinator of
testing • David Ronald – Internationalization• Stuart Freeman – Nucleation point for central
QA testing for Sakai 3
How to Get Involved
11th Sakai Conference - June 15-17, 2010
• Code boundaries act as entropy• Cross cutting concerns
o Micro defects – Static code reviewo Security, GUI, Internationalization, SQL
conversion scripts, Performance and so ono Uneven code quality – Code reviewo Bridge to Product councilo Jira best practice and reporting
Selling to the suits
11th Sakai Conference - June 15-17, 2010
• Low barrier entry point to community
• Opportunity to become SME from technical and functional view point
• What happens in the community has a direct local impact
• Costs
Q/A and not QA
11th Sakai Conference - June 15-17, 2010