integrating beta community testing into development using gamification (eurostar 2015)
TRANSCRIPT
Introduction -‐ Train
• Cross-‐platform (Browser, Mobile) MMO, RPG• 150+ million registered players• 350+ employees from 30 nations• F2P Publisher, Developer
Introduction -‐ Conductor
• Since 2011 working for InnoGames• Currently Senior QA Technical Tester• Projects: Tribal Wars, Forge of Empires
Introduction -‐ Passenger
• Care for the customers and quality of the product
• The less bugs the less complaints
Introduction -‐ Passenger
• Dedicated and motivated players• Like to play with a minimum of
nuisance• Interested in new content before it
goes live
First Stop -‐ Gamification
Gamification is the use of game thinking and game mechanics in none-‐game contexts to
engage users in solving problems and increase users’ self contributions.
First Stop -‐ Team
• Strengthening the Beta team• Experienced players with game knowledge• Prior testing knowledge
• Direct communication channels• Faster reaction and feedback cycle
Construction Zone -‐ Mission Goal
• Activation and increasing the beta testing activities • Increase issue spotting rates for features with random content • Gauge reactions and reception of a slightly more regulated
feedback approach
Construction Zone -‐ Missions
Rules• Template usage• No duplicates• No comments, discussions, etc.• Not “by design”
Construction Zone -‐ Missions
• Short descriptions• TemplateTasks
• Questions• ProblemsTesting
• Error reporting• Test reportReport
Construction Zone -‐ Mission Result
• Reduction of defect reporting after release by 25%
• Bug reports of higher quality by beta testers
• Increased beta testing activities
Construction Zone -‐ Experience
• Better planning certainty in bigger teams• Steady testing activities through regular feature
updates• High fluctuation among beta testers