frets on fire usability testing
TRANSCRIPT
-
7/31/2019 Frets on Fire Usability Testing
1/11
Frets on FireUsability Test
PurposeThe purpose of this test is to determine if the novice computer user can effectivelymake use of Frets on Fire game. This test should also determine how perceptive and
easy to learn the interface of the game.
Test Objective1. Can a first time user of the Frets on Fire game application identify commands
and understand its interface?2. Can the first time user complete the two songs of different levels of difficulty?3. Is the game interesting for the participants whose skills are in the intermediate
level?
User Profile1. Male or female2. 15-25 years old
3. Knows how to play guitar (Intermediate level)4. No prior experienced in using Frets on Fire5. Should be able to read and understand English instructions
MethodologyThe test will be given to one subject at a time. The subject will be provided with aworkstation containing the Frets on Fire game application. A manual shall also beprovided; other than that no other materials and software is needed to complete thetest. The group has the following roles during the test process.
1 Test Monitor
1 Timer
2 Data Logger 1 Observer
Test Process1. Screening
Possible participants will be asked to fill out a form to determine if thequalification of the participant fits the user profile.
2. OrientationThe participant will be briefed using an orientation script describing thetest and the basic tools and features of the game application.
3. Gathering of background informationThe group will ask the subject to elaborate his answers in the screening
form when necessary.4. Testing and data collectionThe test subjects shall be given printout manuals detailing the stepsfrom opening the application until finishing each of the tasks. Byfollowing the direction indicated in the manual, the participants shall beable to finish two songs of different levels of difficulty.
5. Post Testing
-
7/31/2019 Frets on Fire Usability Testing
2/11
The participant shall answer a post-test questionnaire to gatherqualitative data regarding his/her experience in playing Frets on Firegame application.
6. DebriefingTo note down the participants experience, suggestions,
recommendations, and to elaborate on his answers base on the post-test.
Reporting of resultsTheir score will be summarized, analyzed, and reported. From the qualitative andquantitative data gathered, analysis, recommendations, and suggestions forimprovement will be made based on the results of the test.
-
7/31/2019 Frets on Fire Usability Testing
3/11
Frets on FireScreening Questionnaire
Name:
Age:
Gender:
Email Address:
Do you play guitar? (Check one)
() Yes() No
Rate yourself
() Beginner() Intermediate() Advance
Highest Educational Attainment
( ) Grade School( ) High School( ) College( ) Graduate Degree
Please check which game applications you have used:
( ) Guitar Hero( ) JamLegend( ) Super Crazy Guitar Maniac
List other computer game applications you use:
____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
Have you ever used Frets on Fire before? ______
Hobbies:
-
7/31/2019 Frets on Fire Usability Testing
4/11
____________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________________
Frets on FireOrientation
Hello! My name is _________________________ and these are my teammates,________________________.
We have asked you to participate in this test to help us evaluate the effectivenessand efficiency of Frets on Fire game application to novice computer user such asyourself. Frets on Fire, abbreviated FoF is a free, open source music video game. Theplayers use the keyboard to play along with markers which appear on screen, with
the aim to score points, achieve a high point multiplier and complete a song. Thesetasks involve step-by-step instructions on how to play Frets and Fire. Knowing thatyou have no experience in using this application, wed like you to try it out and learnthe basic tools through the help of a manual we will provide. You have your ownworkstation with the Frets on Fire game application installed in it.
We have to observe you as you follow the instructions on the manual and how you goabout in the game to complete them. Feel free to express your frustrations andreactions in any way possible as long as you do not destroy the test materials. Fromtime to time, please tell us which part and what instructions are you following. Forhelp or clarification, just raise your hand and I or the test monitor assigned shallapproach you.
-
7/31/2019 Frets on Fire Usability Testing
5/11
Ill give a brief explanation on the Frets on Fire environment. This is the Frets on Fireenvironment. First you will see a menu of options of whether youd like to start thegame or take the tutorial first.When you choose to play the game, you get to choose what fret board image youlike. After choosing the image, a list of songs will appear but we will just let youchoose a particular song with the corresponding guitar mode and level of difficulty.
-
7/31/2019 Frets on Fire Usability Testing
6/11
The first song would be on a medium mode. In playing the game in this level, use thekeys F1 for the first string, F2 for the second, F3 for the third and F4 for the fourthstring. When keying-in the keys for the strings, the ENTER key must be pressedsimultaneously. After the first song, another song of a hard level of difficulty will beplayed, there would be five strings to manipulate and the key F5 will be the key forthe fifth string.
Do you have any questions at this point?
A more detailed explanation is shown on the manual that we will provide. Please feelfree to ask questions concerning the Frets on Fire game application.
If you dont have any questions, let me first ask some questions before we proceed.
-
7/31/2019 Frets on Fire Usability Testing
7/11
Frets on FireBackground Information Questionnaire
Test Subject No.: _____ Test Subject Name:______________________________________
How long have you started playing guitar? What motivated you to learn play theguitar?
What do you think is your level of expertise? How often do you play the guitar?
Have you played any guitar game application before? If yes, what are those games?
Have you ever observed other people playing Frets on Fire before? Do you find itinteresting?
-
7/31/2019 Frets on Fire Usability Testing
8/11
Frets on Fire
Test Document
1. Open the FRETS ON FIRE game application.
2. Select PLAY GAME from the options.
3. Choose a fret board image from the choices. And start the game.
4. Choose SWEET CHILD OF MINE from the list of songs. Next, select GUITAR
mode from the options given. Then, choose the MEDIUM level of difficulty
which manipulates four strings.
5. Start to play the game.
6. After completing the first song, click the Enter tab to proceed to the next page
where you have to enter your name for the game to record your score.
7. Click QUIT TO MAIN MENU option.
8. Choose the second song, CANON ROCKfrom the song list which is already in
a hard level of difficulty.
9. Start to play the game.
10.After completing the second song, click the Enter tab to proceed to the next
page where you have to enter your name for the game to record your score.
11.Click QUIT TO MAIN MENU to leave the current page.
12.In the main menu, CLICK QUIT to close the Frets on Fire game application.
-
7/31/2019 Frets on Fire Usability Testing
9/11
Frets on FirePost-test
I found the layout/interface of the gameClear Strongly
AgreeAgree Neutral Disagree Strongly
Disagree
Organize StronglyAgree
Agree Neutral Disagree StronglyDisagree
Understandable
StronglyAgree
Agree Neutral Disagree StronglyDisagree
Easy StronglyAgree
Agree Neutral Disagree StronglyDisagree
I found the control keys and buttonsClear Strongly
AgreeAgree Neutral Disagree Strongly
Disagree
Organize StronglyAgree Agree Neutral Disagree StronglyDisagreeUnderstanda
bleStrongly
AgreeAgree Neutral Disagree Strongly
DisagreeEasy Strongly
AgreeAgree Neutral Disagree Strongly
Disagree
I found the navigation of the softwareClear Strongly
AgreeAgree Neutral Disagree Strongly
DisagreeOrganize Strongly
Agree
Agree Neutral Disagree Strongly
DisagreeUnderstanda
bleStrongly
AgreeAgree Neutral Disagree Strongly
DisagreeEasy Strongly
AgreeAgree Neutral Disagree Strongly
Disagree
I found the manualClear Strongly
AgreeAgree Neutral Disagree Strongly
DisagreeOrganize Strongly
AgreeAgree Neutral Disagree Strongly
Disagree
Understandable
StronglyAgree
Agree Neutral Disagree StronglyDisagree
Easy StronglyAgree
Agree Neutral Disagree StronglyDisagree
-
7/31/2019 Frets on Fire Usability Testing
10/11
I found the Visual Effects and Graphics to beClear Strongly
AgreeAgree Neutral Disagree Strongly
DisagreeOrganize Strongly
AgreeAgree Neutral Disagree Strongly
DisagreeUnderstanda
bleStrongly
AgreeAgree Neutral Disagree Strongly
DisagreeEasy Strongly
AgreeAgree Neutral Disagree Strongly
Disagree
I found the Audio EffectsClear Strongly
AgreeAgree Neutral Disagree Strongly
DisagreeOrganize Strongly
AgreeAgree Neutral Disagree Strongly
DisagreeUnderstanda
ble
Strongly
Agree
Agree Neutral Disagree Strongly
DisagreeEasy StronglyAgree
Agree Neutral Disagree StronglyDisagree
Overall, I found the game to beClear Strongly
AgreeAgree Neutral Disagree Strongly
DisagreeOrganize Strongly
AgreeAgree Neutral Disagree Strongly
DisagreeUnderstanda
bleStrongly
AgreeAgree Neutral Disagree Strongly
Disagree
Easy StronglyAgree
Agree Neutral Disagree StronglyDisagree
-
7/31/2019 Frets on Fire Usability Testing
11/11
Frets on FireDebriefing Questions
Test Subject No.: _____ Test Subject Name:______________________________________
How did you find the instructions?
How did you find the tasks?
What do you think of the game?
Do you think a first time user of Frets on Fire can easily understand the game?
As a whole, did you find it difficult to play?
Are you willing to play the game again?