remote research at ixd10
DESCRIPTION
My talk on Remote Research from the 2010 IxD10 conference in Savannah.TRANSCRIPT
REMOTE DESIGN!RESEARCHINTERACTION 10
I’M!NATE!BOLT
I’M!NATE!BOLTROBOTIC!DOG!TREATS
I’M!NATE!BOLTROBOTIC!DOG!TREATSDINOSAUR!EXPLAINS!IA
10 YEARS234 STUDIES2,815 PARTICIPANTS (MODERATED)89 ORGANIZATIONS19,120 HOURS
#ixd10 #Remote
#ixd10 #Remote7
SO!ANYWAY WHAT’s UP WITH YOU?
Have you conducted remote testing before? Biggest concern (about remote silly)?
THE!REMOTEDESIGN RESEARCH
SITUATION
DESIGN!RESEARCH
CONCEPT TESTING
PERSONA DEVELOPMENT
SURVEYS
ETHNOGRAPHY
NEEDS ASSESSMENT
IDEATION
GAME"BASED ELICITATION
Remote Research
Definition:
Research where the participant is not sharing physical space with the researcher.
In personRemote
% of qualitative research done remotely*
*Source: BP’s best guess
THE!WHOLEREMOTEPART!OF!THIS
When does remote win?
Native Environment
Cheap ethnography, not cheap lab.
Real Time
Allows self-motivated tasks.
I’ll trade you time for physical presence
Involved Observers
Easier to collaborate in real time.
Geography
When does remote fail?
Bandwidth
Yes, it’s an issue.
Translation
It’s expensive and difficult to do live.
Minors
Consent is a bear.Especially if they’re under 13.
Faces
Most users don’t have webcams.Webcams are a little invasive.
DesigningREMOTE!STUDIES
TIME-AWARE TasksTold to find purple pumps.
Doesn’t care.
Has to wear this for sister’s wedding this weekend.
Whole different interview.
Real Time OBservers
Portable Research
Change on the fly
“No one seems engaged in the laptop customizer”
“Let’s add questions about who they get recommendations from”
prototypes, wireframes, Sketches = heck yes
TOOLS
Usabilla
Clicks & QuestionsHeatmapsYou do your own recruiting$49 - $199
Loop11 (un-moderated)
PlainFrame SNEAK!PREVIEW
Communication
Reliable
Can be expensive for international
Conference calls needed for observers
The Past
phone
Cheap or free
Harder for users
Can combine with screensharing to stress user’s connection
The Future
Skype / VOIP
Screen-sharing
Adobe Connect
LiveLook
WebEx
GoToMeeting
StandaloneUserVue
Integrated
Adobe Acrobat Connect - $39/mo
Recording Tools
Phone Patch
Cables
HardwareCamtasia (Windows)
iShowU HD (Mac)
Software
RecruitingFOR!REMOTE
Recruiting Options
Grab someone in the hallway
Grab someone who isn’t directly involved in your project
IM your friends for a quick look
Panels and recruiting agencies
Real customers from marketing lists
Site intercepts
realness
Gold Standard
Live recruitingGet as close as you can
Recruiting Options
EthnioLinks or house ads to online formsRecruiting agenciesCustomer email listsPanelsCraigslist/online ads
use Ethnio when
Website accessSome budgetQuotas are relatively simple
use forms when
You can place a link but not codeLow budgetQuotas are relatively complexOptions:
Google Docs
Wufoo
use Agencies when
No website accessPeople whine about first-time visitorsHigher budgetOnline recruiting failed
Customer lists
Sub-segmentsOwnership requirementsNo website access
PANELS
Craigslist
When other methods don’t workNo doughTakes a whileEmbarrassing to admit to your friends
Live Recruiting Math
Target: 6 recruits/hourAllow for: 1% response (low average)
You Need: 8-10,000 uniques/day
Paying Incentives
Collect minimal personal infoDeliver quicklyAppropriate for location
HOW!TO!BEgraceful
When All Your
TECHNOLOGY
BREAKS
What they worry about
WHO!ARE!YOU!AND!CAN!I TRUST!YOU?
IF!YOU!CAN!SEE!MY!SCREEN,CAN!YOU!SEE!MY!FACE?
WILL!YOU!BE!ABLE!TO!TAKECONTROL!OF!MY!COMPUTER?
WILL!YOU!HELP!ME!GET!THE PLUG"IN
OFF!MY!COMPUTER!AT!THE!END?
WILL!THIS!WORK!IF!I!HAVE!AFIREWALL/PROXY/STRICT!IT
DEPARTMENT?
IS!THIS!GOING!TO!END!UP!ONYOUTUBE?
Advanced TechniquesHigh Emotions
OXYMORON?Remote empathy
hybrid studies
Numbers actually do lie sometimesAnd they don’t tell you the why3-5 remote interviews is all you need
mobile Research?
Advanced TechniquesOne to many moderation
Multi-threading
Burn the scriptFind out what matters.
The Future
remoteusability.com
@boltron