hekler sbm 2012_friday_symposium_final
DESCRIPTION
Symposium Eric Hekler gave at the annual Society of Behavioral Medicine conference in New Orleans. www.sbm.orgTRANSCRIPT
![Page 1: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/1.jpg)
HOW CAN WE USE TECHNOLOGY TO SPEED
THE PACE OF BEHAVIORAL RESEARCH?
Eric Hekler, PhDSchool of Nutrition and Health Promotion
Arizona State University
![Page 2: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/2.jpg)
Collaborators
Abby King
Frank Chen
Shauna Shapiro
Matthew Buman
Lauren Grieco
Sandi Winter
Jesse Cirimele
Tom Robinson
Banny Banerjee
![Page 3: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/3.jpg)
Outline
The Problem
Testing commercial apps
Commercial products as “Hacks”
Agile Science
![Page 4: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/4.jpg)
Outline
The Problem
Testing commercial apps
Commercial products as “Hacks”
Agile Science
![Page 5: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/5.jpg)
We want interventions that are: Evidence-based
Cost-effective
Tailored
Easy to disseminate
Promote maintenance
![Page 6: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/6.jpg)
2005 2006 2007 2008 2009 2010 2011 2012
500,000th AppAccepted on App Store
Conceive of a study
Gather Pilot Data
Submit Grant
Receive Funding
Conduct the study
Submit publications for review
![Page 7: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/7.jpg)
In less time than it takes to complete a standard R01, the app store has gone from nonexistent to over 500,000 apps.
![Page 8: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/8.jpg)
Academia Industry
Evidence-based
Promote maintenance
Tailored
Cost-effective
Easy to disseminate
Tailored?
Who’s doing which piece?
![Page 9: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/9.jpg)
What to do?
New methods for fast efficacy testing?
Partner w/ business and use their data?
Create new methods for development?
Other strategies?
![Page 10: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/10.jpg)
What to do?
New methods for fast efficacy testing?
Partner w/ business and use their data?
Create new methods for development?
Other strategies?
![Page 11: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/11.jpg)
Outline
The Problem
Testing commercial apps
Commercial products as “Hacks”
Agile Science
![Page 12: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/12.jpg)
Testing Commercial Apps (Examples)
Calorific Mindfulness Bell
![Page 13: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/13.jpg)
Calorific Test See full details at tonight’s
poster session (C-89).
Compared this app to custom apps we developed focused on PA (see other poster tonight; C-156).
8-week study with 36 participants (older adults, naïve to using smartphones)
![Page 14: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/14.jpg)
Calorific Results
Vegetables Fruits Processed Foods
Sweets Fatty Meats Fatty Dairy
-4
-3
-2
-1
0
1
2
3
4
5
6
Control
Intervention∆C
on
su
mp
tio
n s
erv
ing
s/w
k
![Page 15: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/15.jpg)
Mindfulness Bell Test RCT comparing
Mindfulness training (conducted by Shauna Shapiro) and Mindfulness Bell App
Assessment-only control
Population: College students
8-week study with approximately 20 per arm
![Page 16: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/16.jpg)
Mindfulness Bell Preliminary Results
No differences with any variable measured including:Mindfulness practicesStressSubjective HappinessSelf-compassionPhysical ActivityHealthful Eating
![Page 17: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/17.jpg)
Key findings from both Apps we tested did not indicate much utility (though,
definitely could be due to sample size)
Both apps changed repeatedly during the intervention trials 4 updates for Calorific 2 for Mindfulness Bell, one including name change; it used
to be called Zen Reminder
For both, we received very positive feedback that they “worked” (i.e., the feedback often reported in the app store ratings)
![Page 18: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/18.jpg)
Implications
Apps are often changing so quickly that they may easily change during your trial
Good reviews do not necessarily translate to behavior change
Regardless of outcomes, apps offer a very quick “hack” for testing behavioral ideas
![Page 19: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/19.jpg)
Outline
The Problem
Testing commercial apps
Commercial products as “Hacks”
Agile Science
![Page 20: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/20.jpg)
“Hacking” behavioral science
Quick tests of commercial appsAlready discussed
Designing Health Behavior Change Interventions Class
Data visualization “hack”
![Page 21: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/21.jpg)
Designing Health Behavior Change Interventions Grad level class evidence-informed interventions
theory, qualitative research methods; survey selection and development; experimental design, and prototyping (see McClain poster tonight on prototyping)
Key focus is on identifying assumption/hypotheses and then devising the most rapid way of testing that assumption via a prototype
Key preexisting technologies that foster “hacking” Gmail (Free SMS from a computer) Apps (e.g., Handcent SMS for automating text sends) Twitter/Facebook (easy for quick polls on ideas) Google Docs Bit.ly
See “hacks” at http://www.slideshare.net/DesigningHealth/
![Page 22: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/22.jpg)
The Stanford Healthy Neighborhood Discovery Tool
Harness technology to improve neighborhood designs for physical activity and healthful nutrition
Engage seniors as auditors and advocates
Crowd-sourcing
Buman, Winter, Sheats, Hekler, Otten, Grieco, & King, April 2012, Society of Behavioral Medicine
![Page 23: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/23.jpg)
Data visualizations for policymakers
How far out did they venture?
1.0 ± 0.6 km (.62 miles)
![Page 24: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/24.jpg)
Data visualizations for policymakers
![Page 25: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/25.jpg)
Outline
The Problem
Testing commercial apps
Commercial products as “Hacks”
Agile Science
![Page 26: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/26.jpg)
The Agile Manifesto (highlights)
Our highest priority is to satisfy the customer through early and continuous delivery of valuable software.
Welcome changing requirements, even late in development. Agile processes harness change for the customer's competitive advantage.
http://agilemanifesto.org/principles.html
![Page 27: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/27.jpg)
The Agile Manifesto (highlights)
Deliver working software frequently, from a couple of weeks to a couple of months, with a preference to the shorter timescale.
Business people and developers must work together daily throughout the project.
http://agilemanifesto.org/principles.html
![Page 28: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/28.jpg)
We want interventions that are: Evidence-based
Cost-effective
Tailored
Easy to disseminate
Promote maintenance
![Page 29: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/29.jpg)
Agile Science – beta Beyond efficacy and cost-effectiveness, time-effectiveness
also needs to play a central role methods decisions. Key Principles
Utilize the fastest methods for getting funding, particularly when piloting.○ Crowd-funding?
Utilize the most time-effective formative research methods○ User Experience Design? (McClain, Hekler, et al poster, C-087)
Create, test, and iterate w/ Minimal Viable Products○ “Hacks” (See Lean Startup book by Eric Reis)
Use a variety of dissemination channels○ CHI 2012 Conference; Blogs? Wikis?
Use business to disseminate evidence-based work
![Page 30: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/30.jpg)
We need to stop sacrificing good enough at the altar of perfection.
![Page 31: Hekler sbm 2012_friday_symposium_final](https://reader034.vdocument.in/reader034/viewer/2022051210/54c379144a7959d62b8b4791/html5/thumbnails/31.jpg)
Reactions? Let’s figure this out!
Eric Hekler
Designing Health Lab @ASU
Twitter: @ehekler