research on research by michael mccrary, federated sample
DESCRIPTION
Michael McCrary of Federated Sample highlights the value of sample diversity, sharing the results of an internal study which compared various sample sources with different reward structures. New survey routing technology makes it increasingly easy to include multiple sample sources to increase the representativeness of surveys.TRANSCRIPT
Sample Source Diversity
Research On ResearchAll well-known sample sources sources apply
di�erent incentive & management practices.
Each was blinded in this presentation.
In January 2012, Federated Sample undertook research on research.
The purpose was to understand sample source diversity in six sample sources: Cash Only, Points for Cash, Rewards Program, Samplicious, Social Media, and Sweeps & Cash. Over thirteen-hundred people participated in a 12-minute survey. Here are the results.
Our SampleResearch On Research
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Gender Income Distribution $
EmploymentRelationship StatusChildren
Age Distribution
0 20 40 60 80 100
Male Female
0 20 40 60 80 100
Yes No
0 20 40 60 80 100
50-74k +100k
Prefer notto answer
30-49k<30k
0 20 40 60 80 100
<18 18-34 35-54 55+
0 20 40 60 80 100 0 20 40 60 80 100
Single Full Time
SE Full Time
SE Part Time
Part Time
Active Military
Inactive Mil/VetStudent
Disabled
Prefer not to answer
Temp Unem
Retired
Married
Widowed
Divorced
Separated
Prefer not to answer
75-100k
FT Home Maker
Phone OwnershipResearch On Research
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Home Phone
0 10 20 30 40 50 60 70 80
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Smart Phone
Cell Phone
Home Media ConsumptionResearch On Research
0 10 20 30 40 50 60 70 80 90
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Standard DVD
0 10 20 30 40
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
0 10 20 30 40
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Blu-Ray DVD
Netflix/Hulu
Game Console OwnershipResearch On Research
0 5 10 15 20 25 30 35 40
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Xbox360
0 5 10 15 20 25 30
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
0 5 10 15 20 25 30 35 40 45
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Wii
PS3
Video Game AvidityResearch On Research
0 10 20 30 40 50 60 70 80
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Weekly
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
0 1 2 3 4 5 6 7 8 9 10
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Monthly
Once/Monthor less
Go to Movies in TheaterResearch On Research
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Weekly
0 10 20 30 40 50 60
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Monthly
Once/Monthor less
Dine out at RestaurantResearch On Research
0 10 20 30 40 50 60
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Weekly
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Monthly
Once/Monthor less
Go Shopping in StoresResearch On Research
0 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40 42 44 46
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Weekly
0 5 10 15 20 25 30 35 40 45
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
0 2 4 6 8 10 12 14 16 18 20 22 24 26 28 30
Cash Only
Points for Cash
Rewards Program
Samplicious
Social Media
Sweeps & Cash
Monthly
Once/Monthor less
Our conclusions.
There is no good or bad sample source. Di�erent sources clearly attract di�erent types of survey takers. Using one source type introduces biases to survey results. Inclusion of multiple sources enriches the breadth of results. Diversity is good and should be embraced in sampling.