the survey

38
The survey Broad-based information on a population

Upload: clare

Post on 22-Feb-2016

23 views

Category:

Documents


0 download

DESCRIPTION

The survey. Broad-based information on a population. “Getting the lay of the land”. Surveys. A social science survey is a research method where a number of people answer a fixed set of questions concerning their knowledge, attitudes and behaviors - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: The survey

The survey

Broad-based information on a population

Page 2: The survey

“Getting the lay of the land”

Page 3: The survey

Surveys

• A social science survey is a research method where a number of people answer a fixed set of questions concerning their knowledge, attitudes and behaviors

• The people are usually chosen carefully to represent a larger population

• Question topics and wording are crucial to the success of the method

Page 4: The survey

Uses of surveys

• Surveys are mainly used to:• Gain an understanding of the characteristics of

populations • Public opinion• Media use• Population demographics, etc.

• Develop and test theories concerning relationships among variables in large populations

Page 5: The survey

Self-report measures

• Depending on respondents to provide information about themselves has strengths and weaknesses as a data-gathering method

• Respondents may be the only source for much of the information you want to know• Knowledge, experiences, etc.

• A number of biases occur in people’s provision of information about themselves

Page 6: The survey

Census v. sample survey

• When you conduct a census you measure every member of a population

• When you conduct a sample survey you measure a subset of the population• Sample surveys are used to estimate what a

census would have found

Page 7: The survey

Census

• U.S. census• Course evaluations

• US News survey of US colleges

Page 8: The survey

The sample survey• Most telecommunications surveys are

sample surveys because populations researchers study are usually very large • a census would be very expensive and

inefficient

Page 9: The survey

Polls

• Polls usually are short surveys looking to determine public opinion on a topic of current interest• Usually are not used to develop more advanced

theory• Often look to identify opinions of subgroups

(demographic clusters)

Page 11: The survey

• Pew Research Center surveys

Page 12: The survey

Survey validity

Page 13: The survey

How do you collect the data?

• Personal interviews• Phone interviews• Mail interviews• Computer-mediated interviews

Page 14: The survey

Why choose one over the other?

• Cost• Response rate• Respondent need for guidance• Anonymity/confidentiality• Speed• Control over data collection

Page 15: The survey

Personal interviews

Page 16: The survey

Personal interviews• An interviewer asks the respondent a

number of questions face-to-face

Page 17: The survey

Source: www.lynnefeatherstone.org/gallery.htm

Page 18: The survey

Advantages of the personal interview

• Interviewer can monitor respondent’s answers • Interviewer can react to nonverbal cues• Survey can include visual stimuli

• Movie posters, videos, etc. • Interviewer can probe for deeper answers• Response rates are high

Page 19: The survey

• High level of control over the interview situation• Respondent identity• Interviewer can prevent input from other people in

household, noise and other distractions• May be the only way to reach certain

populations• Homeless• LGBT• Undocumented aliens

Page 20: The survey

Disadvantages of personal interviews

• Expensive• Slow• Supervision of interviewing staff is difficult• Significant potential for interviewer bias

Page 21: The survey

Telephone interviews• An interviewer asks questions of the

respondent over the phone• Very common method

• Computer-automated dialing• Computer-aided interviewing

• Large facilities with multiple interviewing stations

Page 22: The survey
Page 23: The survey

Advantages of telephone interviewing

• Moderate cost• Can be carried out quickly• Supervising interviewers is relatively easy• Interviewers can help respondents with their

questions and concerns• High response rate

• Callbacks are relatively easy• Personal touch (human voice)

Page 24: The survey

Disadvantages of telephone interviews

• Less control over the interview situation• Cannot use visuals• No face contact• Respondents get bored quickly

• Probes, depth limited

Page 25: The survey

Disadvantages of phone interviews

• Response rate is lower than with personal interviews• Unlisted numbers• Wrong numbers (turnover is rapid)

• Class attempt to use UK phonebook was a disaster• Cell phones• Refusals• Not-at-homes (answering machines)

Page 26: The survey

Questionnaires v. interviews

• Questionnaires are presented to the respondents, who fill them out themselves• Distribution can happen in a wide variety of

ways• Product warranties• Restaurants• Doctors’ offices• Magazines• Blogs

Page 27: The survey
Page 28: The survey

Mail-distributed questionnaires

• A questionnaire is sent through the mail, self-administered

• Used for radio/tv diaries, disks with ads on them, product warranty cards, political polls by representatives

Page 29: The survey

Advantages of mail questionnaires• Low cost• Wide sample possible• No field staff to manage• Confidentiality• No interviewer bias• Respondent is not rushed, can answer

questions at her leisure • Can include limited graphics

Page 30: The survey

Disadvantages of mail questionnaires• Low response rates• May be biased in favor of those interested in

topic• Respondents must interpret questions without

help available• Complicated questions cannot be asked (nor

can extensive probes be used)• No ability to be certain the respondent is who

he says he is

Page 31: The survey

Disadvantages of mail questionnaires

• Respondents must be literate in the language on the survey • U.S. has a high adult illiteracy rate• English may not be the respondent’s first

language• Slow response

• May take weeks or even months

Page 32: The survey

Nielsen’s diary

• http://diary.tvratings.com/

Page 33: The survey

Other distribution systems for paper questionnaires

• Handed out at worksites, doctor’s offices, etc.

• Group administration• Targeted audiences (not random)• Efficient• High response rate

Page 34: The survey

Internet-based questionnaire distribution

• The survey is distributed in computer file form, either to list of people via e-mail or administered to those who visit a website

• Popularity rapidly rising• May be too popular—people are simply ignoring

Page 35: The survey

Advantages of Internet-distributed questionnaires

• Very inexpensive• Data can automatically be included into the

database without inputting• Skip patterns can be programmed in• Data can be collected quickly• Audiovisual materials can accompany the

questionnaire

Page 36: The survey

Disadvantages of computer-mediated questionnaires

• Sample bias• Many people have limited Internet access

• Upscale homes, workplaces• Internet access is not the same as use

• Little help is available for respondent• Little control

• (skipped questions, ‘help’ from others during response, etc.)

Page 37: The survey

Disadvantages of computer-mediated questionnaires

• Respondent self-selection • Low response rate• Multiple response

• Groups may want to influence survey outcome, though this is relatively rare

Page 38: The survey

Personal Telephone Mail Computer

Cost

Response rate

Control

Flexibility

Speed

Help

Confidentiality

Rapport

Sample bias