14-1 chapter 14 questionnairesandinstruments. 14-2 learning objectives understand the link forged...
TRANSCRIPT
14-1
Chapter 14Chapter 14
QuestionnairesQuestionnaires
andand
InstrumentsInstruments
14-2
Learning Objectives
• Understand the link forged between the management dilemma and the communication instrument by the management-research question hierarchy
• Understand the influence of the communication method on instrument design
• Understand the three general classes of information and what each contributes to the instrument
14-3
Learning Objectives
• Understand the influence of question content, question wording, response strategy, and preliminary analysis planning on question construction
• Understand each of the numerous question design issues influencing instrument quality, reliability, and validity
• Understand the sources for measurement questions • Understand the importance of pretesting questions
and instruments
14-4
Exhibit 14-1 Overall Flowchart for Instrument Design
14-5
Exhibit 14-2 Phase 1
14-6
Strategic Concerns in Instrument Design
What type of scale is needed?
What communication approach will be used?
Should the questions be structured?
Should the questioning be disguised?
14-7
Technology Affects Questionnaire Development
• Write questionnaires more quickly
• Create visually driven instruments
• Eliminate manual data entry
• Save time in data analysis
WebSurveyor used to write an instrument.
14-8
Structured Unstructured
Undisguised
Disguised
Example:
Typical descriptive surveywith straight-forward, structured questions
Example:
Survey with open-endedquestions to discover “new”answers or focus group interview
Example:
Survey interview to measurebrand A’s image versuscompetitive brands’ images or brand recall (unaided recall)
Example:
Projection techniques usedmostly for exploratory research
Classifying Surveys by Degree of Structure and Degree of Disguise
14-9
Exhibit 14-3 Dummy Table for American Eating Habits
Age
Use of Convenience Foods
__________________________________________________
Always UseUse
FrequentlyUse
Sometimes Rarely Use Never Use
18-24
25-34
35-44
55-64
65+
14-10
Exhibit 14-4 Phase 2
14-11
Question Categories and Structure
Administrative
Classification
Target
14-12
Question Content
Should this question be asked?
Is the question of proper scope and coverage?
Can the participant adequately answer this question as asked?
Will the participant willingly answer this question as asked?
14-13
Question Wording
CriteriaCriteria
Shared vocabulary Single
meaning
Misleading assumptions
Adequate alternatives
Personalized
Biased
14-14
Response Strategy
Factors Factors
Objectives of the study
Participant’s level of
information
Degree to which participants have
thought through topic
Ease and clarity with which participant communicates
Participant’s motivation to
share
14-15
Free-Response Strategy
What factors influenced your enrollment in Metro U?________________________________________________________________________________________
14-16
Dichotomous Response Strategy
Did you attend the A Day at College program at Metro U?
YesNo
14-17
Multiple Choice Response Strategy
Which one of the following factors was most influentialin your decision to attend Metro U?
Good academic standingSpecific program of study desiredEnjoyable campus lifeMany friends from homeHigh quality of faculty
14-18
Checklist Response Strategy
Which of the following factors influencedyour decision to enroll in Metro U? Check all that apply.
Tuition costSpecific program of study desiredParents’ preferencesOpinion of brother or sisterMany friends from home attendHigh quality of faculty
14-19
Rating Response Strategy
Strongly influential
Somewhat influential
Not at all
influential
Good academic reputation
Enjoyable campus life
Many friends
High quality faculty
Semester calendar
14-20
Ranking
Please rank-order your top three factorsFrom the following list based on their Influence in encouraging you to apply to Metro U.Use 1 to indicate the most encouraging factor,2 the next most encouraging factor, etc.
_____ Opportunity to play collegiate sports_____ Closeness to home_____ Enjoyable campus life_____ Good academic reputation_____ High quality of faculty
14-21
Exhibit 14-7 Characteristics of Response Strategies
Characteristic DichotomousMultipleChoice Checklist Rating
RankOrdering
FreeResponse
Type of Scale Nominal Nominal, ordinal, or ratio
Nominal Ordinal or interval
Ordinal Nominal or ratio
Usual Number of Answer Alternatives Provided
2 3 to 10 10 or fewer 3 to 7 10 or fewer None
Desired Number of Participant Answers
1 1 10 or fewer 1 per item 7 or fewer 1
Used to Provide...
Classification Classification, order, or specific numerical estimate
Classification Order or distance
Order Classification(of idea), order, or specific numerical estimate
14-22
Exhibit 14-6 Internet Survey Response Options
14-23
Exhibit 14-6 continued
14-24
Exhibit 14-6 continued
14-25
1a. How many years have you been playing tennis on a regular basis? Number of years: __________
b. What is your level of play?
Novice . . . . . . . . . . . . . . . -1 Advanced . . . . . . . -4Lower Intermediate . . . . . -2 Expert . . . . . . . . . -5Upper Intermediate . . . . . -3 Teaching Pro . . . . -6
c. In the last 12 months, has your level of play improved, remained the same or decreased?
Improved. . . . . . . . . . . . . . -1 Decreased. . . . . . . -3Remained the same . . . . . -2
2a. Do you belong to a club with tennis facilities? Yes . . . . . . . -1No . . . . . . . -2
b. How many people in your household - including yourself - play tennis?Number who play tennis ___________
3a. Why do you play tennis? (Please “X” all that apply.)
To have fun . . . . . . . . . . -1To stay fit. . . . . . . . . . . . -2To be with friends. . . . . . -3To improve my game . . . -4To compete. . . . . . . . . . . -5To win. . . . . . . . . . . . . . . -6
b. In the past 12 months, have you purchased any tennis instructional books or video tapes? Yes . . . . . . . -1
No . . . . . . . -2
Dear Passenger:
American Airlines is pleased to have you on board today.
To help us provide the best service possible, we need to know more about you and your opinions of our service. If you are over 11 years old, we would appreciate it if you would complete this questionnaire.
Your flight attendant will pick up your completed questionnaire shortly.
Thank you.
1. Please indicate: Flight number ___________ Date_____________
2a. At the city where you boarded this particular plane, did you make a connection from another flight?
Yes, from American . . . . 1Yes, from Other Airline . . 2No . . . . . . . . . . . . . . . . . . 3
b. Did you board this plane at the airport from which it just took off, or were you a through passenger for which that was an intermediate stop?
Boarded here . . . . . . . . . . 1Through passenger. . . . . . 2
3. How would you rate the overall service from American for this flight, all things considered, from your arrival at the airport terminal until now?
Excellent Good Fair PoorOverall Service . . . . . . . . . . 1 2 3 4
4. Please rate each of the following with regard to this flight, if applicable.
Excellent Good Fair Poor
1 2 3 4Courtesy and Treatment from the: Skycap at airport . . . . . . . . . . . . . . Airport Ticket Counter Agent . . . . . Boarding Point (Gate) Agent . . . . . Flight Attendants . . . . . . . . . . . . . .Your Meal or Snack. . . . . . . . . . . . .Beverage Service . . . . . . . . . . . . . .Seat Comfort. . . . . . . . . . . . . . . . . . Carry-On Stowage Space. . . . . . . .Cabin Cleanliness . . . . . . . . . . . . . Video/Stereo Entertainment . . . . . .On-Time Departure . . . . . . . . . . . .
14-31
Exhibit 14-8 Sources of Questions
• Handbook of Marketing Scales
• The Gallup Poll Cumulative Index
• Measures of Personality and Social-Psychological Attitudes
• Measures of Political Attitudes
• Index to International Public Opinion
• Sourcebook of Harris National Surveys
• Marketing Scales Handbook
• American Social Attitudes Data Sourcebook
14-32
Exhibit 14-8 Web Sources of Questions
• Interuniversity Consortium for Political and Social Research
• iPoll
• Online Survey Research/ Public Opinion Centers
• Survey Research Library, Florida State University
• The Odum Institute
14-33
Exhibit 14-9 Phase 3
14-34
Guidelines for Question Sequencing
Interesting topics earlyInteresting topics early
Classification questions laterClassification questions later
Sensitive questions laterSensitive questions later
Simple items earlySimple items early
Transition between topicsTransition between topics
14-35
Illustrating the Funnel Approach
• How do you think this country is getting along in its relations with other countries?
• How do you think we are doing in our relations with Iran?
• Do you think we ought to be dealing with Iran differently than we are now?
• (If yes) What should we be doing differently?• Some people say we should get tougher with
Iran and others think we are too tough as it is; how do you feel about it?
14-36
Branching Question
14-37
Exhibit 14-10 Components of Questionnaire
14-38
Overcoming Instrument Problems
Build rapportBuild rapport
Redesign question processRedesign question process
Explore alternativesExplore alternatives
Use other methodsUse other methods
PretestPretest
14-39
MindWriter Survey
14-40
Key Terms
• Administrative question• Branched question• Buffer question• Checklist• Classification question• Dichotomous question
• Disguised question• Double-barreled question • Free-response question• Interview schedule• Leading question• Multiple-choice question
14-41
Key Terms
• Pretesting• Primacy effect• Ranking question• Rating question• Recency effort
• Screen question• Structured response• Target question
– Structured– Unstructured
• Unstructured response
14-42
Assignment• Roll No. 1-10 – Develop a Likert scale for measuring
attitude towards NCM• Roll No. – 11-20, Develop a Likert scale for measuring
attitude towards canteen facilities in the campus• Roll No. 21-30 Develop a Likert Scale for measuring
attitude towards cricket match watching on television• Roll No. 31-40 Develop a Likert Scale for measuring
attitude towards Religion • Roll No. 41-50 Develop a Likert Scale for measuring
attitude towards Pollution • Roll No. 51-58 Develop a Likert Scale for measuring
attitude towards Globalisation