14-1 chapter 14 questionnairesandinstruments. 14-2 learning objectives understand the link forged...

14-1

Chapter 14Chapter 14

QuestionnairesQuestionnaires

andand

InstrumentsInstruments

14-2

Learning Objectives

• Understand the link forged between the management dilemma and the communication instrument by the management-research question hierarchy

• Understand the influence of the communication method on instrument design

• Understand the three general classes of information and what each contributes to the instrument

14-3

Learning Objectives

• Understand the influence of question content, question wording, response strategy, and preliminary analysis planning on question construction

• Understand each of the numerous question design issues influencing instrument quality, reliability, and validity

• Understand the sources for measurement questions • Understand the importance of pretesting questions

and instruments

14-4

Exhibit 14-1 Overall Flowchart for Instrument Design

14-5

Exhibit 14-2 Phase 1

14-6

Strategic Concerns in Instrument Design

What type of scale is needed?

What communication approach will be used?

Should the questions be structured?

Should the questioning be disguised?

14-7

Technology Affects Questionnaire Development

• Write questionnaires more quickly

• Create visually driven instruments

• Eliminate manual data entry

• Save time in data analysis

WebSurveyor used to write an instrument.

14-8

Structured Unstructured

Undisguised

Disguised

Example:

Typical descriptive surveywith straight-forward, structured questions

Example:

Survey with open-endedquestions to discover “new”answers or focus group interview

Example:

Survey interview to measurebrand A’s image versuscompetitive brands’ images or brand recall (unaided recall)

Example:

Projection techniques usedmostly for exploratory research

Classifying Surveys by Degree of Structure and Degree of Disguise

14-9

Exhibit 14-3 Dummy Table for American Eating Habits

Age

Use of Convenience Foods

__________________________________________________

Always UseUse

FrequentlyUse

Sometimes Rarely Use Never Use

18-24

25-34

35-44

55-64

65+

14-10

Exhibit 14-4 Phase 2

14-11

Question Categories and Structure

Administrative

Classification

Target

14-12

Question Content

Should this question be asked?

Is the question of proper scope and coverage?

Can the participant adequately answer this question as asked?

Will the participant willingly answer this question as asked?

14-13

Question Wording

CriteriaCriteria

Shared vocabulary Single

meaning

Misleading assumptions

Adequate alternatives

Personalized

Biased

14-14

Response Strategy

Factors Factors

Objectives of the study

Participant’s level of

information

Degree to which participants have

thought through topic

Ease and clarity with which participant communicates

Participant’s motivation to

share

14-15

Free-Response Strategy

What factors influenced your enrollment in Metro U?________________________________________________________________________________________

14-16

Dichotomous Response Strategy

Did you attend the A Day at College program at Metro U?

YesNo

14-17

Multiple Choice Response Strategy

Which one of the following factors was most influentialin your decision to attend Metro U?

Good academic standingSpecific program of study desiredEnjoyable campus lifeMany friends from homeHigh quality of faculty

14-18

Checklist Response Strategy

Which of the following factors influencedyour decision to enroll in Metro U? Check all that apply.

Tuition costSpecific program of study desiredParents’ preferencesOpinion of brother or sisterMany friends from home attendHigh quality of faculty

14-19

Rating Response Strategy

Strongly influential

Somewhat influential

Not at all

influential

Good academic reputation

Enjoyable campus life

Many friends

High quality faculty

Semester calendar

14-20

Ranking

Please rank-order your top three factorsFrom the following list based on their Influence in encouraging you to apply to Metro U.Use 1 to indicate the most encouraging factor,2 the next most encouraging factor, etc.

_____ Opportunity to play collegiate sports_____ Closeness to home_____ Enjoyable campus life_____ Good academic reputation_____ High quality of faculty

14-21

Exhibit 14-7 Characteristics of Response Strategies

Characteristic DichotomousMultipleChoice Checklist Rating

RankOrdering

FreeResponse

Type of Scale Nominal Nominal, ordinal, or ratio

Nominal Ordinal or interval

Ordinal Nominal or ratio

Usual Number of Answer Alternatives Provided

2 3 to 10 10 or fewer 3 to 7 10 or fewer None

Desired Number of Participant Answers

1 1 10 or fewer 1 per item 7 or fewer 1

Used to Provide...

Classification Classification, order, or specific numerical estimate

Classification Order or distance

Order Classification(of idea), order, or specific numerical estimate

14-22

Exhibit 14-6 Internet Survey Response Options

14-23

Exhibit 14-6 continued

14-24

Exhibit 14-6 continued

14-25

1a. How many years have you been playing tennis on a regular basis? Number of years: __________

b. What is your level of play?

Novice . . . . . . . . . . . . . . . -1 Advanced . . . . . . . -4Lower Intermediate . . . . . -2 Expert . . . . . . . . . -5Upper Intermediate . . . . . -3 Teaching Pro . . . . -6

c. In the last 12 months, has your level of play improved, remained the same or decreased?

Improved. . . . . . . . . . . . . . -1 Decreased. . . . . . . -3Remained the same . . . . . -2

2a. Do you belong to a club with tennis facilities? Yes . . . . . . . -1No . . . . . . . -2

b. How many people in your household - including yourself - play tennis?Number who play tennis ___________

3a. Why do you play tennis? (Please “X” all that apply.)

To have fun . . . . . . . . . . -1To stay fit. . . . . . . . . . . . -2To be with friends. . . . . . -3To improve my game . . . -4To compete. . . . . . . . . . . -5To win. . . . . . . . . . . . . . . -6

b. In the past 12 months, have you purchased any tennis instructional books or video tapes? Yes . . . . . . . -1

No . . . . . . . -2

Dear Passenger:

American Airlines is pleased to have you on board today.

To help us provide the best service possible, we need to know more about you and your opinions of our service. If you are over 11 years old, we would appreciate it if you would complete this questionnaire.

Your flight attendant will pick up your completed questionnaire shortly.

Thank you.

1. Please indicate: Flight number ___________ Date_____________

2a. At the city where you boarded this particular plane, did you make a connection from another flight?

Yes, from American . . . . 1Yes, from Other Airline . . 2No . . . . . . . . . . . . . . . . . . 3

b. Did you board this plane at the airport from which it just took off, or were you a through passenger for which that was an intermediate stop?

Boarded here . . . . . . . . . . 1Through passenger. . . . . . 2

3. How would you rate the overall service from American for this flight, all things considered, from your arrival at the airport terminal until now?

Excellent Good Fair PoorOverall Service . . . . . . . . . . 1 2 3 4

4. Please rate each of the following with regard to this flight, if applicable.

Excellent Good Fair Poor

1 2 3 4Courtesy and Treatment from the: Skycap at airport . . . . . . . . . . . . . . Airport Ticket Counter Agent . . . . . Boarding Point (Gate) Agent . . . . . Flight Attendants . . . . . . . . . . . . . .Your Meal or Snack. . . . . . . . . . . . .Beverage Service . . . . . . . . . . . . . .Seat Comfort. . . . . . . . . . . . . . . . . . Carry-On Stowage Space. . . . . . . .Cabin Cleanliness . . . . . . . . . . . . . Video/Stereo Entertainment . . . . . .On-Time Departure . . . . . . . . . . . .

14-31

Exhibit 14-8 Sources of Questions

• Handbook of Marketing Scales

• The Gallup Poll Cumulative Index

• Measures of Personality and Social-Psychological Attitudes

• Measures of Political Attitudes

• Index to International Public Opinion

• Sourcebook of Harris National Surveys

• Marketing Scales Handbook

• American Social Attitudes Data Sourcebook

14-32

Exhibit 14-8 Web Sources of Questions

• Interuniversity Consortium for Political and Social Research

• iPoll

• Online Survey Research/ Public Opinion Centers

• Survey Research Library, Florida State University

• The Odum Institute

14-33

Exhibit 14-9 Phase 3

14-34

Guidelines for Question Sequencing

Interesting topics earlyInteresting topics early

Classification questions laterClassification questions later

Sensitive questions laterSensitive questions later

Simple items earlySimple items early

Transition between topicsTransition between topics

14-35

Illustrating the Funnel Approach

• How do you think this country is getting along in its relations with other countries?

• How do you think we are doing in our relations with Iran?

• Do you think we ought to be dealing with Iran differently than we are now?

• (If yes) What should we be doing differently?• Some people say we should get tougher with

Iran and others think we are too tough as it is; how do you feel about it?

14-36

Branching Question

14-37

Exhibit 14-10 Components of Questionnaire

14-38

Overcoming Instrument Problems

Build rapportBuild rapport

Redesign question processRedesign question process

Explore alternativesExplore alternatives

Use other methodsUse other methods

PretestPretest

14-39

MindWriter Survey

14-40

Key Terms

• Administrative question• Branched question• Buffer question• Checklist• Classification question• Dichotomous question

• Disguised question• Double-barreled question • Free-response question• Interview schedule• Leading question• Multiple-choice question

14-41

Key Terms

• Pretesting• Primacy effect• Ranking question• Rating question• Recency effort

• Screen question• Structured response• Target question

– Structured– Unstructured

• Unstructured response

14-42

Assignment• Roll No. 1-10 – Develop a Likert scale for measuring

attitude towards NCM• Roll No. – 11-20, Develop a Likert scale for measuring

attitude towards canteen facilities in the campus• Roll No. 21-30 Develop a Likert Scale for measuring

attitude towards cricket match watching on television• Roll No. 31-40 Develop a Likert Scale for measuring

attitude towards Religion • Roll No. 41-50 Develop a Likert Scale for measuring

attitude towards Pollution • Roll No. 51-58 Develop a Likert Scale for measuring

attitude towards Globalisation