numeric codes in questionnaires€¦ · numeric codes in questionnaires the influence on unit...

Dipl. Soz. Felix Bader Institute for Sociology, LMU Munich Institute for Sociology, University Mannheim

Numeric Codes in Questionnaires The Influence on Unit Nonresponse, Item Nonresponse, and Misreporting

Dr. Johannes Bauer Institute for Sociology, LMU Munich Institute for Empolyment Research

Dipl. Soz. Martina Kroher Institute for Sociology, University Hannover

Dipl. Soz. Patrick Riordan Institute for Sociology, LMU Munich

Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich # 2

paper questionnaires: optical mark recognition

Readsoft AXIOME Yomark SQS queXF Udai OMR TCExam C# (OMR) Remark Office OMR

Teleform Neoptec Ogami OMR FormReturn Form Scanner DRS SDAPS OMR Mark Engine Leadtools OMR SDK

Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich

How a questionnaire scanner works

# 3

982012

001421

340003 217561

411131

317142

982012

982012

982012

Data


How a questionnaire scanner works

# 3

Are numbers a problem?

982012

001421

340003 217561

411131

317142 982012

982012


Are numbers a problem?

# 4

when?

anonymity


Survey on Group Focused Enmity

# 5

Group Focused Enmity

disabled people

long-term unemployed

homeless people

immigrants

muslims

jews

homosexuals national socialism


Survey Experiment

# 7

no scancode (n = 1863)

with scancode (n = 931)

scancode with explanation (n = 931)

Johannes Bauer, Institute for Employment Research / Institute of Sociology, LMU Munich # 6

Response rate: 30.2 percent 30.1 percent 31.0 percent

Responses: 281 280 577


Measuring Items and Sensitivity

# 7


muslims

fully disagree

fully agree

fully disagree

fully agree

Most unemployed persons make an effort to find a job.

There are too many Muslims in Germany.


Regression on all 38 GFE-Items

# 8

Multivariate Regression

without scanncode (reference) with scanncode with scanncode and explanation

Additional variables: Sex Age, Age² Religion German Citizenship Education Employment Status Unemployment Experience Income Sense of Belonging Contact to Foreigners in the Family Contact to Foreigners at Work Politically Involved Trust in Government Social Participation „Getting my Fair Share“ Socio-Economic Comparison Sentiment during Childhood City District

muslims in Germany

unemployed make effort

With scann-

code + expla-

nation

-0.3

-0.2

-0.1

0.0

0.1

0.2

0.3

Reg

ress

ion

Par

amet

er

standardized GFE-Items



# 8



Additional variables: Sex Age, Age² Religion German Citizenship Education Employment Status Unemployment Experience Income Sense of Belonging Contact to Foreigners in the Family Contact to Foreigners at Work Politically Involved Trust in Government Social Participation „Getting my Fair Share“ Socio-Economic Comparison Sentiment during Childhood City District

-0.3

-0.2

-0.1

0.0

0.1

0.2

0.3

With scann-

code

Reg

ress

ion

Par

amet

er

+ expla-

nation


With scann-

code + expla-

nation

standardized Non sensitive Items



# 8



-0.3

-0.2

-0.1

0.0

0.1

0.2

0.3

With scann-

code

Reg

ress

ion

Par

amet

er

+ expla-

nation


With scann-

code + expla-

nation

standardized Non sensitive Items

0

1

2

3

4

Item

Nonre

spon

se (

Per

cen

t)

GFE-Items Item Nonresponse

With scan-

code

+ expla-

nation

No scan-

code

Non sensit. Items

With scan-

code

+ expla-

nation

No scan-

code


Regression on Xenophobia Index, Interactions with scancode

# 10

Regression


immigrants

Additional variables: Sex Age, Age² Religion German Citizenship Education Employment Status Unemployment Experience Income Sense of Belonging Contact to Foreigners in the Family Contact to Foreigners at Work Politically Involved Trust in Government Social Participation „Getting my Fair Share“ Socio-Economic Comparison Sentiment during Childhood

n = 706

Interaction Parameter

-1.96 SE 0 +1.96 SE

Male Age

2

Catholic Religion

Lutheran-Protestant No Religion

German Citizenship No Degree/Junior High School Degree

Middle School (“Realschule”) Degree

Adv. Tech. College Qualification University Qualification

Full-Time Employed Reg. Part-Time Employment

Marginal Part-Time Employment

No Unemployment Experience Income Per Capita (in 1000 €)

Sense of Belonging to Germany No Sense of Belonging to Europe

Contact to Foreigners in the Family No Contact to Foreigners at Work

Politically Involved

Trust in Government Social Participation

'Getting My Fair Share' (Negative) Socio-Economic Comparison

Sentiment During Childhood

Age


t-values of six GFE Indices

# 10

Regression


immigrants

muslims

jews


homosexuals

national socialism

t-Values

-3 -2 -1 0 1 2 3 4

0.0

0

.1

0.2

0

.3

0.4

0

.5

0.6

Den

sity

Standard Normal Distribution

𝑝𝐴𝐷 = 0.556

𝑝𝑆𝑊 = 0.614

𝑝𝐾𝑆 = 0.676

𝑝𝐴𝐷 = 0.052

𝑝𝑆𝑊 = 0.092

𝑝𝐾𝑆 = 0.007

156 interactions and t-values


discussion

Scancode has an effect on responses to sensitive questions

An explanation in the cover letter does not weaken this effect

Researcher has to decide what is more relevant, bias or cost?

Improve Software – Use alternatives to Scancode

Thank you for the attention

# 11

numeric codes in questionnaires€¦ · numeric codes in questionnaires the influence on unit...

Documents