survey research operations survey research center institute for social research the use of...

Survey Research OperationsSurvey Research Center

Institute for Social Research

The Use of Structured Survey Instrument Metadata

throughout the Data Lifecycle

Sue Ellen HansenInstitute for Social Research

University of Michigan

ESRA 20111

Survey Research OperationsSurvey Research Center ▪ Institute for Social Research

Presentation Outline

• Data Lifecycle

• Survey Lifecycle

• MQDS

• Moving through the data lifecycle

• Study example

2

Survey Research OperationsSurvey Research Center ▪ Institute for Social Research

Data Lifecycle (DDI)

3

http://www.ddialliance.org/

Survey Lifecycle (CCSG)

4

http://ccsg.isr.umich.edu/

Survey Research OperationsSurvey Research Center ▪ Institute for Social Research

MQDS

• Michigan Questionnaire Documentation System▪ Documents Blaise™ survey instruments and

datasets▪ Produces relational and eXtended Markup

Language (XML) question-level metadata that meet the Data Documentation Initiative (DDI) metadata standard

▪ Now available to licensed Blaise ™ users

5

Survey Research OperationsSurvey Research Center ▪ Institute for Social Research

MQDS Version 3

• Relational database▪ DDI compliant standardized tables

▪ Flexibility to add extensions that meet client and organizational needs

▪ Allows • Automated documentation of any Blaise survey

instrument• Importing and documenting data produced by

other software (e.g., SAS)• Lower cost development of other tools that

facilitate editing and disseminating data

Survey Research OperationsSurvey Research Center ▪ Institute for Social Research

MQDS V3Relational Database

7

Survey Research OperationsSurvey Research Center ▪ Institute for Social Research

Using MQDS across the Data Lifecycle

8

MQDS

From Concepts toInstrument Specifications

• Concepts → Constructs → Indicators → Measures

• Questionnaire design▪ Focus groups, cognitive interviews, etc.

• Questionnaire

• Instrument design

• Instrument specifications → programming & screen layout → MQDS documentation (instrument and codebook)

9

Instrument Specifications

10

Blaise™ Programming

11

Blaise™ Screen

12

MQDS Instrument Documentation

13

Survey Research OperationsSurvey Research Center ▪ Institute for Social Research

Using MQDS across the Data Lifecycle

• Check programming against instrument specifications

• Compare versions of instruments• Test programmed instruments• Document preliminary datasets• Document cleaned datasets• Harmonize data• Disseminate data for public use data

14

Survey Research OperationsSurvey Research Center ▪ Institute for Social Research

15

Study Example

• Collaborative Psychiatric Epidemiological Surveys (CPES)▪ National Comorbidity Survey Replication (NCS-R)

▪ National Survey of American Life (NSAL)

▪ National Latino and Asian American Study (NLAAS) – 5 languages

• U.S. National Institute of Mental Health (NIMH)http://www.icpsr.umich.edu/icpsrweb/CPES/

CPES

• Programming and data collection▪ Survey Research Operations (SRO), Survey

Research Center, (SRC), Institute for Social Research (ISR)

• Harmonization project▪ SRO and the Inter-University Consortium for

Political and Social Research (ICSPR), ISR▪ Facilitated by MQDS standardized structured

XML metadata for all three CPES surveys

16

Survey Research OperationsSurvey Research Center ▪ Institute for Social Research

17

CPES Harmonization Project

• Primary goals:▪ Harmonize and merge CPES datasets▪ Prepare codebooks and data for on-line analysis ▪ Develop Website▪ Disseminate for public use

18

The Data• ~ 20,000 Respondents

▪ NCS-R: 9,282 adults▪ NSAL: 6,199 adults

• 3,570 African American• 1623 Afro-Caribbean• 891 non-Latino White

▪ NLAAS: 4,864 adults• 1095 Asian• 2,554 Latino• 215 non-Latino, non-Asian White

• ~ 6,000 variables▪ from 9,000 before harmonization and disclosure

analysis

Process for Creating CPES XML

CPES SAS Merged Dataset

SAS Macro

Create “Blaise” Metadata

MQDS Create Blaise

Codebook

CPES Metadata (.BMI file)

CPES Freqs XML

CPES XML

Crosswalk / XML LinkSurvey

Crosswalk

CPES Final XML

ICPSR Web Site

Process Repeated for

• NCS-R• NSAL• NLAAS• NLAAS English• NLAAS Spanish• NLAAS Tagolog• NLAAS Vietnamese• NLAAS Chinese

20

CPES Website Development and Data Dissemination

21

CPES Interactive Codebook

22

http://www.icpsr.umich.edu/icpsrweb/CPES/

CPES Interactive Codebook

23

CPES Interactive Codebook

24

CPES Interactive Codebook

25

Survey Research OperationsSurvey Research Center ▪ Institute for Social Research

Summary

26

MQDS

Questions?

• Data Documentation Initiative

• CPES

• Cross-Cultural Survey Guidelines

• MQDS

27

http://www.ddialliance.org/

http://ccsg.isr.umich.edu/

http://www.icpsr.umich.edu/icpsrweb/CPES/

http://www.blaise.com/Tools