Upload File

the dasish questionnaire design documentation tool … · about the questionnaire once the research...

  • Home
  • Documents
  • The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for
36
NSD©2016 The DASISH Questionnaire Design Documentation Tool (QDDT) Benjamin Beuster, Hilde Orten (NSD) ESRA17 – Lisbon, PT July 17-21, 2017 License: CC BY 4.0 (exceptions see last slide)

Upload: ngoduong

Post on 06-Jun-2018

221 views

Category:

Documents


0 download

Report

TRANSCRIPT

Page 1: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

The DASISH Questionnaire Design Documentation Tool (QDDT)

Benjamin Beuster, Hilde Orten (NSD)ESRA17 – Lisbon, PT

July 17-21, 2017

License: CC BY 4.0 (exceptions see last slide)

https://creativecommons.org/licenses/by-nc-sa/4.0/
Page 2: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Outline

• Why document questionnaires?

• The DASISH Questionnaire Design Documentation

Tool (QDDT) – Current functionalities and examples

from the ESS

• Further development

Page 3: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Why document the Question andQuestionnaire development?

• Relevant information surrounding the questionnaire development

• Preserve information for the future to answer any questions about the questionnaire once the research is complete

• Reuse questions (metadata elements) for other researches

Page 4: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Question

Comment

Comment

Page 5: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Data/Metadata Life Cycle

QDDT

Page 6: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

The DASISH Questionnaire Design Documentation Tool (QDDT)

• QDDT documents the questionnaire design process from the first conceptualization to the final questionnaire

• Aim is to assist large-scale survey projects in their business processes related to questionnaire development

Page 7: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

QuestionnaireModule Concept Question

ResponseDomain

Instrument

NSD©2016NSD©2016

Workflow in theEuropean Social Survey (ESS)

Page 8: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

IASSIST, Bergen, May 31 – June 3

QDDT conceptual model, DDI 3.2 based

CodeDomain

NumericDomain

Concept

ControlConstruct InstrumentStatementItem

ExternalAid

Instruction

Universe

Study

CategoryDomain

DateTimeDomain

ScaleDomain

TextDomain

QuestionGridResponseDomain

QuestionAsInInstrument

QuestionItem

Page 9: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Online tool

Menu to manage concepts, questions and response

domain etc.

Open content of the survey

Page 10: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Open content of the survey

Page 11: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Modules are researchtopics and consist of

concepts and questions

Add description, information about authorand upload documents

Page 12: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Top level concept

Sub concepts

ConceptHierarchy

Page 13: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Find questions

Select questions

Page 14: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Question text

Check wherequestion is used

Response domain

Page 15: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Add Questions to concepts

Page 16: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

View question

Page 17: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Page 18: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

What elsemakes the

QDDT special?

• Communication within thetool using nested comments

• Two level versioning system using RationaleCode

• Comparison of elements

Page 19: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Add or view (nested) comments

Page 20: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Page 21: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Make versioning easy!

Page 22: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

ChangeDisplay Layout

Version 1.1

Page 23: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Version 2.0

Page 24: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Versioning in QDDT

Save as version

Page 25: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Versioning in QDDT

Save as new minor version

Select the change type

Page 26: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Versioning in QDDT

Select the change reason and enter a save comment

Page 27: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Compare to previous version

Page 28: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Page 29: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Publish metadata elements

• Create a publication package• Select a publication status• Find elements from data base• Select version

Page 30: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Expand the element

Package name

Select publication status

Page 31: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Page 32: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

• Tool in production since June 17• QDT develop questions for ESS9 (Sept. 17)• Generate PDF and DDI 3.2 XML• Add instrument option and question grid

Page 33: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

Thank you for your attention

Special thanks to:

Knut Kalgraff Skjåk, Stig Norland (NSD), Sarah Butt, Virginia Ros (ESS HQ, City University),

Joachim Wackerow

Page 34: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

License

This presentation is offered under license CC-BY 4.0

The license does not apply to the following copyrighted material used in this presentation:

The logo of NSD:

The logo of SERISS:

The logo of DASISH:

https://creativecommons.org/licenses/by-nc-sa/4.0/
Page 35: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

IASSIST, Bergen, May 31 – June 3

QDDT conceptual model, DDI 3.2 based

CodeDomain

NumericDomain

Concept

ControlConstruct InstrumentStatementItem

ExternalAid

Instruction

Universe

Study

CategoryDomain

DateTimeDomain

ScaleDomain

TextDomain

QuestionGridResponseDomain

QuestionAsInInstrument

QuestionItem

Page 36: The DASISH Questionnaire Design Documentation Tool … · about the questionnaire once the research ... • Aim is to assist large-scale survey projects in their ... • no need for

NSD©2016

QDDT Architecture

Angular 2 + Typescript • No Javascript in dev tools, only in browser• Typescript can transpile to ES3 • Supports «evergreen» browsers (Chrome, FireFox, Opera,

Safari, and IE10/11)

Spring MVC API• RESTful API• JSON for free• no need for a SOAP service stackSpring security (OAuth2)• Tokenbased• No state for requestsPersistence Layer implemented with Hibernate + Envers• Revisions• Database agnostic• Since qddt is open source, we chose Postgres

Angular2

Router Layer

Service Layer

Persistence Layer

Database

Browser

REST Backend

Http/JSON

http://hibernate.org/
http://docs.jboss.org/hibernate/core/4.1/devguide/en-US/html/ch15.html

DASISH The big picture

DEVELOPMENT OF CASCOT 5.0 (a multi-language text coding tool) Presentation to the DASISH project meeting, Gothenburg, 27-28 November 2014 Peter Elias Margaret

Dasish workshop on Audit and Certification 2014-b sierman

Idependent Contractor Status · PDF fileKeep this questionnaire to assist you in documenting independent contractor status. Your Conclusion Is the worker an independent contractor?

Fraud Risk Questionnaire - CD - Roselli, Clark & …roselliclark.com/wp-content/uploads/2016/09/MMAAA-Fraud... · Web viewThis questionnaire was developed to assist your municipality

The Increased Demand for and Relevancy of Waste … · Questionnaire will include a list of relevant definitions and comprehensive guidance to assist respondents with filling the

QUESTIONNAIRE TO ASSIST PREPARATION FOR … · Is there a separate manual for the Energy Management System an integrated management manual for all systems (QMS, EMS, EnMS)?

DASISH Web Annotation Framework DWAN Annotator front- and backend 2014-04-28April 2014, Vitamin TLA

INTERNAL CONTROL QUESTIONNAIRE - North …qa.osc.nc.gov/sigdocs/sig_docs/documentation/policies_procedures/...Tax/Payroll Compliance ... agencies to assist in confirming the presence

GUIDANCE ON VOLUNTARY SELF-ASSESSMENT BY … · This Voluntary self-assessment questionnaire will assist those conducting the voluntary self-assessment in documenting the Administration’s

Chapter Eleven. Lecture Plan Questionnaire Definition Questionnaire Design Process Questionnaire Objectives

Creating a Questionnaire. Questionnaire Development

Kim Eng Hong Kong · Risk Profiling Questionnaire ("RPQ") — This questionnaire is designed to assist in the assessment of your company's attitude towards investment risk. Your answers

Newman Questionnaire Report 2015 Newman Questionnaire Report Report... · Newman Questionnaire Report 2015 Newman Questionnaire Report ... Newman Questionnaire Report 2015 ... The

The Life Insurance Design Questionnairetheoneillco.com/li_design.pdfThe Life Insurance Design Questionnaire ® is an assessment tool that enables your insurance advisor to assist you

DASISH Online Training Module

Tender€¦  · Web viewThis questionnaire has been prepared to assist ... Does the company provide adequate facilities for the welfare of . ... persons other than its employees

Public Works Contractor Prequalification Model Documents · Web viewWhile it is the intent of the qualification questionnaire and required documents to assist the Judicial Council

DASISH Metadata Catalogue Binyam Gebrekidan Gebre, Stephanie Roth, Olof Olsson, Catharina Wasner, Matej Durco, Bartholemeus Worcslav, Przemyslaw Lenkiewicz,

International Recommendations for Energy Statistics (IRES): A … · A brief questionnaire will be prepared to accompany the provisional draft and assist countries in the evaluation

DASISH Online Training Module Claudia Engelhardt [email protected] Access Policies and Licensing Timo Gnadt [email protected]

Questionnaire: Contractor Payments · 2020. 7. 1. · Questionnaire: Contractor Payments This questionnaire is designed to assist business operators when seeking professional advice

Towards an understanding of the youth’s perception of, and ...ijmt.yolasite.com/resources/100.pdfpast the questionnaire distribution point was approached to assist with the study

Junior Parent Meeting · - Submit request to teacher for recommendation in May/early June of Junior year - A completed Senior Questionnaire can assist letter writer - Senior Questionnaire

PARENT QUESTIONNAIRE -PARENTING - Alisha Ankers Questionnaire.pdf · PARENT QUESTIONNAIRE -PARENTING The purpose of this questionnaire is to assist me as the parenting investigator

NSD © 2014 DASISH Digital Services Infrastructure for Social Sciences and Humanities WP4 Data Archiving Claudia Engelhardt (UGOE), Arjan Hogenaar (DANS),

Community & Social Services 2015 Business Plan & Budget · 2015-01-15 · 2015 Business Plan & Budget ... and was labour intensive. ... A Skills Questionnaire was redeveloped to assist

Trust and the European Framework for Audit and Certification of Digital Repositories Claudia Engelhardt, Astrid Recker DASISH Workshop on Trust and Certification,

Trivia Questionnaire & retorical questionnaire

Appendix 01 - BPM General Questionnaire DRAFT · Web viewTo complete this objective effectively, the Contractor may need to assist the Department in developing a strategic balanced

Vigdis Kvalheim Norwegian Social Science Data Services (NSD) DASISH Digital Services Infrastructure for Social Sciences and Humanities Legal and Ethical

Questionnaire CONTRACTOR PAYMENTS PAYMENTS This questionnaire is designed to assist ... contractor payments are liable for payroll tax and will ... for a specific project

CONFIDENTIAL ESTATE PLANNING QUESTIONNAIRE FOR …...This questionnaire will assist your von Briesen & Roper, s.c. attorney in identifying the tax and non-tax issues relevant to your

Demonstration of Performance of CASCOT 5.0 Presentation for DASISH Workshop Venice, 10-11 April 2014 Ritva Ellison Institute for Employment Research

Questionnaire 08-02-2013 Epmloyeee Questionnaire