www.bournemouth.ac.uk
Cross-Cultural Survey Guidelines (CCSG) workshop
Dublin, Feb. 2012
Prof. Edwin van Teijlingen
www.bournemouth.ac.uk
Comparative studies
• Cross-national research helps one to look at problems from a different angle, questioning current practice, warn against side effects, etc. I.e. there exist ways of doing things which have not been considered in the UK (or Germany or Finland or …..) .
• Cognitive psychology recognises that cognition is a situated process and that knowledge is a collaborative, culture-bounded effort.
Comparative research
www.bournemouth.ac.uk
Cross-Cultural Survey Guidelines
Guidelines are part of Comparative Survey Design & Implementation (CSDI) Guidelines Initiative.
Initiative promotes internationally recognized guidelines that highlight best practice for the conduct of comparative survey research across cultures and countries.
Designed for researchers planning or engaged in cross-cultural or cross-national research.
http://ccsg.isr.umich.edu/index.cfm
www.bournemouth.ac.uk
Starter question
What makes a good quantitative survey? What are the characteristics of well designed and implemented survey?
• How do student midwives in Ireland see the job market in their field developing over the coming five years?
www.bournemouth.ac.uk
A good survey consists of:
• .….• …..• …..• …..
www.bournemouth.ac.uk
Overview 15 chapters CCSG
1. Study, Organizational, and Operational Structure 2. Survey Quality 3. Ethical Considerations in Surveys 4. Tenders, Bids, and Contracts 5. Sample Design 6. Questionnaire Design 7. Adaptation of Survey Instruments 8. Translation 9. Instrument Technical Design 10. Interviewer Recruitment, Selection, and Training 11. Pretesting 12. Data Collection 13. Data Harmonization 14. Data Processing and Statistical Adjustment 15. Data Dissemination
www.bournemouth.ac.uk
CCSG Glossary (as specifically relevant today
Adaptation • Changing existing materials (e.g., management
plans, contracts, training manuals, questionnaires, etc.) by deliberately altering some content or design component to make the resulting materials more suitable for another socio-cultural context or a particular population.
Coordinating centre • A research centre that facilitates and organises
cross-cultural or multi-site research activities.
www.bournemouth.ac.uk
Overview 15 chapters CCSG
1. Study, Organizational, and Operational Structure 2. Survey Quality 3. Ethical Considerations in Surveys 4. Tenders, Bids, and Contracts 5. Sample Design 6. Questionnaire Design 7. Adaptation of Survey Instruments 8. Translation 9. Instrument Technical Design 10. Interviewer Recruitment, Selection, and Training 11. Pretesting 12. Data Collection 13. Data Harmonization 14. Data Processing and Statistical Adjustment 15. Data Dissemination
www.bournemouth.ac.uk
CCSG: Survey Lifecycle
www.bournemouth.ac.uk
First 9 chapters CCSG
1. Study, Organizational, and Operational Structure
2. Survey Quality
3. Ethical Considerations in Surveys
4. Tenders, Bids, and Contracts
5. Sample Design
6. Questionnaire Design
7. Adaptation of Survey Instruments
8. Translation
9. Instrument Technical Design
www.bournemouth.ac.uk
Shaping a Network of Local Researchers
COST brings together midwifery/maternity
care researchers from a range of different
academic disciplines working across
Europe.
To conduct a cross-national survey there has
to be a balance between (a)
standardisation of implementation and (b)
adaptation of the cultural context.
This needs ‘leadership’/coordinating centre.
www.bournemouth.ac.uk
Guidelines: leadership
To establish study's overall structure & locus of control at all levels and across all aspects of study's design & implementation, and to communicate this structure to each participating country's survey organization.
www.bournemouth.ac.uk
II. Survey Quality
http://ccsg.isr.umich.edu/quality.cfm
www.bournemouth.ac.uk
II. Survey Quality
www.bournemouth.ac.uk
Sampling frames
• As maternity services, health systems and the was populations are registered varies across countries we may have to deal with different sampling frames across COST countries.
www.bournemouth.ac.uk
8 Translation
Translation is :A.Language;B.Culture;C.Context & system (related).
Starting point cross-national survey? Translate from Dutch into German / French / English.
www.bournemouth.ac.uk
8 Translation / language
A. LanguageWords have ‘meaning’ which
needs to be translated.Translations from English into
other European languages take more space.
Miles & lbs & pints………
www.bournemouth.ac.uk
8 Translation / Culture
B. CultureWill we have a questionnaire
in German?OrA German questionnaire, a
Swiss questionnaire and an Austrian questionnaire?
www.bournemouth.ac.uk
8 Translation / Culture
B. CultureWill we have a questionnaire
in minority languages such as Hindi, Urdu, Turkish, etc. and use same questionnaire in Hindi different European countries?
www.bournemouth.ac.uk
8 Translation / Culture
B. CultureSome colours and numbers
have special significance in some cultures so should perhaps be avoided answers to multiple choice questions.
www.bournemouth.ac.uk
8 Translation / context
C. Context• ‘Private health services’
means something different in a state health service system such as in the UK than in a health-insurance system such as the Netherlands or Germany.
www.bournemouth.ac.uk
Problematising Terminology
Comparing like with like?
• Trained nurse-midwife
• Direct-entry midwife (NB: UK vs US meaning)
• Midwifery assistant / maternity care assistant
• Maternity benefits
• Economic migrant
• etc.
www.bournemouth.ac.uk
11. Pretesting
• Test instrument• Test research protocol• Training researcher/ Education• Collect preliminary data• Impress (potential) funders• Help calculate sample size
www.bournemouth.ac.uk
Reasons for pilot studies
Test instrument:• test questions;• test possible answers for multiple
choice questions;• test order of questions;• test colour of paper;• etc.• etc.
www.bournemouth.ac.uk
Reasons for pilot studies
Test research protocol:• test way of questionnaire
distribution• test process of returning them
to you• test intervening factors (gate
keepers, etc.)• try out different incentives to
increase response rates
www.bournemouth.ac.uk
Reasons for pilot studies
Training researcher/ Education:• Project as part of training/
degree• Train new researcher on a
study• Train researcher in new
technique
www.bournemouth.ac.uk
Ethics committees
Glasziou & Chalmers (2004) found that piloting of leaflet aimed at elderly to improve GP consultations needed ethical review, in Belgium, Slovenia and UK, but not in Austria, France, Germany and Switzerland, whilst UK has one of most complicated ethical processes (Hearnshaw 2004).
www.bournemouth.ac.uk
Ethics committees
• What if ethics committee in the UK does not think question 17 in the questionnaire is appropriate, but ethics committee in Belgium and in xxxx has accepted the questionnaire as it stands?
• What do we do?
www.bournemouth.ac.uk
Balance
UniformityContext & cultural
sensitivity
Balance between the need to keep
survey
as uniform as possible to be able to
make
cross-national comparisons AND the
need
to be as sensitive as possible to the
local
context, culture & health system!
www.bournemouth.ac.uk
References
Glasziou P, Chalmers I (2004) Ethics review roulette: What can we learn? Brit Med J, 328: 121-122.
Hearnshaw H (2004) Comparisons of requirements of research ethics committees in 11 European countries for a non-invasive interventional study. Brit Med J, 328: 140-141.
Survey Research Center. (2010). Guidelines for Best Practice in Cross-Cultural Surveys. Ann Arbor, MI: Survey Research Center, Institute for Social Research, University of Michigan. Retrieved Feb. 2012 from http://www.ccsg.isr.umich.edu/
van Teijlingen ER, Sandall J, Wrede S, Benoit C, DeVries R, Bourgeault I. (2003) Comparative studies in maternity care RCM Midwives J 6: 338-40.
Peat J et al. (2002), Health Science Research: A Handbook of Quantitative Methods, London: Sage.
Teijlingen van, E., Hundley, V. (2001) The importance of pilot studies, Social Research Update Issue 35, http://www.soc.surrey.ac.uk/sru/SRU35.html
www.bournemouth.ac.uk
www.bournemouth.ac.uk
Thank you!
Edwin van Teijlingen