harnessing the power of microdata standards, tools and best practices for microdata dissemination...
TRANSCRIPT
Harnessing the Power of Microdata
Standards, tools and best practices for microdata dissemination and management
International Household Survey Network (IHSN) http://www.ihsn.org
Data Life Cycle
Evaluate
Archive
Disseminate
Analyze
Process
Collect
Build
Design
Specify needs
International Household Survey Network (IHSN)
Met
adat
a m
anag
emen
t (do
cum
enta
tion)
Policymaking
Research
Statistical Integration
Why disseminate microdata?
• Support research and policymaking. Tabular and aggregated outputs will not meet all specific needs of researchers. Microdata dissemination meets specialised needs of researchers and students, and encourages diversity of analysis.
• Increase returns on data collection. Microdata dissemination reduces the risk of duplicated activities and the burden on respondents.
• Improve quality and credibility of data and output. Broader access to metadata and microdata makes replication (or correction) of analysis possible.
• Improve future data collection. Through wider use of microdata, NSO also gains insights for improvement for future data production.
• Promote development of new data models and analytics.
International Household Survey Network (IHSN)
Costs and risks
• Confidentiality. One of the biggest challenges of microdata dissemination is to minimize the risk of disclosure of any data that would compromise the identity of respondents
• Official vs. non-official results and contradiction. Dissemination of microdata may lead to a proliferation of differing -and possibly contradictory- results and statistics.
• Legal concerns. Countries’ specific statistical legislation.• Financial cost. Cost of creating microdata files, access tools and
safeguards, and of supporting enquiries
International Household Survey Network (IHSN)
Safe Dissemination
• An enabling legislation– Provision in statistics’ acts enabling release of microdata
files• A microdata access policy specifying conditions
– Public Use Files. Open to anyone with access to an NSO website
– Licensed Files. User(s) have to be identified and agree to the terms and conditions. Access requests are reviewed and approved by NSO.
– Data enclaves. Access limited on NSO premises, supervised by NSO staff. Results screened before taken outside.
International Household Survey Network (IHSN)
Application for access to a licensed fileExample from Rwanda-NADA
Why are metadata important for microdata dissemination?
• Metadata is “data about data”, e.g. study description, sampling, codebook, questionnaires, etc.
• For data producers, well-documented metadata– increase the credibility and transparency of statistical outputs– preserve institutional memory– allow replication of data collection and analysis
• For data users, well-documented metadata help– better understand why, when, how and by whom microdata
were produced– make better use of microdata, avoiding misuse and or
misinterpretation
International Household Survey Network (IHSN)
Why are metadata important? Different variable definitions can mean different estimates for indicators. Well-documented metadata are crucial for data harmonization.
In this example, metadata helped understand and reconcile the differences in the estimates of “access to safe water”
International Household Survey Network (IHSN)
Survey Definition of safe water Original New
DHS 1999 Assumes that water from pipes, private wells, boreholes, and springs are not contaminated.
53.1% 53.0%
CLFS2000 Safe is not defined. Unsafe sources are defined as ponds, stream or river and rainwater.
69.3% 50.8%
DHS 2003 Sources of water expected to be relatively free of disease are piped water and water drawn from protected wells and deep boreholes.
42.0% 42.7%
NLSS 2004 Pipe water, untreated pipe, borehole and protected well are considered safe
60.0% 60.7%
CWIQ 2006 Safe water source is defined for households using treated piped water, bore hole/hand pump or protected well.
51.4% 53.4%
GHS 2006 Safe water is constituted by those who use: piped treated water, piped untreated water, borehole with hand pump and well/spring protected water.
46.4% 49.1%
MICS 2007 Piped into dwelling, Piped into yard or plot, Public tap/standpipe, Tubewell/borehole, Protected well, Protected spring, Rainwater collection, Bottled Water are considered safe
49.1% 50.4%
BASE 2008 Safe water includes: Household Connections, Boreholes with hand pump, Motorized borehole, Protected Dug well, Public Standpipe, Rain water harvesting, Protected Spring
…53.3%
When to document metadata?
Evaluate
Archive
Disseminate
Analyze
Process
Collect
Build
Design
Specify needs
Documentation should be an ongoing process, to ensure quality and completeness, prevent information loss and reduce cost
International Household Survey Network (IHSN)
Met
adat
a m
anag
emen
t (do
cum
enta
tion)
Tools: National Data Archive (NADA) 4.0• Allows data producers to
document and disseminate microdata and metadata in a secured environment, in compliance with their own policies and processes
• Used internally and/or externally• Available in Arabic, English, French,
Portuguese, Russian and Spanish
International Household Survey Network (IHSN)
100+ agencies in 65+ countries in the world (27 countries in Africa) have established an online catalog using NADA
International Household Survey Network (IHSN)
Engaging Users
• Promote the use of existing microdata, tools and policies
• Identify who the users are• Understand what user demands are: consult
users on data availability, accessibility and relevance a feedback loop leading to better data and better use of data
International Household Survey Network (IHSN)
About IHSN
• A network of over twenty international agencies, launched as a recommendation of the Marrakech Action Plan for Statistics (MAPS) 2004
• develop tools and guideline on microdata documentation, preservation, anonymization, cataloguing and dissemination; assess and improve survey methods
• Accelerated Data Program (ADP) uses IHSN tools and guidelines to help data producers in developing countries increase the use and value of microdata
International Household Survey Network (IHSN)
Thank you!
For more information, visit:http://www.ihsn.orghttp://adp.ihsn.org
International Household Survey Network (IHSN)