Upload File

collecting high-quality data. m&e plan frameworkindicators data collection data quality data use...

  • Home
  • Documents
  • Collecting High-Quality Data. M&E Plan FrameworkIndicators Data Collection Data Quality Data Use and Reporting Evaluation Strategy Budget Part of the
11
Collecting High-Quality Data

Upload: semaj-kane

Post on 15-Dec-2015

214 views

Category:

Documents


0 download

Report

Tags:

TRANSCRIPT

Page 1: Collecting High-Quality Data. M&E Plan FrameworkIndicators Data Collection Data Quality Data Use and Reporting Evaluation Strategy Budget Part of the

Collecting High-Quality Data

Page 2: Collecting High-Quality Data. M&E Plan FrameworkIndicators Data Collection Data Quality Data Use and Reporting Evaluation Strategy Budget Part of the

Part of the M&E Plan

Page 3: Collecting High-Quality Data. M&E Plan FrameworkIndicators Data Collection Data Quality Data Use and Reporting Evaluation Strategy Budget Part of the

Data Quality:

How well our M&E data “tell the true story.”

Data Quality:

How well our M&E data “tell the true story.”

Actual

Results

Actual

ResultsReported

Results

Reported

Results

What is Data Quality?

?

Adapted from: http://www.cpc.unc.edu/measure presentation by Win Brown, USAID/South Africa, School of Health Systems and Public Health, Monitoring and evaluation of HIV/AIDS Programs, Data Quality; March 2, 2011.

Page 4: Collecting High-Quality Data. M&E Plan FrameworkIndicators Data Collection Data Quality Data Use and Reporting Evaluation Strategy Budget Part of the

Elements of Data Quality

Validity Data measure what they are supposed to measure.

ReliabilityEveryone defines, measures, and collects data the same way—all the time.

CompletenessData include all of the values needed to calculate indicators. No variables are missing.

Precision Data have sufficient detail. Units of measurement are very clear.

Timeliness Data are up to date. Information is available on time.

IntegrityData are true. The values are safe from deliberate bias and have not been changed for political or personal reasons.

Adapted from: http://www.cpc.unc.edu/measure presentation by Win Brown, USAID/South Africa, School of Health Systems and Public Health, Monitoring and evaluation of HIV/AIDS Programs, Data Quality; March 2, 2011.

Page 5: Collecting High-Quality Data. M&E Plan FrameworkIndicators Data Collection Data Quality Data Use and Reporting Evaluation Strategy Budget Part of the

Validity and Reliability: Hitting the Target

NOT ValidNOT Reliable

Reliable butNOT valid

X X X X X X X X X X

XXX XXXXXXX

Reliable AND Valid!!!

XXX

XXXXXXX

Adapted from: http://www.cpc.unc.edu/measure presentation by Win Brown, USAID/South Africa, School of Health Systems and Public Health, Monitoring and evaluation of HIV/AIDS Programs, Data Quality; March 2, 2011.

Page 6: Collecting High-Quality Data. M&E Plan FrameworkIndicators Data Collection Data Quality Data Use and Reporting Evaluation Strategy Budget Part of the

Precision

Indicator Description

Treatment success rate Cure PLUS completed treatment

Indicator Description

Treatment success rate All patients in the cohort:- with smear conversion and - who completed full coursenegative smear at 5 months of treatment but do not PLUS meet cure definition

DIVIDED BY:Total number of smear-positive patients in the treatment cohort

MULTIPLIED BY: 100

Which indicator description will yield the most precise result?

Page 7: Collecting High-Quality Data. M&E Plan FrameworkIndicators Data Collection Data Quality Data Use and Reporting Evaluation Strategy Budget Part of the

Completeness

Often related to:• ease of collecting and reporting data• data sources• training

NGOpartner

Number of members participating in social

mobilizationComment

Friends of TB Not available Participant log not maintained

TB Matters 10

TB Helpline Not available Unclear how to determine who actively participated

Stop TB NOW! 12

TOTAL ???

Page 8: Collecting High-Quality Data. M&E Plan FrameworkIndicators Data Collection Data Quality Data Use and Reporting Evaluation Strategy Budget Part of the

Timeliness

1. Are we meeting internal and external deadlines?• Communicate expectations clearly.• Offer support to collect/analyze where needed

(budget?).

2. Are we analyzing results often enough to be useful for program management?• The sooner we know about a problem, the sooner

we can fix it!

Page 9: Collecting High-Quality Data. M&E Plan FrameworkIndicators Data Collection Data Quality Data Use and Reporting Evaluation Strategy Budget Part of the

Integrity

• Often difficult and sensitive topic.• Routine verification from the start can help

avoid bias of any kind.

• A partner submits perfect reports every month on time and meets or exceeds targets.

• A partner submits reports with a few errors every month, sometimes 1-2 days late; usually meets or comes close to targets.

Which data would you verify and why?

Page 10: Collecting High-Quality Data. M&E Plan FrameworkIndicators Data Collection Data Quality Data Use and Reporting Evaluation Strategy Budget Part of the

Data Quality Plans

How can we ensure: Strategy Resources

Validity

Reliability

Completeness

Precision

Timeliness

Integrity

Page 11: Collecting High-Quality Data. M&E Plan FrameworkIndicators Data Collection Data Quality Data Use and Reporting Evaluation Strategy Budget Part of the

Helpful Resources

MEASURE Evaluation Project

Data Quality

http://www.cpc.unc.edu/measure/tools/monitoring-evaluation-systems/data-quality-assurance-tools

Data Use

http://www.cpc.unc.edu/measure/our-work/data-demand-and-use


Collecting High Quality Data: Accurate Data · Why is quality control important? ... – Data on the interview and surveyor – Repeating questions from the original interview

1 Collecting Special Pops Data in California Chuck Wiseley CCC Chancellor’s Office Data Quality Institute – Phoenix 2006

Collecting and Monitoring Quality Data

Collecting Data

Collecting High Quality Evaluation Data and Successfully ......December 8-10, 2014 Collecting High Quality Evaluation Data and Successfully Completing Your First DFC Progress Report

Collecting High Quality Outcome Data: Part 2virginiaservice.virginia.gov/wp-content/uploads/2016/02/collecting... · Collecting High Quality Outcome Data: Part 2 ... Analyze pilot

Overcoming Barriers to Collecting and Reporting Encounter Data · Top barriers to encounter data quality 1. Legacy technology impacting data quality 3. Coding discrepancies between

Collecting Data Sensibly

Forum Guide to Collecting and Using Attendance Data Cooperative Education Statistics System ... Improving student attendance data quality, ... Forum Guide to Collecting and Using Attendance

Collecting Data: Sampling

1 The Good, the Bad, and the Ugly: Collecting and Reporting Quality Performance Data

COLLECTING STATISTICAL DATA

Challenges in Collecting and Measuring Quality Data …caltcm.memberclicks.net/assets/2011CALTCMsyllabus/bakerjian ppt.pdfChallenges in Collecting and Measuring Quality Data in QAPI

Collecting Twitter Data

Collecting Applicant Data: The Perils of NOT Collecting the Right Data

Collecting Data 2

Collecting Small Watershed Runoff and Water Quality Data ...nrt.tamu.edu/media/637223/stormwatertempleoct2013-reduced.pdf · Collecting Small Watershed Runoff and Water Quality Data

Collecting Data - SAGE Publications · 5 Collecting Data 105 CHAPTER Collecting Data Qualitative data collection techniques Quantitative data collection techniques Interviews Journals

COLLECTING AND REPORTING ACCURATE DATA Three States Discuss Their Strategies for Advancing Data Quality

Cutting costs, boosting quality and collecting data real ...siteresources.worldbank.org/INTLAC/Resources/257803-126939003402… · Cutting costs, boosting quality and collecting data

Data is your Friend Collecting, Charting, Analyzing, and ... · Data is your Friend Collecting, Charting, Analyzing, and Interpreting Data to Support Quality ... Run Charts Four (probability-based)

Collecting High Quality Outcome Data, part 2

Tool for Collecting Quality Data for

Quality and Outcomes Framework Assessor Training Collecting and Analysing Data Module S4

1 The Challenge of Collecting and Maintaining Quality Data – Overview of U.S. Toxics Release Inventory Data Quality Activities U.S. PRTR – Toxics Release

Key Elements of High Quality Performance Data...Objectives • Understand the importance and benefits of collecting high quality data • Identify and understand the five quality data

Data Handling Collecting Data

Collecting Data: Experiments

Commissioning for Quality and Innovation (CQUIN)€¦ · 4b 4c 4d Understanding Performance: Monitoring performance Collecting quarterly data: approach to auditing Collecting quarterly

Collecting Data Technique

Collecting Qual Data

Collecting High Quality Outcome Data: Part 2€¦ · Collecting High Quality Outcome Data: Part 2 Implementing Data Collection After identifying a data source, method and instrument:

Collecting Data Electronically in Developing Countries - IFS · Collecting Data Electronically in Developing Countries ... Collecting Data Electronically in Developing Countries Author:

Collecting High Quality Outcome Data: Part 1 Collecting High Quality Outcome Data Copyright © 2012 by JBS International, Inc. Developed by JBS International

COLLECTING YOUR OWN DATA: IMPROVING DATA QUALITY …cyfs.unl.edu/cyfsprojects/videoPPT...IMPROVING DATA QUALITY THROUGH QUALTRICS SURVEY DESIGN. Overview ... oContingency items can