Monitoring & Monitoring & Evaluation Evaluation

in World Bank Agriculture in World Bank Agriculture and Rural Development and Rural Development

OperationsOperationsSASAR Monitoring & Evaluation SASAR Monitoring & Evaluation

WorkshopWorkshop

New Delhi; June 20, 2006New Delhi; June 20, 2006

Purposes of M&EPurposes of M&E

Improve design or Improve design or implementation during projectimplementation during project

Planning and allocating Planning and allocating resourcesresources

Measure and demonstrate Measure and demonstrate resultsresults

Inform future decision-making Inform future decision-making and project designsand project designs

What Is M&E?What Is M&E?

There is a difference between M and E!There is a difference between M and E!

Monitoring:Monitoring:The gathering of evidence to show what progress has been made in the implementation of programs. Focuses on inputs and outputs.

Evaluation:Evaluation:Measuring changes in outcomes and evaluating the impact of specific interventions on those outcomes.

Complementary Roles for Complementary Roles for Monitoring and EvaluationMonitoring and Evaluation

MonitoringMonitoring

Routine collection Routine collection of informationof information

Tracking Tracking implementation implementation progressprogress

Measuring Measuring efficiencyefficiency

““Is the project doing Is the project doing things right ?”things right ?”

EvaluationEvaluation Analyzing Analyzing

informationinformation Ex-post assessment Ex-post assessment

of effectiveness of effectiveness and impactand impact

Confirming project Confirming project expectationsexpectations

Measuring impactsMeasuring impacts

““Is the project doing the Is the project doing the right things?”right things?”

Steps to Design a M&E Steps to Design a M&E SystemSystem

Plan for M&EPlan for M&E Developing the Results FrameworkDeveloping the Results Framework Determine information sources and Determine information sources and

designdesign Plan to analyze and use resultsPlan to analyze and use results Complete and test the systemComplete and test the system Annual self-assessments and Annual self-assessments and

periodic external evaluationperiodic external evaluation

The M&E PlanThe M&E Plan

What? What? Type of information and data to be Type of information and data to be

consolidatedconsolidated How? How?

Procedures and approaches including Procedures and approaches including methods for data collection and analysismethods for data collection and analysis

Why? Why? How the collected data will support How the collected data will support

monitoring and project managementmonitoring and project management

The M&E PlanThe M&E Plan

When?When? Frequency of data collection and Frequency of data collection and

reporting reporting

Who? Who? Focal points and resource persons. Focal points and resource persons.

Responsibilities and capacities.Responsibilities and capacities.

Institutional and Human Institutional and Human Capacity RequirementsCapacity Requirements

Establishing an M&E UnitEstablishing an M&E Unit Centralized/project specificCentralized/project specific Collaboration across co-implementing Collaboration across co-implementing

institutions institutions Institutionalizing and Harmonizing M&E Institutionalizing and Harmonizing M&E

systemssystems Facilitates sector wide planning, Facilitates sector wide planning,

development of policies and knowledge development of policies and knowledge sharingsharing

Allocate sufficient time and resourcesAllocate sufficient time and resources

Data Collection & Data Collection & AnalysisAnalysis

Prior to project start Prior to project start Baseline data: at an absolute minimum Baseline data: at an absolute minimum

baseline data are required on each baseline data are required on each outcome indicator and results indicator.outcome indicator and results indicator.

During the course of the projectDuring the course of the project Data on implementation, physical and Data on implementation, physical and

financial progress.financial progress. At critical junctures and project At critical junctures and project

completioncompletion Data for assessing achievements and Data for assessing achievements and

impacts.impacts.

Some Data Collection Some Data Collection MethodsMethods

Formal SurveysFormal Surveys Household SurveysHousehold Surveys Core Welfare Indicators Questionnaire (CWIQ)Core Welfare Indicators Questionnaire (CWIQ) Client Satisfaction (or Service Delivery) Client Satisfaction (or Service Delivery)

SurveysSurveys Citizen Report CardsCitizen Report Cards

Participatory MethodsParticipatory Methods Participatory M&EParticipatory M&E

Public Expenditure Tracking SurveysPublic Expenditure Tracking Surveys Remote SensingRemote Sensing

Project Management Project Management Information SystemInformation System

What is it? What is it? System for collection, analysis, storing System for collection, analysis, storing

and dissemination of project informationand dissemination of project information Supports management in making timely Supports management in making timely

and effective decisions for planning, and effective decisions for planning, monitoring and managing a monitoring and managing a project/programproject/program

Generally consists of accounting software Generally consists of accounting software and a database management systemand a database management system

M&E in the Project CycleM&E in the Project Cycle

PreparationPreparation M&E planning, Results Framework, M&E planning, Results Framework,

baseline survey, resource allocation, baseline survey, resource allocation, reporting formats, capacity assessmentreporting formats, capacity assessment

AppraisalAppraisal Development of detailed M&E plan, Development of detailed M&E plan,

manual of procedures, preparation of manual of procedures, preparation of ToRs, M&E training program, agree on ToRs, M&E training program, agree on Results FrameworkResults Framework

M&E in the Project CycleM&E in the Project Cycle

Between end-of-negotiations and Between end-of-negotiations and project effectivenessproject effectiveness M&E unit established M&E unit established Baseline completedBaseline completed

Implementation & SupervisionImplementation & Supervision ISRISR Mid-term ReviewMid-term Review

Implementation and CompletionImplementation and Completion ICRICR Sustainability of M&E systemsSustainability of M&E systems

Necessities for Necessities for Successful M&ESuccessful M&E

M&E must have strong ownership and support M&E must have strong ownership and support from leadersfrom leaders

M&E requires expert supportM&E requires expert support

M&E needs broad stakeholder consultation in M&E needs broad stakeholder consultation in defining and setting target indicatorsdefining and setting target indicators

M&E training is essential for successM&E training is essential for success

M&E systems have to be user-friendlyM&E systems have to be user-friendly