Monitoring Process

ByDr.Shazia Zamir

NUML

Monitoring ProcessMonitoring is ongoing assessment of

how activities and materials are being implemented by whom, for whom, with whom, how, when and where.

Two important approaches to program evaluation are process and outcome evaluation which can be further divided into process and outcome monitoring. Process monitoring falls under the overall evaluation of a program.

Links between monitoring and evaluation

Dimension Monitoring Evaluation

Frequency Periodic, occurs regularly Episodic

Function tracking / oversight \Assessment

Purpose Improve efficiency, provide information forreprogramming to improve outcomes

Improve effectiveness, impact, value for money,future programming, strategy and policymaking

Methods Routine review of reports, registers, administrativedatabases, field observations

Scientific, rigorous research design, complex andintensive

Informationsource

Routine field observation,reports, progress reports, rapid assessment,program review meetings etc

Same sources used for monitoring, pluspopulation-based surveys, vital registration,special studies

Links between monitoring and evaluation

Dimension Monitoring Evaluation

Cost Consistent, recurrent costs spread acrossimplementation period

Episodic, often focused at the midpoint and endof implementation period

Who needs, uses M&E Information?

To Improve program implementation…

To Inform and improve future programs

Inform stakeholders

Managers

Donors Governments

Donors Governments Communities Beneficiaries

Who conducts M&E….?

Program implementer

StakeholdersBeneficiary

Remember .. M&E Technical skills

Participatory process

How to carry out M&E…? Key Features

1. Program Framework: Analyze and systematically lay out program elements

2. Identify key elements to monitor and evaluate.

3. Determine and describe the measures to be used for monitoring and evaluation

4. Develop M&E Framework and action plans, including data collection and analysis, reporting and dissemination of findings.

Framework for successful Process Monitoring

Step 1 Determine Purpose and Uses

Step 2 Develop Measurable Objectives

Step 3 Develop Evaluation Questions

Step 4 Collect/Gather Credible Evidence

Step 5 Analyze Information & Develop Conclusions

Step 6 Report Findings

Program Framework

What do you know about your program….?

Step 1 - Determine Purpose and Uses for Your Process Monitoring

Purpose Uses

The main purpose of process monitoring is to improve how things get done by answering questions about program operations, implementation, and service deliver

➡ To improve program implementation➡ Context for understanding effectiveness➡ Accountability ➡ Quality management

Program Framework

Systematic lay out of the program elements and path showing what the program plans to:

do ……………..achieve!

Step 2 - Develop Measurable Process ObjectivesProcess objectives are statements that

describe the specific implementation activities of an intervention for a specified population within a given timeframe. Process objectives focus on “implementation activities”

Step 3 - Develop Process Evaluation Questions

Once objectives are identified, you need to develop specific questions that you want your evaluation to answer. The focus of evaluation questions in process monitoring is describing the intervention activities including the human and other

resources needed to carry them out, the level of effort needed to accomplish each activity, and the time frames in which

the activities will be conducted.

Step 4 - Collect/Gather Credible Evidence for Process Monitoring

Process data can be collected at two levels: student-level and program-level.

Step 5 - Analyze Data & Justify Conclusions about Your Process MonitoringData Analysis – the process of

categorizing, ordering, manipulating, and summarizing data to obtain answers to evaluation questions.

Step 6 - Report Findings about Your Process Monitoring

Often times process monitoring serves an accountability function. Specifically,

data from process measures can provide information about the quality of the program or services.

Scope of Monitoring

From an accountability perspectiveFrom a management perspectiveFrom an evaluators perspective

M&E Questions

Monitoring questions◦ What is being done?◦ By whom?◦ Target population?◦ When?◦ How much?◦ How often?◦ Additional outputs?◦ Resources used?

(Staff, funds, materials, etc.)