3rd results- based m&e workshop

ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1

3rd Results- Based M&E Workshop

3rd APCoP-MfDR Results-Based M&E Workshop

Session 1 Finalizing the M&E Capacity Gaps on the Four Attributes covered

during the 2nd WorkshopBallroom 1

Intercontinental Hotel Phnom Penh, Cambodia

28-30 June 2011

04/20/23 Institutionalizing M&E System in Cambodia 1

ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 104/20/23 Institutionalizing M&E System in Cambodia 2


Summary of 2Summary of 2ndnd M&E Workshop M&E Workshop Objectives: Institutionalizing M&E System Objectives: Institutionalizing M&E System

Summary of 2Summary of 2ndnd M&E Workshop M&E Workshop Objectives: Institutionalizing M&E System Objectives: Institutionalizing M&E System

To determine the gaps To determine the gaps in institutionalizing in institutionalizing M&E System M&E System

To determine the gaps To determine the gaps in institutionalizing in institutionalizing M&E System M&E System

To assess the level of To assess the level of understanding of MfDR understanding of MfDR and M&Eand M&E

To assess the level of To assess the level of understanding of MfDR understanding of MfDR and M&Eand M&E

Harmonized Capacity Building Strategies Harmonized Capacity Building Strategies for Institutionalized M&E System for Institutionalized M&E System Harmonized Capacity Building Strategies Harmonized Capacity Building Strategies for Institutionalized M&E System for Institutionalized M&E System

MfDR and M&E: Relational Function Institutionalizing M&E System in Country Settings Briefers on Core Attributes of M&E System

MfDR and M&E: Relational Function Institutionalizing M&E System in Country Settings Briefers on Core Attributes of M&E System

Break Out Break Out SessionsSessionsBreak Out Break Out SessionsSessions

Plenary Plenary Sessions Sessions Plenary Plenary

Sessions Sessions

Shared Knowledge-Resources Shared Knowledge-Resources In RDMs In RDMs

Shared Knowledge-Resources Shared Knowledge-Resources In RDMs In RDMs

RDM PanelRDM PanelPresentationsPresentationsRDM PanelRDM Panel

PresentationsPresentations

To identify Capacity Building To identify Capacity Building Strategies in institutionalizing Strategies in institutionalizing M&E SystemM&E System

To identify Capacity Building To identify Capacity Building Strategies in institutionalizing Strategies in institutionalizing M&E SystemM&E System

Identified capacity gaps in delivering M&E functions

Identified capacity gaps in delivering M&E functions

Capacity Development Needs M&E System by RDMs

Capacity Development Needs M&E System by RDMs

Opening Session: In

troduction


2nd Results- Based M&E Workshop


Monitoring

Reports progress to managers and alerts them to problems

Routinely collects data on these indicators, compares actual results with targets

Translates objectives into performance indicators and set targets

Links activities and their resources to objectives

Clarifies programme objectives

Provides lessons, highlights significant accomplishment or program potential, and offers recommendations for improvement

Explores unintended results

Examines implementation process

Assesses specific causal contributions of activities to results

Analyses why intended results were or were not achieved

Evaluation

Complementary Roles of Results-Based Monitoring and Evaluation


2nd Results- Based M&E Workshop


Monitoring

Analysis and reporting specified

Data Management Systems specified (Data encoding, programming, processing and reporting)

Institutional responsibilities defined

Indicators from planning

Stakeholders engagement

Results dessiminated or shared

Institutional responsibilities defined

Methodology formulated or designed

Evaluation

With reference to APCOP MfDR Framework Attributes of Results-Based Monitoring and Evaluation


Level of Results

66

MfDR in Rural Development Workshop MfDR in Rural Development Workshop 6/7 December 20106/7 December 2010


A paper or computer-based tracking mechanism which is indicator-driven, outcome-led and impact-based derived from developed results of any specified intervention strategy, capturing changes contributing to the effectiveness and efficiency of any program development initiatives and setting.

M&E System Defined


2.

Indicators

Or Perfo

rmance

Measures

1. Project Goals, Purposes, Objectives, and Specific Objectives

3. Results-Based Management Logframe

8. Information

Sharing and

Exchange or

Feedback Mechanism

Results

4. Development of tools

and forms

5. Data Management : Data Collection, Encoding and Programming Information Processing and Analysis

7. Interim Evaluation:Formative or Summative

6.In

stitu

tional

Arrangem

ent

M&E System and Capacity Building Framework

M&E System

ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1904/20/23 Institutionalizing M&E System in Cambodia

Key Results

Capacity development gaps identified

IndicatorsTools and FormsDatabase ManagementInstitutional Responsibilities

Identified the Capacity Gaps by RDMs

Across RDMs, Database Management needs a comprehensive capacity plan

Covered Four Core Attributes in M&E

Participants (27): MAFF, MRD, MOWRAM, MOP and ADB

Refine the Capacity Development Actions

Discussion on the capacity development actions for each gap identified

Summary of the 2nd Workshop

ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1AP-CoP MfDR

Participants’ Feedback

•The capacity gaps in delivering M&E system were identified

•The attributes of M&E to the results-based public sector management framework were linked.

•The conduct of the workshop was effective, timely and relevant to the need of the ministries.

•The sessions facilitated their learning in appreciating MfDR, Results-Based Public Sector Management (RBPSM) and M&E

•The changes of their management in the respective ministries should be encouraged towards adopting the use of M&E system specifically on tools and forms, among others;

•The discussions on M&E and Results-based PSM should continue and the participants see themselves as part of the country based networks or CoPs.

•The capacity gaps in delivering M&E system were identified

•The attributes of M&E to the results-based public sector management framework were linked.

•The conduct of the workshop was effective, timely and relevant to the need of the ministries.

•The sessions facilitated their learning in appreciating MfDR, Results-Based Public Sector Management (RBPSM) and M&E

•The changes of their management in the respective ministries should be encouraged towards adopting the use of M&E system specifically on tools and forms, among others;

•The discussions on M&E and Results-based PSM should continue and the participants see themselves as part of the country based networks or CoPs.

ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1AP-CoP MfDR

Comments: 2nd M&E Workshop

Current M&E staffs either delegated or appointed are “trainable” individuals whose current skills could be “up-scaled” if and when appropriate M&E learning packages were to be designed;

Interfaces on the functionality of the M&E system via institutional arrangement has to be integrated within the line ministries, national agencies and partners by adopting a common mechanism across RDMs;

Despite an approved sub-decree creating Monitoring and Evaluation System, as a function within the Ministry of Planning and with the RDMs has not been established

A Monitoring and Evaluation System have not been established. However, some components of the M&E system which have been existing were not linked to each other’s functionality and in some ways disjointed;


Welcome to the 3rd APCOP-MfDR Results-Based M&E

Workshop for Rural Development Ministries in Cambodia

Session 3 : Identifying Capacity Development Gaps and Actions for

Institutional Logframe

04/20/23 12Institutionalizing M&E System in Cambodia

Results-Oriented M&E Workshop

ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 104/20/23 Institutionalizing M&E System in Cambodia


Elements M&E Core Attribute 5: Determining Capacity Gaps in developing Institutional Logframe

Yes/No

If YES, Specific Capacity Gap

Specific Action(s) Remarks

1Program or Project goals are clearly stated Yes - Unit established but lack

of practical knowledge, skill and experiences

- Institutional strengthening and long-term HR development

2Linkage between activities, results, purpose and objectives of the program, project, or policy in a hierarchy indicated

No

3Performance indicators of projects or programs identified

Yes -Harmonize sector indicator and NSDP, i.e. rural water supply and sanitation

- Harmonize indicators: Cencus, CSES, JMIs…

4Sources of information for the indicators identified

Yes -Lack reporting mechanism and institution

- Set up reporting mechanism: information and institution

5Assumptions for the performance indicator agreed

Yes -Lack of agreed (consolidate) indicator

-Harmonization and alignment

6Risks of achieving the performance indicator documented

Yes - Long-term budget - Ensure long-term budget support

7 The 4 x 4 (Four by Four) Matrix showing the methodical manner and causal logic developed

No -Individual project/program based- Consolidate

8 Project or program operational plans assisted with reference to the logframe developed

No -As above

Note(s):




Session 5 : Identifying Capacity Development Gaps and Actions for Data Quality Assessment, Analysis

and Reporting



ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 104/20/23 15Institutionalizing M&E System in Cambodia


Elements M&E Corel Attribute 6: Determining capacity gaps in completing Data Quality Assessment, Analysis and Reporting

Yes/ No

If YES, Specific Capacity

Gap

Specific Action(s)

Remarks

1 Critical indicators identified Yes Lack of harmonization and alignment

Consultative

2 Procedures to assess critical indicators followed

Yes Single Project/program

Standardize

3 Variables for the indicator(s) encoded and processed

Yes Knowledge and skill TA and applications and equipments

4 Variables validated Yes As above As above

5 Sampling or selection strategy identified Yes Not fully applied As above

6 Quantitative and or qualitative analysis designs utilized

Yes Not fully applied As above

7 Linking quantitative and qualitative data Yes Not fully applied As above

8 Statistical measures in quantitative data used Yes Not fully applied As above

9 Deductive or inductive method of analysis in qualitative data used

Yes Not fully applied As above

10 Format of reporting of results agreed Yes Not yet standardized

Consultative

11 Schedules of reporting specified No

12 Reports published or shared Yes Not yet fully shared Consultative

13 Implementing partner(s) or agencies informed Yes Not fully informed As above

14 Specific visit(s) or mission(s) scheduled Yes Not yet systematic As above

Note(s):




Session 7 : Identifying Capacity Development Gaps and Actions for Evaluation Designs, Methodology

and Approaches





Elements M&E Corel Attribute 7: Identifying capacity development gaps in Evaluation Designs, Methodology and Approaches

Yes/ No

If YES, Specific

Capacity Gap

Specific Action(s) Remarks

1 Evaluation designs or models determined

2 Evaluation methodologies specified

3 Evaluation plan matrix agreed

4 Parameters or measures established

5 Sampling methodologies identified

6 Baseline data collected

7 Critical data used for evaluation quality-assessed

8 Data analysis addressed

9 Results level subject to evaluation clarified

10 Changes in interventions documented

11 Indicators for evaluation exercise addressed

12 Statistical models for evaluation formulated

13 Evaluation conduct specified (sub-contract, external, joint, etc)

14 Effectiveness, efficiency and relevance directly responded

15 Presenting evaluation results planned

16 Evaluation results reported and shared

17 Ethical concerns (standards, guidelines, etc. ) addressed




Session 8 : Identifying Capacity Development Gaps and Actions for

Feedback Mechanism





Elements M&E Corel Attribute 8: Feedback mechanism

Yes/ No

If YES, Specific Capacity

Gap

Specific Action(s)

Remarks

1 Feedback questionnaires for key stakeholders developed

2 Evaluation results supported

3 Evaluation results as tool for decision making used

4 Assumptions and risks to project implementation reviewed

5 Key stakeholders’ opinions shared

6 Exchange of opinions documented

7 Feedback from stakeholders available in customized e-portals or other forms of information sharing mechanism

8 Response(s) on effectiveness and efficiency of projects/program recorded.

Note(s):

3rd results- based m&e workshop

Documents