WMO

Monitoring & Evaluation System

(Measuring our Performance/Success)

2

Monitoring & Evaluation

Background Information

Cg-XVI (para 8.4.1-8.4.4)

- WMO Monitoring & Evaluation System - WMO M&E Manual

Methods for collecting data on each KPI

- Departments - EC WG/SOP

3

WMO M&E System

4

WMO M&E System

OBJECTIVES

• To enable senior management and programme managers of the Secretariat, the WMO constituent bodies and the scientific steering committees of WMO joint programmes to track the progress of the Organization’s activities, enhance performance and impact, and identify areas where corrective action is required with respect to activities and deliverables.

• To enable the Secretariat to demonstrate organizational effectiveness, efficiency, accountability and transparency externally and when reporting to WMO governing bodies.

• To facilitate dialogue and discussions at meetings of WMO constituent bodies, with partner organizations and donors, as well as other stakeholders.

5

WMO M&E System

ESSENTIAL PROPERTIES

• connecting the outcomes achieved to the use of resources, implementation of activities and production of deliverables/outputs.

• a bottom-up, flexible approach

• will evolve, over time

• focussed on programme improvement and on identifying new approaches

• quality assurance of performance data

• an integrated approach to monitoring and evaluation

• consistent with the WMO Quality Management Framework initiative and the ISO 9004:2000 quality management systems

• cost-efficient

6

WMO M&E System

Performance Measures

• Performance metrics • KPIs and expected results• KPTs and deliverables

• Performance baselines• Performance targets

7

KEY QUESTIONS

• What activities have taken place?

• What deliverables/outputs have been realised from the implemented activities?

• What outcomes have been realised from the accomplished deliverables/outputs?

• What has been the impacts (effects) and result of these outcomes?

• How have we contributed to the strategic results?

• How can we prove all of this?

8

The Monitoring Process

First Level Monitoring

Second Level Monitoring

Institutional Monitoring

Organizational Monitoring

9

The Evaluation Process

Self Evaluation

Independent Evaluation

10

Baseline/Impact

Establishing Baseline

Impact Assessment

11

Data Collection

What type of data needs to be collected in order to track the progress of the KPI and later evaluate its achievements?

• Quantitative data: Questionnaire on Impacts of Achieved Results on Members

• Qualitative data: Reports from Working Groups

12

Expected Result 5

Enhanced capabilities of Members to contribute to and draw benefits from the global research capacity for weather, climate, water and the related environmental science and technology development.

Key Outcome 5.2: Research in the prediction of high-impact weather on time scales of hours to seasons is enhanced

KPI 5.2.1: Increased research on operations products and services

KPI 5.2.2: Improvements in the number of internationally coordinated NMHS in developing and least developed countries contributing to relevant regional and international research initiatives, weather research initiatives and/or forecast demonstration projects completed

13

Expected Result 5

Key Outcome 5.2: Research in the prediction of high-impact weather on time scales of hours to seasons is enhanced

KPI 5.2.3: Increased research on operations products and services

Key Outcome 5.4 Seamless forecasts of weather, climate, water and the environment from months to seasons are developedKPI 5.4.1: Increase in the implementation of WMO Global Integrated Forecast System by NMHSsKPI 5.4.2: Improvement in skill of monthly to seasonal forecasting systems

14

Expected Result 5

Key Outcome 5.5: Predictions/projections of El-Nino/Southern Oscillation (ENSO) and monsoons are improved

KPI 5.5.1: Improvements in the skills of ENSO and monsoon forecastsKPI 5.5.2: Satisfaction in the predictions/projections of ENSO and monsoons

15

KPI Indicator Sheets

16

KPI Indicator Sheets

17

KPI Reference Sheets

18

THANK YOU