project cycle management for international development cooperation indicators teacher pietro celotti...
TRANSCRIPT
Project Cycle Management for
International Development
Cooperation
Indicators
TeacherPietro Celotti
Università degli Studi di Macerata
16 December 2011
Agenda
Background
Definition and types of indicators
Monitoring
Quality of the indicator system
Programmes and projects
Programme
Project 1
Project n
Project …
Financial contribution from programmes to projects
Information (e.g. progress reports) concerning the status of implementation
to the authorities responsible for the programme -> support the day to day
management
Agenda
Background
Definition and types of
indicators
Monitoring
Quality of the indicator system
Indicators: what is needed?
Definition
Unit of measurement
Source of information (going from internal to external)
Baseline (i.e. the initial value against which an indicator is subsequently measured)
Refers to local context; or
Refers to activities in previous programmes
Target (combined with baseline information, provides information concerning the importance of the planned interventions)
Current status
Project indicators - Output
Output indicators: direct products of the project
Normally requires information from beneficiaries
Project indicators - Results
Result indicators:
relate to the direct and immediate effect on direct beneficiaries brought about by a project. They provide information on changes to, for example, the behaviour, capacity or performance of beneficiaries.
Project indicators - Output
Indicator type Indicator Name Unit
Output Length of rehabilitated/modernized county roads KM
ResultsIncrease passengers and freight traffic on the rehabilitated, constructed, modernized roads
%
Other examples - Regional and local transport infrastructure :
Project indicators - Output
Indicator type Indicator name Unit
OutputInhabitants benefiting from the implementation of integrated urban development plans
N
Other examples - Sustainable development of urban growth poles:
ResultCompanies established in the “urban action zones”
N
Project indicators - Output
Indicator type Indicator Name Unit
OutputRehabilitated/equipped health care mobile units (total and by type)
N
Other examples - Social Infrastructure:
Result Average response time of mobile units N
Project indicators - Output
Indicator type Indicator Name Unit
Other examples - Regional and local business environment:
Output Micro-enterprises created and supported N
ResultsNew jobs created in the supported micro-enterprises
N
Project indicators - Output
Indicator type Indicator Name Unit
Other examples - Sustainable development and promotion of tourism:
Output Tourism small infrastructures implemented N
Result Increase of overnights-staying %
Core indicators
Core indicators can be used to make comparisons or aggregations of data across similar programmes, priorities or measures.
How does it work? Programme authorities are required to include a number of ‘core’ indicators in their monitoring systems……
Programme indicators - Impacts
Impact indicators:
refer to the consequences of the programme beyond the immediate effects; often available only after a considerable time lag and they often need substantial methodological input in order to be valid.
At which stage of the programming cycle are they used?
during programme design, the ex-ante quantification of impacts clarifies the strategic direction of the programme;
ex-post, it helps understanding if the programme achieved the initial objectives (success or failure?)
Context indicators
Context indicators: reflect the socio-
economic conditions of a programme area
they enable to assess local needs of the programme area, to assess how the general context of a programme is evolving
Not just programme indicators…
Monitoring
Background
Definition and types of indicators
Monitoring
Quality of the indicator system
Indicators – Physical, financial, procedural
Physical indicators: describe the concrete ‘products’ of the programme;
Financial indicators: provide a basic picture for usage of the available resources (i.e. how fast? which priorities?):
Committed/spent; Year/Priority/Source of funding.
Procedural indicators: provide information on the current status of the operational level and forecasts for the next steps.
Physical monitoring
Example of physical monitoring:
Indicator (number of enterprises)
Unit of Measurement
Target Achievement
Micro N 142 91
Small N 133 111
Medium N 39 21
Owner (women) N 50 40
Owner (<30y) N 26 3
Start-up N 54 3
Financial monitoring
Example of financial monitoring:
Priority Expected expenditures
Resources committed
Expenditures
Amount Amount % Amount %
(a) (b) (b/a) (c) (c/a)
P1 133.4 100.4 75.2 71.8 53.9
Procedural monitoring
Most public activities have to follow a more or less rigid schedule in which the different steps are mandated and the deadlines fixed (i.e.). Procedural monitoring usually provides information about how project pipelines are progressing (where and when calls for tenders have been published, contracts have been awarded, …).
Demand
Procedural monitoring
Prio
rity
Ap
plic
atio
ns
Bein
g a
ssessed
Not e
ligib
le o
pera
tion
s
Elig
ible
not c
o-fu
nd
ed
Co-fu
nd
ed
op
era
tion
s
Sta
rted C
an
celle
d
Ren
ou
nced
Tota
l
Com
ple
ted
Bein
g im
ple
men
ted
P1 3,650 156 341 643 2,395 1,769 1,615 154 51 64
Implementation status (number of projects):
Project capacityMortality
Operational efficiency
Monitoring and evaluation
• Monitoring =information about the ongoing situation
• Evaluation = analysis (using monitoring and additional data)
Indicators are not used just for the purpose of day to day management…
Monitoring and evaluation
Quantitative and qualitative data, used as
input in evaluation exercises.
Monitoring Evaluation
Lessons to improve monitoring systems – e.g. identify better
indicators for future projects / programming.
Monitoring: data are collected concerning the progress with respect to
stated objectives.
Evaluation: using monitoring and
additional data, provides policy recommendations.
Surveys of beneficiaries
Stakeholders interviews
Focus Group
Case studies
Participative techniques
Monitoring
Background
Definition and types of indicators
Monitoring
Quality of the indicator system
Quality - individual indicators
Timeliness: information concerning the indicator can be collected and reported in time to influence the managerial decisions.
Sensibility: interventions can influence the valorisation of the indicator. (e.g. supporting exports, better turnover
related to new customers reached through the programme than
general turnover)
Availability: this means that the costs necessary to collect information from sources must be reasonable.
Validity: understanding of the indicator shall be the same for every potential user.and… possible perverse effects…
Quality – indicator system
Coverage: adequate coverage of expected allocation of financial resources;
Balance: among the different categories of indicators;
Selection: capacity of the authorities to absorb data and information is limited!
Relevance: advanced development for indicators related to the most significant themes and interventions.
