1. 2 why are result & impact indicators needed? to better understand the positive/negative...
TRANSCRIPT
1
2
Why are Result & Impact Indicators Needed?
To better understand the positive/negative results of EC aid.
The main questions are:1. What change is needed?2. For whom?3. How to measure this change?
3
Why are Result & Impact Indicators Needed?
1. Assist EC country teams to develop a set of indicators for the programming level (e.g. to guide development and monitoring of a Country Strategy Paper)
2. To fill, as much as possible, the 'missing middle' between implementation indicators and global impact indicators
4
The Missing Middle
Outputs Results(Outcomes)
Specific Impacts
Intermediate Impacts
Global Impacts
Implementation Programming
5
Education MDG’s
MDG 2 Achieve MDG 2 Achieve Universal Primary Universal Primary EducationEducation
MDG 3 Promote MDG 3 Promote Gender Equality & Gender Equality & Empower WomenEmpower Women
QualityLearning/
SkillsAccess(at alllevels)
“It is generally acknowledged that Uganda has been
successful in improving access, but it is felt that this was at the
cost of the quality of education.”Netherlands Education Sector Evaluation of Uganda, 2008
“School enrolment has increased …[but] weak
governance outcomes remain, such as teacher absenteeism
and the associated lack of teaching activity in schools.”
EC India Evaluation, 2007
“More than 90% of children in developing
countries are enrolled in primary schools and
54% attend secondary school.”
UNDP Website
6
Education Intervention Logic
Institutional Management
Curricula & Teaching Materials
Teacher Recruitment & Training
Education Facilities
Health
Better Allocation of Educational Resources
Increased Affordability of
Education
Optimal Employment
Skills and Learning
Enhancement
Equitable Access to Education
Quality of Education
Greater Income Opportunities
Economic Growth
Social Development
Poverty Reduction
OutputClusters
Results(Outcomes)
Specific Impact
IntermediateImpacts
GlobalImpacts
Improved Participation in
Society
Improved Family Planning &
Health Awareness
MDG 3
MDG 2
MDG 1
7
Result (Outcome) Indicators 1
Institutional Management
Curricula & Teaching Materials
Teacher Recruitment & Training
Education Facilities
Health
Better Allocation of Educational Resources
Increased Affordability of
Education
Optimal Employment
OutputClusters
Results(Outcomes)
Indicators
1. Transparent decision making
2. Cost for household
13. Employment: school/university construction and maintenance
14. Employment: teachers and government workers
8
Result (Outcome) Indicators 2
Institutional Management
Curricula & Teaching Materials
Teacher Recruitment & Training
Education Facilities
Health
Better Allocation of Educational Resources
Increased Affordability of
Education
Optimal Employment
Equitable Access to Education
Quality of Education
OutputClusters
Results(Outcomes)
Indicators
3. Absenteeism & Drop Out
4. Teacher ratios/rates
5. Qualification of teachers
6. Teaching material ratios
7. Transition & Repetition
8. Equitable education participation
9. Enrolment rate
10. Completion rate
11. Distance to school/university
12. School and university places
9
Specific Impact Indicators
Institutional Management
Curricula & Teaching Materials
Teacher Recruitment & Training
Education Facilities
Health
Better Allocation of Educational Resources
Increased Affordability of
Education
Optimal Employment
Skills and Learning
Enhancement
Equitable Access to Education
Quality of Education
OutputClusters
Results(Outcomes)
Specific Impact
Indicators
15. Literacy & Numeracy rates
16. Examination results
17. Social views
10
Intermediate Impact Indicators
Institutional Management
Curricula & Teaching Materials
Teacher Recruitment & Training
Education Facilities
Health
Better Allocation of Educational Resources
Increased Affordability of
Education
Optimal Employment
Skills and Learning
Enhancement
Equitable Access to Education
Quality of Education
Greater Income Opportunities
OutputClusters
Results(Outcomes)
Specific Impact
IntermediateImpacts
Indicator
Improved Participation in
Society
Improved Family Planning &
Health Awareness
18. Employability
11
The Missing Middle
Outputs Results(Outcomes)
Specific Impacts
Intermediate Impacts
Global Impacts
Implementation Programming
12
Attention
1. This is a simplified tool, not a template. Intervention logic must be developed for each country based on its context and existing government strategies
2. Indictors are not fixed but provide ideas on how to set, monitor and evaluate CSP objectives
3. Crosscutting issues should be mainstreamed into relevant indicators (e.g. disaggregation of data by gender)
4. Outcomes/Impact are not fully attributable to the EC Outputs are 100% attributable to the EC but attribution falls as you move up the chain of results
13
List of Key Indicators (with examples)
Affordability Result (Outcome) Indicators
1. Transparent decision making
- Implementation of transparent mechanisms to allocate resources between
sectors (e.g. using tools such as average cost ratios per student for different
educational levels)
2. Cost for Household
- Cost of education (i.e. fees, materials/equipment, lunches etc) as a % of
household expenditure; cost per student as a % of income per capita
Quality Result (Outcome) Indicators
3. Absenteeism and drop out
- Teacher/student absenteeism rates; drop out rates
4. Teacher ratios/rates
- Student teacher ratio; rate of double shifting
5. Qualification of teachers
- Average qualification of teachers at each educational level
6. Teaching material ratios
- Student textbook ratio
7. Transition and repetition
- Progression rates; repetition rates
Access Result (Outcome) Indicators
8. Equitable educational participation
- Ratio of girls to boys in primary, secondary and tertiary education; ratio of other
disadvantaged groups compared to x% of population
9. Enrolment rate
- Gross and net enrolment rates
10. Completion rate
- Gross and net enrolment rates
Specific Impact Indicators
15. Literacy and numeracy rates
- Literacy and numeracy rates by age, sex and social group
16. Examination results
- Examination results for various educational levels and subject areas by age, sex &
social group
17. Social views
- Support for violent conflict; prejudiced views towards other social groups
Intermediate Impact Indicators
18. Employability
- % of school leavers/graduates gaining paid employment (split by type of employment)
Optimal Employment Result (Outcome) Indicators
13. Employment: school/university construction and maintenance
- Number of people directly and indirectly employed in school/university construction and
maintenance
14. Employment: teachers and government workers
- Number of people directly & indirectly employed as teachers and
government workers linked to education sector
11. Distance to school/university
- x% of students within x kilometre of a school
12. School and university places
- Educational places as an x% of eligible students