monitoring and evaluation system · 2018. 11. 15. · information flow in map’s monitoring and...
TRANSCRIPT
Mesoamerican Agroenvironmental Program (MAP)Monitoring and Evaluation System
MAP is a platform that integrates actions in research, education and development in order to contribute to the solution of five of the global problems that affect the
Mesoamerican region: (i) poverty, (ii) gender inequity, (iii) food and nutritional insecurity, (iv) degradation of ecosystem services, and (v) vulnerability to Climate Change. MAP is a CATIE’s program that is financed with Norwegian cooperation.
MAP entered its second phase (MAP Norway) in June 2013. This phase was designed and is being implemented under the Climate Smart Territories (CSTs) approach in two key territories: Trifinio (frontier region of El Salvador, Honduras and Guatemala) and NicaCentral (north-central area of Nicaragua).
MAP impact pathwayImpact pathway can be defined as a sequence of steps to be followed in order to achieve the expected outcomes in order to impact people’s livelihoods. The impact pathway is a useful tool to guide project management in complex environments such as sustainable rural development. It is built on a theory of change that describe how project outputs are developed with, and used by, others to achieve chains of outcomes that contribute to eventual impact on social, environmental or economic conditions. The Impact pathway is the basis for the development of Monitoring, Evaluation (M&E) and Impact Assessments systems. (Alvarez et. al. 2008, CCAFS, 2015). MAP’s impact pathway is presented in Figure 1.
Leida Mercado Programa AgroambientalMesoamericano (MAP)CATIE, Turrialba, Costa RicaTel. + (506) [email protected]
Leonardo AguilarPrograma AgroambientalMesoamericano (MAP)CATIE, Turrialba, Costa RicaTel. + (506) [email protected]
What are the benefits of having a monitoring and evaluation system?1. Allows tracking, over time, of the families, farms, home gardens, community gardens, organizations, institutions and platforms with
which we work.
2. Provides a secure and integrated source of information that incorporates quality controls and can be used by the program.
3. Monitors performance and effect to measure the program’s progress.
4. Provides the ability to perform simple or complex information queries and obtain the data immediately.
5. Can check key aspects of the project in real time through graphics.
6. Provides information that offers very useful inputs to support research conducted by the program.
7. Has flexibility to incorporate new reports or queries since it was developed from open-source software tools, which allows easy updating and future improvements.
8. Allows access to system information from anywhere in the world simply by entering your Internet browser.
9. Preserves the information and knowledge generated by the program.
ReferencesAedo, Cristian. 2005. Evaluación del impacto. Series Manuales 47. CEPAL División de Desarrollo Económico y GTZ.Bernal, Raquel y Peña, Ximena. 2010. Guía práctica para la evaluación de impacto. CEDE, Facultad de Economía, Universidad de losAndes. Bogotá: Ediciones Uniandes. 336 p. Desarro. soc. no.66 Bogotá July/Dec. 2010.Alvarez, S., Douthwaite, B., Thiele, G., Mackay, R., Cordoba D. and Tehelen, K. 2008. Participatory Impact Pathways Analysis: a practical method for project
planning and evaluation. Paper prepared for: ‘Rethinking Impact: Understanding the Complexity of Poverty and Change’ Workshop. March, 2008. Available at http://www.researchgate.net/profile/Boru_Douthwaite/publication/237079470_Participatory_Impact_Pathways_Analysis_a_practical_method_for_project_planning_and_evaluation/links/02e7e51f98ee4d6229000000.Visited June 30th, 2015.
CCAFS. Impact Pathways. https://ccafs.cgiar.org/impact-pathways-0#.VZgbBuv3FVo. Visited June, 30th, 2015.
INPUTS
INTERVENTIONS
PRODUCTS
OUTCOMES
IMPACTS
• CATIE´s Researchers and Specialists
• CATIE´s tools and methodologies• Farm Field Schools• Territorial Business Training
School• Participatory agricultural
landscape assessment of adaptive capacity
• Farm and landscape planning
• Participatory Research
• Productive inputs (seed, other) • Monitoring
• Training-of-trainers (TOT)
• Gender sensitive training
• Planning of sustainable:•home gardens/farms•business organizations•territorial platforms•use of agro-biodiversity and improve
food preparation
• Crowdsourcing for seed selection
• Weather information networks
• Development of investment plans
• Knowledge exchange and sharing of best practices
• Five thousand families (5,000 females and 5,000 male) trained in:•innovative technologies•use of weather information•improving nutrition•business plans
• Four thousand home-garden and farm plans implemented
• At least five germplasm/seed banks established and five mechanism of genetic resources exchange
• Thirty business organizations developed that implement gender and CC sensitive business plans
• Six platforms trained in CST key issues
• Results of at least 40 research projects with recommendations to improve livelihood systems, territorial management, adaptation to CC
• R1. Five thousand families increased their assets and improved equity in family decision making for food and nutritional security
• R2. Five thousand farms and home gardens (HG) increased and diversified agroecological and agroforestry production
• R3. Thirty business organizations increased capacity and access to markets
• R4. Six platforms improved enabling conditions to implement CSTs.
• R5. CSTs approach scaling up and out
• Reduction in rural poverty
• Reduction in food and nutritional insecurity
• Reduction in gender inequality
• Reduction of vulnerability to climate change
• Reduction in degradation and loss of ecosystem services
http://map.catie.ac.cr
Autores:
http://map.catie.ac.cr
Figure 1. MAP impact pathway
Information flow in MAP’s monitoring and evaluation systemMonitoring in MAP is a continuous and systematic process that allows obtaining and processing information on progress toward achieving program results. The system enables management of information from information gathering to its validation, storage and use, making it possible to monitor and follow-up the actions and the effects produced by the program.
MAP monitoring and evaluation system main featuresMAP monitoring and evaluation system (MAP’s M&ES) is a tool that enables the program to monitor the actions it carries out, as well as to measure progress toward expected results. The system was developed based on the program’s logical framework.
Site(Farm, garden, research plot)
Regional platforms
Organizations/Institutions (Producer, Business, Governmental, Non-Governmental Educational)
Families
People
Related to
Consisting of
Linked to
Grouped in
Results-Based Management
MAP Norway Logical
Framework Res
ult
s
Performance Indicators
Output Indicator
Monitoring and
Evaluation System
MAP´s M&ES main features:• 25 graphics of the program’s key aspects
• 22 performance indicators
• 12 outcome indicators
• 7 information sheets (family, farm, home garden, plans, people, institution, documents)
• A mechanism for complex searches that permits extraction of information in more than 10,000 different combinations
• 24 forms to enter data, which are made up of more than 3,000 fields
Performance indicators: measure progress of actions toward achievement of expected outputs.Outcome indicators: measure progress in the changes sought at the end-user level, both in the short and medium term. To a great extent, these changes are generated as a result of program actions.
Flexibility of MAP’s Monitoring and Evaluation SystemThe system was designed to be flexible, with a structure that has basic elements that enable adaptation of the M&ES to other initiatives that work with the following elements:
M&ES database
MAP’s monitoring and evaluation system
Monitoring Outcomes
Monitoring performance
Gather information Enter information in M&ES
Validate informationentered in system
Facilitator Digitator Verifier
MAP’s monitoring and evaluation users
MAP’s monitoring and evaluation system users• MAP team
• CATIE community (students, managers, researchers)
• Donors
• Local partners (producer organizations, territorial platforms)
• Research partners (Bioversity, ICRAF, CCAFS, FTA)
Impact assessment (IA)The purposes of IA is to determine whether an intervention (be it a program, policy or project) produced the desired effects for the people, households and institutions. It uses quantitative methods to assess if changes can actually be attributed to the program.
An impact assessment should identify whether or not there is a cause and effect relationship between the intervention and the achieved expected and unexpected results since other factors that occur during the intervention period could be also correlated to changes in specific indicators. The impact assessment is undertaken once the intervention has ended in order to verify fulfillment of the desired results. It can be seen as an analysis of the comparison between results actually observed in the presence of an intervention and those that would have been observed without it (Aedo 2005).
MAP’s M&ES is one of the main sources of information for impact assessment of the program since it provides reports, fact sheets, searches, cross references of information and real-time graphics that provide a great diversity of pertinent information to support impact assessment.
Information flow in MAP’s monitoring and evaluation systemMonitoring in MAP is a continuous and systematic process that allows obtaining and processing information on progress toward achieving program results. The system enables management of information from information gathering to its validation, storage and use, making it possible to monitor and follow-up the actions and the effects produced by the program.
MAP monitoring and evaluation system main featuresMAP monitoring and evaluation system (MAP’s M&ES) is a tool that enables the program to monitor the actions it carries out, as well as to measure progress toward expected results. The system was developed based on the program’s logical framework.
Site(Farm, garden, research plot)
Regional platforms
Organizations/Institutions (Producer, Business, Governmental, Non-Governmental Educational)
Families
People
Related to
Consisting of
Linked to
Grouped in
Results-Based Management
MAP Norway Logical
Framework Res
ult
s
Performance Indicators
Output Indicator
Monitoring and
Evaluation System
MAP´s M&ES main features:• 25 graphics of the program’s key aspects
• 22 performance indicators
• 12 outcome indicators
• 7 information sheets (family, farm, home garden, plans, people, institution, documents)
• A mechanism for complex searches that permits extraction of information in more than 10,000 different combinations
• 24 forms to enter data, which are made up of more than 3,000 fields
Performance indicators: measure progress of actions toward achievement of expected outputs.Outcome indicators: measure progress in the changes sought at the end-user level, both in the short and medium term. To a great extent, these changes are generated as a result of program actions.
Flexibility of MAP’s Monitoring and Evaluation SystemThe system was designed to be flexible, with a structure that has basic elements that enable adaptation of the M&ES to other initiatives that work with the following elements:
M&ES database
MAP’s monitoring and evaluation system
Monitoring Outcomes
Monitoring performance
Gather information Enter information in M&ES
Validate informationentered in system
Facilitator Digitator Verifier
MAP’s monitoring and evaluation users
MAP’s monitoring and evaluation system users• MAP team
• CATIE community (students, managers, researchers)
• Donors
• Local partners (producer organizations, territorial platforms)
• Research partners (Bioversity, ICRAF, CCAFS, FTA)
Impact assessment (IA)The purposes of IA is to determine whether an intervention (be it a program, policy or project) produced the desired effects for the people, households and institutions. It uses quantitative methods to assess if changes can actually be attributed to the program.
An impact assessment should identify whether or not there is a cause and effect relationship between the intervention and the achieved expected and unexpected results since other factors that occur during the intervention period could be also correlated to changes in specific indicators. The impact assessment is undertaken once the intervention has ended in order to verify fulfillment of the desired results. It can be seen as an analysis of the comparison between results actually observed in the presence of an intervention and those that would have been observed without it (Aedo 2005).
MAP’s M&ES is one of the main sources of information for impact assessment of the program since it provides reports, fact sheets, searches, cross references of information and real-time graphics that provide a great diversity of pertinent information to support impact assessment.
Mesoamerican Agroenvironmental Program (MAP)Monitoring and Evaluation System
MAP is a platform that integrates actions in research, education and development in order to contribute to the solution of five of the global problems that affect the
Mesoamerican region: (i) poverty, (ii) gender inequity, (iii) food and nutritional insecurity, (iv) degradation of ecosystem services, and (v) vulnerability to Climate Change. MAP is a CATIE’s program that is financed with Norwegian cooperation.
MAP entered its second phase (MAP Norway) in June 2013. This phase was designed and is being implemented under the Climate Smart Territories (CSTs) approach in two key territories: Trifinio (frontier region of El Salvador, Honduras and Guatemala) and NicaCentral (north-central area of Nicaragua).
MAP impact pathwayImpact pathway can be defined as a sequence of steps to be followed in order to achieve the expected outcomes in order to impact people’s livelihoods. The impact pathway is a useful tool to guide project management in complex environments such as sustainable rural development. It is built on a theory of change that describe how project outputs are developed with, and used by, others to achieve chains of outcomes that contribute to eventual impact on social, environmental or economic conditions. The Impact pathway is the basis for the development of Monitoring, Evaluation (M&E) and Impact Assessments systems. (Alvarez et. al. 2008, CCAFS, 2015). MAP’s impact pathway is presented in Figure 1.
Leida Mercado Programa AgroambientalMesoamericano (MAP)CATIE, Turrialba, Costa RicaTel. + (506) [email protected]
Leonardo AguilarPrograma AgroambientalMesoamericano (MAP)CATIE, Turrialba, Costa RicaTel. + (506) [email protected]
What are the benefits of having a monitoring and evaluation system?1. Allows tracking, over time, of the families, farms, home gardens, community gardens, organizations, institutions and platforms with
which we work.
2. Provides a secure and integrated source of information that incorporates quality controls and can be used by the program.
3. Monitors performance and effect to measure the program’s progress.
4. Provides the ability to perform simple or complex information queries and obtain the data immediately.
5. Can check key aspects of the project in real time through graphics.
6. Provides information that offers very useful inputs to support research conducted by the program.
7. Has flexibility to incorporate new reports or queries since it was developed from open-source software tools, which allows easy updating and future improvements.
8. Allows access to system information from anywhere in the world simply by entering your Internet browser.
9. Preserves the information and knowledge generated by the program.
ReferencesAedo, Cristian. 2005. Evaluación del impacto. Series Manuales 47. CEPAL División de Desarrollo Económico y GTZ.Bernal, Raquel y Peña, Ximena. 2010. Guía práctica para la evaluación de impacto. CEDE, Facultad de Economía, Universidad de losAndes. Bogotá: Ediciones Uniandes. 336 p. Desarro. soc. no.66 Bogotá July/Dec. 2010.Alvarez, S., Douthwaite, B., Thiele, G., Mackay, R., Cordoba D. and Tehelen, K. 2008. Participatory Impact Pathways Analysis: a practical method for project
planning and evaluation. Paper prepared for: ‘Rethinking Impact: Understanding the Complexity of Poverty and Change’ Workshop. March, 2008. Available at http://www.researchgate.net/profile/Boru_Douthwaite/publication/237079470_Participatory_Impact_Pathways_Analysis_a_practical_method_for_project_planning_and_evaluation/links/02e7e51f98ee4d6229000000.Visited June 30th, 2015.
CCAFS. Impact Pathways. https://ccafs.cgiar.org/impact-pathways-0#.VZgbBuv3FVo. Visited June, 30th, 2015.
INPUTS
INTERVENTIONS
PRODUCTS
OUTCOMES
IMPACTS
• CATIE´s Researchers and Specialists
• CATIE´s tools and methodologies• Farm Field Schools• Territorial Business Training
School• Participatory agricultural
landscape assessment of adaptive capacity
• Farm and landscape planning
• Participatory Research
• Productive inputs (seed, other) • Monitoring
• Training-of-trainers (TOT)
• Gender sensitive training
• Planning of sustainable:•home gardens/farms•business organizations•territorial platforms•use of agro-biodiversity and improve
food preparation
• Crowdsourcing for seed selection
• Weather information networks
• Development of investment plans
• Knowledge exchange and sharing of best practices
• Five thousand families (5,000 females and 5,000 male) trained in:•innovative technologies•use of weather information•improving nutrition•business plans
• Four thousand home-garden and farm plans implemented
• At least five germplasm/seed banks established and five mechanism of genetic resources exchange
• Thirty business organizations developed that implement gender and CC sensitive business plans
• Six platforms trained in CST key issues
• Results of at least 40 research projects with recommendations to improve livelihood systems, territorial management, adaptation to CC
• R1. Five thousand families increased their assets and improved equity in family decision making for food and nutritional security
• R2. Five thousand farms and home gardens (HG) increased and diversified agroecological and agroforestry production
• R3. Thirty business organizations increased capacity and access to markets
• R4. Six platforms improved enabling conditions to implement CSTs.
• R5. CSTs approach scaling up and out
• Reduction in rural poverty
• Reduction in food and nutritional insecurity
• Reduction in gender inequality
• Reduction of vulnerability to climate change
• Reduction in degradation and loss of ecosystem services
http://map.catie.ac.cr
Autores:
http://map.catie.ac.cr
Figure 1. MAP impact pathway