Can Evaluation Strengthen Sustainable Development?

Three Cases to Consider

Asima NaeemQualitative Research Methods EDRD*6000University of GuelphMarch 7, 2016

Source: http://www.nouvellesimages.com/sustainable-dev-614.html

• Description of sustainable development• Description of evaluation• Unmet 2015 MDGs – Lack of evaluation (Case 1)• Strengths of using evaluation• Use of evaluation in Nepal’s resource programme (Case 2)• Use of evaluation in sustainability of Russian forest management (Case 3)• Limitations/Questions

Outline

What is Sustainable Development?

Meeting the needs of today without compromising the ability of future generations to meet their own needs

Brundtland Report, 1987

New 2030 UN Sustainable Development Goals

Source: https://sustainabledevelopment.un.org

“...We are off course because of unmet commitments, inadequate resources and a lack of focus and accountability…” United Nations (UN) Secretary-General Ban Ki-moon

http://www.un.org/millenniumgoals/

Unmet 2015 Millennium Development Goals

Who will be accountable, 2015. http://www.ohchr.org/Documents/Publications/WhoWillBeAccountable_summary_en.pdf

How Can Commitment, Focus, and Accountability be Strengthened for Sustainable Development?

Evaluation

Independent systematic objective analyses of completed or ongoing activities

Measures relevance, effectiveness, efficiency, impact, and sustainability

Provides information to help in decision-making, improve outcomes or achieve desired goals

UNDP Handbook on Planning, Monitoring, & Evaluation for Development Results, 2009

Evaluation

Oxfam, n.d.

Key Aspects:

1) Producing Logic Models – outline the strategies, outputs, outcomes, and impacts of a program, policy, or intervention

2) Choosing Indicators – measure change over time and should be SMART (specific, measurable, attainable, relevant, time-bound)

3) Collecting Data (including baseline studies) – collect right information at the right time, use different methodologies

4) Reviewing and Reporting – analyze data and review, relevance, efficiency, effectiveness, impact, and sustainability

• Unreliable or unavailable data to evaluate programmes

• MDG targets based on ‘little evidence of feasibility in low-income countries’

• Lack of clear guidance on achieving goals

• Short-term planning instead of sustainable long-term planning – use different indicators

Lack of Meaningful Evaluation in 2015 MDGs

Fehling, 2013

“We treasured what we measured—and perhaps that was the wrong way round. It seems to me we should measure what we treasure.”

UN High Commissioner for Human Rights, Navi Pillai

1. Clarify objectives through appropriate indicators

2. Provide feedback regarding the outcomes of activities

3. Identify problems and barriers

4. Increase accountability by measuring results and impacts

5. As a tool for advocacy and support

How Can Evaluation Strengthen Sustainable Development

Source: http://www.clearhorizon.com.au/wp-content/uploads/2009/02/theproject25percent.jpg

Use of Evaluation in Nepal’s Rural Energy Development Programme

In 1996• Launched decentralized renewable energy pilot programme in 5 remote hill districts

In 2001 • Expanded programme and incorporated into national policy through the use

of evaluation systems which informed the social and economic costs and benefits of the program

By 2010:• 59,000 households connected to micro hydropower installations• 317 new micro hydropower plants• 15,000 improved cooking stove• 7,000 toilet-attached biogas plants• 3,200 solar home heating systems UNDP Case Studies, 2012

Use of Evaluation to Strengthen Sustainable Development of Russian Forest Management

1990s:• Poor sustainable policies to protect Russian Forest• Driven by corruption and illegal logging• Evaluations subjective and not independent

2000s:• ENPI FLEG Programme funded by European Union to develop sustainable

management of forests, strengthen law, and improve local livelihoods• Independent NGOs started evaluations• Evaluations involved identifying all stakeholders, collecting data, monitoring,

assessment of progress, and reporting• Ministry of Agriculture adopted long-term plan against illegal logging

By 2011: • FSC certified 32 hectares of forest

Gerasimova, 2013

Questions of Limitations

1) How can quality evaluations be carried out?

2) What factors should be considered when collecting data? Do they change for a different culture? How do we know our data is reliable?

3) How can we choose the best indicators possible?

4) How do we overcome resource issues to maintain evaluations and sustainability of development?

References1. Fehling, M., Nelson, B. D., & Venkatapuram, S. (2013). Limitations of the Millennium Development

Goals: a literature review. Global public health, 8(10), 1109-1122

2. Gerasimova, K. (2013). The potential of evaluation to promote sustainable development in Russian forest management. Development in Practice, 23(8), 1048-1058.

3. Oxfam GB Evaluation Guidelines (n.d.): http://policy-practice.oxfam.org.uk/~/media/Files/policy _and_practice/methods_approaches/monitoring_evaluation/ogb_evaluation_guidelines.ashx

4. UNDP Handbook on planning, monitoring, & evaluation for development results (2009). Retrieved from: http://web.undp.org/evaluation/evaluations/handbook/english/documents/pme-handbook.pdf

5. UNDP Case studies of sustainable development in practice: Triple wins for sustainable development (June 2012). Retrieved from: http://www.undp.org/content/dam/undp/library/Cross-Practice%20generic%20theme/Triple-Wins-for-Sustainable-Development-web.pdf

6. Who will be accountable. Human rights and the post-2015 development agenda (2015). Retrieved from: accountablehttp://www.ohchr.org/Documents/Publications/WhoWillBeAccountable_summary_en.pdf