narrative report of the - evaluationcanada.ca · narrative report of the third conference of the...

NARRATIVE REPORT OF THE THIRD CONFERENCE OF THE AFRICAN EVALUATION ASSOCIATION HELD IN CAPE TOWN • SOUTH AFRICA ON 1 - 4 DECEMBER 2004, WITH PRE-CONFERENCE WORKSHOPS ON 29-30 NOVEMBER Submitted by Zenda Ofir Chairperson: African Evaluation Association (AfrEA) and Executive Director: Evalnet and Lise Kriel AfrEA Secretariat and Conference Coordinator

African Evaluation Association

PO Box 41829 • Craighall 2024 • Johannesburg • South Africa

Tel: +27-11-880 3790 • Fax: +27-11-880 4736 • Email: chair

@afrea.org

Third AfrEA Conference 1-4 Dec 2004 Narrative Report

OVERVIEW On 1-4 December 2004 the African Evaluation Association, in collaboration with the Public Service Commission of South Africa, held its Third Conference in the Holiday Inn Conference Centre, Cape Town, South Africa, with the theme

Africa Matters, Evaluation Matters: Joining Forces for Democracy, Governance and Development.

All contributions were expected to analyse and reflect on at least one of the dimensions of the Conference theme. Participants were encouraged to challenge conventional evaluation wisdom and to highlight lessons and innovations in evaluation approaches and methodology stemming from African experiences. The Conference was designed to share experiences, to stimulate debate and to bring African and other stakeholders up to date with the latest developments in this field in Africa. As the uptake of monitoring and evaluation as instruments for development has not been the same in all African countries, the Conference was to provide a platform for the sharing of lessons between organisations, between evaluation associations and networks, and between individuals interested in monitoring and evaluation from countries in Africa. The timing of the conference coincided with a growing demand for accountability, reflection and review across the continent, including within national governments and regional initiatives such as NEPAD and CAPAM. Furthermore, academic and other institutions across the continent have begun, or are thinking of beginning, to offer short and graduate courses in evaluation. The Conference provided practitioners and academics with opportunities to network towards sharing of curricula and methodologies and to form partnerships for further strengthening of capacities and reach. At the same time there is a movement worldwide focusing on rethinking, reforming and reshaping development evaluation rationales, approaches and methods. The Conference was designed to offer a platform through which African thinking and experiences could feed into this movement. It was also to present an opportunity for reflection by AfrEA to determine the best role it could play in future and to strengthen and refine its strategies to support the next phase of the development of monitoring and evaluation in Africa. Thus the Conference was to give representatives from governments, donors, multilateral development agencies, NGOs, academic and research institutions, evaluators and other influential stakeholders an opportunity to share their knowledge, raise issues, listen to one another and determine ways in which monitoring and evaluation could be made more meaningful and useful for development on the continent. The Conference was marketed very widely through listserves and professional contacts. This attracted a significant number of well-known and experienced international evaluators and evaluation association/network leaders from all over the world. They attended the Conference as part of an increasing interest in the development of evaluation in Africa. The organisers tried to involve as much as possible of the international expertise in the pre-

1


conference workshops and in the Conference in order to facilitate two-way transfer of expertise for mutual benefit. The Conference was based on a series plenary, special and panel sessions, and technical strands consisting of individual presentations as well as panel, plenary and group discussions (Annex 1). At any given time, several sessions or strands were conducted in parallel. In total there were

six Plenary Addresses by African and international experts;

three Special Sessions to stimulate debate and highlight cross-cutting areas of

critical importance in the development of monitoring and evaluation in Africa;

three Panel Sessions aimed at dissecting vital aspects which currently of great

interest to monitoring and evaluation in Africa, in particular national ownership,

partnerships in the evaluation of aid and development, and the meaning and

promotion of evaluations of quality on the continent;

nine Technical Strands aimed at drawing together those with an interest in

monitoring and evaluation in specific fields such as HIV/Aids, education, poverty

reduction, NEPAD, innovative methods and community-based M&E;

two Special Technical Sessions on the evaluation of humanitarian relief, and the

practice of self-reflection.

Six side meetings were also arranged by a number of organisations who made use of the opportunity to link their own planning and report-back meetings with the Conference. The conference was preceded by 10 professional development workshops on 29-30 November. All were conducted by highly respected international as well as several local evaluation specialists. In order to maximise exposure at the Conference, an opportunity was also given to interested organisations across the continent and elsewhere to display evaluation resource exhibits at the Conference venue. Sixteen organisations made use of this opportunity to provide materials or display demonstrations of their work.

Conference Objectives

To stimulate and plan for renewal in evaluation in Africa

To debate, develop and demonstrate the role that evaluation should play in promoting democracy, good governance and effective development in Africa

To showcase African evaluation expertise and achievements

To create a forum for the interaction of representatives from various sectors

To provide opportunities for sharing technical expertise and insights between African and international specialists

To build capacity on the continent among evaluators and their clients

To encourage a better understanding of the articulation in Africa between evaluation theory and practice, and development theory and practice.

2


PARTICIPATION More than 550 people attended the Conference, including around 70 present only at specific sessions for less than one day. A total of 482 participants from 56 countries registered for the Conference (Annex 3). Of these, 87% came from 36 countries in Africa. The high international profile of the Conference is highlighted by the fact that it succeeded in attracting 62 participants from 20 countries on four other continents (Figures 1 and 2).

Figure 1: PERCENTAGE OF COUNTRIES REPRESENTED PER CONTINENT

Africa66%

Asia7%

Europe19%

North America4%

Oceania4%

Figure 2: NUMBER OF PARTICIPANTS PER CONTINENT

Africa420

Asia5

Europe27

Oceania2

North America26

3


The effect on local professionals of holding an event in a particular country is illustrated by the large number of South Africans who attended the Conference - 250 in total. It is interesting that the country best represented after the host country was the USA with 24 participants, followed by the previous host country Kenya (20), Uganda (13), Botswana (13) and Mozambique (12).

Figure 3: PERCENTAGE OF AFRICAN COUNTRIES REPRESENTED PER REGION

Central Africa17% East Africa

19%

North Africa8%

Southern Africa 25%

West Africa31%

Figure 4: PERCENTAGE AFRICAN PARTICIPANTS PER REGION

Central Africa4%

East Africa11%

North Africa2%

Southern Africa 74%

West Africa9%

4


Even though there was representation from a good distribution of countries across the African continent (Figure 3), the need to ensure that the Conference takes place in different regions is emphasised by the presence of the large majority of participants (74%) from southern Africa, even when the host country is excluded (Figure 4). Participants were well distributed by gender with 45% women attending (Figure 5), but less so by preferred language, with only around 10% representation by those who preferred French above English.

Figure 5: PARTICIPANTS BY GENDER

263219

Figure 6: PARTICIPANTS BY LANGUAGE

French47

English435

The distribution of participants and number of organisations per organisation type illustrates the success of the organisers’ attempts to attract participants from diverse sectors. Of special significance was the number of participants from government entities, as well as the number of such departments, agencies and offices represented across the continent (Figure 7 and Annex 4). Representatives from 21 African universities attended, which is encouraging in view of the need for specialised and postgraduate M&E courses in Africa.

Figure 7: DISTRIBUTION OF PARTICIPANTS AND ORGANISATIONS BY ORGANISATION TYPE

66

34

33

32

22

18

11

12

7

6

6

2

160

62

56

38

39

23

24

23

35

11

6

5

0 20 40 60 80 100 120 140 160

Government Departments /Offices / Agencies

Academic Institutions

Private Sector Companies

Non-GovernmentalOrganisations

Donor & MultilateralDevelopment Agencies

Associations & Networks

International Non-Governmental Organisations

Research & Semi-Governmental Organisations

United Nations Agencies

IntergovernmentalOrganisations

Partnerships, Programmes &Projects

Unknown

number of participants

number of organisations

5


PARTNERSHIPS AND SPONSORSHIPS Partnerships and sponsorships were negotiated to help realise the Conference. The reaction was overwhelming and an excellent mix of 25 local and international organisations provided financial and/or in-kind support, and coordinated and hosted Conference sessions and strands. Thirteen of these were international or local agencies based in Africa, including 11 from South Africa. The Public Service Commission supported the initiative from the start and agreed to co-host the Conference. The excellent support of the Chairperson, Prof. Stan S Sangweni; the Co-Chair of the Conference, Indran Naidoo; Commissioner Nozipho Mxakato-Diseko and the PSC team has been instrumental in the success of the Conference.

Co-hosts African Evaluation Association (AfrEA) Public Service Commission (PSC) of the Government

of South Africa AfrEA and Conference Secretariat

Evalnet, South Africa Partners

African Capacity Building Foundation (ACBF), Zimbabwe

Department for International Development (DFID), United Kingdom

Deutsche Gesellschaft für Technische Zusammenarbeit (GTZ), South Africa

Nelson Mandela Foundation, South Africa Swedish International Development Agency (SIDA),

South Africa The World Bank, USA

Sponsors, Endorsing and Coordinating Organisations

L’Agence Intergouvernementale de la Francophonie, France

African Development Bank, Tunisia Active Learning Network for Accountability and

Performance in Humanitarian Action (ALNAP), United Kingdom

Similarly, the Conference would not have taken place without the assistance of AfrEA’s six partner organisations that provided major financial support. We are equally grateful to the sponsors, endorsing and coordinating organisations that made available a range of grants and in-kind support towards the Conference core budget, mobilisation of expertise, travel funds for participants, and the coordination of sessions and strands.

Department of Public Service and Administration, South Africa

Bank of Southern Africa (DBSA), South Development Africa

undation, South Africa Ford Fo International Development Evaluation Association

(IDEAS) onal Development Research Centre (IDRC), Internati

Canada onal Organisation for Cooperation in Internati

Evaluation (IOCE) National Research Foundation (NRF), South Africa

BUILDING CAPACITY In order to enhance the potential for capacity building provided by such a large gathering of evaluation specialists, ten 1-2

NEPAD Secretariat, South Africa OECD/DAC Network on Development Evaluation,

France South Africa UNAIDS, UNDP, USA UNIFEM, USA University of the Free State, South Africa USAID through MEASURE Evaluation, USA

World Conservation Union (IUCN), Switzerland

6


day pre-conference professional development workshops were presented by highly skilled, experienced evaluators from within and outside Africa. The workshops were attended by around 250 participants. In three workshops, local and international presenters were teamed to highlight their different perspectives and experiences within the same training context. The evaluation results of five of the workshops show that they were extremely well received, especially with respect to the quality and relevance of the content and the presentation styles (the evaluation forms of the other five workshops were lost in the process of transfer of material between Cape Town and Pretoria after the Conference). AfrEA is grateful for the support provided for several of the workshops by the African Capacity Building Foundation. Their funding was instrumental in ensuring attendance of evaluation association network leaders, travel grants for those who otherwise would not have been able to participate, and for expert input and presentations that helped to ensure high quality events.

Workshops conducted

i. Introduction to Assessing Organisational Performance

(conducted by Nancy MacPherson, IUCN Switzerland, and Mine Pabari, IUCN Kenya)

ii. Designing and implementing a Results-based M&E System in the Public Sector and

iii. Managing for Results using the ProLL Integrated Performance Management Framework (conducted by Arunaselam Rasappan, ARTD Malaysia, Jerome Winston, PPSEI, Australia, and Mufunani Khosa, Zimbabwe)

iv. Designing and Building Performance-Based Monitoring and Evaluation Systems: A Tool for Managing Programmes and Policies (conducted by Ray C Rist, World Bank, USA)

v. Contracting for Evaluation (facilitated by Lauren Wildschut, ERA, South Africa)

vi. Participatory M&E Tools for Building Capacity of Parliaments in Poverty Monitoring (facilitated by Sulley Gariba, Institute for Policy Alternatives, Ghana)

vii. RealWorld Evaluation: Conducting Evaluations under Constraints of Time, Budget and Data (conducted by Jim Rugh, CARE International, USA)

viii. Building National Capacity through effective Evaluation Associations and Networks (conducted by Jean-Louis Dethier, Perspective Consulting, Belgium, Oumoul Kharyi Ba Tall, Mauritania, and Zenda Ofir, Evalnet, South Africa)

ix. An Introduction to Programme Theory and Logic Models and

x. Using and Teaching Logic Models (conducted by Nancy Porteous, Health Canada)

7


CONFERENCE ORGANISATION AND FINANCIAL MANAGEMENT In order to keep the organisation costs as low as possible, the Conference was organised by the AfrEA Secretariat with support provided by the Public Service Commission and with advice and assistance from members of the AfrEA Executive. The two Conference Co-Chairs – Zenda Ofir, Chairperson of AfrEA and Indran Naidoo, Chief Director in the Public Service Commission of the South African Government – led the conceptualisation, programming content and coordination, and fundraising efforts. Specialist expertise was brought in where required. Quotations were obtained from reliable service providers in order to ensure cost-effectiveness as well as high quality work. Two South African institutions, the University of the Free State and Evalnet, an evaluation consultancy company that also serves as AfrEA Secretariat, were used to manage the Conference and workshop finances. Partners and sponsors could choose their preferred financial management agency. All Conference funding was eventually managed by Evalnet. TRANSLATION SERVICES In order to encourage participation by French-speaking colleagues, significant effort went into the mobilisation of funding to enable translation of materials as well as simultaneous translation facilities at the Conference. AfrEA is grateful for those grants which included support for a variety of translation services, allocated by

L'Agence Intergouvernementale de la Francophonie;

Nelson Mandela Foundation;

IDRC;

World Bank;

Office of HIV/AIDS, Bureau of Global Health, USAID - through MEASURE Evaluation;

DFID;

UNIFEM; and

African Development Bank.

In spite of significant financial support, due to the very high costs of simultaneous translation not all sessions could be translated into French. All plenary sessions as well as four parallel sessions each day were provided with simultaneous translation. Of the materials the key announcements and the Conference website could be translated into French. Should resources be available, the proceedings will be translated into French.

8


TRAVEL GRANTS Funds for bringing specialist expertise and other participants to the Conference and workshops were made available from a variety of sources, contributing greatly to the excellent attendance and high quality presenters characterising many of the sessions and strands: i. All coordinating organisations provided funding and other forms of support to bring

African and international presenters to the Conference, thereby contributing greatly to its success.

ii. L'Agence Intergouvernementale de la Francophonie was instrumental in allocating

travel grants to participants from West Africa, from where travel costs to Cape Town were prohibitive.

iii. The World Bank provided funding to enable six national evaluation association and

network leaders to attend the Conference and workshops, the African Capacity Building Foundation supported another four, while UNIFEM sponsored 11 members of the Africa Gender and Development Evaluators Network to attend.

iv. AfrEA was fortunate to obtain grants from several organisations to bring key

presenters, young evaluators and post-graduate students, M&E managers from small NGOs and leaders of evaluation associations and networks to the Conference and workshops. A total of 36 grants were allocated by AfrEA on a competitive basis from more than 130 applications, with pooled funding provided by the Nelson Mandela Foundation, the African Capacity Building Foundation and DFID in the United Kingdom.

OBSERVATIONS AND RESULTS AfrEA organised a basic evaluation of the Conference and preceding workshops through distribution among participants of evaluation forms to be completed on the last day of these events. These forms would have yielded very valuable information for future planning, but to our dismay the Conference and five of the workshop evaluation forms were lost among boxes of material sent between Cape Town and Pretoria immediately after the Conference. To date efforts to trace the boxes / forms have been unsuccessful. In order to ensure that formal feedback is received, the Secretariat is planning to send electronic evaluation forms to all participants for completion. These comments will then be incorporated into this report. In spite of this setback, the organisers are confident that the Conference and its accompanying capacity development efforts were a success and have in fact achieved more than expected (even though only a few weeks have elapsed since the Conference). We base this observation on the following:

9


i. We have been overwhelmed by praise for the Conference received by email and

verbally, from both African and international evaluation specialists, with comments focusing on

the high quality of the workshops in terms of presentation and content (supported by the excellent evaluation results of the five workshops for which forms are available);

the ample opportunities provided to interact and network; the appropriate format and high quality and relevance of the Conference

programme; the large number and diversity of the participants; the high quality of a number of presentations by African specialists, as well as the

high quality of floor discussions in several of the sessions; the high quality of the keynote speakers and of the contribution by the Premier of

the Western Cape during one of the social events; the efforts to provide simultaneous translation facilities (although still not

adequate); and the good venue, effective organisation and excellent food.

ii. These comments as well as the feedback during the final plenary session clearly

indicate that the Conference has moved AfrEA into a next phase of professionalism and credibility as mouthpiece for, and promoter of, African monitoring and evaluation, both in terms of its own perceptions of its role and potential contributions, and the perceptions of its stakeholders. Several funders have already approached AfrEA for collaboration in the period until the next conference.

iii. The summary feedback and recommendations from each session and strand during the

final plenary session highlighted key issues relevant to the future development of monitoring and evaluation in Africa. Many of these will be taken on board by AfrEA in designing its action plans. These comments also provided insights that other organisations can take to heart in their consideration of methods and strategies in the field.

iv. The Conference even at an early stage has enhanced the profile of African evaluation

in the international arena. Examples are

A previous American Evaluation Association President and renowned evaluator is planning to highlight his experiences and lessons from the Conference during a special session at the advanced training course presented by the Evaluators’ Institute in the US in February 2005.

Several IOCE Board Members have remarked on the richness of their experiences during the Conference. They are all leaders of national or regional evaluation associations with extensive influence over their constituencies. At least one has already agreed to return to South Africa for further training later this year.

It is very likely that sessions from this Conference will inform sessions at the Conference of the joint American Evaluation Association / Canadian Evaluation Society to be held in Toronto, Canada in October 2005.

10


v. The Conference theme has been very similar to that of the European Evaluation

Society (EES) Conference held in September 2004, as well as that of the Latin America and the Caribbean Network of Monitoring, Evaluation and Systematisation (ReLAC) Conference held in October 2004. There is a possibility that the issues and solutions offered by the experiences on these continents in the area of Evaluation for Good Governance will be compared and analysed to develop a better understanding of the factors influencing evaluation across cultures and geographic borders in developing contexts.

vi. The networking opportunities and exposure at the Conference have been stimulating

initiatives to develop new national evaluation associations and networks. One of the workshops which were very well received was aimed at those interested in setting up such organisations in their countries. It was attended by more than 20 participants. The first concrete result is the launch of a process to establish a Tanzanian Evaluation Network/Association, which flowed directly from the presence at the Conference of the Minister for the Public Service in Tanzania. The Chairperson of AfrEA was invited to speak at the launch of the process in Dar es Salaam in January 2005. Conference participants are also aiming to establish such an organisation in Morocco, which as far as we know will be the first such initiative in North Africa.

vii. Over the past two years the South African Evaluation Network (SAENet) has been

operating in an informal manner using a listserv and seminars to facilitate information sharing and promote interaction within the local evaluation community. The Conference provided an excellent opportunity to move the Network to a next phase of development. A special meeting was held to plan the way forward for the next two years, resulting in the establishment of a Task Team to work towards the launch of a more formal network or association in April/May 2005.

viii. The Public Service Commission (PSC) has taken responsibility to ensure that specific

reports and action plans are presented to various stakeholders. These include the following:

The Parliamentary Portfolio Committee on Public Service and Administration of the South African Government: Parliament nominated three of its members to attend the Conference and their feedback was very positive. A specific presentation on the conference and its outcomes is to be made in Parliament.

The Presidency: The PSC will table a report to the Presidency.

The Minister of Public Service and Administration, Ms Geraldine Fraser-Moleketi: The Minister supported, attended and made an input into the Conference, and is expecting an action plan to develop monitoring and evaluation at the continental level.

The Director-General of the Department of Public Service and Administration, Prof Richard M Levin, who also heads the M&E Task Team for the South African Government: Prof. Levin was a keynote speaker and is keen to ensure that a

11


comprehensive monitoring and evaluation programme is developed at the country and regional level.

The NEPAD Secretariat: The Secretariat has committed to working with the PSC to devise clear monitoring and evaluation capacity development plans for the continent.

ix. The African Development Bank (AFDB) and the Joint Africa Institute (JAI) have proposed collaboration with the PSC and AFREA to hold a seminar on development evaluation.

FOLLOW-UP AND FUTURE DIRECTIONS The AfrEA Executive has now decided to move the organisation into a new phase of development after establishing its credibility and finding its role in the promotion of monitoring and evaluation in Africa. The period 2005-2006 until the next Conference in Niger will be one of formalisation of its structure and processes, and of launching activities that will extend some of the tentative initiatives during the first few years of its existence, and launch new ones. AfrEA’s action plan will be enriched by the summaries and discussions during the final plenary session which highlighted issues for consideration and recommendations from each session and strand. These inputs represent a concerted voice from hundreds of stakeholders on the way forward, not only for AfrEA but also for monitoring and evaluation in Africa in general. They will be used to design strategies to launch, through effective partnerships including some of those noted above, a new phase in strengthening monitoring and evaluation on the continent. Areas highlighted as needing attention and which will be among those considered in the selection of priority foci for AfrEA are:

The development of shared approaches, standards, methods and tools across the continent, with the inclusion of expertise based on indigenous and local knowledge;

Advocacy for monitoring and evaluation, among others as an instrument for good governance, learning, accountability, evidence-based decision-making, rights-based approaches and the empowerment of people;

The use of monitoring and evaluation to “give voice to local voices”;

Deepening practice around the use of monitoring and evaluation, with a special focus on good governance across the continent;

Systematic, concerted and well designed capacity building through training and related activities, based on the strength provided by associations and networks;

Development of the capacity of evaluation network and association leaders;

12


Ensuring monitoring and evaluation expertise in support of important instruments such as the peer review mechanism;

Stimulating work in areas of growing importance that moves monitoring and evaluation “beyond aid”, for example to include the evaluation of policies and policy coherence;

The collection, analysis and dissemination of information that can assist and support the evaluation community in Africa;

The establishment of interest groups that can develop monitoring and evaluation theory and practice in specific areas, such as conservation or community-based monitoring and evaluation;

The promotion of networking between sectors, practitioners and local communities, and other key stakeholders.

Any other interested organisation will have access to key presentations discussions and recommendations through Conference Proceedings that will be published in the first part of 2005. African evaluators need to contribute to the development of new approaches to theory and practice, and the Conference was to be a catalyst for more dynamic contributions by people from the continent. The publication of professional proceedings will thus be a first step in exposing the knowledge shared at the Conference to a broader audience in an attempt to bring the voice of Africa to other evaluation forums across the world.

13

Third AfrEA Conference 1-4 Dec 2004 Conference Sessions, Strands and Meetings

ANNEX 1: CONFERENCE SESSIONS, STRANDS AND SPECIAL MEETINGS Plenary Addresses i. Welcome and Opening Address

Prof. Stan S Sangweni, Chairperson, Public Service Commission, South Africa ii. Evaluation in the African Renaissance

Dr Sulley Gariba, Executive Director of the Institute for Policy Alternatives, Ghana and President: IDEAS

iii. The Practice of International Evaluation: Dissemination, Development or Control?

Dr Elliot Stern, President: IOCE and Editor of Evaluation, the International Journal of Theory, Research and Practice, UK

iv. The African Evaluation Guidelines: Instrument for Improving Evaluation Quality in

Africa? Dr Craig Russon, Evaluation Manager, WK Kellogg Foundation and AEA Board Member; and Dr Mahesh Patel, Regional Social Policy and Economic Analysis Advisor for UNICEF, East Asia and Pacific Region

v. Joining Forces – Partnerships, Alliances and Strategies: Voices of Key Players shaping

M&E in Africa Dr Noeleen Heyzer, Executive Director, UNIFEM, USA Dr Richard Levin, Director-General, Department of Public Service and Administration, South Africa

Special Sessions i. Evaluation in a Culturally Diverse World

(coordinated by the International Organisation for Cooperation in Evaluation - IOCE) ii. Re-thinking Development Evaluation in the African Context

(coordinated by the International Development Evaluation Association - IDEAS) iii. Developing Evaluation Capacity in Africa

(coordinated by the World Bank, USA) Technical Strands i. Innovation in M&E Methods and Approaches in Africa

(coordinated by the International Development Research Centre – IDRC, Canada) ii. Community-based M&E

(coordinated by AfrEA) iii. M&E for Good Governance

(coordinated by the Public Service Commission, South Africa and the German Technical Agency GTZ)

14

Third AfrEA Conference 1-4 Dec 2004 Conference Sessions, Strands and Meetings

iv. M&E and NEPAD

(coordinated by the African Development Bank, Tunisia) v. M&E in Poverty Reduction, Agriculture and Rural Development

(coordinated by the University of the Free State, South Africa) vi. M&E for Conservation and Sustainable Development

(coordinated by the IUCN, EARO Kenya) vii. M&E in Education (coordinated by the University of the Free State, South Africa) viii. Gender and Rights-based M&E

(coordinated by UNIFEM, USA) ix. M&E and HIV/AIDS

(coordinated by UNAIDS, South Africa) Panel Sessions i. Towards Development Effectiveness: Assessing National Ownership

(coordinated by UNDP, USA) ii. The Evaluation of Aid and Development, with a Focus on Partnerships

(coordinated by OECD DAC Network on Development Evaluation, France) iii. Encouraging High Quality Evaluations in Africa

(coordinated by AfrEA) Special Technical Sessions i. The Principles of Humanitarian Evaluation

(sponsored by ALNAP, UK) ii. Planning, Conducting and Using Self-Evaluation

(presented by the World Bank and ARTD Malaysia) Special Side Meetings Second Board Meeting of the International Organisation for Cooperation in Evaluation

(IOCE) Meeting of the UNIFEM/AfrEA Africa Gender and Development Evaluators Network Meeting of the South African Evaluation Network (SAENet) Meeting of leaders of African evaluation associations and networks Meeting of National AIDS Councils (or equivalent bodies) in Africa Regional M&E Workshop organised by the UNDP Evaluation Office

15

Third AfrEA Conference 1-4 Dec 2004 Conference Programme

ANNEX 2: CONFERENCE PROGRAMME

Monday and Tuesday, 29-30 November 07h30-09h00 Registration

09h00-17h30 Concurrent Professional Development Workshops

Introduction to Assessing Organisational Performance Designing and implementing a Results-based M&E System in the Public Sector Managing for Results using the ProLL Integrated Performance Management

Framework Designing and Building Performance-Based Monitoring and Evaluation Systems: A

Tool for Managing Programmes and Policies Contracting for Evaluation Participatory M&E Tools for Building Capacity of Parliaments in Poverty Monitoring RealWorld Evaluation: Conducting Evaluations under Constraints of Time, Budget

and Data Building National Capacity through effective Evaluation Associations and Networks An Introduction to Programme Theory and Logic Models Using and Teaching Logic Models

Wednesday, 1 December 07h30-09h30 Registration

09h30-10h45

Welcome and opening Chairperson: Dr Zenda Ofir, AfrEA Chair and Executive Director, Evalnet, South Africa

Welcome Address by the Chairperson of the Public Service Commission of South Africa, Professor Stan S Sangweni

Spotlight on the Conference

10h45-11h15 Tea/Coffee

11h15-12h15

Setting the Scene Chairperson: Indran Naidoo, Chief Director, Public Service Commission, South Africa

Keynote Address by Dr Sulley Gariba, Executive Director of the Institute for Policy Alternatives, Ghana and President - IDEAS: Evaluation in the African Renaissance

Keynote Address by Dr Elliot Stern, President, International Organisation for

13h30 Lunch in Conference venue

13h30-15h30

Cooperation in Evaluation (IOCE) and Editor of Evaluation, the International Journal of Theory, Research and Practice, UK: The Practice of InternationalEvaluation: Dissemination, Development or Control?

12h15-

Concurrent Sessions

SS1 Evaluation in a Culturally Diverse World SS2 Re-thinking Development Evaluation in the African Context SS3 Developing Evaluation Capacity in Africa

15h30-16h00 a

ns (cont.)

Te /Coffee

16h00-17h30 Concurrent Sessio

SS1 Evaluation in a Culturally Diverse World SS2 Re-thinking Development Evaluation in the African Context SS3 Developing Evaluation Capacity in Africa

18h30-20h00 estern Cape: Premier E Rasool Opening Reception hosted by the Premier of the W

Chairperson: Commissioner NJ Mxakato-Diseko, South Africa

16


Thursday, 2 December

08h30-09h15 Plenary Address Chairperson: Dr Peter Ssentongo, Uganda

By Dr Craig Russon, Evaluation Manager for the Food Systems and Rural Development Programme, WK Kellogg Foundation and AEA Board Member, and Dr Mahesh Patel, Regional Social Policy and Economic Analysis Advisor for UNICEF, East Asia and Pacific Region The African Evaluation Guidelines: Instrument for Improving Evaluation Quality in Africa?

09h15-10h45 Special Sessions (cont.):

SS3 Developing Evaluation Capacity in Africa

Special Panel Session coordinated by OECD DAC

AH1 Evaluation Partnership in Development Cooperation - Issues and Challenges

10h45-11h15 Tea/coffee

11h15-13h15 Concurrent Special Sessions (cont.):

SS3 Developing Evaluation Capacity in Africa

Special Panel Session coordinated by UNDP

AH2 Towards Development Effectiveness: Assessing National Ownership

Special Technical Session presented by the World Bank and ARTD Malaysia

AH3 Planning, Conducting and Using Self-Evaluations

13h15-14h00 Lunch in Conference venue

14h00-15h30 Concurrent Technical Strands

TS1 Innovation in M&E Methods and Approaches in Africa TS3 M&E for Good Governance TS4 M&E and NEPAD

Special Panel Session coordinated by the African Evaluation Association

AH4 Improving Evaluation Quality in Africa

Special Technical Session presented by ALNAP

AH5 Introduction to the Evaluation of Humanitarian Action


16h00-17h30 Concurrent Technical Strands (cont.)

TS1 Innovation in M&E Methods and Approaches in Africa (cont.) TS3 M&E for Good Governance (cont.) TS4 M&E and NEPAD (cont.)

Special Session coordinated by the African Evaluation Association (cont.)

AH4 Improving Evaluation Quality in Africa

Special Seminar and Working Sessi AP (cont.)

on presented by ALN

AH5 Introduction to the Evaluation of Humanitarian Action

19h00 17h00-

19h00-20h30 ith the South

Meeting of the South African Evaluation Network (SAENet)

Cocktail Function by invitation only, hosted by AfrEA in conjunction wAfrican Evaluation Network, for South African participants and special guests

17


Friday, 3 December 09h00-10h45 Concurrent Technical Strands: morning sessions

TS1 Innovation in M&E Methods and Approaches in Africa TS2 Community-based M&E TS3 M&E for Good Governance TS5 M&E in Agriculture, Rural Development and Poverty Reduction TS6 M&E for Conservation and Sustainable Development TS7 M&E in Education TS8 Gender and Rights-based M&E TS9 M&E and HIV/Aids


11h15-13h00 Concurrent Technical Strands: morning sessions (continue)

13h00-14h00 Lunch in Conference venue

14h00-15h30 Concurrent Technical Strands: afternoon sessions

TS1 Innovation in M&E Methods and Approaches in Africa TS2 Community-based M&E TS3 M&E for Good Governance TS5 M&E in Agriculture, Rural Development and Poverty Reduction TS7 M&E in Education TS8 Gender and Rights-based M&E TS9 M&E and HIV/Aids


rands: afternoon sessions (continue) 16h00-17h30 Concurrent Technical St

Saturday, 4 December n: Shaping the Future of Evaluation in Africa 09h00-10h30 Interactive Final Plenary Sessio

Chairperson: Dr Mahesh Patel, Thailand

Joining Forces – Networks, Partnerships, Alliances and Strategies: Voices of Key

Director, UNIFEM f Public Service and

Players shaping M&E in Africa Dr Noeleen Heyzer, ExecutiveDr Richard Levin, Director-General, Department oAdministration, SA Government

Report-back from the Sessions and Strands - Recommendations for a Dynamic

11h00 Tea/co

11h00-12h30 n: Shaping the Future of Evaluation in Africa

Future

ffee 10h30-

Interactive Final Plenary SessioChairperson: Jean-Charles Rouge, Niger

Report-back from the Sessions and Strands; Recommendations (cont.) Mapping the Work of the African Evaluation Association

Dr Zenda Ofir, Chairperson: AfrEA and Executive Director, Evalnet, South Africa

2h30-13h30

nd Sponsors

Closure of the Conference

1 Lunch in Conference venue

13h30-14h30 AfrEA Meeting with Partners a

18

Third AfrEA Conference 1-4 Dec 2004 Number of Participants

ANNEX 3: NUMBER OF PARTICIPANTS PER COUNTRY AND CONTINENT

Continent Region

Country num

ber

of

part

icip

ants

num

ber

of

coun

trie

s Continent Country nu

mbe

r of

pa

rtic

ipan

ts

num

ber

of

coun

trie

s

Africa 420 36 Asia 6 5 Central Africa 17 6 India 2

Burundi 2 Israel 1 Cameroon 1 Malaysia 1 Thailand 1 Chad 1 United Arab Emirates 1 Democratic Republic of Congo 3 Europe 27 10 Gabon 2 Austria 1 Rwanda 8 Belgium 3

East Africa 47 7 France 7 Djibouti 1 Georgia 1 Ethiopia 2 Italy 1 Kenya 20 Netherlands 4 Madagascar 1 Norway 1 Sudan 2 Sweden 2 Tanzania 8 Switzerland 1 Uganda 13 United Kingdom 6

North Africa 9 3 North America 26 2 Egypt 2 Canada 2 Morocco 1 United States of America 24 Tunisia 6 Oceania 2 2

Southern Africa 308 9 Australia 1 Angola 1 New Zealand 1 Botswana 13 Unknown 1 1 Lesotho 1 Malawi 5 Mozambique 12 Namibia 1 South Africa 250 Zambia 5 Zimbabwe 20

West Africa 39 11 Benin 5 Burkina Faso 4 Cote d'Ivoire 2 Ghana 5 Guinea 1 Guinea-Bissau 1 Mali 3 Mauritania 4 Niger 6 Nigeria 5 Senegal 3 TOTAL number of countries 56

19

Third AfrEA Conference 1-4 Dec 2004 Organisations

ANNEX 4: ORGANISATIONS REPRESENTED AT THE CONFERENCE

Academy for Educational Development (AED) (Egypt & United States of America) ACER (Africa) Environmental Management Consultants (South Africa) Action Against Hunger (Malawi) Actionaid International (Ghana & Uganda) Active Learning Network for Accountability and Performance in Humanitarian Action (ALNAP)

(United Kingdom) Africa Consulting (Pty) Ltd (South Africa) African Capacity Building Foundation (ACBF) (Zimbabwe) African Comprehensive HIV/AIDS Partnerships (ACHAP) (Botswana) African Development Bank (AfDB) (Tunisia) African Gender Institute (South Africa) African Peer Review Mechanism (APRM) Secretariat (South Africa) AFRICARE (Niger) Agence intergouvernementale de la Francophonie (France) Agricultural Business Chamber (South Africa) Agricultural Research Council (ARC) (South Africa) Alpha Development Centre (Uganda) Anchor International (South Africa) Approvisionnement en eau Potable en milieu rural (Benin) Association Mauritanienne de Suivi - Evaluation (AMSE) (Mauritania) Austrian Development Agency (Austria) Belgian Ministry of Development Cooperation (Belgium) BES3 / United States Agency for International Development (USAID) Project (Namibia) Botswana Christian AIDS Intervention Programme (BOCAIP) (Botswana) Botswana Institute for Development Policy Analysis (BIDPA) (Botswana) Breldan Consultancy (Kenya) Brooks Consulting (United States of America) Bureau Appui au Développement Durable et à l’Environnement au Sahel – ADDES (Mali) Business and Economic Development Consults Limited (Ghana) Business Intelligence (India) Cameroon Development Evaluation Association (CaDEA) (Cameroon) Cape Technikon (South Africa) anda, Tanzania, United States of America CARE International (Benin, Burundi, Mali, Rw

Zimbabwe) &

Center for Corporate Governance (Kenya) ation (CeDRE) (Malaysia) Center for Development & Research in Evalu Centre for AIDS Development, Research and Evaluation (CADRE) (South Africa) Centre for Education Policy Development (CEPD) (South Africa) Centre for Integrated Community Development and Outreach (CICDOT) (Kenya) Centre for Public Participation (CPP) (South Africa) Centre for Rural Legal Studies (CRLS) (South Africa) Centre for Viable Development Research, Innovation and Intervention (Kenya) Claremont Graduate University (United States of America) Commission Nationale de Lutte contre le SIDA (CNLS) / National AIDS Control Commission (NACC)

(Rwanda) Commonwealth Secretariat (United Kingdom) -based Public Works programme (South Africa) Community Council for Scientific and Industrial Research (CSIR) (South Africa) Crown Agents (SA) Pty Ltd (South Africa) Department of Provincial and Local Government (DPLG) (South Africa) Development Alternatives Consult (Uganda) Development Bank of South Africa (DBSA) (South Africa)

20


Direction Nationale des Collectivites Territoriales (DNCT) (Mali) Eastern Cape Provincial Government (South Africa) Eastern Cape Socio-Economic Consultative Council (ECSECC) (South Africa) Empower Children & Communities against Abuse (ECCA) (Uganda) Enhancement of Universal Primary Education in Kampala (EUPEK) (Uganda) Ethiopian Economic Policy Research Institute (Ethiopia) European Centre for Development Policy Management (ECDPM) (Kenya) Evalnet (South Africa) Exegesis Consulting (South Africa) F3E (France) Faculté des Sciences Agronomiques, Université d’Abomey Calavi (Benin) Firelight Foundation (United States of America) Food Security Initiative in Niger (FSIN) (Niger) Foundation for Contemporary Research (South Africa) Free State Premier's Office (South Africa) Free State Provincial Government (South Africa) Gauteng Government Department of Finance and Economic Affairs (South Africa) Gauteng Tourism Authority (South Africa) German Development Cooperation (GTZ) (South Africa) Girl Child Art Foundation (Nigeria) Government Department of Education (South Africa) Government Department of Environmental Affairs and Tourism (DEAT) (South Africa) Government Department of Housing (South Africa) Government Department of Land Affairs (South Africa) Government Department of Public Service and Administration (South Africa) Government Department of Public Works (South Africa) Government Department of Social Development (South Africa) Government Department of Water Affairs and Forestry (DWAF) (South Africa) Government of Botswana (Botswana) Government of Zimbabwe (Zimbabwe) Groupe des Ecoles EIER – ETSHER (Ecole des Ingénieurs de l’équipement Rural) (Burkina Faso) Health Canada (Canada) HOPE Worldwide (South Africa) Horizonti, the Foundation for the Third Sector (Georgia) Human Rights Network (Uganda) Human Sciences Research Council (HSRC) (South Africa) Ibis (South Africa) Imbewu II Programme (South Africa) Insideout (South Africa) Institute for Democracy in South Africa (Idasa) (South Africa) Intergovernmental Authority on Development (Djibouti) International Development Evaluation Association (IDEAS) (Canada, Ghana, India & South Africa) International Development Research Centre (IDRC) (Kenya) International Finance Corporation (United States of America) International Food Policy Research Institute (IFPRI) (United States of America) International Institute for Communication and Development (Netherlands) International Monetary Fund (United States) International Organisation for Cooperation in Evaluation (IOCE) (Canada, New Zealand & United

Kingdom) International Planned Parenthood Federation - Africa Regional Office (IPPF - ARO) (Kenya) IUCN - The World Conservation Union (Burkina Faso, Kenya & Switzerland) J Roberts Consulting Services (South Africa) JET Education Services (South Africa) John Snow Inc (United States of America & Rwanda)

21


Joint United Nations Programme on HIV/AIDS (UNAIDS) (South Africa) Kenyatta University (Kenya) Khulisa Management Services (South Africa) KwaZulu-Natal Provincial Government (South Africa) Lad-Bay Enterprises (United Arab Emirates) Lagos State Government (Netherlands) LEAP Consultants (Uganda) Life Vanguards (Nigeria) Limpopo Provincial Government (South Africa) Literacy and Adult Basic Education (Uganda) M & E IQ (South Africa) Makerere University (Uganda) Management Development Institute (Senegal) Manto Management (South Africa) MAP – Bénin (Benin) Minister Du Plan et du Developpement (Cote d' Ivoire) Minister of State (Tanzania) Ministere des Affaires etrangeres (France) Ministry for Education and Training (Tunisia) Ministry of Agriculture and Cooperatives (Zambia) Ministry of Agriculture and Food Security (Tanzania) Ministry of Economic Affairs and Development (Mauritania) Ministry of Economy and Finances (France) Ministry of Education (Senegal) Ministry of Finance and National Planning (Zambia) Ministry of Finance, Planning and Economic Development (Uganda) Ministry of Health (Mozambique) Ministry of Higher Education, Science & Technology (Mozambique) Ministry of Labour and Administrative Reform (Sudan) Ministry of Planning & Finance (Mozambique) Ministry of Public Service (Rwanda) Mpumalanga Provincial Government (South Africa) Mupani District Facilitator (South Africa) NASFAM Center for Development (NASCENT) (Malawi) National African Peer Review Mechanism Governing Council (NAPRM-GC) (Ghana) National AIDS Committee (NAC) (Burundi) National AIDS Coordinating Agency (NACA) (Botswana) National Institute of Standards & Quality Assurance (Mozambique) National Intelligence Agency (NIA) (South Africa) National Parks Council (Gabon) National Research Foundation (South Africa) National Smallholder Farmers’ Association of Malawi (NASFAM) (Malawi) Nelson Mandela Foundation (South Africa) Netherlands Development Organisation (SNV) (Netherlands) New Partnership for Africa’s Development (NEPAD) Secretariat (South Africa) New Zealand Agency for International Development (New Zealand) New Zealand High Commission (South Africa) Northern Province Government (South Africa) Norwegians Peoples Aid (Angola) Office of the Premier, North West Province (South Africa) Office of the Prime Minister (Uganda) Oktconsult (Mauritania) Organisation for Economic Cooperation and Development (OECD) (France & Tunisia) Organisation Nationale pour l'enfant, la femme et la famille (ONEF) (Cote d Ivoire)

22


Parliament (South Africa) Partners in Change (South Africa) PE Technikon (South Africa) Plan International (South Africa & Uganda) PME Consulting (Nigeria) Population and Development Information Services (South Africa) Program for Public Sector Evaluation International (Australia) Programme alimentaire mondia (Italy) Programme National Multisec

Congo) toriel De Lutte Contre Le Sida (PNMLS) (Democratic Republic of

Project for Conflict Resolution and Development (PCRD) (South Africa) Projet D Appui Aux Services Agricoles et Aux Organisations de Producteurs (Chad) Public Sector Reform (Mozambique) Public Service Commission (OPSC) (South Africa) Public Service Management (Tanzania) Regional AIDS Training Network (Kenya) for the Future (South Africa) Research Réseau malgache de Suivi et Evaluation (Madagascar) Réseau Nigerien De Suivi Evaluation – ReNSE (Niger) Rhodes University (South Africa) Royal Dutch Embassy (Burkina Faso) Rural Change and Livelihoods (South Africa) SM Wachira & Associates Consultants (Kenya) Save the Children (Ethiopia) Social Development (South Africa) Social Development (Zimbabwe) Society for Family Health (Nigeria) SOS Children's Villages (South Africa) Soul City (Malawi) South African Council for Educators (SACE) (South Africa) South African Grantmakers' Association (SAGA)(South Africa) South African Management Development Institute (SAMDI) (South Africa) South African Wine and Brandy Company (South Africa) South Africa-Netherlands Research Program

Africa) me on Alternatives in Development (SANPAD) (South

South Coast Air Quality Management District (SCAQMD) (United States of America) Southern Hemisphere (South Africa) Students Health and Welfare Centres Organization (South Africa) Swedish International Development Agency (SIDA) (Sweden) Tanzania High Commission (Tanzania) Technical Unit for Public Sector Reform (Mozambique) The Cradle – The Children’s Foundation (Kenya) idency (South Africa) The Pres The President’s Office, Public Service Management (PO-PSM) (Tanzania) The Valley Trust (South Africa) The World Bank (United States) Troparg Consultancy Services (Zimbabwe) Tulane University School of Public Health and Tropical Medicine (United States) Uganda Media Women’s Association (Uganda) United Kingdom Department for International Development (DFID) (Lesotho, South Africa &

United Kingdom) United Nations Capital Development Fund (UNCDF) (United States of America) United Nations Children's Fund (UNICEF) (Bo

Rwanda & Zimbabwe) tswana, Burkina Faso, France, Gabon, Kenya,

United Nations Development Fund for Women (UNIFEM)(Niger & United States of America)

23


United Nations Development Programme (UNDP) (Benin, Democratic Republic of Congo, Guinea, e) Guinea-Bissau, Malawi, Niger, South Africa, United States of America & Zimbabw

United Nations Educational, Scientific and Cultural Organization (UNESCO) (France) United Nations Human Settlements Programme (UN-HABITAT) (Kenya) Université Abdou Moumouni (Niger) Université de Marrakech (Morocco) Université Internationale de langue française au service du développement africain (Unive

Senghor) (Egypt) rsité

University of Botswana (Botswana) University of California Irvine (United States of America) University of Cape Town (South Africa) University of Eduardo Mondlane (Mozambique) University of KwaZulu-Natal (South Africa) University of Leicester (Ghana) University of London (South Africa) University of Malawi (Malawi) University of Nairobi (Kenya) University of Natal (South Africa) University of Pretoria (South Africa) University of South Africa (South Africa) University of Stellenbosch (South Africa) University of the Free State (South Africa) University of the Western Cape (South Africa) University of the Witwatersrand (South Africa) University of Venda (South Africa) University of Zambia (Zambia) University of Zimbabwe (Zimbabwe) Office of the Vice President' (Tanzania) Vrije Universiteit Amsterdam (Netherlands) WK Kellogg Foundation (South Africa) WK Kellogg Foundation (United States of America) Walloon Society for Evaluation and Foresight (Belgium) West Africa Rural Foundation (Senegal) Western Cape Government Department of Agriculture (South Africa) Western Cape Provincial Government (South Africa) William Paterson University (United States of America) World Bank (South Africa) World Health Organization (WHO) (Zimbabwe) World Vision (Zimbabwe) Zambia Evaluation Association (Zambia) Zimbabwe Aids Network (Zimbabwe) Zimbabwe Evaluation Society (ZES) (Zimbabwe) Zimbabwe Prevention Project (ZAPP) (Zimbabwe)

24

Third AfrEA Conference 1-4 Dec 2004 Service Providers

ANNEX 5: CONFERENCE SERVICE PROVIDERS

Communication & Marketing Bizwebs (AfrEA website design/hosting) URL: http://www.bizwebs.co.za/

FedEx (courier service) Tel +27 11 923 8000 URL: http://www.fedex.com/za iKraal Media Solutions (photography) Tel: +27 21 701 9566 Email: [email protected] Mail & Guardian (print advertising) Tel: +27 11 727 7000 Email: [email protected] Topica (listserv / discussion list service provider) URL: http://lists.topica.com/ Audio-Visual Equipment TCH Bonisa Tel: +27 12 424 4940 Email: [email protected] The Sight 'n Sound Group Tel: +27 21 448-4094 Email: [email protected] Materials, Design & Printing Group 7 Printers and Publishers Tel: +27 12 808 1359 Email: [email protected] Hippo Bag & Screen cc Tel: +27 21-593 3360 Email: [email protected] Jetline e.com (photocopying/printing) Tel: +27 11 327 3324 Email: [email protected] Q-MUNI-K (corporate gifts & materials) Tel: +27 82 443 3820 Email: [email protected] School & Office Supplies (stationery) Tel: +27 12 662 2193 Email: [email protected] Solet Prinsloo Graphic Design Tel: +27 12 808 0190 Email: [email protected] Translation & Interpretation Services Deborah Taylor (translation - Niger) Tel: +227 75 23 01 Email: [email protected] Dr Cécile Spottiswoode (interpretation) Tel: +27 21 674 3356 Email: [email protected] French Translation Services Tel: +27 12 884 3544 Email: [email protected] Travel Agent JenTravel Tel: +27 11 7838106 Email [email protected] Venue & Accommodation Cape Banquets Tel: +27 21 488 5161 Email: [email protected] Holiday Inn Cape Town Tel: +27 21 488 5100 Email: [email protected] The St Georges Hotel Tel: +27 21 419 0808 Email: [email protected]

25

Third AfrEA Conference 1-4 Dec 2004 Service Providers

ANNEX 6:

ES FROM THE TSCEN HIRD AFREA CONFERENCE

26

narrative report of the - evaluationcanada.ca · narrative report of the third conference of the...

Documents