results of final evaluation on card€¦ · questionnaire (2) target countries for interview bmgf...

Results of Final Evaluation

on CARD

The 7th CARD General Meeting

October 2nd, 2018, Tokyo, Japan

Takanori Satoyama

General Coordinator

CARD Secretariat

PwC

1. Overview of Final Evaluation

1-1. Scope of Evaluation

1-2. Target Countries and Institutions

1-3. Method of Evaluation

2. Achievement of CARD

2-1. Achievement at Country Level

2-2. Achievement at Initiative Level

3. Positive Feedback

4. Success Factors & Challenges

5. Lessons Learned

5-1. Lessons Learned at Country Level

5-2. Lessons Learned at Initiative Level

6. The Way Forward

6-1. Proposed target, focus areas/

approaches, and selection

standards for member countries

6-2. Proposed priorities and scopes

Outline

1. OVERVIEW OF THE FINAL EVALUATION

PwC 4

Prepare recommendations to

African countries in order to

leverage on CARD and

continue to implement the

NRDS beyond 2019

(1) Research on the

achievements of

CARD as

an international initiative

(2) Research regarding

the impact of CARD on

the individual country-level

(3) Preparation of

recommendations for the

African rice sector

development beyond 2019

Member countries

Understand the implementation

status of NRDS as well as

impact of CARD, and analyze

the issues and KSFs

Understand the

achievements of CARD and

the implementation status,

and analyze the issues and

KSFs

SC members and Partner

Organizations

－

－

Prepare recommendations

to CARD beyond 2019

based on research on the

current situation

Eva

luatio

n Ite

ms

Target

1. Overview of Evaluation

1-1 Scope of Evaluation

PwC 5

1st

Group

Ghana

Guinea

Tanzania

Madagascar

Mozambique

Nigeria

Uganda

Cameroon

Serra Leone

Kenya

Mali

Senegal

Côte d’Ivoire

Rwanda

CAR

Zambia

Benin

Burkina Faso

DR Congo

Ethiopia

The Gambia

Liberia

Togo

2nd

Group

Group Country

Total No. of

Countries

(1) Target countries for

questionnaire

(2) Target countries for

interview

●

●

● ●

● ●

●

● ●

●

●

● ●

●

●

●

●

● ●

●

● ● ●

●

●

●

●

●

●

●

●

●

●

23 11 + Kenya

▲

●

Target Countries Target Institutions

Group Institutions

Steering

Committee

members

JICA

JIRCAS

AfricaRice

AGRA

FARA

IRRI

NEPAD

FAO

CARD Secretariat

AfDB

IFAD

WB

IWMI

WFP

BRAC

BMGF

Partner

organizations


1-2 Target Countries and Institutions

PwC 6 6

1200.

Development of

research

indicators list

1100.

Hypothesis set

up

1000. Research

Preparation

6000. Reporting

6100.

Kick-off

6200.

Inception

report

6300.

Interim

Report

6400.

Draft Final

report

6600.

Final

Report 6500.

CARD SC meeting

：Work in Africa

2000. Desktop

Research

2100.

Collection of

existing info

2200.

Additional

desktop

research

3000.

Questionnaire

＠23 countries

3100.

Selection of

target

organizations

3200.

Questionnaire

design

3300.

Questionnaire

survey

3400.

Organization

of research

results

4000. Field Research ＠11

countries

4200.

Field research

1

4300.

Field research

2

4400.

Field research

3

5000.

Recommendations

5100. Organization

and analysis of the

achievement and

challenges of CARD

5200.

Recommendations

for the next phase

4500.

Analyzing

research

results

4100.

Preparation of

research

items

11 countries

23 countries


1-3 Method of Evaluation

2. ACHIEVEMENT OF CARD

PwC 8

NRDS Process

NRDS Formulation &

LaunchingGap Analysis & Prioritization

Concept Notes

Lobbying for Funding

Project Cycle Management

Updates

XDonor Mapping

NeedsMapping = Gaps

Priorities

↓

Mechanization Promotion

Thematic issues e.g. Market Access

↓

Alignment to CAADP

NRDS Taskforce

Gov’t Budget

CAADP I/P

DPs

PrivateSector

Concept Notes

NRDS Process

NRDS Formulation &


Concept Notes



Updates

XDonor Mapping

NeedsMapping = Gaps

Priorities

↓



↓

Alignment to CAADP

NRDS Taskforce

Gov’t Budget

CAADP I/P

DPs

PrivateSector

Concept Notes

NRDS Process

NRDS Formulation &


Concept Notes



Updates

XDonor Mapping

NeedsMapping = Gaps

Priorities

↓



↓

Alignment to CAADP

NRDS Taskforce

Gov’t Budget

CAADP I/P

DPs

PrivateSector

Concept Notes

NRDS Process

NRDS Formulation &


Concept Notes



Updates

XDonor Mapping

NeedsMapping = Gaps

Priorities

↓



↓

Alignment to CAADP

NRDS Taskforce

Gov’t Budget

CAADP I/P

DPs

PrivateSector

Concept Notes

=

NRDS Process

NRDS Formulation &


Concept Notes



Updates

XDonor Mapping

NeedsMapping = Gaps

Priorities

↓



↓

Alignment to CAADP

NRDS Taskforce

Gov’t Budget

CAADP I/P

DPs

PrivateSector

Concept Notes

×

1) NRDS formulation and launch

(updating)

NRDS Process

NRDS Formulation &


Concept Notes



Updates

XDonor Mapping

NeedsMapping = Gaps

Priorities

↓



↓

Alignment to CAADP

NRDS Taskforce

Gov’t Budget

CAADP I/P

DPs

PrivateSector

Concept Notes

NRDS Process

2-1 Achievement at Country Level

- NRDS Process -

PwC 9

Country NRDS Rice Seeds Mechanization

Status Year of formulation Period covered

1st

Group

Cameroon 2009 2008-2018

Ghana 2009 -2020

Guinea 2009 2008-2018

Kenya 2009/2014 2008-2018

Madagascar 2009/2016 2008-2018

2016-2020

Mali 2009 2008-2018

Mozambique 2011/2016 2008-2018

2016-2027

Nigeria 2009 2007-2018

Senegal 2009/2012/2014 -2017

Sierra Leone 2009 2008-2018

Tanzania 2009 2008-2018

Uganda 2012 2008-2018

2nd

Group

Benin 2011 2008-2018

Burkina Faso 2011 2008-2018

CAR 2012 2008-2025

Cote d’Ivoire 2012 2012-2020

DR Congo 2013 2008-2018

Ethiopia 2010 2009-2019

The Gambia 2014 2015-2024

Liberia 2012 2008-2018

Rwanda 2011/2013 2011-2018

Togo 2010 2008-2018

Zambia 2011/2016 2016-2020

：Finalized and approved

：Drafted

As of June 2017


- Policy Development -

PwC 10

Country NRDS Concept notes CARD labeled projects

1st

Group

Cameroon 7

Ghana 14

Guinea 6

Kenya 4

Madagascar 16

Mali 18

Mozambique 4

Nigeria 21

Senegal 15

Sierra Leone 4

Tanzania 17

Uganda 9

2nd Group

Benin 21

Burkina Faso 9

CAR N/A

Cote d’Ivoire 13

DR Congo 4

Ethiopia 5

The Gambia 2

Liberia N/A

Rwanda 5

Togo 11

Zambia 3

：Done

Evaluation reports have been drafted in about 10 countries including Cote d’Ivoire, Guinea, Mali, Nigeria, and Senegal

As of June 2017


- Implementation and Monitoring-

PwC 11

General Meeting

6 meetings were held in

2008, 2009, 2010, 2011,

2013 and 2015 to update

progress of CARD.

Steering Committee

12 meetings were held

once or twice a year to

discuss the operation and

management of CARD.

Workshop/Training

•Video conference seminar

•Regional workshop

•Pre-conference seminar

•Side event

•Tsukuba seminar

Website

Technical materials and

analytical work produced by

SC members were shared on

the website.

Other

Other achievements include

facilitating information exchange

among stakeholders through

e-mail correspondence.

2-2 Achievement at Initiative Level

3. POSITIVE FEEDBACK

PwC

Learning from the experiences of member countries

Opportunities were provided to follow each other’s progress, and countries that are leaders in implementing the NRDS shared the lessons learned with others.

Capacity building (learning from SC members)

Technical advice at conferences contributed to the improvement of policy-making capabilities of participants.

South-south cooperation (SSC)

Participants learned the experiences of SSC countries through conferences and training or study tours that were organized by SSC countries.

Partnership among SC members

Information obtained from other SC members served as input for their decision making on rice projects.

Public-private partnership

CARD invited the private sector to conferences to give presentations.

Partnerships among projects/initiatives

Coordination and alignment of some initiatives were improved as duplication was avoided.

Sensitization and branding

CARD was one of the factors behind the increase in government commitment towards rice development in both member and non-member countries.

Application to other strategy formulation

CARD’s approach to developing the NRDS was applied in the formulating of other strategies.

Other CARD activities contributed indirectly to the establishment of institutions and the collection of baseline data 13

The

Permanent

Secretary for

the Ministry of

Agriculture in

Madagascar went

to Uganda to learn

about the

implementation

structure of NRDS

In the countries

such as Uganda,

Zambia and the

DRC, the NRDS

guided the

government to take

a crop-specific

approach.

3 Positive Feedback

4. SUCCESS FACTORS AND CHALLENGES

PwC 15

Factors Success Challenge

Go

ve

rn

me

nt

The importance of rice for the national economy and/or food security

✓

Authority of the NRDS ✓

Assignment of appropriate unit ✓ ✓

Government structure for implementation ✓ ✓

Authority/level of CARD focal point ✓ ✓

Number and capacity of government officials ✓ ✓

Continuity of CARD focal point / taskforce/ high-ranking officials

✓ ✓

Financial resources ✓

Action plan for NRDS implementation ✓

Ownership and support from high-level government officials

✓

✓

Incentives for rice development promotion ✓

Bureaucracy ✓

Other government policies ✓ ✓

Rice is important for many countries, but in some cases

an existing strategy is already in place as a master

document for fund mobilization.

The leadership of high-

level government officials

has facilitated the

enhancing of stakeholder

involvement and NRDS

implementation.

A dedicated unit for rice was a key to storing

institutional knowledge.

4 Success Factors and Challenges (1/3)

PwC 16


Se

cre

taria

t

Communication ✓

Provision of personnel ✓ ✓

Financial resources ✓

Number and capacity of human resources ✓

Authority ✓

Advocacy for government high-officials ✓ ✓

Methodology ✓

SC

me

mb

er

s a

nd

Pa

rtn

er

O

rg

an

iza

tion

s

Communication between the SC member

representative and SC local office ✓

Awareness of CARD ✓

Incentive to participate ✓

Commitment ✓

Roles of SC members ✓

JICA's support ✓

Inclusion in organization’s development

assistance strategy/policy ✓

Donor presence and office functions ✓

Success stories from rice project ✓

Collaboration ✓ ✓

The Secretariat with higher

authority would have

facilitated dialogues among

the management of SC

members/ Partner

Organizations.

The roles of SC members were

not clear, and communication

between the headquarters and

local offices was not

encouraged.

The visibility of CARD

among SC local offices was

still a big challenge in many

countries.


PwC 17


GM

an

d S

C

Frequency ✓

Timing ✓

Participation/ membership ✓

Authority ✓

Meeting agenda ✓ ✓

Logistics ✓

Venue ✓ ✓

Oth

er

Selection of member countries ✓

Distribution of roles among the CARD

Secretariat, JICA, and other SC members ✓ ✓

Indicators and baseline data ✓

Availability of reliable statistics and evaluation of progress

✓

Introduction of rice as a new crop ✓ ✓

External Factors ✓

Private-sector involvement ✓

The CARD meetings have

been well run. But the

change of participants has

affected the quality of

discussions, because new

focal points are not always

well aware of the content

of previous meetings.

Without an evaluation mechanism,

stakeholders were not able to track the progress of the

strategies.


5. LESSONS LEARNED

PwC 19

A. To make the policy substantial:

Rice is important to the national economy and/or food security

Support for rice development strategy will be necessary as no other strategy works as a master strategy for rice, especially

when rice is still new to a country

B-1. To ensure that relevant officials raise funds under NRDS:

Appropriate units should be assigned to implement the policy in

different areas of the rice value chain

Have a succession plan for focal points and task force members

C. To conduct effective monitoring to show impacts to other

stakeholders :

Targets and goals will have to be clear from the beginning

Baseline data and reliable statistics will have to be in place

B-2. To involve donors for harmonization under NRDS:

Hold frequent discussions at the technical level

High-level officials will have to be committed to lead technical

officers in approaching donors in the right manner

Institutionalized regular meetings will have to be in place

Issues in the first phase Proposed steps in the next phase

A. P

olic

y

De

ve

lop

me

nt

B. F

un

d m

atc

hin

g

C. M

onito

ring

Stakeholders, especially

those outside the

government do not refer

to the NRDS even when

it has been developed.

New focal points

misunderstood that once

the strategy was finalized,

the aim of CARD would

be achieved.

Development partners

were not necessarily

aware of CARD, and

fund matching activities

were limited.

Stakeholders were not

able to know the

progress of CARD.

5-1 Lessons Learned at Country Level

PwC 20

Issues in the first phase

The operationalization of the strategy

remained weak.

Identify the priorities and clarify the scopes

based on a clear and competitive strategy

Proposed steps in the next phase

The strategic prioritization of activities, roles

and responsibilities of the stakeholders,

infrastructural support, and resource

allocation were not optimized.

CARD morphed into relying mainly on the

Secretariat to implement its strategy.

The Secretariat had to utilize limited

resources in response to the demands from

counterparts on an ad-hoc basis, which

ultimately undermined potential impacts.

Stakeholders interviewed, especially outside

the government stated that they do not have

a clear idea of what CARD does exactly.

Assign roles and responsibilities among

stakeholders and align activities,

infrastructural support, and resources

accordingly

Communicate with stakeholders to create a

clear understanding about the vision,

strategic priorities, the scopes of work, and

targeted impacts of CARD

Create impacts effectively by ensuring that

each stakeholder fulfills their own roles and

responsibilities

1.

2.

3.

4.

5-2 Lessons Learned at Initiative Level

6. THE WAY FORWARD

PwC 22

Country/region/group

-specific approaches

South-South

cooperation

Further engagement with private

sector actors is recommended.

Member countries may be

grouped according to their

commonalities.

Similar initiatives exist, and synergies should be created and a clear position established for

CARD.

Increased engagement is

necessary (knowledge-sharing

through study tours, projects,

workshops etc.)

Continue to focus on increasing rice production in Sub-Saharan Africa

Target

Focus

areas/approaches

Rice is one of the top

strategic crops

Commitment of the

government in

promoting

the rice sector

Commitment of SC

members in supporting

the rice sector

Selection standards

Synergy with similar

initiatives

Private sector

involvement

6-1 Proposed Target, Areas/Approaches, and

Selection Standards for Member Countries

PwC 23

Activities Priorities Actions in the second phase

Initia

tive

leve

l

A) Information & knowledge sharing

High-Middle

1.Increase opportunities for learning from non-member countries

2.Host more workshops for knowledge-sharing among SC members

3.Create a database of best practices and lessons learned

4.Restructure the website

5.Deliver information about progress of CARD

B) Policy dialogue & advocacy

High 1.Ensure the involvement of high-level officials of SC members

2.Strengthen lobbying with high-level officers

3.Expand policy advocacy to the sub-regional level

Co

un

try le

ve

l

C) Policy development

Middle 1.Provide assistance for renewing current strategies

2.Ensure the involvement of development partners

3.Strengthen the incorporation of NRDS in existing policies

D) Implementation

High 1.Support the preparation of an action plan for implementation

2.Establish country-level steering committees 3.Support focal points and taskforces in marketing concept notes

4.Host roundtables for SC members at the initiative level 5.Add officers for policy planning and project coordination to taskforce

6.Strengthen institutional support

E) M&E

High-Middle

1.Encourage evaluation study

2.Encourage the involvement of M&E units

3.Training of M&E personnel

6-2 Proposed Priority and Scope

Thank you

results of final evaluation on card€¦ · questionnaire (2) target countries for interview bmgf...

Documents