a roadmap: impact evaluation to development impact...

19
A Roadmap: Impact Evaluation to Development Impact (i2i) M Abul Azad IE Coordinator, DIME ieConnect Impact Evaluation Workshop Rio de Janeiro, Brazil June 22-25, 2015

Upload: others

Post on 20-Apr-2020

11 views

Category:

Documents


0 download

TRANSCRIPT

A Roadmap:

Impact Evaluation to Development Impact (i2i)

M Abul Azad

IE Coordinator, DIME

ieConnect Impact Evaluation WorkshopRio de Janeiro, BrazilJune 22-25, 2015

What have we done

Oops

What have we really done?

QUESTIONS SOLUTIONS ? METHODS

What will we do next?

PRESENT DESIGN IMPLEMENT DISSEMINATE

Who will be involved?

WORLD BANK OPERATIONS TEAM

IMPACT EVALUATION

RESEARCH TEAM

PROJECT IMPLEMENTATION

TEAM

Design

• Inputs: o Project design (determines overall structure of

the project and sets overarching development objectives)

o Impact evaluation research questions and hypotheses

o Evidence, experience, expertise

• Output:o IE concept noteo IE concept note review meeting

TASKS ProjectImplementation Team

World Bank Operational Team

Impact Evaluation Research Team

IE design mission Joint responsibility

Intervention design Intervention designand approval

Operational and technical inputs

Concept note drafting Policy, operational, technical inputs; review; no objection

Drafting

Concept note review Review and respond to comments; attend meeting

Primary responsible for responding to

comments; redrafting if needed

Design

Implementation

IE data collection and analysis

InputsResearch protocol

Data collection tools and procedures

Analytical plan

Funding

OutputsDatasets

Intermediate and final analyses

Feedback to the project team

Implementation of IE interventions

Inputs

Operational manual

Monitoring tools

Implementing partners

Funding

Outputs

Activities implemented

Field reports

Monitoring data

IE data collection and analysis

TASKS ProjectImplementation Team

World Bank Operational Team

Impact Evaluation Research Team

Ethical clearance Support with national guidelines

Drafting and submission

Design of data collection tools and procedures

Context and sector expertise Development of tools

Hiring of data collection firm

Hiring of firm Supervision of process

TOR drafting;technical review

Funding of data collection

Primary responsibility No objection

Supervision of data collection

Supervision of contract Supervision of process

Supervision & direct inputs into fieldwork

Analysis and drafting of reports/briefs

Operational and policy inputs Analytical work

Implementation of IE interventions

TASKS ProjectImplementation Team

World Bank Operational Team

Impact Evaluation Research Team

Drafting of operational manual

Primary responsibility Supervision and technical and

operational inputs

Technical and operational inputs

Implementation of interventions

Primary responsibility Planning support and supervision

Planning and implementation

support

Funding of implementation

Primary responsibility Supervision

Ongoing monitoring Primary responsibility Supervision Planning and implementation

support

Dissemination

• Inputs/Activities: o IE and M&E datao Analyseso Dissemination strategy

• Outputs:o Ongoing feedbacko Policy and operational briefso In and out-of country dissemination events

(seminars, workshops, conferences)o Working papers and journal articleso Social media

Dissemination

TASKS Project Implementation Team

World Bank Operational Team

Impact Evaluation Research Team

Ongoing operationaland policy feedback

Willingness to adjust Support adjustmentprocesses

Provide feedback

Preparation of reportsand briefs

Policy, operational, technical input Primary responsibility

Dissemination in-country

Securing key audiences; preparing

and presenting

Preparing and presenting

Dissemination out of country

Preparing and presenting

Securing key audiences; preparing andpresenting

Academic papers Operational and policy inputs Primary responsibility

Social media Shared responsibility

A roadmap examplePRESENT (today)

DESIGN

Design mission

Concept note review and approval

IMPLEMENT

Baseline data collection and analysis

Roll-out of activities

Follow-up data collection(s)

End-of-evaluation dissemination activities

DISSEMINATE

A roadmap example

Big question

What are the costs?

o Research design & concept note developmento Data collection o Analysis o Intervention o Dissemination

Bigger question

Who will pay for all these?

INVESTMENT CATEGORY SOURCE OF FUNDING

INTERVENTIONS PROJECT BUDGET

DATA COLLECTION PROJECT M&E BUDGET

RESEARCH TEAM EXTERNAL SOURCES (E.G. i2i)

i2i

$50,000 x 3

$25,000

$20,000

i2i

• Expression of interest

• Technical review by external reviewers

• Policy review by World Bank regional departments

• $25k seed funding for concept note development

• $50k IE implementation funding per year for three years

• $20k dissemination funding

Thank You!

facebook.com/ieKnow

#impacteval

blogs.worldbank.org/impactevaluations

microdata.worldbank.org/index.php/catalog/impact_evaluation

http://dime.worldbank.orgWEB