Overview and Introduction to RAPID

Lessons and ToolsJohn Young

Click icon to add partner logo

6 lessons from our work

Policy processes and social realities are complex

Research plays a minor role in

policy and practice

But it is possible for research to

play a role

Must understand landscape

Policy and social

entrepreneurs need a set of

skills

Intent is necessary!

2

Identify the problem

Commission research

Analyse the results

Choose the best option

Establish the policy

Evaluation

Implement the policy

Policy processes are not...

3

Monitoring and Evaluation

Agenda Setting Decision

Making

Policy Implementation

Policy Formulation

Policy processes are more like ...

Civil Society

DonorsCabinet

Parliament

Ministries

Private Sector4

5

Policy and complexity

• Interconnected• Feedback• Emergence• Nonlinearity• Sensitivity• Changing• Edge of chaos• Adaptive agents• Self-organising• Co-evolution

The gap betweenresearch and policy

Research Policy

gap

Bridge6

No gap between research and policy

Rese

arch

Policy

Technocratic networks

Ideological think tanks

Internal think tanksUN Think

tanks Public think tanks

Political parties

Lobbies

NGOs

corporations

Universities

Regulatory bodies

Executive

Crowded

Map

Think tanks

The six lessons

Policy processes and social realities are complex

Evidence plays a minor role in

policy and practice

But it is possible for research to

play a role

Must understand landscape

Policy and social

entrepreneurs need a set of

skills

Intent is necessary!

8

Policy makers are…

• Speed• Superficiality• Spin• Secrecy• Scientific Ignorance

Vincent Cable – Lib. Democrat MP & Shadow Minister of FinanceMore at: www.odi.org.uk/RAPID/Meetings/Evidence

…practically incapable of using evidence because of the 5 Ss…

9

Evidence

Experience & Expertise

Judgement

Resources

Values and Policy

Context

Habits & Tradition

Lobbyists & Pressure Groups

Pragmatics & Contingencies

There are many factors

Source: Phil Davies Impact to Insight Meeting, ODI, 200510

Different notionsof evidence

Source: Phil Davies Impact to Insight Meeting, ODI, 200511

• ‘Scientific’ (Context free)

• Proven empirically

• Theoretically driven

• As long as it takes

• Caveats and qualifications

Researchers

• Colloquial (Contextual)

• Anything that seems reasonable

• Policy relevant

• Timely

• Clear Message

Policy Makers

The six lessons

Policy processes and social realities are complex

Research plays a minor role in

policy and practice

But it is possible for evidence to

play a role

Must understand landscape

Policy and social

entrepreneurs need a set of

skills

Intent is necessary!

Health Care in Tanzania

“The results of household disease surveys informed processes of health service reform which contributed to a 43 and 46 per cent reduction in infant mortality between 2000 and 2003 in two districts in rural Tanzania.”

TEHIP Project, Tanzania: www.idrc.ca/tehip

14

Some IE Examples

• Progresa-Oportunidades (2004)– IFPRI – Mexican Government– Direct impact on programme– Popularised RCTs

• Deworming in Kenya (2004)– International Child Support Africa + Kenyan

Government– JPAL

• Microcredit in Bangladesh (2008)– Highly contested– Political controversy re Microcredit

The six lessons

Policy processes and social realities are complex

Research plays a minor role in

policy and practice

But it is possible for research to

play a role

Must understand landscape

Policy and social

entrepreneurs need a set of

skills

Intent is necessary!

15

An analytical framework

The political context – political and economic structures and processes, culture, institutional pressures, incremental vs radical change etc.

The evidence – credibility, the degree it challenges received wisdom, research approaches and methodology, simplicity of the message, how it is packaged etc

External Influences Socio-economic and cultural influences, donor policies etc

The links between policyand research communities – networks, relationships, power, trust, knowledge etc.

16

A practical framework

External Influences political context

evidencelinks

Politics and Policymaking

Media, Advocacy, Networking Research,

learning & thinking

Scientific information exchange & validation

Policy analysis, & research

Campaigning, Lobbying

17

The six lessons

Policy processes and social realities are complex

Research plays a minor role in

policy and practice

But it is possible for research to

play a role

Must understand landscape

Policy and social

entrepreneurs need a set of

skills

Intent is necessary!

18

Policy and social entrepreneurs

Researcher

Storyteller Networker

FixerEngineer

19

The six lessons

Policy processes and social realities are complex

Research plays a minor role in

policy and practice

But it is possible for research to

play a role

Must understand landscape

Policy and social

entrepreneurs need a set of

skills

Intent is necessary

20

To maximise impact you need to:

21

• focus more on policy• establish different incentives• establish different systems• spend more on communications• engage with different actors• produce different products• be ready to seize unexpected policy

opportunities and move very fast

Any questions?

RAPID Outcome Mapping Approach

23

Different time, different approaches

Academic research communications

Develop a network or partnership

Online communications

Media strategy

More research

Policy advocacy coalition

24

Different roles and functions

Message based on

Mode of work

Ideology, values or interests

Applied, empirical or synthesis

research

Theoretical or academic research

Independent research

Consultancy

Influence/advocacy

The Media

Political parties

Applied research centers in Universities

Internal think tanks, ideological centers, interest groups, NGOs, lobbies

Chief scientific advisors, Academic/Opinion leaders

Oxbridge

Consultancies

“Independent Think tanks”

.25

Types of policy change

Procedural changes

26

The steps

27

Start by defining your policy objectives –

constantly review them during the

process

The RAPID Framework

The political context – political and economic structures and processes, culture, institutional pressures, incremental vs radical change etc.

The evidence – credibility, the degree it challenges received wisdom, research approaches and methodology, simplicity of the message, how it is packaged etc

External Influences Socio-economic and cultural influences, donor policies etc

The links between policyand research communities – networks, relationships, power, competing discourses, trust, knowledge etc.

28

29

Political economy analysis

The steps

30

Start by defining your policy objectives –

constantly review them during the

process

Develop enthusiasm to address

topic

Learn in partnership

Develop awareness

and enthusiasm

Challenge existing beliefs

High

Gene

ral l

evel

of

alig

nmen

t Low

LowHigh

Interest in specific

topic

Identifying audiences

AIIM Matrix

1. Identify all stakeholders

2. Map them onto the alignment / interest matrix

3. Identify who has power

4. Identify who you can influence

31

The steps

32

Start by defining your policy objectives –

constantly review them during the

process

Progress Markers

• Move from initial to more profound changes in behaviour

• Show transformation in a single boundary partner

• More informative than a single indicator

33

34

Outcome Mapping

OUTCOME MAPPING:Building Learning and Reflection into Development ProgramsSarah Earl, Fred Carden, and Terry Smutylo

http://www.idrc.ca/en/ev-9330-201-1-DO_TOPIC.html

The steps

35

Start by defining your policy objectives –

constantly review them during the

process

Force Field Analysis

5*

3

?

?

MEF

Time

?

?

Negative forces

4

1

2

?

Funds

CSOs

Public demand

?

Positive forces

5

1

?

?

Your influence on the force

Plan:

Minister of Trade puts forward pro-poor trade and complementary policy programme to the cabinet by April 2008

4

5

2

?

Your influence on the force

36

Assessing internal capacity

Start by defining your policy objectives –

constantly review them during the

process

37

SWOT Analysis

• What type of policy influencing skills and capacities do we have?

• In what areas have our staff used them more effectively?

• Who are our strongest allies?• When have they worked with

us?• Are there any windows of

opportunity?• What can affect our ability to

influence policy?

Strengths Weaknesses

Opportunities Threats

38

Monitoring and Evaluating

39

Start by defining your policy objectives –

constantly review them during the

process

40

Stories

Stories of change1. Situation2. A change or challenge3. Action4. Result5. Lesson

41

After Action Review

An after action review asks 4 simple questions:

• What was supposed to happen?

• What actually happened?

• Why was there a difference?

• What can we learn from it?

15 minute team debrief, conducted in a “rank-free” environment.

• Progress Markers• Opportunities and

Threats timeline• Policy Objectives• AIIM• Force Field Analysis

• Force Field Analysis• Policy entrepreneur questionnaire• SWOT• Internal performance frameworks

• Log Frame (flexible)• Outcome Mapping• Journals or impact logs• Internal monitoring tools

• AIIM• Stakeholder analysis• Influence Mapping• Social Network Analysis• Force Field Analysis

• Publications, public relations• Media and events• Negotiation and advice• Develop a network or coalition• Research

• RAPID Framework• Drivers of Change• Power Analysis• SWOT• Influence Mapping• Force Field Analysis

Other tools

Start by defining your policy objectives –

constantly review them during the

process

42

Resources• Bridging Research and Policy in International Development. An analytical and practical framework.

ODI/RAPID Briefing Paper 1. 2004 - http://www.odi.org.uk/resources/details.asp?id=159&title=bridging-research-policy-international-development-analytical-practical-framework

• Helping researchers become policy entrepreneurs. How to develop engagement strategies for evidence-based policy-making. John Young and Enrique Mendizabal. ODI Briefing Paper 53. 2009 - http://www.odi.org.uk/resources/details.asp?id=1127&title=become-policy-entrepreneur-roma

• 3ie Clinic IE Case Studies - ?????• Tools for Policy Impact: A Handbook for Researchers, ODI Toolkits, September 2004 -

http://www.odi.org.uk/resources/details.asp?id=156&title=tools-policy-impact-handbook-esearchers • Tools for Knowledge and Learning: A Guide for Development and Humanitarian Organisations ODI

Toolkits, June 2006 - http://www.odi.org.uk/resources/details.asp?id=153&title=tools-knowledge-learning-guide-development-humanitarian-organisations

• Problem-driven governance and political economy analysis, Good Practice Framework, Verena Fritz, Kai Kaiser, Brian Levy, World Bank 2009 - http://www.odi.org.uk/events/docs/3791.pdf

• DFID Political Economy Analysis How To Note – July 2009 - http://www.odi.org.uk/events/docs/3797.pdf

• Outcome Mapping: Building Learning and Reflection into Development Programs. Sarah Earl, Fred Carden, and Terry Smutylo IDRC http://www.idrc.ca/EN/Resources/Publications/Pages/IDRCBookDetails.aspx?PublicationID=121

• Knowledge to Policy. Making the Most of Development Research. Fred Carden. IDRC 2009. http://www.idrc.ca/EN/Resources/Publications/Pages/IDRCBookDetails.aspx?PublicationID=70

• 3ie/ODI Policy Impact Toolkit - http://policyimpacttoolkit.squarespace.com/

Any questions?