Factors that Influence Evaluation Utilisation

Theoretical Perspectives

Michael Quinn Patton’s

‘Utilisation Focused Evaluation’

• Addresses issue of use of evaluation findings in decision-making

• Stakeholders more likely to use evaluation findings if understand and feel ownership of findings

Theoretical Perspectives contd

Carole Weiss (1998) defined four categories of evaluation use:

• Guidance for action: direct instrumental use of findings

• Reinforcement of prior beliefs: enhancing confidence of those who press for change

• Mobilisation of support for desired change

• Enlightenment: increase in understanding

Theoretical Perspectives contd

RAPID (at ODI)

• Divides influence on use into four areas:

– Political context

– Nature of the evidence

– Links

– External factors

Key Factors Affecting Utilisation

1 The Personal Factor

2 Political Considerations

3 Organisational culture

4 Evidence

5 Effective Dissemination / Communication

Key Factors Affecting Utilisation

1 The Personal Factor

Finding the proper ‘owner/s’ at senior mgmt.

Quality, quantity & timing of interactions is important. Right people for the right issues.

Relationships need ongoing nurturing.

Consider need to identify multiple stakeholder communities.

Key Factors Affecting Utilisation contd

2 Political Considerations

Getting the right information to the right people.

Creating the right links.

Understand how policy makers think.

Identify ‘windows of (policy) opportunity’.

Key Factors Affecting Utilisation contd

3 Organisational Culture

Evaluation is part of a broader learning process that promotes ownership and establishes a standard follow-up procedure

Opportunities and constraints

Key Factors Affecting Utilisation contd

Essential characteristics of a follow-up process:

• Evaluation units play role of facilitator• Follow-up includes decision-making by senior mgmt• Follow-up format is established within

departments concerned

Ownership of results thus clearly defined.

Key Factors Affecting Utilisation contd

4 Evidence

Relevance, timeliness, brevity, quality.

Research approach, methodology, and credibility of evidence

Reinforcement of prior beliefs / coherence with other messages and conceptual models

Key Factors Affecting Utilisation contd

5 Dissemination and Communication Strategy

Active and diversified approaches to dissemination and communication

Differentiated, targeted audiences; differentiated products; pro-active follow-up, etc