Module 1Module 1

Program Evaluation Program Evaluation and Its Practiceand Its Practice

22

OverviewOverview

What is evaluation? Definitions of program evaluation What can be evaluated? What is a program? Why evaluate programs? Historical overview

33

Working Definition of Program Working Definition of Program EvaluationEvaluation

Evaluation is the process of making

judgements about programs based on

information and analysis relative to such

issues as relevance, cost-effectiveness and

success for its stakeholders

44

Evaluations provide . . . Evaluations provide . . .

Judgements – that affect

Stakeholders – who are the people with a vested interest

Information – with which to make

55

What to Evaluate?What to Evaluate?

Institution

Organization

Projects

Program Program

66

Program EvaluationProgram Evaluation

A program is an intervention, comprised of various activities, processes or projects, all of which are intended to contribute to a common goal.

Program evaluation can be applied both to the whole program or to its sub-components.

77

Formative EvaluationFormative Evaluation

To improve the operation of an existing program

Conducted during the implementation of the program

Allows you to pinpoint problems, correct them and get things back on track

88

Summative EvaluationSummative Evaluation

Conducted to assess the results of the program (its outcomes)

Done once the program is completed Allows you to demonstrate results of

the program

99

Why Evaluate Programs?Why Evaluate Programs?

Accountability

Decision-

Making

Learning ?

1010

Evaluations provide . . . Evaluations provide . . .

Judgements – that affect

Stakeholders – who are the people with a vested interest

Information – with which to make

1111

Evaluation has Roots in Many Evaluation has Roots in Many FieldsFields

Law (Common/Civil) Agriculture (Agricultural Economics) Health / Medicine Human Sciences (Psychology /

Education) Evaluation Science Business

1212

Dominant ApproachesDominant Approaches

19th century: Measurement 1920s - 50s: Description/Comparison 1950s - 80s: Judgement 1980s: Transparency/ Accountability Performance 1990s: Empowerment/

Transformation

1313

Good Program EvaluationGood Program Evaluation

Is strategic, as it gives priority to large, problematic or important programs

Focuses on important issues for decision-makers

Is credible Is timely Produces useable results

1414

Monitoring and EvaluationMonitoring and Evaluation

Monitoring assesses progress in implementation of ongoing programs

Evaluation provides a snapshot against some benchmarks at a point in time of programs that may or may not be continuing

1515

Monitoring and Evaluation - Monitoring and Evaluation - RationaleRationale

Monitoring• holds implementers

accountable for delivery of inputs

• provides basis for corrective action

• provides assessment of continued relevance

Evaluation• Accountability

- was money well spent?

• Learning - what could we do better next time?

1616

Monitoring and Evaluation - FocusMonitoring and Evaluation - Focus Monitoring

• Was delivery according to plan?

• What were the deviations?

• Were they justifiable?

Evaluation• Relevance• Appropriateness• Success• Cost effectiveness• Lessons learned• Effectiveness• Impact• Sustainability• Efficiency

1717

Monitoring and Evaluation - Monitoring and Evaluation - TimingTiming

Monitoring• Ongoing or

periodic throughout the life of the program

Evaluation• Typically at mid-

point in a funding cycle, a year before the end

• Impact evaluation - 3 to 5 years afterwards

• Delay depends on the nature of the project