![Page 1: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/1.jpg)
An Introduction to Outcome Mapping
Tools for Planning, Monitoring & Evaluating
Development Projects and Programs
IPDETJune 16, 2011
Terry Smutylo [email protected]
![Page 2: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/2.jpg)
2
Objectives for this Session
1. Inspire you to search for and adapt evaluation tools to fit your context & needs
2. Introduce key concepts & tools in Outcome Mapping
![Page 3: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/3.jpg)
3
Development interventions can be:
Complex (involve a confluence of actors and factors)
Unstable (independent of project duration)
Non-linear (unexpected, emergent, discontinuous)
Two-way (intervention may change)
Beyond control (but subject to influence)
Incremental, cumulative (watersheds & tipping points)
![Page 4: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/4.jpg)
4
![Page 5: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/5.jpg)
5
Challenges in evaluating development interventions:
establishing cause & effect in open systems measuring what did not happen reporting on emerging objectives timing: success today, failure tomorrow? encouraging ongoing learning reconciling differing values, perspectives measuring ‘sustainable’ results
![Page 6: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/6.jpg)
6
program influence decreases (is replaced)
changed behavior
The focus of Outcome Mapping
community capacity & ownership increases
![Page 7: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/7.jpg)
77
What is Outcome Mapping?
A project/program management tool for:
Clarifying intentions
Developing strategies to achieve results
Identifying information for monitoring and evaluating
Fostering organizational learning
Enhancing other frameworks & methods
![Page 8: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/8.jpg)
8
1990s: IDRC’s post-Rio search for ‘sustainable’ results
1998: Barry Kibel and Outcome Engineering
1999: Collaboration & testing within projects
2000: Publication of manual in English & French
2002: Training, facilitation & usage globally
2006: OM Learning Community: www.outcomemapping.ca
2008: CLAMA
OM: brief history
![Page 9: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/9.jpg)
9
Three key concepts in OM:
Sphere of influence
Recognizing changes in behaviour as outcomes
Boundary Partners
![Page 10: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/10.jpg)
10
BeneficiariesProject or Program
Partners
There are limits to our influence
sphere of influence
sphere of concern
![Page 11: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/11.jpg)
11
inputs activitiesoutputs
Changes in behaviour as ‘outcomes’
sphere of influence
sphere of concern
o u t c o m e s
changes in conditions, well-being
changes in behaviour
![Page 12: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/12.jpg)
12
![Page 13: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/13.jpg)
13
improved human, social, & environmental wellbeing
Step 1:
![Page 14: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/14.jpg)
14
I have a dream!
Martin Luther King, Jr.August 28, 1963
![Page 15: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/15.jpg)
15
The mission is that “bite” of the vision statement on which the
program is going to focus.
MissionStep 2:
![Page 16: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/16.jpg)
16
A mission statement describes:
What do you do?
Who are your principle collaborators?
How do you work with them?
![Page 17: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/17.jpg)
17
✓ about the future
✓ concrete, observable
✓ idealistic
✓ not about the program
✓ feasible
✓ identifies activities and relationships
✓ about the program
Vision Mission
![Page 18: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/18.jpg)
18
Step 3: Who are our Boundary Partners?
Boundary Partners
Beneficiaries
other stakeholders
Project or
Program
![Page 19: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/19.jpg)
19
Participatory research on demonstration farms to develop approaches to drip irrigation
Extension workers visit demonstration farms
Training of extension workers
Publication of performance of different set-ups
Extension workers explain & promote drip irrigation
Farmers adoptdrip irrigation methods
Greater quantities of groundwater available
Farmers participate in field trials using drip irrigation
Farmers add to own knowledge of techniques
Reduced numbers of new wells
Adapted from K. Kelpin, 2009
![Page 20: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/20.jpg)
20
Progress Markers
(Deep transformation)
(Active engagement)
(Early positive responses)
Love to see
Like to see
Expect to see
Step 5:
![Page 21: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/21.jpg)
2121
Why use Progress Markers?
Articulate the complexity of the change process
Encourage the program to seek the most profound transformation possible
Facilitate negotiation of expectations with partners
Enable early assessment of progress
Help identify mid-course improvements
![Page 22: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/22.jpg)
22
Progress Markers – IMF examples
Expect to see local communities:• Participating in regular model forest (MF) meetings• Establishing an organizational structure for cooperation • Acquiring new skills for managing model forests• Articulating a locally relevant vision for the MF
Like to see local communities:5. Contributing resources to set up their MF
6. Calling upon external experts for advice
7. Seeking out new partners for the MF
Love to see local communities:
8. Obtaining funding from different national sources
9. Publishing examples of benefits achieved through MF
10. Helping other communities establish MFs
11. Sharing lessons learned internationally
12. Influencing national policy debates on resource use
![Page 23: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/23.jpg)
23
Sample progress markers
Like to see Women’s Self-Help Groups:4. Soliciting training in maternal & child health for its members5. Acquiring skills in managing credit programs6. Lending money to members
Love to see Women’s Self-Help Groups:7. Lobbying local government for expenditures on community
improvements8. Putting forth candidates for election to local government
council
Expect to see Women’s Self-Help Groups:1. Holding regular meetings2. Discussing a list of shared concerns3. Contributing to a group bank account
![Page 24: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/24.jpg)
24
6 kinds of strategies
Causal Persuasive Supportive
Iaimed at
Individual boundary partner
Strong, direct
influence
Arouse new thinking;
build skills, capacity
Continuing support
Eaimed at boundary partner’s
Environment
Alter the physical,
regulatory or information environment
Broad information disseminatio
n;
Access to new info
Create / strengthen
peer networks
![Page 25: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/25.jpg)
25
causalpersuasiv
esupportiv
e
I
E
Step 6: Strategy Map
![Page 26: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/26.jpg)
26
Step 7: Organizational Practices
How does your team or organization stay relevant, viable and effective?
![Page 27: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/27.jpg)
27
You:
keep learning
foster creativity & innovation
seek better ways to assist your partners
maintain your niche
maintain high level support
build relationships
![Page 28: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/28.jpg)
28
Organizational Practices
1. Prospecting for new ideas, opportunities, and resources
2. Seeking feedback from knowledgeable informants
3. Maintaining the support of your next highest power
4. Assessing and redesigning products, services, systems, and procedures
![Page 29: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/29.jpg)
29
…organizational practices
5. Getting feedback from those already served
6. Sharing your learning with the world
7. Experimenting to remain innovative
8. Engaging in organizational reflection
![Page 30: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/30.jpg)
30
V i s i o n O
RG
AN
IZA
TIO
NA
L
PR
AC
TIC
ES
ST
RA
TE
GIE
S
Und
erta
ken
to
Brin
g
abou
t O
utco
mes
OU
TC
OM
ES
Beh
avio
rs, A
ctio
ns,
Rel
atio
nshi
ps o
f
Bou
ndar
y P
artn
ers
P r o g r e s s M a r k e r s L o v e t o S e e
L ik e t o S e e
E x p e c t t o S e e
B O U N D A R Y P A R T N E R 2
O u t c o m e C h a l l e n g e
M i s s i o n
P r o g r e s s M a r k e r s L o v e t o S e e
L ik e t o S e e
E x p e c t t o S e e
P r o g r e s s M a r k e r s L o v e t o S e e
L ik e t o S e e
E x p e c t t o S e e
S t r a t e g y M a p 3 S t r a t e g y M a p 2 S t r a t e g y M a p 1
B O U N D A R Y P A R T N E R 3
O u t c o m e C h a l l e n g e
B O U N D A R Y P A R T N E R 1
O u t c o m e C h a l l e n g e
![Page 31: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/31.jpg)
31
5 kinds of M&E Information
Program Partner
outcomes(behaviour changes in the
partners)implementation(interventions by the program)
relevance & viability(actions of the program)
C o n t e x t u a l I n f o r m a t I o n
State, status or situational
data
Strategies
![Page 32: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/32.jpg)
32
Changes in well-beingChanges in behavior
‘Capacity’ includes the power & responsibility to act
Need for diversified strategies
Influence not control
Operating Principles of OM:Operating Principles of OM:
Contribution not attribution
![Page 33: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/33.jpg)
33
OM is designed to be:
Flexible: modular to be adapted to use & context
Complementary: can be combined with other methods
Evaluative: promote a culture of reflection, and social & organizational learning
Participatory: seek dialogue and collaboration with partners
![Page 34: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/34.jpg)
34
1.There is no “silver bullet”
2. Seek quality with passion & integrity
3. Recognize & celebrate achievements of your partners
4. Be “idealistic realists.”
5. Learn, and teach upwards.
In monitoring & evaluation:
![Page 35: An Introduction to Outcome Mapping Tools for Planning, Monitoring & Evaluating Development Projects and Programs IPDET June 16, 2011 Terry Smutylo tsmutylo@magma.ca](https://reader033.vdocument.in/reader033/viewer/2022061304/5513da1355034646298b5561/html5/thumbnails/35.jpg)
35
Inspiration & Information
Visit the OM learning community:
www.outcomemapping.ca
www.mapeodealcances.net
http://publicwebsite.idrc.ca/EN/Themes/Evaluation/Pages/default.aspx