choosing the correct evaluation approach for your project€¦ · table 1. characteristics of...
TRANSCRIPT
Participatory Approach
Process!of!inquiry,!learning,!critical!analysis,!community!building!and!
social!change!using!a!collaborative!approach!that!values!the!
contribution!of!everyone!involved.!
!
Outcome Mapping
Plan,!monitor!and!evaluate!activities!that!bring!
about!behavioural!change!in!society!!
Is the Outcome Predictable?
Traditional Evaluation Developmental Evaluation
WHY? !!!Step%1%Vision!HOW? !!Step%2%Mission!WHO? !!Step%3%Partners!
WHAT? !!Step%4%Outcomes!
Inte
ntio
nal D
esig
n
YES NO
Out
com
e &
Perf
orm
ance
M
onit
orin
g
Developmental!Evaluation!is!an!ongoing!
process,!which!supports!learning!and!
development!for!complex!and!constantly!
changing!issues.!!It!involves!continuous!
adaptation!based!on!timely!feedback.!!
The!DE!evaluator!builds!relationships,!
provides!leadership!and!strategic!
thinking.%
Traditional!approaches!to!evaluation!
have!a!“sequence!of!steps!that!are!
required!to!assess!the!situation,!
gather!and!analyze!data,!formulate!a!
solution!and!then!implement!the!
solution”![1].!It!works!well!when!the!
situation!is!simple,!clearly!defined,!
with!definite!boundaries![1].!!
Characteristics of Complexity ?[1]%[2]!!!
• High%uncertainty!–!Difficult!to!predict!outcomes!• Cause/%Effect%are%difficult%to%track!–!The!main!causes!are!not!clearly!defined!• Social%Complexity!H!Involves!collaboration!among!multiple!stakeholders!!• Context%dependent!H!Varies!from!person!to!person!and!community!to!community!• Dynamic!H!Constantly!evolving!and!rapidly!changing!• Emergent!H!No!obvious!measures!of!success!and!constantly!changing!environment!!• Non%linear%H!Small!actions!can!have!large!and!multiple!reactions!!• Innovative!H!RealHtime!learning!and!development!!!
!
Choosing the Correct Evaluation Approach for your Project
Table 1. Characteristics of Traditional Evaluation Compared to Developmental [3]
Developmental Evaluation Entry Points [4]!
For More Information:
Developmental!Evaluation!Literature!Review!!
Developmental!Evaluation!One!Pager!National!Collaborating!Centre!for!Determinants!of!Health!!
Orientation – Includes!steps!such!as:!direction,%principles,%system%features%and%%boundaries%and%strategies%and%progress%markers.!!Orientation!covers!the!same!elements!as!Intentional%Design!in!the!Outcome%Mapping!framework
Relationship Building – Role!of!the!developmental!evaluator!is!to!build!a!relationship!with!the!stakeholders!to!influence!change!and!to!form!a!strong!foundation!
for!the!work
Development of a Learning Framework – Highlight!key!challenges,!opportunities,!areas!for!learning!and!identify!feedback!mechanisms
Sense – Making – Data%is%collected,%analyzed,%synthezed%and%reported%in%a%quick%manner.%Evaluator!works!with!the!stakeholder!to!identify!patterns!in!the!data!and!facilitate!ongoing!learning!%
Traditional Evaluation Developmental Evaluation
Success!and!failure!can!be!measured!
There!is!no!success!or!failure!but!evaluation!
generates!feedback!and!learning!which!can!
support!the!direction!of!the!change!
Results!can!be!compared!to!anticipated!
outcomes!
New!monitoring!is!developed!as!goals!
change.!Outcomes!are!not!predictable.!
Evaluation!design!is!based!on!a!cause!and!
effect!model.!With!a!series!of!steps!to!
follow.!Ie!if!X!is!changed!Y!will!happen!
Design!the!evaluation!to!capture:!learning!
from!feedback!loops,!developing!
interconnections!and!relationships!
Findings!can!be!generalized!across!time!and!
applicable!to!different!areas!
Learnings!are!specific!to!the!project!and!can!
influence!ongoing!innovation!
Example:!Following!a!recipe.!Recipes!are!
tested!to!produce!the!same!results!over!
time.!Follow!a!set!of!instructions!to!get!a!
predetermined!outcome.!
Example:!Environmental!Initiatives.!
Competing!stakeholders!are!involved!with!
different!interests!and!the!stakes!are!high.!
!
References 1. Gamble,!J.!A.!A.!(2008).!A!developmental!evaluation!primer.!Montreal:!JW!McConnell!Foundation.! Retrieved!from!http://www.mcconnellfoundation.ca/assets/Media%20Library/Publications/A%20De
velopmental%20Evaluation%20Primer%20H%20EN.pdf!
!
2.!!Patton,!M.!Q.!(2011).!Developmental!Evaluation:!Applying!Complexity!Concepts!to!
Enhance!Innovation!and!Use!(1st!ed.).!The!Guilford! Press!
!
3.!!Evaluation!and!the!Effectivenss!of!Social!Innovation! –!A!call!for!the!Long!View!
(2011)!Retrieved!from!(http://theacaciagroup.ca/ideas/?p=39)!
!
4.!!Dozois,!E.,!BlanchetHCohen,!N.,!Langlois,!M.,!Foundation,!J.!M.!F.,!Rights,!U.!O.!V.!(.!I.!I.!F.!
C.,!&!Development.!(2010).!DE!201:!A!Practitioner's!Guide!to!Developmental!Evaluation.!
International!Institute!for!Child!Rights!and!Development,!University!of!Victoria!
!
!
!
!
!