learning by doing
TRANSCRIPT
Non-linear learning for projects
Originally presented in workshop on evaluation capacity building with Education Innovation For India by Clare Strawn, PhD and Stéphan Vincent-Lacrin, PhD of OECD
July 26-28, 2013Hosted by Sri Aurobindo SocietyPondicherry, India
“We don’t really like the word ‘evaluation’ rather we are more interested in creating dynamic feedback mechanisms”
- EIFI grantee
What is evaluative capacity?Evaluation capacity building involves the activities and processes that help create, strengthen, and sustain the learning of individuals and communities. It is a foundation of sustainable communities.• Increases capacity to monitor and adapt to
changing environment• Creates shared knowledge to guide decision
making and planning• Develops participation of staff, clients, and other
stakeholders in success of your endeavors
If the staff feels disconnected, they don’t see the whole picture. They don’t know where the program is going. Once they buy into it they say, ‘‘I will take leadership of this piece.’’
Organizations may partake in evaluation to reduce uncertainty and secure resources, including financial and political resources.
Evaluation capacity can also meet an internal demand to achieve community goals.
Cultivating – doing the work of the program
Harvesting the produce - data
Slicing and Dicing to make it useful
Cooking – interpreting to make meaning
Not the same as “cooking the books”
Presentations to different stakeholders
ImplementingCommunity of practice
Continuous learning process
• Leadership vision and commitment • Stakeholders – who should be at the table?• Focus – define questions, priorities, uses. What is
your theory of change? • Map activities and data flow. How will you know if
things are working and adapting?• Plan data collection and management integrated
into activities• Interpret findings collaboratively• Implement recommendations
“The commitment of organizational leadership was critical in transforming the role of evaluation from one of basic reporting and accountability to a true process of continuous learning”http://contentlibrary.theglobalfund.org/eLearning/me/01en/Index1.html
Leaders must “share responsibilities and find ways to integrate evaluation into organizational life”
Non-linear program models
Its only new because it has been missing for so long: Indigenous Evaluation Capacity Building. Anderson, Chase, Johnson III, Mekiana, McIntyre, Ruerup Kerr.American Journal of Evaluation 2012 33: 566
ExampleLogic model for workshop
Needs Activities Outputs Outcomes
• Reliable reporting on project impact
• Stories• Baseline
assessment• Report on state of
eval capacity• Experience
evaluating global projects
• Collectively defined needs
• Asset mapping• Critical thinking• Skill development& sharing• Collaboration• Project analysis• Tools
• Review and revision of program data and information plans.
• Adaptation of tools and skills for specific program needs.
• Leadership and confidence
• Transfer to project staff
• Accurate data reports
• Useful stories• Sustainable
systems and program infrastructure
• Network of peer to peer collaboration for program improvement
Sample logic model template
Thinking about Data• Data burden on participants• How will it be used informs what you
collect.• What “Unit of analysis” is needed to
answer your question?• Check for consistent comparisons• Cultural validity and construct validity• Unintended consequence
From The Community Tool Box http://ctb.ku.edu/en/tablecontents/sub_section_tools_1338.aspx