by apollos b. goyol, phd american university of nigeria yola, adamawa state nigeria
DESCRIPTION
THE IMPACT AND PRACTICAL UNTILITY OF EVALUATION OUTCOME MEASUREMENT AS A FEED-BACK MECHANISM FOR SUSTAINABLE DEVELOPMENT. BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria Email:[email protected] AT International Conference of - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/1.jpg)
THE IMPACT AND PRACTICAL UNTILITY OF EVALUATION OUTCOME MEASUREMENT AS A FEED-BACK MECHANISM FOR SUSTAINABLE
DEVELOPMENT
BY APOLLOS B. GOYOL, PhD
American University of NigeriaYola, Adamawa State
NigeriaEmail:[email protected]
AT
International Conference of African Evaluation Association
L’Association Africaine d’Evaluation
PERSPECTIVES ON IMPACT EVALUATION: Approaches to Assessing Development EffectivenessAn International Conference in Africa for policy-makers, program managers, evaluators, sponsors and other stakeholders in evaluation and
developmentSunday 29 March – Thursday 2 April 2009, CAIRO, EGYPT
![Page 2: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/2.jpg)
What is Outcome measurement evaluation?
Is a continual and systematic process of assessing the value or potential value of programs to guide decision-making for the program’s/projects future and sustainability
Is an essential indicator of how programs and projects should be sustained.
![Page 3: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/3.jpg)
Process vs. Outcome Evaluation
Process Evaluation Resources Activities Units produced Did they do what
they said they would do?
Outcome Evaluation Measures of change in
Individuals Institutions Communities
Did they change what they said they would change?
![Page 4: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/4.jpg)
Realities of Today in Nigeria
More Money (billions of Naira) Increased competition Greater expectations for effectiveness Increasing scrutiny Increasing political awareness Greater need for team/collaboration
![Page 5: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/5.jpg)
Critical Accountability Questions:
You received billions of naira last year---what did your government and agency do with them?
We have supported your party for years, why should we continue this support?
What are you doing to improve or terminate ineffective programs and curtail wastage?
![Page 6: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/6.jpg)
Why evaluate?
Planning purposes Analysis of program effectiveness or
quality Direct decision-making Maintain accountability Project impact assessment Project impact and sustenance
![Page 7: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/7.jpg)
When to evaluate?
The timing of program/project evaluation: Project/program design stage Project start-up stage In-progress of formative evaluation Program wrap-up or summative evaluation Follow –up studies and feed –back Continues sustenance
![Page 8: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/8.jpg)
When we evaluate a project/program We examine the context of the project\
program Study its goals and objectives Collect information about a project’s
/program’s input, outcome and impact Compare findings to some pre-set
standards or mandates Make a value judgment about the project Report findings to stakeholders
![Page 9: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/9.jpg)
Types of outcome evaluation
Formative or process evaluation: Focus on information for program/project
improvement, modification, management and sustenance
Summative or impact evaluation Focus on determining program/project results and
effectiveness (merit and worth) Serves the purpose of making major decisions
about program – continuation, expansion, reduction, and funding.
Using the Logic model as road map
![Page 10: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/10.jpg)
Evaluators Credibility
Competence: Knowledge of the program/project Evaluation expertise Data analysis and interpretation skills Report writing and presentation skills
Personal Style: Communication skills Strong interpersonal skills Ability to nurture trust and rapport Sensitivity in reporting
![Page 11: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/11.jpg)
Logic Model
Identifies both process and outcome portions of your program
Shows relationship of your program inputs to the expected results or outcomes
Helps you identify the major questions you want the evaluation to answer
![Page 12: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/12.jpg)
Logic Model
Provides a graphic summary of how program parts relate to the whole
Makes explicit the underlying theory of a program
Identifies categories to measure in the program evaluation
Sets timelines and benchmarks
![Page 13: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/13.jpg)
Developing a Program Evaluation Logic Model
Sample
OutcomeProcess
Resources Activities Outputs Outcomes Goals
![Page 14: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/14.jpg)
Resources
Program ingredients Funds Staff Community support Participants
Back
![Page 15: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/15.jpg)
Activities
Method used to accomplish program goals Classes Counseling Training
Back
![Page 16: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/16.jpg)
Outputs
Units produced by a program Number and type of clients served Number of policies developed Number of events planned
Back
![Page 17: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/17.jpg)
Outcomes
Short term and immediate indicators of progress towards a goal Collaborative partnerships Improved family functioning Improved school performance
Back
![Page 18: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/18.jpg)
Goals
Long term desired program effects Resilient community Economic self-sufficiency Violence prevention
Back
![Page 19: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/19.jpg)
Sample Program Evaluation Logic Model
Program Name: School and Community Violence Prevention Project
Continue
OutcomeProcess
Resources Activities Outputs Outcomes Goals
![Page 20: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/20.jpg)
Sample Resources Staff Violence prevention curriculum Case management services Partnerships
University Counseling centers Sheriff’s department School district
ParticipantsBack
![Page 21: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/21.jpg)
Sample Activities
Commission Funded Delivery of violence prevention
curriculum in the schools Intensive violence prevention
groups to high-risk youth Intensive outreach services to
families with high-risk youth
![Page 22: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/22.jpg)
Sample Activities
Concurrent Activities DARE (Drug Abuse Resistance
Education) Family Empowerment Project
services to families
Back
![Page 23: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/23.jpg)
Sample Outputs
4-6 hours of violence prevention education for 1,890 students
480 students receive intensive prevention training in 10-week groups of 6-10 students each
185 at risk families receive intensive outreach services
60 at risk families receive Family Empowerment Project services
Back
![Page 24: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/24.jpg)
Sample Outcomes
Improvement in healthy peer social communication
Reduction of violent behaviors in school climate
Increase in healthy behavior patterns in handling stress
Improved school-related behaviors Increase in family support Consumer satisfaction
Back
![Page 25: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/25.jpg)
Sample Goals
Violence prevention
Back
![Page 26: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/26.jpg)
Outcomes You Can Measure
Example: Desired outcome is improvement in parenting skills.
![Page 27: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/27.jpg)
Indicators
Clear parental expectations for child behavior
Use of problem-solving and communication skills
Increased positive parent-teacher interaction
Increased positive family activities
![Page 28: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/28.jpg)
Indicators
Use of behavior reinforcement mechanisms
Home learning environment supportive of school work
Use of family interaction skills Reduction of conflict
![Page 29: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/29.jpg)
Documenting Impact of outcome evaluation Impact is a clear description of value of a program/project
to people and society. Generally, these are the longer-term sustainable benefits and impact to clients or society. It could be: Increased knowledge Improved attitudes Financial gain Production efficiencies Preservation and environmental resources Improved condition of health care Improved condition of roads Improved condition of education Improved condition of water supply, etc
![Page 30: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/30.jpg)
Outcome evaluation checklist for government, organizations, agencies, etc Present a clear concise plan for evaluation
achievement of outcome objectives State what (outcomes and impacts) will be
measured with benchmarks State what methods will be use for collecting
data Describe any testing instruments to be used State who will do the evaluation Show how outcome evaluation will be used for
program evaluation and sustenance.
![Page 31: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/31.jpg)
Summary/Conclusion
Outcome elevation is a tool to assist, plan, implement, monitor, evaluate, account and sustain programs/projects: By having a road map that will assist in
implementation and sustaining projects/programs To assist government ministries, departments and
agencies (MDAs) to be accountable and effective To enable government measure the impact and
benefit of its projects/programs in consonance with their agendas which are sustainable
![Page 32: BY APOLLOS B. GOYOL, PhD American University of Nigeria Yola, Adamawa State Nigeria](https://reader035.vdocument.in/reader035/viewer/2022081513/5681339b550346895d9aaa8f/html5/thumbnails/32.jpg)
The End
Thank you and questions