monitoring and evaluation final (backup)
TRANSCRIPT
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 1/36
Dr. Ritu AgrawalMedical Consultant,NIHFW, New Delhi
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 2/36
` Regular observation (Systematic & Purposeful)
` Recording of activities on all aspects of the
programme (Data Collection)
` Measurement of progress towards programmeobjective
` Feedback to the donors, implementers and
beneficiaries
` Reporting of gathered information to be used indecision making for improving the project
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 3/36
3
PLANNING CYCLE
Assessmentof health need
Establish
goals&objectives
Assessment
of resources
Establishment
of prioritiesDesign
alternative
programme
Select the
best
alternative
Action
plan
Time
frame
Implementation
of programme
Monitoring
Evaluation GOALS&OBJECTIVES
No
Yes
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 4/36
GOALS_
` Describes the hoped for result of a programme
` Are achieved over a long period of time` Through the combined efforts of multiple programme
OBJECTIVES-
` Specific results to be achieved
`
Time bound` Details the desired results/accomplishments of the
programme
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 5/36
` S- SPECIFIC
` M-MEASURABLE
` A-ATTAINABLE
` R-RELEVANT` T-TIME
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 6/36
� Important for project planning &implementation
� Analyzing the situation in the community
� Determining whether the inputs are well utilized
� Identifying problems in the project
� Ensuring all activities are carried out properly by theright people and in time
� Using lessons from previous project
� Determining whether the way project was planned is
the most appropriate way of solving the problem athand
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 7/36
` Preparation of action plan
` The plan should specify what needs to be done, who is
going to do it, and when it is to be done
` Inadequacy in planning will result in inadequacy in
monitoring
` The plan should identify key result areas and define
how they will be measured
` The plan should specify prioritize activities, so that
they receive adequate emphasis during monitoring
` The plan should cater to local variations
7
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 8/36
` Detecting deviations from plans
` Diagnosing causes for deviations
` Taking corrective action
8
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 9/36
` INPUT-Resources going into conducting and carrying out the
project. Staff, finance , materials and time
` PROCESS-Set of Activities in which programme resources
(human and financial) are used to achieve the result (NO. of
workshops or training session )
` OUTPUTS-Immediate results obtained by the programme
through the execution of activities (no. of staff trained)
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 10/36
` Measuring how much, how many, quantity
` Tends to document number associated with programme
` Focuses on which and how often programme elements
are carried out
` Tends to involve record keeping and numerical counts
` Monitoring and its associated activities should be
integrated into the project timeline
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 11/36
` How well the programmes are carried out
` EX. Changes in people attitude towards the
programme, behaviour change , how information
permeates the at-risk society` Works also as a Feedback System
` METHODS-
` Open ended methods to investigate
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 12/36
` Provides a means to assess the quality of the
project and programme implementation
`
Compliments quantitative, input-outputprogress monitoring
` Is a tool for institute learning and taking
corrective action in innovative and adaptive
projects
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 13/36
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 14/36
� Benchmark calendar
� List of planned key activities arranged by dates
� Activity Based Budget Estimates of inputs required to
undertake benchmarked activities� Comparison chart
� Compares plans and budgets against occurrence and
spending
�
Deliverable schedule� Indicates what is due for a project to offer within a set
time
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 15/36
It is a systematic way of learning from experienceand using the lessons learnt to improve current
activities and promote better planning by carefulselection of alternatives for future action
15
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 16/36
` To review the implementation of and services provided by health programmes
so as to identify problems and recommend necessary revisions of the
programme
` To assess progress towards desired health status at national or state levels
and identify reasons for gap, if any
` To contribute towards better health planning
` To document results achieved by a project funded by donor agencies
` To know whether desired health outcomes are being achieved and identify
remedial measures
` To improve health programmes and the health infrastructure
` Allocation of resources in current and future programme
` To render health activities more relevant, more efficient and more effective
16
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 17/36
` Review of Records` Monitoring`
Case studies` Qualitative studies` Controlled experiments and intervention studies` Sample surveys
17
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 18/36
` Evaluation of structure
` Evaluation of Process
` Evaluation of Outcome
18
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 19/36
The process of evaluation consists of the followingcomponents:
1. Specify the particular subjects2. Information support
3. Verify relevance
4. Assess adequacy
5. Review progress
6. Assess efficiency
7. Assess effectiveness
8. And assess impact
19
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 20/36
` It determines Programmeefficiency
` It establishes standard of performance at the activitylevel
` It forms a basis for Programme accountability
` It alerts the managementof discrepancy
` It identifies strong &weakpoints of programmeoperations
` It determines Programme
effectiveness
` It identifies inconsistencies
between the programme
objectives and activities
` It alerts the management of
discrepancies between actual
and anticipated levels of
programme impact
` It suggests changes in
programme procedures,operation and objectives
` It identifies the possible side
effects of the programme
20
Monitoring Evaluation
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 21/36
Types of Monitoring and Evaluation:
Formative Assessments
and Research (concept and
design)
Monitoring (monitoring
inputs, processes, and
outputs;
Evaluation (assessing
outcome Impact)
Cost-Effectiveness
Analysis (including
sustainability issue
Questions Answered by the Different Types of Monitoring and Evaluation:
�Is an intervention
needed?
�Who needs theintervention?
�How should the
intervention be
carried out?
�To what extent are
planned activities
actually realized?
� How well are the
services provided?
�What outcomes are
observed?
�What do the
outcomes mean?
� Does the program
make a difference?
�Should program
priorities be
changed or
expanded?
�To what extent
should resources be
reallocated?
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 22/36
` Monitoring involves counting what we are doing.
` Monitoring involves routinely looking at the
quality of our services.
` Evaluation requires study design.` Evaluation sometimes requires a control or
comparison group.
` Evaluation involves measurements over time.
` Evaluation involves special studies.
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 23/36
23
INDICATORS
` OPERATIONAL
` RELIABLE
` VALID` SPECIFIC
` SENSITIVE
` AFFORDABLE
` FEASIBLE
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 24/36
` To describe information to be measured
` Monitoring is EXPENSIVE & TIME CONSUMNG
` For Reporting and Analysis in Simplest form
` To generate important information` For management decision making
` Words like improved ,increased , gained do not
belong to an indicator
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 25/36
� Information unit of measurement documentation of
change
� Evidence of how much has been or has not been
achieved1. Qualitative (Narrative/Observation)
2. Quantitative (Number/%)
� Anything you can think to measure
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 26/36
` To highlight problems
` Act as early warning signs
` Tells where support corrective actions required
` Evaluate effectiveness of management actions` To determine achievements
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 27/36
27
Quality Indicator in RCH Project
�% Pregnancy Registered before 12 weeks
�% ANC with 5 visits
�% ANC receiving all RCH services
�% High risk cases referred
�% High risk cases followed up
�% deliveries by ANM/TBA�%PNC with 3 PNC visits
�% PNC receiving all counseling
�% PNC complications referred
�% Eligible couple offered FP choices
�% women screened for RTI/STDs
�% Eligible couple counseled for prevention of RTI/STDs
�% ADD given ORS
�% ARI treated
�% children fully immunized
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 28/36
` Monitoring & Evaluation are necessary to
ensure efficiency and effective uses of measure` Efficiency is usually measured by the ratio of
activity to input
` Effectiveness is measured by the ratio of output
to activities
28
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 29/36
` � Show how goals/objectives are related to results
` � Describe how objectives will be achieved/measured
` � Identify data needs
` � Define how the data will be collected and analyzed
` � Describe how results will be used` � Anticipate resources needed for M&E
` � Show stakeholders how program will be accountable
` The content and organization of an M&E work plan areflexible. They should be appropriate for the
` level (e.g., country, region, district, community, or organization) and the program areas.
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 30/36
` Monitoring involves counting what we are doing.
` Monitoring involves routinely looking at the quality of our
services
` Evaluation requires study design
` Evaluation sometimes requires a control or comparison
group.
` Evaluation involves measurements over time.
` Evaluation involves special studies.
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 31/36
31
The 5 year RCH phase II is being launched inTamilNadu on 2005 with a vision to bring aboutoutcomes as envisioned in the MillenniumDevelopment Goals, the National Population Policy2000 (NPP 2000), the Tenth Plan, the National Health
Policy 2002 and Vision 2020 India, minimizing theregional variations in the areas of RCH and populationstabilization through an integrated, focused,participatory programme meeting the unmet needs of the target population, and provision of assured,equitable, responsive quality services.
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 32/36
32
IndicatorTenth Plan
Goals (2002-2007)
RCH II Goals(2005-2010)
NationalPopulation
Policy2000 (by
2010)
MillenniumDevelopmentGoals (B
y 2015)
PopulationGrowth
16.2% (2001-2011)
16.2%(2001-2011)
- -
InfantMortality Rate
45/1000 35/1000 30/1000 -
Under 5Mortality Rate - - - Reduce by2/3rds from1990 levels
MaternalMortality Ratio
200/100,000 150/100,000 100/100,000
Reduce by3/4th from1990 levels
Total FertilityRate
2.3 2.2 2.1 -
CoupleProtection Rate
65% 65% Meet100%needs
-
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 33/36
33
THE ACTION PLAN FOR CARRYING OUT R.C.H SERVICES
Goal: ³Health For All´
Objective: Population stabilization by 2045
Target : Total fertility rate to the replacement
level by 2010 and to achieve the otherindicators of health for all
Programme: Comprehensive R.C.H services
Plan : High quality, integrated, decentralized,
needs based and holistic approach
Monitoring & Evaluation: R.C.H indicators/Feedback data
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 34/36
Monitoring and evaluation are essential management
tools which help to ensure that health activities areimplemented as planned and to assess whether desiredresults are being achieved.
` Monitoring:1. To provide concurrent feedback on the progress of activities2.To identify the problems in their implementation3.To take corrective action
` Evaluation:To assess whether the desired results of a
programme have been achieved if not how it should beredesigned
34
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 35/36
` Identify all inputs to be provided
` Activities to be carried out
` Outputs desired for the programme
` Select the key inputs, activities, output variables formonitoring
` Identify the indicators for measuring the variables
` Prepare a plan for collecting and processing theinformation on the selected indicators
` Prepare a format for giving feedback on theseindicators to managers responsible forimplementation
35
8/7/2019 Monitoring and Evaluation Final (Backup)
http://slidepdf.com/reader/full/monitoring-and-evaluation-final-backup 36/36
Thank You