concept of monitoring and evaluation and its application in nepal krishna prasad dhakal program...
TRANSCRIPT
Concept of Monitoring and Evaluation and
Its Application in Nepal
Krishna Prasad DhakalProgram Director
National Planning Commission Secretariat
Public Sector Management
MANAGEMENT
What is Monitoring and Evaluation?The term “monitoring and evaluation” tends
to get run together as if it is only one thing.
In fact, these are two distinct sets of organizational activities.
M and E are related (both are ultimately about measurement) but not identical.
Divorce of M&E
Divorce between Monitoring and
Evaluation is needed to
understand and use it in
appropriate way.
What is Monitoring?
Monitoring is a continuous process of collecting and analyzing information to compare how well a project, program or policy is performing against expected results.
It is aimed at improving the efficiency and effectiveness of a project or organization.
It is based on targets set and
activities planned during the planning phases of work.
What is Monitoring?
It helps to keep the work on track, and can let management know when things are going wrong.
it is an invaluable tool for good management, and it provides a useful base for evaluation.
What is Monitoring?
It enables you to determine- whether the resources you have
available are sufficient and are being well used,
whether the capacity you have is sufficient and appropriate, and
whether you are doing what you planned to do?
What is Monitoring?
gLlt, of]hgf, sfo{qmd÷cfof]hgfdf nufgL tyf ;fwgsf] k|jfx ;d"lrt (ª\un] ePsf] %÷%}g / lqmofsnfkx?sf] sfof{Gjog sfo{tflnsf cg';f/ eO{ nlIft k|ltkmn k|fKt ePsf] %÷%}g egL ljleGg txsf] Joj:yfkg jf Joj:yfkgn] tf]s]sf] JolQm, lgsfoaf^ lg/Gt/ / cfjlws ?kdf lgu/fgL /fVg] sfo{ cg'udg xf] .
-cg'udg tyf d"NofÍg sfo{ljlw, 2069 sf] d:of}baf^_
s] x]%{ cg'udgn]
-s_ cfof]hgfsf] ;|f]t, ;fwgx?sf] k|flKt / k|of]u :jLs[t ah]^ / ;dotflnsfcg';f/ ePsf] 5, 5}g <
-v_ cfof]hgfsf ck]lIft k|ltkmnx? ;dod} / nfut k|efjsf/L ?kdf xfl;n ePsf] 5, 5}g <
-u_ cfof]hgfsf] sfof{Gjog Ifdtf s], s:tf] 5< -cg'udg tyf d"NofÍg sfo{ljlw, 2069 sf] d:of}baf^_
cg' + udg of] sfo{s|d cjlwe/ lg/Gt/ ul/g] k|ls|of xf] .
o;nfO{ cfof]hgfsf] Pp6f cfGtl/s sfo{sf] ¿kdf klg lnO{G5 .
cg'udg ;fdfGotof sfof{Gjogsf] cj:yfdf b]lvPsf sdL, sdhf]/Lx¿nfO{ ;'wf/ ug]{ ;+:yfut k|ls|of xf] .
cg'udg sfo{ cfof]hgfsf] k|ls|of, nufgL / k|ltkmn;Fu k|ToIf ¿kdf ;DalGwt x'G5 .
cg'udg Joj:yfkgsf] k|0ffnLsf] Pp6f c+u xf] .
glthfd"ns cg'udgsf ljlwx¿
! nIo / k|ultsf] t'ngf ljlw nIocg';f/ sfo{ eP gePsf] tyf sfo{qmdsf] ;du| l:ylt -ef}lts k|ult, ljQLo k|ult / JotLt ;do_ ljj/0f sfo{qmd,cfof]hgfaf6 x/]s rf}dfl;s cjlwdf ul/g] k|ltj]bgaf6 ul/g] cg'udg .;"rs nIo k|
ultnIo k|
ult ljrsf] cGt/
sf/0f
;d:of ;dfwfgsf k|of;x?
nIo / k|ultsf] t'ngf
glthfd"ns cg'udgsf ljlwx¿
@= :ynut cg'udg ljlw sfo{qmd, cfof]hgfdf ePsf ljleGg lqmofsnfkx? cfof]hgf:ynd} uP/ cjnf]sg u/L ul/g] cg'udg . o;df ;DalGwt sfo{qmd,cfof]hgfsf] lgDg b:tfj]h ;d]t k|of]u ug{' kb{5 .
!= nlhsn k|m]djs{@= aflif{s ljsf; sfo{qmd#= rf}dfl;s k|ult k|ltj]bg$= ;"rsx¿%= jflif{s ljsf; sfo{qmd -efu !_ ^= lhNnf:t/Lo jflif{s ljsf; sfo{qmd -efu @_
#= t];|f] kIf cg'udg ljlw s'g} vf; bIftf tyf sfo{s'zntfsf] dfWodaf6 cg'udg u/fpg k/]df :jtGq lgsfo tyf JolQmx?af6 u/fOg] ljlw .
What is Evaluation?
Evaluation is an assessment, based on detailed data collection and careful analysis, of the results of a policy or program.
Evaluation is research, but not just any research.
It is the comparison of actual project impacts against the agreed strategic plans.
It looks at what you set out to do, at what you have accomplished, and how you accomplished it.
What is Evaluation?
It can be formative (taking place
during the life of a project or
organization, with the intention
of improving the strategy or
way of functioning of the project
or organization).
It can also be summative (drawing learning from a completed project or an organization that is no longer functioning).
Someone once described this as the difference between a check-up and an postmortem.
Process evaluation A study of the implementation of a program or policy focusing on inputs, activities, and outputs and often used to assess the performance of implementers.
Program evaluation A study, using research methods to collect and analyze data, of the outcomes of a program—that is, whether and how well a program is working and why.
What is Evaluation?
sfof{Gjog ul/Psf gLlt, sfo{qmd÷cfof]hgf xfnsf] ;dodf s]slt ;fGble{s, nfebfoL / k|efjsf/L /x]sf 5g\ tyf s]s:tf pknlJw Pjd\ k|efjx? xfl;n ePsf 5g\ eGg] s'/fsf] cfGtl/s / afXo d"NofÍgstf{af6 p2]Zok"0f{ / Jojl:yt tl/sfn] n]vfhf]vf ug]{ sfo{ d"NofÍg xf]
-cg'udg tyf d"NofÍg sfo{ljlw, 2069 sf] d:of}baf^_
lrq != sfof{Gjog ;dofjlwdf cg'udg tyf d"NofÍg
kmfObfx?sf] k|j fx k"j {
d"NofÍg
cfwf/ ; j ]{If0f
dWofj lw d"NofÍg
clGtd d"NofÍg
k|efj d"NofÍg
lg/Gt/ cg'udg
lgdf{0f r /0f
lbuf]kgfsf] cg'udg
; ~r fng r /0f 5gf}6 r /0f
lg/Gt/ k[i7kf]if0f
-;fef/– >L tLy{/fh 9sfn, ;x;lrj, /fof]cf;_
cg'udg tyf d"NofÍgsf k|
sf/
p2]Zo
lg/Gt/ cg'udg
sfo{qmd |cfof]hgf lgdf{0f r/0fdf nufgL, lqmofsnfk, k|lqmof / k|ltkmn ;"rsx?sf] cfwf/df sfo{;Dkfbg eP gePsf] lgwf{/0f ug{ .
lbuf]kgf cg'udg
sfo{qmd, cfof]hgfsf] lgdf{0f r/0f ;DkGg kZrft pQm sfo{qmd, cfof]hgfsf] lgwf{l/t cfo";Dd lg/Gt/ ;~rfngsf] nflu cfjZos kg]{ ;|f]t;fwg tyf dd{t;Def/ lglZrt ug{ .
sfo{qmd÷cfof]hgfdf ul/g] cg'udg tyf d"NofÍgsf p@]Zo
k"j{ d"NofÍg (Ex-ante)
sfo{qmd, cfof]hgfsf] cfjZostf tyf ;'lglZrttf lgwf{/0f ug{
sfo{qmd, cfof]hgfsf] k"0f{ ljj/0f :ki6 ug{ / ;"rsx? lgwf{/0f ug{
rfn" d"NofÍg (Ongoing)
sfo{qmd, cfof]hgfsf] k|ult cfFsng ug{ k"j{ lgwf{l/t sfo{of]hgfdf kl/dfh{g
ug{ jf ;~rfng 9fFrfdf cfjZos kl/jt{g ug{
clGtd d"NofÍg (Terminal)
sfo{qmd, cfof]hgfsf] sfo{Ifdtf, k|efjsfl/tf / bLuf]kgfnfO{ Wofgdf /fv]/ ;dLIff ug{
sfo{qmd, cfof]hgf ;DkGg ePkl5 yk sfo{ (follow-up) cfjZos /x]sf] jf g/x]sf] lgSof}{n ug{
k|efj d"NofÍg (Ex-post)
sfo{qmd, cfof]hgfsf] k|efj / bLuf]kgfnfO{ Wofgdf /fv]/ ;dLIff ug{
eljiodf sfo{qmd, cfof]hgfsf] th"{df / sfof{Gjog ubf{ ;'wf/ ug{sf nflu l;sfO / ;'emfjx? k|fKt ug{
-cg'udg tyf d"NofÍg sfo{ljlw, 2069 sf] d:of}baf^_
d"NofÍgsf kfFr cfwf/x¿d"NofÍgsf cfwf/x?
kl/efiff
;fGble{stf (Relevance)
nlIft ju{sf cfjZostf / k|fyldstf tyf /fli6«o, If]qut ljsf; nIox? jf gLltx? ;fy} bft[ lgsfosf ;xfotf gLlt;Fusf] ;fGble{stf .
k|efjsfl/tf (Effectiveness)
nIox? s'g, s], slt k|fKt eP jf k|fKt x'g] ;Defjgfsf 5g\ eGg] klxrfg ug]{
sfo{bIftf (Efficiency)
nufgLsf] cg'kftdf k|ltkmn k|fKt eP jf gePsf] dfkg ub{5 .
k|efj,c;/ (Impact) k|ToIf jf ck|ToIf, lgwf{l/t jf clgWff{l/t, ;sf/fTds jf gsf/fTds kl/jt{gnfO{ dfkg ug]{
bLuf]kgf (Sustainability)
;DkGg ePkZrft k|fKt kmfObf / k|ltkmnx?n] lg/Gt/tf kfpF5g\ jf kfpFb}gg\ .
d"NofÍg ljlwx¿
!= kl/df0ffTds ljlw (Quantitative Method)
nfO{sfo{qmd, cfof]hgfn] kf/]sf] jf kfg]{ k|efj jf c;/nfO{ ;+Vof jf k|ltztdf k|:t't u/L ck]lIft glthf;Fu t'ngf u/L d"NofÍg ug]{ ljlw kl/df0fTds ljlw xf] .
kl/df0ffTds tYofÍ k|fKt ug]{ tl/sfx¿
k|ZgfjnL / ;j]{If0f ljlw ljBdfg 8f6fa];x?— EMIS, HMIS, FMIS etc
d"NofÍg ljlwx¿
tYofÍ ljZn]if0f nfut–nfe tyf nfut–sfo{bIftf
sfo{qmd, cfof]hgf ;~rfng x'g'cl3 / ;~rfng eO;s]kl5sf] cj:yf t'ngf (Pre/Post Test)
sfo{qmd, cfof]hgf …;~rfng ePsf] If]qÚ (with) / …;~rfng gePsf]Ú (without) p:t} k|s[ltsf If]qaLrsf]
t'ngfTds ljZn]if0f
d"NofÍg ljlw@= u'0ffTds ljlw (Qualitative Method)
kl/df0fTds ?kdf dfkg ug{ g;lsg] ;]jfu|fxLx?sf] afgLJojxf/, wf/0ff, ;fj{hlgs ;]jfk|
ltsf] ;Gt'li6h:tf ljljw kIfx?nfO{ dfkg ug{ o;sf] k|of]u ul/G5 .
Uf'0ffTds tYofÍ k|fKt ug]{ tl/sfx? k|ToIf cjnf]sg ljlw nlIft ;d"x ljlw cGtjf{tf{ ljlw gd"gf ljlw SWOT Analysis ljlw b:tfj]h cWoog
d"NofÍg ljlw
#= ldl>t ljlw (Mixed Method) -kl/df0ffTds / u'0ffTds ljlwsf] ld>0f_
kl/df0ffTds ljlw / u'0ffTds ljlwsf cf}hf/ (tools) / lgrf]8 (fact findings) nfO{ ;Tofkg (triangulate) ug]{ p2]Zon] ldl>t ljlw (Mixed
method) ckgfOG5 .
o; ljlwn] kl/df0ffTds ljlw / u'0ffTds ljlwx?sf] ;sf/fTds kIf / ;Ldf (Limitations) nfO{ Wofg lbO{ k|fKt lgrf]8x?sf] j}wtf / ljZj;gLotf (Validity and Reliability) kl/If0f u/L lg0f{o ug{ ;xof]u u5{ .
Facilitating Vs Conducting Evaluation
Facilitating Selection of policy, programs projects for
evaluation Preparing TOR Bidding Process Getting reports in various stages such as inception report, field report, draft report and final report.
Providing feedback and suggestions Implementing and Using Evaluation
report for establishing accountability and lesson learning.
Conducting
Ways of Evaluation?
Self-evaluation
It is a way of self-reflective, learning and improving practice.
Participatory evaluationThis is an internal evaluation involving
stakeholders such as project staff and beneficiaries
Interactive evaluationThis involves a very active interaction
between an outside evaluator or evaluation team and the organization or project being evaluated.
What is Evaluation?
Rapid Participatory AppraisalThis is a qualitative way of doing
evaluations by an interdisciplinary team over a short time especially applied in rural areas. It involves the use of secondary data review, direct observation, semi-structured interviews, key informants, group interviews,
games, diagrams, maps and calendars.
External evaluation This is an evaluation done by a carefully chosen
outsider or outsider team.
cg'udg d"NofÍgsfo{qmd cjlwe/ lg/Gt/ ul/g] k|lqmof xf],h;nfO cfof]hgfsf] Pp^f cfGtl/s sfo{sf] ?kdf klg lnO{G% .
sfo{qmdsf] ;'¿df k"j{ d"NofÍg -Ex-ante_, dWofjlws (Mid-term), clGtd jf ;DkGg d"NofÍg -Terminal_ / sfo{qmd kl%sf] d"NofÍg (Ex-post) ul/G%.
cg'udg sfo{ cfof]hgf sfof{Gjog / ;~rfngsf] cj:yfdf dfq ul/G% .
d"NofÍg sfo{ cfof]hgfsf] sfof{Gjogsf]cj:yfdf / cfof]hgf sfof{Gjogsf] ;dflKt kl%sf cj:yfx¿df klg ul/G% .
sfof{Gjogsf] cj:yfdf b]lvPsf sdL,sdhf]/Lx¿nfO{ ;'wf/ ug]{ ;+:yfut k|lqmof xf] .
sfof{Gjogsf] r/)fdf cfjZos ;'wf/ ug]{ tyf sfof{Gjogsf qmddf ePsf sdL, sdhf]/Laf^ kf& l;sL eljZosf To:t} of]hgf, sfo{qmd / lg)f{ox¿df Joj:yfkgn] ;'wf/ ug]{ ;fwg xf] .
cg'udg d"NofÍg
cg'udg sfo{ cfof]hgfsf] k|lqmof, nufgL / k|ltkmn;
+u k|ToIf ¿kdf ;DalGwt
x'G% .
d"NofÍg sfo{ cfof]hgfsf] k"j{ lgwf{/t nIo / pknlAwsf] l:ylt tyf o;n] ;/f]sf/jfnfnfO{ kf/]sf] c;/ /
k|efjsf] cWoog;F+u ;DalGwt % .
cg'udg Joj:yfkg
k|)ffnLsf] Pp^f cª\u xf] .d"NofÍg sfof{Gjog ul/Psf sfo{af^ kf& l;Sg] sfo{d"vL Joj:yfksLo cf}hf/ xf] .
;fwf/)ftof, cg'udg sfo{ sfof{Gjog ug]
{ lgsfox¿af^ g} ul/G% .
;fwf/)ftof, d"NofÍg sfo{ sfof{Gjog ug]{ lgsfoeGbf aflx/sf / :jtGq ;+:yfx¿af^ u/fOG% .
Uses and Importance of M&E
Evaluate/
learn/ decide
Plan
Implement
Reflect/learn/
decide/adjust
Monitor
Implement
Uses and Importance of M&E
Help you identify problems and their causes;
Suggest possible solutions to problems;
Raise questions about assumptions and strategy;
Push you to reflect on where you are going and how you are getting there;
Uses and Importance of M&E
Provide you with information and insight;
Encourage you to act on the information and insight;
Increase the likelihood that you will make a positive development difference.
But It is important to recognize that monitoring
and evaluation are not magic wands that can be waved to make problems disappear, or to cure them, or to miraculously make changes without a lot of hard work being put in by the project or organization.
cg'udgsf] dxTjljsf; sfo{qmd÷cfof]hgfx?df nufgL
ul/Psf] ;|f]t;fwgsf] kf/bzL{, lhDd]jf/Lk"0f{ / k|efjsf/L k|of]u ;'lglZrt ug{,
lqmofsnfkx¿nfO{ lgwf{l/t nIok|flKttkm{{ lgb]{lzt ug{, /
sfof{Gjogdf s'g} ;d:of / afwfJojwfgx¿ b]lvPdf tTsfn ;dfwfg ug{ .
d"NofÍgsf] dxTj
cfof]hgfsf] p2]]Zo tyf nIo xfl;n ug{ k"j{lgwf{l/t lqmofsnfk, ;|f]t ;fwg / If]q (scope) df kl/jt{g cfjZos 5, 5}g eGg] hfgsf/Lsf pknAw u/fpF5 .
;DkGg cfof]hgfsf] ;fGble{stf, bIftf, k|efjsfl/tf, k|efj / lbuf]kgfsf af/]df oyfy{ hfgsf/L pknAw u/fO{ rfn" cj:yfdf cfjZos ;'wf/ ug{ / eljiodf gLlt, of]hgf sfo{qmd÷cfof]hgfx¿sf] th"{dfdf ljutsf cg'ejaf6 kf7 l;sL uNtLx¿ bf]xl/g glbg ;xof]u k'¥ofpF5 .
glthfd"ns cg'udg k|ltj]bg tyf glthfsf] k|of]u
-;fef/– >L tLy{/fh 9sfn, ;x;lrj, /fof]cf;_
M&E institutionalization effortsPlan Focus of M&E
First to Fourth
Practices of progress review in NDC, NPC esp. input and processesNo systematic M&E system and processes
Fifth Weightage system (Physical progress tied up with actual performance than budget spent)
Eighth New M&E System (NDAC, MDAC, M&E units, Formats, indicators)
Since Tenth Plan
Towards Results based M&E (MfDR)- (PMAS, DPMAS, Streamlined Hh surveys); RBME: indicator-based monitoring
Monitoring responsibility Agency Responsible
NPCS, M&E Division Monitoring of monitoringDesigning guidelines, formatsMonitoring outcomes; sustainability monitoringEvaluationSecretariat services to NDACFacilitate build M&E capacities
NPCS, Sectoral Divisions
Prog./Project monitoring and progress updates
OPMCM. M&E section
Monitoring services deliveryMonitoring projects of national pride
MOF, M&E Division Monitoring projects’ key milestones and disbursement status
Line ministries Implementation monitoring, completion evalu....
-;fef/– >L tLy{/fh 9sfn, ;x;lrj, /fof]cf;_
cg'udg tyf d"NofÍgsf tx tyf ;+:yfut ;+/rgf
tx s] sf] s;n] < slxn] <
s;/L <
/fli6«o
gLlt k|wfgdGqL tyf dlGqkl/ifbsf] sfof{no, /fli6«o of]hgf cfof]u,;DjlGwt dGqfno
gLlt sfof{Gjog r/0f
:jtGq lgsfoaf6 d"NofÍg
cfjlws of]hgf
/fli6«o of]hgf cfof]u
of]hgf cjlwe/
lg/Gt/ cg'udg,:jtGq lgsfoaf6 d"NofÍg
klxnf] k|fyldstf k|fKt cfof]hgf
k|wfgdGqL tyf dlGqkl/ifbsf] sfof{no, /fli6«o of]hgf cfof]u,dGqfno
cfjZostf cg';f/
;+o'Qm cg'udg
If]qLo
sfo{qmd, cfof]hgf
ljefu, If]qLo sfof{no
cfjZostfcg';f/
lg/Gt/ cg'udg, t];|f] kIf cg'udg,
sfo{qmd, cfof]hgf
sfo{qmd,cfof]hgf
lhNnf ljsf; ;ldlt,;Da4 lhNnftxsf lgsfox?
cfjZostfcg';f/
lg/Gt/ cg'udg, t];|f] kIf cg'udg,
ljleGg txdf ug'{kg]{ cg'udg tyf d"NofÍg
-;fef/– >L tLy{/fh 9sfn, ;x;lrj, /fof]cf;_
ljleGg txdf cg'udg tyf d"NofÍg Aoj:yfM
/fli6«o tx◦dxfn]vf k/LIfssf] sfof{no ◦k|wfgdGqL tyf dlGqkl/ifb\sf] sfof{no
◦/fli6«o of]hgf cfof]u◦cy{ dGqfno ◦/fli6«o ;ts{tf s]Gb| ◦dxfn]vf lgoGqssf] sfof{no
;+:yfut Joj:yf /fli6«o ljsf; ;d:of ;dfwfg ;ldltdGqfno:t/Lo ljsf; ;d:of ;dfwfg ;ldltcg'udg tyf d"NofÍg dxfzfvf÷zfvf
lhNnf:t/Lo ljsf; sfo{qmd÷cfof]hgfx?sf] cg'udg tyf d"NofÍg Joj:yf
;'kl/j]If0f tyf cg'udg ;ldlt :yfgLo :jfoQ zf;g P]g, @)%% tyf :yfgLo :jfoQ zf;g lgodfjnL, @)%^
adf]lhdsf] Joj:yf .