m&e of policy influence some guidance thoughts…. elements of a monitoring frame.. policy...
TRANSCRIPT
![Page 1: M&E of policy influence some guidance thoughts…. Elements of a monitoring frame.. Policy objective and theory of change Indicators Data collection tools](https://reader036.vdocument.in/reader036/viewer/2022083005/56649f135503460f94c26b56/html5/thumbnails/1.jpg)
M&E of policy influencesome guidance thoughts…
![Page 2: M&E of policy influence some guidance thoughts…. Elements of a monitoring frame.. Policy objective and theory of change Indicators Data collection tools](https://reader036.vdocument.in/reader036/viewer/2022083005/56649f135503460f94c26b56/html5/thumbnails/2.jpg)
Elements of a monitoring frame..
Policy objective and theory of change Indicators Data collection tools
![Page 3: M&E of policy influence some guidance thoughts…. Elements of a monitoring frame.. Policy objective and theory of change Indicators Data collection tools](https://reader036.vdocument.in/reader036/viewer/2022083005/56649f135503460f94c26b56/html5/thumbnails/3.jpg)
Starting with policy objective and TOC..To identify key moments
Change in resettlement practices
Access to Secretary, Ministry of Highways
Public pressure to change
Workshops with RDA officers
Media dissemination
Workshops with ADB, JICA ?
?
![Page 4: M&E of policy influence some guidance thoughts…. Elements of a monitoring frame.. Policy objective and theory of change Indicators Data collection tools](https://reader036.vdocument.in/reader036/viewer/2022083005/56649f135503460f94c26b56/html5/thumbnails/4.jpg)
Thinking about indicators…
Output levelMeetings, presentations….
Outcome levelUptake: citations, media clippings….Changes in Knowledge, Attitudes, Behaviors:
changes in interest, participation in events…Policy Impact level
Changes in policy / practice: changes in policy documents, legislation, replication….
![Page 5: M&E of policy influence some guidance thoughts…. Elements of a monitoring frame.. Policy objective and theory of change Indicators Data collection tools](https://reader036.vdocument.in/reader036/viewer/2022083005/56649f135503460f94c26b56/html5/thumbnails/5.jpg)
Choosing data collection tools..
Sources of dataThe IE teamThe users - policy
makers / practitioners
Academics, other researchers
Media…..
Possible toolso AIIMo After Action Reviewso User Surveyso Bellwether Methodo Outcome Mappingo Most significant
changeo ……
![Page 6: M&E of policy influence some guidance thoughts…. Elements of a monitoring frame.. Policy objective and theory of change Indicators Data collection tools](https://reader036.vdocument.in/reader036/viewer/2022083005/56649f135503460f94c26b56/html5/thumbnails/6.jpg)
After action reviewsUseful for evaluating quality of outputs
Guiding QuestionsWhat was supposed to happen?What actually happened?Why were there differences?What worked? What didn’t? Why?What would you do differently next
time?
Turn conscious learning into tacit knowledge..
![Page 7: M&E of policy influence some guidance thoughts…. Elements of a monitoring frame.. Policy objective and theory of change Indicators Data collection tools](https://reader036.vdocument.in/reader036/viewer/2022083005/56649f135503460f94c26b56/html5/thumbnails/7.jpg)
User surveys
Useful for monitoring uptake - to get perceptions and reactions of a range of users
Can be in the form of Large scale questionnairesSmall focus group discussions
Useful for monitoring uptake of websites, policy briefs
![Page 8: M&E of policy influence some guidance thoughts…. Elements of a monitoring frame.. Policy objective and theory of change Indicators Data collection tools](https://reader036.vdocument.in/reader036/viewer/2022083005/56649f135503460f94c26b56/html5/thumbnails/8.jpg)
Bellwether MethodBellwethers Defined
‘Influentials’ in the public and private sectors whose positions require that they are politically informed and that they track a broad range of policy issues
► Policymakers► Administrators► Media► Advocates► Funders► Business► Associations
Useful for monitoring if policy messages have ‘broken through’
![Page 9: M&E of policy influence some guidance thoughts…. Elements of a monitoring frame.. Policy objective and theory of change Indicators Data collection tools](https://reader036.vdocument.in/reader036/viewer/2022083005/56649f135503460f94c26b56/html5/thumbnails/9.jpg)
Group Exercise
Question: What indicators can you suggest to monitor whether the IE’s policy objective(s) are being met?
To the plenary, please present the followingProposed indicators together with rationale,
for the selected project any “lessons” from the exercise that the other
projects in the group can take forward into their own projects
![Page 10: M&E of policy influence some guidance thoughts…. Elements of a monitoring frame.. Policy objective and theory of change Indicators Data collection tools](https://reader036.vdocument.in/reader036/viewer/2022083005/56649f135503460f94c26b56/html5/thumbnails/10.jpg)
How to monitor policy influence: in summary
Many activities, many contexts, much still to be learnt on how to monitor
But some lessons are available:Select few key IndicatorsUse fit-for-purpose, easy to use data collection
toolsWhere to begin? Policy Objective and Theory of
Change
If you want to read more… A guide to monitoring and evaluating policy influence by Harry JonesMaking a difference: M&E of policy research by Ingie Hovland