use of monitoring data for evidence-based decision a ... · evidence-based decision making. there...
TRANSCRIPT
![Page 1: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including](https://reader034.vdocument.in/reader034/viewer/2022042417/5f333094091ba21ebe5d22ab/html5/thumbnails/1.jpg)
Supporting water sanitation
and hygiene services for life
31 October 2018
Use of monitoring data for
evidence-based decision
making:
A factor analysis
Marieke Adank
UNC Water and Health Conference
![Page 2: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including](https://reader034.vdocument.in/reader034/viewer/2022042417/5f333094091ba21ebe5d22ab/html5/thumbnails/2.jpg)
Source: mowie.gov.et
Setting the scene
![Page 3: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including](https://reader034.vdocument.in/reader034/viewer/2022042417/5f333094091ba21ebe5d22ab/html5/thumbnails/3.jpg)
Setting the scene
However, is this data used for informing decision-making processes?
How can this be improved?
What are the factors than enable or hamper use of
monitoring data in evidence-based decision making?
![Page 4: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including](https://reader034.vdocument.in/reader034/viewer/2022042417/5f333094091ba21ebe5d22ab/html5/thumbnails/4.jpg)
Use of monitoring data for decision making
• For improvement
• For accountability
• Data, information and
knowledge
• Continuous collection
and analysis -> trends
• Instrumental
• Conceptual
• Symbolic
• Operations and
corrective actions
• Planning
• Resource allocation
• Regulation
• Policy making
![Page 5: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including](https://reader034.vdocument.in/reader034/viewer/2022042417/5f333094091ba21ebe5d22ab/html5/thumbnails/5.jpg)
3 Models
Linear model
• Influence and dependencies
(MICMAC)
• Centrality
• Causal loops
Data useWell-packaged
information
Data use
Data producer
Data user
Relationship model
Systems model
Data
useActors and factors
![Page 6: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including](https://reader034.vdocument.in/reader034/viewer/2022042417/5f333094091ba21ebe5d22ab/html5/thumbnails/6.jpg)
CapacitiesData characteristics
Factors
Data use
Data Relevance
Data
Accessibility
Data
Timeliness
Motivations
Data Quality
Data Quantity
Incentives
Interest
Culture
Individual capacity
Organisational capacity: Financial and logistical resources
Organisational capacity: Data and information systems
Institutional capacity
![Page 7: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including](https://reader034.vdocument.in/reader034/viewer/2022042417/5f333094091ba21ebe5d22ab/html5/thumbnails/7.jpg)
Relationships between factors(Matrix of Direct Influence)
Data characteristics factors Capacity factors Motivation factors
Outcome
factor
Influenced
Influencing
Data
relevanc
e
Data
quality
Data
quantity
Data
accessibility
Data
timeliness
Individual
capacity
Organisational
capacity -
Financial and
logistical resources
Organisational
capacity -
Data and
information
Institutional
capacity Incentives Interest Culture
Use of
data
Data relevance 0 0 0 0 0 1 0 0 1 0 2 0 2
Data quality 0 0 0 0 0 1 0 0 1 0 2 0 2
Data quantity 0 0 0 0 0 1 0 0 1 0 1 0 2
Data accessibility 0 0 0 0 0 1 0 0 2 0 2 0 2
Data timeliness 0 0 0 0 0 1 0 0 1 0 2 0 2
Individual capacity 2 2 1 0 2 0 0 1 1 2 2 1 2
Organisational
capacity -
Financial and
logistical resources 1 1 1 1 1 1 0 2 0 2 1 1 2
Organisational
capacity -
Data and information
systems 1 2 1 2 2 0 0 0 1 0 1 1 2
Institutional capacity 2 1 2 2 1 1 1 2 0 1 1 2 1
Incentives 2 2 2 1 2 1 2 2 0 0 2 2 2
Interest 2 2 2 1 2 1 2 2 0 2 0 2 2
Culture 2 1 1 1 1 1 1 2 2 2 2 0 1
Use of data 0 0 0 0 0 2 0 0 2 2 2 1 0
![Page 8: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including](https://reader034.vdocument.in/reader034/viewer/2022042417/5f333094091ba21ebe5d22ab/html5/thumbnails/8.jpg)
Factor dependency and influence(MICMAC)
Dependence
Infl
uen
ce
Leverage points
Low significance
Potentially volatile
Highly sensitive
![Page 9: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including](https://reader034.vdocument.in/reader034/viewer/2022042417/5f333094091ba21ebe5d22ab/html5/thumbnails/9.jpg)
Potentially volatile
Data characteristics
Dependence
Infl
uen
ce
Leverage points
Low significance Highly sensitive
Motivations
Capacities
Factor dependency and influence(MICMAC)
![Page 10: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including](https://reader034.vdocument.in/reader034/viewer/2022042417/5f333094091ba21ebe5d22ab/html5/thumbnails/10.jpg)
Centrality
Label
weighted indegree
(influenced)
weighted outdegree
(influencing)
betweenness centrality
(bridging)
Interest 21 21 15.9
Incentives 12 21 1.7
Institutional capacity 13 18 15.9
Individual capacity 13 17 10.2
Culture 11 17 2.6
Organisational capacity - Financial and logistical resources 7 15 0.1
Organisational capacity - Data and information systems 13 13 1.5
Use of data 22 12 4.4
Data accessibility 10 8 0.5
Data relevance 13 7 0.5
Data quality 12 7 0.5
Data timeliness 12 7 0.5
Data quantity 11 6 0.5
Using Gephi 0.9.2 (https://gephi.org/)
![Page 12: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including](https://reader034.vdocument.in/reader034/viewer/2022042417/5f333094091ba21ebe5d22ab/html5/thumbnails/12.jpg)
Causal loopsData relevance
Data quality
Data quantity
Data accesability
Data timeliness
Individual capacity
Finacial and logistical
arrangements
Presence of data and
information systems
Institutional
capacity
Incentives to use
data
Interest to use data
Culture
Use of data
![Page 13: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including](https://reader034.vdocument.in/reader034/viewer/2022042417/5f333094091ba21ebe5d22ab/html5/thumbnails/13.jpg)
Causal loopsData relevance
Data quality
Data quantity
Data accesability
Data timeliness
Individual capacity
Finacial and logistical
arrangements
Presence of data and
information systems
Institutional
capacity
Incentives to use
data
Interest to use data
Culture
Use of data
![Page 14: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including](https://reader034.vdocument.in/reader034/viewer/2022042417/5f333094091ba21ebe5d22ab/html5/thumbnails/14.jpg)
Causal loopsData relevance
Data quality
Data quantity
Data accesability
Data timeliness
Individual capacity
Finacial and logistical
arrangements
Presence of data and
information systems
Institutional
capacity
Incentives to use
data
Interest to use data
Culture
Use of data
![Page 15: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including](https://reader034.vdocument.in/reader034/viewer/2022042417/5f333094091ba21ebe5d22ab/html5/thumbnails/15.jpg)
Conclusions
Focussing improving data characteristics through focussing on data-
collection, processing and storage systems will not ensure improved
evidence-based decision making.
There is especially a need to also address:
- Culture and incentive structures (including regulatory frameworks);
- Individual capacities related to collection, analysis and use of
monitoring data;
- Organisational capacity related to financial and logistical resources
for data collection, analysis and use;
- Institutional capacities, including relationships and trust.
![Page 16: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including](https://reader034.vdocument.in/reader034/viewer/2022042417/5f333094091ba21ebe5d22ab/html5/thumbnails/16.jpg)
Visiting address
Bezuidenhoutseweg 2
2594 AV The Hague
The Netherlands
Postal address
P.O. BOX 82327
2508 EH The Hague
The Netherlands
T +31 70 3044000
www.ircwash.org
Supporting water sanitation
and hygiene services for life
Thank you!
Blog (and paper) forthcoming on
https://www.ircwash.org/blog
For (further) comments, suggestions, inputs and feedback,
please contact me: Marieke Adank: [email protected]