use of monitoring data for evidence-based decision a ... · evidence-based decision making. there...

16
Supporting water sanitation and hygiene services for life 31 October 2018 Use of monitoring data for evidence-based decision making: A factor analysis Marieke Adank UNC Water and Health Conference

Upload: others

Post on 09-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including

Supporting water sanitation

and hygiene services for life

31 October 2018

Use of monitoring data for

evidence-based decision

making:

A factor analysis

Marieke Adank

UNC Water and Health Conference

Page 2: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including

Source: mowie.gov.et

Setting the scene

Page 3: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including

Setting the scene

However, is this data used for informing decision-making processes?

How can this be improved?

What are the factors than enable or hamper use of

monitoring data in evidence-based decision making?

Page 4: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including

Use of monitoring data for decision making

• For improvement

• For accountability

• Data, information and

knowledge

• Continuous collection

and analysis -> trends

• Instrumental

• Conceptual

• Symbolic

• Operations and

corrective actions

• Planning

• Resource allocation

• Regulation

• Policy making

Page 5: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including

3 Models

Linear model

• Influence and dependencies

(MICMAC)

• Centrality

• Causal loops

Data useWell-packaged

information

Data use

Data producer

Data user

Relationship model

Systems model

Data

useActors and factors

Page 6: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including

CapacitiesData characteristics

Factors

Data use

Data Relevance

Data

Accessibility

Data

Timeliness

Motivations

Data Quality

Data Quantity

Incentives

Interest

Culture

Individual capacity

Organisational capacity: Financial and logistical resources

Organisational capacity: Data and information systems

Institutional capacity

Page 7: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including

Relationships between factors(Matrix of Direct Influence)

Data characteristics factors Capacity factors Motivation factors

Outcome

factor

Influenced

Influencing

Data

relevanc

e

Data

quality

Data

quantity

Data

accessibility

Data

timeliness

Individual

capacity

Organisational

capacity -

Financial and

logistical resources

Organisational

capacity -

Data and

information

Institutional

capacity Incentives Interest Culture

Use of

data

Data relevance 0 0 0 0 0 1 0 0 1 0 2 0 2

Data quality 0 0 0 0 0 1 0 0 1 0 2 0 2

Data quantity 0 0 0 0 0 1 0 0 1 0 1 0 2

Data accessibility 0 0 0 0 0 1 0 0 2 0 2 0 2

Data timeliness 0 0 0 0 0 1 0 0 1 0 2 0 2

Individual capacity 2 2 1 0 2 0 0 1 1 2 2 1 2

Organisational

capacity -

Financial and

logistical resources 1 1 1 1 1 1 0 2 0 2 1 1 2

Organisational

capacity -

Data and information

systems 1 2 1 2 2 0 0 0 1 0 1 1 2

Institutional capacity 2 1 2 2 1 1 1 2 0 1 1 2 1

Incentives 2 2 2 1 2 1 2 2 0 0 2 2 2

Interest 2 2 2 1 2 1 2 2 0 2 0 2 2

Culture 2 1 1 1 1 1 1 2 2 2 2 0 1

Use of data 0 0 0 0 0 2 0 0 2 2 2 1 0

Page 8: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including

Factor dependency and influence(MICMAC)

Dependence

Infl

uen

ce

Leverage points

Low significance

Potentially volatile

Highly sensitive

Page 9: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including

Potentially volatile

Data characteristics

Dependence

Infl

uen

ce

Leverage points

Low significance Highly sensitive

Motivations

Capacities

Factor dependency and influence(MICMAC)

Page 10: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including

Centrality

Label

weighted indegree

(influenced)

weighted outdegree

(influencing)

betweenness centrality

(bridging)

Interest 21 21 15.9

Incentives 12 21 1.7

Institutional capacity 13 18 15.9

Individual capacity 13 17 10.2

Culture 11 17 2.6

Organisational capacity - Financial and logistical resources 7 15 0.1

Organisational capacity - Data and information systems 13 13 1.5

Use of data 22 12 4.4

Data accessibility 10 8 0.5

Data relevance 13 7 0.5

Data quality 12 7 0.5

Data timeliness 12 7 0.5

Data quantity 11 6 0.5

Using Gephi 0.9.2 (https://gephi.org/)

Page 11: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including

Generated using Gephi 0.9.2 (https://gephi.org/)

Centrality

Page 12: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including

Causal loopsData relevance

Data quality

Data quantity

Data accesability

Data timeliness

Individual capacity

Finacial and logistical

arrangements

Presence of data and

information systems

Institutional

capacity

Incentives to use

data

Interest to use data

Culture

Use of data

Page 13: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including

Causal loopsData relevance

Data quality

Data quantity

Data accesability

Data timeliness

Individual capacity

Finacial and logistical

arrangements

Presence of data and

information systems

Institutional

capacity

Incentives to use

data

Interest to use data

Culture

Use of data

Page 14: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including

Causal loopsData relevance

Data quality

Data quantity

Data accesability

Data timeliness

Individual capacity

Finacial and logistical

arrangements

Presence of data and

information systems

Institutional

capacity

Incentives to use

data

Interest to use data

Culture

Use of data

Page 15: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including

Conclusions

Focussing improving data characteristics through focussing on data-

collection, processing and storage systems will not ensure improved

evidence-based decision making.

There is especially a need to also address:

- Culture and incentive structures (including regulatory frameworks);

- Individual capacities related to collection, analysis and use of

monitoring data;

- Organisational capacity related to financial and logistical resources

for data collection, analysis and use;

- Institutional capacities, including relationships and trust.

Page 16: Use of monitoring data for evidence-based decision A ... · evidence-based decision making. There is especially a need to also address: - Culture and incentive structures (including

Visiting address

Bezuidenhoutseweg 2

2594 AV The Hague

The Netherlands

Postal address

P.O. BOX 82327

2508 EH The Hague

The Netherlands

T +31 70 3044000

[email protected]

www.ircwash.org

Supporting water sanitation

and hygiene services for life

Thank you!

Blog (and paper) forthcoming on

https://www.ircwash.org/blog

For (further) comments, suggestions, inputs and feedback,

please contact me: Marieke Adank: [email protected]