agency-wide measurement approach (barbara willett, mercycorps)

13
Mission Metrics: Using An Agency-Wide Measurement Approach to Understand Emergency Response March 6, 2013 Barbara Willett Michael Wallace Active Learning Network for Accountability and Performance in Humanitarian Action (ALNAP)

Upload: alnap

Post on 30-Jun-2015

306 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Agency-wide measurement approach (Barbara Willett, MercyCorps)

Mission Metrics:Using An Agency-Wide Measurement

Approach to Understand Emergency Response

March 6, 2013

Barbara Willett Michael Wallace

Active Learning Network for Accountability and Performance in Humanitarian Action (ALNAP)

Page 2: Agency-wide measurement approach (Barbara Willett, MercyCorps)

Mission StatementMercy Corps exists to alleviate suffering,

poverty and oppression by helping people build secure, productive and just

communities.

What is Mission Metrics?

2

An agency initiative to understand how we – collectively –

are achieving our mission.

Page 3: Agency-wide measurement approach (Barbara Willett, MercyCorps)

3

Page 4: Agency-wide measurement approach (Barbara Willett, MercyCorps)

4

Emergency Relief ServicesTheme 1. Basic needs are met after loss-occurring

events (Basic Needs)

1.1 Number of people receiving emergency relief services1.2 Number of households or individuals receiving emergency

relief services showing change in assessed conditions1.3 Number or percentage of programs implementing emergency

relief services that have elements of recovery programming within 90 days of the initial response

Page 5: Agency-wide measurement approach (Barbara Willett, MercyCorps)

6

• Program indicators are aligned with Mission Indicators

• Results are reported• Data is reviewed for quality

and methodology• Results aggregated, analyzed,

discussed, presented• Recommendations for action

Program Indicators

Mission Indicator

AGENCY RESULTS

Mission Indicators: How they work

Page 6: Agency-wide measurement approach (Barbara Willett, MercyCorps)

7

Emergency Beneficiaries

2010 2011 20120

1,000,000

2,000,000

3,000,000

4,000,000

Water & Sanitation Cash Health Shelter/NFI Food

Page 7: Agency-wide measurement approach (Barbara Willett, MercyCorps)

8

Emergency Types

Page 8: Agency-wide measurement approach (Barbara Willett, MercyCorps)

9

Emergency Programs with Evidence of Change

2010 2011 20120

20

40

60

80

Programs Providing Emergency ServicesPrograms Providing Emergency Services Measuring Change in Condition

32%13%

18%

Page 9: Agency-wide measurement approach (Barbara Willett, MercyCorps)

10

Types of Evidence Reported

Food security

Shelter

Health

Cash/Economic

Water & Sanitation

0 1 2 3 4 5 6 7 8 9 10

MI 1.2 - Categories of 'Change in Assessed Condition' (n=31)

Number of Results

Page 10: Agency-wide measurement approach (Barbara Willett, MercyCorps)

11

Improved food security

Improved food security behavior

Improved health condition

Improved health behavior

Improved health infrastructure

Improved shelter

Improved income

Restarted business/livelihoods

Improved sanitation infrastructure

Improved water cleanliness

Improved sanitation behavior

Increased water per person/day

0 1 2 3 4 5 6

MI 1.2 - Categories of 'Change in Assessed Condition' (n=31)

Water & Sanitation Shelter Cash/EconomicHealth Food security

Number of results

Types of Evidence Reported

Page 11: Agency-wide measurement approach (Barbara Willett, MercyCorps)

12

How to use the data?Questions for discussion/investigation:• Do the numbers seem accurate, or are we missing critical

information?• Is it important to understand/distinguish acute versus chronic

emergencies? • Wat/san is clearly our most important sector – do we have the

resources we need to support that?• Should we work harder at measuring “change in assessed

condition”? • Are there other emergency-related variables that should be

tracked?• What about links to ‘community resilience to destabilizing

events’ (theme 2)?

Page 12: Agency-wide measurement approach (Barbara Willett, MercyCorps)

13

Lessons Learned

Focus early on use – what questions do you want to answer?

Engage everyone you can in the process

Link closely to program M&E processes

Ensure quality IT and data management systems

Give it time to develop and dedicate ongoing resources to maintain

Limit expectations

Page 13: Agency-wide measurement approach (Barbara Willett, MercyCorps)

14

Expand the Vision – Evidence

High Quality,

High Impact

ProgramsThought

Leadership

Research

M&EMission MetricsPM@MC

Org Learning