Routes to Resilience: Lessons Learnt from Monitoring BRACED

PaulaSilvaVillanuevaCatherineGouldPLACARDWebinar30.01.2017

3

Ethiopia

Uganda

South Sudan

Sudan Chad Niger

Mali

Mauritania

Senegal Burkina Faso

Kenya

Africa: 13 projects in 11 countries

Myanmar (Burma)

Nepal

Asia: 2 projects in 2 countries

BuildingResilienceAndAdaptaDonToClimateExtremesandDisasters(BRACED)2015-2018

DFIDFunded:£110mwww.braced.org

ImplemenDngPartners

KnowledgeManager(KM)&FundManager(FM)

3

Research

TheKMcomprises6organisaDonswithcomplementaryexperDseindifferentdisciplinesandgeographiesworkingtogethertogenerateandshareevidencebasedknowledge…

Learning&Uptake

Monitoring&Evalua9on

AsiaRegionalPartner

Communica9ons&Dissemina9on

AfricaRegionalPartner

TheFMisresponsibleforoverseeingthedeliveryoftheBRACEDprojects.Itcomprises2organisaDonswhichtogetherformanintegratedteam:

BRACEDM&E‘Infrastructure’BRACED

Fund Manager FM Results

Team

Quarterly & Monthly

Reporting

Quarterly Performance

ReportingDirect

engagement with IPs

Monitoring visit reports

BRACED Knowledge Manager

Monitoring & Results

Reporting (MRR)

Consistent project results

reporting (Outcome

level)

3As (Absorptive, Anticipatory,

Adaptive)Areas of Change

(Outcome Mapping)

Evaluative Monitoring

Project to programme evidence &

learning

Annual Reporting Synthesis

Evaluation

EA 1: BRACED

Programme ToC

Contribution Analysis (Country

Case Studies)

EA 2: BRACED

InterventionsRealist Evaluation

EA 3: BRACED Projects

Quasi-Experimental

Impact EvaluationEA 4: Adaptive

Social Protection

(System level)

Contribution Analysis

EA 5: PHASE Case based analysis

HowisBRACEDperforming?HoweffecDvelyareacDviDesbeingdelivered?WhatresultshasBRACEDdelivered?DoestheBRACEDmodelwork?Forwhom?Whatdoesthismeanforfutureresilienceprogramming?Whatdoesthismeanforresiliencestrengtheningmorebroadly?Whathavewelearnedaboutmonitoringandmeasurementofresilienceprogramming?

AcDvity Method

KM Monitoring & Results Reporting (MRR) How are BRACED projects building resilience and what can we learn from MRR efforts?

5

BuildingtheevidencebaseviarobustmonitoringandresultsreporDng

4

Co-developmentoftheBRACEDfoundaDonaldocumentsfromtheboBom-up:theoryofchangeandlogframe

Developmentof3qualita9veframeworksformonitoringandmeasuringresilience

LighttouchM&Esupportthroughguidancenotes&M&E1:1clinics,webinars&workshops

Aggregation & synthesis: from projects to programme

KM BRACED MRR Framework Enabling data collection and evidence generation to track and understand the processes of change that lead to climate and disaster resilience

Theo

ry o

f cha

nge

What is the long term change and development impact the project is seeking

to support?

‘3A’s (Anticipatory, Absorptive & Adaptive)

Transformation

How will change happen? Who are the key actors?

Areas of Change(knowledge, capacity, decision-

making, partnerships)

What are the contextual drivers that may enable or constrain change?

Evaluative Monitoring (climatic and non-climatic context)

What are the underlying assumptions about how this change would happen and

did they hold?Reflection and learning- Testing

theory of change

Key questions How we monitor & assess change?

2Mandatoryprogramme-wideindicators:§  KPI4(outcome):ThenumberofpeoplewhoseresiliencehasimprovedasaresultofBRACEDsupport§  KPI1(output):ThenumberofpeoplesupportedbyBRACEDtocopewiththeeffectsofclimatechange

Lessons learnt from year 1

9

•  Quantitative indicators of resilience need to be complemented with qualitative and explanatory frameworks

•  There is a need to shifts mindsets from logframe-driven data collection exercises to learning-oriented M&E

•  There are different options for rolling out, but each comes with its own trade-offs

•  Aggregation and synthesis at scale takes time and resources, challenging real time learning and course correction

INDICATORS

PURPOSEOFM&E

ROLLINGOUTPROGRAMMELEVELFRAMEWORKS

SYNTHESIS&AGGREGATIONATSCALE

Implications for Practice When designing, implementing and reporting against resilience M&E frameworks:

1.  Be clear about what counts and why from the beginning

2.  Go beyond business as usual, but know your limits (or improve them!)

3.  Pick your framework but be aware of its implications (and resource for them)

4.  Resource for reporting at scale (and be cautious of time)

Question for further reflection Ø  In this context, how complex does M&E need to be?

This material has been funded by UK aid from the UK government; however the views expressed do not necessarily reflect the UK government’s official policies.

THANKYOU!

Forfurtherinsightsvisit:

RoutestoResilience:insightsfromBRACEDyear1

RoutestoResilience:lessonsfrommonitoringBRACED