Title page using same image and text as document cover page

CENTRE FOR

DISABILITY

RESEARCH AND

POLICY

Monitoring Manual and Menu (MM&M)

for CBR and other community-based disability

inclusive development programs

MM&MRos Madden

WHO-FIC October 2014

Poster C535

Rationale

• CBR is a valued community development approach but there is a lack of

evidence of its efficacy (World Report on Disability 2011, Global Disability

Action Plan 2014).

• To build evidence about CBR, consistent with the philosophy of CBR,

monitoring should be the starting point: locally controlled and empowering

stakeholders with information.

The development of a monitoring toolkit to assist CBR program managers

and stakeholders to record locally meaningful information and data,

based where possible on international standards.

Aim

1. Literature review and analysis (36 M&E articles and reports)

Confirmed need for more rigorous and compatible monitoring and

evaluation practices to be developed.

Identified 2,495 information items used or sought in literature on

monitoring and evaluation of CBR, and coded 788 items (32%) to

ICF domains and categories.

Demonstrated ICF is a relevant and potentially useful classification

for CBR monitoring.

Madden RH, Dune T, Lukersmith S, Hartley S, Kuipers P, Gargett A, Llewellyn G. The relevance of the International Classification of Functioning, Disability and Health (ICF) in monitoring and evaluating Community-based Rehabilitation (CBR). Disabil Rehabil 2013 Early Online: 1–12.Lukersmith S, Hartley S, Kuipers P, Madden RH, Llewellyn G, Dune T. Community-based rehabilitation (CBR) monitoring and evaluation methods and tools: a literature review. Disabil Rehabil 2013 Early Online: 1–13.

Method

4

8%

1%

49%

42%

Body Functions

Body Structures

Activities &Participation

Environmental Factors

Most common ICF components

5

4% 1%

11%

9%

10%

7%

10%

24%

24%

Learning & applying knowledge

General tasks & demands

Communication

Mobility

Self-care

Domestic life

Interpersonal interactions and relationships

Major life areas

Community, social & civic life

Activities & Participation

Most common

ICF domains

6

10%4%

20%

43%

23%

Products & technology

Natural environment and humanmade changes to environment

Support & relationships

Attitudes

Services, systems & policies

Environmental Factors

Most common

ICF domains

2. Workshops with CBR stakeholders

2011: Workshops with CBR stakeholders from Vietnam, Lao PDR and the Philippines.

Participants’ information needs, then first draft of organised lists of information items.

2013: CBR stakeholders from PNG, Timor Leste, Solomon Islands and Fiji in 2013,

Similar process, resulting in first draft Manual and Menu.

3. Synthesis, consultation and review

Synthesised information items from previous stages via thematic analysis.

Mapped to relevant frameworks (e.g. CBR Matrix) and data standards (including ICF).

Refined the logic, structure and wording of the Menu (including via an online survey).

Collaborators provided case studies to highlight the purpose and value of information

that can be gleaned from monitoring, for inclusion in the Manual.

Further consultation with collaborators to refine the Manual and Menu.

Advisory Group from June 2013.

External reviewers on several iterations of the draft Manual and Menu.

Method

Photos

2013

The results

Steps explained in the ManualBefore you begin1 Prepare for collaboration2 Design information

Exercise 1: Why is information needed? How will it be used?Exercise 2: What items of information are needed?Exercise 3: How will we collect and record the information?Exercise 4: When and where will information be collected, who will collect it, and how will it be stored?Exercise 5: Who will use the information and how?

3 Develop the monitoring plan4 Undertake monitoring activities5 Analyse and use information6 Review monitoring activities & the monitoring plan

Menu of information items: Headings

P1 Person—Personal profile & history P2 Person—Functioning and disability

P2.1 Body functions P2.2 Activities and Participation

P3 Person – Environmental factors P4 Person – OutcomesO1 Organisation – Purpose, structure, strategyO2 Organisation – Resources O3 Organisation – Environment O4 Organisation – OutcomesA1 Activities – What is done A2 Activities – Outcomes W1 Workforce – Personal profile of staffW2 Workforce – Knowledge and skills W3 Workforce – Responsibilities and tasksW4 Workforce – Training undertaken W5 Workforce – Quality of performance

• Freely available guidance for CBR and other disability inclusive

development programs to plan locally controlled monitoring activities which

empower stakeholders with information

• Deeper understanding of the diverse information needs and priorities of

CBR stakeholders from Asia and the Pacific region, and of data standards

that are relevant and useful for CBR monitoring

• A strong and vibrant network of CBR stakeholders in the Asia Pacific

region, underpinned by shared commitment to CRPD, CBR guidelines and

matrix, and the ICF.

• A desire among collaborators and CBR network to test and improve the

Manual and Menu…

Outcomes of the project (so far)

Thank youfrom the collaborators

University of Sydney team

Centre for Disability Research and Policy

Ros Madden

Sue Lukersmith

Sally Hartley

Michael Millington

Charlotte Scarf

Nicola Fortune

Alexandra Gargett

Gwynnyth Llewellyn

sydney.edu.au/health-sciences/cdrp/cbr-monitoring

ros.madden@sydney.edu.au

Grateful acknowledgment of resources from: Australian Aid, CBM International,

The University of Sydney

Sainimili Tawake

Mariaia Matakibau

Bounlanh Phayboun

Sengthong Soukhathammavong

Khamko Chomlath

Bounpheng Phetsouvanh

Ben Theodore

Peter Sindu

Susan Goikavi

Goretti Pala

Casper Fa'asala

Elsie Ningalo Taloafiri

Penafrancia Ching

Joaquim Soares

Francisco de Deus Soares

Phuong Anh Tran Thi

Phuong Tran Thi

Nhan Ha Chan

Cam Tu Huynh Thi