Technical OverviewMIRA

2013 - Pakistan

ASSESSMENT

WORKING GROUP

Outline• Survey of Surveys• MIRA Overview

– MIRA Scope– MIRA Tool and Approach– MIRA Data Capture

• Sampling• MIRA Key Informant• Interview Techniques• ToT – Key Points• Use of Satellite Imagery• Use of PDAs• Simulation Exercise

ASSESSMENT

WORKING GROUP

It doesn’t matter how many resources you have

If you don’t know how to use them,it will never be enough.

Information is a basic need in humanitarian response

ASSESSMENT

WORKING GROUP

Survey of Surveys/Assessment Registry

http://pakresponse.org/pak/sos

ASSESSMENT

WORKING GROUP

MIRA ScopeExtent and scale Priorities and needs

• Remote Sensing i.e. analysis of satellite imageries

• Land scan 2010 for population density

• Verification against government data and local authorities

• Post disaster district check list

• Community level assessment• Sample based survey

• Statistically representative to districts

• Distribution is proportionate to affected population for Tehsils/Talukas

ASSESSMENT

WORKING GROUP

MIRA Tool and ApproachTool Approach

Key Informant Interviews (Gender-balanced)1 Male1 Female

• Structured interview• Pre-developed questionnaire

(feeding into analysis framework)• Multi-sector coverage

Direct Observation1 per site

• Pre-developed checklist• Validate KI Interviews

MIRA District Checklist • Pre-disaster district checklist• Post-disaster district checklist

(affected Pop and Damages)

ASSESSMENT

WORKING GROUP

MIRA Data Capture

Tool Advantaged UsagePaper-basedquestionnaire

Require no knowledge of technologyEasily accepted by communities

Government responseJoint response in areas of sensitivity

Digital input(PDA/Smart phone technology)

Direct data (real-time) input – improve quality and effectiveness

Joint response

ASSESSMENT

WORKING GROUP

Sampling

ASSESSMENT

WORKING GROUP

The sample size is calculated to give results within certain reliability limits (5% margin of errors and 95% confidence level). In MIRA 2012, 5% margin of error and 90% confidence level.

The sample is then distributed among the Tehsil/Talukas using PPS (Proportionate to Population Size) sample allocation method.

Sample villages Selection using “Simple Random Selection Method”.

Method of selection and sampling

ASSESSMENT

WORKING GROUP

And

Where:• SS = Sample Size• Z = Z value (e.g. 1.96 for 95% confidence level)• p = percentage picking a choice, expressed as decimal

(0.5 used for sample size needed)• C = confidence interval, expressed as decimal (e.g., .05 = ±5)• pop= population

Sample size calculation formula

http://www.surveysystem.com/sscalc.htm

ASSESSMENT

WORKING GROUP

Sampling of MIRA 2012NDMA requested the Assessment Working Group (AWG) to assess the following 5

districts: Rajanpur, Punjab Jacobabad, Sindh Kashmore, Sindh Jafferabad, Balochistan Naseerabad, BalochistanSample size:

DistrictPlanned Sample

SizeAssessed Men KI

Assessed Women KI

Confidence Level

according to assessed sites

Total Assessed KI

% Female KI

Assessed

Rajanpur 119 93 63 80% 156 40%Jacobabad 174 115 85 80% 200 43%Kashmore 129 115 53 85% 168 32%Jafferabad 151 127 78 90% 205 38%Naseerabad 73 73 20 95% 93 22%Total 646 523 299 86% 822 36%

Due to accessibility issues all the sampled sites could not be assessed, however, this will not effect the results significantly.

ASSESSMENT

WORKING GROUP

MIRA Key Informant

ASSESSMENT

WORKING GROUP

MIRA Key Informant selection1 Male and 1 Female per Site

• Careful identification of Key Informants– The choice of Key Informants affects the result of the survey

• Selection criteria for Key Informants– Knowledgeable of a wide range of issues: Population profile

and figures, security/access, sector information– Example of roles: Community leader, leader of women’s

group, religious leader, teacher, Lady health worker/Dai– Female key informants should not conveniently be female

members of the male key informants rather identify a strong female key informant while selecting male key informant

• Key Informant is representing the community including disadvantage groups – Minorities, extremely poor, displaced, etc.

ASSESSMENT

WORKING GROUP

MIRA Key Informant Interviews

• The assessment relies on the Key Informant to provide an overview of priorities and needs in community

• One Male and One Female Key informant interview will be conducted from each sample community

• A Key Informant can consist of more than one person– Responses recorded as consensus of people represented

• The Key Informant should be objective and impartial, representing the needs of ALL population

ASSESSMENT

WORKING GROUP

Interview Techniques

ASSESSMENT

WORKING GROUP

Interview Do’s Pay attention in the choice of the key informant,

balancing time available good choice of respondent, gender and diversity considerations

Establish contact first by introducing yourself, team and organization (wear official the tags, if available)

Describe the objectives of the interview/assessment, the expected length, the collection method (e.g. PDA)

Request informed consent for conducting interview

ASSESSMENT

WORKING GROUP

Interview Do’s Hold the interview in a place that put the respondent(s)

at ease Respect the local customs, behaviors and beliefs. Show empathy and friendly behavior, establish rapport

and inspire confidence and trust Speak clearly and repeat the question if necessary Avoid using humanitarian acronyms', always spell the

names or the concept (including MIRA) Listen carefully, record data properly Do not presume, do not assume the meaning of an

answer, ask politely to repeat

ASSESSMENT

WORKING GROUP

Interview Do’s

Pace yourself according to the time allotted for the interview

Note down your own observations about the process and content of the interview if you feel necessary

Go through all questions, check before the end If key protection risks are expressed, refer them

confidentially to Protection colleagues for appropriate and confidential follow up.

Thank the participant for making his or her time available

ASSESSMENT

WORKING GROUP

Interview Don'ts

Don’t use judgmental tones that may influence responses

Don’t show non-serious attitude, maintain a professional tone

Don’t read immediately all the possible answers of the multi-response questions, let the respondent talk and note

Don’t try to influence the responses in any way Avoid arguing with the respondent Let the respondent articulate his/her response

ASSESSMENT

WORKING GROUP

Interview don'ts Don’t get stuck on a question Do not argue with a team member about a question

or questioning method If the KI is uncomfortable with the questions, do not

insist they answer Don’t create expectations about future humanitarian

support and promises you cannot keep Don’t prevent respondents from asking you

questions at the end of the interview

ASSESSMENT

WORKING GROUP

ToT – Key Points

ASSESSMENT

WORKING GROUP

Know your audience (knowledge level and working context)

Know your subject (MIRA process, methodology, tools)

Prepare (presentation delivery and Q&A) Engage participants (interactive training,

ask questions, group work etc) Follow up (respond to questions and get

training feedback etc)

ToT MIRA

ASSESSMENT

WORKING GROUP

Key elements of MIRA knowledge

Questionnaire and observation sheet (clear understanding of questions in forms)

KI interviewing (identify KI (purposive selection of male and female), setting up the interview, interviewing to represent the question accurately)

Using the PDA (technical set up and use) PAWG coordination (field assessments, who is doing

the assessment where and when? Assessment monitoring and support)

Data management and analysis process (data nationally centralized, ATT basic analysis to feed partners and for final report)

ASSESSMENT

WORKING GROUP

Use of Satellite Imagery

ASSESSMENT

WORKING GROUP

Land Scan Population distribution model, database, and tool

developed from census using a uniform regular grid (roughly 1 by 1 km)

Representing estimated population as projected of 2012 with the population growth

Flood Extent Satellite Imagery of inundated area Produced from MODIS (Moderate Resolution Imaging

Spectroradiometer) satellite image. Population Calculation

By overlaying flood extents on land scan, population under the flood extent was considered as affected population.

Sample SelectionAffected / Population Calculation

ASSESSMENT

WORKING GROUP

Maximum Flood Extent as of 14 September 2012

ASSESSMENT

WORKING GROUP

Flood Extent as of 30 September 2012

Flood Extent as of 9 October 2012

ASSESSMENT

WORKING GROUP

Flood Extent as of 14 October 2012

ASSESSMENT

WORKING GROUP

30

Flood Extent as of 14 October 2012 Flood Extent

14 October 2012

ASSESSMENT

WORKING GROUP

Field Data CollectionUse of PDAs

ASSESSMENT

WORKING GROUP

Mobile devices?

• Mobile devices are now widely being used for data collection.• Using GPRS technology to send the data immediately as it is

entered in the field.• Data entry is easy and friendly.• Available in different screen sizes as required.

ASSESSMENT

WORKING GROUP

Conventional System of Assessment (Paper based)

Questionnaire Design

Field Data

Collection

Form Compilat

ionData

Entry Data

CleaningData

Analysis

Questionnaire Design

Field Data Collection

Form compilation Data Entry Data

CleaningData

Analysis

Paper based Computer based

Computer based

Computer based

Using mobile devices

ASSESSMENT

WORKING GROUP

Real time data transfer from PDAs to the data server Online data server (MIRA Server) placed in OCHA Data available once entered into the PDAs Data analysis and verification starts just after the data

collection – Live data monitoring Data manager (OCHA) maintain and have access to data along

with technical team members

Online Data Server

ASSESSMENT

WORKING GROUP

Data Collection – MIRA 2012

Data from the field was collected through Android based smart phones/tablets.

Open Data Kit (ODK) http://opendatakit.org is a free and open-source set of tools which provide mobile data collection solutions.

ODK used for:Build the data collection form for mobile devicesCollect the data on a mobile devices and send it to a

server; andAggregate the collected data on the server and extract it in

useful formats e.g. Excel

ASSESSMENT

WORKING GROUP

PDA Setting

• http://mirapk.info• User Name: mira• Password: mira123

ASSESSMENT

WORKING GROUP

Assessment Simulation Exercise• 2-3 participants – Uncoordinated Assessment

– Will conduct individual assessments

• A group of 2-3 participants – Coordinated Assessment– Will conduct the assessment together

• 2-3 participants – Observers– Will observe the above-groups whether they are following interview

techniques or not while collecting the assessment data

• Remaining participants– Will act as key informant of their affected villages

Information Required (in 30 minutes):• What is the total affected population• How many people have been displaced (total IDPs)• How many houses have been damaged with the breakdown of partially and fully

damaged houses

ASSESSMENT

WORKING GROUP

Asadullah KhanAssessment Coordinator, UNOCHA, IslamabadKhan67@un.org – 0302-8519871

Zeeshan Ahmad QamarInformation Management Officer, UNOCHA, Islamabadqamar@un.org – 0302-8519883

Thank you