country his assessments interim report july 2007 8 th board meeting 23-24 july, 2007 seattle, u.s.a

Country HIS assessmentsInterim report

July 2007

Country HIS assessmentsInterim report

July 2007

8th Board Meeting

23-24 July, 2007

Seattle, U.S.A. www.healthmetricsnetwork.org

Data sourcesData sources

• Preliminary or final reports from 23 countries that used HMS assessment tool

- Sub-Saharan Africa (12)

- Middle East and North Africa (1)

- Europe and Central Asia (2)

- East Asia and Pacific (6)

- Latin America and Caribbean (2)

• Qualitative analysis - process: n=17

• Quantitative analysis - results: n=23

Assessment strategiesAssessment strategies

• All countries followed the suggested HMN strategy- identify and convene stakeholder group- participants conduct the self-assessment- consensus workshop to review the findings

• Some included sub-national meeting; others conducted meetings at sub-national levels.

• Several countries included follow-up interviews

Relation with previous assessments

• The HMN assessment results were compatible with previous assessments

• The assessment tool filled gaps not assessed by the previous assessments

Stakeholder participationStakeholder participation

Stakeholders widely involved in assessments

• Ministry of Health

• National statistics office

• Other ministries and national institutions (Planning, Interior, Finance, Social Security)

• Research institutions, NGOs

• UN agencies (WHO, UNICEF, UNFPA)

Stakeholders infrequently involved

• World Bank, UNAIDS

• Bilateral donors

Stakeholders not known for their involvement

• Global Fund, GAVI representatives

Stakeholder participation(development partner participation)

Stakeholder participation(development partner participation)

Multi-lateral agenciesBilateral and technical

agencies

WHO 15 USAID 4

UNICEF 7 DFID 3

UNFPA 7 DANIDA 2

UNDP 4 GTZ 2

EC 3 BTC 1

UNAIDS 3 CDC 1

World Bank 3 Italy 1

ADB 1 JICA 1

Netherlands 1

Assessment results - overallAssessment results - overall

0%

20%

40%

60%

80%

100%

ResourcesIndicators

Data sourcesData management

Info productsDissemination & use

Overall HIS

Highly adequate

Adequate

Present butnot adequate

Notadequate

Notfunctional

Assessment resultsResourcesAssessment resultsResources

0%

20%

40%

60%

80%

100%

Policy & planningInstitution, HR, financing

Infrastructure

1. Resources

Highly adequate

Adequate


Notadequate

Notfunctional

Assessment resultsResources - Policy and planningAssessment resultsResources - Policy and planning

0% 20% 40% 60% 80% 100%

Other

EAP

SSA

Moldova (ECA)Yemen (MENA)Georgia (ECA)Panama (LAC)

Honduras (LAC)

Timor-LesteCambodiaLao PDRMyanmarViet Nam

China

Sierra LeoneSudan

SwazilandGambia

CameroonKenyaGhanaEritreaBenin

UgandaLesotho

1A. Policy & Planning

Not Not Present but Adequate Highly functional adequate not adequate adequate

Sub-Saharan Africa

East Asia & Pacific

Other regions

Assessment resultsIndicatorsAssessment resultsIndicators

0% 20% 40% 60% 80% 100%

Other

EAP

SSA

Georgia (ECA)Moldova (ECA)Yemen (MENA)Honduras (LAC)

Panama (LAC)

Timor-LesteLao PDR

CambodiaViet NamMyanmar

ComorosCameroon

Sierra LeoneGambia

SwazilandSudanKenyaEritreaBenin

LesothoUgandaGhana

2. Indicators


Sub-Saharan Africa

East Asia & Pacific

Other regions

Assessment resultsData sourcesAssessment resultsData sources

0%

20%

40%

60%

80%

100%

CensusVital registration

SurveysDisease records

Service recordsAdministrative rec

3. Data sources

Highly adequate

Adequate


Notadequate

Notfunctional

Assessment resultsData sources - SurveysAssessment resultsData sources - Surveys

0% 20% 40% 60% 80% 100%

Other

EAP

SSA

Moldova (ECA)Panama (LAC)Georgia (ECA)

Honduras (LAC)Yemen (MENA)

Viet NamTimor-Leste

CambodiaMyanmar

ChinaLao PDR

ComorosGambia

CameroonSwaziland

Sierra LeoneSudanBenin

UgandaLesotho

KenyaEritreaGhana

3C. Surveys


Sub-Saharan Africa

East Asia & Pacific

Other regions

Assessment resultsData sources – Vital statisticsAssessment resultsData sources – Vital statistics

0% 20% 40% 60% 80% 100%

Other

EAP

SSA

Yemen (MENA)Honduras (LAC)

Georgia (ECA)Panama (LAC)Moldova (ECA)

Lao PDRTimor-Leste

CambodiaViet Nam

ChinaMyanmar

SudanCameroon

GambiaComoros

KenyaLesotho

EritreaBenin

Sierra LeoneSwaziland

UgandaGhana

3B. Vital Statistics


Sub-Saharan Africa

East Asia & Pacific

Other regions

Assessment resultsData managementAssessment resultsData management

0% 20% 40% 60% 80% 100%

Other

EAP

SSA

Georgia (ECA)Moldova (ECA)

Honduras (LAC)Yemen (MENA)Panama (LAC)

CambodiaLao PDR

Timor-LesteMyanmarViet Nam

China

ComorosSwaziland

SudanSierra Leone

CameroonKenya

GambiaLesothoUgandaGhanaEritreaBenin

4. Data management


Sub-Saharan Africa

East Asia & Pacific

Other regions

Assessment resultsDissemination and useAssessment resultsDissemination and use

0%

20%

40%

60%

80%

100%

Analysis & useUse for policy & advocacy

Use for planningUse for resource allocation

Use for implementation

6. Dissemination and use

Highly adequate

Adequate


Notadequate

Notfunctional

Evaluation of survey componentsEvaluation of survey components

0

1

2

3

Su

rvey

for

key

MC

H s

erv

Est

imat

es f

or IM

R &

U5

MR

Su

rvey

for

key

NC

D &

ris

k fa

ct -

Cap

for

data

-col

, pr

oces

s, a

nal

Han

dlin

g pe

rson

al d

ata

Dis

aggr

eg b

y ag

e, s

ex,

geo

g

Dis

aggr

eg b

y w

ealth

, edu

catio

n -

Ava

ilabi

lity

of m

etad

ata

Ava

ilabi

lity

of m

icro

dat

a -

Coo

rd fo

r tim

ing,

va

r, f

und

ing

Coo

rd fo

r d

esig

n, im

pl,

ana

l, u

se

3C. Evaluation of survey components (n=18)

Highly adequate

Adequate


Not adequateat all

0

1

2

3

Nat

l cap

in c

ore

heal

th in

fo s

ci

Ava

il &

qu

al o

f an

nual

rep

ort -

Fun

ctio

nal H

IS u

nit

at M

oH

Cap

of H

IS u

nit

for

in-d

epth

ana

l -

Use

of

grap

hic

s at

sub

-na

tiona

l

Use

of

map

s a

t sub

-na

tion

al -

Cen

sus:

cap

for

data

-col

,pro

c,an

al

Vit

sta:

cap

for

col,p

roc,

ana

l

Su

rvey

: cap

for

col,p

roc,

ana

l

Dis

rec

: cap

for

col,r

ep,

anal

,act

Analytical capacity

Evaluation of analytical capacityEvaluation of analytical capacity

Highly adequate

Adequate


Not adequateat all

Country result examples(difference in dispersion of scores across components)

Country result examples(difference in dispersion of scores across components)

0% 20% 40% 60% 80% 100%

Info use

Info prod

Data sour

Resources

Overall

implementationres allocation

planningpolicy&advocacy

analysis&use

risk factorshlth system

morbidmortal

hlth status

logisticsfinancing

human resinfra&service

admin recservice rec

disease recsurvey

vital statcensus

infrastructureinstit,HR,finan

policy&planning

Info useInfo products

Data managementData sources

IndicatorsResources

Viet Nam / WPR / EAPOverall

Resources

Data sources

Information products

Dissem& use

Viet Nam

0% 20% 40% 60% 80% 100%

Info use

Info prod

Data sour

Resources

Overall



analysis&use


morbidmortal

hlth status

logisticsfinancing



disease recsurvey

vital statcensus


policy&planning



IndicatorsResources

Republic of Moldova / EUR / ECAMoldovaOverall

Resources

Data sources


Dissem& use

Country result examples(difference in the mean scores for all components )

Country result examples(difference in the mean scores for all components )

0% 20% 40% 60% 80% 100%

Info use

Info prod

Data sour

Resources

Overall



analysis&use


morbidmortal

hlth status

logisticsfinancing



disease recsurvey

vital statcensus


policy&planning



IndicatorsResources

Ghana / AFR / SSAOverall

Resources

Data sources


Dissem& use

Ghana

0% 20% 40% 60% 80% 100%

Info use

Info prod

Data sour

Resources

Overall



analysis&use


morbidmortal

hlth status

logisticsfinancing



disease recsurvey

vital statcensus


policy&planning



IndicatorsResources

Timor-Leste / SEAR / EAPTimor-LesteOverall

Resources

Data sources


Dissem& use

Conclusions- Assessment tool performance -Conclusions- Assessment tool performance -

• Worked well for:– Generating a broad understanding of the HMN

concept of HIS– Provoking discussion and enhancing collaboration

among various stakeholders

• Worked not so well for– Comparisons between countries and over time– Detailed assessment of HIS components (e.g. civil

registration)– Objectivity of the respondents and possible conflict

of interest when a self assessment tool is used– Move from the assessment to planning– Attention to user needs and to assessing both what

policy makers' and planners' need

country his assessments interim report july 2007 8 th board meeting 23-24 july, 2007 seattle, u.s.a

Documents