Module 8: Indicators for Mainstreaming ICT into Other Sectors of the Economy

Anat Lewin and Sheridan Roberts

2

Module OutlineEnvironmentHealthEducation

ICT4H - Health Indicators

ICT4Edu - Education Indicators

ICT4Env - Environment Indicators

ICT Applications and e-Gov – Frameworks & Context

3

Ho

rizo

nta

lsV

erti

cals

Citizens, Businesses, Government, Civil Society

b

Fina

ncia

l M

gmt

e-He

alth

e- Tax

e

-Ed

ucat

ion

Enterprise Architecture and Standards

e- Cust

oms

e- Cada

stre

e-Security

Shared Infrastructure and Services

Strategy, Policies, Laws, Regulations, Institutions, Knowledge

Syn

erg

iesHorizontals

[Interoperability,Security, Norms, .national portal, single window for citizens/businesses]

Verticals[e-services, on-line registrations, etc..

The ICT Applications Framework

4

Good Practices

• e-Health, e-Education and e-Environment applications are seen as part of the national e-Government vision

• Application design conforms to national and local policy objectives for e-Gov, public sector management and G2C services

• ICT Applications are developed using a Government Enterprise Architecture Framework – “Service Oriented Architecture”

• ICT Applications comply with national interoperability standards and also take into account international requirements

5

Skills Needed on Counterpart team:

• High-level enterprise architects

• People “plugged” into line ministries and their services

• People skilled in Change Management and Processes

•Applications are developed as a combination of services

•Each service is like a Lego block

•Services can be invoked and reused

•Faster, more flexible and more cost-effective development

•Same Payment System can be invoked by e-Education as by other services

–Use of online banking processes e.g. Latvia

–Post office payment system e.g. e-Dinar Tunisia

Service-Oriented Architecture

6

Old Thinking | New Thinking

7

Interoperability example: e-Business Registries

SocialSecurity

Business Registry

GAFI

Land Registry

SecuredAsset

RegistryCar/Ship Registry

Interoperability of ICT

Applications

Interoperability of databases, registries and online services bring benefitsand time / cost savings

E-CustomsTrade DB

TaxRegistry

CentralBank

ITIDA Investmt

Promotion

8

Delivering Location-Specific Services

9

Components of Interoperability

•Organizational Interoperability

•Technical Interoperability–Connectivity and networking standard –Integration standard –Security standards

•Data standards –Data standards catalogue (definition of data standards at business and

logical level) –Data schemas (for exchange of data)

•Metadata standards –Metadata standards (attributes for tagging electronic documents) –Metadata dictionaries

•Semantic Interoperability –Common vocabularies and mapping strategies –Ontology-based approach

10

Technology is Not the Problem

11

Technology is Not the Problem

12

Politics is the Challenge

• Weak institutions need strong champions in both Line Ministries and e-Gov agency, and pressure from above, e.g. Head of State’s office

• Officials lacking capacity build capacity and empower “doers”

• Institutions traditionally not connected create collaboration among agencies

• Turf issues resolution from top

• Local – National challenges resolution from top

• Need reasonable budget and sensible PPP

13

Collaboration among Data Players

• MCIT, Ministry of Administrative Reform• CAPMAS• Any of Ministry of Education, Ministry of Health,

Ministry of Agriculture, Ministry of Higher Education• Special initiatives of Egypt’s ICT Strategy• Donors (project levels)

When there are many players and data sources, the issues are collection gaps or duplication, ownership, quality assurance, coordination.

1.Collaboration is needed through a steering committee composed of representatives.2.Data should be standardized, mined, stored, shared and used

collaboratively.3.Transparent data systems and workflows need to be created.

Education

Working together is crucial

14

ICT Investments have Risks…

•Gartner study: 8 out of 10 dollars invested in IT are not having an impact, October 2006

•Guardian headline: “Government’s IT Blunders Cost £2bn” (January 5, 2008)

Partial Failures 50%

Total Failures 35%

Successes 15%

Source: Richard Heeks. 2003. “Most e-Government-for-Development Projects Fail: How Can Risks be Reduced?”. IDPM i-Government Working Paper no. 14

e-Government initiatives in Developing/Transitional Countries

15

… and Success Has a Variable Price

Economist: The Electronic Bureaucrat: A special report on technology and government, February 16, 2008

Spending does not mean Success

16

General M&E Indicators for all ICT Applications

Sample Outcome Indicators

• Implementation of ICT Applications that are most in demand by citizens and businesses

• Growth of number of users and transactions of the ICT Application; before/after substitution

• Interoperability among government databases / registries / services

• Effective Use of Public-Private Partnerships (PPPs)

• Quality indicators: increases in (a) usability, (b) functionality and (c) accuracy of ICT Applications; increase in access to relevant information

• Quantity indicators: increases in coverage, scope or number of services

Sample Impact Indicators

• Quality: User satisfaction with ICT Application (survey)

• Efficiency: cost savings to government, citizens or businesses

• Efficiency: time savings to government, citizens or businesses

• Governance: Increase in transparency and responsiveness of government; reduction of corruption.

• Re-investment of net profits

• Reduction of environmental foot print (paper-less government)

• Any social or economic benefit to the user population overall.

17

Module Outline

ICT4H - Health Indicators

ICT4Edu - Education Indicators

ICT4Env - Environment Indicators

ICT Applications and e-Gov – Frameworks & Context

18

Education-related MDGs

Goal 2 Achieve universal primary education

• Target 3 Ensure that, by 2015, children everywhere, boys and girls alike, will be able to complete a full course of primary schooling.

Goal 3 Promote gender equality and empower women

• Target 4   Eliminate gender disparity in primary and secondary education, preferably by 2005, and to all levels of education no later than 2015.

19

Core ICT Education Indicators

Source: UNESCO Institute for Statistics, Feb 2009

Education

Indicator # Education Core ICT Indicators Type

ED1 Proportion of schools with a radio used for educational purposes (by ISCED level 1 to 3)

OUTPUT

ED2 Proportion of schools with a TV used for educational purposes (by ISCED level 1 to 3)

OUTPUT

ED3 Proportion of schools with a telephone communication facility (by ISCED level 1 to 3)

OUTPUT

ED4 Student-to-computer ratio (by ISCED level 1 to 3) OUTPUT

ED5 Proportion of schools with Internet access, by type (by ISCED level 1 to 3)

OUTPUT

ED6 Proportion of students who have access to the Internet at school (by ISCED level 1 to 3)

OUTPUT

ED7 Proportion of students enrolled by gender at the tertiary level in ICT-related fields (for ISCED levels 5 and 6)

OUTPUT

ED8 Proportion of ICT-qualified teachers in primary and secondary schools

OUTPUT

EDR1 Proportion of schools with electricity (by ISCED level 1 to 3) INPUT

20

Core Indicator Availability

Source: UNESCO Institute for Statistics, Feb 2009

Education

21

Current Issues at UIS

• Lack of standardized definitions, classification, methodological and operational manuals, or indicator guidelines; piloting the current list is in progress

•Need to improve policy relevance of the core list by its future expansion to measuring:

– Frequency of use of ICTs by learners and teachers for educational purposes- ICTs impact on educational achievements and outcomes on labour market

• Elaboration of a reference guidebook on extended list of ICT4E indicators

•Formation of a technical Working Group on ICT Statistics in Education (WISE) of 25 pilot countries – including Egypt - to test, amend, operationalize and validate refined definitions and methodologies.

Source: UNESCO Institute for Statistics, Feb 2009

Education

22

3.2 ICT 4 Education & Lifelong Learning

3.2.1 To help the GoE achieve its vision of educate and lifelong learning as a drive for socioeconomic development

• Optimizing investment in ICT and securing best value through use of economies of scale and research an development of new technologies to help find and sustain cost-effective methods for educational institutions to meet their computer/instructor ratios

• Satisfying training requirements for industry-related capacity in ICT graduates

• Setting up the required platforms for and continuing to promote lifelong learning

23

3.2.2 To integrate ICT within formal education at all levels and foster better management of education systems

• Using ICT to increase the efficiency and effectiveness of the services offered by educational institutions by supporting educational institutions in meeting their computer/instructor rations and ensuring that all staff in schools, offices and educational establishments have access to ICT equipment, management systems, intranet and Internet supported by appropriate training

• Connecting the education community through broadband and establishing an open learning environment

• Promoting the embedding of ICT in the curriculum of all pupils and encouraging intermediary level students to attain certification in ICT

• Increasing the utilization of ICT in educational management systems to raise the general quality of education

3.2 ICT 4 Education & Lifelong Learning

24

3.2.3 To support the training of world-class technically skilled ICT graduates

–Integrating ICT skills, with a special focus on content development, within the curricula of faculties of education, law and business across Egypt

–Developing the confidence, competence and capability of all education professionals and educational institutions to use ICT effectively; providing guidance on appropriate content; and working to enable teachers and instructors to support content development.

3.2 ICT 4 Education & Lifelong Learning

25

Outcome and Impact Indicators

Input Indicators

• Literacy rates

• Reliable electricity

• Enrolment rates in schools

• Number of devices (computers, printers, projectors, etc.) per school (sorted by their technical characteristics)

• Number of students or teachers per device

• Number of computers connected to the Internet and quality / speed

• Number of educational software for key subjects (mathematics, language and science) or special function (e.g. disability)

• Investment in hardware, software or training per school

Output Indicators

• Maximized student learning

• ICT-skilled teachers per student

• Enhanced teacher’s productivity

• Incorporation of ICT in curriculum reform both as a subject and as an enabler mainstreamed in subjects

• Enrolment rates in specialized ICT training

• Education Management System used by MoE, schools and related institutions

Education

26

Outcome and Impact Indicators

Outcome Indicators

• Percentage growth of ICT graduates who find employment in ICT sector or other sectors

• Increase in salary of ICT-certified students

• Increased public-private partnership in education

• Increase of female students specializing in ICTs

• Increase in % of schools with PCs and broadband

• Enhanced teacher creativity and productivity

• Enhanced student creativity and productivity

Impact Indicators

• Increase in GDP per capita, reduction of poverty

• Increase in Education quality

• Competitiveness of ICT industry

• Increase in innovative entrepreneurship

• Joining the “information society”

• Upgrade Human Capital in ICT

• Long-term employment growth

• Reduction of urban-rural divide

• Reduction of gender divide

• Education sector cost / time savings

Education

27

Module Outline

ICT4H - Health Indicators and Methodologies

ICT4Edu - Education Indicators and Methodologies

ICT4Env - Environment Indicators and Methodologies

ICT Applications and e-Gov – Frameworks & Context

28

Health related MDGs

Goal 4 - Reduce child mortality

• Target 5  Reduce by two thirds, between 1990 and 2015, the under-five mortality rate

Goal 5 - Improve Maternal Health

• Target 6 Reduce by three quarters, between 1990 and 2015, the maternal mortality ratio.

Goal 6 - Combat HIV Aids, Malaria and Other Diseases

• Target 7 Have halted by 2015 and begun to reverse the spread of HIV/AIDS

• Target 8 Have halted by 2015 and begun to reverse the incidence of malaria and other major diseases

29

Status Quo on ICT4Health

• There are no agreed international standards for measuring ICT in health.

• OECD has initiated a project on comparative health ICT measures, but no statistical standards have resulted as yet.

Health

Common Denominator Indicators: International Partnership’s Core ICT Indicators

Specialized Indicators:Egyptian National ICT Strategy Indicators

30

Question to Participants

Selecting Core Indicators for measuring the success of Egypt’s ICT4Health policies.

?

Health

31

3.3 ICT for Health

3.3.1 To improve the level of healthcare services in partnership with the MoH

• Creating knowledge networks to support decision-making by health authorities and health managers

• Supporting the integration of ICT infrastructure in the public health management system

3.3.2 To boost information dissemination and knowledge acquisition for the development and improvement of public health

•Developing the infrastructure necessary for secure transmission of patient data in compliance with international EMR standards and laws for data and identify protection

•Promoting the integration of and access to ICT in medical assistance and development provided to the public

Health

32

3.3 ICT for Health

3.3.3 To assist in reducing the cost and increasing the efficiency of public health services across the country

• Promoting telemedicine and online health services

• Developing the capacity of medical professionals to utilize ICT to deliver improved public health services

• Conducting research and development activities on the use of technology to assist the health sector

Health

33

ICT4Health

Inputs and Activities

• Budget

• ICT Skills training for health care workers

• Software, Hardware

• Doctors, dentists, nurses, medical assistants

• Hospitals, clinics

Output Indicators

• Unique health identifier number for each Egyptian citizen

• Health Information Systems at the Ministry and clinics / hospitals

• Completion rate of digitalized health records across Egypt

• Web-enabled services for citizens and health care professionals

Health

34

ICT4Health

Outcome Indicators

• Increase in number of “networked” and “wired” health activities enabled by ICTs

• Improved access by rural health staff to pertinent health information through telemedicine

• Improved access by doctors to international best practice

• Improved ICT-skilled health professionals

• Improved experience by patients

Impact Indicators

• Improved efficiency for the delivery of Health Services (time savings for patients, workers and cost savings for patients and health care institutions)

• Improved quality of health care

• Improved health of population, e.g. preventing, diagnosing, treating, or curing illness, or saving lives due to the enablement of ICTs

• Reduction of poverty due to improved health

• Higher ranking in Human Development Index

Health

35

How to collect?

1. Administrative records – look for EDI transaction data, correlate to patient’s health results

2. Surveys (a) include questions in household surveys about service consumption and demand and (b) focused on health industry – ask about usage of equipment, network and systems.

3. Collect trade data on specialized health-industry ICT equipment

4. Before/After comparison on project-level

ISIC references

•Section: Q - Human health and social work activities, http://unstats.un.org/unsd/cr/registry/regcs.asp?Cl=27&Lg=1&Co=Q •21 - Manufacture of basic pharmaceutical products and

pharmaceutical preparations http://unstats.un.org/unsd/cr/registry/regcs.asp?Cl=27&Lg=1&Co=21

•266 - Manufacture of irradiation, electromedical and electrotherapeutic equipment http://unstats.un.org/unsd/cr/registry/regcs.asp?Cl=27&Lg=1&Co=266

Health

36

Module OutlineEnvironment

ICT4H - Health Indicators

ICT4Edu - Education Indicators

ICT4Env - Environment Indicators - Sheridan

ICT Applications and e-Gov – Frameworks & Context

37

Environment-related MDGs

Goal 7 - Ensure environmental sustainability

• Target 9   Integrate the principles of sustainable development into country policies and programmes and reverse the losses of environmental resources.

• Target 10 Halve by 2015 the proportion of people without sustainable access to safe drinking water and basic sanitation.

• Target 11 Have achieved by 2020 a significant improvement in the lives of at least 100 million slum dwellers.

38

Introduction

•This talk is based on recent work undertaken for the OECD on measuring the relationship between ICT and the environment.1

•It included investigation of current statistical frameworks and the development of an ICT and the environment statistics conceptual model.

•The main features of the model are to recognise the links between ICT and the environment.

•They are complicated and involve direct and indirect, as well as positive and negative, impacts.

1. Measuring the Relationship Between ICT and the Environment: Scoping Study (OECD, 2008), Working Party on the Information Economy,

DSTI/ICCP/IE(2008)4.

Environment

39

Environmental Impacts - ICT products

• ICT products as agents to improve environmental outcomes

–Efficiency improvements for existing products/processes e.g. engine management systems

–Products facilitating dematerialisation e.g. teleworking–Essential role of ICT in monitoring, modelling,

administration and dissemination.

• ICT products as contributors to environmental damage–Energy usage in/emissions from manufacturing,

transport and operation of ICT equipment.–Pollution from disposal.

• ICT products of interest will not only be the general purpose technologies that are the subject of international standards (computers, Internet).

Environment

40

Environmental Impacts - use of ICT

•Use of ICT to improve environmental outcomes–Use of ICT in a way that improves efficiency–Dematerialisation, use of available technologies–Use of ICT in monitoring, modelling,

administration and dissemination–Behavioural attitudes.

•Use of ICT as a contributor to environmental damage

–Energy usage in/emissions from operation of ICTs–Purchasing decisions–Pollution from poorly disposing of ICTs–Behavioural attitudes.

Environment

41

Indirect factors affecting ICT & environment

• Indirect positive and negative impacts–Difficult/impossible to measure

• National level factors–Policy and regulatory environment–Level of education and skills–Wealth–Government policies and actions

• Global factors and relationships –Include the influences of international

organisations and partnerships –Impact of global agreements and treaties.

Environment

42

Data on ICT and the environment

• The main focus of the OECD paper was official statistics.• Official data relating ICT and the environment could

include:–Use of patent data to examine inventions that link ICT

and the environment.–R&D performed by the ICT sector and R&D in an ICT field

with an environment objective. –Environmental drivers for innovation by ICT sector

businesses.–Teleworking trends from household and business

surveys.–Trends in Internet activities as a substitution for material

activities (dematerialisation).–Changes in use of paper and physical mail.–ICT equipment as a contributor to waste.

• Non-official data includes–Analytical studies, including future projections.–Product life cycle studies.

Environment

43

Conclusions

• While it clear that there are a number of links between ICT and environmental outcomes, there is no separate statistical field that links the two. • Responses by the statistical community could include:

–Undertaking targeted household surveys (or expanding existing ICT use or environment surveys) to collect information that links individual ICT use with environmental behaviours and concerns.

–Expanding household ICT use surveys to collect information about unused ICT equipment and disposal of ICT equipment.

–Expanding classifications (such as those for field or science and socio-economic objective used in R&D surveys) to better reflect ICT and the environment.

–Ensuring that sample sizes are sufficient to enable better tabulation of the ICT sector and cross-tabulation of data by characteristics of interest (for example, Internet activities by age and gender).

–Adding questions to existing business ICT use surveys on the uses of ICT that can have a positive or negative effect on environmental outcomes.

Environment

Thank You!

45

Reminder: Indicators Framework

Outcomes • Intermediate effects of outputs on clients

Outputs • Products and services produced

Activities• Task personnel

undertake to transform inputs to outputs

Inputs • Financial, human, and material resources

Impacts • Long-term, widespread improvement in society

Impl

emen

tatio

nR

esul

ts

Binnendijk, 2000

46

ICT4Education Example

Outcomes• Improved use of schools in preparing

students for ICT workforce; Improved ability of students to find ICT jobs; Improved ability of students to obtain higher-paying jobs

Outputs• Number of students a year trained; Number

of students receiving an ICT certification; Broadband access in schools; Low Students per computer ratio; High PCs per school ratio

Activities• Training students in use and application of

ICTs; Supporting innovation & entrepreneurial spirit; Providing career advice center; Supporting private sector in hiring graduates.

Inputs • Budget, ICT Trainers, Hardware and Software in Classroom, Internet connectivity

Impacts • Higher GDP per capita among ICT-trained students; Poverty Reduction

Impl

emen

tatio

nR

esul

ts