measuring the information society - cepal · pdf filesocio-economic outcomes and impacts of...

Measuring the Information Society :Measuring the Information Society :

The Canadian experience andThe Canadian experience andapplications for Latin America and the Caribbeanapplications for Latin America and the Caribbean

Training workshop

Panama City, Panama21 November, 2006

Heidi ErtlStatistics Canada

George SciadasInternational Development Research Centre

Agenda Agenda

Introduction and context - why measure ICT?The role of official statisticsObjectives of training workshopCapacity building and the closing of gapsLinkages to economic and societal processes

Measuring demand for ICTby households and individualsby business and government

Measuring supply of ICTICT sector

Coordination, analysis and dissemination

1. Introduction and context

Why measure information and communications technology (ICT)?

Why measure ICT?Why measure ICT?

We live in an ‘Information Society’ where information and communications technologies (ICTs) touch every aspect of our lives – economic, social, political, cultural, etc

Need reliable statistics and indicators of ICT readiness, use and impact to support and inform policy making

Explosion of interest creating a demand for consistent concepts, definitions and methods for international harmonization and comparability

The role of official statisticsThe role of official statistics

Statistics used to develop indicators for Monitoring, benchmarking, evaluating programmes

Framework needed to guide development, measurement and evolution of indicators

Activities Linkages Outcomes Impacts

Indicators for the Information SocietyICT supply and demandICT infrastructure, ICT products, electronic contentSocio-economic outcomes and impacts

A framework for ICT indicators A framework for ICT indicators

ICT products

Information and electronic content

ICT infrastructureICT supplyindustries

characteristics

products

value added

employment

innovation

impacts

ICT demand

who

where

characteristics

activities

frequency

expenditures

barriers

INFORMATION SOCIETYSocio-economic outcomes and impacts of ICT use and development

Effect of domestic policy and regulatory environment on ICT use and development

Global factors, framework conditions and relationships

The need for international coordinationThe need for international coordination

Need ICT indicators to ‘tell the story’How to do it?

Communication between indicator producersand users

Evolution of technologies, policy interests, indicators

Coordination of indicator developmentStandards, classifications, definitions, guidelinesInterpretability and comparabilityCore indicators, inventory of indicators Capacity building

The state of ICT indicators in LACThe state of ICT indicators in LAC

Increase quantity and improve quality of ICT indicators in the LAC region

Standardization and harmonization of ICT indicators More coherent collection of dataBuilding capacity

Global stocktaking exercise on ICT indicatorsInstitutional environment Statistical operationsCurrent and planned ICT indicators

Objectives of workshop on measuring ICTsFrom advocacy to statistical implementation and operationsIdentification of regional characteristics?

Capacity building and the closing of gapsTrain the trainer

Linkages to economic and societal processes

ICT measurement in the context of LACICT measurement in the context of LAC

Measuring the Information Society in CanadaMeasuring the Information Society in Canada

Demand for ICTAccess to and use of ICT

– People and households– Businesses– Governments (including education, health)

Supply of ICT Group of industries supplying ICT goods and services

– ICT sector and products

Research, analysis & disseminationCross-cutting thematic approach

– The Digital Divide– Relationship between literacy and ICT skills– Impact of the Internet on patterns of communication, spending,

and time-use

2. Measuring demand for ICT

ICT access and usage by households and individuals

Measuring demand for ICTMeasuring demand for ICT

Canadian Internet Use Survey (CIUS)

conducted for the first time in 2005

collects information on the Internet activities of Canadian individuals every two years

design based on OECD model survey and needs of policy community in Canada

voluntary supplement to existing Labour Force Survey

replaces Household Internet Use Survey (1997-2003)

Canadian Internet Use Survey (CIUS)Canadian Internet Use Survey (CIUS)

Key indicatorsaccess to and use of the Internet frequency and intensity of uselocation of use (home, work, school, library other)type of use (email, general browsing, electronic banking, search for health, government, other information)language of usetype of connection reasons for non-useelectronic commerce and Internet shoppingprivacy and security social outcomes, digital divide, impacts

Socio-demographic characteristicsage, sex, marital status, family type, education level, labour force status, geographical location, income

Survey developmentSurvey development

Survey has evolved over many yearsquestions and content survey instrument and methodology

Design based on the OECD model survey (WPIIS) and core indicators

consultation with stakeholders, research and policy communities to ensure relevance for Canada and international comparability

Questions tested with both Internet users and non-users across the country

13 focus group consultationssimulated one-on-one interviews

Survey methodologySurvey methodology

Design‘add-on’ to existing Labour Force Survey (LFS)short questionnaire to reduce respondent burdenaverage length of interview is 12 minutes

Samplestratified, multi-stage cluster design employing probability samplingsub-sample from the LFSapproximately 30,000 non-proxy respondents from 10 provinces

Target population Canadians aged 18 and over with some exclusions

residents of the North (Yukon, Northwest Territories and Nunavut), persons living on Indian reserves, full-time members of the Canadian armed forces, and inmates of institutions

Data collectionData collection

91% of interviews completed over the telephone (CATI)others done in person (CAPI)

Computer randomly selects one eligible individual from the LFS household

Only the selected individual can respond to the CIUS questions (non-proxy)

over 30% of CIUS interviews were completed immediately following the LFS interviewif the selected individual is unavailable, interviewers record the best time to call back in order to complete the interviewautomated call scheduling application keeps track of follow-up calls at different times of day throughout the collection period

71% response rate in 2005

Analysis and disseminationAnalysis and dissemination

Two official releases in The Daily August 15, 2006 for Internet access rates and purposes of useNovember 1, 2006 for e-commerce and Internet shopping

Summary statistics on www.statcan.ca

Special requests and tabulationsPolicy community & partnersOECD, ITU and other international organizations

Microdata made available to universities, researchers

Research and analysisConsultation and collaboration with policy community, other partners and academic researchersPublications, presentations, conferences, workshops

http://www.statcan.ca/

Internet use: Selected country comparisonInternet use: Selected country comparison

Proportion of individuals using the Internet, 2005

54%

58%

63%

68%

69%

70%

74%

85%

50% 75%

European Union (25)

European Union (15)

Australia

Canada

Germany

U.K.

Finland

Sweden

CanadaCanada: Internet use higher in some provinces: Internet use higher in some provinces

B.C.B.C.69%69% Sask.Sask.

66%66%Alta. Alta. 71%71% Man. Man.

66%66% Ont. Ont. 72%72%

Que. Que. 62%62%

N.L. 55%N.L. 55%P.E.I. 61%P.E.I. 61%N.S. 67%N.S. 67%N.B. 57%N.B. 57%

Canada Canada 68%68%

Source: Statistics Canada, CIUS, 2005

Limitations and challengesLimitations and challenges

Manage response burden and costLimited room for new questions Balance core and supplementary contentBalance international requirements and evolving policy issues

Consider changes to target populationInclude younger age groups (16 years ?)Include the North

Secure funding from partnersMaintain relationship with policy communityMaintain relevance of survey

Measurement issues and lessons for developing countriesMeasurement issues and lessons for developing countries…If you don’t know where you are, a map won’t help

Information Society measuresmust be demand-driven

should contribute to the development of policy which ensures that all persons are empowered to use ICT to access, create and share information for their economic, social and cultural development

should shed light on the impact of ICT on human development and the barriers that prevent wider participation by society

should be internationally comparable, but must also meet national priorities for policy-making and planning

should be aligned when possible with international definitions and standards

Development of surveys, content, and indicators requires close coordination and cooperation from all sectors (government, business and civil society)

Existing or administrative data (i.e. information on ICT infrastructure) should be complemented by data on use of ICT, which are generally obtained through surveys

ICT questions/modules should be added to existing multi-purpose or general household surveys (i.e. Labour Force Survey, Census of Population)

Use existing survey vehicles and social characteristicsStart with a small core set of key questions

Measurement issues and lessons for developing countriesMeasurement issues and lessons for developing countries

Survey design should be appropriate to the country circumstances(i.e. local context, culture, language)

Inclusion of older technologies (radio, television, telephone)Moving from collection of essential core indicators to more sophisticated one may not happen quicklyNeed to consider social factors that may create barriers to owning, accessing, and using ICT (illiteracy, language, social-cultural barriers, lack of skills, low income)Community access may play an important role in reducing technology divides


Survey frequency, reference period, recall period

Minimize sampling and non-sampling errorUse well designed samples of sufficient size to produce reliable dataCareful design and testing of questions and question sequenceTraining and evaluation of interviewersReduce non-response ratesReduce data entry, editing and processing errors

Collection techniquesFace-to-face interviews preferred to telephone or postal

Statistical unit, selection and weightingHouseholds, individuals or bothResponses should be weighted according to an independent estimated distribution of the population


Proportion of households witha radioa TVa fixed line telephonea mobile cellular telephonea computerInternet access at homeelectricity (reference indicator)

Proportion of individuals whoused a computer (any location) in the last 12 monthsused the Internet (any location) in the last 12 months

Basic core ICT indicators Basic core ICT indicators –– households & individualshouseholds & individuals

Basic core ICT indicators (continued)Basic core ICT indicators (continued)

Location of individual use of the Internet in the last 12 months

home, work, place of education, another person’s home, community/commercial Internet access facility, other

Internet activities by individuals in the last 12 monthsgetting information, communicating, purchasing or ordering goods and services, Internet banking, education or learning, dealing with government organisations/public authorities, leisure

Extended coreindividual use of mobile phone, frequency of access to Internethousehold connection type

3. Measuring demand for ICT

ICT access and usage by business and government

Measuring demand for ICTMeasuring demand for ICT

Survey of Electronic Commerce and Technology (SECT)

first cross-economy measures of e-commerce by a statistical office (data available for 2000-2005)

collects information about e-commerce and technology use by Canadian businesses and governments every year

design based on OECD definitions, model survey and needs of policy community in Canada

definitions focus on e-transactions, but do not address means of payment, methods of delivery

Key indicatorsemployer use of PC, email, Internet, Web siteemployee access to PC, email, Internetbuying and selling on-line (with or without on-line payment)value of sales over the Internet (with or without on-line payment)% sales B2B, % sales B2Cperceived benefits of conducting business over the Internete-business practicesopen-source softwarebarriers to buying, selling on-line

Key indicators by sector, employment size

Survey of Electronic Commerce and Technology (SECT)Survey of Electronic Commerce and Technology (SECT)

Survey developmentSurvey development

Survey content has evolved over many yearsreflects policies that affect Canadian people, business and governmentrelevance to priorities and policies of funding department (Industry Canada)comparability to international definitions and model (OECD)

E-business questions added in 2005 initially proposed by OECDquestions developed and tested by Statistics Canada and Industry Canada questions designed to capture the use of electronic business practices

Survey methodologySurvey methodology

Design4-page mandatory surveycovers both private and public sectors‘Section D’ reserved for new and emerging issues

Samplesample drawn from Business Register (BR)stratified across size and industry

– (70% overlap with previous sample)approximately 19,500 respondents

Target populationCanadian enterprises with some exclusions

– local governments

Data collectionData collection

Data collected at the enterprise leveltop of the hierarchy – ‘head office’enterprise company establishment location

Mail-out / mail-back survey

Follow-up done by fax and / or second mail-outquestions or problems handled by telephone

Response rate between 70-75% every year

Results published 15 weeks after end of reference period


Official release in The DailyHistorical time series, selected variablesApril 20, 2006 for reference year 2005


Special requests and tabulations

Micro-data made available to researchers for approved projects and analysis

Research and analysis Publications, presentations, posters, international conferences

– How B2B Sales Dominate e-Commerce– Broadband Internet: Removing the Speed Limit for Canadian Firms– ICT Use: Are Small Firms Catching Up?


Enterprise use of ICT, 2005 Enterprise use of ICT, 2005

81.6

38.343.4

7.3

99.6

82.5

15.2

94.9

0

20

40

60

80

100

120

Internet use Web site Onlinepurchasing

Online selling

Private sector Public sector

Source: Statistics Canada, SECT, 2005


Manage respondent burdenMinimize additions to contentKeep technical language simpleTarget appropriate person within the enterprise to complete survey

Changing content due to changing nature of technology Year over year comparisons more difficultSecure content and funding for ‘Section D’

Include indicators of outcomes and impacts

Maintain up-to-date sample universe (births, deaths, changes)

Secure funding from Industry CanadaMaintain relationship with policy departmentMaintain relevance of survey


Use of existing industry or sector surveys to add ICT questions

Need for business frame (register) if one does not already exist

Consider content and questions relevant to specific developing country circumstances

barriers to conducting e-commerce (technological infrastructure, low levels of income, lack of skills, training)emphasis on web searching and marketing applications (rather than purchasing and selling)government may introduce new technology, services or infrastructure to market before private industry

Basic core ICT indicators Basic core ICT indicators -- businessbusiness

Proportion of businesses using computersusing the Internetwith a Web presencewith an Intranetreceiving orders over the Internetplacing orders over the Internetelectricity (reference indicator)

Proportion of employeesusing computers using the Internet

Extended core ICT indicators Extended core ICT indicators -- businessbusiness

Proportion of businesses

using the Internet by type of connectionwith a Local Area Networkwith an Extranetusing the Internet by type of activity

– sending and receiving email– getting information– Internet banking or accessing other financial services– dealing with government organizations– providing customer services – delivering products online

4. Measuring supply of ICT

The ICT sector

Supply of ICTSupply of ICT

In 1998, OECD member countries reached an important consensus on an industry-based definition of the ICT sector, under work carried out by the WPIIS

ICT sector industries drawn from the International Standard Industrial Classification (ISIC, Rev.3)concordances developed between ISIC and the industry classification standards used in Canada (NAICS)ICT sector definition provided a statistical framework for international comparisonsICT sector definition to change due to ISIC revisions

Supply of ICT: ManufacturingSupply of ICT: Manufacturing

NAICS-based ICT sector industries

Commercial and service industry machineryComputer and peripheral equipment Telephone apparatusRadio and television broadcasting and wireless communications equipment Audio and video equipmentSemiconductor and other electronic componentsNavigational, measuring, medical, and control instrumentationCommunication and energy wire and cable

Supply of ICT: ServicesSupply of ICT: Services

Software publishers Telecommunications (wired, wireless, resellers, satellite, other)Cable and other program distributionInternet service providersWeb search portalsData processing, hosting and related services Computer systems design and related services Electronic and precision equipment repair and maintenance Computer, computer peripheral and pre-packaged software , wholesaler-distributors Electronic components, navigational and communications equipment and supplies, wholesaler-distributorsOffice and store machinery and equipment, wholesaler-distributors Office machinery and equipment rental and leasing

Measuring the ICT sectorMeasuring the ICT sector

Integration of data from many divisions, sources

Combination of industry and economy-wide surveys

Industry telecommunications servicescable computer services Internet service providersICT manufacturing

Economy-wide Survey of Employment, Payrolls and Hours National AccountsTrade statistics

Measuring the ICT sectorMeasuring the ICT sector

Key indicatorsproductionemploymentinternational tradecapital expendituresrevenuesexpenditures on research and development

Annual and national statistics for the ICT sector aggregate

Sub-annual and sub-national statistics available for some individual ICT sector industries

Value of ICT sector statisticsestablished statistical infrastructure (NAICS, ICT sector)national and international comparability (OECD, ITU, core indicators)leading benchmark data for policy makers, industry



First quantification of Canada’s ICT sector in Networked Canada : Beyond the Information Highway (56-504)

Information and Communications Technology in Canada : A Statistical Profile of the ICT sector (56-506)

Canada’s Journey to an Information Society (56-508)

www.strategis.ic.gc.ca

www.oecd.org


http://www.strategis.ic.gc.ca/

http://www.oecd.org/

Indexed GDP, 1999Indexed GDP, 1999--2005 (1999=100)2005 (1999=100)

100

105

110

115

120

125

130

135

1999 2000 2001 2002 2003 2004 2005

ICT sectorICT sector

Business sectorBusiness sector

Total economyTotal economy

Source: Industry Measures & Analysis Division, CANSIM Tables 379Source: Industry Measures & Analysis Division, CANSIM Tables 379--0017, 3790017, 379--00200020

Indexed ICT sector GDP, 1999Indexed ICT sector GDP, 1999--2005 (1999=100) 2005 (1999=100)

50

70

90

110

130

150

170

1999 2000 2001 2002 2003 2004 2005

ICT manufacturingICT manufacturing

ICT servicesICT services

Source: Industry Measures & Analysis Division, CANSIM Table 379Source: Industry Measures & Analysis Division, CANSIM Table 379--00200020

What about ICT products?What about ICT products?

Need ICT product statistics to measure: International trade in ICT productsHousehold, business and government expenditures on ICT productsDomestic supply of and demand for ICT products

Need ICT product definitions and classificationsWork began in 1998, but difficulties associated with rapidly changing nature of ICT goods and services and dated commodity classifications (i.e. UN’s Central Product Classification)

ICT goods classification agreed by OECD in 2003, but currently under revisionICT services classification agreed in 2006


Timeliness, coordination and dissemination

Revisions to classifications, definitionsICT sector, ICT goods, ICT services

Convergence and advances in technology

Increased role for statistical agencies to provide data and indicators to monitor progress


Issues for ICT supplyConcordance between ISIC and other industry classificationsConfidentiality (telecommunications, ISP)Technological ‘leap-frogging’ (i.e. mobile telephony)Imports vs. local manufacturing

Data reporting for ICT sector aggregates may be more feasible (ICT manufacturing and ICT services)

Measures for ICT products should include radio and television

Basic core ICT indicators Basic core ICT indicators –– ICT sectorICT sector

Proportion of total business sector workforce involved in the ICT sector

Value added in the ICT sector (as a % of total business sector value added)

ICT goods imports as a % of total imports

ICT goods exports as a % of total exports

Core ICT indicators Core ICT indicators –– infrastructure & accessinfrastructure & access

Radio sets per 100 inhabitants

Television sets per 100 inhabitants

Fixed telephone lines per 100 inhabitants

Mobile cellular subscribers per 100 inhabitants% of population covered by mobile cellular telephonyMobile cellular tariffs (100 minutes of use per month)

Computers per 100 inhabitants

Internet subscribers per 100 inhabitantsBroadband subscribersInternational Internet bandwidthInternet access tariffs (20 hours per month)

% of localities with public Internet access centresby number of inhabitants (rural/urban)

5. Coordination, analysis and dissemination

Analysis and dissemination Analysis and dissemination –– telling the storytelling the story

Indicators of ICT supply and demandNetworked Canada: Beyond the Information HighwayCanada’s Journey to an Information SocietyThe Daily http://www.statcan.ca/english/dai-quo/Summary statistics (Canadian Statistics) http://www40.statcan.ca/l01/ind01/l3_2256_3817.htm?hili_none

Research and analytical work published in Statistics Canada’s Connectedness Serieshttp://www.statcan.ca/cgi-bin/downpub/listpub.cgi?catno=56F0004MIE

Our Lives in Digital TimesThe Internet: Is It Changing the Way Canadians Spend Their Time?Literacy and Digital Technologies: Linkages and OutcomesUnveiling the Digital Divide

http://www.statcan.ca/english/dai-quo/

http://www40.statcan.ca/l01/ind01/l3_2256_3817.htm?hili_none

http://www.statcan.ca/cgi-bin/downpub/listpub.cgi?catno=56F0004MIE

Coordination and development Coordination and development

World Summits on the Information SocietyPhase 1: Geneva, Switzerland (December 2003)Phase 2: Tunis, Tunisia (November 2005)

Partnership on Measuring ICT for Development

UN regional commissions

Regional institutions (OSILAC, ICA)

OECD Guide to Measuring the Information Society

International, regional, national meetings, workshops, conferences

Capacity building, training, outreach

Data integration and analysis (ITU, OECD, IDRC)

Partnership on Measuring ICT for DevelopmentPartnership on Measuring ICT for Development

Purposeto close ICT data gaps at the international level, and in particular in developing countries

PartnersOECD, ITU, UNCTAD, UIS, four UN Regional Commissions (UNECLAC, UNESCWA, UNESCAP and UNECA), the UN ICT Task Force, Eurostat and the World Bank

ObjectivesCore ICT indicatorsCapacity building in developing countriesInternational database on ICT indicators

Core list of ICT indicatorsCore list of ICT indicators

Infrastructure and access indicators

Access and use of ICTs by households and individuals

Access and use of ICTs by businesses

ICT sector and trade in ICT goods

http://measuring-ict.unctad.org

http://measuring-ict.unctad.org/

Draft Guide to Information Society MeasurementDraft Guide to Information Society Measurement

Purposeto document work of the OECD (WPIIS) and others in developing statistical standards for measuring the Information Society

Objectivesfacilitate improved harmonisation of practices and thus, international comparability, identify strengths and weaknesses, track progressassist newly participating countries to start or further developmeasurement programs

Scopecompilation of concepts, definitions, classifications and methods of Information Society measurement and analysis

Steps towards improved ICT indicatorsSteps towards improved ICT indicators

Assess current state of data holdings (i.e. existing surveys, resources, policy needs)

Assess needs and feasible options for collection of basic ICT measures

Consult with stakeholders to ensure coordination and cooperation (i.e. what are data needs of policy departments, ministry of education, telecommunications regulator)

Identify core indicators and relevant ICT questions/modules

Develop work plan for implementation, analysis and dissemination

National focus, regional initiatives and global linkages

Identifying the stakeholders and resources

Engaging the stakeholders

Balancing international harmonization with national policy relevance

The way forward and the larger context

Linkages, multiLinkages, multi--disciplinaritydisciplinarity and partnershipsand partnerships

ResourcesResources

http://measuring-ict.unctad.org

http://www.itu.int/wsis/

http://www.oecd.org/dataoecd/41/12/35654126.pdf

http://www.statcan.ca

http://measuring-ict.unctad.org/

http://www.itu.int/wsis/




http://www.statcan.cahttp://www.statcan.ca

Find statisticsPublications

Free Internet publications– Communications– Science & Technology

Understanding statisticsDefinitions, data sources and methods

Surveys and statistical programs Standard classificationsQuestionnaires


measuring the information society - cepal · pdf filesocio-economic outcomes and impacts of...

Documents