Download - Modernization of official statistics Eric Hermouet Statistics Division, ESCAP [email protected]
Modernization Modernization of official statisticsof official statistics
Eric HermouetStatistics Division, ESCAP
Changing environmentChanging environment
The data deluge New competitors Changing user demand Economic pressure
2
The data delugeThe data deluge
3
The internethad 1800exabytes ofdata in 2011
exa = 10^18
The data delugeThe data deluge
4
50 000 exabytes by 2020
Even if 99.9% are videos, photos, audio files, text messages etc., that still leaves a huge amount of potentially relevant data
New competitorsNew competitors
Google:– Real-time price indices– Public Data Explorer– First point of reference for the “data generation”
Facebook, store cards, credit agencies, ...– What if they link their data?
Can they provide an alternative to population censuses?
5
Changing user demandsChanging user demands
Statistics made available faster Need to answer wider range of user
– Need to package data differently
Need for more detailed information Need for integrated data products
– Linking logically datasets from different sources
6
Response of official statistics communityResponse of official statistics community
Develop and promote new:
Sources Processes Products
High-Level Group for Strategic Directions in Business Architecture in Statistics (HLG-BAS)– Created by the Conference of European Statisticians in
2010– 9 heads of national and international statistical
organizations
Civil Registration and Vital Statistics7
8
The Challenges are too big for statistical organizations to tackle on their own.
We need to work together
Collaboration
Coordination
Communication
9
What is modernization?What is modernization?
Common processes Common tools Common methodologies Recognizing that all statistics are produced in a
similar way:
No domain is “special” Increased flexibility to adapt to new sources and
produce new outputs
10
Industry standardsIndustry standards
Generic Statistical Business Process Model
Generic Statistical Information Model
Statistical Data and Metadata eXchange
Data Documentation Initiative
11
GSBPM – The BackgroundGSBPM – The Background
Statistical production has traditionally been organised by topic, e.g. transport, trade, …
Some statistical organisations are moving towards a process-based approach
12
GSBPM: Why do we need a model?GSBPM: Why do we need a model?
To define and describe statistical processes in a coherent way
To standardize process terminology To compare and benchmark processes within and
between organisations To identify synergies between processes To inform decisions on systems architectures and
organisation of resources
13
GSBPM: ApplicabilityGSBPM: Applicability
All activities undertaken by producers of official statistics which result in data outputs
National and international statistical organisations Independent of data source, can be used for:
– Surveys / censuses– Administrative sources / register-based statistics– Mixed sources
14
15
Key features of GSBPMKey features of GSBPM
Not a linear model Sub-processes do not have to be followed in a
strict order It is a matrix, through which there are many
possible paths, including iterative loops within and between phases
Some iterations of a regular process may skip certain sub-processes
16
Other uses of the GSBPMOther uses of the GSBPM
Harmonizing statistical computing systems Facilitating sharing of statistical software Framework for process quality management Structure for storage of documents Measuring operational costs
18
GSIMGSIM
The Generic Statistical Information Model is a reference framework of information objects, which enables generic descriptions of data and metadata definition, management, and use throughout the statistical production
process
Another model is needed to describe data and metadata objects and flows within the statistical business process
19
GSIMGSIM
Provide a common reference model for statistical information
Define the information required to drive statistical production processes and define outputs
Facilitate building efficient metadata driven collection, processing, and dissemination systems
20
Civil Registration and Vital Statistics21
Leads to a modular approach in designing software
Plug and play tools
Related ESCAP activitiesRelated ESCAP activities
EGM in June 2011 SIAP Management Seminar in December 2011 Moscow workshop, April 2012
On the agenda of the upcoming Committee on Statistics, December 2012
http://www.unescap.org/stat/MSIS/index.asp
Civil Registration and Vital Statistics22
Further informationFurther information
GSBPM– http://www1.unece.org/stat/platform/display/metis/The+
Generic+Statistical+Business+Process+Model
GSIM– http://www1.unece.org/stat/platform/display/metis/Gene
ric+Statistical+Information+Model+(GSIM)
HLG-BAS– http://www1.unece.org/stat/platform/display/hlgbas
23
THANK YOU.
Questions?
Civil Registration and Vital Statistics24