implementing ess standards for reference metadata and quality reporting at istat
Post on 24-Feb-2016
45 Views
Preview:
DESCRIPTION
TRANSCRIPT
Implementing ESS standards for reference metadata and quality reporting at Istat
Work Session on Statistical MetadataTopic (i): Metadata standards and models
Giorgia Simeoni, IstatUnit «Quality, audit and harmonisation»simeoni@istat.it
6 May 2013
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
Contents
1. Project background
2. SIDI/SIQual architecture and contents
3. ESS standards for reference metadata and quality reporting
4. Project objectives and outline
5. The quality reports subsystem design
2
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
Project background
ESS reference metadata and quality reporting conceptual harmonisation: - Euro-SDMX Metadata Structure (ESMS)- ESS Standard for Quality Reports Structure (ESQRS)
National implementation in progresssupported by SDMX compliant IT tools (Metadata Handler)
SIDI/SIQual - Istat official system for reference metadata and quality indicators documentation – includes a lot of information required from ESMS and ESQRS
3
Project: to enhance SIDI/SIQual in order to produce ESS standard metadata files and quality reports in compliance with SDMX technical standards
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
Istat official information system for documenting quality and reference metadata of the statistical production processes
SIDI «input» system, SIQual for consultation
SIDI first implementation in 2001, later converted in a web-based architecture
SIQual first release in 2005, English version released in 2008
SIDI/SIQual is the reference metadata component of the Unified System of Metadata currently under development at Istat
SIDI/SIQual
4
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
SIDI/SIQual architecture
Quality indicatorsReference metadata
Staff Management
ETL
Quality indicators
Reference metadata
Reference metadata
SIDI
SIQual internet
SIQual intranet
National Statistical
ProgrammeManagement
metadata
DARC(Administrative
archive)
Dissemination website
IT Application Catalogue
ARMIDA(Validated microdata)
Input GUI
Quality reporting
Process quality report
Product quality report
Short method. note
5
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
CONCEPTUAL METADATAThemesUnits….
SIDI/SIQual contents
6
OPERATIONSPhases Operations Sub-operations
GENERALISED SOFTWARE Phases Software QUALITY CONTROL ACTIONS
Phase/Non sampling ErrorsPreventingMonitoring Evaluating
IN-DEPTH DOCUMENTATION:Sampling design Index production methodology…
STANDARD QUALITY INDICATORSProcess orientedProduct oriented
DOCUMENTS REPOSITORYRegulations, ManualsQuestionnairesDocuments (field operations, methods, standards, …)
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
ESS standards for reference metadata and quality reporting
7
Euro SDMX Metadata StructureConcept Name Concept Name Concept Name
1 Contact 7 Confidentiality 15 Timeliness and punctuality 1.1 Contact organisation 7.1 Confidentiality - policy 15.1 Timeliness
1.2 Contact organisation unit 7.2 Confidentiality - data treatment 15.2 Punctuality
1.3 Contact name 8 Release policy 16 Comparability1.4 Contact person function 8.1 Release calendar 16.1 Comparability - geographical
1.5 Contact mail address 8.2 Release calendar access 16.2 Comparability - over time
1.6 Contact email address 8.3 User access 17 Coherence1.7 Contact phone number 9 Frequency of dissemination 17.1 Coherence - cross domain1.8 Contact fax number 10 Dissemination format 17.2 Coherence - internal
2 Metadata update 10.1 News release 18 Cost and burden 2.1 Metadata last certified 10.2 Publications 19 Data revision2.2 Metadata last posted 10.3 On-line database 19.1 Data revision - policy
2.3 Metadata last update 10.4 Micro-data access 19.2 Data revision - practice
3 Statistical presentation 10.5 Other 20 Statistical processing3.1 Data description 11 Accessibility of documentation 20.1 Source data
3.2 Classification system 11.1 Documentation on methodology 20.2 Frequency of data collection
3.3 Sector coverage 11.2 Quality documentation 20.3 Data collection
3.4 Statistical concepts and definitions 12 Quality management 20.4 Data validation
3.5 Statistical unit 12.1 Quality assurance 20.5 Data compilation
3.6 Statistical population 12.2 Quality assessment 20.6 Adjustment
3.7 Reference area 13 Relevance 21 Comment3.8 Time coverage 13.1 User needs
3.9 Base period 13.2 User satisfaction
4 Unit of measure 13.3 Completeness
5 Reference period 14 Accuracy and reliability6 Institutional mandate 14.1 Overall accuracy
6.1 Legal acts and other agreements 14.2 Sampling error
6.2 Data sharing 14.3 Non-sampling error
ESMS Example
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
ESS standards for reference metadata and quality reporting
8
ESS Standard for Quality Reports Structure
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
Project:• Enhancing SIDI/SIQual in order to be compliant with the ESS conceptual
and technical standards for reference metadata files and quality reports.
Frameworks:• Istat multi-year innovation strategy Stat2015• Eurostat Grant co-funding “Implementing the SDMX Istat strategy”
Organisation:• Start: second half of December 2012• Duration: for 2 years• Main phases:
1. The design phase. Main output expected: the document of requirements for the SIDI/SIQual enhancement (6 months devoted);
2. The software development, including requirement analysis, detailed design, realisation and test (1 year devoted)
3. The implementation process, the first metadata files and quality reports will be produced via the new subsystem
9
Project objectives and outline
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
Main advantages:
10
Project objectives and outline
Exploit the already available information
Reduce reporting burden for survey managers
Avoid inconsistencies in metadata and quality reporting
Improve the metadata asset
Enhance internal system to be compliant to international technical standards
Facilitate next re-use
Improve internal coordination, harmonisation and centralised monitoring
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
1.The design phase: four steps to collect requirements
The first step: mapping between ESMS and ESQRS and SIDI/SIQual contents- Based on standard ESS Guidelines- Exercise of compilation from SIDI/SIQual
11
Project objectives and outline
Example for ESMS concept «Statistical Unit»
ESMS SIDI
Concept Name
Concept Code Descriptions Represen
tation ESS Guidelines Sidi concept, if available SQL Query Output example
(LFS)
3,5 Statistical unit STAT_UNIT
Entity for which information is sought and
for which statistics are ultimately compiled.
Text
List the basic units of statistical observation for which data are
provided. These observation units (e.g. the enterprise, the local
unit, private households,...) can be different from the reporting units used in the underlying
statistical surveys.
Observation units
select R3_T_UN_STAT.NOME_UNITA_ENG from r6_indagine, r3_t_un_stat, r17_ind_t_ust where R3_T_UN_STAT.CODICE_UNIT_STTSTC=R17_IND_T_UST.CODICE_UNIT_STTSTC and r6_indagine.codice_indagine=r17_ind_t_ust.codice_indagine and R17_IND_T_UST.TIPO_UNITA_STATISTICA in (2,3,4,5,7,8) and r6_indagine.codice_indagine="Survey_code"
Persons, Persons aged 15
and over
ESMS SIDI
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
1.The design phase
The second step: analysis of National Reference Metadata Editor (NRME) functionalities, available Metadata Structure Definitions, already filled in metadata files and quality reports
12
Project objectives and outline
Main inputs obtained:
- «Input» compliance with SDMX artifacts and concepts is needed
- Functionalities to be implemented to support compilation (e.g: copy of a previous edition, re-use of single items, …)
- …
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
1.The design phase
The second step: analysis of NRME functionalities, available Metadata Structure Definitions, already filled in metadata files and quality reports
13
Project objectives and outline
Difficulties: two levels “Domain” customisation
1. At Metadata Structure Definition level: introduction of Domain specific concepts Example
This case can be managed through a more generalised software implementation, that will also facilitate the software reuse and higher its flexibility for changing requirements
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
1.The design phase
The second step: analysis of NRME functionalities, available Metadata Structure Definitions, already filled in metadata files and quality reports
14
Project objectives and outline
Difficulties: two levels “Domain” customisation
2. Within sub-concept level: introduction of different html tables in different domains
10.2. Dissemination format - Publications 10.2. Dissemination format - Publications
Dissemination at national level
Dissemination at national level : publications
Reference year
Statistical yearbook
Thematic publications
XXXX
XXXX
For XXXX, please report any scheduled action plan, specifying the implementation date.
Name of national paper publications
Text
Name of national electronic dissemination
Text
Example
The solution to this issue is still under evaluation, suggestions?
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
1.The design phase
The third step: involvement of stakeholders
• At national level• Contacts with Eurostat
The fourth step: drafting the requirements’ document
15
Project objectives and outline
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
2. The software development:• Design by Istat IT experts• Realisation outsourced
3. The implementation process:• Under definition a proposal for the governance to be then approved by the
top management• The production of metadata files and quality reports with the new
subsystem should be centrally supported
16
Project objectives and outline
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
Quality reporting subsystem building blocks
17
SIDI Reference Metadata & Quality indicators DB
SIDI Metadata & quality indicators
GUI
Enhancement for ESMS/ESQRS contents not
included (1)
GUI Enhancement (1)
Enhancement to be compliant to SDMX
artifacts (3)
GUI for metadata files compilation (4)
Euro-SDMX registry
SDMX Metadata set (5)
Eurostat (NRME or EDAMIS)
WS (8)
SEP
ETL Web Browser
SIQual (8)
GUI template management (7)
Pulling out procedures (2)
SDMX artifacts import
functionalities (6)
Quality reports (8)
Implementing ESS standards for reference metadata and quality reporting at IstatGiorgia Simeoni – Geneva, 6 May 2013
Thank you for your attention!
Comments and suggestions are welcome
simeoni@istat.it
18
top related