essnet on sdmx phase ii october 27 - 28, koln dario camol istat - italian national institute of...

ESSnet on SDMX phase II

October 27 - 28, Koln

Dario CamolISTAT - Italian National Institute of StatisticsDivision of Users’ Needs, Integration and Territory

Objectives of ESSnet on SDMX phase II

• Implementation of SDMX at international or national level;

• the further development of the SDMX technical standards used

for data and metadata;

• the further development of the SDMX Content-oriented

Guidelines;

• the further development and use of the SDMX service

infrastructure and IT tools;

• the increase of the SDMX capacity and knowledge.

SISAI ESSnet workshop

October 27 - 28, Koln

General information on ESSnet

Countries: Bulgaria, Italy, Slovak Republic and Sweden.

Coordinator: Italy.

Amount: 595,492 euro (70% contribution from EC).

Starting date: 28.03.2011

Duration: 18 Months.

WPs proposed: 4 Work packages + Management.

ESSnet workshop

October 27 - 28, Koln

Work packages presented

• WP1 - Management of the action (IT)

• WP2 - PC-Axis SDMX integration phase II (SE)

• WP3 - Support of SDMX application for Micro Data handling (SK)

• WP4 - Harmonization of existing SDMX tools (IT,BG)

• WP5 - Capacity building actions (IT)

ESSnet workshop

October 27 - 28, Koln

WP2 – PC-Axis SDMX integration phase II

Integration of the PC-Axis environment with SDMX

ESSnet workshop

October 27 - 28, Koln

The PC-Axis environment

A family of programs:

• PC-Axis/PX-Web

• PX-Edit

• PX-Make

• PX- Map

A network of members:

• 58 International members

• 17 Swedish members

ESSnet workshop

October 27 - 28, Koln

WP2 – PC-Axis SDMX integration phase II

Starting point (ESSnet phase I):

SDMX-RI

SQLDatabase

PC-AXIS Environment

ESSnet workshop

October 27 - 28, Koln

SDMX-RI

PC-AXIS Environment

WP2 – Activities and gantt

Activities:

o Test of the architecture already in place.

o Process description & diffusion of process.

o Further implementation:

• Add attributes at cell level (PX-Web),

• Implementation of a Generic SDMX data file for visualization (PX-

Web).

o Integration of the User Manual of the process with more types of

statistics.

ESSnet workshop

WP2 – Main deliverables and Progress reportESSnet workshop

Deliverables:

Software: a new version of PX-Web (.Net version).

Documentation: a more complete User’s Manual about the architecture.

Workshop: for Pc-Axis community and for other NSIs, in which will be

described the process and tools used (16-18 April 2012, the third day).

Progress report:

Testing the architecture.

October 27 - 28, Koln

WP3 – SDMX for Micro-data handling

Support the description and the export of Micro Data in SDMX format

ESSnet workshop

October 27 - 28, Koln

WP3 – SDMX for Micro-data handling

Starting point (ESSnet phase I): :

QuestionnaireMetadatabase

Questionnairedata

SDMX MetadataEditor E-Collect-X

Questionnaire definitionUser

RespondentUser

ESSnet workshop

October 27 - 28, Koln

WP3 – SDMX for Micro-data handling

QuestionnaireMetadatabase

Questionnairedata

MappingStore

DSD generator

DSD

SDMX-RI

SDMX Data Generator

Data Retriever

ESSnet workshop

SDMX-RI

MappingAssistant

October 27 - 28, Koln

Data retriever

Activities

o Development of “DSD generator”.

o Test of the tool with two pilot projects.

o Enhancement of E-Collect-X application with more complex calculations.

o Analysis of DDI vs SDMX standard.

WP3 – Activities and ganttESSnet workshop

October 27 - 28, Koln

WP3 – Main deliverables and Progress reportESSnet workshop

Deliverables

Software: “DSD generator” application and enhancement of E-Collect-X

Documentation:

• user and system documentation of “DSD generator”

• a report on the results of the pilot projects

• a report on the result of DDI vs SDMX analysis

Progress report

• Development in progress of the “DSD generator”.

• Enhancement in progress of the E-Collect-X functionalities.

• First study of DDI for Micro data handling.

October 27 - 28, Koln

WP4 – Harmonization of existing tools

Provide the necessary instruments to reuse some modules of SDMX-RI

Integration of the “Loader” application into the SDMX-RI framework

ESSnet workshop

October 27 - 28, Koln

Activities:

o Analysis of the source code of the modules: sdmx_model , sdmx_io, DataGenerator and QueryParser. (Italy .NET, Bulgaria Java)

o Realization of step-by-step tutorials on two examples that reuse some of the modules.

o Loader development: merge of two software modules from Istat SDMX framework (http://bms.istat.it/sodidownload) and to be integrated in the SDMX-RI framework. The merge will include:

• interaction with Mapping Store, • rewriting of the code in C#, • use of modules developed by Eurostat in order to guarantee coherence and maintainability.

WP4 – ActivitiesESSnet workshop

October 27 - 28, Koln

WP4 – Gantt and main deliverablesESSnet workshop

Deliverables

Documentation:

• A technical paper on the analysis of the modules of the SDMX-RI

(intermediate deliveries are scheduled according to the timetable

defined by Eurostat for the modification of the modules);

• Step-by-Step tutorials on two examples;

• Documentation about the Loader application

Software: Loader application.

October 27 - 28, Koln

Progress report (Bulgaria):

• Analysis of the documentation on the SDMX-RI.

• Start of the source code analysis about “sdmx_model” and “QueryParser“

modules and releasing of a first draft document.

Progress report (Italy):

• Development in progress of the first example and production of a draft

step-by-step tutorial.

• Start of the development of the second example.

• Release of a draft analysis document of the Loader application.

ESSnet workshop WP4 – Progress report

October 27 - 28, Koln

WP5 – Capacity Building

Increasing of knowledge on SDMX

ESSnet workshop

October 27 - 28, Koln

Activities

o Producing a Handbook on “How to use SDMX” for statisticians

o Workshop on SDMX based on the model of UNESWA (United Nation's Economic and Social Commission for Western Asia's) for IT staff and statisticians

WP5 – Activities and ganttESSnet workshop

October 27 - 28, Koln

WP5 – Main deliverables and Progress reportESSnet workshop

Progress report

• definition of the agenda of the workshop

• proposal for a skeleton of the Handbook

Deliverables

Documentation:

• A handbook on how to use SDMX

• Workshop documentation: agenda, slides, workshop user guide

Workshop: for all the EU countries (16-18 April 2012, the first and

second day)

October 27 - 28, Koln

Next activitiesESSnet workshop

WP2

Start the upgrade of the User’s Manual

WP3

Continue the development of the “DSD generator”

WP4

• Start the development of the first example (BG)

• Start the analysis of the source code of the “QueryParser”

module (IT)

WP5

Start the production of the Handbook

ESSnet workshop ESSNet web site

http://www.essnet-portal.eu/

October 27 - 28, Koln

ESSnet workshop ESSNet web site

October 27 - 28, Koln

ESSnet workshop ESSNet web site

October 27 - 28, Koln

ESSnet on SDMX phase II

October 27 - 28, Koln

Dario CamolISTAT - Italian National Institute of StatisticsDivision of Users’ Needs, Integration and Territory

Thank you…