Corporate Data Model (CDM)

Underlying principle: 4 datastores

1. INPUT - raw data

2. CLEAN UNIT - cleaned data

3. AGGREGATE - aggregated data

4. DISSIMINATION - published data

CDM was seen as ≈ active DWH

Corporate Data Model (CDM)

Main characteristics:• All (statistical) processes must use the

4 datastores• Processing systems interact on the data stores• At some moments: snap shots,

which build next data store• It is possible to work further on the same

(snap shotted) data store• Simultanious updating of / on data

is mainly organisational issue

Corporate Data Model CSO - Ireland

INPUTCLEANED

DATASETSAGGREGATEDATASETS DISSEMINATION

DATA

MANAGEMENT

STORE

ADMINISTRATIVE

DATA CENTRE

2 OPERATIONALIMPLEMENTATIONS

Surveys

Admin data

Data Management Store (DMS)• First implementation of CDM• Mainly survey data• Data tables are created and populated through

the DMS applications.• Metadata must be entered as the data tables

are created.• Metadata capturing = minimal

bottleneck• BR outside DMS (stand alone)

Corporate Data Model CSO - Ireland

DA

TA

C

OL

LE

CT

ION

A

CT

IVIT

IES

INPUTCLEANED

DATASETSAGGREGATEDATASETS DISSEMINATION

D

M

S

APP – layer, incl. I/O interfaces

DMS meta layer – Basic descriptions

SHAREDINPUT

SHAREDCLEANED UNIT

AGGREGATESTORE

SNAPSHOTS

B

I

SYS 1

SYS 2

SYS n

Mainly surveys

Administrative Data Centre (ADC)• Developed for organisational reasons• Only Admin data• A catalyst to exploit administrative data for

statistical purposes• Interface with public authorities on admin data

flows to CSO• Clearing house inside CSO for admin data• Data governance with respect to admin data

Administrative Data Centre (ADC)• Has analysis layer• R&D on available data• To develop new datasets• Without specific needs / demands

from statistics

Corporate Data Model CSO - Ireland

INPUTCLEANED

DATASETSAGGREGATEDATASETS DISSEMINATION

A

D

C

ADC meta layer

B

I

SYS 1

SYS 2

SYS n

DA

TA

C

OL

LE

CT

ION

A

CT

IVIT

IES

SOURCES DataProducts

E

T

L

ADC

Front

Door

LEAN INTERFACE

Only Admin Data

Corporate Data Model CSO - Ireland

DA

TA

C

OL

LE

CT

ION

A

CT

IVIT

IES

INPUTCLEANED

DATASETSAGGREGATEDATASETS DISSEMINATION

D

M

S

A

D

C

APP – layer, incl. I/O interfaces

DMS meta layer – Basic descriptions

ADC meta layer

SHAREDINPUT

SHAREDCLEANED UNIT

AGGREGATESTORE

SNAPSHOTS

B

I

SYS 1

SYS 2

SYS n

DA

TA

C

OL

LE

CT

ION

A

CT

IVIT

IES

SOURCESData

Products

E

T

L

ADC

Front

Door

LEAN INTERFACE