kostat's experience in enabling an institutional environment for data integration · 2020. 12....

26
KOSTAT's Experience in Enabling an Institutional Environment for Data Integration UNESCAP Regional Workshop 2020 November 24, 2020 Administrative Data Management Division, Statistics Korea

Upload: others

Post on 22-Jan-2021

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

KOSTAT's Experience in Enabling an Institutional Environment

for Data Integration

UNESCAP Regional Workshop 2020November 24, 2020

Administrative Data Management Division, Statistics Korea

Page 2: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

Background01

Acquisition and Use of Administrative Data02

Collaboration with Data Provider04

Future Plans and Issues05

Protection of Privacy and Confidentiality 03

Page 3: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

Integrated Data

Administrative data assist surveys and replace some part

of the surveys (e.g., Statistical Business Registers to

replace business surveys)

Administrative Data

Administrative data are directly used to produce

statistics, replacing the existing programs (e.g.,

Register-based Census)

Survey Data

Traditional method for statistical data

through F/F, CAPI, Internet, etc.

New paradigm from surveys to administrative data

1. Background

1

Page 4: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

• Already available and cheap

• Growing demands for statistical data

• Improving the statistical programs

• Checking the quality of statistical

products

Survey DataAdministrative

Data

• Growing apathy / hostility to surveys

• Growing concern for response burden

• Budgetary constraints

• Growing need for protecting personal

information

1. Background

2

New paradigm from surveys to administrative data

Page 5: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

3

Using Pseudonymous Data

for Commercial Purpose

Personal Information

Protection Act

Transferred Privacy-related

Matters to Personal Information

Protection Act

Act on Information and

Communications Network

Using Pseudonymous Data

for Big Data Analysis

in Financial Sector

Credit Information Use

and Protection Act

1. Background

Favorable environment for Integrated Data

Page 6: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

Favorable environment for Integrated Data

4

Smart factory

Self-driving car

Digital governmentIntelligent CCTV

Fine dust reduction

Disease diagnosis and prediction

Data utilization and innovative service creation

Data Accumulation, Processing and Combination

Energy saving

Customized Asset Management

Data collection using 5G, IOT, Sensor, Robot, etc.

1. Background

Page 7: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

Data for statistical purposes may be drawn from all types of sources including surveys and administrative data

Use of Administrative Data is a Global Trend

1. Background

5

Page 8: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

The general precondition to use administrative data is LEGAL BASIS

UNECE

The preferred approach is for the NSI’s right of access to administrative data

to be enshrined in a general Statistics Act.

In any case the NSI should consider initiating and introducing changes to its

statistical legislation to ensure access is guaranteed by law.

2. Acquisition and Use of Administrative Data

6

Page 9: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

The general precondition to use administrative data is LEGAL BASIS

2018

Legal Framework (Statistics Act)

2007 2014 2015

2. Acquisition and Use of Administrative Data

7

Page 10: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

Establishing legal framework for using administrative data by amending Statistics Act

Preparing the Legal Basis for Acquiring and Using Administrative Data

Statistics Act Article 24 (2007)

→ Request for use of administrative data can be made for statistical purpose.

→ Head of public agency receiving such requests must supply administrative data unless there is a reasonable excuse.

→ The terms of provision of administrative data shall be decided based on consultation between two agencies.

→ The administrative data supplied by public agencies shall not be used for any purpose other than for the

collection of statistics nor shall it be supplied to other persons.

→ In cases of violation of the provisions, supply of data may be suspended or limited.

Statistics Act Article 24-2 (2014)

→ (Commissioner of Statistics Korea) is entitled to request access to Electronic Family Relations

Register Data and Criminal Data for statistical use.

Article 2-2 of the Enforcement Decree of Statistics Act (2015)

→ Can take a Census by using administrative data based on the Statistics Act Article 24

2. Acquisition and Use of Administrative Data

8

Page 11: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

Implementation of the law which allows the use of administrative data

prior to approval

Statistics Act Article 18 (2018)

→ The head of a statistics service agency shall judge in advance whether it is possible to produce statistics

by utilizing administrative data before he/she obtains approval for Production of Statistics.

Statistics Act Article 25 (2018)

→ Where relevant data are necessary for the production of designated statistics, the head of a central

administrative agency or local government shall judge in advance whether he/she may achieve the purpose

of producing designated statistics by utilizing administrative data provided pursuant to Article 24.

2. Acquisition and Use of Administrative Data

9

Establishing legal framework for using administrative data by amending Statistics Act

Page 12: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

Administrative data mediating system

NTS

Social Insurance Services

MOIS

National Pension Service

National Court

Data AcquisitionData loading, refinement and

DB construction (original data)

Administrative data were stored and processed

safely in the Integrated Management System

for administrative data

ON LINE

OFF LINE

Administrative DB

(Refined)

USB

External Hard Drive

CD

Data Holders

SAS,

SQL,

etc.

Data loading,

deleting duplications,

imputation, error

checking, encryption

2. Acquisition and Use of Administrative Data

10

Building Administrative DB after Refining & Securing Process

Page 13: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

Process of Database Establishing and Use

Integration

2. Acquisition and Use of Administrative Data

11

Producing various statistics by using administrative data

Page 14: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

2. Acquisition and Use of Administrative Data

12

Producing various statistics by using administrative data

Page 15: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

Alternative PINAddress

Address Business registration number

2. Acquisition and Use of Administrative Data

13

Producing various statistics by using administrative data

Page 16: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

2. Acquisition and Use of Administrative Data

14

Producing various statistics by using administrative data

Page 17: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

Physical measures for protection of privacy and confidentiality

Intranet system was designed and constructed to protect private

information and confidentiality

Administrative data were stored and processed safely in the

Integrated Management System For Administrative Data

3. Protection of Privacy and Confidentiality

15

Page 18: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

Encryption via I-Pin DI Generation Module

Mapping table of Encrypted DI Number and

Alternative PIN

Encrypted DI Number Alternative PIN

MC0GCCqGSIb3DQIJAyEAbDSAY…..Cw+3Li4ENiRKJhDHsZXXXXX= 123456789

MC0GCCqGSIb3DQIJAyEAu36eI/W…..DKJhI8pUqcN2SeRaXXXXX= 234567890

MC0GCCqGSIb3DQIJAyEAseIHV37…..ghViiONXgzIQdw8GXXXXX= 345678901

RRN* (cf. SSN),

FRN**

Checking

Errors

in RRN/FRN

Encrypting RRN/FRN

Using DI***

Generation Module

Alternative PIN

Transforming

Module

Encrypting personal information for data security

16

3. Protection of Privacy and Confidentiality

* RRN: Resident Registration Number

** FRN: Foreign Registration Number

*** DI: Duplication Information

Page 19: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

Masking data for protection of privacy and confidentiality

Personal identification numbers (PIN) were replaced to record

identification numbers

Existence of variables with text is reduced

17

3. Protection of Privacy and Confidentiality

Page 20: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

4. Collaboration with Data Provider

18

* KSIC: Korea Standard Industrial Classification

Page 21: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

Business

Category

Code

Korea

Standard

Industrial

Classification

4. Collaboration with Data Provider

19

Page 22: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

2009

2017

2019

4. Collaboration with Data Provider

20

Page 23: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

Result ofcollaboration

Result ofcollaboration

4. Collaboration with Data Provider

21

Page 24: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

5. Future Plans and Issues

22

Page 25: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

5. Future Plans and Issues

23

Page 26: KOSTAT's Experience in Enabling an Institutional Environment for Data Integration · 2020. 12. 17. · Building Administrative DB after Refining & Securing Process. Process of Database

THANK YOU