real-world data governance: the role of meta-data in data governance

Copyright © 2012 – Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com

1


Real World Data Governance Webinar 2: The Role of Meta-Data in Data Governance

Monthly Webinar Series Hosted by Dataversity Robert S. Seiner – KIK Consulting / TDAN.com

February 16, 2012 – 2:00 p.m. EST

Robert S. Seiner KIK Consulting & Educational Services, LLC - KIKconsulting.com

The Data Administration Newsletter, LLC - TDAN.com


2

• Data Governance and Meta-Data share a very important relationship. As we heard in the previous “Real World Data Governance” webinar, meta-data stored in accessible artifacts becomes a valuable byproduct of a successful Data Governance program. But the relationship works the other way as well. The meta-data itself must be governed.

• Join Bob Seiner and DATAVERSITY for the second in a series of Data Governance webinars titled “Real World Data Governance” where Bob and a guest practitioner discuss:

1) the role that meta-data plays in a successful data governance program

2) the level of governance required to collect and deliver that meta-data.

Real-World Data Governance The Role of Meta-Data in Data Governance


3

• In this webinar, Bob will share examples of how data governance programs leverage meta-data from artifacts and their information management environments as well as the tactics required to manage and maintain that meta-data.



4

• Definitions: – Data Governance – Formalized Behavior Associated with Data

Execution and Enforcement of Authority Over the Management of Data and Data-Related Assets / Processes

– Data Stewardship – Accountability for Data

Formalized Accountability Over the Definition, Production and Use of Data and Data-Related Assets / Processes

– Meta-Data – Data About Data

Data, Recorded in IT tools, that Improves Business & Technical Understanding of Data and Data-Related Assets / Processes

4



5

• Regarding Meta-Data … Let’s Break the Mold

• What kind of meta-data are we talking about regarding Data Governance: – Data about who defines, produces and uses data – Data about where data is defined, produced and used through process – Data about how data is defined, produced and used – Data about what the rules are associated with the data – Data about when data can be copied, shared, retained, retired

• All of these types of meta-data were collected in the artifacts shared in the

last Real-World Data Governance webinar.

5



6

• It’s Like “Love and Marriage” – Two-Way Street – Can’t have one without the other

• Meta-Data is a By-Product of

a Data Governance Program.

• Meta-Data Itself has to be Governed.

6



7

• What Role does Meta-Data Play in a Data Governance Implementation? – Increases knowledge / understanding of data and data related assets – Increases formality of handling of data and data related assets – Improves quality / effective use of data related assets

• What Governance is required to manage that Data Governance Meta-Data?

– Meta-Data Stewards are required to Define, Produce and Use meta-data – Meta-Data must have a home, a place to go where people can access – Processes for Governance Meta-Data Definition, Production and Use

7



8

IT ASSETS

SYSTEM

DATA

NON-SYSTEM

DATA

IT ASSET MANAGEMENTMETA-DATA FRAMEWORK

STRUCTURED

DATA

UNSTRUCTURED

DATA

System Asset Data

Applications

Jobs/Procs

Programs/Scripts

Copybooks, ...

Database

Table Space

Table/View

Column

Index, …

Data Model

Entity

Attribute/Key

Domain

Valid Value, ...

Reporting Tool

Report/Query

Data/Logic

Distribution

Relationships between System

Infrastruct Data specified above.

Example: Database to Table to

Column

more … Inventory & Audit

Non-System Asset Data

Mainframe Hardware

Mainframe Software

Networks

Printers

Telephone

PC Hardware/Software

Technical Architecture

Mission/Vision

Best Practices

Policies

Standards

Procedures

Methodology

Configuration

People/Stewards

Locations

Timing/Dependencies

Business Rules

Metrics/Measurements

Relationships between Non-

System Infrastructure Data

specified above. Example: Method

to Procedure to Steward

more … Inventory & Audit

Structured Data

Resides in … “Data”

Databases/Tables/Columns

IT Data Management Tools

Business Technology Tools

Spreadsheets/Desktop Tools

Other

Unstructured Data

Resides in … “Artifacts”

Documents (Non Web-Based)

Content (Web-Based)

Desktop Tools

Video/Graphics/Video

Other

Relationships

Resides in … “Artifacts” if at all

Between Assets & the Data

Between System & Non-Sys Data

Within System & Non-System Data

Between Structured & Unstructured Data

Example: Applications (System Asset) to

Hardware (Non-System Asset),

Hardware to Software (Non-System Asset)

DATA GOVERNANCE FRAMEWORK

DATA GOVERNANCE FRAMEWORK

DA

TA

GO

VE

RN

AN

CE

FR

AM

EW

OR

KD

AT

A G

OV

ER

NA

NC

E F

RA

ME

WO

RK

RELATIONSHIPS

There are a lot of different

types of meta-data.

Need people to define,

produce, use the meta-data.

Need process to manage the

meta-data.

Need discipline to maintain the

meta-data.

8



9

• Traditional Meta-Data Categories: – Data Definition Meta-Data

• Data Modeling Tools • Database Catalogs • Data Dictionaries • Data Standards • Data Quality Tools • Business Rules, …

– Compliance Rules – Classification Rules – Privacy Rules – Security Rules – Handling Rules, …

9



10

• Traditional Meta-Data Categories: – Data Production Meta-Data

• Data Mappings Spreadsheets • Extract Transformation Load Tools, …

– Data Usage Meta-Data • Reporting Tools • Scheduling Tools • Report Catalog Tools • Ad-Hoc Reporting Tools • Ownership (?) / Stewardship • Accountability • Decision Rights or Authority • System of Record, …

10



11

• Tribal Knowledge Vs. Formal Knowledge

• Identify & Record the People that Have Responsibility for: – Defining the Data/Meta-Data Is Necessary to operate the Business

• Are they associated with a specific area of the organization? • Is there ever more than one person who has the responsibility? • How do you know who to contact with questions about:

– Origin – Validity – Location – Accessibility, …

• Just because you know who to contact, do other people? – Producing the Data/Meta-Data Is Necessary to operate the Business – Using the Data/Meta-Data that is Necessary to operate the Business

11



12


• Discussion Questions Regarding Data Governance Artifacts: – What Meta-Data is collected in this Artifact? – How can we use this Meta-Data to benefit the program? – What can’t we do if we don’t have this Meta-Data? – Who is responsible for this Meta-Data? – Where will we store this Meta-Data? – How will People Use / Access this meta-data? – Do we need Governance around the management of this meta-data?

• This information is a by-product and the results of the Stewardship aspect

of “Non-Invasive Data Governance”™.

12


13

Operational Level

Operational Data Stewards (existing)

Data Definers, Producers, Users

These people are presently defining,

producing and using data as part of their

jobs. Recording of the Operational Data

Stewards will be an important enabler of

improved communications, coordination

and cooperation among stewards.

Tactical Level

Data Domain Stewards

Per assigned Subject Areas

Data Steward Coordinators

One per Business Unit

Strategic Level

Data Governance CouncilData Governance Sponsors Group

or Group of similar participation. One person, plus

alternate, for each Business Unit represented & IT.

Consider financial services & human resources.

Executive Level

Data Steering CommitteeSenior-most level knowledge of the program.

Leverage existing business structure as possible.

If no structure exists, utilize an IT Steering Committee

or an executive founded board or council.

Operational Level - Business Unit Specific

Strategic -

Enterprise

Tactical Level - Cross Business Unit

Executive

“Non-Invasive Data Governance”™ Operating Modelof Roles & Responsibilities

Escalation / A

pproval Path

Copyright © 2009 - Robert S. Seiner - KIK Consulting & Educational Services, LLC - All Rights Reserved

Dat

a G

ove

rnan

ce P

rogra

m T

eam

(D

GPT)

IT S

ubje

ct R

esourc

e Exp

erts

Data Governance Program Team

Data Governance Team ManagerResponsible for Administering the Program,

facilitating use of the Data Governance Council,

communicating program components and value to the Organization.

Advisory assistance from other levels.

IT Subject Resource Experts

System/Data Resource ExpertsIT Staff including Application

Development, Data Design,

Security, and other Data

Resource Management.

Com

munication

KIK Consulting & Educational Services, LLC

EXISTS

EXISTS

EXIS

TS

NEW

LEVERAGE

NEW

Real-World Data Governance

The Role of Meta-Data in Data Governance


14



15



16



17



18



19


• Where Do We Start – Define Data Domains

• Customer Data

• Product Data

• Vendor Data

• Material Data

• Financial Data

• Human Resource Data

• Transaction Data

• Research Data

• Shared Data

19

• Note that this is a sample list that of what companies use.

• Beyond this they break the domains into “aspects of customer data”, “aspects of product data”, … very particular to each company.


20

• Where Do We Start – Define Meta-Data Domains

• Data Definition Meta-Data

• Data Production Meta-Data

• Data Usage Meta-Data

• Privacy, Security, Compliance Meta-Data

• Business Rule Meta-Data

• Hardware Meta-Data

• Software Meta-Data

• Technology Meta-Data

• Vendor Meta-Data

20

• Note that this is a sample list that of what companies use.

• Beyond this they break the domains into “aspects of data definition meta-data”, “aspects of data production meta-data”, … very particular to each company.



21

• Where Do We Start – Define Organization Units

• The Organizational Units can be pulled from an organizational chart or they can be determined by Company, Division, Department, Team, …

• If the Organizational Units are defined by the Company it is often left to the Company to determine how granular they want to get with their units.

• Insert Tools that are used by the Business Areas to house meta-data.

21



22

• How Do We Populate the Stakeholder of the CDM? – Naturally! That is the Non-Invasive way!

• By the Data / Meta-Data Steward Coordinator • Through project management • Through recall of past projects • Through existing committees &

working groups • Through existing tools, glossaries, dictionaries, SharePoint sites, …

22



23

• How Do We Populate the Stakeholder of the CDM? – Data / Meta-Data Steward Coordinator

• The Data / Meta-Data Steward Coordinator often has the responsibility of identifying the operational meta-data stewards for their business unit by meta-data domain.

• This may require the coordinator to research and inventory the data that is being defined, produced and used in their business unit.

• This requires that the domains of data are defined and documented to the level of detail that will enable the Data Steward Coordinator to complete this task.

23



24

• The Role of Meta-Data Stewards:

The Definition Meta-Data will not manage itself.

Meta-Data Definers: Responsible for Data Definition Meta-Data 2 Perspectives: 1. Someone has to Identify What Definition Meta-Data in Needed 2. Someone has to Provide the Definition Meta-Data Operational Data Stewards

The Definition of Meta-Data will not manage itself.

24



25


The Production Meta-Data will not manage itself.

Meta-Data Producers: Responsible for Data Production Meta-Data 2 Perspectives: 1. Someone has to Identify What Production Meta-Data in Needed 2. Someone has to Provide the Production Meta-Data Operational Data Stewards

The Production of Meta-Data will not manage itself.

25



26


The Usage Meta-Data will not manage itself.

Meta-Data Users: Responsible for Usage Data Meta-Data 2 Perspectives: 1. Someone has to Identify What Usage Meta-Data in Needed 2. Someone has to Provide the Usage Meta-Data Operational Data Stewards

The Usage of Meta-Data will not manage itself.

26



27

27



28

Fill in With Meta-Data Definition

Fill in With Meta-Data

Location

Fill in With Domain Specs

Meta-Data

Fill in With Steward

Responsibility

28



29

• Summary

– Real-World Data Governance

– Definitions / The Role of Meta-Data in Data Governance

– Meta-Data and Governance Framework

– Traditional Meta-Data Categories

– Non-Traditional Meta-Data Categories

– Meta-Data in Data Governance Artifacts

– Meta-Data Governance



30

Wrap Up & Discussion

• Real-World Data Governance – Scheduled Webinars

– March 15: Non-Invasive Data Governance – The Practical Approach

– Future Subjects:

– Data and Information Governance: Why the Distinction Matters

– The Data Governance Team: Placement, Size, Skills & Responsibilities

– Setting Appropriate Business Expectations for Data Governance

– Visit Dataversity.Net for More Information


31

Wrap Up & Discussion

Robert S. Seiner KIK Consulting & Educational Services – KIKconsulting.com The Data Administration Newsletter - TDAN.com Post Office Box 112571, Pittsburgh, Pennsylvania 15241 412.220.9643, 9644 (Fax) [email protected], [email protected]

real-world data governance: the role of meta-data in data governance

Technology

managementof data

useof data

process data

metadata plays

kind of metadata

types of metadata

data governance definitions

level of governance