asg dama data governance

7/29/2019 ASG DAMA Data Governance

1/25

Copyright2010 Allen Systems Group, Inc.

www.asg.com

Metadata: The Critical Foundation for

Data GovernanceMay 17, 2013

www.asg.com

Copyright 2013 Allen Systems Group Inc. This document is unpublished and the foregoing notice is affixed to protect ASG in

the event of inadvertent publication. All rights reserved. No part of this document may be reproduced in any form, including

photocopying or transmission electronically to any computer, without prior written consent of ASG. The information contained

in this document is confidential and proprietary to ASG and may not be used or disclosed except as expressly authorized in

writing by ASG

Ravi ChivukulaDirector, Business Solutions


2/25


www.asg.com

Agenda

What Metadata is

Challenges with Data Governance

Features of Metadata that help address

Governance challenges

Types of Metadata and where it can be found

How to use Metadata to build an effective

Governance program

1


3/25


www.asg.com

What is Metadata?

Business Metadata

Business

Policies

Information

Policies

Business

Rules

Services

Service

Directory

Service

Users

Interfaces

Data Governance

Information

Usage

Information

Quality

Data Quality

SLAs

Access

Control

Information Architecture

Entity

Models

Relational

Tables

Master Object

Directory

Data Elements

Critical Data

Elements

Data Element

Definitions

Data

Formats

Aliases &

Synonyms

Reference Metadata

Conceptual

Domains

Value

Domains

Reference

Tables

Mappings

Business Definitions

Concepts Business

Terms

Definitions Semantics

Source: Master Data Management by David Loshin

I Dont Know What Metadata Is

But I Can Sure Tell When I See It !!

2


4/25


5/25


www.asg.com

Highly Complex Data Architectures

Data Warehouse

Acct

Sales

Mktg

CRM

HR

Operational

Data store

Reports

Analytics

Dashboards

Corporate

Visualization

Cross-Channel

Analysis

MDM Multi-platform Usage

E T L

Social Media

Cloud

4


6/25


www.asg.com

Source physical entitiesAnalyze physical entities

Develop Logical and

Conceptual entities

Map physical to Logical

and then to Conceptual

entities

Source Conceptual

mappings from LOB

Develop Enterprise

entities

Consolidate and map to

Enterprise entities

Identify Enterprise

entities for Governance

Identify Attributes of

governable entities

Identify governanable

attributes

LOB RepositoryEnterprise

Repository

Enterprise

Attributes

Metadata: Roadmap for Data Governance

5


7/25Copyright2010 Allen Systems Group, Inc.

www.asg.com

Devil maybe in the data, but sinful to ignore Rules!

Most Metadata is benign but Business rules are not!Business Rules manipulate your data when you are not looking!

Business Rules represent the collective thinking of the enterprise

Governance reaches full potential when it manages Business Rules

Legal Corporate IT Finance Analysts

RuleRule

Rule

RuleRule

Rule

RuleRule

Rule

RuleRule

Rule

RuleRule

Rule

Business rules is the metadata that glues your enterprise data6



www.asg.com

Analyze and Troubleshoot Issues

Business Glossary

/Conceptual layer

Enterprise Logical

layer

LOB/Application

Logical layer

Physical layer

Database schema

Upstream/Downstream

Data traceability

Enables robust

impact analysis at the

Enterprise level

7

Metadata Stack



www.asg.com

Business

Vocabulary

Data

Lineage

Root-cause

Anaysis.

History /

Versioning

Enterprise

Scale

Metadata

Regulatory Compliance

Data

Transparency

8



www.asg.com

Deep Dive

Into

Metadata



www.asg.com

Versions and Configurations

Versioning allows storingdifferent versions of an item,each displaying only thoseproperties and details about the

item that are relevant for aparticular context.

A Configuration is a set oflogically associated items (e.g.,the items pertaining to a

software application at differentdevelopment stages) and thusdefine particular views of theitems of a database.

10


12/25


13/25

www.asg.com 2013 Allen Systems Group, Inc.

Extended Data Lineage

OperationalSystem

StagingDatabase

OperationalSystem

OperationalSystem

Transform DataWarehouse

Transform

Data Mart Data Mart Data Mart

Report Report Report

A good lineage solutionwill allow this flow to bediagrammed, with userrecognizable names inthe boxes

12


14/25


Deeper Data Lineage

Transform

ApplicationCode

Implements

Process / Data Flow Process / Data Flow

BusinessProcess

Implemented By

Data Lineage can bevery complicated, andgovernance requires theability to dive deep intolineage

The flow may

not just be datait could be

messages in aqueuing system or

even businessprocesses

The flow may

be across manysystems and fromthe highest levelof abstraction to

the most granulardetail

13


15/25


Metadata Sources for Lineage

OperationalStores

ETLTechnology

Data

Warehouse /Data marts

ReportingTechnologies

Business TermsBusiness Process

Models

Data Models Applications

Traditional LineageDeep Lineage

14


16/25


Predominant Metadata Sources

DBMS's Modeling Tools

Transformation

Language ETL Tools BI Tools

DB2/UDB ARIS C/C++ Data Stage Business ObjectsGreenplum Casewise COBOL Informatica CognosMS SQL Server

Erwin JAVA SSIS SSAS/SSRS

OraclePowerDesigner

SQL / Stored

Procedures

Sybase Rational ToolsTeradata System Architect

15

Metadata Repository

ASG-Rochade / Business Glossary


17/25


The Components Of A ComprehensiveLineage Approach

DataModel

ProcessModel

DisplayModel

Lineage

Solution

16


18/25


A View Of A Core Data Model

Contains Concepts forbroad and deep lineage

Is technology agnostic

Connects naturally toother RepositoryInformation Modelconstructs

17


19/25


Build Knowledge Base

Basic Process Flow

Discover Capture

Lineage

(Where)

Impact

(How)

Rationalize

Analyze

Metadata Capture

18


20/25


Display Model

Visualization can be selected to Display only selected attributes

19


21/25


www.asg.com

A Look at Business Metadata

Data Model

Table

Column

Relationship

Attribute

Entity

Database

Business

Term

Concepts

Conceptual ModelRelationship

Attributes

Definitions

Contexts

Metrics/Standards

Process(App/ETL)

20


22/25


www.asg.com

How Does a Glossary help Governance

Unique number assigned

by the company

Password created by the

Customer/user

Identifier

Authentication

Unique number assigned

by the Govt.

Password created by the

Customer/user

Identifier

Authentication

Customer

Social

Security

Number

BUSINESS TERMS

Harmonization Through CollaborationThe collaborative platform exposes variances that impact semantic consistency

Governance Through Collaboration

A collaborative platform allows interested individuals to track those business terms,

data elements, concepts, and reference metadata that is relevant to your business

21


23/25


www.asg.com

Business Terms Help Lineage

Unique number

assigned by

the company

IdentifierCustomer

Data Element Type

First Name VARCHAR

Last Name VARCHAR

CustID VARCHAR

Start Date DATE

Data Element Type

First Name VARCHAR

Middle CHAR

Last Name VARCHAR

Customer_Id VARCHAR

Telephone VARCHAR

Multiple definitions for same term can be captured and

Shared through a central repository.

Discrepancies can be resolved through collaboration

22


24/25


An Integrated Wide RangingManagement Environment

140 + metadata sources (databases, languages, models, DW/BI tools)

Mainframe and distributed environments

Operational and Decision Support (BI/DW) environments

Higher level /Architectural metadata

ASG-Rochade

Business Terminology /Concepts

ASG-metaGlossary

Detailed/ Applicationmetadata

ASG-becubic

23


25/25

Copyright2010 Allen Systems Group Inc

www.asg.com

Questions

Thank You For Attending!!

Ravi Chivukula

Director, Business Solutions

Email: [email protected]

Tel: 817-652-6323

Carl Roberts

Senior Account ExecutiveEmail: [email protected]

Tel: 303-249-3607

24
mailto:[email protected]:[email protected]:[email protected]:[email protected]

asg dama data governance

Documents