dama international symposium san diego ca 03-17-2008

© 2008 RCG IT, DAMA & Wilshire Conferences. All rights reserved.

Enterprise Information Enterprise Information Management [EIM] Management [EIM] ––

Proven Techniques For Proven Techniques For SuccessSuccess

Robert J. Abate, CBIPGlobal Managing Principal, RCG ITGlobal Managing Principal, RCG IT

Monday, March 17 th, 2008 5PM – 6PM

AgendaAgenda

Presentation TopicsPresentation Topics

EndEnd--ToTo--End Data Management [EIM]End Data Management [EIM]

Requires A Integration ArchitectureRequires A Integration Architecture

Integrating Governance & QualityIntegrating Governance & Quality

Proven Techniques For SuccessProven Techniques For Success

Key TakeKey Take--AwaysAways



EndEnd--ToTo--End Data End Data

Management [EIM]Management [EIM]Robert J. Abate, CBIP

Global Managing Principal, RCG ITGlobal Managing Principal, RCG IT


RCG INFORMATION TECHNOLOGYRCG INFORMATION TECHNOLOGY

© 2008 RCG IT, DAMA & Wilshire Conferences. All rights reserved.4

What Is Enterprise Information Management?

�� Intersection Of Strategy, Architecture & Delivery O f InfoIntersection Of Strategy, Architecture & Delivery O f Info

� It Is A Managed Information Environment (with End – To – End Data Management) Incorporating:

� Where Data Is Known To Be Of High Quality

� Information Is Wrapped With (Or Having) Governance

� Contain A Single Source Of Truth

� Flexible Structure or “Architecture”

� Responsive To Change

� Supportive Of Integration And Delivery Of Informati on

�� A flexible structure is important because:A flexible structure is important because:

� Business needs are changing at an accelerating pace

� It is the core feature that allows IT to be responsive in meeting new business requirements



The Information Foundation: Data Management

This requires:This requires:

�� Metadata managementMetadata management for compliance enforcement, audit support, for compliance enforcement, audit support, analysis, and reportinganalysis, and reporting

�� Master dataMaster data integration and controlintegration and control

�� NearNear--real timereal time business informationbusiness information

�� Source data managementSource data management for controlling data quality at the for controlling data quality at the transaction leveltransaction level

�� Effective governanceEffective governance for a successful managed data environmentfor a successful managed data environment

�� IntegrationIntegration of analytics, reporting, and transaction controlof analytics, reporting, and transaction control

�� ControlControl of business processes and information usageof business processes and information usage

�� Unstructured dataUnstructured data needs to be addressed as wellneeds to be addressed as well

The role of data management in the business is evol ving from“A Single Source Of Truth” to becoming

“The Information Assurance And Delivery Mechanism”



How Do You Build One?

�� Flexible Reference / Data ArchitectureFlexible Reference / Data Architecture�� Controlled Data LifecycleControlled Data Lifecycle�� Metadata / Information TaxonomyMetadata / Information Taxonomy�� Master Data ManagementMaster Data Management�� ModelModel --Driven DevelopmentDriven Development�� Data Integration ToolsData Integration Tools

� Extraction, Transformation & Loading [ETL]� Data Delivery Services

�� Information DeliveryInformation Delivery� Reporting & Analytics� Security

�� Dimensional Models (Data Warehouse)Dimensional Models (Data Warehouse)� Conformed Dimensions

�� Data GovernanceData Governance�� Data QualityData Quality

� Data Profiling� Exception Handling

Action Time

Valu

e L

ost

Action Time

Valu

e L

ost

Time

Value

Action

Business Event

Taken

Business Event

Taken

Capture Latency

AnalysisLatency

Decision Latency

Data Ready For Analysis

Information Delivered

Capture Latency

AnalysisLatency

Decision Latency



© Chart: Richard Hackathorn, Bolder Technology, Inc. , 2007. All Rights Reserved. Used with Permission.

DataSources

Finance

XLS

POS

ERP

SCM

ERP

Transaction Level DetailGranularDenormalizedIntegratedCurrent & History

ReportingTransaction Level DetailGranularDenormalizedIntegratedCurrent & History

Reporting

Metadata

(Extract/Transform/Load)-- Apply business rules-- Manage metadata-- Consolidate data

ETL / DataIntegration Hub

Transaction Level Detail‘Atomic’-level DataNormalized (3NF)IntegratedTemporary

Integration

Aggregates & KPIsDimensionalDrilling Conformed

Analytics

ETLServer

Dashboards

Predictive & BehavioralAnalytics

Reporting & Ad hoc Queries

DatabaseServer Reporting

Server / Portal

Scoring

Algorithms

Metadata Inquiries

Others

A “permanent” Integration Data Store can facilitate data conversions and system upgrades because it contains data already standardized, cleansed, and integrated.

**

Data DeliveryEnterprise Data



What Is A Flexible Architecture?

�� Definition of a flexible architecture Definition of a flexible architecture (from Dictionary.com)(from Dictionary.com)::�� Architecture:Architecture: “Orderly arrangement of parts; structure”

�� Flexibility:Flexibility: “Responsive to change; adaptable”

�� Responsive:Responsive: “readily reacting to events or stimuli”

�� Therefore, a flexible architecture is one that is:Therefore, a flexible architecture is one that is:� Readily adaptable to events or stimuli that require i t to change

� Designed to provide the key capabilities necessary f or BI today

�� And an inflexible architecture is one that is:And an inflexible architecture is one that is:� Hard or time-consuming to change

� Unable to incorporate new capabilities when needed



Partner with the Business: Focus on Impacting the Bottom Line

Operational BIStrategic BI

Simple metrics: • Customer satisfaction• Inventory turns• Quality measurement• Financial reporting

Dashboard with metrics:• Customer profitability• Product profitability• Operational performance

Performance ManagementPerformance Management

Performance OptimizationPerformance Optimization

Complex metrics:• Market success• Customer relationship• Information innovation• Value creation

Value to the

Corporate

Bottom Line

These inform different kinds of decisions at different levels of the organization

OperationalReporting& Analysis



Best Practices & Trends…

�� Separation of Architectural Layers using Separation of Architectural Layers using Reference Reference

ArchitecturesArchitectures ((““ akaaka”” Architectural FrameworksArchitectural Frameworks ))

�� Model Driven Development [MDD] Model Driven Development [MDD] with a focus on the with a focus on the

business functions / processes to drive alignment w ith business functions / processes to drive alignment w ith

business goals and objectives business goals and objectives –– ““ akaaka”” Business Business

ArchitectureArchitecture

�Providing requirements traceability

� “Glue” or integration points for iterative developme nt

�� Convergence Of Convergence Of Applications (SOA)Applications (SOA) & & Managed Data Managed Data

Environments (Business Intelligence)Environments (Business Intelligence)


Requires An IntegrationRequires An Integration

Architecture Architecture





The Problem – Aligning Systems with the Business

1. As proposed by the project sponsor

2. As defined by the requirements doc’s

3. As designed by the Senior Analyst

4. As produced by the programmers

5. As installed at the user’s site

6. What The User Really Wanted!

This Cartoon Has Been Circulating In IT For Over 20 + Years In Various Forms…



The Importance of Requirements

““ Analysts report that as many as 71% of projects tha t Analysts report that as many as 71% of projects tha t fail do so because of poor requirements management, fail do so because of poor requirements management, making it the single biggest reason for project fai luremaking it the single biggest reason for project fai lure ””

CIO magazine, November 15, 2005

Failure can also be defined as:Failure can also be defined as:�� ““ Analysis ParalysisAnalysis Paralysis ”” or or ““ Scope CreepScope Creep ””�� A never ending test cycleA never ending test cycle�� Redevelopment of systems after implementationRedevelopment of systems after implementation



Relationship Between Business Architecture & IT

Enables

Dictates

Enables

Dictates

Supplem

ents

Dictates

DictatesBusiness /

SBU StrategyBusiness

Architecture

BusinessProjects &Programs

Implies

DictatesTechnology

Strategy

App. & Info.TechnologyArchitecture

TechnologyProjects &Programs

Implies

Con

trib

utes

& S

uppo

rts

Con

trib

utes

& S

uppo

rts

Con

trib

utes

& S

uppo

rts

There Is An “Implied” Relationship Between Business & Technology Building Blocks

Business Architecture is a comprehensive framework for the representation of the business processes,

information, rules, and organizational designs that result directly from the business strategy. It provides a

coherent graphical means for the capture, management, and communication of business knowledge and

needs to support business solutions in the form of actionable requirements.

IT Confined ByProject Budgets

And Define App/InfoArchitecture



�� Define business requirements in a Define business requirements in a manner that manner that aligns IT and Businessaligns IT and Business

�� Requirements are Requirements are graphical graphical (pictures) and (pictures) and easy to understandeasy to understand

�� Supports both application and Supports both application and information architecturesinformation architectures

�� Vendor agnosticVendor agnostic

�� Supports rules established in Supports rules established in Business ArchitectureBusiness Architecture

�� Provides for Provides for checking consistency checking consistency and completeness throughoutand completeness throughout

�� Supports management with Supports management with quality quality control and governancecontrol and governance

�� ModelModel --driven approachdriven approach should use a should use a repositoryrepository --based toolbased tool

The Many Benefits Of Model Driven Development



MDM Has Full Traceability - Through Design, Build and Test

Des

ign

& B

uild

Req

uire

men

tsT

estin

g

Requirements andAcceptance Criteria

Design Component and/or Use Case that

Satisfies each Requirement

Test Groups, Test CasesOf Each Design Component

Requirements are satisfied by a design component an d each componRequirements are satisfied by a design component an d each compon ent isent isassigned to a test group with test cases. Thus tes t cases test assigned to a test group with test cases. Thus tes t cases test requirements. requirements. Test results can then be measured against acceptanc e criteria.Test results can then be measured against acceptanc e criteria.



Reference Architecture And It’s ViewsBUSINESS ARCHITECTURE

Mission / Vision, Business Requirements, Business Rules, Organizational Structure, Critical Success Factors, Business Process Design

APPLICATIONS ARCHITECTURE

Process Alignment, Services Definition, Services/Event Architectures, Custom Application Development, Enterprise Applications Integration Components

INFORMATION ARCHITECTURE

Data Integration, Data Architecture, Master Data Management, Metadata Management, Data Delivery Architecture, Dashboards, Performance Measurement, Analytics , Business Intelligence, Enterprise Reporting

INFRASTRUCTURE ARCHITECTURE

Legacy (Non-Service Enabled) ApplicationsNetworks, Servers / Hardware, Operating Systems

INT

EG

RA

TE

D G

OV

ER

NA

NC

E

Sec

urity

, Dat

a, S

LAs,

Ser

vice

s an

d IT

Por

tfolio

Man

agem

ent

QU

ALIT

Y C

ON

TR

OL

Quality A

ssurance, Testing, D

ata Quality M

anagement

Reference ArchitectureReference Architecture is a proven template for a solution domain that is a proven template for a solution domain that provides a common vocabulary with which to discuss designs and provides a common vocabulary with which to discuss designs and implementations implementations –– it frames solution delivery.it frames solution delivery.

Enterprise Architecture FrameworkEnterprise Architecture Framework describes a structure and describes a structure and behavior for an organization's processes, information systems, behavior for an organization's processes, information systems, personnel, and organizational subpersonnel, and organizational sub--units, aligning them with the units, aligning them with the organization's core goals and strategic direction.organization's core goals and strategic direction.



Reference Architecture – Artifacts / Techniques

StrategyStrategyProcessProcessFunctionFunctionTimeTimeLocationLocationDataDataOrganizationOrganization

WHYWHYHOWHOWWHENWHENWHEREWHEREWHATWHATWHOWHO

�� Enterprise Enterprise

Infrastructure VisionInfrastructure Vision

�� Strategic Network Strategic Network

PlanPlan

�� System Operation System Operation

Diagram (SODDiagram (SOD--P)P)

�� Security Management Security Management

PlanPlan

�� Systems Architecture Systems Architecture

DiagramDiagram

�� Network Architecture Network Architecture

DiagramDiagram

�� Infrastructure Infrastructure

Calendar PlanCalendar Plan�� Location Support PlanLocation Support Plan�� Data Management Data Management

PlanPlan

�� Data Capacity PlanData Capacity Plan

�� Data Archive PlanData Archive Plan

�� Infrastructure Infrastructure

Resource PlanResource Plan

�� CSFCSF’’ss�� Business Goals / Business Goals /

DirectionDirection

�� Business PlanBusiness Plan

– BPM / BPI

– Continuity Plan

�� Policy CharterPolicy Charter

�� Business Process Business Process

Flow (SODFlow (SOD--L)L)

�� Use CaseUse Case

�� ScreensScreens

�� ReportsReports

�� Business Logic (ASD)Business Logic (ASD)

�� Business Functions Business Functions

(FSD)(FSD)

�� Business Process Business Process

(FSD)(FSD)

�� Business PrioritiesBusiness Priorities

�� Business Time Business Time

DefinitionsDefinitions

�� Master Schedule Master Schedule

(Events & Triggers)(Events & Triggers)

�� Business LocationsBusiness Locations

�� LocationLocation--specific specific

Business Business

Requirements & Requirements &

DefinitionsDefinitions

�� Entity Relationship Entity Relationship

Diagram (EDD)Diagram (EDD)

�� Attribute Dependency Attribute Dependency

Diagram (ADD)Diagram (ADD)

�� KPI Structure Diagram KPI Structure Diagram

(KSD)(KSD)

�� Organization Chart Organization Chart

(OSD)(OSD)

�� RolesRoles & &

ResponsibilitiesResponsibilities

System Operation Diagram (SOD-L)

System Operations Documentation

Disaster Recovery Plan

Business R

equirements drive E

nterprise Architecture and B

usinessC

ontextB

usin

ess

Arc

hite

ctur

e

�� Business Plan Business Plan

AlignmentAlignment

�� Application Application

PrioritizationPrioritization


Replacement PlanReplacement Plan

�� Workflow Process Workflow Process

ModelModel


Architecture DesignArchitecture Design

�� Systems Interface Systems Interface

DesignDesign


Architecture DesignArchitecture Design

�� Services Map Screen Services Map Screen

DiagramsDiagrams

�� Application / Process Application / Process

Event Correlation Event Correlation

DiagramsDiagrams

�� Location Processing Location Processing

Workflow ModelsWorkflow Models�� Semantic Model Semantic Model

(Metadata)(Metadata)

�� Messaging DiagramMessaging Diagram

�� XML / XSLT DiagramsXML / XSLT Diagrams

�� SOAP / MessagesSOAP / Messages

�� Organization Process Organization Process

Mapping RulesMapping Rules

�� User Interface User Interface

DiagramsDiagrams

METADATA (repository-based): Application / Services Metaprocesses

App

licat

ions

A

rchi

tect

ure

�� Enterprise Managed Enterprise Managed

Data EnvironmentData Environment

�� Master Data Master Data

Management PlanManagement Plan

�� Business Business

Performance Performance

ManagementManagement

�� Data Quality Data Quality

MonitoringMonitoring

�� Data Exception Data Exception

ProcessingProcessing

�� Data Performance Data Performance


�� Enterprise Data Enterprise Data

Structures AuditStructures Audit

�� Enterprise Reporting Enterprise Reporting

& Analytics & Analytics


�� ETL / Data Integration ETL / Data Integration


�� Data Quality Data Quality


�� Metadata Metadata


�� Event Data Event Data

Correlation DiagramsCorrelation Diagrams

�� Enterprise Data Enterprise Data

Synchronization Synchronization

ScheduleSchedule

�� Data Control Data Control

StructuresStructures

�� Data Location & Data Location &

Physical Physical

Interdependency Interdependency

MapsMaps

�� Data Source Of Data Source Of

Record (SourceRecord (Source--toto--

Target for Enterprise Target for Enterprise

Data Structures)Data Structures)

�� Dimensional Dimensional

Hierarchies / Hierarchies /

TaxonomyTaxonomy

�� KPI / Metrics KPI / Metrics

DefinitionDefinition

�� Master Data ModelMaster Data Model

�� Logical / Physical Logical / Physical

Data ModelsData Models

�� Physical StructuresPhysical Structures

�� User Access User Access

AuthorizationAuthorization

�� Data Visualization & Data Visualization &

Delivery Delivery

RequirementsRequirements

METADATA (repository-based): Business (Definitions, Access Rights…), Operational (Load Timings, Controls…) & Technical (Environmental…)

Info

rmat

ion

Arc

hite

ctur

eIn

fras

truc

ture

A

rchi

tect

ure



Reference Architecture – Logical Managed ComponentsIN

TE

GR

AT

ED

GO

VE

RN

AN

CE

Sec

urity

, Dat

a, S

LAs,

Ser

vice

s an

d IT

Por

tfolio

Man

agem

ent

QU

ALIT

Y C

ON

TR

OL

Quality A

ssurance, Testing, D

ata Quality M

anagement

INFORMATION ARCHITECTURE APPLICATIONS ARCHITECTURE

Business Rules EngineApp / Svcs

Integration

BrokerData

RulesApp

Rules

Services Mgmt

Event Correlation

Process Choreography

Svcs Orchestration

Services Mgmt

Event Correlation

Process Choreography

Svcs Orchestration

BUSINESS ARCHITECTURE


Existing Application Backbone for Transaction Proce ssing (includes Legacy Applications )


Existing Application Backbone for Transaction Proce ssing (includes Legacy Applications )

Central Metadata & Metaprocess Library

Data & Data Audit Metadata

Enterprise Reporting

Integrated KPIs & Dashboards

Data Quality,Profiling & Cleansing

Enterprise Reporting



ETL / Data

Integration

Hub

Enterprise Data Structures

Sync

Sync SyncIntegrated Trx Data Store

Trx Processing

Recent Data, Normalized, Fine-grained, Unit-of-Work (UoW)

Processing

EDW & Data Marts

Reporting

Granular,

Denormalized,

Current / History

Analytics

Aggregates,

Dimensional,

Conformed

Master Data

Customer

Value, Control

Data, ID X-ref

Product

Value, Control

Data, ID X-ref

Orgn Chart

Value, Control

Data, ID X-ref


Sync


Trx Processing


Processing

EDW & Data Marts

Reporting

Granular,

Denormalized,

Current / History

Analytics

Aggregates,

Dimensional,

Conformed

Master Data

Customer

Value, Control

Data, ID X-ref

Product

Value, Control

Data, ID X-ref

Orgn Chart

Value, Control

Data, ID X-ref

Applications / Services Metaprocesses

Services Library

Application Svcs

Data Delivery Svcs

Messaging Svcs

Services Library

Application Svcs

Data Delivery Svcs

Messaging Svcs

StrategyProcessFunctionTimeLocationDataOrganization

WHYHOWWHENWHEREWHATWHO


Integrating Governance Integrating Governance

& Quality & Quality





Dedicated Management of Process and CommunicationsDedicated Management of Process and Communications

Data Governance – An Overview



What Is Data Governance Anyway…

�� Data Governance is what an organization does that yiel ds:Data Governance is what an organization does that yiel ds:� The highest quality decisions made at the lowest cost.� Increased efficiency in conducting/completing IT projects for the business.

�� Data Governance is NOT:Data Governance is NOT:� A project� Someone else’s responsibility� Intuitive� Something that happens on it’s own

�� Drivers For Data Governance:Drivers For Data Governance:� Lack of trust in the data

� Reports utilizing same data do not report same totals or computations

� Data not available in an easy manner� Multiple sources of data have to be gathered and manipulated

� Data timeliness� Manual process to collect, analyze and provide results

� Data integrity� Unknown filters, varying calculation/computations, fields used for data not indicative of field

names, data passed along from one person to another to another to another…..



Data Governance – Master Data Management Included…

A Comparison of Data Governance & MDMA Comparison of Data Governance & MDM

Master Data ManagementMaster Data Management�� Brings together single, consistent Brings together single, consistent

view of data that may reside in view of data that may reside in multiple source applications (CRM, multiple source applications (CRM, ERP, financial applications, Web ERP, financial applications, Web servers) by maintaining a single servers) by maintaining a single source of critical data, then crosssource of critical data, then cross --referencing and synchronizing data referencing and synchronizing data across all other missionacross all other mission --critical critical applicationsapplications

�� Critical business data flows in realCritical business data flows in real --time to multiple applications for time to multiple applications for single view of customers, suppliers single view of customers, suppliers and other dataand other data

Data GovernanceData Governance�� Strategy Strategy –– Why? Goals and Why? Goals and

objectives of organization (treat objectives of organization (treat data as an asset of organization) data as an asset of organization) –– MDM is a goalMDM is a goal

�� Policies, Procedures, Process Policies, Procedures, Process ––What? Who? When? Where? What? Who? When? Where? Provides structure, Provides structure, communications, and communications, and accountabilityaccountability

�� Implementation / Resolution Implementation / Resolution ––How? RealHow? Real --world application to world application to make it all happenmake it all happen

Beyond MDM: Regulatory Risk, Compliance, and SOARegulatory Risk, Compliance, and SOA


Proven Techniques For Proven Techniques For

Success Success





Partner With The Business: Help Them Understand Themselves

Stage 4 : ‘Perform ’ (business results)Actions : Structure KPIs & metricsFocus : Dashboarding processes

Stage 3 : ‘Structure ’ (enterprise data)Actions : Conform & Standardize DataFocus : Standardizing data & terms

Stage 2 : ‘Verify ’ (EDW data)Actions : Ensure Data QualityFocus : Governing data & metadata

Stage 1 : ‘Trust ’ (in application data)Actions : Collect & OrganizeFocus : Gathering data for reporting

Stage 5 : ‘Optimize ’ (the business)Actions : Establish Strategy & GoalsFocus : Improving market success

Departmental Usage

Enterprise Ready

Executive Driven

Reality

Perception



Develop Iteratively – It’s All About The Repeatable Process

�� A repeatable process implies an iterative methodolo gyA repeatable process implies an iterative methodolo gy� Utilize open-ended architecture/design principles t o facilitate reuse in future

iterations

� Stagger iterations as shown to save time and money

� Leverage best practices already available

� Requirements must be thoroughly understood

� Data profiling must be conducted in parallel with R equirements

� Activities should take progressively lesser time du ring subsequent iterations due to leveraging reusable components

� Program Management and Governance will ensure that iterations meet business requirements, minimize rework between iter ations and proper management of master data through its entire lifecy cle

Requirements Architecture Development Deployment

Iteration 1

Iteration 2

Iteration …



Proven Techniques: Define Your Components

■ Data Management– Master data– Data standardization– Data quality– Metadata– Data security, audit, and compliance

■ Data and delivery architectures– Modeling and structuring data– ETL data integration and data rules– Data delivery services (SOA-compliant)– Data technologies compatibility

■ Performance management– KPI relationships and metrics structure– Dashboard development and integration

■ Analytics management– Enterprise reporting– Analytics in transaction processing– “Real-time” analytics– Business activity monitoring (BAM)

INFORMATION ARCHITECTURE

Data Rules

Data & Data Audit MetadataEnterprise Reporting



ETL / Data

Integration

Hub


Sync


Trx Processing


Processing

EDW & Data Marts

Reporting

Granular,

Denormalized,

Current / History

Analytics

Aggregates,

Dimensional,

Conformed

Master Data

Customer

Value, Control

Data, ID X-ref

Product

Value, Control

Data, ID X-ref

Orgn Chart

Value, Control

Data, ID X-ref


Sync


Trx Processing


Processing

EDW & Data Marts

Reporting

Granular,

Denormalized,

Current / History

Analytics

Aggregates,

Dimensional,

Conformed

Master Data

Customer

Value, Control

Data, ID X-ref

Product

Value, Control

Data, ID X-ref

Orgn Chart

Value, Control

Data, ID X-ref

A Managed Data Environment

Data Delivery Svcs

Implies… Managed Data Components



Proven Techniques: Define Your Data Lifecycle…

© Richard Hackathorn, Bolder Technology, Inc., 2007. All Rights Reserved. Used with Permission.

Managing The Time-Value Curve

Action Time

Valu

e L

ost

Time

Value

Action

Business Event

Taken

Capture Latency

AnalysisLatency

Decision Latency





Proven Data Architecture – Data Validation & Verification

DataSources

Finance

XLS

POS

ERP

SCM

ERP

Transaction Level DetailGranularDenormalizedIntegratedCurrent & History

Reporting

Metadata

(Extract/Transform/Load)-- Apply business rules-- Manage metadata-- Consolidate data

ETL / DataIntegration Hub

Transaction Level Detail‘Atomic’-level DataNormalized (3NF)IntegratedTemporary

Integration

Aggregates & KPIsDimensionalDrilling Conformed

Analytics

ETLServer

Dashboards

Predictive & BehavioralAnalytics

Reporting & Ad hoc Queries

DatabaseServer Reporting

Server / Portal

Scoring

Algorithms

Metadata Inquiries

Others

Because there are several technologies covered by this graphic, it is important that they “play well together”

Data DeliveryEnterprise Data

1

2

3

4 5

6



Proven Techniques: Vision and Direction�� Establish A Vision of the Establish A Vision of the

FutureFuture� The Mission & Vision

� The Stakeholders

� BI and Reporting Differentiators

� Operating Principles

� Goals and Objectives for BI and Reporting

�� Prepare a Roadmap for the Prepare a Roadmap for the FutureFuture

� Recommended Initiatives & Impact

� Action Plans for High-Priority Initiatives

� Transition Strategy

� Critical Success Factors for the Transition

•D

ata

Qua

lity

Man

agem

ent,

Aud

it &

Con

trol

•M

aste

r D

ata

Man

agem

ent

•S

core

card

Dev

elop

men

t•

ET

L M

anag

emen

t for

Sou

rce

Sys

tem

Cha

nges

•E

DW

Arc

hite

ctur

e an

d E

nhan

cem

ent

•B

usin

ess

Per

form

ance

Man

agem

ent

• Marketing • Advertising • Customers

• Finance• Employee • Organization• Transportation

• Distribution Centers• Inventory• Orders • Vendors

• Sales• Sales Transactions• Products• Stores Phase 1:

Sales & StoresC

AP

AB

ILIT

Y ��

Phase 2:Inventory &

Orders

Phase 3:Finance &Employee

Phase 4:Marketing &Customer

Implementation, Phase by Phase, progresses over tim e ��

Ongoing, Centralized,

EDW Capabilities and Program Management

• Store and Product Master Data• Product Hierarchy Reference Data• Sales Scorecard Development

• Vendor and Order Master Data• Vendor Scorecard Development• Inventory Scorecard Development

• Employee Master Data• Organization Reference Data• Expenses and Margin Scorecard Development• Complete Store Scorecard Development

• Customer Master Data• Business Performance Analysis• Profitability Analysis (stores, products, customers)



Proven Techniques: Project Selection Planning

Widely used dimensionsLow Complexity

Considerable overall valueMEDIUM PRIORITY – HIGH IMPACT

Scarcely used dimensionsLow complexity

Easy to implementQUICK WINS – LIMITED IMPACT

Scarcely used dimensionsHigh complexity

Low overall valueLOW PRIORITY – LIMITED IMPACT

Widely used dimensionsHigh complexity

High overall valueHIGH PRIORITY – HIGH IMPACT

VIPS

Broader usage

HIGH VISIBILITY

Narrower usage

LOW VISIBILITY

“Enterprise Bus Matrix ”



Proven Techniques: Implementation Planning

�� A sequence of dimensions and marts that takes all A sequence of dimensions and marts that takes all criteria into accountcriteria into account

�� Demonstrates dimension reuse over timeDemonstrates dimension reuse over time

Stage 1 – VIPS

2

2 2 2 2 2 2 2 2 2 2 2222

222

2

2

22

2

2

2

2222

222

222

222

222

2 2 2

22

22

22

22

2

2 2

2 2 2

2 2

2 2

2 2

2 2

222

222

222

222

222

22

22 2

2 222

22

2 22 2

222

22

22

222

222

2

2

2

2

22

2

22

3

3

33

3

3

3

3

3

33

3

3

3

333

3

33

3

3

3 3 3

3 3 3

3 3 33 3 3 33

3

3

3

3

3

44

4 4

4

44

4

4

4

44

4

4 4

4

4

4 4

4

4

44

444

44

4



Flexible Architecture: A Managed Data Environment Is Needed

Universe of Applications

Universe of Application Data

Specialized Data Marts

Built as needed fromthe EDW

Enterprise Data Warehouse (EDW)

Data extracted from source systems of record Data Delivery Services

Ex

istin

g E

nviro

nm

en

t

Dashboards

High-EndAnalytics

End-to-End Data Management(Data Consolidated, Aggregated, Standardized, Dimensions Conformed)

Ma

na

ge

d D

ata

En

viro

nm

en

t

EnterpriseReporting

“O.K., Where do I

get the information

I need?”

“Cubes”

PremiumCustomer

CustomerAddress

Claim

EmployeeCash Value

Policy

Location

Property

Reporting DB Reporting

DB App DB

App DB App DB

Department Data MartDepartment

Data MartDepartment Data MartDepartment

Data Mart

Enterprise

Data Warehouse

ODS

GranularRelationalHistory

Metrics

AggregatesDimensionalDrill-Thru

Metadata Repository

Master Data

RepositoryETL

Hub



Flexible Architecture: ETL, Metadata, and OLAP as Well

■ Define ETL Reference Architecture– Independent of implementation technologies– Flexible process-managed delta extraction– Initial assembly into generalized business

objects– Comprehensive audits and controls

supporting error detection, staging, and notification

`

BOMM User Interface

(Standard & Custom Reports)

BO XI R2 Universes

Business Objects Metadata Manager (BOMM XI Release 2 Repository

BO Report Objects

CA AllFusion ERwin (EDW Models)

IBM Websphere DataStage(ETL Jobs)

EDW Server

EDW Database

Staging Database

Operational Source Systems

Advance 1

Peoplesoft

BO Data Insight XI Data Profiling Repository

Future

EDW Server Schema Objects

DataStage Transformation

Objects

Source Schema Objects

Profiling Statistics Log

EDW Data Defintion Objects

Current

Future

Current

Current

Current

Current

Current

Current

ETL Audit Reports

■ Metadata Management Architecture– Leverage solutions that interconnect using

the Metadata– Proactively leverage vendor partnerships to

formulate solution– Custom integration of ETL Audits and

Controls reporting into framework – Position for future integration of profiling

metadata



Proven Techniques: Deploying ETL Architecture

�� Provide the ability to perform/handle CDC and full refreshProvide the ability to perform/handle CDC and full refresh�� Provide granular data load dependenciesProvide granular data load dependencies�� Provide centralized, reusable audit and control Provide centralized, reusable audit and control

componentscomponents�� Provide centralized, reusable errors and exceptions Provide centralized, reusable errors and exceptions

componentscomponents�� Make the ETL process selfMake the ETL process self --healing / selfhealing / self --cleaningcleaning�� Provide technical and applicationProvide technical and application --level metadata level metadata

integrationintegration�� Provide security managementProvide security management�� Provide nearProvide near --real time supportreal time support�� Provide replicated data source supportProvide replicated data source support�� Design for ETL performanceDesign for ETL performance



Proven Architecture: Measures and KPIs for Analysis



Governance: Conceptual Model For Governance Metadata

Implement GovernanceIncrementally via aSeven Stage Maturity Model

Author: Martha Dember, RCG IT

Implement GovernanceImplement GovernanceIncrementally via aIncrementally via aSeven Stage Maturity ModelSeven Stage Maturity Model

Author: Martha Dember, RCG ITAuthor: Martha Dember, RCG IT

Strategy & Framework

Scenarios & Validation

Formalized Organization & Responsive Process Rollou t

Proactive Process Rollout

Expanded Business Involvement

Stewardship Culture

Strategic Governance

© 2005-2009. Martha Dember, All Rights Reserved.



Issues

Constraints

ConceptualConceptualData Model(s)Data Model(s)

LogicalLogicalData ModelData Model

DataDataLife CycleLife Cycle

EntityEntityComplexityComplexity

Actor

Roles

Activities

Objects

Sources

Locations

VolumeFrequency

Sub-Act Sub-Act

Elements

Definitions Attributes Facts &Measures

Reports

Events

BusinessRules

Governance: Conceptual Model For Governance Metadata Repository



MDM: A Process For Management Of Master Data

2. PersistIntegrate with other master data as neededStore in MDRStore DQ score/rating

6. MaintainUse Master Data Maintenance UI

Capture changes to structure/contentStore history

1. DefineDefine source system of record for master data element

Design data structure and process for creation/capturePerform QC prior to importing

3. Secure(Create new roles/privileges)Apply security policy

4. ConsumeDistribute to relevant application data storesConsumption governed by security policyApplication performs QA prior to acceptance

5. MonitorCapture operational metadata on usage of master data

Perform capacity management of MDM infrastructurePerform periodic QA in MDR to verify DQ score/rating

MASTER DATALIFECYCLE


Key Take Key Take –– Aways Aways

(Remember These(Remember These……) )





Key Take-Aways: Apply Proven Principles

�� FoundationFoundation :: Separation between data, source systems, and their Separation between data, source systems, and their

implementation technologies implementation technologies –– focus on BI & Data Delivery in this way to focus on BI & Data Delivery in this way to

achieve achieve ““Information IndependenceInformation Independence””

�� Core PrincipleCore Principle :: Information design and management Information design and management –– an architecture for an architecture for

delivering correct, complete, reliable, and timely data quickly delivering correct, complete, reliable, and timely data quickly and and

effectively effectively

�� Keys to SuccessKeys to Success :: Information design and management are essential as Information design and management are essential as

data delivery becomes critical to the businessdata delivery becomes critical to the business



�� Bottom Line Benefits Bottom Line Benefits ((essential for high business valueessential for high business value ):):

� Target BI analytics on improving business metrics ( what would be the value of increasing inventory turns by 5%?)� Learn from Lowe’s, 3M, and others

� Engage the business in the core business process of focused improvement by turning information into action

�� Cost Savings Cost Savings ((necessary, but not sufficientnecessary, but not sufficient ):):

� Eliminate redundant data and the associated storage and servers

� Standardize on a small set of BI & Data Delivery te chnologies, reducing ongoing license and maintenance fees

� Match BI & Data Delivery capabilities to the users and manage license fees for products

� Reduce the time taken managing Excel and Access dat a manipulation, analysis, and reporting

Key Take-Aways: Focus On Results



�� Every company can use data to deliver bottomEvery company can use data to deliver bottom --line line business valuebusiness value

�� Apply the core corporate performance management Apply the core corporate performance management (CPM) business process (CPM) business process

�� Focus on bottomFocus on bottom --line benefits for real ROI; donline benefits for real ROI; don ’’ t get lost t get lost in typical IT cost justificationsin typical IT cost justifications

�� While there are business and technical obstacles to While there are business and technical obstacles to overall success, these are known and can be overcom e overall success, these are known and can be overcom e

�� Deliver through an architectural and data managemen t Deliver through an architectural and data managemen t frameworkframework

�� Use a combination of business, IT, and outside expe rtise Use a combination of business, IT, and outside expe rtise to develop a core competencyto develop a core competency

Key Take-Aways: Deliver Value



Key Take-Aways: Industry Trends

�� Much more enterpriseMuch more enterprise --level thinkinglevel thinking

�� BI selfBI self --service for easeservice for ease --ofof --use by business usersuse by business users

�� ReRe--architecting existing BI and data delivery architecting existing BI and data delivery environmentsenvironments

�� Starting to get anal about audit and control over d ata Starting to get anal about audit and control over d ata movementmovement

�� Growing awareness:Growing awareness:� Data quality issues, especially as they impact qual ity of analytics

� Need for performance management

� Competency centers (or center of excellence) performanc e is different than skilled use of technology

�� Attacking problems with BI and data delivery strate gies Attacking problems with BI and data delivery strate gies and roadmapsand roadmaps


Thank You For Your Thank You For Your

ParticipationParticipation……


[email protected]@rcgit.com

(732) 744(732) 744--36223622

dama international symposium san diego ca 03-17-2008

Documents