gwen thomas-dama-mn-oct 2008€¦ · [email protected] 321-438-0774 data governance...
TRANSCRIPT
Data Governanceand Alignment
The Data Governance Institutepage 1
Data GovernanceData Governanceand Alignment Withand Alignment With
Various Various Data Management EffortsData Management Efforts
Gwen ThomasGwen ThomasPresident, The Data Governance InstitutePresident, The Data Governance Institute
Data Governanceand Alignment
The Data Governance Institutepage 2
AgendaAgenda
q Introductions
q Data Governance Basics
q Options for Fitting Data Governance into Organizational Landscapes
q Aligning Data Governance With VariousData Management Efforts
Data Governanceand Alignment
The Data Governance Institutepage 3
IntroductionsIntroductions
Data Governanceand Alignment
The Data Governance Institutepage 4
About The Data Governance Institute and GwenAbout The Data Governance Institute and Gwen ThomasThomas
q President, The Data Governance Institute and Publisher of its websites
q Keynote, industry’s first Data Governance conference
q Designer of Data Governance programs for large and mid-size companies:World Vision International, WaMu, BankUnited, Sallie Mae, Wachovia*, Walt Disney World**, Coors Brewing**, NDCHealth / Wolters Kluwer** * IBM was the prime contractor ** CIBER was the prime contractor
q Author, Alpha Males and Data Disasters: The Case for Data Governance.
q Assisted with data strategy, integration, warehouses, metadata, and content governance at numerous organizations over past 20 years
Email:gwen.thomas@
datagovernance.com
Phone: 321-438-0774
The Data Governance Institute has three arms:
1. Training/consulting
2. Membership(The Data Governance & Stewardship Community of Practice) atwww.DataStewardship.com
3. Information services, publishing the free DGI Data Governance Framework, whitepapers and reports, and many websites, including:
• The web’s largest free resource for Data Governance and Stewardship information at www.DataGovernance.com
• An “apples-to-apples” master catalog of Data Governance Software, at www.DataGovernanceSoftware.com
Data Governanceand Alignment
The Data Governance Institutepage 5
ROI and Data Governance
A Note About ValueA Note About Value
Everything an organization doesshould tie to one of three universal value drivers
1.Increase revenue and value2.Manage cost and complexity3.Support Risk Management and Compliance
efforts, and increase confidence.
Data Governance (and all your efforts!)MUST tie back
to one or more of these drivers.
Data Governanceand Alignment
The Data Governance Institutepage 6
Data Governance BasicsData Governance Basics
Data Governanceand Alignment
The Data Governance Institutepage 7
In today’s inter-connected and post-compliance world, it’s no longer enough to “do” IT efforts. Work isn’t done until you:
1. Do it
2. Control it
3. Document it
4. Prove compliance
No manager is in a position to understand the requirements for all of the above and to understand the impacts of data-related actions. Alignment is needed for data-related decisions.
Why Management IsnWhy Management Isn’’t Enought Enough
The Post-Compliance Paradigm
Data Governanceand Alignment
The Data Governance Institutepage 8
DefinitionsDefinitions
“Management is the decisions you makeGovernance is the structure for making them."
- CIO Magazine
“Data Governance is the exercise of decision-making and authority for data-related matters.
Data Stewardship is the set of activities that ensure data-related work is performed according to policies and practices as established through governance.“
- The Data Governance Institute
Data Governance is how we Data Governance is how we ““decide how to decidedecide how to decide”” ––it sets the rules of engagement for Data Managementit sets the rules of engagement for Data Management
Group activity
Individual responsibilities
(plus, sometimes, group activities)
Data Governanceand Alignment
The Data Governance Institutepage 9
What Any Type of Governance DoesWhat Any Type of Governance Does
Proactively create and align rules
Enforce rules,
resolve conflicts
Provide ongoing servicesand Stakeholder CARE
(policy, standards,guiding principles,data quality rules,data definitions, etc.)
Data Governanceand Alignment
The Data Governance Institutepage 10
How We Start Data GovernanceHow We Start Data Governance(and what we revisit in years 2, 3, 4(and what we revisit in years 2, 3, 4……))
1. Justify your existence:What’s your Macro reason for governance?Compliance, Business Transformation, Business Integration
2. Justify your efforts:What benefits will you deliver with your projects and ongoing processes?
3. Identify scope - What data and information will you address? (more about this later)
4. Articulate the concerns to focus on and the changesyou’ll help your organization make.
5. Identify general and specific goals and metrics.
7 Monitor,
Measure,Report
6Govern
the data
5Deploy
the program
4Design
theprogram
3 PlanandFund
2Prepare
aroadmap
1Develop a value
statement
7 Monitor,
Measure,Report
7 Monitor,
Measure,Report
6Govern
the data
5Deploy
the program
4Design
theprogram
3 PlanandFund
2Prepare
aroadmap
1Develop a value
statement
Data Governanceand Alignment
The Data Governance Institutepage 11
Why Have Data Governance Why Have Data Governance ProgramsPrograms??A Macro ViewA Macro View
A recent survey and report from TDWI says Data Governance is used to support
q Compliance (Internal and External)
q Business Transformationq Business Integration
We agree that these are macro-level driversfor many efforts, including Data Governance, EIM,MDM, Metadata, and others
TDWI Report: “Data Governance Strategies: Helping your Organization Comply, Transform, and Integrate” http://www.tdwi.org/Research/ReportSeries/index.aspx
Categories of Business Drivers
Data Governanceand Alignment
The Data Governance Institutepage 12
Specific Efforts Data Governance May AddressSpecific Efforts Data Governance May Address
q Data sharingq Data analysisBusiness Integration
q New capabilitiesq Understanding change (impact
analysis)q Enabling & supporting changeq Alignment
Business Transformation
q Data accessq Controlsq Proving complianceq Change control
Risk & Compliance
You may be concerned aboutIf you’re doing governance for this reason
Data Governanceand Alignment
The Data Governance Institutepage 13
Result: Typical Result: Typical ““FlavorsFlavors””of Data Governance of Data Governance (we(we’’ll come back to these)ll come back to these)
Policy, Standards, Strategy
Data Quality
Privacy / Compliance / Security
Architecture / Integration
Data Warehouses and BI
Management Alignment
© The Data Governance Institute
Data Governanceand Alignment
The Data Governance Institutepage 14
q Operational and compliance driversq Complexity of the organization, technology landscape,
and data landscapeq What you’re specifically trying to accomplishq What you have to work withq Experience of staff and maturity of existing effortsq Cultural attitudes toward rules, authority,
decision-making, and controls
What Else to Consider When Designing What Else to Consider When Designing a Data Governance Programa Data Governance Program(or aligning your Data Management efforts with one)(or aligning your Data Management efforts with one)
Data Governanceand Alignment
The Data Governance Institutepage 15
q Frameworks help us organize how we think and communicateabout complicated or ambiguous concepts.
q Data Governance can mean different things to different people – the natural state is confusion!
q A framework serves the same purpose as a taxonomy or the table of contents and page headings in a book, website, or presentation – it keeps everyone in sync.
DGI Data Governance Framework components
Rules and Rules of Engagement1. Mission and Vision2. Goals, Governance Metrics and
Success Measures, and Funding Strategies
3. Data Rules and Definitions 4. Decision Rights5. Accountabilities6. Controls
People and Organizational Bodies7. Data Stakeholders 8. A Data Governance Office9. Data Stewards
Processes10. Data Governance Processes
You can download the DGI Data Governance Framework for free at www.DataGovernance.com
Using a Framework Using a Framework
Data Governanceand Alignment
The Data Governance Institutepage 16
The DGI Data Governance FrameworkThe DGI Data Governance Framework
Data Governanceand Alignment
The Data Governance Institutepage 17
Context: Where Context: Where Governance and ArchitectureGovernance and Architecture
Fit Into Corporate DecisionFit Into Corporate Decision--MakingMaking
Data Governanceand Alignment
The Data Governance Institutepage 18
Who Who ““OwnsOwns”” Data Governance?Data Governance?
Businessorganizations
Technologyorganizations
Governance,Architecture
BPM,Risk Mgmt,
Compliance,Privacy,Security,
etc.
Data Governanceand Alignment
The Data Governance Institutepage 19
Detail: Context forGovernance & Architecture
Cross-functionalGovernance & Architecture
• Vertical Silos• Finance• Sales• Operations• etc.
• Functions that• Create data• Acquire data• Use data• Share data
• Horizontal Efforts• Metadata• Master Data• Application Dev• etc.
• Functions that• Store data• Process data• Move data• Display data
Business
IT
Data Governanceand Alignment
The Data Governance Institutepage 20
Context forGovernance & Architecture
• Data Definitions• Data Quality
Policies, Standards, Guidelines, Requirements, Controls, Rules
• Vertical Silos• Finance• Sales• Operations• etc.
• Functions that• Create data• Acquire data• Use data• Share data
• Horizontal Efforts• Metadata• Master Data• Application Dev• etc.
• Functions that• Store data• Process data• Move data• Display data
Types of Governance• Data Governance• IT Governance• Compliance /
Privacy / Security• Project Management• Change Control• etc.
Programs and Strategies
Data Apps
Systems
Business Processes
Data Apps
Systems
Business Processes
Architectures
(plus security architectures, controls architectures, etc.)
Models and Strategies
BusinessIT
Data Governanceand Alignment
The Data Governance Institutepage 21
Challenges forGovernance & Architecture
• Data Definitions• Data Quality
Types of Governance• Data Governance• IT Governance• Compliance /
Privacy / Security• Project Management• Change Control• etc.
Programs and Strategies
Data Apps
Systems
Business Processes
Data Apps
Systems
Business Processes
Architectures
(plus security architectures, controls architectures, etc.)
Models and Strategies
BusinessIT
What group aligns all these rules? Communicates them?
Policies, Standards, Guidelines, Requirements, Controls, Rules
Do all these groups speak
the same language, or
do they need a “translator”?
Do these groups know each others
rules? Is there a mechanism for gaps and
overlaps?
Data Governanceand Alignment
The Data Governance Institutepage 22
Levels of Complexity for Data Governance Organizations
• Data Definitions• Data Quality
• Vertical Silos• Finance• Sales• Operations• etc.
• Functions that• Create data• Acquire data• Use data• Share data
• Horizontal Efforts• Metadata• Master Data• Application Dev• etc.
• Functions that• Store data• Process data• Move data• Display data
BusinessIT
Data Governance Board
Data Stewardship
Council
Working Groups
DGO
SubjectMatter Experts
Policies, Standards, Guidelines, Requirements, Controls, Rules
QualityStewards
Data Governanceand Alignment
The Data Governance Institutepage 23
Result of These Options:Result of These Options:Six Models for StewardshipSix Models for Stewardship
Data Governanceand Alignment
The Data Governance Institutepage 24
Result of These Options:Result of These Options:Six Models for StewardshipSix Models for Stewardship
Complexity
formality
Stewardshipembedded infunctional responsibilities
1 level of formal stewardswith finite
responsibilities
1-2 levels of stewardsplus formal
Data Quality initiative
Hierarchy of stewardswith finite
responsibilities
Hierarchy of stewards with Data Quality and other
responsibilities
Several hierarchies of stewards plus
Enterprise Data Stewards
Data Governanceand Alignment
The Data Governance Institutepage 25
““FlavorsFlavors”” of of Data Governance:Data Governance:
Typical Focus AreasTypical Focus Areasfor Programsfor Programs
Data Governanceand Alignment
The Data Governance Institutepage 26
What Each What Each ““FlavorFlavor”” Has in CommonHas in Common
q They all address universal governance processes, such as decision-making, rule-making and alignment, issue resolution, and communication.
q They all have activities that address a three-part governance mission
create and
alignrules
enforce rulesand resolve conflicts
provide ongoing services.
q They will differ, however, in the type of rules and issues they’ll address.
q They’ll differ in the emphasisthey give to certain data-related decisions and actions.
q And, they’ll differ in the level of involvementrequired of types of data stakeholders.
q They all employ each of the universal components of a Data Governance framework.
Data Governanceand Alignment
The Data Governance Institutepage 27
Data Governance With a Focus onData Governance With a Focus on
Policy, Standards, StrategyPolicy, Standards, Strategy
q What problem is this addressing?– Some group needs support from a cross-functional leadership body.
q Who might originate the program?– Data Architecture, Data Management, BPR, or a cross-functional team
that needs to align policies, standards, requirements. Often starts with a focus on Master Data.
q What is the scope?– Enterprise, or at least the scope of the team needing support.
q What might Data Governance do (besides Issue Resolution, Communication, and Stakeholder CARE)?– Review, approve, monitor policy– Collect, choose, review, approve, monitor standards– Align sets of policies and standards– Contribute to Business Rules– Contribute to Data Strategies– Identify stakeholders and establish decision rights
Policy, Standards, Strategy
Data Quality
Privacy / Compliance / Security
Architecture / Integration
Data Warehouses and BI
Management Support
Policy, Standards, Strategy
Data Quality
Privacy / Compliance / Security
Architecture / Integration
Data Warehouses and BI
Management Support
Data Governanceand Alignment
The Data Governance Institutepage 28
Partial Stakeholder Map for Data Governance With a Focus onPartial Stakeholder Map for Data Governance With a Focus on
Policy, Standards, StrategyPolicy, Standards, Strategy
Data Stewards
Business and IT staff who must comply with policy
supportersopponents
Stakeholderswho needpolicy
support
DGO
Executive Sponsors
Data Governance Council
So these are the people
I worked with to sell
the new standard…
Data Governanceand Alignment
The Data Governance Institutepage 29
Data Governance With a Focus onData Governance With a Focus on
Data QualityData Quality
q What problem is this addressing?– Quality, integrity, usability, of data.
q Who might originate the program?– Data Quality group or a business team that needs better quality data.
(Example: Data Acquisition, Mergers & Acquisitions.)Often starts with a focus on Master Data.
q What is the scope?– Could be enterprise, local to a department, or local to a project.
q What might Data Governance do (besides Issue Resolution and Stakeholder CARE)?– Set direction for Data Quality– Monitor Data Quality– Ensure consistent Data Definitions – Identify stakeholders, establish decision rights, clarify accountabilities
Policy, Standards, Strategy
Data Quality
Privacy / Compliance / Security
Architecture / Integration
Data Warehouses and BI
Management Support
Policy, Standards, Strategy
Data Quality
Privacy / Compliance / Security
Architecture / Integration
Data Warehouses and BI
Management Support
Data Governanceand Alignment
The Data Governance Institutepage 30
Partial Stakeholder Map for Data Governance With a Focus onPartial Stakeholder Map for Data Governance With a Focus on
Data QualityData Quality
Data Stewards
Data Governance Council
Executive Sponsors
keystakeholders(setting quality
direction)
Data QualityStewards
PMO,Training,PurchasingforDQtools
IT for Data Quality
DGO
How good is “good
enough”?
Data Governanceand Alignment
The Data Governance Institutepage 31
Data Governance With a Focus onData Governance With a Focus onPrivacy / Compliance / SecurityPrivacy / Compliance / Security
q What problem is this addressing?– Data Privacy, Access Management, Information Security controls,
compliance with regulatory, contractual, or internal requirements.q Who might originate the program?
– Business or IT. Often comes from a senior management mandate.q What is the scope?
– Generally enterprise, but often limited to specific types of data.q What might Data Governance do
(besides Issue Resolution and Stakeholder CARE)?– Help protect Sensitive Data through support for Access Management
and Security Requirements– Support cross-system data analysis– Help define Risk and Controls– Help enforce regulatory, contractual, architectural compliance
requirements– Identify stakeholders, establish decision rights, clarify accountabilities
Policy, Standards, Strategy
Data Quality
Privacy / Compliance / Security
Architecture / Integration
Data Warehouses and BI
Management Support
Policy, Standards, Strategy
Data Quality
Privacy / Compliance / Security
Architecture / Integration
Data Warehouses and BI
Management Support
Data Governanceand Alignment
The Data Governance Institutepage 32
Partial Stakeholder Map for Data Governance With a Focus onPartial Stakeholder Map for Data Governance With a Focus on
Privacy / Compliance / SecurityPrivacy / Compliance / Security
PMO,Training,Software Purchasing
Data Stewards
keystakeholders
fromGRC
(GovernanceRisk
Compliance)Business and ITstaff who mustcomply withpolicy
Access Mgmt;IT Security
DGO
Executive Sponsors
Data Governance Council
Compliance is NOT
optional!
Data Governanceand Alignment
The Data Governance Institutepage 33
Data Governance With a Focus onData Governance With a Focus on
Architecture / IntegrationArchitecture / Integration
q What problem is this addressing?– Challenges moving from a silo environment to integrated or enterprise
systems.q Who might originate the program?
– Data Architecture group or a project addressing a data integration challenge. SOA. M&A groups.
q What is the scope?– Could be enterprise, local to a department, or local to a project.
q What might Data Governance do (besides Issue Resolution and Stakeholder CARE)?– Ensure consistent data definitions– Support cross-system data analysis– Support Architectural Policies and Standards– Support Metadata Programs, SOA, Master Data Management– Bring cross-functional attention to integration challenges– Identify stakeholders, establish decision rights, clarify accountabilities
Policy, Standards, Strategy
Data Quality
Privacy / Compliance / Security
Architecture / Integration
Data Warehouses and BI
Management Support
Policy, Standards, Strategy
Data Quality
Privacy / Compliance / Security
Architecture / Integration
Data Warehouses and BI
Management Support
Data Governanceand Alignment
The Data Governance Institutepage 34
Partial Stakeholder Map for Data Governance With a Focus onPartial Stakeholder Map for Data Governance With a Focus on
Architecture / IntegrationArchitecture / Integration
PMO,Training,Software Purchasing
Data Stewards
fromthe
business
Business and IT staff who must comply with policy
IT andDataMgmt
Keybusiness
stake-holders
forArch &
Integration efforts
DataArch,MD,ETL
Projects;MDM – CDI;SOA
Executive Sponsors
Data Governance Council
DGO
These are a lot of
stakeholders’needs to align!!!
Data Governanceand Alignment
The Data Governance Institutepage 35
Data Governance With a Focus onData Governance With a Focus on
Data Warehouses and BIData Warehouses and BI
q What problem is this addressing?– Enforcement of rules that affect data in Data Warehouses, Data Marts,
or Business Intelligence systems. q Who might originate the program?
– Data Management teams or the Business Groups who sponsor/use these systems.
q What is the scope?– Generally limited to roles and responsibilities for the warehouse.
Sometimes this prototype grows to an enterprise effort.q What might Data Governance do
(besides Issue Resolution and Stakeholder CARE)?– Establish rules for data usage and data definitions– Set standards and entry criteria for sourcing and provisioning of data– Identify stakeholders, establish decision rights, clarify accountabilities– Clarify the value of data assets and data-related projects.
Policy, Standards, Strategy
Data Quality
Privacy / Compliance / Security
Architecture / Integration
Data Warehouses and BI
Management Support
Policy, Standards, Strategy
Data Quality
Privacy / Compliance / Security
Architecture / Integration
Data Warehouses and BI
Management Support
Data Governanceand Alignment
The Data Governance Institutepage 36
Partial Stakeholder Map for Data Governance With a Focus onPartial Stakeholder Map for Data Governance With a Focus on
Data Warehouses and BIData Warehouses and BI
Data Stewards
fromthe
business
who clean up databefore it
goes into the warehouse
Keybusiness
stake-holders
forware-
house
IT staffwho accept data intothe warehouse or provide access to it
Those who need to use the data
DGO
Executive Sponsors
Data Governance Council
No garbage in!
Data Governanceand Alignment
The Data Governance Institutepage 37
Data Governance With a Focus onData Governance With a Focus on
Management AlignmentManagement Alignment
q What problem is this addressing?– Managers need to make collaborative decisions but either don’t know all
the stakeholders to involve or have an obstacle to assembling them.– The value/impact of data and data-related efforts needs to be assessed.
q Who might originate the program?– Any stakeholder group with a problem that has not been resolved
through other channels.q What is the scope?
– Could be enterprise, local to a department, or local to a project.q What might Data Governance do
(besides Issue Resolution and Stakeholder CARE)?– Measure the value of data and data-related efforts.– Align frameworks and initiatives– Identify stakeholders, establish decision rights, clarify accountabilities– Identify SDLC embedded governance steps and loop-outs for projects– Monitor and report on data-related projects– Promote data-related messages and positions
Policy, Standards, Strategy
Data Quality
Privacy / Compliance / Security
Architecture / Integration
Data Warehouses and BI
Management Support
Policy, Standards, Strategy
Data Quality
Privacy / Compliance / Security
Architecture / Integration
Data Warehouses and BI
Management Support
Data Governanceand Alignment
The Data Governance Institutepage 38
Partial Stakeholder Map for Data Governance With a Focus onPartial Stakeholder Map for Data Governance With a Focus on
Management AlignmentManagement Alignment
Data Stewardship Organization
Data Governance Council
Executive Sponsors
DGO
Representatives from organizational silos
So the leaders decided what to do, and who would do it, and theneverything was settled and we all went about our work!
Data Governanceand Alignment
The Data Governance Institutepage 39
Review: Six Review: Six ““FlavorsFlavors”” of Data Governance, of Data Governance, Each With Different Data StakeholdersEach With Different Data Stakeholdersand Unique Configuration Challengesand Unique Configuration Challenges
Data Governance can focus on
1. Policy, Standards, Strategy2. Data Quality3. Privacy / Compliance / Security4. Architecture / Integration5. Data Warehouses and BI6. Management Alignment
I like what I see!
If you identify what you’re focusing on, then you canbetter understand your stakeholders’ needs, whichshould result in a more successful and better-supported program.
Data Governanceand Alignment
The Data Governance Institutepage 40
Questions to Ask Questions to Ask if You Want to Get Involvedif You Want to Get Involved
Data Governanceand Alignment
The Data Governance Institutepage 41
1. About Mission and Focus1. About Mission and Focus
q Is this program concentrating on problems you have answers to?
q If so, are they addressing all aspects of the Post Compliance Paradigm?
Data Governanceand Alignment
The Data Governance Institutepage 42
2. About Goals and Success Measures2. About Goals and Success Measures
q If yes to #1, has the program staff though about metrics? (Their execs will!)Can you assist by– Bringing clarity?– Offering benchmarks or metrics?– Offering a way to collect or report metrics?
Data Governanceand Alignment
The Data Governance Institutepage 43
3. About Funding and Stakeholders3. About Funding and Stakeholders
qWhich funding model is in place for– Making and aligning rules– Issue analysis and issue resolution– Administration and stakeholder care
qWhat do you know about data stakeholders that the Data Governance team should be aware of?
Data Governanceand Alignment
The Data Governance Institutepage 44
4. About Roles4. About Roles
qDoes a DGO exist?qHow is executive-level stewardship
handled?qHow are priorities set?qHow are decisions made?qWho influences decisions?
Data Governanceand Alignment
The Data Governance Institutepage 45
4. About Policies, Practices, and Process4. About Policies, Practices, and Process
qWhat does your group already do toensure that the goals of governance are met?
qWhat practices can you influence?qWhat processes need adjusting?qHow should you be involved in setting
policy, standards, guidelines?qHow should you all decide how to decide?
Data Governanceand Alignment
The Data Governance Institutepage 46
What else would you like to talk about?What else would you like to talk about?
Gwen ThomasPresident, The Data Governance Institute www.DataGovernance.com
Sponsors of The Data Governance and Stewardship Community of Practicewww.DataStewardship.com
Email:[email protected]
Phone:321-438-0774