rwdg slides: apply data governance to agile efforts

1

Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting #RWDG @RSeiner

Real World Data Governance

Apply Data Governance to Agile EffortsMonthly Webinar Series Hosted by DATAVERSITYRobert S. Seiner – KIK Consulting / TDAN.comMarch 16, 2017 – 2:00 p.m. EST

2

2

#RWDG @RSeiner Copyright © 2017 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting

• Real-World Data Governance – Monthly Webinar SeriesApril 20, 2017 – Governing Data Governance and Master MetadataThird Thurs @ 2pm EST – Register at DATAVERSITY, TDAN.com, KIKconsulting.com

• Non-Invasive Data Governance Book ISBN 9781935504856 / Technics Publishing / Amazon.com

• DATAVERSITY EventsEnterprise Data World 2017 – Atlanta, Georgia – April 2-7DGIQ Conference 2017 – San Diego, California – June 12-16

• Online Learning PlanNon-Invasive Data Governance - DATAVERSITY Training CenterSeven Online Courses with Evaluation – Celebrate Data Education Month!

• The Data Administration Newsletter (TDAN.com)Twice Monthly – Articles, Columns, Blogs and FeatureProduced by DATAVERSITY – Subscribe for emails

Real-World Data GovernanceCurrent Events

3

3


• Data Governance Programs and Agile Data Projects are known to conflict when it comes to how the information and data is managed.

• Senior Leadership has come to expect both the formal governance of data and data projects to be delivered quickly and effectively.

• These two requirements continue to cause problems.

Apply Data Governance to Agile EffortsAbstract

4

4


• During this webinar I will discuss:– Looking for common ground to stand on– The Data goals of an Agile effort– The Agile goals of a Data Governance program– Bridging the gap and building understanding– Steps to apply governance to Agile efforts

Apply Data Governance to Agile EffortsAbstract

5

5


• Data Governance– Data Governance is the Execution and Enforcement of Authority

Over the Management of Data and Data-Related Resources.

• Data Stewardship– Data Stewardship is the Formalization of Accountability

Over the Management of Data and Data-Related Resources.

Apply Data Governance to Agile EffortsDefinitions

6

6


• Non-Invasive Data Governance™– The practice of:

• applying formal accountability & behavior • through non-invasive roles & responsibilities• to existing and / or new processes• to assure that the definition, production & usage of data• assures regulatory compliance, security, privacy, protection & quality.

– Non-Invasive describes how governance is applied to assurenon-threatening management of valuable data assets.

– The goal is to be» Transparent» Supportive» Collaborative.


7

7


• The Agile Approach– In simple terms: Quick and Easy– Relating to or denoting a method of project management used especially

for software development. Freedictionary.com


8

8


• The Agile Approach– Short Work Phases– Frequent Reassessment– Adaptation of Plans


9

9


• The Agile Approach– Develop Functionality– Integrate and Test– Repeat– Demonstrate Release– Feedback / Changes– Repeat– System Testing– Repeat


DEVELOPFUNCTIONALITY

INTEGRATE &TEST

DEMONSTRATERELEASE

FEEDBACK &CHANGES

SYSTEMTESTING

FUNCTIONALITYCOMPLETE

10

10


• The Waterfall Approach– In simple terms: Slow and Deliberate– Relating to or denoting a method of project management that is

characterized by sequential stages and a fixed plan. Freedictionary.com

– “Pay me now or pay me later.”


11

11


• The Waterfall Approach1. Analyze Business Requirements / Needs2. Design Business Requirements3. Code Implementation4. Test Solution for Implementation5. Evaluation by End-User6. Maintenance


AN

ALYZE

DESIG

N

CO

DE

TEST

EVALA

UA

TE

MA

INTA

IN

12

12


• Boils Down to Two Things

1. Convincing the Agile Development Team that sufficient(data) governance is necessary for their project.(May require a mandate.)

2. Find ways to apply Data Governance sufficiently withoutinterfering with the Agile Development Team.(May require compromise.)

Apply Data Governance to Agile EffortsLooking for Common Ground

13

13


• How do you begin to bring together approaches that are different?• Begin by looking at what they have in common.• Strengthen that.


14

14


• Data Governance Core Principles: 1. Data Managed as an Asset2. Clearly Defined Accountability3. Follow Internal and External Rules4. Consistent Across Lifecycle


15

15


• Agile Core Principles: 1. Requirements at a High Level2. Testing – Early and Often3. Active User Participation4. Timing – Quickly, Incrementally5. Lightweight & Visual


16

16


• What does Senior Leadership want from Data Governance?– Understood Data – Govern Data Definition– Quality Data – Govern Data Production– Protected and Valued Data – Govern Data Usage

Apply Data Governance to Agile EffortsBridging the Gap / Building Understanding

17

17


• What does Senior Leadership want from Agile?– Speedy Delivery– Incremental Delivery– High Quality Delivery


18

18


• What does Senior Leadership think about Data Governance?– The reasons why they are implementing Data Governance:

• Data must be managed as an asset.• The data must be protected.• The data drives analytics & decision-making so it must be quality.• The auditors are telling them they must have formal governance.• Other organizations are governing their data.


19

19


• What does Senior Leadership think about Data Governance?– The reasons why they are not implementing Data Governance:

• They do not understand all of the approaches that are available.• It is very complex based on the organization.• It moves very slowly.• It can be quite expensive.• It requires a lot of resources.• It will change the culture.• It is not a project.


20

20


• What does Senior Leadership think about Agile?– The reasons why they are implementing Agile:

• Large projects take too long and they cost way too much.• Projects must be managed to be delivered quickly and accurately.• The project must be delivered early and continuously.• The project communications must be face-to-face and constant.• High Quality and Timely Delivery are Critical.


21

21


• What does Senior Leadership think about Data Governance?– The reason why they are not implementing Agile:

• The fact is that they are attempting to deliver projects using Agile.• And … Agile is only being used for large and complex projects.

– ERP Implementations– Data Warehouse Redo-s– Enterprise Transformations


22

22


• What does Senior Leadership know about relating the two?– Very Little

• How much effort has been made to relate the two?– Very Little

• What effort has been made to get the Program and Projects aligned? – Very Little

• How well are Data Governance Programs acting Agile?– Very Little


23

23


• Data Governance is a Sustained Program– Beginning … No End– Data Definition, Production and Usage– Focused on Delivering Quality Data

• Agile is a Project Methodology– Beginning … Milestones … Completion– Software Definition, Production and Usae– Focused on Delivering Quality Software / Projects


24

24


• To Provide:– Accurate Data– Timely Data– Dependable Data– Consistent Data– Understood Data

… from the Project… Without Interfering with the Project Schedule

Apply Data Governance to Agile EffortsData Goals of an Agile Effort

25

25


• To Provide:– The “Right” Data– At the “Right” Time– From the “Right” Sources– For the “Right” Purposes– To Produce the “Right” Results

… Quickly, Efficiently and Effectively… Without Interfering with the Project Schedule

Apply Data Governance to Agile EffortsAgile Goals of a Data Governance Program

26

26


Apply Data Governance to Agile EffortsSteps to Apply Governance to Agile Efforts

• Before we review some steps …– Need to focus on two key aspects of governing …

• The assurance that governance is going to happen (mandate)• The appropriateness of the level of governance (compromise)

• Reminder of definition …– Data Governance is the execution and enforcement of authority

over the management of data and data-related assets.

27

27



• You will not be able to apply Governance to Agile …– if there is no assurance that governance will take place.– If the appropriate level of governance is not applied.

28

28



• Assurance– Making certain it will happen.– Synonyms:

• Word of Honor• Promise• Pledge• Vow• Guarantee• Commitment

29

29



• Assurance– Requires that your Management understand …

• Goals of Data Governance• Approach(es) to Data Governance• Goals of Agile• How Data Governance and Agile can work together• Accept and Promote Harmony

30

30



• Appropriate– Suitable and proper for circumstance.– Synonyms:

• Proper• Fitting• Right• Relevant• Pertinent• Formal

31

31



• Appropriate– Requires negotiation and compromise of:

• Levels of documentation, requirements, metadata• Defining of what’s “right” – Bill of “Rights”• Approval at Management Level

32

32


DevelopFunctionality

Integrate andTest

DemonstrateRelease

MakeChanges

SystemTesting

Assure AppropriateRequirements

Assure AdequateDevelopment Time

Assure FunctionalityInterdependence

Assure AppropriateSignoff

Phases of anAgile Effort

Applying (Data) GovernanceTo Each Phase


33

33



Integrate andTest

DemonstrateRelease

MakeChanges

SystemTesting

Assure AppropriateIntegration / Testing Plan

Assure Involvementof the Right People

Assure AppropriateTesting Time

Validate andConfirm Results

Assure AppropriateData to Test




34

34



Integrate andTest

DemonstrateRelease

MakeChanges

SystemTesting

Assure AppropriateAudience

Assure AppropriateUse of Data


Assure AppropriateRelease Signoff

Assure AppropriateResults Documentation




35

35



Integrate andTest

DemonstrateRelease

MakeChanges

SystemTesting

Assure AppropriateChange Management

Assure AppropriateDocumentation

Assure Follow-Up onTechnical Debt

Assure AppropriateData Considerations




36

36



Integrate andTest

DemonstrateRelease

MakeChanges

SystemTesting



Detailed IntegrationAnd Testing Plan

Involve theRight People

Allow AppropriateTesting Time


Use AppropriateData to Test


37

37


• It all comes down to the two key words …– Assurance

• This will require Management level understanding.• This will require authority for enforcement.

– Appropriate• This will require compromise to satisfy both camps.• This will require negotiation to satisfy both camps.• This will require acceptance to satisfy both camps.


38

38


• During this webinar I discussed:– Looking for common ground to stand on– The Data goals of an Agile effort– The Agile goals of a Data Governance program– Bridging the gap and building understanding– Steps to apply governance to Agile efforts

Apply Data Governance to Agile EffortsSummary

39

39


• Real-World Data Governance – Monthly Webinar Series– April 20, 2017 – Governing Data Governance and Master Metadata

• Questions and Answers

Real-World Data GovernanceContact Information

40

40


• Robert S. SeinerKIK Consulting & Educational Services – KIKconsulting.comThe Data Administration Newsletter – TDAN.comPost Office Box 112571, Upper St. Clair, Pennsylvania 15241412.220.9643, 412.220.9644 (Fax)[email protected]@tdan.com

@RSeiner #RWDG

Real-World Data GovernanceContact Information