become agile with data modeling
TRANSCRIPT
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands. All rights reserved. No part
of this material may be reproduced, stored in a retrieval system, or transmitted in any form or by
any means, electronic, mechanical, photographic, or otherwise, without the explicit written permission of
the copyright owners.
Become Agile with Data Modeling
by
Rick F. van der LansR20/Consultancy BVTwitter @rick_vanderlanswww.r20.nl
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 2
Everything About Data has Changed
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 3
We Live in the Big Data Era
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 4
New Data Storage Technologies
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 5
Applications Come and Go
Application 1
Application n
Application 6
Application 5 Application 4
Application 3
Application 2
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 6
Data in the Hands of the Users
Self-Service
Reporting
Self-Service Analytics
Self-Service ETL
Self-Service Cleansing
Self-Service …
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 7
Lost Without a Data Model
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 8
Why Data Models?
A data model describes what data means, what the relationships are, what the characteristics of data are, and so on
What does this mean: <John, December 15, 1999>
Data without a data model is like words without a dictionary
A data model is the Rosetta Stone to understand data correctly
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 9
NoSQL Requires Data Modeling As Well
ID VALUE
75295<employee>
<number>6</number>
<name> <lastname>Parmenter</lastname>
<initials>R</initials>
</name>
<address> <street>Haseltine Lane</street>
<houseno>80</houseno>
<postcode>1234KK</postcode>
<town>Stratford</town>
</address>
</employee>
10381
9
<employee>
<number>7</number>
<name> <lastname>Metheny</lastname>
<initials>P</initials>
</name>
<address> <street>Brownstreet</street>
<houseno>80</houseno>
<province>ZH</province>
<town>Boston</town>
</address>
</employee>
13217
1
<employee>
<number>15</number>
<name> <lastname>Metheny</lastname>
<initials>P</initials>
<code>45</code>
</name>
</employee>
Multi-structured table
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 10
A Data Model is More Than a Diagram
Textual definitions
List of synonyms
Textual descriptions
Integrity rules related to data quality
Business glossary
Security rules
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 11
A Data Model is Pivotal
For business users to develop their own reports
For business users to analyze reports and results
For developers to develop new big data applications to understand the structure of the data
For BI specialists to integrate data from multiple systems to present a correct 360 degrees view of customers
For data stewards to determine the correctness of data
For many more …
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 12
Data Modeling Old Style
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 13
Four Requirements for Agile Data Modeling
Data storage agnostic
Collaboration
Business glossary
Flexible data model
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 14
1. Data Storage Technology Agnostic
Dealing with many different data storage technologies
Dealing with Polyglot Persistence
Application 1
SQL
Application 2
Hadoop
Application 3
NoSQL
Application 4
…
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 15
1. Data Storage Technology Agnostic
Rich set of data model concepts
Forward engineering
Reverse engineering
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 16
1. Data Storage Technology Agnostic
SQLHadoop
NoSQL
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 17
2. Agile Data Modeling is Collaboration
Data stewards
Business analysts
Business users
Data architects / modelers
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 18
Versioning of Data Model (Components)
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 19
Comparing Data Models
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 20
Fine-Grained Check-in and Check-out
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 21
3. Business Glossary
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 22
Searching for Business Objects
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 23
An Integrated Business Glossary
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 24
4. Flexible Data Model
see http://www.agiledata.org/essays/dataModeling101.html
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 25
A Flexible Data Model
Membercategory
Subscription Junior/Senior
Librarymember
Membercategory
Subscription Junior/Senior
Librarymember
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 26
Concluding Remarks
Everything about data has changed
The data model has become pivotal for a larger audience
Agile data modeling is pivotal
Agile data modeling tools must support:• Data storage agnostic
• Collaboration features
• Business glossary
• Flexible data model
Copyright © 1991 - 2015 R20/Consultancy B.V., The Hague, The Netherlands 27
Resources
New white paper on Agile Data Modeling• http://forms.embarcadero.com/AgileDataModelingWP
Learn more about the ER/Studio product family• http://www.embarcadero.com/data-modeling
To arrange a demo, please contact Embarcadero Sales• http://forms.embarcadero.com/forms/ERStudioProductInterest
Save the Date: April 30, 2015• Learn about upcoming features for ER/Studio’s next release
• http://forms.embarcadero.com/ERStudioNewRelease