agile, automated, aware: how to model for success

Grab some coffee and enjoy the pre-show banter

before the top of the

hour!

The Briefing Room

Agile, Automated, Aware: How to Model for Success

Twitter Tag: #briefr The Briefing Room

Welcome

Host: Eric Kavanagh

[email protected] @eric_kavanagh


  Reveal the essential characteristics of enterprise software, good and bad

  Provide a forum for detailed analysis of today’s innovative technologies

 Give vendors a chance to explain their product to savvy analysts

  Allow audience members to pose serious questions... and get answers!

Mission


Topics

October: DATA MANAGEMENT

November: ANALYTICS

December: INNOVATORS


A Model for Success Ø What’s Old Is New Again

Ø Modeling Envisions Solutions

Ø  Serves as a Bridge to the Future


Analyst: David Loshin

David Loshin, president of Knowledge Integrity, Inc., is a thought leader and expert consultant in the areas of data quality, master data management, and business intelligence. David is the author of numerous books and papers on data management, including the “Practitioner’s Guide to Data Quality Improvement.” David is a frequent speaker at conferences and in web seminars. His best-selling book, “Master Data Management,” has been endorsed by data management industry leaders. David can be reached at [email protected], or at (301) 754-6350.


Embarcadero

  Embarcadero offers a wide variety of database management and application development products

  ER/Studio, its data architecture and modeling solution, enables agile change management and a number of automated tasks

  ER/Studio includes an extensible business glossary and metadata collaboration tools


Guest: Ron Huizenga

Ron Huizenga is the Senior Product Manager for the Embarcadero ER/Studio product family. Ron has over 30 years of experience as an IT executive and consultant in Enterprise Data Architecture, Governance, Business Process Reengineering and Improvement, Program/Project Management, Software Development and Business Management.

EMBARCADERO TECHNOLOGIES EMBARCADERO TECHNOLOGIES

Agile, Automated and Aware How to Model for Success

Ron Huizenga Senior Product Manger – ER/Studio

EMBARCADERO TECHNOLOGIES

Agile Overview

11


ER/Studio: Agile Change Management

•  Enable “Agile Data Modeler” •  Change Management Center

–  User stories /tasks •  Granular repository check-‐out & check-‐in

–  Individual objects or sets of objects –  Full models/sub-‐models if desired

•  Change records at check in (or check out) –  Can be associated to user stories, tasks

•  SKll fully supports named releases, branch & merge as well


ER/Studio: Change Management Center

13


ER/Studio: Change Record Details

14


Is the team responsible for data models included in your agile process?

Data team’s inclusion in agile process incomplete

Yes, completely

34%

Somewhat 58%

No 8%

Does your organizaKon follow an agile development methodology?

Yes, fully 16%

Yes, somewhat

57%

No 27%


ER/Studio: AutomaFon

•  Reverse engineering •  Metadata interchange •  Naming standards •  Compare & merge •  Forward Engineering •  Macros •  Glossary IntegraKon

16


ER/Studio: Apply Naming Standards

•  Can invoke with other wizards –  General Physical Model –  Compare & Merge –  XML Schema GeneraKon –  Model ValidaKon

•  Can apply to model or sub-‐model at any Kme

•  Either DirecKon •  SelecKve review/apply •  Enabled by loose model coupling •  Name lockdown (freeze names)

17


ER/Studio: AutomaFc Naming Standards

18

Real-‐Kme update while typing


19

ER/Studio: Compare and Merge


ER/Studio: NaFve Big Data Support

•  MongoDB –  Diagramming –  Reverse & Forward Engineering (JSON, BSON) – MongoDB cerKficaKon for 2.x and 3.0

•  CerKfied for HDP 2.1 –  Forward and reverse engineering –  Hive DDL

9


ER/Studio: Extended NotaFon for MongoDB

21


•  Powerful enterprise glossary, model & metadata collaboration

•  Integrate key business terms and definitions with business systems

•  View, store, and manage a single source of business definitions

•  Attach business policies to daily workflows with contextual alerts and tips

ER/Studio: Business CollaboraFon

22


ER/Studio Team Server: Glossaries & Terms

23


ER/Studio: Glossary IntegraFon

24


Database Tools PorMolio

25


Concluding Remarks •  ER/Studio provides automaKon, awareness and

collaboraKon –  Agile change management –  Documents “why” and “what” for the changes –  Sharing of models and metadata –  Awareness and business meaning through glossaries

•  Agile is becoming mainstream –  73% of companies use agile to some degree –  Only 16% have fully embraced it

•  Crucial stakeholders aren’t fully involved –  Of companies using Agile, only 34% fully involve data modelers –  58% involve them somewhat –  8% exclude them enKrely

26


Perceptions & Questions

Analyst: David Loshin

The Modern Modeling Conundrum

David Loshin Knowledge Integrity, Inc.

loshin@knowledge-‐integrity.com Briefing Room – October 27, 2015

© 2015 Knowledge Integrity, Inc loshin@knowledge-‐integrity.com (301) 754-‐6350 28

When Worlds Collide…

•  OrganizaKons are increasingly impacted by conflicKng approaches to data management: –  Tabular data vs. RDBMS –  RDBMS vs. NoSQL –  Big Data vs. ???

•  ConflicKng development methodologies are are also impacKng the way systems are designed and built –  TradiKonal waterfall vs. Agile

© 2015 Knowledge Integrity, Inc loshin@knowledge-‐integrity.com (301) 754-‐6350

29

Assessing the Modern Data Landscape

Enterprise Data

Management

Legacy OLTP

Plaporms

Mainframe files

Heritage RelaKonal Systems

Sta/c E/R models

Emerging Big Data

NoSQL and HDFS


30

Transitions…

•  The trend has data management moving from staKc to dynamic


31

•  Focus on fixed structure •  Transform on write •  Single source, many copies •  Issues with consistent

interpretaKon with many users

•  Allows variant structure •  Transform on read •  MulKple sources, limit copies •  Issues with consistency

among users with many interpretaKons

Data Management/Change Management

•  CompeKng data management frameworks and compeKng development methodologies are championed by compeKng generaKonal schools of pracKce

•  But there is a need to impose data management best pracKces to provide –  Unified data views –  Uniform development methodologies

•  Layer “agility” over enterprise metadata and modeling –  Data discovery –  Metadata capture and management –  Support for naKve data representaKons –  “Aliased” modeling –  Simplified applicaKon development –  PresentaKon to the data consumers –  Collabora/on across the enterprise


32

Questions for Embarcadero

•  Embarcadero has provided data modeling and metadata management tools for a very long Kme. What do you see as the main differences in informaKon design and modeling between 1995 and 2015?

•  How has the Agile methodology influenced the ways that system designers work?

•  There is clearly a much greater interest and apKtude among business users today when it comes to data uKlizaKon, but at a cost of increased complexity in the environment. What are the three greatest challenges in ensuring consistency in data interpretaKon?


33

Questions for Embarcadero

•  MongoDB is probably the most widely used example of NoSQL. How has the growing interest in these types of data management technologies impacted the modeling effort?

•  What do you see as being the next challenges in big data

integraKon within the enterprise? How do you plan to address these challenges?

•  Please elaborate on how your products supplement an

enterprise data governance program.


34

Questions & Suggestions

•  www.knowledge-‐integrity.com •  www.dataqualitybook.com •  www.decisionworx.com •  If you have quesKons, comments,

or suggesKons, please contact me David Loshin 301-‐754-‐6350 loshin@knowledge-‐integrity.com


35


Upcoming Topics

www.insideanalysis.com

October: DATA MANAGEMENT

November: ANALYTICS

December: INNOVATORS


THANK YOU for your

ATTENTION!

Some images provided courtesy of Wikimedia Commons and https://www.facebook.com/techinsider/videos/426968527501509/

agile, automated, aware: how to model for success

Technology