examining master data integration using biztalk server and sql server master data services
DESCRIPTION
Examining Master Data integration using BizTalk Server and SQL Server Master Data Services, in this session will give an introduction to using BizTalk Server together with SQL Server Master Data Services. These technologies are helpful in an Enterprise Information Management scenario. It will showcase the SQL Server technology and talk about what you need to know and the patterns you can use from an integration perspective to import and export information and perform integration between SQL Server and external information sources. BizTalk Summit 2014, London March 03-04 Brought to you by BizTalk360TRANSCRIPT
brought to you by
BIZTALK SUMMIT 2014, LONDON
MARCH 03-04sessions. discussions. networking and
more
Examining Master Data integration using BizTalk Server and SQL Server Master Data ServicesJOHAN HEDBERG
World Champions
Olympic Champions
SQL Master Data Services
“Master Data Services (MDS) is the SQL Server solution for master data management (MDM)”
Agenda
Master Data ServicesScoping the discussionOffice ExcelSQL Server Integration ServicesBizTalk Server
Scoping the Discussion
Master Data Solution Patterns
Master Data = Data Distribution?
Integration & Distribution
Best of Breed System
Subscribing System
Data
Subscribing SystemSubscribing
System
Best of Breed System
Data
Subscribing SystemSubscribing
SystemSubscribing System
Best of Breed System
Data
Subscribing SystemSubscribing
SystemSubscribing System
Customer
Master Data = Data Distribution?
Integration & Distribution
Best of Breed System
Subscribing System
Data
Subscribing SystemSubscribing
System
Best of Breed System
Data
Subscribing SystemSubscribing
SystemSubscribing System
Best of Breed System
Data
Subscribing SystemSubscribing
SystemSubscribing System
Product
Master Data = Data Distribution?
Integration & Distribution
Best of Breed System
Subscribing System
Data
Subscribing SystemSubscribing
System
Best of Breed System
Data
Subscribing SystemSubscribing
SystemSubscribing System
Best of Breed System
Data
Subscribing SystemSubscribing
SystemSubscribing System
Master Data Enterprise information Management
Data Management
Best of Breed System
Subscribing System
Data
Subscribing SystemSubscribing
System
Best of Breed System
Data
Subscribing SystemSubscribing
SystemSubscribing System
Best of Breed System
Data
Subscribing SystemSubscribing
SystemSubscribing System
Data Steward
What is the “Data Steward’s” favorite tool?
Microsoft Excel
Demo
• Introduction• Working with Master Data Services in SQL Server 2012• The Portal• Excel
Basic MDS Architecture
MDS DatabaseStaging Tables Subscription
Views
MDS Tables
What Master Data Services is
• It is a central data store• It contains data staging tables and data
export views• It does not contain any integration
capabilities in itself
What Master Data Services is not
• It is not data distribution• It is not data sync from a (another) master
system
So how do we import data without Excel?
Data Architecture – 1 Tier Staging
MDS DatabaseStaging Tables Subscription
Views
MDS Tables
Data Import Data Export
SQL Server Integration Services (SSIS)
“SSIS is an Extract, Transform, Load (ETL) framework for data integration”
Data Architecture – 2 Tier Staging
MDS DatabaseStaging Tables Subscription
Views
MDS Tables
Data Import Data Export
Staging Tables
DQS (Cleansing & Matching)
Data MERGE and Translation
Staging Tables
External Systems External Systems
Data Architecture – 1 Tier Staging
MDS DatabaseStaging Tables Subscription
Views
MDS Tables
SSISData Import
SSISData Export
Demo
• Data import• Using SSIS
Is SSIS an Integration Platform?
Yes and no
Is there another Integration Platform
we can use?
BizTalk
Data Architecture – 1 Tier Staging
MDS DatabaseStaging Tables Subscription
Views
MDS Tables
BizTalkData Import
BizTalkData Export
Demo
• Stage/Import data with BizTalk• Export/Sync data with BizTalk
So it’s all about batches of data?
It depends…
Data Architecture – 1 Tier Staging
MDS DatabaseStaging Tables Subscription
Views
MDS Tables
BizTalkAdaptability
EventingProcesses
…
BizTalkAdaptability
Pub/SubDelta processing
…
MDS WCF Architecture
IIS Service
MDS Service
WCF
WEB-UI Excel Add-In
Workflow/Notifications
MDS Database
External Systems
MDS WCF Architecture
IIS Service
MDS Service
WCF
BizTalk
MDS Database
External Systems
*
Demo
• The WCF API’s• Data Lookup
MDS Complete Architecture
IIS Service
MDS Service
WCF
WEB-UI Excel Add-In
Workflow/Notifications
Subscribing Systems MDS Database
Subscription Views Staging Tables DQS (Cleansing &
Matching)
External Systems
BizTalk/.NET
SSIS SSIS
BizTalk/.NET
BizTalk/.NET
Recommendations
• Start small• It’s the Business’s data• BizTalk can be an enabler