Business Process Modeling and Analysis for Data Warehouse Design
Slava KokaevLead Business Intelligence Architect at Lockheed Martin
Email: [email protected]: @SlavaKokaev
Agenda
Dimensional Model Physical Implementation
Design Dimensional Model
Model and Analyze Business Processes
Tools And Technologies
Microsoft SQL Server 2014
UML
IDEF0 Notation
SADT Methodology
What is Business Intelligence?
Business intelligence is a set of theories, methodologies, processes, architectures, and technologies that transform raw data into meaningful and useful information for business purposes.
Business Intelligence GoalTo optimize organizational Key Business Processes and Operations by providing critical to business Information at Right Time and Right Format to all levels of employees.
Expl
ore
Ana
lyz e
Vis
uali
zeCon
tro l
System DefinitionSystem is a group or set of functional elements that interact together to produce desired result or achieve a goal
Element 1
Element 2
Element 3
We scope a system by defining its boundary; this means choosing which entities are inside the system and which are outside – part of the environment.
Element 5
Element 6
Element 7
System ProcessA system can also be viewed as a bounded transformation process, that is, a process or collection of processes that transforms inputs into outputs. Inputs are consumed; outputs are produced.
ProcessInput
Control
Processor
Output
System Formation
System is a set of detailed methods, procedures and routines created to carry out a specific activity, perform a duty, or solve a problem.
Identify Problem
Set Goal and
Result
Define Mechani
sm
Perform Task
Analyze Result
Improve Process
Business ProcessBatch processing Architecture Scheduled Large dataset size
A business process is a collection of related, structured activities or tasks that produce a specific service or product (result) (serve a particular goal) for a particular customer or customers.
There is two types of business processes: key processes and supportive processes.Key Business process is a process that adds value to the productSupportive process adds value to the process itself, but not to the product
Business Process Structure
Enterprise Business Analytics System
Customers
Business Partners
Vendors, Suppliers
Service Providers
Monitoring Systems
Analysis Systems
Business Processes and Operations
Controlling Systems
Strategy and Planning Systems
Business Conceptual Framework
Reseller Sales
AmyJack
Mo Shipping Dept.
Sales Quota $1000
Manager
Order Date
Order # Reseller Sales Person
Ship Date Product Price
06/17/2010 E223084 Jack Yo Amy Valdez 06/18/2010 Mountain Bike -200
Data Sources
Customer Web App Order Cloud
Web Service
FTP Server
Database Server
Data Sources
Customer Web App Order Cloud
Web Service
FTP Server
Database Server
ETL
Web Service
FTP Server
Database Server
ETL Extract, Transform, Load
ETL
Data Warehouse
ETL Extract, Transform, Load
Web Service
FTP Server
Database Server
ETL
Data Warehouse
Data Warehouse
Data Warehouse
Data Warehouse
OLAP Cube
Data Mining
Structure
Data Warehouse
Data Warehouse
OLAP Cube
Data Mining
Structure
Data Presentation
OLAP Cube
Data Mining
Structure
Data Presentation
SharePoint Server
Custom Application
Dashboards
Clients
Business Logic
Power User
Use Case
Reseller Sales
AmyJack
Mo Night Freight Sales Quota $1000
Manager
Order Date Order # Reseller Sales Person Ship Date Product
06/17/2010 E223084 Jack Yo Amy Valdez 06/18/2010 Mountain Bike -200
Identifying System Boundary
Reseller
Sales Mager
Sales Person
Shipping Person
Browse Product Catalog
Get Product Quotes
Order Product
Receive Product
Analyze Sales Create Sales
Plan
Sale Product
Process Order
Ship the Product
Package Product
Get Processed
Order
Source System
Create KPI
Business Intelligence System
Business Process
Business ActivityMoney
Customers
Materials
Business Rules Plans Standards
IT ResourcesHuman Resources Equipment
Products
Orders
Contracts
Functional Structure (PDCA Model)
Plan
Act
Check
Do
Data Mining Reporting Services Analysis ServicesSQL Server
Input Data
Resources
Plans, Business Rules
Result Data
Process Output (Facts /Measures)
Feedback (Improvement)
Sales Business Process
Plan Sales
Analyze Sales
Monitor Sales
Sale Product
Sales ManagerSales Representative
Analysis Data
Reseller Info (Dimension)
Sales Quota
Sales Result
Order Info (Facts /Measures)
Sales corrections and Improvement
Sales Summary
Balance Scorecards
Sales Transaction
Product Info (Dimension)
KPI
Designing Dimensional Model
Dimension
Dimension
Dimension
Dimension
DimensionFact
Designing Dimensions
Reseller
Name
Address
Phone
Business Type
Product Line
Jack Yo
…, NJ, USA
(555)333-7777
Bikes
Retailer
Designing Dimensions Hierarchy
Product
Name
Category
Sub Category
Color
Price
Mountain Bike 200
Bike
Mountain Bike
Black
$150.00Name
Category
Sub Category
Designing Dimensions
HierarchiesA dimension hierarchy is a collection of logically structured levels based on attributes.
Surrogate KeysPrimary key purposeIdentifies uniquenessRelates to foreign keys in a fact tableConsolidates multiple data sourcesConsolidates multi-value business keysAllows tracking of dimension history
Product
Name
Category
Sub Category
Color
Price
Product ID
DimProduct
Name
Category
Sub Category
Color
Price
Product ID
Product Key
Mountain Bike
Bike
Mountain Bike - 200
Black
$150.00
MB124677
1
Source OLTP Table Target DW Table
8/12/2013DateSK812201
3
Full NameAmy
Valdes
EmployeeSK5
Full NameJohn Doe
ResellerSK20
ProductNameBike-200,
Mnt, B
ProductSK
555
Date
Designing Dimensional Model
Order Date
ResellerSales Person
Product Price Order Qty8/12/2013 John Doe
Amy Valdes
Bike-200, Mnt, B
$150.00
20
Shipping Date
9/3/2013
Order Date
ResellerSales Person
Product8/12/2013 John Doe
Amy Valdes
Bike-200, Mnt, B
DimDate
DimEmployee
DateSK8122013
DateSK932013
EmployeeSK5
DimReseller
ResellerSK20
DimProduct
ProductSK555
FactResellerSales Measures
9/3/2013 932013
This is the End of the Slides
But not the end of the presentation