bi archi + design 01 - readme-3.0
TRANSCRIPT
-
8/7/2019 BI Archi + Design 01 - ReadMe-3.0
1/6
Business IntelligenceArchitecture and Design
Guide
Summary: Welcome to Microsoft Patterns & Practices Business intelligence architecture anddesign guide. This guide gives you prescriptive guidance on how to overcome architectural
challenges and design issues when building Business Intelligence solutions using Microsoftplatform.
Microsoft Confidential. 2006 Microsoft Corporation. All rights reserved. These materials areconfidential to and maintained as a trade secret by Microsoft Corporation. Information in thesematerials is restricted to Microsoft authorized recipients only. Any use, distribution or publicdiscussion of, and any feedback to, these materials is subject to the terms of the attachedlicense. By providing any feedback on these materials to Microsoft, you agree to the terms of thatlicense.
Microsoft Confidential. 2006 Microsoft Corporation. All rights reserved. By using orproviding feedback on these materials, you agree to the attached license agreement.
Please provide feedback at BI Feedback Alias.
mailto:[email protected]?subject=BIFEEDBACK:http://msdn.microsoft.com/practicesmailto:[email protected]?subject=BIFEEDBACK: -
8/7/2019 BI Archi + Design 01 - ReadMe-3.0
2/6
Microsoft Corporation Technical Documentation License Agreement (Standard)READ THIS! THIS IS A LEGAL AGREEMENT BETWEEN MICROSOFT CORPORATION ("MICROSOFT") AND
THE RECIPIENT OF THESE MATERIALS, WHETHER AN INDIVIDUAL OR AN ENTITY ("YOU"). IF YOU HAVEACCESSED THIS AGREEMENT IN THE PROCESS OF DOWNLOADING MATERIALS ("MATERIALS") FROM AMICROSOFT WEB SITE, BY CLICKING "I ACCEPT", DOWNLOADING, USING OR PROVIDING FEEDBACK ONTHE MATERIALS, YOU AGREE TO THESE TERMS. IF THIS AGREEMENT IS ATTACHED TO MATERIALS, BY
ACCESSING, USING OR PROVIDING FEEDBACK ON THE ATTACHED MATERIALS, YOU AGREE TO THESETERMS.
1. For good and valuable consideration, the receipt and sufficiency of which are acknowledged, You andMicrosoft agree as follows:
(a) If You are an authorized representative of the corporation or other entity designated below("Company"), and such Company has executed a Microsoft Corporation Non-Disclosure Agreement that isnot limited to a specific subject matter or event ("Microsoft NDA"), You represent that You haveauthority to act on behalf of Company and agree that the Confidential Information, as defined in theMicrosoft NDA, is subject to the terms and conditions of the Microsoft NDA and that Company will treat theConfidential Information accordingly;
(b) If You are an individual, and have executed a Microsoft NDA, You agree that the ConfidentialInformation, as defined in the Microsoft NDA, is subject to the terms and conditions of the Microsoft NDAand that You will treat the Confidential Information accordingly; or
(c)If a Microsoft NDA has not been executed, You (if You are an individual), or Company (if You are anauthorized representative of Company), as applicable, agrees: (a) to refrain from disclosing or distributingthe Confidential Information to any third party for five (5) years from the date of disclosure of theConfidential Information by Microsoft to Company/You; (b) to refrain from reproducing or summarizingthe Confidential Information; and (c) to take reasonable security precautions, at least as great as the
precautions it takes to protect its own confidential information, but no less than reasonable care, to keepconfidential the Confidential Information. You/Company, however, may disclose Confidential Informationin accordance with a judicial or other governmental order, provided You/Company either (i) givesMicrosoft reasonable notice prior to such disclosure and to allow Microsoft a reasonable opportunity toseek a protective order or equivalent, or (ii) obtains written assurance from the applicable judicial orgovernmental entity that it will afford the Confidential Information the highest level of protection affordedunder applicable law or regulation. Confidential Information shall not include any information, howeverdesignated, that: (i) is or subsequently becomes publicly available without Your/Companys breach of anyobligation owed to Microsoft; (ii) became known to You/Company prior to Microsofts disclosure of suchinformation to You/Company pursuant to the terms of this Agreement; (iii) became known toYou/Company from a source other than Microsoft other than by the breach of an obligation ofconfidentiality owed to Microsoft; or (iv) is independently developed by You/Company. For purposes of thisparagraph, "Confidential Information" means nonpublic information that Microsoft designates as beingconfidential or which, under the circumstances surrounding disclosure ought to be treated as confidential
by Recipient. "Confidential Information" includes, without limitation, information in tangible or intangibleform relating to and/or including released or unreleased Microsoft software or hardware products, themarketing or promotion of any Microsoft product, Microsoft's business policies or practices, andinformation received from others that Microsoft is obligated to treat as confidential.
2. You may review these Materials only (a) as a reference to assist You in planning and designing Your
product, service or technology ("Product") to interface with a Microsoft Product as described in theseMaterials; and (b) to provide feedback on these Materials to Microsoft. All other rights are retained byMicrosoft; this agreement does not give You rights under any Microsoft patents. You may not (i) duplicateany part of these Materials, (ii) remove this agreement or any notices from these Materials, or (iii) giveany part of these Materials, or assign or otherwise provide Your rights under this agreement, to anyone
else.
3. These Materials may contain preliminary information or inaccuracies, and may not correctly representany associated Microsoft Product as commercially released. All Materials are provided entirely "AS IS." Tothe extent permitted by law, MICROSOFT MAKES NO WARRANTY OF ANY KIND, DISCLAIMS ALL EXPRESS,IMPLIED AND STATUTORY WARRANTIES, AND ASSUMES NO LIABILITY TO YOU FOR ANY DAMAGES OFANY TYPE IN CONNECTION WITH THESE MATERIALS OR ANY INTELLECTUAL PROPERTY IN THEM.
4. If You are an entity and (a) merge into another entity or (b) a controlling ownership interest in You
changes, Your right to use these Materials automatically terminates and You must destroy them.
Microsoft Confidential. 2006 Microsoft Corporation. All rights reserved. By using orproviding feedback on these materials, you agree to the attached license agreement.
Please provide feedback at BI Feedback Alias.
mailto:[email protected]?subject=BIFEEDBACK:mailto:[email protected]?subject=BIFEEDBACK: -
8/7/2019 BI Archi + Design 01 - ReadMe-3.0
3/6
5. You have no obligation to give Microsoft any suggestions, comments or other feedback ("Feedback")relating to these Materials. However, any Feedback you voluntarily provide may be used in MicrosoftProducts and related specifications or other documentation (collectively, "Microsoft Offerings") which inturn may be relied upon by other third parties to develop their own Products. Accordingly, if You do giveMicrosoft Feedback on any version of these Materials or the Microsoft Offerings to which they apply, Youagree: (a) Microsoft may freely use, reproduce, license, distribute, and otherwise commercialize YourFeedback in any Microsoft Offering; (b) You also grant third parties, without charge, only those patentrights necessary to enable other Products to use or interface with any specific parts of a Microsoft Product
that incorporate Your Feedback; and (c) You will not give Microsoft any Feedback (i) that You have reasonto believe is subject to any patent, copyright or other intellectual property claim or right of any thirdparty; or (ii) subject to license terms which seek to require any Microsoft Offering incorporating or derivedfrom such Feedback, or other Microsoft intellectual property, to be licensed to or otherwise shared withany third party.
6. Microsoft has no obligation to maintain confidentiality of any Microsoft Offering, but otherwise theconfidentiality of Your Feedback, including Your identity as the source of such Feedback, is governed byYour NDA.
7. This agreement is governed by the laws of the State of Washington. Any dispute involving it must bebrought in the federal or state superior courts located in King County, Washington, and You waive any
defenses allowing the dispute to be litigated elsewhere. If there is litigation, the losing party must pay theother partys reasonable attorneys fees, costs and other expenses. If any part of this agreement isunenforceable, it will be considered modified to the extent necessary to make it enforceable, and the
remainder shall continue in effect. This agreement is the entire agreement between You and Microsoftconcerning these Materials; it may be changed only by a written document signedby both You and Microsoft.
Microsoft Confidential. 2006 Microsoft Corporation. All rights reserved. By using orproviding feedback on these materials, you agree to the attached license agreement.
Please provide feedback at BI Feedback Alias.
mailto:[email protected]?subject=BIFEEDBACK:mailto:[email protected]?subject=BIFEEDBACK: -
8/7/2019 BI Archi + Design 01 - ReadMe-3.0
4/6
Who Should Read This GuideThis guide is intended for software architects and developers who are developing
Business Intelligence applications on the Microsoft .NET Framework using SQL Server
2005 - Integration Services, Analysis Services, Reporting Services and Microsoft Office.
What You Must KnowTo most effectively use this guidance, you should already have experience using SQL
Server 2005, .NET development techniques and technologies. You should be familiar
with general distributed application architecture challenges, and, if you have already
implemented business intelligence solutions, you should know your own application
architecture and deployment pattern.
Where we areWe are in the early stage of Business intelligence architecture guide. This guide
address architectural and design aspects of Business intelligence. We anticipate gaps in thisguide as we are doing release at the very early stage. This guide is evolving guide and we willincorporate the valuable feedback from the readers.
Out of ScopeWe will not be providing any business solutions nor discuss any domain specific business
problems. Concepts discussed in this guide are well suited for Microsoft BI solution framework.
This guide will not dwell deep into all the Microsoft product feature sets rather focus on core
functionalities.
What Is in This GuideThis guide consists of the following chapters, each of which deals with a specific issue
relevant to business intelligence. Each chapter is designed to be read, in whole or in part,
according to your needs.
Microsoft Confidential. 2006 Microsoft Corporation. All rights reserved. By using orproviding feedback on these materials, you agree to the attached license agreement.
Please provide feedback at BI Feedback Alias.
mailto:[email protected]?subject=BIFEEDBACK:mailto:[email protected]?subject=BIFEEDBACK: -
8/7/2019 BI Archi + Design 01 - ReadMe-3.0
5/6
In Release 4.0 (Final) we will be covering the following chapters.
BI Framework Data Extraction
Data Staging
Data Transformations and Data Quality
Data Loading
Dimensional Modeling
Data Partitions
Online Analytical Processing (OLAP)
Data Mining
Introduction. This chapter examines the challenges you might face when designing
and building business intelligence applications. It then discusses some of the high-
level architectural challenges, solutions and provides guidance to help you determine
and build an architecture right for your application. This guide will introduce you a BI
frame to help you organize and prioritize challenges. Use the design guidelines in this
chapter to learn practices, principles, patterns, and anti-patterns that will help you to
make informed choices.
DataExtraction. This chapter examines the various extraction models and
techniques. It also covers the various options available for doing extraction in
Microsoft Product Stack. Address the most frequent challenges faced during
extraction like delta detection, high volume etc.
DataStaging. This chapter examines the thoughts behind stage or not to stage and
types of staging
Data Transformations and Data Quality: This chapter examines the various data
quality problems and proposes the solutions. Common transformations techniques
and guidelines are detailed in this chapter.
DataLoading. This chapter examines the challenges faced in loading and provides
options to address it. This chapter provides loading guidelines.
Microsoft Confidential. 2006 Microsoft Corporation. All rights reserved. By using orproviding feedback on these materials, you agree to the attached license agreement.
Please provide feedback at BI Feedback Alias.
Meta data, Security,Performance & Operations
Part-I
Data
Source
Part-II
DataExtraction
Data QualityDataTransformationDataLoadingDataStaging
Part-III
Dimensional
ModelingDataPartitions
Part-IV
OLAPDataMining
Part-V
HostFormatPresentation
SOURCE
SOURCE
INTEGRATION
INTEGRATION STORAGE
STORAGE ANALYSIS
ANALYSIS
PRESENTATION
PRESENTATION
http://mswikis/biwiki/Pages/Chapter%201%20Introduction.aspxhttp://mswikis/biwiki/Pages/Chapter%201%20Introduction.aspxhttp://mswikis/biwiki/Pages/Chapter%204%20Data%20Integration.aspxhttp://mswikis/biwiki/Pages/Chapter%204%20Data%20Integration.aspxhttp://mswikis/biwiki/Pages/Chapter%204%20Data%20Integration.aspxhttp://mswikis/biwiki/Pages/Chapter%204%20Data%20Integration.aspxhttp://mswikis/biwiki/Pages/Chapter%204%20Data%20Integration.aspxhttp://mswikis/biwiki/Pages/Chapter%204%20Data%20Integration.aspxmailto:[email protected]?subject=BIFEEDBACK:http://mswikis/biwiki/Pages/Chapter%204%20Data%20Integration.aspxhttp://mswikis/biwiki/Pages/Chapter%204%20Data%20Integration.aspxhttp://mswikis/biwiki/Pages/Chapter%204%20Data%20Integration.aspxmailto:[email protected]?subject=BIFEEDBACK:http://mswikis/biwiki/Pages/Chapter%201%20Introduction.aspx -
8/7/2019 BI Archi + Design 01 - ReadMe-3.0
6/6
Dimensional Modeling: This chapter details the dimensional modeling techniques
on design guidelines for facts, dimensions. It explains the common guidelines and
solutions for the general design problems.
Data Partitions: This chapter details the techniques that can be adopted for
designing the partitions. The basic advantage of partitions is to reduce the loading
time and so the availability is increased, and boosting the query performance
Online Analytical Processing (OLAP): This chapter details the concept and
implementation details of OLAP. It has the guidelines that can be considered for
various custom measures, storage structures, aggregations and querying the multi
dimensional data.
Data Mining: This chapter details the basic concept of Data Mining, need of data
mining, techniques, guidelines and customer scenarios for choosing the right data
mining model
Collaborators and Reviewers
Special thanks to our reviewers:
Special thanks to our external reviewer:
Thanks to our editors and release team:
Thanks to our test team:
Thanks to our product management:
Feedback on the GuideWe have made every effort to ensure the accuracy of this guide. We are particularly
interested in feedback regarding the following:
Technical issues specific to recommendations
Usefulness and usability issues Writing and editing issues
Email your valuable feedback to [email protected]. We sincerely appreciate yourvaluable feedback.
Microsoft Confidential. 2006 Microsoft Corporation. All rights reserved. By using orproviding feedback on these materials, you agree to the attached license agreement.
Please provide feedback at BI Feedback Alias.
mailto:[email protected]:[email protected]?subject=BIFEEDBACK:http://msdn.microsoft.com/practicesmailto:[email protected]:[email protected]?subject=BIFEEDBACK: