basic introduction of data warehousing from adiva consulting

Post on 22-Jan-2015

308 Views

Category:

Technology

0 Downloads

Preview:

Click to see full reader

DESCRIPTION

Basic Introduction of Data Warehousing

TRANSCRIPT

Hyperion Essbase & Planning Training

www.adivaconsulting.com1

BASIC INTRODUCTION OF DATA WAREHOUSING

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Raw Data

2

Raw Data will be no use until it will become information

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Raw Data -> Information

3

How do you find out the

profit of Product

“Electronics” from 100’ s of Excel

sheets

Metadata

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Then what is OLTP

In general, All Database Systems are OLTP • Most RDBMS systems are OLTP• Detailed, Up to Date Data• Read/Update of few records• Run the business in real time• Historical Data will be archived for performance reasons

Eg: Walk into Reliance Store you will find OLTP

Walk into ATM you will find OLTP

Buy TV in electronic shops

Buy Stocks in Broker like Etrade -> OLTP

4

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Current Challenges• I can’t find the data I need

– data is scattered over the network– many versions, subtle differences– No Single source for Information

• I cant understand the data I found– available data poorly documented

• I can’t use the data I found– results are unexpected– data needs to be transformed from one

form to other

What's certain about today's business climate is uncertainty

5

Hyperion Essbase & Planning Training

www.adivaconsulting.com

What is Data Warehouse

• A single, complete and consistent store of data obtained from a variety of different sources made available to end users in a what they can understand and use in a business context.

- Barry Delvin

6

Hyperion Essbase & Planning Training

www.adivaconsulting.com

In Other Words

• A data warehouse is a subject-orientedIntegrated time-varying non-volatile collection of data that is used primarily in organizational decision making.--------Bill Inmon

7

Hyperion Essbase & Planning Training

www.adivaconsulting.com

OLTP -> OLAP

8

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Why do you need the history

9

Study the past if you define the future

Hyperion Essbase & Planning Training

www.adivaconsulting.com10

Data WarehouseRelational Detail Star SchemasCommon Dimensions Common TransformationsData Models

GL Excel Sheets/Flat FilesHR

ETL

Dashboard Reporting

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Data Mart

11

MarketingMart

HR Data Mart

Sales Data Mart

Data Marts

DataWarehouse

Data grouped for a specific subject area and considered as subset of data warehouseCan contain atomic data and summarized data.Generally Each data mart is designed for each department like Marketing, Sales etc.

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Dimension Tables

• Dimension tables establish the context of the facts• In other words, Dimensional tables store fields that

describe the facts • Eg: Time Periods, Products, Customers etc

12

Fact TableFact tables are used to record actual facts or measures in the business.Facts are the numeric data items that are of interest to the business Access via dimensions

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Types of Measures-Facts

• Additive: Valid to SUM up to any Dimensional level

-SUM(Sales_Amount)

• Semi-Additive: Semi-Additive measures are measures that can be added across some, but not all dimensions. For example the bank account balance is simply a snapshot in time and cannot be summed over time.

-Sum(balance) where month=2011-12-12

• Non-Additive=never used in a Sum• Eg: Gross-Margin , Ratios etc...;

13

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Slowly Changing Dimensions

• Type-I SCD (Over write)

• Type-II SCD (Maintain History)

• Type-III SCD(Alternate Realities)

Cust ID Cust Name Cust City

10 XYZ New York

Cust ID Cust Name Cust City

10 XYZ SeattleChange of Attributes

No History Maintained

Cust ID Cust Name Cust City Date

10 XYZ New York 1-Jan-2000Change of Attributes

ALL History Maintained

Cust ID Cust Name Cust City Date

10 XYZ New York 1-Jan-2000

10 XYZ Seattle 1-Jan-2005

Cust ID Cust Name Cust City

10 XYZ New York

Cust ID Cust Name Cust City1 Cust City 2

10 XYZ New York SeattleChange of Attributes

History In Separate columns

14

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Schema Design

Schema Types Star SchemaSnow-Flake SchemaFact Constellation schema or Galaxy Schema

15

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Star Schema

• A single fact table and for each dimension one dimension table

16

Fact Table (or)

Measures

Time

Product Scenario

Customers

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Snow Flake Schema

• Represent dimensional hierarchy directly by normalizing tables.• Gives more Detailed Information

17

Fact Table (or)

Measures

Time

Product Scenario

Countries Cities

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Fact Constellation

• Multiple Fact Tables that share multiple dimensional tables

18

Fact Table (or)

Measures

Time

Product Scenario

Customers

Revenue

Hyperion Essbase & Planning Training

www.adivaconsulting.com

DWH Cycle

19

Oracle

Flat Files

DB2

Staging Area ETL Enterprise

DWH

DM1

DM3

DM2OLAP

Business Decision Reports

Hyperion Resource

MDM / DRM

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Dimensional Modeling Design Process

• Choose a business process to model

- Business activity that is valuable to analyze

-Set of transactions that can be collected in a fact table• Declare the Grain of the fact table

-level of detail that you will record in the fact table• Choose the Dimensions

-Descriptive information about transactions

-Usually want to limit number of dimensions• Choose the Metrics

-Numeric fields tagged to each fact table row

20

Hyperion Essbase & Planning Training

www.adivaconsulting.com

EPM

Enterprise Performance ManagementA set of processes that help organizations optimize

their business performance. It is a framework for organizing, automating and analyzing business methodologies , metrics, processes and systems that drive business performance

The products formerly known as Hyperion provide Enterprise Performance Management ("EPM")

capabilities

21

Hyperion Essbase & Planning Training

www.adivaconsulting.com22

Basic Introduction of Hyperion Essbase

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Multi Dimensional Analysis

• Query tool caches pre-computed aggregates in memory or on mid-tier server for extra-fast response time.

• Used to Analyze the future business based on past and present sales

Eg: Sales Analysis• Avoid spending time in analyzing huge numbers of daily

transactions data• Essbase stands for Extended Spreadsheet Analysis• Used to Analyze data in multiple view of perspective so that

business users can take decision for forecast analysis

23

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Advantages of MOLAP

Hyperion is multi Slice Dice

dimensional database

24

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Drill-Down/Up

25

Rollup

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Essbase History

Arbor Corporation Essbase

1992

Hyperion Solutions

1998

EssbaseHyperion Enterprise

Hyperion Reporting

Planning and Budgeting

Oracle Corporation

Oracle EPM System

BI Foundation

Essbase2007

26

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Cube means

27

Intersecting Dimensions -- Form Data CellsOLAP Storage Paradigm -- Multidimensional databases are array structures , not related tables -- Will concentrate about cells not fields

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Essbase is tuned for Analysis• Which customers are most profitable• What is the customer likely to buy next• What if demand falls short of forecast

28

Why Essbase• Richest business users experience• Highly Advanced Calculation Engine• Write-Back Capability Feature

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Essbase Introduction

Part of Business Intelligence Foundation in Oracle EPM System widely considered to be the industry leading OLAP (On-Line Analytical Processing) server

It is a multidimensional database that enables Business Users to analyze business data in multiple views/prospective and at different consolidation levels. It stores the data in a multi dimensional array

Essbase

Planning &

Budgeting

Forecasting

Product Analysis

Customer Analysis

Essbase Usage

Minute->Day->Week->Month->Qtr->YearProduct Line->Product Family->Product Cat->Product sub Cat

29

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Essbase Architecture

30

Essbase Server

Essbase Database

Provider Services

Smart-View

Essbase Excel-Add-in, MaxL ,

MDX

TCP/IP

TCP/IP HTTP

Administration Services

EssbaseStudio ServicesRDMS

ODBC

A

B

D E

C

F

A

B

D E

C

F

TCP/IP

HTTP

EAS Console

Essbase StudioConsole

Database Tier

Middle Tier

Client Tier

Hyperion Essbase & Planning Training

www.adivaconsulting.com

How Essbase Thinks

31

Multidimensional Cubes Dimensions Common grouping of master data like Organization , Products, AccountsOptimized Data Storage Block Storage Aggregate Storage XOLAP Drill Through Reporting

Hyperion Essbase & Planning Training

www.adivaconsulting.com

How Essbase Cubes Looks Like

32

Hyperion Essbase & Planning Training

www.adivaconsulting.com

ESSBASE STUDIO• Single graphical modeling environment and single setup for

Essbase app building and administration

33

Hyperion Essbase & Planning Training

www.adivaconsulting.com

How business users Analyze Data

34

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Oracle EPM Workspace

• Single thin client environment bringing all of the EPM system and BI tools together in one access point

35

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Integration with BI Tools – Smart View Addin

• Common add-in to provide integration with Microsoft office for oracle EPM system and BI tools like Essbase, Planning, OBIEE, HFR

36

Hyperion Essbase & Planning Training

www.adivaconsulting.com

User Security – Shared Services Console

37

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Life Cycle Management – Migration Tool

38

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Complete EPM System

39

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Life Cycle of Essbase

Database Objects- Outline File- Rule Files- Calculation Scripts

40

Create an Application(ASO or BSO) Create an DatabaseDimension ModelingData LoadingReport GenerationHyperion Daily Maintenance Activities

Hyperion Essbase & Planning Training

www.adivaconsulting.com

Continuation

• Hyperion Essbase Installation• Hyperion Services Order• Essbase Log Files• Essbase Applications Path

41

Hyperion Essbase & Planning Training

www.adivaconsulting.com42

Thank you

top related