normailzed tranformation

7/30/2019 Normailzed Tranformation

1/63

IBM DataStage 8.5 Beginners Guide - Lab#13

Aggregate Transformation

Description: BISP is committed to provide BEST learning material to the

beginners and advance learners. In the same series, we have prepared

a list of beginners guide and FAQs for IBM Data Stage. We have built

complete financial Data Model and various data transformation

techniques. Download many such learning documents, student guide,

Lab Guide and Hands-on practice materials. This document describesin step by step manner how to de-normalized and convert transaction

model to OLAP model. Data is coming from multiple flat files sources

and loading into Target tables Join our professional training to

learn from Experts.

www.bispsolutions.com www.bisptrainigs.com Page 1
http://www.bispsolutions.com/http://www.bisptrainigs.com/http://www.bispsolutions.com/http://www.bisptrainigs.com/


2/63

Contents

Contents.......................................................................................................................... 2

Source Data Model:-........................................................................................................ 3

Target Data Model:-......................................................................................................... 3

Steps to Perform Normalized Transformation..................................................................9

Loading Product Dimension........................................................................................... 26

Loading Supplier Dimension.......................................................................................... 38

Loading Employee Dimension........................................................................................47

Loading Store Dimension...............................................................................................55



3/63

Source Data Model:-

Target Data Model:-



4/63

Customer Source Model and Mapping Sheet:-



5/63

Product Source Model and Mapping Sheet:-



6/63

Supplier Source Model and Mapping Sheet:-



7/63

Employee Source Model and Mapping Sheet:-



8/63

Store Source Model and Mapping Sheet:-



9/63

Steps to Perform Normalized TransformationStep-1 :- In Windows Click Designer Client of DataStage

Step-2 :- New Window open than click Jobs than click Parallel because we use parallel

jobs.



10/63

Load the Customer Dimension

Step-1:- First go on Database Palette than scroll the cursor and choose oracle

enterprise stage and drag them to Parallel Job and rename it.



11/63

Step-2:- Choose Join stage from processing palette this is used for making relationship

between input tables.

Step-3 :- For making connection between them we choose link from general palette.

Step-4:- Double click on oracle stage and choose directly load table from database.

Now specify your table name and credentials for accessing this table from database.



12/63

Step-5:-There's one more option here once you click on connection tab then remote

server options are popup then we have to specify our server name of oracle.

Step-6 Go to Columns tab and enter same column names as declared in Input file and

put data type, length then click on View Data. This will show your Input Data.



13/63

Step-7:- Now click on View Data and Ok. If your data is shown like this that means you

have made successful connection between input table and DataStage otherwise it will

give some error like column mismatch error.

Step-8:- Now Apply same thing in customer_type table specify table and credentials.



14/63







15/63

Step-11 :- Now click on View Data and Ok. If your data is shown like this that means

you have made successful connection between input table and DataStage otherwise it

will give some error like column mismatch error.




16/63

Step-13:- Now click on View Data and Ok. If your data is shown like this that meansyou have made successful connection between input table and DataStage otherwise it


Step-14:- The Join stage is a processing stage. It performs join operations on two or

more data files input to the stage and then outputs the resulting oracle table. The Join

stage is one of three stages that join tables based on the values of key columns.



17/63

Step-15:- Now there are basically four types of joins, in this we used inner join.

Step-16:- Here we specify partition as we choose auto partition technique with the

help of this datastage automatically choose best partition technique for our job.



18/63

Step-17:- Now Go to output tab and create mapping, select all columns and drag and

drop in output space.

Step-18:- This is second join we used choose key value and apply join,



19/63


Step-20:- Here we specify partition as we choose auto partition technique with the

help of this datastage automatically choose best partition technique for our job.



20/63



Step-22 :- Now double click on Oracle enterprise stage than it looks like it and wehave to enter our table name here in which table we want to insert our data and there

multiple options if we directly want to load data than we simple used write method as

load otherwise we manually put queries on it and also we have to specify

username/password on it this password should be matched with oracle

username/password..



21/63

Step-23:- We don't have target table that's why we choose create mode here and

apply credentials.



22/63

Step-24:- See here my server name is ORCL and username password and table name

than ensure you put correct information than you able to load the data into table..

Step-25:- Click on column tab and see all the columns are showing or not.



23/63

Step-26:- This shown like this and now click on button for compiling our job.

Step-27:- If this shown that means your compilation is done otherwise it shows error

and now click on run button or (CTRL+F5).



24/63

Step-28:- Now click on Run tab and notice some options available here. We have

selected No limit of warnings and we can validate before run the job.

Step-29:- After click on run wait for a while than it shows GREEN line that means your

transformation is successfully done otherwise if it shows RED Line that means not Done

and BLUE Line means Under Process.



25/63

Step-30:- Now Go to SQL Console and connect with the same login credentials as I

mentioned in oracle enterprise stage src_creditcard/password so you can choose your

own username and password. Before loading, remember to check structure of this file

is available and then you should be able to load the data. then simple query:



26/63

Loading Product Dimension

Step-1 :- See choose files and oracle stage from palette and now for this product

model we have to apply same process.



27/63

Step-2:- Double click on Input file and browse an input file that can be .txt, .csv any

test file.

Step-3:- Go to column tab and put all product columns and view data, if it shows like

this that means we successfully able to load data from flat file to datastage.

Step-4:- Now Apply same thing in packaging table specify table and credentials.



28/63




Step-6:- Now Apply same thing in brand table specify table and credentials.



29/63




Step-8:- Now Apply same thing in category table specify table and credentials.



30/63









31/63






32/63







33/63



Step-16 :- Now double click on Oracle enterprise stage than it looks like it and we

have to enter our table name here in which table we want to insert our data and there





34/63


username/password..


apply credentials.

See here my server name is ORCL and username password and table name than

ensure you put correct information than you able to load the data into table..



35/63





36/63


transformation is successfully done otherwise if it shows RED Line that means not Doneand BLUE Line means Under Process.



37/63







38/63

Loading Supplier Dimension

Step-1 :- See choose files and oracle stage from palette and now for this suppliers




39/63

Step-2:- Now Apply same thing in suppliers table specify table and credentials.






40/63

Step-4:- Now Apply same thing in supplier_type table specify table and credentials.



41/63









42/63






43/63

Step-9 :- Now double click on Oracle enterprise stage than it looks like it and we have

to enter our table name here in which table we want to insert our data and there




username/password..



44/63


apply credentials.






45/63







46/63







47/63

Loading Employee Dimension

Step-1 :- See choose files and oracle stage from palette and now for this employees


Step-2:- Now Apply same thing in employee table specify table and credentials.



48/63

Step-3:- Now click on View Data and Ok. If your data is shown like this that means youhave made successful connection between input table and DataStage otherwise it will


Step-4:- Now Apply same thing in department table specify table and credentials.



49/63






50/63







51/63








username/password..



52/63


apply credentials.





53/63





54/63










55/63

Loading Store Dimension

Step-1 :- See choose files and oracle stage from palette and now for this store model

we have to apply same process.

Step-2:- Now Apply same thing in store table specify table and credentials.



56/63






57/63

Step-4:- Now Apply same thing in store_region table specify table and credentials.






58/63






59/63






60/63






username/password..


apply credentials.





61/63





62/63










63/63

normailzed tranformation

Documents