sql server integeration services

7/27/2019 SQL Server Integeration Services

1/29


2/29


3/29

Integration Services is a brand-new application that is part ofthe Microsoft SQL Server Business Intelligence platform

that enables the development of end-to-end BI applications.

SQL Server Integration Services(SSIS), Analysis Services(SSAS),and Reporting Services(SSRS) all use a common MicrosoftVisual Studio based development environment called theBusiness Intelligence Development Studio(BIDS).

BIDS provides an integrated development environment (IDE)for BI application development.


4/29

SSIS SSAS SSRS

Data acquisition fromsource systems andintegration

Data transformationand synthesis

Data enrichment withbusiness logic andhierarchical views

Data discoverythrough data mining

Data presentationand distribution

Data access for

the masses

Integrate Analyze Report


5/29


6/29


7/29


8/29

o SSIS packages can be created in BIDS (Business IntelligenceDevelopment Studio). These can be used to merge datafrom heterogeneous data sources into SQL Server. They canalso be used to populate data warehouses, to clean andstandardize data, and to automate administrative tasks.

o Contains all the items you need to move data or create awork flow with minimal or no code.

o The Package Designer contains four tabs: Control flow

Data Flow

Event Handlers

Package Explorer


9/29


10/29

In a control flow we define workflow to complete a task

No Package on SSIS can be made without having a ControlFlow

A control flow consists of various Containers and Tasks

Containers:

For Loop Container

For Each Loop Container

Sequence Container


11/29


12/29

Execute SQL Task:- Used to execute SQL statement or storedprocedure against SQL server or other database.

Script Task:- It is a powerful tool for customizing packageseither by VB or C# language.

Send Mail Task:- It makes It possible to generate and send

email from the package, this is helpful for altering us tocertain events such as package completion or error.

Execute Process Task: -It is used to execute an executablefile.

File System Task: -This task is used to create, delete, rename,

copy files and directories. FTP Task:-This task is used to move files between local and

remote machines.

Execute Package Task: -This task is conceptually very simple.Its primary purpose is to execute other child package.


13/29

Bulk Insert Task:-This task provides a way a to quickly loadlarge amount of data from flat file to SQL Server.

Data Flow Task:- This task is used to extract data from differentsources then do changes according to the business andfinally load data to the destination.


14/29

For loop Container: It allows the workflow to execute until anexpression evaluates to false.

For each loop Container: It allows the workflow to executeonce for each item in a collection.

Sequence container: it is used to execute all the tasks in agiven order and also used to follow the properties of

transaction


15/29

Precedence constraint are the traffic light of Integrationservices.

We use them to control which task to execute in a givenorder

There are three types of precedence constraint

Success

Failure

Completion


16/29

Variables Store values that a SSIS package and its containers,tasks and event handlers can use at runtime.

The scripts in the script task and the script component in dataflow can also use variables.

Integration Services supports two types of variables:

User defined variables

System variables


17/29

A data flow task is a task which has a separate design paneunder which we implement ETL functionality.


18/29

The Data Flow task encapsulates the data flow engine thatmoves data between sources and destinations, and lets theuser transform, clean, and modify data as it is moved.

Data source:-Data sources contain the information that SSISwill need to connect to an OLE DB-compliant system like SQLServer, Oracle, DB2, or Microsoft Access ,Microsoft Excel

Source Adapter:- Microsoft Excel, OLEDB Source, Flat file, XML

Destination Adapter:- Microsoft Excel, OLEDB Source, Flatfile,SQL Server


19/29

Transformations: Transformations are key components to thedata flow that change the data to a desired format.

Transformaions are given below:

Aggregate:-It provides several different aggregation operationlike count,avg,sum and a group by feature

Conditional Split:-It uses expression based predicates to devidethe incoming stream of data into separate outputs.


20/29

Derived column:-It also uses expression and has an expressionbuilder as its editor one can add a new column or replace

the existing one with values derived from other columns andvariables

Multicast:- This transformation is used to split data flow path tomultiple identical path

Merge:-It combine two sorted input into one sorted output

Merge Join:-It supports three types of join

o Inner Join

o Left Outer Join

o Inner Join


21/29

Lookup Transform: It provides a way to detect if a given keyexists in a reference table. There are three basic options for

how lookup transform caches the reference set Full

Partial

None

Union All:-It provides a way to combine multiple data flowsinto one data set

Audit Transformation:-It is used to create new column on a

given path that will contain system variable information

Percentage sampling:-It provides a way to select subset ofrow data


22/29

Row Count:-It provides a way to track how many rows areflowing through a particular path

Character Map: This Transformation is used for commoncharacter conversions

Data Conversions:- The Data Conversion transformationconverts the data in an input column to a different data type

and then copies it to a new output column.


23/29

Sort Transformation:-It provides a way to order rows on one ormore columns

It also provides a way to remove duplicate row

Slowly changing Dimension: The Slowly Changing Dimensiontransformation, or SCD Transform, is the most sophisticated ofthe transforms included in SSIS. It automates and standardizes

the common, yet complex problem of how to addresschanging attributes in dimensions in a data warehouse.


24/29

Fuzzy Lookup Term Lookup

Fuzzy Grouping

OLEDB Command

Pivot

Unpivot

Copy column

Term Extraction

Term Lookup

Script component


25/29

A data viewer is truly a unique feature which displays the

data that is moving between two data flow components.

It Helps in debugging, means that, using data viewer one cansee data movement within the pipeline for debuggingpurposes.


26/29

An event is the occurrence of an action during the executionlife cycle. SSIS package and components (containers, tasks)generate events at various stages of their lifetime. Customevent handlers can be written for these events to extend

package functionality and make packages easier tomanage at run time.

On Error - generated as the result of an error condition.

OnPreValidatefired before validation process starts.

OnPreExecute - indicates that an executable component isabout to be launched.

OnPostExecute - takes place after an executablecomponent finishes running.


27/29

To add an event-handler, click the Event Handlers tab in thedesigner pane, from the left combo-box select thecomponent and from the right combo-box select the event.In the below example, Employee Data Flow Task and its

OnPostExecute event have been selected. This Execute SQLTask will do cleanup work after the execution of the DataFlow Task.


28/29

QUESTIONS ???


29/29

THANK YOU!!!

sql server integeration services

Documents