wouter smit about the speaker wouter has been working in the data warehousing field for more than 10...

36

Upload: adrian-powers

Post on 22-Dec-2015

214 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator
Page 2: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Upgrading DTS Packages to Microsoft SQL Server Integration Services

Wouter Smit

Page 3: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

About the Speaker

Wouter has been working in the data warehousing field for more than 10 yearsMCITP Professional

Database AdministratorDatabase DeveloperBusiness Intelligence Developer

Worked on a multitude of database platformsWorking for a company called 3fifteen technology solutions

Page 4: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

About this session

A presentation that was done at the North American Tech-EdDone by Brian Knight

SQL Server MVP, and co-founder of SQLServerCentral.com and JumpstartTV.comwww.PragmaticWorks.com

Written ten SQL Server books

Page 5: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Mapping DTS Knowledge and Skills to SSISRunning DTS Packages in SQL 2005 or 2008Upgrading DTS PackagesUpgrading ActiveX Scripts

Agenda

Page 6: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Why Choose SSIS?

64bit supportParallel in-memory multi buffer architecture helps to load data several times faster than DTSLogging, configuration, CheckPoint etc.Source Safe Integration because everything is XMLMany new tasks (e.g. Script Task, For Each Loop, XML Task etc.) that replace need for ActiveX

Page 7: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

DTS vs. SSIS Engine Speed Test

DTSSSIS SQL Server Destination

SSIS OLE DB Destination

Average Runtime (seconds)

33.2 s 11.3 s 12.3 s

On 32 bit dual core machinePulling 1 million rows out and writing to SQL table with no transformationSSIS 65% + faster than DTSAdding transformation would add more SSIS advantagePackage needs to run from the destination server

Page 8: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Designing Packages

DTS Designer

Page 9: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Designing Packages

Business Intelligence Development Studio (BIDS)

Page 10: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Comparing DTS to SSIS Objects

Transform Data Task

Page 11: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Comparing DTS to SSIS Objects

Data Flow Task

Page 12: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Connections

DTS Connections

Connection Managers

Page 13: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

SSIS Quick Mapping

demo

Page 14: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Project Options

Run DTS in 2005 or 2008Missing the package logsRuns under 32 bit

Upgrade using MS WizardNot compatible with most package

Upgrade using DTS xChangeMinutes per package

Starting from scratchAbout 3-6 hrs per package conservatively

Page 15: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Running Packages Under 2005+

Need to download DTS Designer Components (part of SQL Server 2005 Feature Pack)Pro:

Delays the upgrade hurdleCon:

Cannot create new packages (easily)Logging views historically in SQL Server 2000 not availableRuns in 32 bit mode only (WOW)Support ceases in vNext

Page 16: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Common Errors

Need to Install the 2005 Backward Compatibility Kit2005 DTS Designer Components

In SQL 2008, copy two additional DLL files over and RLL files

Common Errors

Page 17: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Running DTS Package in SQL Server 2005/2008

demo

Page 18: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Microsoft Package Upgrade Wizard

Built into SQL Server 2005/2008Pros:

FreeWorks on simple packages

Cons:Does not handle ODBCOnly handles a few types of text file use casesNo Dynamic Properties TaskNo UDL or legacy database support in data pumpPackages only have about a 20% chance of working

Page 19: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Microsoft Package Upgrade WizardDemo of MS Existing Wizard

demo

Page 20: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Sample Upgrade Project Plan

Scope and Number of PackagesHow long will it take you to migrate each type of taskUse a tool to migrateUpgrade the ActiveX Script Task logicTest, test and test

Page 21: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

DTS xChange Feature HighlightsProfiles DTS packages to help with a conversion project planRapidly converts DTS Packages to SSIS (2005 or 2008) and applies SSIS best practicesConverts tasks that are not handled by the existing SQL Server conversion wizardIncludes a SSIS logging repository and reports for trending and alertingIncludes BI xPress for new SSIS packages

Page 22: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Monitor Packages

Page 23: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

DTS xChangeProfile, Convert and Monitor

demo

Page 24: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

A Few of the Conversion Rules

Support for migration of children packagesLogging to SQL Server, Text Files or via Event HandlersConsolidate Connection ManagersCreate configuration files automaticallyCreate package transactionsCheckpointsNULL handling

Page 25: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Other Advantages

Handles text files properlyHandles NULLs properlyHandles ODBC for a sourceMigrates Dynamic Properties TasksAdvanced profiler to estimate your projectFull validation of the output of the migration94%+ package success rate in customer migrations over tens of thousands of packages

Page 26: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Extract/Load Trend

Runtime TrendError/Warning Trend

Monitor Packages

Page 27: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Run Through ProfilerRun Through Package ConverterShow SSIS Auditing Framework

demo

Page 28: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

ActiveX Script Migration

All tools mentioned migrate DTS ActiveX to ActiveX in SSISActiveX migrates to SSIS but you would not want to keep it there and it may not runNeed for ActiveX Script Task has been replaced with built-in, easy to maintain SSIS tasks

File System Object = File System TaskMail objects = Send Mail Task (now has SMTP)ADO objects = Execute SQL Task

Page 29: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

DeActiveX Script Conversions

mo

demo

Page 30: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

BI xPress

Product changing names from SSIS xPressHelps audit, notify, manage and deploy packagesProvides in code reusability in SSISIntegrates with Business Intelligence Development Studio (BIDS) and Management Studio

Page 31: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

BI xPress

Page 32: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

BI xPressdemo

Page 33: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Please download a demo at: [email protected]

question & answer

Page 34: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

www.microsoft.com/teched

Sessions On-Demand & Community

http://microsoft.com/technet

Resources for IT Professionals

http://microsoft.com/msdn

Resources for Developers

www.microsoft.com/learningMicrosoft Certification and Training Resources

www.microsoft.com/learning

Microsoft Certification & Training Resources

Resources

Page 35: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

Complete an evaluation on CommNet and enter to win!

Page 36: Wouter Smit About the Speaker Wouter has been working in the data warehousing field for more than 10 years MCITP Professional Database Administrator

© 2009 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS,

IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.