data services - platform and transforms - sap
TRANSCRIPT
DS10Data Services - Platform and Transforms
..
COURSE OUTLINE.
Course Version: 15Course Duration: 3 Day(s)
SAP Copyrights and Trademarks
© 2017 SAP SE or an SAP affiliate company. All rights reserved.
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP SE or an SAP affiliate company.
SAP and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP SE (or an SAP affiliate company) in Germany and other countries. Please see http://global12.sap.com/corporate-en/legal/copyright/index.epx for additional trademark information and notices.
Some software products marketed by SAP SE and its distributors contain proprietary software components of other software vendors.
National product specifications may vary.
These materials are provided by SAP SE or an SAP affiliate company for informational purposes only, without representation or warranty of any kind, and SAP SE or its affiliated companies shall not be liable for errors or omissions with respect to the materials. The only warranties for SAP SE or SAP affiliate company products and services are those that are set forth in the express warranty statements accompanying such products and services, if any. Nothing herein should be construed as constituting an additional warranty.
In particular, SAP SE or its affiliated companies have no obligation to pursue any course of business outlined in this document or any related presentation, or to develop or release any functionality mentioned therein. This document, or any related presentation, and SAP SE’s or its affiliated companies’ strategy and possible future developments, products, and/or platform directions and functionality are all subject to change and may be changed by SAP SE or its affiliated companies at any time for any reason without notice. The information in this document is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. All forward-looking statements are subject to various risks and uncertainties that could cause actual results to differ materially from expectations. Readers are cautioned not to place undue reliance on these forward-looking statements, which speak only as of their dates, and they should not be relied upon in making purchasing decisions.
Typographic Conventions
American English is the standard used in this handbook.
The following typographic conventions are also used.
This information is displayed in the instructor’s presentation
Demonstration
Procedure
Warning or Caution
Hint
Related or Additional Information
Facilitated Discussion
User interface control Example text
Window title Example text
© Copyright. All rights reserved. iii
iv © Copyright. All rights reserved.
Contents
vii Course Overview
1 Unit 1: Data Services
1 Lesson: Defining Data Services
3 Unit 2: Source and Target Metadata
3 Lesson: Defining Datastores in Data Services3 Lesson: Defining a Data Services Flat File Format
5 Unit 3: Batch Job Creation
5 Lesson: Creating Batch Jobs
7 Unit 4: Batch Job Troubleshooting
7 Lesson: Writing Comments with Descriptions and Annotations7 Lesson: Validating and Tracing Jobs7 Lesson: Debugging Data Flows7 Lesson: Auditing Data Flows
9 Unit 5: Functions, Scripts, and Variables
9 Lesson: Using Built-In Functions9 Lesson: Using Variables, Parameters, and Scripts
11 Unit 6: Platform Transforms
11 Lesson: Using Platform Transforms11 Lesson: Using the Map Operation Transform11 Lesson: Using the Validation Transform11 Lesson: Using the Merge Transform11 Lesson: Using the Case Transform11 Lesson: Using the SQL Transform
13 Unit 7: Error Handling
13 Lesson: Setting Up Error Handling
15 Unit 8: Changes in Data
15 Lesson: Capturing Changes in Data15 Lesson: Using Source-Based Change Data Capture (CDC)15 Lesson: Using Target-Based Change Data Capture (CDC)
© Copyright. All rights reserved. v
17 Unit 9: Data Services Integrator Transforms
17 Lesson: Using Data Services Integrator Transforms17 Lesson: Using the Pivot Transform17 Lesson: Using the Data Transfer Transform
vi © Copyright. All rights reserved.
Course Overview
TARGET AUDIENCEThis course is intended for the following audiences:
● Data Consultant/Manager
● Solution Architect
● Super / Key / Power User
© Copyright. All rights reserved. vii
viii © Copyright. All rights reserved.
UNIT 1 Data Services
Lesson 1: Defining Data ServicesLesson ObjectivesAfter completing this lesson, you will be able to:
● Define Data Services
© Copyright. All rights reserved. 1
Unit 1: Data Services
2 © Copyright. All rights reserved.
UNIT 2 Source and Target Metadata
Lesson 1: Defining Datastores in Data ServicesLesson ObjectivesAfter completing this lesson, you will be able to:
● Define datastore types
Lesson 2: Defining a Data Services Flat File FormatLesson ObjectivesAfter completing this lesson, you will be able to:
● Define flat file formats
© Copyright. All rights reserved. 3
Unit 2: Source and Target Metadata
4 © Copyright. All rights reserved.
UNIT 3 Batch Job Creation
Lesson 1: Creating Batch JobsLesson ObjectivesAfter completing this lesson, you will be able to:
● Examine batch jobs
● Create a basic data flow
© Copyright. All rights reserved. 5
Unit 3: Batch Job Creation
6 © Copyright. All rights reserved.
UNIT 4 Batch Job Troubleshooting
Lesson 1: Writing Comments with Descriptions and AnnotationsLesson ObjectivesAfter completing this lesson, you will be able to:
● Write comments with descriptions and annotations
Lesson 2: Validating and Tracing JobsLesson ObjectivesAfter completing this lesson, you will be able to:
● Validate jobs
● Trace jobs
Lesson 3: Debugging Data FlowsLesson ObjectivesAfter completing this lesson, you will be able to:
● Use the interactive debugger
Lesson 4: Auditing Data FlowsLesson ObjectivesAfter completing this lesson, you will be able to:
● Audit data flows
© Copyright. All rights reserved. 7
Unit 4: Batch Job Troubleshooting
8 © Copyright. All rights reserved.
UNIT 5 Functions, Scripts, and Variables
Lesson 1: Using Built-In FunctionsLesson ObjectivesAfter completing this lesson, you will be able to:
● Use functions in expressions
Lesson 2: Using Variables, Parameters, and ScriptsLesson ObjectivesAfter completing this lesson, you will be able to:
● Use variables, parameters, and scripts
© Copyright. All rights reserved. 9
Unit 5: Functions, Scripts, and Variables
10 © Copyright. All rights reserved.
UNIT 6 Platform Transforms
Lesson 1: Using Platform TransformsLesson ObjectivesAfter completing this lesson, you will be able to:
● Describe platform transforms
Lesson 2: Using the Map Operation TransformLesson ObjectivesAfter completing this lesson, you will be able to:
● Use the Map Operation transform in a data flow
Lesson 3: Using the Validation TransformLesson ObjectivesAfter completing this lesson, you will be able to:
● Use the validation transform
Lesson 4: Using the Merge TransformLesson ObjectivesAfter completing this lesson, you will be able to:
● Use the merge transform
Lesson 5: Using the Case TransformLesson ObjectivesAfter completing this lesson, you will be able to:
● Use the case transform
Lesson 6: Using the SQL TransformLesson Objectives
© Copyright. All rights reserved. 11
After completing this lesson, you will be able to:
● Use the SQL transform
Unit 6: Platform Transforms
12 © Copyright. All rights reserved.
UNIT 7 Error Handling
Lesson 1: Setting Up Error HandlingLesson ObjectivesAfter completing this lesson, you will be able to:
● Explain the levels of data recovery strategies
© Copyright. All rights reserved. 13
Unit 7: Error Handling
14 © Copyright. All rights reserved.
UNIT 8 Changes in Data
Lesson 1: Capturing Changes in DataLesson ObjectivesAfter completing this lesson, you will be able to:
● Update data which changes slowly over time
Lesson 2: Using Source-Based Change Data Capture (CDC)Lesson ObjectivesAfter completing this lesson, you will be able to:
● Use source-based change data capture (CDC)
Lesson 3: Using Target-Based Change Data Capture (CDC)Lesson ObjectivesAfter completing this lesson, you will be able to:
● Use target-based CDC
© Copyright. All rights reserved. 15
Unit 8: Changes in Data
16 © Copyright. All rights reserved.
UNIT 9 Data Services Integrator Transforms
Lesson 1: Using Data Services Integrator TransformsLesson ObjectivesAfter completing this lesson, you will be able to:
● Use the data services integrator transforms
Lesson 2: Using the Pivot TransformLesson ObjectivesAfter completing this lesson, you will be able to:
● Use the pivot transform
Lesson 3: Using the Data Transfer TransformLesson ObjectivesAfter completing this lesson, you will be able to:
● Describe performance optimization
© Copyright. All rights reserved. 17