sbo411_ds_reference_en.1-200

7/27/2019 sbo411_ds_reference_en.1-200

1/200

Reference Guide SAP BusinessObjects Data Services 4.1 Support Package 1 (14.1.1.0)

2012-11-22


2/200

2012 SAP AG. All rights reserved.SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAPBusinessObjects Explorer, StreamWork, SAP HANA and other SAP products and services mentioned

Copyright

herein as well as their respective logos are trademarks or registered trademarks of SAP AG in

Germany and other countries.Business Objects and the Business Objects logo, BusinessObjects,Crystal Reports, Crystal Decisions, Web Intelligence, Xcelsius, and other Business Objects productsand services mentioned herein as well as their respective logos are trademarks or registeredtrademarks of Business Objects Software Ltd. Business Objects is an SAP company.Sybase andAdaptive Server, iAnywhere, Sybase 365, SQL Anywhere, and other Sybase products and servicesmentioned herein as well as their respective logos are trademarks or registered trademarks of Sybase,Inc. Sybase is an SAP company. Crossgate, m@gic EDDY, B2B 360, B2B 360 Services areregistered trademarks of Crossgate AG in Germany and other countries. Crossgate is an SAPcompany. All other product and service names mentioned are the trademarks of their respectivecompanies. Data contained in this document serves informational purposes only. National productspecifications may vary.These materials are subject to change without notice. These materials areprovided by SAP AG and its affiliated companies ("SAP Group") for informational purposes only,without representation or warranty of any kind, and SAP Group shall not be liable for errors oromissions with respect to the materials. The only warranties for SAP Group products and services

are those that are set forth in the express warranty statements accompanying such products andservices, if any. Nothing herein should be construed as constituting an additional warranty.

2012-11-22


3/200

Contents

Introduction...........................................................................................................................15Chapter 1

Welcome to SAP BusinessObjects Data Services.................................................................151.1

Welcome...............................................................................................................................151.1.1

Documentation set for SAP BusinessObjects Data Services.................................................151.1.2

Accessing documentation......................................................................................................181.1.3

SAP BusinessObjects information resources.........................................................................191.1.4Overview of this guide............................................................................................................191.2

About this guide.....................................................................................................................191.2.1

Who should read this guide....................................................................................................201.2.2

Objects..................................................................................................................................21Chapter 2

Characteristics of objects......................................................................................................212.1

Object classes ......................................................................................................................212.1.1

Object options, properties, and attributes..............................................................................232.1.2

Descriptions of objects .........................................................................................................242.2

Annotation.............................................................................................................................272.2.1Batch Job..............................................................................................................................282.2.2

Catch ....................................................................................................................................372.2.3

COBOL copybook file format ................................................................................................412.2.4

Conditional ............................................................................................................................482.2.5

Data flow ..............................................................................................................................492.2.6

Datastore...............................................................................................................................522.2.7

Document............................................................................................................................1062.2.8

DTD.....................................................................................................................................1062.2.9

Excel workbook format ........................................................................................................1162.2.10

File format............................................................................................................................1232.2.11Function...............................................................................................................................1362.2.12

HDFS file format..................................................................................................................1372.2.13

Log......................................................................................................................................1392.2.14

Message function................................................................................................................1442.2.15

Outbound message..............................................................................................................1452.2.16

Project.................................................................................................................................1452.2.17

2012-11-223
http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-


4/200

Query transform...................................................................................................................1462.2.18

Real-time job........................................................................................................................1472.2.19

Script...................................................................................................................................1502.2.20

Source.................................................................................................................................1512.2.21

Table....................................................................................................................................1622.2.22

Target..................................................................................................................................1652.2.23

Target Writer migrated from Data Quality ............................................................................2092.2.24

Template table.....................................................................................................................2092.2.25

Transform............................................................................................................................2122.2.26

Try.......................................................................................................................................2132.2.27

While loop............................................................................................................................2132.2.28

Work flow............................................................................................................................2142.2.29

XML file...............................................................................................................................2162.2.30

XML message......................................................................................................................2182.2.31

XML schema........................................................................................................................2202.2.32

XML template......................................................................................................................2342.2.33

Smart editor........................................................................................................................237Chapter 3

Accessing the smart editor...................................................................................................2373.1

Smart editor options............................................................................................................2383.2

Smart editor toolbar.............................................................................................................2383.2.1

Editor Library pane...............................................................................................................2393.2.2

Editor pane...........................................................................................................................2393.2.3

To browse for a function......................................................................................................2423.3To search for a function........................................................................................................2433.4

Data Types..........................................................................................................................245Chapter 4

Descriptions of data types...................................................................................................2454.1

date.....................................................................................................................................2464.1.1

datetime...............................................................................................................................2484.1.2

decimal................................................................................................................................2484.1.3

double .................................................................................................................................2494.1.4

int (integer)..........................................................................................................................2494.1.5

interval.................................................................................................................................2504.1.6Limitations for long and blob.................................................................................................2504.1.7

numeric................................................................................................................................2544.1.8

real.......................................................................................................................................2544.1.9

time......................................................................................................................................2554.1.10

timestamp............................................................................................................................2564.1.11

varchar.................................................................................................................................2574.1.12

2012-11-224

Contents
http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-


5/200

Data type conversion...........................................................................................................2584.2

Date arithmetic....................................................................................................................2584.2.1

Conversion to or from internal data types.............................................................................2594.2.2

Conversion of data types within expressions........................................................................2834.2.3

Conversion among number data types.................................................................................2834.2.4

Conversion between explicit data types...............................................................................2864.2.5

Conversion between native data types.................................................................................2864.2.6

Transforms..........................................................................................................................291Chapter 5

Operation codes..................................................................................................................2915.1

Descriptions of transforms...................................................................................................2925.2

Data Integrator transforms...................................................................................................2965.3

Data_Transfer......................................................................................................................2965.3.1

Date_Generation..................................................................................................................3075.3.2Effective_Date......................................................................................................................3095.3.3

Hierarchy_Flattening.............................................................................................................3145.3.4

History_Preserving...............................................................................................................3235.3.5

Key_Generation...................................................................................................................3295.3.6

Map_CDC_Operation..........................................................................................................3315.3.7

Pivot (Columns to Rows).....................................................................................................3375.3.8

Reverse Pivot (Rows to Columns)........................................................................................3435.3.9

Table_Comparison...............................................................................................................3465.3.10

XML_Pipeline.......................................................................................................................3565.3.11

Data Quality transforms.......................................................................................................3595.4Transform configurations......................................................................................................3595.4.1

Downloading blueprints and other content objects...............................................................3655.4.2

Dynamic transform settings..................................................................................................3665.4.3

About Data Quality fields......................................................................................................3685.4.4

Associate ............................................................................................................................3705.4.5

Country ID ..........................................................................................................................3845.4.6

Data Cleanse.......................................................................................................................3865.4.7

DSF2 Walk Sequencer.......................................................................................................4155.4.8

Geocoder.............................................................................................................................4235.4.9

Global Address Cleanse.......................................................................................................4445.4.10

Global Suggestion List ........................................................................................................5055.4.11

Match..................................................................................................................................5165.4.12

USA Regulatory Address Cleanse.......................................................................................5775.4.13

User-Defined........................................................................................................................6465.4.14

Address Cleanse reference..................................................................................................6545.4.15

Platform transforms..............................................................................................................6955.5

Case....................................................................................................................................6955.5.1

2012-11-225

Contents
http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-


6/200

Map_Operation....................................................................................................................6985.5.2

Merge..................................................................................................................................7005.5.3

Query ..................................................................................................................................7015.5.4

Row_Generation..................................................................................................................7305.5.5

SQL.....................................................................................................................................7325.5.6

Validation ............................................................................................................................7365.5.7

XML_Map............................................................................................................................7465.5.8

Text Data Processing transforms.........................................................................................7665.6

Entity Extraction transform...................................................................................................7665.6.1

Functions and Procedures..................................................................................................777Chapter 6

About functions....................................................................................................................7776.1

Functions compared with transforms....................................................................................7776.1.1

Operation of a function.........................................................................................................7776.1.2Arithmetic in date functions..................................................................................................7786.1.3

Including functions in expressions........................................................................................7786.1.4

Built-in functions...................................................................................................................7806.2

Database and application functions......................................................................................7816.2.1

Descriptions of built-in functions..........................................................................................7816.3

abs.......................................................................................................................................7906.3.1

add_months.........................................................................................................................7916.3.2

ascii.....................................................................................................................................7926.3.3

avg.......................................................................................................................................7936.3.4

base64_decode...................................................................................................................7936.3.5base64_encode...................................................................................................................7946.3.6

cast......................................................................................................................................7956.3.7

chr.......................................................................................................................................7976.3.8

ceil.......................................................................................................................................7986.3.9

concat_date_time ................................................................................................................7996.3.10

count ...................................................................................................................................7996.3.11

count_distinct.......................................................................................................................8006.3.12

current_configuration ..........................................................................................................8016.3.13

current_system_configuration..............................................................................................8026.3.14

dataflow_name ....................................................................................................................8026.3.15

datastore_field_value...........................................................................................................8036.3.16

date_diff...............................................................................................................................8036.3.17

date_part .............................................................................................................................8046.3.18

day_in_month.......................................................................................................................8066.3.19

day_in_week........................................................................................................................8076.3.20

day_in_year..........................................................................................................................8086.3.21

db_type................................................................................................................................8096.3.22

2012-11-226

Contents


7/200

db_version...........................................................................................................................8106.3.23

db_database_name..............................................................................................................8126.3.24

db_owner.............................................................................................................................8136.3.25

decode.................................................................................................................................8136.3.26

decrypt_aes.........................................................................................................................8156.3.27

decrypt_aes_ext...................................................................................................................8166.3.28

double_metaphone...............................................................................................................8176.3.29

encrypt_aes.........................................................................................................................8186.3.30

encrypt_aes_ext...................................................................................................................8196.3.31

error_context.......................................................................................................................8206.3.32

error_message.....................................................................................................................8216.3.33

error_number.......................................................................................................................8216.3.34

error_timestamp...................................................................................................................8216.3.35

exec.....................................................................................................................................8226.3.36

extract_from_xml..................................................................................................................8266.3.37

file_exists ............................................................................................................................8286.3.38

fiscal_day.............................................................................................................................8286.3.39

floor.....................................................................................................................................8296.3.40

gen_row_num_by_group......................................................................................................8306.3.41

gen_row_num .....................................................................................................................8316.3.42

gen_uuid..............................................................................................................................8326.3.43

get_domain_description.......................................................................................................8326.3.44

get_env................................................................................................................................8336.3.45

get_error_filename ..............................................................................................................8346.3.46

get_file_attribute..................................................................................................................8346.3.47

get_monitor_filename ..........................................................................................................8356.3.48

get_trace_filename ..............................................................................................................8366.3.49

greatest...............................................................................................................................8376.3.50

host_name ..........................................................................................................................8386.3.51

ifthenelse.............................................................................................................................8386.3.52

index....................................................................................................................................8406.3.53

init_cap................................................................................................................................8416.3.54

interval_to_char....................................................................................................................8426.3.55

is_group_changed................................................................................................................8436.3.56

is_set_env............................................................................................................................8446.3.57

is_valid_date........................................................................................................................8456.3.58

is_valid_datetime..................................................................................................................8466.3.59

is_valid_decimal...................................................................................................................8486.3.60

is_valid_double.....................................................................................................................8496.3.61

is_valid_int...........................................................................................................................8496.3.62

is_valid_real.........................................................................................................................8506.3.63

2012-11-227

Contents
http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-


8/200

is_valid_time........................................................................................................................8516.3.64

isempty ...............................................................................................................................8526.3.65

isweekend ...........................................................................................................................8536.3.66

job_name ............................................................................................................................8546.3.67

Job_Run_ID.........................................................................................................................8546.3.68

jul ian....................................................................................................................................8556.3.69

julian_to_date.......................................................................................................................8556.3.70

key_generation.....................................................................................................................8566.3.71

last_date .............................................................................................................................8576.3.72

least.....................................................................................................................................8586.3.73

length ..................................................................................................................................8596.3.74

literal....................................................................................................................................8606.3.75

ln..........................................................................................................................................8626.3.76

load_to_xml..........................................................................................................................8626.3.77

log........................................................................................................................................8646.3.78

long_to_varchar....................................................................................................................8656.3.79

lookup .................................................................................................................................8666.3.80

lookup_ext...........................................................................................................................8696.3.81

lookup_seq..........................................................................................................................8756.3.82

lower ...................................................................................................................................8786.3.83

lpad .....................................................................................................................................8796.3.84

lpad_ext...............................................................................................................................8806.3.85

ltrim .....................................................................................................................................8816.3.86

ltrim_blanks .........................................................................................................................8826.3.87

ltrim_blanks_ext ..................................................................................................................8836.3.88

mail_to.................................................................................................................................8846.3.89

match_pattern......................................................................................................................8866.3.90

match_regex .......................................................................................................................8896.3.91

match_simple.......................................................................................................................8966.3.92

max......................................................................................................................................8976.3.93

min.......................................................................................................................................8986.3.94

mod.....................................................................................................................................8996.3.95

month..................................................................................................................................9006.3.96

num_to_interval....................................................................................................................9006.3.97

nvl........................................................................................................................................9026.3.98

power...................................................................................................................................9026.3.99

previous_row_value..............................................................................................................9036.3.100

print ....................................................................................................................................9046.3.101

pushdown_sql .....................................................................................................................9056.3.102

quarter.................................................................................................................................9076.3.103

raise_exception ...................................................................................................................9086.3.104

2012-11-228

Contents


9/200

raise_exception_ext ............................................................................................................9086.3.105

rand.....................................................................................................................................9096.3.106

rand_ext...............................................................................................................................9106.3.107

replace_substr ....................................................................................................................9116.3.108

replace_substr_ext...............................................................................................................9126.3.109

repository_name .................................................................................................................9146.3.110

round...................................................................................................................................9146.3.111

rpad.....................................................................................................................................9156.3.112

rpad_ext...............................................................................................................................9166.3.113

rtrim ....................................................................................................................................9186.3.114

rtrim_blanks ........................................................................................................................9196.3.115

rtrim_blanks_ext ..................................................................................................................9206.3.116

sap_openhub_processchain_execute...................................................................................9206.3.117

sap_openhub_set_read_status.............................................................................................9236.3.118

search_replace.....................................................................................................................9256.3.119

set_cdc_checkpoint.............................................................................................................9296.3.120

set_env ...............................................................................................................................9306.3.121

sleep ...................................................................................................................................9316.3.122

soundex...............................................................................................................................9316.3.123

sql .......................................................................................................................................9326.3.124

sqrt......................................................................................................................................9346.3.125

smtp_to................................................................................................................................9356.3.126

substr..................................................................................................................................9386.3.127

sum......................................................................................................................................9406.3.128

sysdate................................................................................................................................9416.3.129

system_user_name .............................................................................................................9426.3.130

systime................................................................................................................................9426.3.131

table_attribute .....................................................................................................................9436.3.132

to_char.................................................................................................................................9446.3.133

to_date................................................................................................................................9476.3.134

to_decimal ..........................................................................................................................9486.3.135

to_decimal_ext ....................................................................................................................9496.3.136

total_rows............................................................................................................................9506.3.137

trunc....................................................................................................................................9516.3.138

truncate_table......................................................................................................................9526.3.139

upper...................................................................................................................................9536.3.140

varchar_to_long....................................................................................................................9546.3.141

wait_for_file..........................................................................................................................9556.3.142

week_in_month....................................................................................................................9566.3.143

week_in_year.......................................................................................................................9576.3.144

WL_GetKeyValue ...............................................................................................................9586.3.145

2012-11-229

Contents


10/200

word....................................................................................................................................9586.3.146

word_ext .............................................................................................................................9596.3.147

workflow_name ...................................................................................................................9616.3.148

year......................................................................................................................................9626.3.149

Custom functions.................................................................................................................9626.4

To create a custom function.................................................................................................9636.4.1

To edit an existing function...................................................................................................9646.4.2

To replicate a custom function..............................................................................................9656.4.3

To delete a custom function.................................................................................................9656.4.4

About procedures................................................................................................................9656.5

Overview..............................................................................................................................9656.5.1

Requirements.......................................................................................................................9666.5.2

Creating stored procedures in a database............................................................................9676.5.3

Importing metadata for stored procedures ...........................................................................9716.5.4

Structure of a stored procedure...........................................................................................9726.5.5

Calling stored procedures....................................................................................................9736.5.6

Checking execution status ..................................................................................................9776.5.7

Scripting Language.............................................................................................................979Chapter 7

To use the scripting language...............................................................................................9797.1

Language syntax..................................................................................................................9797.2

Syntax for statements in scripts...........................................................................................9797.2.1

Syntax for column and table references in expressions........................................................9807.2.2

Strings.................................................................................................................................9817.2.3Variables..............................................................................................................................9827.2.4

Variable interpolation............................................................................................................9837.2.5

Functions and stored procedures.........................................................................................9837.2.6

Operators............................................................................................................................9847.2.7

NULL values........................................................................................................................9867.2.8

Debugging and Validation.....................................................................................................9887.2.9

Keywords.............................................................................................................................9897.2.10

Sample scripts.....................................................................................................................9927.3

Square function....................................................................................................................9927.3.1

RepeatString function..........................................................................................................9927.3.2

Metadata in Repository Tables and Views..........................................................................995Chapter 8

Auditing metadata................................................................................................................9958.1

AL_AUDIT............................................................................................................................9958.1.1

AL_AUDIT_INFO..................................................................................................................9968.1.2

Imported metadata...............................................................................................................9978.2

2012-11-2210

Contents
http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-


11/200

AL_INDEX............................................................................................................................9978.2.1

AL_PCOLUMN....................................................................................................................9988.2.2

AL_PKEY.............................................................................................................................9998.2.3

ALVW_COLUMNATTR........................................................................................................9998.2.4

ALVW_COLUMNINFO......................................................................................................10008.2.5

ALVW_FKREL....................................................................................................................10028.2.6

ALVW_MAPPING..............................................................................................................10028.2.7

ALVW_TABLEATTR...........................................................................................................10098.2.8

ALVW_TABLEINFO...........................................................................................................10108.2.9

Internal metadata................................................................................................................10118.3

AL_LANG..........................................................................................................................10118.3.1

AL_LANGXMLTEXT...........................................................................................................10128.3.2

AL_ATTR...........................................................................................................................10138.3.3

AL_SETOPTIONS..............................................................................................................10148.3.4

AL_USAGE........................................................................................................................10158.3.5

ALVW_FUNCINFO............................................................................................................10198.3.6

ALVW_PARENT_CHILD....................................................................................................10198.3.7

Operational metadata.........................................................................................................10218.4

AL_HISTORY.....................................................................................................................10218.4.1

ALVW_FLOW_STAT..........................................................................................................10228.4.2

Data Quality repository statistics tables...........................................................................1023Chapter 9

Data Quality repository statistics tables.............................................................................10239.1

Repository tables common columns...................................................................................10259.2Repository tables for USA and Global address cleanse......................................................10269.3

ADDRINFOCODEDATA....................................................................................................10289.3.1

ADDRINFOCODESUMMARY...........................................................................................10299.3.2

ADDRSTATUSCODEDATA...............................................................................................10309.3.3

ADDRTYPESUMMARY.....................................................................................................10319.3.4

ADDRVALIDATESUMMARY.............................................................................................10329.3.5

CSLSTATS........................................................................................................................10349.3.6

DPVLACSLINKSUMMARY...............................................................................................10359.3.7

DSFAUGMENTSTATS.......................................................................................................10379.3.8

DSFSEQUENCESTATS.....................................................................................................10379.3.9

MEDSTATS.......................................................................................................................10389.3.10

NCOALCERTIFICATIONDATA...........................................................................................10399.3.11

NCOALINKSUMMARY......................................................................................................10449.3.12

PAFBALASTATS...............................................................................................................10459.3.13

PSFORM3553DATA..........................................................................................................10469.3.14

SENDRIGHTADDRACCURACY........................................................................................10499.3.15

SERPADDRACCURACY...................................................................................................10519.3.16

2012-11-2211

Contents


12/200

USREGULATORYLOCKING..............................................................................................10529.3.17

Geocoder repository statistics tables.................................................................................10539.4

GEO_ASSIGN_LEVEL.......................................................................................................10549.4.1

GEO_INFO_CODE.............................................................................................................10559.4.2

Match repository statistics tables.......................................................................................10559.5

MTBRACTION...................................................................................................................10579.5.1

MTBRINFO........................................................................................................................10589.5.2

MTBRKGRP.......................................................................................................................10599.5.3

MTBRKGRPINFO..............................................................................................................10609.5.4

MTCMPCRIT.....................................................................................................................10619.5.5

MTCRITDEF.......................................................................................................................10629.5.6

MTDUPESDATA................................................................................................................10649.5.7

MTGSSRCBYSRCSTS......................................................................................................10649.5.8

MTGSSRCSTS..................................................................................................................10659.5.9

MTINFO.............................................................................................................................10669.5.10

MTINSRCBYSRC..............................................................................................................10669.5.11

MTINSRCGRPINFO...........................................................................................................10679.5.12

MTINSRCINFO..................................................................................................................10689.5.13

MTINSRCMSRC...............................................................................................................10699.5.14

MTINSRCSELECT.............................................................................................................10709.5.15

MTINSRCSTATS...............................................................................................................10739.5.16

MTKEYDEF........................................................................................................................10749.5.17

MTPROCESS....................................................................................................................10759.5.18

MTRULESRES...................................................................................................................10769.5.19

Locales and Multi-byte Functionality................................................................................1079Chapter 10

Language packs.................................................................................................................107910.1

To set locales in the Designer............................................................................................107910.1.1

To set locales in the Locale Selector..................................................................................108010.1.2

To set locales in UNIX or Linux...........................................................................................108010.1.3

Impact of locale settings on Data Services components.....................................................108110.1.4

Locale support...................................................................................................................108110.2

Locale selection.................................................................................................................108310.2.1

Code page support............................................................................................................108510.2.2

Guidelines for setting locales.............................................................................................108710.2.3

Multi-byte support..............................................................................................................109210.3

Multi-byte string functions..................................................................................................109210.3.1

Numeric data types: assigning constant values..................................................................109210.3.2

Byte Order Mark characters...............................................................................................109310.3.3

Round-trip conversion........................................................................................................109410.3.4

Column sizing.....................................................................................................................109410.3.5

2012-11-2212

Contents


13/200

Limitations of multi-byte support........................................................................................109510.4

Definitions..........................................................................................................................109510.5

Supported locales and encodings.......................................................................................109710.6

Python...............................................................................................................................1101Chapter 11

Python...............................................................................................................................110111.1

About Python ....................................................................................................................110111.1.1

Create an expression with the Python Expression editor....................................................110411.1.2

Built-in objects...................................................................................................................110811.1.3

Defined classes and methods............................................................................................110911.1.4

FlDataCollection class........................................................................................................111011.1.5

FlDataManager class..........................................................................................................111411.1.6

FlDataRecord class............................................................................................................111611.1.7

FlProperties class...............................................................................................................111811.1.8FlPythonString class...........................................................................................................111911.1.9

Python examples................................................................................................................112111.1.10

Hadoop..............................................................................................................................1127Chapter 12

Prerequisites......................................................................................................................112712.1

Configuring Hadoop for text data processing.....................................................................112812.1.1

Connecting to HDFS..........................................................................................................112812.2

Connecting to Hive............................................................................................................112912.3

Adding, configuring, and starting a Hive adapter instance ..................................................112912.3.1

Adding and configuring a Hive adapter datastore................................................................113012.3.2About partitions..................................................................................................................113012.3.3

Reserved Words................................................................................................................1133Chapter 13

About Reserved Words......................................................................................................113313.1

Glossary............................................................................................................................1137Chapter 14

Index 1155

2012-11-2213

Contents
http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-http://-/?-


14/200

2012-11-2214

Contents


15/200

Introduction

1.1 Welcome to SAP BusinessObjects Data Services

1.1.1 Welcome

SAP BusinessObjects Data Services delivers a single enterprise-class solution for data integration,data quality, data profiling, and text data processing that allows you to integrate, transform, improve,and deliver trusted data to critical business processes. It provides one development UI, metadatarepository, data connectivity layer, run-time environment, and management consoleenabling ITorganizations to lower total cost of ownership and accelerate time to value. With SAP BusinessObjectsData Services, IT organizations can maximize operational efficiency with a single solution to improvedata quality and gain access to heterogeneous sources and applications.

1.1.2 Documentation set for SAP BusinessObjects Data Services

You should become familiar with all the pieces of documentation that relate to your SAP BusinessObjectsData Services product.

What this document providesDocument

Information about administrative tasks such as monitoring, lifecycle management,security, and so on.

Administrator's Guide

Information about customer issues fixed in this release.Customer Issues Fixed

Information about how to use SAP BusinessObjects Data Services Designer.Designer Guide

Information about available SAP BusinessObjects Data Services books, languages,and locations.

Documentation Map

2012-11-2215

Introduction


16/200


Information about and procedures for installing SAP BusinessObjects Data Servicesin a Windows environment.

Installation Guide for

Windows

Information about and procedures for installing SAP BusinessObjects Data Servicesin a UNIX environment.

Installation Guide for

UNIX

Information for third-party developers to access SAP BusinessObjects Data Servicesfunctionality using web services and APIs.

Integrator's Guide

Information about the application, its components and scenarios for planning anddesigning your system landscape. Information about SAP BusinessObjects Infor-mation Steward is also provided in this guide.

Master Guide

Information about how to use SAP BusinessObjects Data Services Administratorand SAP BusinessObjects Data Services Metadata Reports.

Management Console

Guide

Information about how to improve the performance of SAP BusinessObjects DataServices.

Performance Optimiza-

tion Guide

Detailed reference material for SAP BusinessObjects Data Services Designer.Reference Guide

Important information you need before installing and deploying this version of SAPBusinessObjects Data Services.

Release Notes

A compiled master PDF of core SAP BusinessObjects Data Services books con-taining a searchable master table of contents and index: Administrator's Guide Designer Guide

Reference Guide Management Console Guide Performance Optimization Guide Supplement for J.D. Edwards Supplement for Oracle Applications Supplement for PeopleSoft Supplement for Salesforce.com Supplement for Siebel Supplement for SAP Workbench Guide

Technical Manuals

Information about building dictionaries and extraction rules to create your own ex-traction patterns to use with Text Data Processing transforms.

Text Data Processing

Extraction Customiza-

tion Guide

Information about the linguistic analysis and extraction processing features that theText Data Processing component provides, as well as a reference section for eachlanguage supported.

Text Data Processing

Language Reference

Guide

A step-by-step introduction to using SAP BusinessObjects Data Services.Tutorial

2012-11-2216

Introduction


17/200


Release-specific product behavior changes from earlier versions of SAP Busines-sObjects Data Services to the latest release. This manual also contains information

about how to migrate from SAP BusinessObjects Data Quality Management to SAPBusinessObjects Data Services.

Upgrade Guide

Highlights of new key features in this SAP BusinessObjects Data Services release.This document is not updated for support package or patch releases.

What's New

Provides users with information about how to use the Workbench to migrate dataand database schema information between different database systems.

Workbench Guide

In addition, you may need to refer to several Supplemental Guides.


Information about interfaces between SAP BusinessObjects Data Servicesand J.D. Edwards World and J.D. Edwards OneWorld.

Supplement for J.D. Edwards

Information about the interface between SAP BusinessObjects Data Servicesand Oracle Applications.

Supplement for Oracle Applica-

tions

Information about interfaces between SAP BusinessObjects Data Servicesand PeopleSoft.

Supplement for PeopleSoft

Information about how to install, configure, and use the SAP BusinessObjectsData Services Salesforce.com Adapter Interface.

Supplement for Salesforce.com

Information about interfaces between SAP BusinessObjects Data Services,SAP Applications, SAP Master Data Services, and SAP NetWeaver BW.

Supplement for SAP

Information about the interface between SAP BusinessObjects Data Servicesand Siebel.

Supplement for Siebel

We also include these manuals for information about SAP BusinessObjects Information platform services.


Information for administrators who are responsible forconfiguring, managing, and maintaining an Information

platform services installation.

Information Platform Services Administrator's Guide

Installation procedures for SAP BusinessObjects Infor-mation platform services on a UNIX environment.

Information Platform Services Installation Guide for

UNIX

Installation procedures for SAP BusinessObjects Infor-mation platform services on a Windows environment.

Information Platform Services Installation Guide for

Windows

2012-11-2217

Introduction


18/200

1.1.3 Accessing documentation

You can access the complete documentation set for SAP BusinessObjects Data Services in severalplaces.

1.1.3.1 Accessing documentation on Windows

After you install SAP BusinessObjects Data Services, you can access the documentation from the Start

menu.1. Choose Start > Programs > SAP BusinessObjects Data Services 4.1 > Data Services

Documentation > All Guides.

2. Click the appropriate shortcut for the document that you want to view.

1.1.3.2 Accessing documentation on UNIX

After you install SAP BusinessObjects Data Services, you can access the documentation by going to

the directory where the printable PDF files were installed.1. Go to /doc/book/en/.

2. Using Adobe Reader, open the PDF file of the document that you want to view.

1.1.3.3 Accessing documentation from the Web

You can access the complete documentation set for SAP BusinessObjects Data Services from the SAPBusinessObjects Business Users Support site.

To do this, go to http://help.sap.com/bods.

You can view the PDFs online or save them to your computer.

2012-11-2218

Introduction
http://help.sap.com/bodshttp://help.sap.com/bods


19/200

1.1.4 SAP BusinessObjects information resources

A global network of SAP BusinessObjects technology experts provides customer support, education,and consulting to ensure maximum information management benefit to your business.

Useful addresses at a glance:

ContentAddress

Information about SAP Business User Support pro-grams, as well as links to technical articles, down-loads, and online forums. Consulting services canprovide you with information about how SAP Busines-

sObjects can help maximize your information manage-ment

sbo411_ds_reference_en.1-200

Documents