interface n conv

6
Data Conversion,Migration and interface ..Why important Posted on June 9th, 2007 by Sanjit Anand |  Print This Post |  Email This Post Have you joined Hub Community  Network Forums of OracleaApps professionals? Don't wait. Do it today Do you know how many ways; we can enter the data into oracle application. Most of us can guess three different ways as: The Data can be entered using the application Screens. The data can be entered using Oracle's Open System Interface. The data can be stored in the database table directly But those who works in some co mplex business environment may figure out some of more like: 3rd Party Software (for the third options) Taviz (formerly SmartDB) which is EAI tool. Crossroads See Beyond (formerly STC) Vitria Data Loader: They have macro enabled spreadsheet kind of tool More4apps And there are many more, bu t most of these are used for master data, and few cases for transaction data via Open interface if available. Importance of data conversion/migration and interfaces within any ERP implementation  project can't be ignored. Since ERP mostly deals with data which finally leads into Information , thus it is equally important to understand the aspect how "data" is important in any ERP system specailly in implementation phase, no matter how simple and unified operation is. Since I been involved in some big transformation oracle apps project thus It is a absolute a good cause to share some information about integration touch point, conversion/migration and interface development to someone who is very new to ERP world as well as Oracle application. Let's start with some common situation, we have three cases, 1. The Cust omer is runnin g there some home grown IT application which cat er most of the company need. Now management has decided to go for any ERP solutions, then the question what will happen for data which is already in the existing application?

Upload: ajay-dogra

Post on 08-Apr-2018

217 views

Category:

Documents


0 download

TRANSCRIPT

8/7/2019 Interface n Conv

http://slidepdf.com/reader/full/interface-n-conv 1/6

Data Conversion,Migration and

interface ..Why important

Posted on June 9th, 2007 by Sanjit Anand |  Print This Post |  Email This Post 

Have you joined Hub Community  Network Forums of OracleaApps professionals? Don't

wait. Do it today 

Do you know how many ways; we can enter the data into oracle application. Most

of us can guess three different ways as:

• The Data can be entered using the application Screens.

• The data can be entered using Oracle's Open System Interface.• The data can be stored in the database table directly

But those who works in some complex business environment may figure out some of 

more like:

• 3rd Party Software (for the third options)

• Taviz (formerly SmartDB) which is EAI tool.

• Crossroads

• See Beyond (formerly STC)

• Vitria

• Data Loader: They have macro enabled spreadsheet kind of tool

• More4apps

And there are many more, but most of these are used for master data, and few cases for transaction data via Open interface if available.

Importance of data conversion/migration and interfaces within any ERP implementation

 project can't be ignored. Since ERP mostly deals with data which finally leads into

Information , thus it is equally important to understand the aspect how "data" is importantin any ERP system specailly in implementation phase, no matter how simple and unified

operation is. Since I been involved in some big transformation oracle apps project thus It

is a absolute a good cause to share some information about integration touch point,conversion/migration and interface development to someone who is very new to ERP

world as well as Oracle application.

Let's start with some common situation, we have three cases,

1. The Customer is running there some home grown IT application which cater most

of the company need. Now management has decided to go for any ERP solutions,then the question what will happen for data which is already in the existing

application?

8/7/2019 Interface n Conv

http://slidepdf.com/reader/full/interface-n-conv 2/6

2. Another situation is already using ERP

a. They want to upgrade to higher version…presuming the structure of some table

get changed? Lets say 10.7 to 11i b. The company is acquired or merged with some other company, and the whole

data need to move into the parent or child company .

c. They want to enable some additional modules within existing application.3. There are few data interacting with both the cases irrespective of database

technology for where data is coming and going based out of need.

The answer of the 1 is data migration and 2 is more pronounced as data conversion where

as thirds is popularly known as Interface. The ways these are working haven't muchdifference but it is more important to understand definition and need. I never found any

 big difference between migration/conversion unless there is huge transformation of data,

the only things figure out is conversion might required some less steps to perform, asassumption is that set up related stuff been already been taken care before execution of 

activity.

Let's understand like this: Data Migration as a process of moving required (and most

often very large) volumes of data from our clients' existing systems to new systems.

Existing systems can be anything from custom-built IT infrastructures to

spreadsheets and standalone databases. Data conversion can be defined as a process

of converting data from one structural form to another to suit the requirements of 

the system to which it is migrated.

Lets take a deep drive to understand better:

Why conversion/Migration is more important in ERP?

Before Go-Live in the production environment the required master data, the open

transaction data and the historical transaction data need to be imported from the oldlegacy applications to Oracle Applications. Since data structure and data design in legacy

systems are different from those of Oracle Applications, data need to be messaged/

converted satisfying the business rules to suite the Oracle requirement. Initial data can be

migrated by any other means as discussed above depending upon cetain paramater likeVolumn, usage, complexity , business rule etc..

How we Define Data Conversion

Process where existing data from the client's old system is extracted, cleansed,formatted, and installed into a new system.

• These can be manual or automated.

• The big difference is that these are One-time only process that requires extensive

testing and preparation.

• They must be executed and performed before a system goes into production.

What Is An Interface then

8/7/2019 Interface n Conv

http://slidepdf.com/reader/full/interface-n-conv 3/6

• These are programs for connection between Two Systems In Order To

Synchronize the Data.

• They can be Manual, Batch or Real-Time.

• Used Repeatedly and Should Therefore Be Designed and Constructed In the Most

Efficient Manner Possible.

These can Be Triggered by an Event (Such As Running A Concurrent Program)Or It Can Be Scheduled To Run At A Certain Time.

• Can Be Very Costly To Construct And Maintain.

Does the conversion/migration/interface have Life Cycle

Yes, they have, because they have a significant efforts required in development and

design and implementation

• Functional Designer works with business owners to determine the data mapping

and complete the functional design using the Design Templates.

If the interface/conversion is automated, the Technical Designer convertsfunctional requirements into technical specs for the construction of the interface

 programs.

• The developer uses the functional and technical designs to build and test the

interface/conversion programs.• More rounds of testing are done until the interface/conversion is migrated to the

 production environment for deployment.

Conversion is assumed as one time activity but never looks like small activity which

can be performed with couple of days.

How conversion and interface differ?

8/7/2019 Interface n Conv

http://slidepdf.com/reader/full/interface-n-conv 4/6

There are good numbers of parameter on which they can be categorize. Take few of 

them:

• Frequency

o conversions are a one time event

o interfaces are ongoing• Occurrence in the project timeline

o conversions executed before production

o interfaces executed during production

• Manner of execution

o conversions are batch

o interfaces may be batch or real time

• Complexity

o Conversion does have very complex, its totally depends upon the data

mapping activity.

o coordinating with other systems make interfaces more complex

• Maintenanceo Maintence of interface is bit cost intensive task.

Interface Type

You have learned how interface is differ from Conversion/Migration. Now lets take fewtypes of interfaces:

 Normally in any system , there are two kinds of interface as:

Inbound Interfaces

• An inbound interface receives data from one system (legacy) and inserts into

Oracle open interface tables.• A typical inbound interface would follow these steps:

1. Extract data from legacy system into a flat file.

2. Use SQL*Loader or equivalent tool to upload information into atemporary table.

3. Write a PL/SQL program to take data from the temp table and insert into

the Open Interface Tables.4. Through the concurrent manager in Oracle Applications, run the standard

Oracle Interface program to transform interface tables into Oracle data.

Outbound Interfaces

o An outbound interface takes data from Oracle tables and inserts it into an external

system (via tables or flat file).

8/7/2019 Interface n Conv

http://slidepdf.com/reader/full/interface-n-conv 5/6

o A typical outbound interface would follow these steps:

- Write a PL/SQL program to extract data from Oracle base tables into a flat file.

- Use a custom program to read that data and post it into the legacy system

Do we have some other standard way to do interface?

• Open Interface is a table based interface registered as a concurrent program

o  process records in batches.

o spawned(Pro-C) or PL/SQL based programs.

• API (Application Program Interface) is a parameter based stored procedureo directly impacts base database tables.

o may be called from Oracle open interfaces,Forms, Reports.• EDI (Electronic Data Interchange) uses industry standard data

definitions(US/ANSI/X.12) for transmission of documents such as PO's, Invoices,

Sales Order, etc.Oracle provides some EDI transactions through EDI Gateway.(

• Enterprise Application Integration (EAI) solutions are often used when complexintegration requirements exist.

What Is An Open Interface Table (OIT)?

• For inbound interfaces, the interface table is the intermediary table where data

from the source application temporarily resides until it is validated and processed

into an Oracle base table through a standard import concurrent program.• Open Interface Tables are standard Oracle tables.

o Oracle uses OITs to provide a simple interface to Oracle base tables.

o Oracle has list of all the open interface that oracle offered in there product.

Oracle Interface Program

• Most Oracle modules have standard import programs (concurrent processes) to

facilitate custom inbound interfaces. The specific processing performed varies by

application.

• These programs pull data from the open interface tables, validate the data, and

then insert into one or more Oracle base tables.• Upon successful completion of processing, the program deletes the processed

rows from the interface table or marks them as completed.

• Depending on the import, errors can be viewed in various ways (exception

reports, error tables, forms, etc…).

Examples of standard import programs:

8/7/2019 Interface n Conv

http://slidepdf.com/reader/full/interface-n-conv 6/6

• GL: Journal Import

• AP: Payables Open Interface

• AR: Customer Interface

• INV : Item Import

• AR - Autoinvoice