applimation is the leading provider of application lifecycle management solutions thursday november...
TRANSCRIPT
Applimation is the leading provider of Application Lifecycle Management solutions
Thursday
November 20th, 2008
Diane Hallahan Account Manager
Paul Capobianco Sales Engineer
Applications Archiving
Agenda
• Overview of Applimation• Application Archiving
– Types of Archiving – Performance, Compliance, Retirement
• Database Subsetting• Intelligent Data Masking
• Informia Archive – Components and details• Informia Subset – Components and details• Informia Secure – Components and details
CONFIDENTIAL SLIDE: 2
Applimation – Broad Application Coverage
SLIDE: 3CONFIDENTIAL
A leader in enterprise data management software
Focus on business applications
Unified, integratedproduct suite
CONFIDENTIAL SLIDE: 4
Applimation: Informia Solutions
Improve ProductionDatabase Performance
Maintain Complete Application Integrity
Comply with Data Retention Regulations
Enable Accessibility to Archived Data
CONFIDENTIAL SLIDE: 5
Applimation: Informia Solutions
Test & Development Optimization
Automate the Creation of Smaller Database Copies
Update Copies with Current, Relevant Production Data
Reduce Storage Space Requirements
CONFIDENTIAL SLIDE: 6
Applimation: Informia Solutions
Protect Sensitive Application Data
Enable Safe Data Sharing
Reduce Risk of Data Breaches
Enhance Test-Data Quality
CONFIDENTIAL SLIDE: 7
Applimation: Informia Solutions
Enable Regulator Compliance
Ensure Data Accessibility
Reduce Infrastructure andLicensing Costs
CONFIDENTIAL SLIDE: 8
Applimation: Informia Solutions
Automate Divestiture Process
Preserve History and Integrity of Data
Speed
Reduced Risk
Reports completed 4 times faster
MRP Demand Planning process cut by 50%Inventory process cut from 2.5 hours to 15 mins
More than 50% improvement in Currency Translation, FSGs, and Discoverer Queries
3 mo retention policy enables consolidation of retail inventory from legacy to Oracle
Enabled never ending month-end Fixed Assets process to finish
Performance Improvement
Employee Privacy ProtectionArchive/Purge personal data in 22 countries
Data Privacy ProtectionArchive/Purge across European countries
Read-only access to archived data ensuresinformation integrity
SOX audit facilitated by read-only access toarchived data
Masking sensitive HR data in non-production environments
Compliance
Archive Before Upgrading
Shortened 11i upgrade outage by 36 hours
Reduced upgrade outage by 40%
Saved 14% of downtime during upgradeUsers return to system 7 hours sooner
Time of each upgrade test cycle reducedby 30%
Oracle beta customer archiving 11i data before upgrade to R12
Shrunk production by 46%1.3 TB 700 GB
Before: 37 TB total, 40 instances
After: 17 TB total, 40 instances
Removed 2 TB from PROD14 Envs X 2 TB = 28 TB Total Savings
6 TB savings across 23 instances
450 GB removed from production10 TB savings across 22 instances
Cut AR by 66% 900 GB 300 GB
Return on Investment
Daily
Weekly
Monthly
Quarterly
Annually
Archiving – A Repeatable Process
Scalability
5+ TB
3.5 TB
3 TB
900 GB
600 GB
300GB
Multi-stage Archiving for ILMD
ata
Acc
essi
bili
ty High
Low
Enterprise Disk
$50 - $70/GB
Modular Disk
$20 - $35/GB
Tape
$1 - $2/GB
Tape Library
$2 - $4/GB
SATA Disk
$5 - $15/GB
Archived Data
Current Data
SATA - Serial Advanced Technology Attachment SATA - Serial Advanced Technology Attachment
Systemic problems caused by data growth
IF YOU DO NOT MANAGE GROWTH
• Application Performance Degradation• Decreased Application Availability• Increased Time for Backups/Restores• Upgrades continue to take Longer• Copies of Production take Longer
• Production Size become unwieldy for testing and development
• Hardware Costs Continue• Bigger CPU / More Disk / More Memory
• Power and Cooling Costs Continue• Analysts expect U.S. companies will spend twice as much on
power and cooling by 2009 as they did to acquire their IT devices (SearchStorage.com)
Data Management – Traditional Options
• Purchase additional hardware
• DBAs tune application standard code
• Rebuild Indexes / Update Stats• Vendor provided
• Purge routines if available
THE PROBLEM: - constantly spending on hardware- tuning only does so much- purging doesn’t archive
Model ERD
CONFIDENTIAL SLIDE: 21
Applimation Informia Archive
Informia Archive
CONFIDENTIAL SLIDE: 22
Informia Archive Product Objective
Informia Archive
Complex transactional chaining
Relocating inactive data
Better performing production database
Solution
Primary Challenge
Method
Objective
What is archiving?
Archiving is an application-aware method of relocating enterprise data out of a production database.
What Archiving is NOT: (and was not repurposed from)• Backup• Disaster recovery• Mirroring• Reporting instance• Data warehouse• ETL
SLIDE: 23CONFIDENTIAL
Business Reasons to Manage Growth
Many copies of productionProject teams require many testing
and development environmentsHow Much Disk does that Total?
Increased OverheadCopies of Production take Longer
• Production Size become unwieldy
for testing and developmentHardware Costs Continue
• Bigger CPU / More Disk / More Memory
PROD
Dev 1
Dev 2
Dev 3
Dev 4
Dev x
Inactive Data
Business Reasons to Manage Growth
PROD
DEV 1
DEV 2
DEV 3
DEV 4
DEV x
Many copies of productionProject teams require many testing
and development environmentsHow Much Disk does that Total?
Increased OverheadCopies of Production take Longer
• Production Size become unwieldy
for testing and developmentHardware Costs Continue
• Bigger CPU / More Disk / More Memory
Informia Today – Broad Application and Database Support
Applimation Informia
Archive Data SubsetData onDemand
Secure
Business Applications
Oracle e-Business
SuiteSAP PeopleSoft Siebel
Custom/3rd Party
Databases
Oracle SQLServer
DB2UDB MySQL Sybase DB2
z/OS
Informia Archive Accelerators - Oracle E-Business
Oracle Financials Oracle Distribution
General Ledger GL Order Entry OE
Payables AP Order Management ONT
Receivables AR Oracle Payroll
Purchasing PO Time and Labor T&L
Fixed Assets FA Payroll HR
Cash Management CE Oracle Projects
Global Accounting Engine AX Project Accounting PA
Federal Financials FV Oracle CRM
Oracle Manufacturing Contracts Core OKC
Inventory INV Service Contracts OKS
Cost (BOM) CST/BOM Telesales AST
Work in Process WIP Collections IEX
Master Scheduling MRP Customer Online IMC
E-Records EDR iSupport - Service CS/BU
OPM – Process Execution GME Install Base CSI
OPM - Financials GMF Configurator CZ
OPM - Inventory GMI Incentive Compensation CN
Shipping WSH Oracle Sales Online
Oracle Workflow Order Capture/Quoting/Sales OSM/ASO,AS,ASF,QOT
Workflow WF/FND Sales ASN
Informia Archive Accelerators – PeopleSoft Enterprise
PeopleSoft Financials/SCM PeopleSoft HCM
General Ledger GL Human Capital Management HCM
Accounts Payable AP Payroll HPY
Accounts Receivable AR Base Benefits HBN
Purchasing PO Benefits Administration HBA
Asset Management AM Time & Labor HTL
Billing BI Expenses T&E
Project Costing PC PeopleSoft Campus Solutions
Order Management OM Student Records SR
Production Management PM Campus Community CC
Inventory INV Student Financials SF
PeopleSoft CRM Financial Aid FINAID
Cases RC Academic Advisement AA
Leads RS Recruiting and Admissions RANDA
Orders RO
Quotes RO
Informia Archive Accelerators – Siebel
Horizontal Verticals
Activities Activities
Invoices Invoices
Messages Messages
Opportunities Opportunities
Orders Orders
Change Requests (Quality)
Change Requests (Quality)
Quotes Quotes
Service Requests Service Requests
Solutions
Attachments
MDF
Accounts
Assets
Contacts
Two Important Accelerator Components
Business Rules• Transaction chaining
• Within an entity
• To other applications
• Testing of Fields, Flags& Codes
Entity Definition• Logical unit to archive
• Database and application level relationships
• Policy scoping criteria
SLIDE: 30CONFIDENTIAL
Database Archiving – What to Call it
Database Archiving
a.k.a. Active Archiving
a.k.a. Data Movement
a.k.a. Data Relocation
Done online
Separates ‘active’ data from ‘seldom’ accessed data
CONFIDENTIAL SLIDE: 32
Informia: An Enterprise Solution
ACQUIRED DIVISION
Custom BillingApplication
CALL CENTER
SHARED SERVICE CENTER
CORPORATE HQ
Oracle Applications
11.5.10
Siebel 7.8PeopleSoft
HR 8.3
SQL Server
Windows
8 Years = 800 GB
DB2 AIX
5 Years = 350 GB
Oracle 10g
Sun Solaris 10
7 Years = 1.4 TB
Sybase
HPUX
10 Years = 600 GB
Current Data
Archive for Compliance – Long Term Retention
CONFIDENTIAL SLIDE: 33
ProductionDatabase
With Online Archive
Online Archive Database
SeamlessAccessLayer
Archived Data
DataDiscoveryPortal
DataDiscoveryPortal
Direct from Production – Archive Only
Current Data
Current Data
Inactive Data
ENCAPSULATED XML ARCHIVES
Retired data
ONLINE ARCHIVE DATABASE
Meeting the Challenge – Online Archive
PRODUCTIONDATABASE
Active Data
• Always Accessible• No Developer Modifications Needed• No Customizations Required
Inactive Data(Read Only)
xml
Retire
Inactive Data(Read Only)
DBArtisan TOADOEM
Oracle APPS PeopleSoft SIEBEL
SQL Plus
DISCOVERER
CUSTOM
Seamless Access Layer
Multi-stage Archiving for Information Lifecycle Management (ILM)
CurrentData
(less than 2 years old)
Online ArchiveDatabase
(2 – 7 years old)
EncapsulatedXML Archive
(over 7 years old)
TRANSACTION 1
TRANSACTION 2
TRANSACTION 3
TRANSACTION 4
TRANSACTION 5
TRANSACTION 6
TRANSACTION 7
OPERATIONAL DATA 3
CONFIG. DATA 1
CONFIG. DATA 2
OPERATIONAL DATA 1
OPERATIONAL DATA 2
SLIDE: 35CONFIDENTIAL
Seamless Access LayerDataDiscovery
CurrentData
(less than 2 years old)
Online ArchiveDatabase
(2 – 7 years old)
EncapsulatedXML Archive
(over 7 years old)
Multi-stage Archiving for Information Lifecycle Management (ILM)
TRANSACTION 1
TRANSACTION 2
TRANSACTION 3
TRANSACTION 5
OPERATIONAL DATA 3
CONFIG. DATA 1
CONFIG. DATA 2
OPERATIONAL DATA 1
OPERATIONAL DATA 2
TRANSACTION 4
TRANSACTION 6
TRANSACTION 7
OPERATIONAL DATA 1
OPERATIONAL DATA 2
CONFIG. DATA 1
CONFIG. DATA 2
SLIDE: 36CONFIDENTIAL
Seamless Access LayerDataDiscovery
Online Archive Process – Another Look
Production History
AR Schema500+ Tables
History Schema
Only High Volume Transaction
Tables
CONFIDENTIAL SLIDE: 38
Business Rule Validation – Same Process for All Applications
Actual Candidate Summary Report
Actual Example
HistoryTables
Archive/History
Staging Area
Online Archive Process – Detailed
2002
2003
2004
2001
2002
2003
2004
2001
Production
2005
2006
2007
2008
N
N
Y
N
Y
1. Build Interim Tables and test against business rules
2. Move into Staging Area ONLY 2001 - 2004 transactions that pass business rules
3. Purge 2001 - 2004 transactions from Production
4. Merge 2001 - 2004 transactions to History location
5. Drop Staging Area
SLIDE: 40CONFIDENTIAL
Open01-OCT-20045
Closed01-MAR-20034
Open01-FEB-20033
Closed01-JAN-20022
Closed01-JAN-20011
StatusDateTxn ID
Transaction Table
APPLIMATION HOME
COMBINEDVIEW
HISTORY_ONLYVIEW
About 200+ Schemas
INV
PO
AP
GL
Online Archive Architecture – Seamless Access – More Detail
APPS
Production
HISTORY
APPLIMATION HOME
History
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
APPSPackages Tables Views
Procs, Syns, Java, etc.
APPSAPPS_COMBINED
SYN
SYN
SYN
VIEW
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
VIEW
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
SYN
VIEW
SYN
SYN
SYN
SELECT column_names from GL.GL_BALANCES UNION ALL(SELECT column_names from GL_BALANCES@HISTORY_DBLINK)
30,000 tables
29,980 have 7 years of data
20 have 2 years of data
20 tables
20 have 5 years of data
CONFIDENTIAL SLIDE: 42
The Challenge of Increasing Data Growth
BEFORE SOLUTION
Growing storage costs
Diminishing performance
Increasing maintenance &Compliance work
AFTER SOLUTION
Predictable manageable growth
Improved, stable performance
Reduced maintenance &compliance work
Seamless Data Access in Oracle Apps
• Auto-generated
• No user re-training
• Access to
• Current Only
• Current + History
• No modifications to code base
• Support for any/all query tools
Seamless Access – Application Layer
• Uses Responsibilities to enable access• No modifications to application code• No additional application server• No new user IDs• No user re-training
Seamless Data Access in PeopleSoft
• Auto-generated
• No user re-training
• Access to
• Current Only
• Current + History
• No modifications to code base
• Support for any/all query tools
Seamless Data Access for End-Users
Custom ApplicationsCustom Applications
Custom Seamless Data Access
• Auto-generated
• No user re-training
• Access to
• Current Only
• Current + History
• No modifications to code base
• Support for any/all query tools
Production Archive / HistorySchema
GL
INV
GL_BALANCES
GL_DAILY_BALANCES
GL_IMPORT_REFERENCES
GL_JE_LINES
MTL_ACTUAL_COST_SUB
MTL_CST_ACTUAL_COST_DET
MTL_MATERIAL_TRX
MTL_UNIT_TRANSACTIONS
MTL_TRANSACTION_LOT_NUM
MTL_CST_TXN_COST_DETAILS
2 Years Current
2 to 7 Years Archive
GL_BALANCES
GL_DAILY_BALANCES
GL_IMPORT_REFERENCES
GL_JE_LINES
GL
GL_DAILY_BALANCES
GL_JE_HEADERS
GL_JE_BATCHES
INV
MTL_ACTUAL_COST_SUB
MTL_CST_ACTUAL_COST_DET
MTL_MATERIAL_TRX
MTL_UNIT_TRANSACTIONS
MTL_TRANSACTION_LOT_NUM
MTL_CST_TXN_COST_DETAILS
WIP_SCRAP_VALUES
MTL_CST_TXN_COST_DETAILS
NEW_COL
CHANGE
CHANGE
CHANGE
Flexibility – Patches and Upgrades
Histo
ry Ta
ble
sFu
ll Pro
du
ctio
n D
ata
base
Multi-stage Archiving for ILMD
ata
Acc
essi
bili
ty High
Low
Enterprise Disk
$50 - $70/GB
Modular Disk
$20 - $35/GB
Tape
$1 - $2/GB
Tape Library
$2 - $4/GB
SATA Disk
$5 - $15/GB
Archived Data
Current Data
SATA - Serial Advanced Technology Attachment SATA - Serial Advanced Technology Attachment
Questions……