introduction to data archiving - sap community

Introduction to DataArchiving

Georg Fischer,Product Manager PDMSSAP AG

This presentation outlines our general product direction and should not be relied on in making a purchase decision. This presentation is notsubject to your license agreement or any other agreement with SAP. SAP has no obligation to pursue any course of business outlined in thispresentation or to develop or release any functionality mentioned in this presentation. This presentation and SAP's strategy and possiblefuture developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is providedwithout a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for aparticular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in this document, except if such damages werecaused by SAP intentionally or grossly negligent.

Agenda

1. Overview2. Data Archiving Basics3. Data Archiving Applied4. Access to Archived Data5. Data Archiving Projects6. More Information

Data Archiving

File System

Archive and Delete Store

AccessDisplay

Online

Database Storage System

Application Data Data Objects Data Objects

Benefits

1System AvailabilityFaster and easier upgrade tohigher software releases.Shorter runtime for backup andrecovery.

2Use of ResourcesReduced hardware costs forDisk, CPU, Memory as well asadministration costs.

Value Generationthrough Data Archiving powered by SAP NetWeaver

3Better PerformanceShorter response times in dialogmode for all employees.

4Legal ComplianceMeeting data retentionrequirements and setting upend-of-life scenarios.

Use of Resources – Storage Savings

Data Records10 GB

Total savings in this scenario: 97.5%

Mirrors20 GB

Arc

hivi

ng Compressionto 20 %

2 GB 2 GBBackup to Tape

System Copies80 GB

Use of Resources – Distribution of StorageCosts“Hard disk costs represent less than a quarter of storage costs.”(Giga Information Group)

“Administration costs for 1 Terabyte storage are five to seven times higher than the storagecosts”(Dataquest/Gartner)

Various(Training, other costs

10%

Environment(Electricity, physical space)

3%

Storage Mgmt.(Soft- & Hardware)

19%

Hard disk23%

Personnel45%

Better Performance – Areas of Improvement

Reduce display of mature data

Faster DB access

Faster access to single documents

0

500

1000

1500

2000

2500

Month 1 Month 2 Month 3 Month 4

MB

/ m

sec

MSEG MB MB51 msec

Number of Legal Requirements KeepsIncreasing

Laws and regulations affecting ever more media and data types

Laws and regulations growing across industries and countries

Laws and regulations requiring data to be kept for longer periods

Agenda


Data Archiving and Storage

Database

Application Data

File System

Data Objects

Storage System

Data Objects

SAP Business Suite Storage SystemPartner (Optional)

StorageSystem

HSMSystem

ArchiveLink

AlternativeStorage

Data Archiving in Relation to Optical Archiving

IncomingDocuments

OutgoingDocuments

Archive FilesPrint Lists

Hyperlink

Archive Development Kit (ADK)

Runtime solution for data archiving

Development tool for data archiving solutionsSAP

Application developers integrate archiving functionality into the applicationCustomer

Archiving solutions for customer-specific tables and extensions

ADK Adjustment of code page, number format, structurechanges, compression, file handling, job scheduling

SAP Business SuiteApplicationsDatabase

Archive Files

Archiving Object

Definition of logical units in business processes

All programs required for archiving, for example preprocessing, read,write and delete programs

Definition of required CustomizingArchiving Object

Programs

DataCustomizing

Archive Administration –Access via Role or Transaction SARA

Archive Administration – Central Access toArchiving Logs

Archive Administration – Tables and ArchivingObjects

Archive Administration – Archive InformationSystem

Archive Administration – Statistics

Archive Management – Overview of ArchivingSessions

Agenda


Accessing Archived Data

Database

SAP System Archive Files

ADK100%

DRB Application

Business viewRetrieval from DB + ArchiveBusiness processes

x% Index / Archive Infostructure

AS

Archive Information System

Flexible creation of archive file indexesConfigurable infostructures stored in transparent database tablesManually filled using selected archive file(s)Automatically filled during archive delete phase

Retrieval of archived data

Technical view for all archiving objects

Document listsBased on infostructuresBased on ad hoc evaluation of selected archive filesUse of display variants

Generic tool also for customer developments

Using the Archive Information System

Archive Retrieval ConfiguratorSelection of the archiving objectSelection of the required field catalogSelection and activation of the desiredinfostructure

Status ManagementFill the infostructure with the required archivefile content

Archive ExplorerSelect infostructureMake field selectionsBrowse document listDetailed display from the archive

Archive Information System

Create Read

Archive Files

ArchiveInformationStructure

Archive RetrievalConfigurator Archive Explorer

Document Relationship Browser (DRB)

Display

Database

User InterfaceArchive ExplorerTransaction ALO1User role SAP_DRBApplication transactions

Display of business processes across archiveand database boundaries

ArchiveFiles

ApplicationData

Infra-structure

DRB – Find Related Documents

DRB – Display the Relationship Tree

Display Archived Data from Within anApplication

Exception: Reloading Archived Data

21ScenarioReload in the test system

Data in a test environment can be reloadedat any time, since this does not affectoperational data (cannot result in businessinconsistencies)

ScenarioReload immediately afterarchiving

Restoring the database due to anerror (e.g. incorrect selection,incorrect customizing of residencetimes)

Reloading archived data back into the DB should beconsidered only in the following cases:

Reload function is not availablefor all archiving objects

Agenda


Finding the Right Time

1A „healthy“ SystemData Archiving should not be seen as the lastresort for preventing total system collapseafter all other means have been exhausted.

2Early PlanningEnsure that the performance of yoursystems remains efficient.

3Interdisciplinary ProcessData Archiving requires a high degree of cooperation betweenuser and IT departments.

Table Growth in Accounting at a CustomerSite

Database Size

050

100150200250300350400450500

Mon

th 1

Mon

th 2

Mon

th 3

Mon

th 4

Mon

th 5

Mon

th 6

Mon

th 7

Mon

th 8

Mon

th 9

Mon

th 1

0

Mon

th 1

1

Mon

th 1

2

Date

[GB

]

1.9033.17Month 1

2.9236.09Month 2

37.6973.78Month 3

64.18137.96Month 4

52.05190.01Month 5

66.98256.99Month 6

52.37428.37Month 9

51.13376.00Month 8

67.88324.87Month 7

Monthly Growth in GBSize in GBDate

Considerations Before Data Archiving

Is the datastill required?

Can the data besummarized?

Can the data be archived?

Yes Summarizedata

NoNo

Dataremains

in thedatabase

Deactivatethe creationof the data

Yes

Yes

Can the data be deleted?

Archivedata!

No Yes Deletedata!

NoYes

Detailed Data Archiving Statistics

Automatically collected statistics can be used toDemonstrate the use and need for data archivingBetter plan future archiving projectsRecognize resource bottlenecks early on

Statistics can beStoredDisplayed

Standard statistics logAnalyze statistics in Archive Administration (transaction SARA)Space information: Database space and disk spaceAmount: Number of data objects, structures, and delete jobsTime: Job duration

Rule of thumb: Compression factor of five – DB size vs. file sizeThe greater the number and the variation of archivingobjects used, the closer the factor is to five

Statistics

Customer Example – Visualized

2.000

4.000

6.000

8.000

10.000

Sizein GB

Jan

Mar

May Ju

l

Sep

Nov Jan

Mar

May Ju

l

Sep

Nov Jan

Mar

May Ju

l

Sep

Nov Jan

Total database size

Allocated DB space

Total amount archived

Estimated DB size without archiving

5.5 TB

9.2 TB

3.8 TB3.2 TB

2007200620052004

Agenda


Important Sources of Information

ILM in SAP Service Marketplacehttp://service.sap.com/ilm

Is Your Missing ILM Strategy Putting You at Risk?From Birth to BurialInformation Lifecycle Management at SAP

Data Archiving:Media Library Presentations

Introduction to Data ArchivingMedia Library Literature & Brochures

Data Management GuideIntroduction to Data ArchivingReports and Transactions for Accessing

Archived Data

Data Volume Managementhttp://service.sap.com/dvm

Archive Migration and Archive Conversionhttp://service.sap.com/slo

Data Archiving in Print - 2nd Edition

Revised new edition with up-to-date information for

SAP NetWeaver 7.0SAP ERP 6.0

New functions and technologies,e.g.

Introduction to ILMArchive RoutingXML-based archivingTable analysis with TAANA

AuthorsSAP archiving experts

More informationwww.sappress.deISBN: 978-3-89842-796-8 (German)ISBN: 1-59229-008-6 (English)ISBN: 4-8222-5130-6 (Japanese) – 1st edition

http://www.sappress.de/

SAP Customer Training

BIT660 Data ArchivingLevel 33 Days

BIT670 Data Archiving – RetrievalLevel 32 Days

BC680*/WDE680 (USA/Germany)Level 32 Days

*on demand only

http:/www.sap.com/education

Thank You!

Copyright 2009 SAP AG. All Rights Reserved

No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without priornotice.

Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors.

Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation.

IBM, DB2, DB2 Universal Database, OS/2, Parallel Sysplex, MVS/ESA, AIX, S/390, AS/400, OS/390, OS/400, iSeries, pSeries, xSeries, zSeries, System i, System i5, System p, System p5, System x, System z,System z9, z/OS, AFP, Intelligent Miner, WebSphere, Netfinity, Tivoli, Informix, i5/OS, POWER, POWER5, POWER5+, OpenPower and PowerPC are trademarks or registered trademarks of IBM Corporation.

Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or registered trademarks of Adobe Systems Incorporated in the United States and/or other countries.

Oracle is a registered trademark of Oracle Corporation.

UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.

Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or registered trademarks of Citrix Systems, Inc.

HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C®, World Wide Web Consortium, Massachusetts Institute of Technology.

Java is a registered trademark of Sun Microsystems, Inc.

JavaScript is a registered trademark of Sun Microsystems, Inc., used under license for technology invented and implemented by Netscape.

MaxDB is a trademark of MySQL AB, Sweden.

SAP, R/3, mySAP, mySAP.com, xApps, xApp, SAP NetWeaver, and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AGin Germany and in several other countries all over the world. All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document servesinformational purposes only. National product specifications may vary.

The information in this document is proprietary to SAP. No part of this document may be reproduced, copied, or transmitted in any form or for any purpose without the express prior written permission ofSAP AG.

This document is a preliminary version and not subject to your license agreement or any other agreement with SAP. This document contains only intended strategies, developments, and functionalities ofthe SAP® product and is not intended to be binding upon SAP to any particular course of business, product strategy, and/or development. Please note that this document is subject to change and may bechanged by SAP at any time without notice.

SAP assumes no responsibility for errors or omissions in this document. SAP does not warrant the accuracy or completeness of the information, text, graphics, links, or other items contained within thismaterial. This document is provided without a warranty of any kind, either express or implied, including but not limited to the implied warranties of merchantability, fitness for a particular purpose, or non-infringement.

SAP shall have no liability for damages of any kind including without limitation direct, special, indirect, or consequential damages that may result from the use of these materials. This limitation shall notapply in cases of intent or gross negligence.

The statutory liability for personal injury and defective products is not affected. SAP has no control over the information that you may access through the use of hot links contained in these materials anddoes not endorse your use of third-party Web pages nor provide any warranty whatsoever relating to third-party Web pages.

Copyright 2009 SAP AG. Alle Rechtevorbehalten

Weitergabe und Vervielfältigung dieser Publikation oder von Teilen daraus sind, zu welchem Zweck und in welcher Form auch immer, ohne die ausdrückliche schriftliche Genehmigung durch SAP AGnicht gestattet. In dieser Publikation enthaltene Informationen können ohne vorherige Ankündigung geändert werden.

Die von SAP AG oder deren Vertriebsfirmen angebotenen Softwareprodukte können Softwarekomponenten auch anderer Softwarehersteller enthalten.

Microsoft®, WINDOWS®, NT®, EXCEL®, Word®, PowerPoint® und SQL Server® sind eingetragene Marken der Microsoft Corporation.

IBM, DB2, DB2 Universal Database, OS/2, Parallel Sysplex, MVS/ESA, AIX, S/390, AS/400, OS/390, OS/400, iSeries, pSeries, xSeries, zSeries, System i, System i5, System p, System p5, System x, System z,System z9, z/OS, AFP, Intelligent Miner, WebSphere, Netfinity, Tivoli, Informix, i5/OS, POWER, POWER5, POWER5+, OpenPower und PowerPC sind Marken oder eingetragene Marken der IBM Corporation.

Adobe, das Adobe Logo, Acrobat, PostScript und Reader sind Marken oder eingetragene Marken von Adobe Systems Inc. in den USA und/oder anderen Ländern.

ORACLE® ist eine eingetragene Marke der ORACLE Corporation.

UNIX®, X/Open®, OSF/1® und Motif® sind eingetragene Marken der Open Group.

Citrix®, das Citrix-Logo, ICA®, Program Neighborhood®, MetaFrame®, WinFrame®, VideoFrame®, MultiWin® und andere hier erwähnte Namen von Citrix-Produkten sind Marken von Citrix Systems, Inc.

HTML, DHTML, XML, XHTML sind Marken oder eingetragene Marken des W3C®, World Wide Web Consortium, Massachusetts Institute of Technology.

JAVA® ist eine eingetragene Marke der Sun Microsystems, Inc.

JAVASCRIPT® ist eine eingetragene Marke der Sun Microsystems, Inc., verwendet unter der Lizenz der von Netscape entwickelten und implementierten Technologie.

MaxDB ist eine Marke von MySQL AB, Schweden.

SAP, R/3, mySAP, mySAP.com, xApps, xApp, SAP NetWeaver, und weitere im Text erwähnte SAP-Produkte und -Dienstleistungen sowie die entsprechenden Logos sind Marken oder eingetragene Markender SAP AG in Deutschland und anderen Ländern weltweit. Alle anderen Namen von Produkten und Dienstleistungen sind Marken der jeweiligen Firmen. Die Angaben im Text sind unverbindlich unddienen lediglich zu Informationszwecken. Produkte können länderspezifische Unterschiede aufweisen.

Die in dieser Publikation enthaltene Information ist Eigentum der SAP. Weitergabe und Vervielfältigung dieser Publikation oder von Teilen daraus sind, zu welchem Zweck und in welcher Form auch immer,nur mit ausdrücklicher schriftlicher Genehmigung durch SAP AG gestattet.

Bei dieser Publikation handelt es sich um eine vorläufige Version, die nicht Ihrem gültigen Lizenzvertrag oder anderen Vereinbarungen mit SAP unterliegt. Diese Publikation enthält nur vorgeseheneStrategien, Entwicklungen und Funktionen des SAP®-Produkts. SAP entsteht aus dieser Publikation keine Verpflichtung zu einer bestimmten Geschäfts- oder Produktstrategie und/oder bestimmtenEntwicklungen. Diese Publikation kann von SAP jederzeit ohne vorherige Ankündigung geändert werden.

SAP übernimmt keine Haftung für Fehler oder Auslassungen in dieser Publikation. Des Weiteren übernimmt SAP keine Garantie für die Exaktheit oder Vollständigkeit der Informationen, Texte, Grafiken,Links und sonstigen in dieser Publikation enthaltenen Elementen. Diese Publikation wird ohne jegliche Gewähr, weder ausdrücklich noch stillschweigend, bereitgestellt. Dies gilt u. a., aber nichtausschließlich, hinsichtlich der Gewährleistung der Marktgängigkeit und der Eignung für einen bestimmten Zweck sowie für die Gewährleistung der Nichtverletzung geltenden Rechts.

SAP haftet nicht für entstandene Schäden. Dies gilt u. a. und uneingeschränkt für konkrete, besondere und mittelbare Schäden oder Folgeschäden, die aus der Nutzung dieser Materialien entstehenkönnen. Diese Einschränkung gilt nicht bei Vorsatz oder grober Fahrlässigkeit.

Die gesetzliche Haftung bei Personenschäden oder Produkthaftung bleibt unberührt. Die Informationen, auf die Sie möglicherweise über die in diesem Material enthaltenen Hotlinks zugreifen, unterliegennicht dem Einfluss von SAP, und SAP unterstützt nicht die Nutzung von Internetseiten Dritter durch Sie und gibt keinerlei Gewährleistungen oder Zusagen über Internetseiten Dritter ab.