lt replication server4hanasps03 external
DESCRIPTION
LT REPLICATION IN SAP HANA ADMINTRANSCRIPT
SAP LT Replication Server for SAP HANA SPS03AGS SLO Product Mgmt.11/2011
© 2011 SAP AG. All rights reserved. 2Internal
Current Status & Positioning
Basic Concept and Development News for SAP HANA SPS03
Summary
© 2011 SAP AG. All rights reserved. 3Internal
LT Replication Server for SAP HANA leverages proven SLO Technologies
Application Lifecyle MgmtSLO technologies are used since more than 10 years and used in several hundred projects per year
Key offerings foster SAP‘s Application Lifecycle Mgmt concept
LT replication Server as a new use case leverages several SLO technologies
© 2011 SAP AG. All rights reserved. 4Internal
Current Status - SAP LT Replication Server for SAP HANA
SAP LT Replication Server was quickly adopted and
is today the default solution for real-time
integration of SAP sources into SAP HANA
Some HANA customers are already live using SLTfor data replication from SAP sources A lot of Proof-of-Concept projects are in process-> many more live customers expected by end of 2011Real-time data replication is a key capability requested by HANA customers
© 2011 SAP AG. All rights reserved. 5Internal
Key Benefits of LT Replication Server for SAP HANA
Key benefits of trigger based approachAllows real-time (and scheduled) data replication, replicating only relevant data into HANA from SAP sources and non-SAP sources
Ability to transform data into HANA format while replicating data in real-time
„Unlimited“coverage of SAP releases (SAP R/3 4.6C onwards) for SAP ERP and ABAP-based SAP applications)
Leverages proven SLO technologies (Near Zero Downtime, TDMS, SAP LT)
Simple and fast installation and configuration and fully integrated with HANA modeler UI (as of SPS02)
LT replication server is the ideal solution for all HANA customers who need real-time (and scheduled) data
replication sourcing from SAP and NON-SAP sources
© 2011 SAP AG. All rights reserved. 6Internal
Commercial and Software Shipment Aspects
Commercial AspectsLT Replication Server for SAP HANA is part of SAP HANA software license model (HANA Enterprise Edition)
Software Shipment LT Replication Server for SAP HANA is part of SAP HANA software shipment and fully integrated into the SAP HANA modeler UI
© 2011 SAP AG. All rights reserved. 7Internal
Current Status & Positioning
Basic Concept and Development News for SAP HANA SPS03
Summary
© 2011 SAP AG. All rights reserved. 8Internal
LT Replication Concept: Trigger-Based Approach (1/2)Architecture and Key Building Blocks
SAP HANA systemLT Replication Server
Application Tables
SAP Source system
Write Modules
Controler Modules
DBConnection
RFCConnection
Read Modules
LoggingTables
Application Tables
Efficient initialization of data replication based on DB trigger
and delta logging concept(as with NearZero downtime approach)
Flexible and reliable replication process, incl. data migration
(as used for TDMS and SAP LT)
Fast data replication via DB connectLT replication functionality is fully integrated with HANA Modeler UI
LT replication server does not have to be a separate SAP system and can run on any SAP system with SAP
NetWeaver 7.02 ABAP stack (Kernel 7.20EXT)
DB Trigger
© 2011 SAP AG. All rights reserved. 9Internal
LT Replication Concept: Trigger-Based Approach (2/2)Set-up of Data Replication in SAP HANA System
Choose Data Provisioning to launch HANA Modeler UI
1. 1. Select source system as defined in LT replication server, related system information and schema will be displayed
2. 2. Use button Load and / or Replicate to set-up the data replication
3. 3. Use button Stop Replication to end or to restart replication
© 2011 SAP AG. All rights reserved. 10Internal
SAP LT Replication Server - DevNews with HANA SPS03at a Glance
Improved and Enhanced FeaturesExtended Data Provisioning features and expert functions
Multi source system support
Revised authorization and security concept
Advanced transformation capabilities
Improved initial load procedures and job scheduling
Configuration & Monitoring DashboardConfiguration, Monitoring, Job scheduling and Statistics
Non-SAP Source System Support(covering SAP supported data bases)
© 2011 SAP AG. All rights reserved. 11Internal
HANA Modeler – Data Provisioning UI - Suspend/Resume
With SPS03, in the HANA modeler, it will be possible to suspend a table from the replication process and to resume it a later point in time.
Suspend - Pause a table from a running replication Trigger will not be deleted at the source systemDelta will still be stored in logging tables within the source system
Resume - Restart replication for a suspended tablePrevious suspended replication will be resumed (no new initial load required)
© 2011 SAP AG. All rights reserved. 12Internal
Multi Source System Support
This allows you to use multi schemas (with the same schema name) to replicate data from multiple source systems into a single schema in the HANA system (N:1 replication).
SAP HANA systemLT Replication ServerSource systems
A
This allows you to use multiple schemas (with the same schema name) to replicate data from multiple source systems into the same schema into different HANA systems (1:1 with the same schema name).
BSchema 123 Schema 123
LT Replication ServerSource systems
A
B
Schema 123
Schema 123SAP HANA system 2
SAP HANA system 1
Schema 123 – source A
Schema 123 – source B
With SPS03 the definition and use of schemas is more flexible -schema name does not have to be unique anymore.
© 2011 SAP AG. All rights reserved. 13Internal
Advanced Role and Security Concept
1. Gain flexibility to grant authorization to HANA Studio users
Replication user (name is equal schema name) is generated for replication purposes
Three additional schema specific roles are generated and can be assigned to a user
Select the user and assign the relevant roles (via the green plus symbol) in the HANA Studio
Name Role Purpose
Data Provisioning <SCHEMA>_DATA_PROV Data provisioning - deploy replication orders
Power User <SCHEMA>_POWER_USER Power user - allow modification within the replication schema
User Admin <SCHEMA>_USER_ADMIN Can call the RS_GRANT_* and RS_REVOKE_* procedures
2. More flexibility for HANA DB user to establish DB connection3. Streamlined authorization (user role: SAP_IUUC_REPL_REMOTE) for SAP source systems
© 2011 SAP AG. All rights reserved. 14Internal
SAP Source System
Transformation Capabilities at a Glance(only for projects lead by SAP)
SAP LT Replication Server
RFCConnection
…Data Portions
Start of Replication CycleGet next portion from source
loop through portion
1
5
4
2
3
add record to sender portion
map fields of a record to sender structure
SAP HANA System
DBConnection
…Data Portions
The data for transformation will be splitted into portions (default: 40.000 lines)
The portions will be processed successively, mapped on LT Replication Server and transferred to HANA
Transformation rules (e.g. filtering, data conversion) is possible at several points of the process via ABAP includes
Implementation of transformation rules is possible by maintaining table IUUC_ASS_RUL_MAP on the LT Replication Server (as additional expert function also rules can be defined for triggers in source system)
Applying transformation rules may lead to data inconsistency and delay data replication process
© 2011 SAP AG. All rights reserved. 15Internal
Jobs & Connections and Statistics
Within the tab Jobs and Connections you get details about the status of the master job, the load jobs and the connection details of all the involved systems.
You can restart the master job, if it stopped for any reason.
On the Statistics tab page, you get the information about the tables which are in replication mode, the current action and status. In addition you get the replication latency of each table, calculated with the median, the minimum and the maximum.
© 2011 SAP AG. All rights reserved. 16Internal
Configuration for non-SAP source system within the LT replication server
To replicate from Non-SAP source system select Legacy and the affected Database System.
Depending on the Database System, additional required information needs to be specified (e.g. for DB2 specify
the DB Connection and the Tablespace name).
Start with transaction LTR
© 2011 SAP AG. All rights reserved. 17Internal
SAP HANA systemLT Replication Server
LT Replication Concept: Trigger-Based ApproachReplication from non-SAP sources
Application Tables
non-SAP source system
Write Modules
Controler Modules
DBConnection
DBConnection
Read Modules
LoggingTables
Application Tables
DB Trigger
LT replication server transfers in a first step all metadata table definitions from the non-SAP sourcesystem to the HANA system into the tables DD02L and DD02T. From the HANA perspective everythinglooks like you work with a SAP source. When a table replication is started, LT replication server createslogging tables within the source system. Only the read modules are created in the LT replication server(for SAP sources the read modules are located in the source system only). The connection from LTreplication server to the non-SAP source system is established by means of a database connection.
With SPS03, LT replication server also supports real-time replication for non-SAP sources.
© 2011 SAP AG. All rights reserved. 18Internal
DB Supportability Matrix: Loading Data via SLT Replication into HANA
Database Technical availability
SAP Sources Non SAP Sources (*)
MSFT SQL Server Enterprise Edition OK OK
Oracle Enterprise Edition OK OK
IBM DB2 LUW/ UDB (DB6) OK OK
IBM DB/2 zSeries OK OK
IBM DB2 iSeries (former AS/400) OK Not supported
IBM Informix Restricted - contact SLT development Not supported
SAP MaxDB OK OK
Sybase ASE Not supported yet Not supported yet
For non-SAP source systems, the customer database license needs to cover a permanent database connection with 3rd party products like LT replication server. (*) Since a DB connection from LT replication server to a non-SAP system is required, the OS/DB restrictions of NetWeaver 7.02 apply (see at http://service.sap.com/pam)
© 2011 SAP AG. All rights reserved. 19Internal
Technical Requirements and System Set-Up Information for LT Replication Server (with SAP Sources)
SAP HANA systemLT Replication ServerSAP Source system
System Requirements:
-SAP Basis: NetWeaver 7.02 with Kernel 7.20EXT (64BIT Unicode) PL110 - see SAP note 1597627- Filesystem: 100 GB- RAM: 16-32 GB- CPU: 2-4 cores- Recommended number of background jobs: 10
DBConnection
RFCConnection
System Requirements:
- SAP Basis 4.6C and higher- All data bases
Installation:
- respective DMIS 2010 version- Minimum support pack level: SP03 - latestavailable recommended!
Installation:
- Addon DMIS 2010_1_700- Minimum support pack level: SP05
Installation:
- HANA SPS03: includes LT replication functionality fully integrated into the UI ofthe HANA modeler
Basic Configuration:
- Define RFC connection to source system- Define DB connection to HANA system- Define no. jobs for data replication
Basic Configuration:
- Optional: define separate table spacefor logging tables
- Define RFC user with appropriate authorization(With SP05 - a streamlined user role SAP_IUUC_REPL_REMOTE is available)
Basic Configuration:
- Create / define DB user with appropriateauthorization (like user SYSTEM or SYS_REPL)
© 2011 SAP AG. All rights reserved. 20Internal
Technical Requirements and System Set-Up Information for LT Replication Server (with non-SAP Sources)
SAP HANA systemLT Replication ServerNon-SAP Source system
System Requirements:
-SAP Basis: NetWeaver 702, with Kernel 7.20EXT (64BIT Unicode) PL110 - see SAP note 1597627- Filesystem: 100 GB- RAM: 16-32 GB- CPU: 2-4 cores- Recommended number of background jobs: 10
DBConnection
DBConnection
System Requirements:
- Only connections supported to OS/DB platforms that are released for NetWeaver 7.02 (see at http://service.sap.com/pam)- Sybase ASE is not yet supported
Installation:
- Addon DMIS 2010_1_700- Minimum support pack level: SP05
Installation:
- HANA SPS03: includes LT replication functionality fully integrated into the UI ofthe HANA modeler
Basic Configuration:
- Define RFC connection to source system- Define DB connection to HANA system- Define max. number of jobs to be used for data replication
Basic Configuration:
- Create DB user for Secondary DB connection with respective authorizations
Basic Configuration:
- Create / define DB user with appropriateauthorization (like user SYSTEM or SYS_REPL)
© 2011 SAP AG. All rights reserved. 21Internal
Current Status & Positioning
Basic Concept and Development News for SAP HANA SPS03
Summary
© 2011 SAP AG. All rights reserved. 22Internal
Summary and Key Take Aways
LT replication concept is based on the proven SLO technology (used for NearZeroDowntime, TDMS, etc.) used by hundreds of customerswith large DBs.
It provides a holistic concept and valuable features to manage the data replication into SAP HANA very efficient and reliable
SLT includes with DMIS_2010 SP05 key improvements and enhance-ments to provide a more complete E2E replication solution for SAP HANA SPS03 - also simplifying a lot of technical operations aspects
LT replication server is the ideal solution for all HANA customers who need real-time (and scheduled) data
replication sourcing from SAP and NON-SAP sources
© 2011 SAP AG. All rights reserved. 23Internal
Frequently Asked Questions
Is SAP LT Replication Server included in the HANA license?Yes - it is part of the HANA - Enterprise Edition license
What is the recommended set-up / landscape strategy using SAP LT Replication Server with SAP HANA?
Installing and operating SAP LT Replication Server is technically possible on any SAP NetWeaver 7.02 instance (for example source system) as long as the technical prerequisites (SP level; SAP Kernel, etc.) are fulfilled and related implications (e.g. performance) are consideredFirst customer experiences show that non-productive SLT instances are sometimes running on SAP Solution Manager (or SAP source systems) but the productive instance of SAP LT replication server is kept separately
Is it also possible to do real-time data replication with non-SAP sources?Yes - using SLT (DMIS_2010 with SP05) with HANA SPS03 also includes capabilities for data replication from non-SAP sources (only for SAP supported databases!)
Has the data replication a negative impact on the performance of the source system?
No - experience from POCs and first live customers prove that there is no measurabl eimpact of the trigger-based approach on the source system. Main load is covered by the SLT system
If SLT is already in use, what to consider when applying SP05 to leverage new features available HANA SPS03
See SAP Note 1649910 for details
© 2011 SAP AG. All rights reserved. 24
Key Information Sources and Contacts
General SAP Note - LT Replication Server for HANA:SAP Note 1605140: includes all important information, links to overview presentation, offline demo as well as SAP corrections
Service Market Place and Help Portal(http://service.sap.com/hana; http://help.sap.com/hana)
Installation GuideSecurity GuideOperations Guide (planned by end of November 2011)
Do not hesitate to contact your SAP Account Team or the HANA Customer Solution Adoption Team for more details.
Thank You!
Contact information:
AGS-SLO Product Mgmt
© 2011 SAP AG. All rights reserved. 26Internal
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without prior notice.Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors.Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation. IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x, System z, System z10, System z9, z10, z9, iSeries, pSeries, xSeries, zSeries, eServer, z/VM, z/OS, i5/OS, S/390, OS/390, OS/400, AS/400, S/390 Parallel Enterprise Server, PowerVM, Power Architecture, POWER6+, POWER6, POWER5+, POWER5, POWER, OpenPower, PowerPC, BatchPipes, BladeCenter, System Storage, GPFS, HACMP, RETAIN, DB2 Connect, RACF, Redbooks, OS/2, Parallel Sysplex, MVS/ESA, AIX, Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix are trademarks or registered trademarks of IBM Corporation.Linux is the registered trademark of Linus Torvalds in the U.S. and other countries.Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or registered trademarks of Adobe Systems Incorporated in the United States and/or other countries.Oracle and Java are registered trademarks of Oracle and/or its affiliates.UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or registered trademarks of Citrix Systems, Inc.HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C®, World Wide Web Consortium, Massachusetts Institute of Technology.
© 2011 SAP AG. All rights reserved.
SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP BusinessObjects Explorer, StreamWork, and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries.
Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal Decisions, Web Intelligence, Xcelsius, and other Business Objects products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Business Objects Software Ltd. Business Objects is an SAP company.
Sybase and Adaptive Server, iAnywhere, Sybase 365, SQL Anywhere, and other Sybase products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Sybase, Inc. Sybase is an SAP company.
All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. National product specifications may vary.
The information in this document is proprietary to SAP. No part of this document may be reproduced, copied, or transmitted in any form or for any purpose without the express prior written permission of SAP AG.