CFM
www.cfm.fr www.cfm.fr
Presented by
ZDLRA implementation at CFM
© CFM 2017
Gabriel NitulescuProject Leader
October 04, 2017
CFM
www.cfm.fr
Fundamental research applied to financial marketsCFM invests in Science, Technology and Finance25 years of experience in managing trading systemsA rational process that produces robust Trading AlgorithmsProprietary software able to execute & control large volumes of data180 PeopleOffices in Paris, London, New York, Tokyo
Who Are We?
© CFM 2017 2
CFM
www.cfm.fr
Data Protection Desired Architecture
© CFM 2017 3
FREP
host@frep
DB_A_frep_00
host@frcn
DB_A_frcn_00DataGuard
Dat
abas
eba
ckup
Arch
ived
logs
bac
kup
data
base
back
up
Arch
ived
log
back
up
Backup system @ FREP Backup System @ FRCN
FREP
CFM
www.cfm.fr
Workload Characterization
© CFM 2017 4
CFM
www.cfm.fr
Oracle Best Practices Disk to Disk to Tape► Daily to Disk
RUN {
RECOVER COPY OF DATABASE WITH TAG 'UPDATABLE';
BACKUP INCREMENTAL LEVEL 1 FOR RECOVER OF COPY WITH TAG 'UPDATABLE' DATABASE;
BACKUP DEVICE TYPE SBT ARCHIVELOG ALL NOT BACKED UP ; }
► Weekly to TapeRUN { BACKUP DEVICE TYPE SBT RECOVERY AREA; }
MAA Best Practices Architecture► Two Independent Data Centers with Data Guard► No special procedures in case of disaster or maintenanceProduction Impacts► Large FRA size (1,7 DB Size)► High CPU Utilization During Backup► High Bandwidth Utilization for Weekly Backups
Legacy Data Protection Strategy
© CFM 2017 5
+RECO
+DATA
BD_A DB_B
Image copy 24 TB 38 TB
Inc0 5 TB 12 TB
Inc1 0.3 TB 0.2 TB
Archives / day 3 TB 1 TB
Flashback logs / day 1 TB 0.3 TB
CFM
www.cfm.fr
Technical advantages (Virtual Full & Real-Time Redo Transport)► Reduce CPU required for backup => no more backup window => sizing => licenses
► Backup & Recovery performances
Financial Aspects (Lower TCO)► Zero Data Loss Recovery Appliance Lower Cost than Primary Storage (FRA on Production Server)
> Savings of 40%
Why ZDLRA?
© CFM 2017 6
CFM
www.cfm.fr
White Paper Deploying the Zero Data Loss Recovery Appliance in a Data Guard Configuration► OEM based implementation
► Minimize downtime
OEM implementation
© CFM 2017 7
CFM
www.cfm.fr
SQL> exec DBMS_RA.ADD_DB (db_unique_name=> 'PRODOMR_FRCN_00', protection_policy_name => 'CFM_003_DAYS', reserved_space=>'51G');SQL> exec DBMS_RA.GRANT_DB_ACCESS (db_unique_name => 'PRODOMR_FRCN_00',username => 'vpccfm');SQL> select DB_UNIQUE_NAME,DBID,DB_KEY from ra_database ORDER BY DB_UNIQUE_NAME;
DGMGRL> switchover to 'prodomr_frcn_00';
[oracle@<DB_server_FREP>]$ rman target /@PRODOMR_FRCN_00_DR catalog /@zfrcn00_catalogRMAN> register database;database registered in recovery catalogstarting full resync of recovery catalogfull resync completeRMAN> show all;RMAN configuration parameters for database with db_unique_name PRODOMR_FRCN_00 are:CONFIGURE DEFAULT DEVICE TYPE TO 'SBT_TAPE';CONFIGURE CONTROLFILE AUTOBACKUP ON;CONFIGURE DEVICE TYPE 'SBT_TAPE' PARALLELISM 2 BACKUP TYPE TO BACKUPSET;CONFIGURE CHANNEL DEVICE TYPE 'SBT_TAPE' FORMAT '%d_%U' PARMS "SBT_LIBRARY=/u01/app/oracle/product/12.1.0.2/dbhome_1/lib/libra.so, ENV=(RA_WALLET='location=file:/u01/app/oracle/wallet credential_alias=ZFRCN00_CATALOG')";CONFIGURE DB_UNIQUE_NAME 'PRODOMR_FRCN_00' CONNECT IDENTIFIER 'PRODOMR_FRCN_00_DR';CONFIGURE DB_UNIQUE_NAME 'PRODOMR_FREP_00' CONNECT IDENTIFIER 'PRODOMR_FREP_00_DR';CONFIGURE ARCHIVELOG DELETION POLICY TO APPLIED ON ALL STANDBY BACKED UP 1 TIMES TO 'SBT_TAPE';
DGMGRL> switchover to 'prodomr_frep_00';
Enrolling Protected Databases
© CFM 2017 8
SQL> exec DBMS_RA.ADD_DB (db_unique_name=> 'PRODOMR_FREP_00', protection_policy_name => 'CFM_003_DAYS', reserved_space=>'51G');SQL> exec DBMS_RA.GRANT_DB_ACCESS (db_unique_name => 'PRODOMR_FREP_00',username => 'vpccfm');SQL> select DB_UNIQUE_NAME,DBID,DB_KEY from ra_database ORDER BY DB_UNIQUE_NAME;
[oracle@<DB_server_FREP>]$ rman target /@PRODOMR_FREP_00_DR catalog /@zfrep00_catalogRMAN> register database;database registered in recovery catalogstarting full resync of recovery catalogfull resync completeRMAN> show all;RMAN configuration parameters for database with db_unique_name PRODOMR_FREP_00 are:CONFIGURE DEFAULT DEVICE TYPE TO 'SBT_TAPE';CONFIGURE CONTROLFILE AUTOBACKUP ON;CONFIGURE DEVICE TYPE 'SBT_TAPE' PARALLELISM 2 BACKUP TYPE TO BACKUPSET;CONFIGURE CHANNEL DEVICE TYPE 'SBT_TAPE' FORMAT '%d_%U' PARMS "SBT_LIBRARY=/u01/app/oracle/product/12.1.0.2/dbhome_1/lib/libra.so, ENV=(RA_WALLET='location=file:/u01/app/oracle/wallet credential_alias=ZFREP00_CATALOG')";CONFIGURE DB_UNIQUE_NAME 'PRODOMR_FRCN_00' CONNECT IDENTIFIER 'PRODOMR_FRCN_00_DR';CONFIGURE DB_UNIQUE_NAME 'PRODOMR_FREP_00' CONNECT IDENTIFIER 'PRODOMR_FREP_00_DR';CONFIGURE ARCHIVELOG DELETION POLICY TO APPLIED ON ALL STANDBY BACKED UP 1 TIMES TO 'SBT_TAPE';
Enrolling Primary Protected Database with Recovery Appliance Repeat for Standby Protected Database with Recovery Appliance
CFM
www.cfm.fr
CLI Backup Scripts
© CFM 2017 9
$ cat backup_inc_l0.rman
run {
backup device type sbt tag 'INCFOREVER' cumulative incremental level 0 filesperset 1 section size 64g database plus archivelog not backed up filesperset 32;}
$ cat backup_inc_l1.rman
run {
backup device type sbt tag 'INCFOREVER' cumulative incremental level 1 filesperset 1 section size 64g database plus archivelog not backed up filesperset 32;}
$time rman target /@PRODOMR_FREP_00_DR catalog /@zfrep00_catalog cmdfile=backup_inc_l1.rman log=backup_inc_l1_${ORACLE_SID}.`date +"%Y%m%d%H%M%S"`.log &
allocated channel: ORA_SBT_TAPE_1
channel ORA_SBT_TAPE_1: RA Library (ZFREP) SID=47483A6E3C363BB5E053345B430A24E2
…
$time rman target /@PRODOMR_FRCN_00_DR catalog /@zfrcn00_catalog cmdfile=backup_inc_l1.rman log=backup_inc_l1_${ORACLE_SID}.`date +"%Y%m%d%H%M%S"`.log &
channel ORA_SBT_TAPE_1: RA Library (ZFRCN) SID=480AB266A1C90E9EE0533E5B460A5440
…
skipping archived logs of thread 1 from sequence 43350 to 43535; already backed up
…
Level 0: One time
Level 1: Daily
Actual OEM limitation
RMAN Backup Job Output
RMAN Backup Job Scripts
CFM
www.cfm.fr
Data Protection Architecture with Recovery Appliance
© CFM 2017 10
FREP
efrep00-vm01
DB_A_frep_00
back
up
FREP
efrcn00-vm01
DB_A_frcn_00
back
up
DataGuard
CFM
www.cfm.fr
Data Guard Concepts and Administration ► 6 Redo Transport Services
> 6.2.1.2 Redo Transport Authentication Using a Password File
SQL> create user vpccfm identified by xxxxxx;SQL> grant sysoper to VPCCFM;SQL> select * from V$PWFILE_USERS;USERNAME SYSDB SYSOP SYSAS------------------------ ----- -----SYS TRUE TRUE FALSEVPCCFM FALSE TRUE FALSESQL> ALTER SYSTEM SET redo_transport_user = 'VPCCFM' SCOPE=SPFILE;
SQL> ho scp orapwd${ORACLE_SID}
SQL> shutdown immediate;SQL> startup;SQL> show parameter redoNAME TYPE VALUE----------------------------------- ------------------------------redo_transport_user string VPCCFM
CLI real time redo: Redo Transport Authentication Using a Password File
© CFM 2017 11
All standby databases
Same User for Redo Transport and Backup (VPC)
CFM
www.cfm.fr
Enable Real-Time Redolog Shipping
© CFM 2017 12
@ FREP SQL> alter system set log_archive_dest_4='SERVICE=zfrep00_catalog VALID_FOR=(ALL_LOGFILES, ALL_ROLES) ASYNC DB_UNIQUE_NAME=zfrep' scope=both sid='*';
@ FRCN SQL> alter system set log_archive_dest_4='SERVICE=zfrcn00_catalog VALID_FOR=(ALL_LOGFILES, ALL_ROLES) ASYNC DB_UNIQUE_NAME=zfrcn' scope=both sid='*';
DGMGRL> add recovery_appliance ZFREP as connect identifier is 'ZFREP00_CATALOG';DGMGRL> enable recovery_appliance ZFREP;DGMGRL> add recovery_appliance ZFRCN as connect identifier is 'ZFRCN00_CATALOG';DGMGRL> enable recovery_appliance ZFRCN;DGMGRL> show configuration;Configuration - prodomr_dgProtection Mode: MaxPerformanceMembers:prodomr_frep_00 - Primary databaseprodomr_frcn_00 - Physical standby database zfrep - Backup appliance zfrcn - Backup appliance
No cascade redo propagation
SQL as rasys@ZFRCN00 > selectDB_UNIQUE_NAME, NZDL_ACTIVE, SPACE_USAGE/1024 as SPACE_USAGE_TB, DISK_RESERVED_SPACE/1024 as DISK_RESERVED_SPACE_TB, round(DEDUPLICATION_FACTOR,2)
fromRA_DATABASE
order by DB_UNIQUE_NAME;
DB_UNIQUE_NAME NZD SPACE_USAGE_TB DISK_RESERVED_SPACE_TB ROUND(DEDUPLICATION_FACTOR,2)-------------------------------- --- -------------- ---------------------- ---------------------------------------PRODOMR_FRCN_00 YES .01 .05 2.04
Configuring Log Archive Destination to RAUpdating DGMGRL Configuration
Confirming Configuration
CFM
www.cfm.fr
Real-Time Data Protection Architecture with Recovery Appliance
© CFM 2017 13
FREP
efrep00-vm01
DB_A_frep_00
back
up
FREP
efrcn00-vm01
DB_A_frcn_00
back
up
DataGuard
Rea
l tim
e R
edo
Ship
ping
Red
oSh
ippi
ng
CFM
www.cfm.fr
Real-Time Data Protection with Recovery Appliance & Data Guard Broker
© CFM 2017 14
FREP
efrep00-vm01
DB_A_frep_00
back
up
FREP
efrcn00-vm01
DB_A_frcn_00
back
up
DataGuard
Rea
l tim
e R
edo
Ship
ping
* RDBMS >= 12.1.0.2
* RDBMS >= 12.1.0.2Active far Sync
Rea
l tim
e R
edo
Ship
ping
CFM
www.cfm.fr
Backup Elapsed Time & Resource Usage
© CFM 2017 15
• DB Size = 12TB• RMAN Backup Channels = 8
CFM
www.cfm.fr
Results 1 of 2
© CFM 2017 16
CFM
www.cfm.fr
Results 1 of 2
© CFM 2017 17
CFM
www.cfm.fr
Results 2 of 2
© CFM 2017 18
CFM
www.cfm.fr
Results 2 of 2
© CFM 2017 19
CFM
www.cfm.fr
Summary
© CFM 2017 20
Technical:Minimized Backup WindowOffloaded Database Server CPUIncreased Recovery Performance
o Virtual full backup, Compression
Ability to implement the desired architecture
Price:Lower TCOReduce impact of CPU for backup => licenses« User TB » on RA vs FRA
Project:Implementation is less complex than first impression
Better OEM integrationMore Detailed DocumentationMore Oracle University CoursewareImproved Support Skills
Positive Results Improvements Needed