1 copyright © 2011, oracle and/or its affiliates. all rights · lakshman lingam dba team manager...

Deduplication & Compression Options for Oracle Database Backups Presenting with:


Donna Cooksey, Sridhar RanganathanHigh Availability Product Management

gLakshman Lingam

Latin America 2011December 6–8, 2011

Tokyo 2012April 4–6, 2012


Oracle OpenWorld Bookstore

• Visit the Oracle OpenWorld Bookstore for a fabulous selection of books on many of the conference topicsselection of books on many of the conference topics and more!

• Bookstore located at Moscone West Level 2• Bookstore located at Moscone West, Level 2• All Books at 20% Discount


Program Agenda

• Data Growth – Challenges for Data Protection• Backup Considerations for Storage Savings• The Integrated Oracle Database Protection of RMAN• RMAN Storage Reduction Strategies• Customer Results: Bank of America• Key Takeaways• Q & A


Enterprise Data GrowthContinuing for the Foreseeable Future

• Enterprise data is growing 10 - 20% per year– Some industries upwards of 50%+ data growth / annually

Continuing for the Foreseeable Future

Some industries upwards of 50% data growth / annually

• Increase in production data is magnified in the backup storage infrastructure– More production data expands exponentially into the backup

storage infrastructure

Year over year data growth !


Exponential Growth in Backup InfrastructureIT Challenges

• Backup retention periods remain

IT Challenges

Data Growth Multiples in Backup Copies:constant based on business needs– Often expanding due to regulatory

requirements

Production Data Size One Month of Backups Long‐TermRetention

Last …and so on

• Storage budget doesn’t scale with data growthD d

Year: and so on…

This Year:

…and so on and so on…

• Data center space and power constraints hamper storage scale-outs


Program Agenda

• Data Growth – Challenges for Data Protection• Backup Considerations for Storage Savings• The Integrated Oracle Database Protection of RMAN• RMAN Storage Reduction Strategies• Customer Results – Bank of America• Key Takeaways• Q & A


Backup Storage Optimization StrategiesConsiderations for Storage Savings

Backup Compression Built-in Backup Deduplication

Add-on Backup Deduplication

Considerations for Storage Savings

- Software (e.g. native utilities)- Hardware (e.g. tape or disk drives)

- Incremental Backups

Deduplication

- Software - Appliance Model

p

E tEmpty Space

Compressed

Deduplicated Backup

Deduplicated Backup


Compressed Backup

Backup Compression 101Reduces Storage Costs by Reducing Backup Size

• Compression removes empty space and/or repeating sequences

Reduces Storage Costs by Reducing Backup Size

Compression removes empty space and/or repeating sequences depending on the technology

• The compression ratio is dependent on the type of data and compression algorithm usedcompression algorithm used

• Application backup compression can be performed at a point in the backup process:– Within the application during a backup operation

Empty Space

g– By the backup application– By the storage – Disk / appliance or tape drive

Compressed Backup


Backup Deduplication 101Reduces Storage Costs via Capacity Requirements

• Deduplication is a specialized form of compression

Reduces Storage Costs via Capacity Requirements

– Only changed blocks are backed up

I t l ll & f t b kcompression– Removes redundant data across

multiple copies of the data

• Granularity of deduplication varies b d f b bl k t fil

– Incrementals are smaller & faster backups than fulls

– Source-side deduplication

by vendor from sub-block to file level

• Three primary categories:

1) Incremental backup strategy

– Replaces redundant data with pointers to shared copy

– Deduplication performed at the source or on 1) Incremental backup strategy

2) Deduplication software

3) Storage appliance deduplication

the target

– Effectiveness is dependent upon awareness of the backup stream format


General Purpose Deduplication OfferingsSoftware or Appliance ModelSoftware or Appliance Model

Deduplication Software Storage Appliance Deduplication• Deduplication software is installed on each

host• Source-side deduplication• No hardware vendor lock-in

• Target-side deduplication :• Inline – Backup is deduplicated prior to

being written to disk• Post-process – Backup is written to a

• Usually the backups need to be reconstituted when copied to tape

staging area, then deduplicated• Backups must be reconstituted when copied

to tape

Distinctions between the two are blurring as hybrid offerings are emerging…


Deduplication RatiosMileage Will Vary

• Deduplication ratios vary by source and backup type

Mileage Will Vary…

• File system backup data is ideal for deduplication– Format does not change in the backup process– Deduplication ratios can range between 10x – 50x !

• Oracle database backups are more complex than th t f fil tthat of file systems – Storage deduplication ratios are minimal, if any


Program Agenda



Oracle Recovery Manager (RMAN)Integrated Backup / Recovery Engine for Oracle DatabaseIntegrated Backup / Recovery Engine for Oracle Database

Built-in Advanced DataBuilt in Advanced Data Protection Capabilities

• Intrinsic knowledge of database file formats and recovery proceduresand recovery procedures– Block validation during backup / restore– Online, multi-streamed backup– Native backup multiplexing

Backup compression and encryption– Backup compression and encryption• Integrated disk, tape* & cloud backup

*RMAN is integrated with Oracle Secure Backup and 3rd party media managers for tape backup.


RMAN Delivers….Comprehensive Protection for the Oracle Database

• Effectively manage RMAN backup / recovery via command or Oracle Enterprise Manager (EM)

Comprehensive Protection for the Oracle Database

Enterprise Manager (EM)– RMAN backup destinations: “DISK” or “SBT”

• Two Oracle database backup options provide maximum flexibility for p p p ydiverse requirements:– Image copy: Exact copy of the datafile, archived redo log file or control file

• Backup is approximately same size as the production database less temp filesBackup is approximately same size as the production database less temp files– Backup set: RMAN-specific proprietary backup format

• Smaller backup size than an image copy backup due to:RMAN null compression and unused block compression (pre backup)


– RMAN null compression and unused block compression (pre-backup)

Storage Deduplication Technologies… Difference Between File System and RMAN BackupsDifference Between File System and RMAN Backups

Understanding the backup stream is critical to identifying redundant dataredundant data

File System DataFile System Data File system data format does not change in the backup processthe backup process--- Ideal for deduplication technologies

Oracle DatabaseOracle Database RMAN passes a pre-packaged backup set

RMAN Integration

p p p g pto backup applications via “SBT” interface:--- Backup stream / block format is Oracle proprietary --- RMAN backup stream is largely opaque to backup applications--- 3rd party deduplication of Oracle backup streams is at best,


ysuperficial

Oracle Data Block Format 101More Than Simple Bits

• Oracle Database manages its logical

More Than Simple Bits….

g gstorage in data blocks

– Minimum unit of I/O

• A data block has a well-defined structure• A data block has a well-defined structure– Block header is kept consistent with payload– Rows do not overlap

Metadata in its place– Metadata in its place …• Can always verify logical consistency


The “411” on Oracle Database Backup BlocksBlock Headers May Vary Between Backups?Block Headers May Vary Between Backups?

Oracle Blocks… Datafile A Datafile B

• Are numbered describing position from beginning of datafile– Unique identifier

1A 2A 3A 4A 5A 6A 1B 2B 3B 4B 5B 6B

1A 1B 2A 3A 2B 5A 3B 4B 6A 5B

Oracle Backup (RMAN) Blocks…• Datafile blocks are logically grouped

Headers differ

Backup Pieceg y g p

into backup pieces • Ordering of blocks within a backup

piece different than within the datafileTranslating to different block headers / numbers between backup operations


---- Only RMAN can map backup block to datafile block

What Storage Deduplication Ratios to Expect?Mileage Will Vary

• Typical storage deduplication ratios for

Mileage Will Vary….

Typical storage deduplication ratios for RMAN backups of the Oracle database:– Full backups in the low, single-digits range– Incremental backups – minimal, if any

Archi ed log back ps ero– Archived log backups - zeroOracle Database


Program Agenda



RMAN Incremental Backup StrategiesBuilt In Backup Deduplication

Incremental Forever Strategy• Initial RMAN image copy backup to

Full / Incremental Strategy• RMAN backup set backup operation to:

Built-In Backup Deduplication

g ydisk (FRA), then copy updated in-place with incrementals going forward

• Switch to copy capability for zero restore capability

p p p• Disk - retention from days to weeks• Tape – retention from weeks to

years• RMAN compression applicable to full

• On-disk retention of 1-7 days• RMAN “BACKUP RECOVERY AREA”

• Optimized backup to disk or tape• RMAN compression applicable to the

• RMAN compression applicable to full , incremental and/or archived log backups

• RMAN “BACKUP BACKUPSET”

• Makes additional copy of the backup to disk or tape• RMAN compression applicable to the

the incremental and archived log backups

to disk or tape

High Availability Space Optimization


RMAN Full / Incremental Backup StrategyInherent Backup Deduplication

Assumptions:

Inherent Backup Deduplication

Assumptions:– Database size (used space) = 450GB

– Database change rate = 10%

B k t RMAN b k t– Backup type = RMAN backup set

– Weekly full backup on Sunday

– Daily incremental backups Mon-Sat


Deduplication For Oracle Database BackupsComparison Between RMAN and Storage AppliancesComparison Between RMAN and Storage Appliances

Description RMAN Incremental BackupsStorage Appliance Deduplication

Backup level Incremental Full

Deduplication type Source Target – Inline or post process

Oracle database-aware Yes No

Remains deduplicated when copied to tape Yes NoRemains deduplicated when copied to tape Yes No

Backup media options Disk or tape Disk

Backup performance Faster than full backup depending on the database change rate, e.g. 10-20x

Full backup time + deduplicationand processing time

Restore performance Similar to that of backup operation Similar to backup, although could be longer due to reconstitution process

Backup overhead on the database server Minimum Maximum


Incremental backups need less IO than full backups !!!!

How much additional storage space can be saved if the full / incremental backups are compressed?


Oracle Database Compression TechnologiesProduction to BackupProduction to Backup

Exadata Hybrid Columnar Compression (EHCC)W h d hi i• Warehouse and archive compression

Oracle Advanced Compression Option (ACO)• OLTP table compression

S Fil i d d d li ti• SecureFiles compression and deduplication• Data pump export compression• Recovery Manager (RMAN) backup compression levels – LOW, MEDIUM, HIGH• Data Guard redo transport compressionp p

Oracle Database Enterprise Edition • Recovery Manager backup compression level – BASIC


Backup of Compressed Oracle Database DataWhat is the Sizing Effect in Backup Storage?What is the Sizing Effect in Backup Storage?

• Remains compressed within the backup• Won’t benefit by additional backup

compression

EHCC Data

OLTP Compressed Tables• Won’t benefit from 3rd party deduplication

offeringsSecureFiles Compressed/Deduplicated

• Non-compressed production data canbenefit from backup storage optimizations


RMAN Backup Compression – Oracle DatabaseWhich Level is Right for You?Which Level is Right for You?

LOW MEDIUM BASIC HIGH

Best performance, lowest CPU utilization

• What compression ratios can be expected?

Best compression ratio

• What compression ratios can be expected?– Varies by data and compression level– Internal and customer testing ratio ranges from 1.5 to 19x


g g

RMAN Backup Compression and/or EncryptionOracle Transparent Data Encryption (TDE)Oracle Transparent Data Encryption (TDE)

Data within the RMAN Backup Type

Compressed andDatabase Standard Compressed Encrypted Encrypted

Not encrypted Backup is not compressed or encrypted

Backup is compressed Backup is encrypted Data is compressed first, then encrypted

TDE column encryption Columns remainencrypted in the backup

Backup is compressed Data is encrypted, double encryption of TDE encrypted columns

Data is compressed first, then encrypted

TDE tablespace ti

Tablespaces remain t d i th b k

Encrypted tablespacesd t d d

Encrypted blocks remain t d l t t

TDE encrypted t blencryption encrypted in the backup decrypted, compressed

and re‐encryptedencrypted, clear text blocks are encrypted

tablespaces re decrypted, compressed and re‐encrypted. Unencrypted tablespaces are compressed, then encrypted

The Secret Sauce…Oracle database-aware advantage!


encrypted

RMAN Incremental + Backup CompressionWinning Combination for Maximum Storage Savings!

Assumptions:

Winning Combination for Maximum Storage Savings!

Assumptions:– Database size (used space) = 450GB

– Database change rate = 10%

Backup type = RMAN backup set– Backup type = RMAN backup set

– Weekly full backup on Sunday

– Daily incremental backups Mon-Sat

– Average RMAN backup compression ratio:Average RMAN backup compression ratio:– Full backup = 11x– Incremental backup = 3x– Archived log backups = 2x


Storage Savings with Compression: 7.6x 11.4x

Recovery Manager Storage Optimizations

• 3.3x improvement using Full / Incremental strategy

• 7.6x improvement using Fulls and compression strategy

• 11.4x improvement using Full p g/ incremental strategy along with compression


Advantages of Database-Aware OptimizationsRMAN is Tightly Integrated with Oracle TechnologiesRMAN is Tightly Integrated with Oracle Technologies

RMAN Deduplication Storage Appliance Deduplication

Can leverage RMAN multiplexing for increased backup performance

Yes No – Recommend FILESPERSET=1

TDE encryption benefits space savings of the deduplication

Yes No – Encrypted data can’t be deduplicated

TDE encrypted tablespaces can be compressed or deduplicated in the backup

Yes – Using RMAN compression No - Encrypted data can’t be deduplicated

Applicable to disk or tape media Yes No – Only disk

Dependency on storage pointers for No YesDependency on storage pointers for consistent restoration

No Yes

Reduced network traffic Yes No


Program Agenda



Oracle Backup and Recovery (RMAN) @ Bank of America

Lakshman LingamDBA Team ManagerBank of America Merrill Lynch (BAML)Global Markets, Finance & Futures

Bank of AmericaO f th W ld’ L t Fi i l I tit ti

• Bank of America provides a full range of banking, investing, f

One of the World’s Largest Financial Institutions

asset management and other financial and risk management products and services

• In the US Bank of America serves:In the US, Bank of America serves:– 58 million consumer and small business relationships– 5,700 retail banking offices and about 17,800 ATMs

Online banking services over 30 million active customers– Online banking services over 30 million active customers

• Among the world’s leading wealth management companies and is a global leader in corporate and investment banking

• Bank of America serves clients via operation in more than 40 countries

Data CentersL 1000 f O l D t b• Effectively manage the Oracle infrastructure leveraging a

lti ti d (0 6) t t b d iti lit f d t d th

Leverage 1000s of Oracle Databases

multi-tiered (0-6) strategy based on criticality of data and the Oracle Maximum Availability Architecture (MAA)– All tiers utilize RMAN for Oracle database backup / recovery and many use

Oracle Data Guard for business continuity

• Backup strategy for the top data tiers includes:– Fast Recovery Area (FRA) sized for 7 day retention on disk using a weekly y ( ) y g y

full (level 0), daily incremental backup (level 1) and archived logs• Backup to FRA at both primary and Oracle Data Guard locations

– Backup of FRA to tape from the Oracle Data Guard Database• Weekly tape backup maintained for 90 days• Monthly tape backup maintained for 7 years

Managing the Backup InfrastructureF O l D t b• Production data amounts are growing which naturally

lti li i th b k i f t t

For Oracle Databases

multiplies in the backup infrastructure• Bank of America is successfully using RMAN in a two-prong

approach to reducing the backup storage footprint:approach to reducing the backup storage footprint:– Full and incremental Oracle database backup strategy– RMAN backup compression level = BASIC which is included in Oracle

Database 11g Enterprise Editiong p

• Our RMAN storage optimization strategy reduces both disk and tape consumption

Storage Savings with RMANFull Backup Effective Space Savings > 7xFull Backup Effective Space Savings > 7x

Compressed full backup size = 3.10TBSpace savings = 7.7xSpace savings 7.7x

Storage Savings with RMAN …Archived Logs Effective Space Savings > 4xArchived Logs Effective Space Savings > 4x

Compressed size = 53.89GSpace savings = 4 8xSpace savings = 4.8x

Storage Savings with RMAN …Incremental Level 1 > Effective Space Savings > 50xIncremental Level 1 > Effective Space Savings > 50x

Compressed size = 437G Space savings = 57 6xSpace savings = 57.6x

Benefits of Using RMAN Optimizations

• An Recovery Manager (RMAN) full / incremental backup strategy is integral to our data protection strategy for thestrategy is integral to our data protection strategy for the Oracle database– RMAN backup compression is a natural extension of our current

deploymentdeployment

• Advantages of RMAN storage optimizations over non-Oracle offerings for the Oracle database include:

RMAN i i t t d ith th O l d t b t f O l– RMAN is integrated with the Oracle database eco-system from Oracle Data Guard to Oracle Enterprise Manager (EM)

– Storage consumption savings extend from disk to tape backup mediaLess moving parts (single technical resource) and reduced costs (RMAN– Less moving parts (single technical resource) and reduced costs (RMAN is free)

RMAN Best Practices

• Use of BCT feature for faster incremental backups.• In RAC deployments, use of service to spread channels acrossIn RAC deployments, use of service to spread channels across

RAC• In Standby, as DB in mount mode, channel distribution to specific

instance instead of service to spread channels across instancesinstance instead of service to spread channels across instances• Use of RMAN for refreshes across environments. • Use of RMAN to build data guards

FRA b k t t i b i “b k ” d• FRA backup to tape is by using “backup recovery area” command rather than OS backup.

THANK YOU!

Program Agenda

• Data Growth – Challenges for Data ProtectionB k St O ti i ti• Backup Storage Optimizations

• Oracle Database Compression Technologies• Recovery Manager – Storage Reduction Strategies• Key Takeaways• Q & A


Key TakeawaysRMAN Provides Backup Storage Optimizations!

• General purpose storage appliance advertised deduplication ratios of 10 50x:

RMAN Provides Backup Storage Optimizations!

deduplication ratios of 10-50x:– Possible for file system backups– Not likely or even close for Oracle database backupso e y o e e c ose o O ac e da abase bac ups

• RMAN is built-in to the Oracle kernel and can deliver backup storage savings of up to 20x viap g g p– Incremental backups (built-in deduplication)– Backup compression


Resources• OTN HA Portal:

http://www.oracle.com/goto/availability

• Maximum Availability Architecture (MAA):Maximum Availability Architecture (MAA): http://www.oracle.com/goto/maa

• MAA Blogs: http://blogs oracle com/maahttp://blogs.oracle.com/maa

• Exadata on OTN:http://www.oracle.com/technetwork/database/exadata/index.html

• Oracle HA Customer Success Stories on OTN:http://www.oracle.com/technetwork/database/features/ha-casestudies-098033.html


098033.html

Key HA Sessions, Demos, Labs by Oracle DevelopmentMonday, 3 Oct – Moscone South * Wednesday, 5 Oct – Moscone South *11:00a Auto Detect, Prevent and Repair Data Corruptions, Rm 10212:30p Future of Oracle Exadata, Rm 10412:30p RMAN: Not Just for Backups Anymore, Rm 3042:00p Extreme Data Management, Moscone North Hall D5 00 O l Hi h A il bilit S t O i R 104

10:15a Oracle Active Data Guard - Lessons Learned, Rm 1021:15p Data Guard for Planned Maintenance, Rm 1021:15p Understanding Oracle RAC Internals, Rm 1031:15p Clone Oracle with CloneDB and Direct NFS, Rm 270

5:00p Oracle High-Availability System Overview, Rm 1045:00p GoldenGate Product Update and Strategy, Intercontinental-Sutter

Tuesday, 4 Oct – Moscone South *10:15a Oracle Secure Backup - Best practices, Rm 304

Thursday, 6 Oct – Moscone South *9:00a Exadata Backup and Recovery, Rm 30410:30a Deduplication and Compression for Backups, Rm 30412 00 D G d S i h / F il R 10311:45a Oracle Exadata Technical Deep Dive, Rm 104

3:30p RMAN & Data Guard: Seven Cool Tips from Oracle, Rm 3043:30p Consolidation on Oracle Exadata, Rm 103

12:00p Data Guard Switchover / Failover, Rm 1033:00p Configure, Size, Monitor Fast Recovery Area, Rm 3043:00p PeopleSoft with Active Data Guard, Moscone West 2022

Hands on Labs Marriott Marquis Salon 14 / 15Demos Moscone South DEMOGrounds Hands-on Labs Marriott Marquis, Salon 14 / 15Monday, Oct 3, 5:00 pm - 6:00 pm Oracle Active Data GuardTuesday, Oct 4, 10:15 am - 11:15 am Oracle Active Data Guard

Demos Moscone South DEMOGroundsMon 10:00a - 5:30p Tue 9:45a - 6:00p Wed 9:45a - 4:00pMaximum Availability Architecture (MAA) ExadataActive Data Guard Oracle Secure BackupRecovery Manager & Flashback GoldenGate *All session rooms at Moscone South unless otherwise noted


Recovery Manager & Flashback GoldenGateReal Application Clusters ASM

All session rooms at Moscone South unless otherwise noted*After Oracle OpenWorld, ref. http://www.oracle.com/goto/availability

Q&AQ&


1 copyright © 2011, oracle and/or its affiliates. all rights · lakshman lingam dba team manager...

Documents