Demystifying Deduplication

Global SMB Event Marketing2

APPROACH:

What is deduplication?

Eliminate redundant data

Start with the backup environment

as the first phase

Maintain references to single instances of data across data

store

Deduplication eliminates redundant copies of data

by leveraging pointers to point duplicate files or blocks to a single object

Deduplication can decrease disk capacity requirements

by up to 98% and decrease bandwidth requirements for data transfer by up to 50 times.

Global SMB Event Marketing

• Data Deduplication is a capacity optimization feature – not a capacity optimization solution Need to understand what problem you are trying to

fix Dell can help find the right solution to your storage

challenges• As deduplication matures it will be

ubiquitous across a wide range of storage products

• Deduplication integrated into software functionality provides the greatest benefits Need to understand what problem you are trying to

fix Dell can help find the right solution to your storage

challenges

• Deduplication technology will expand beyond backup to include static archive data and inactive primary data

Dell’s point of view on deduplication

File

Block

Sub-blockInline Processin

g

Post Processin

g

Deduplication – Confusion abounds

Source

Target

Single Instance Storage

VTL

Different technologies

Different Architectures

Required

5

Types of deduplication

File

• aka Single Instance Store or SIS

• Typically primary storage

Block

• aka Sub-file or Fixed block

• Typically secondary storage

• Better dedupe ratios

Sub-block

• aka Variable block• or Byte-level• Typically secondary

storage• Best dedupe ratios• Most processor

intensive

Data deduplication eliminates common data at a file, block,

or sub-block level.

Disk Capacity

A B C D A B C E

A B C D E

Data object #1

Data object #2 F

FUnique data saved to disk

Global SMB Event Marketing

DeduplicationEnables Cost Effective Disk To Disk Backup

6

Shorten backup window and restore faster with B2D – At a cost similar to tape

Reduce storage capacity, power, cooling and space requirements

Centralize data protection and archive, reducing the burden on offices not staffed to manage it

Enable cost-effective DR

PrimaryDisk

Deduplication

Replication

Backup Archive

Secondary Disk2

Backup to Disk with Dedupe

Global SMB Event Marketing

Why optimize disk-based backup with deduplication?

B2D without deduplication

B2D with deduplication

10:1 ratio

Total capacity needed after 3 years (TB’s)

34.6 3.46

# drives needed 36 5Total storage cost ~$34k ~$8k

1. Example – 20TB of data growing 20% per year2. How long until the deduplicated storage capacity required

equals 3 years without dedupe? Just over 15 years

Global SMB Event Marketing

How deduplication fits into the backup environment

8

Appliance-based (Target)

Advantages:• Ease of implementation • Works with variety of backup

SW

Disadvantages: • Can be more expensive

solution• Replication target restrictions• Greater network traffic

overhead• Often on proprietary hardware

Server-based (Source)& Integrated (Hybrid)

Advantages:• Common management • Ease of use• Can be less expensive solution (lower TCO)• Reduces network traffic• Global deduplication opportunity

Application Servers Backup Server Deduplication Appliance

JBOD/NAS/SAN

OR

Deduplication

Here here hereor or

Deduplication

Deduplication