the truth about all-flash array deduplication

17
The Truth About All Flash Deduplication Learn From Two Deduplication Veterans: •What is deduplication? •Why is it so Valuable in the All-Flash Use Case? •What Can Go Wrong With All- Flash Deduplication? •Ask your deduplication questions to the dedupe panel On-Demand Version Available -- includes Audio and Extensive Q&A Session

Upload: storage-switzerland

Post on 21-Nov-2014

634 views

Category:

Technology


0 download

DESCRIPTION

Deduplication is the key to All-Flash Array adoption because it can drive down the cost of SSD. But each vendor’s dedupe implementation is different and IT Planners should not consider all deduplication to be the same. In this slideshare we give you insight on what to look for and look out for. This slideshare is also available on demand with audio. It features an extensive Q&A session featuring the dedupe expertise of Storage Switzerland’s Lead Analyst George Crump and Permabit’s CEO Tom Cook, and CTO Jered Floyd. Register here: http://bit.ly/dedupetruth

TRANSCRIPT

Page 1: The Truth About All-Flash Array Deduplication

The Truth About All Flash Deduplication

Learn From Two Deduplication Veterans:

•What is deduplication?

•Why is it so Valuable in the All-Flash Use Case?

•What Can Go Wrong With All-Flash Deduplication?

•Ask your deduplication questions to the dedupe panel

On-Demand Version Available -- includes Audio and Extensive Q&A

Session

Page 2: The Truth About All-Flash Array Deduplication

Logistics

● SlideShare viewers please tweet us questions @storageswiss #dedupetruths

● For Audio and Extensive Q&A please register for the on demand webcast:

● http://bit.ly/dedupetruth

Page 3: The Truth About All-Flash Array Deduplication

Today’s Agenda

● Company Backgrounds

● What is Deduplication?

● What Are The Use Cases?

● Why Is it So Valuable in Flash?

● What Are The Challenges Implementing Deduplication on All-Flash Systems?

Page 4: The Truth About All-Flash Array Deduplication

Background

● Analyst firm focused storage, cloud and virtualization

● Knowledge of these market is gained through product testing, implementations and interactions with users and suppliers

● The results of this research can be found in the articles, videos, webinars, product analysis and case studies on our web site:

○ http://storageswiss.com

Page 5: The Truth About All-Flash Array Deduplication

5 Copyright © Permabit Technology Corporation - CONFIDENTIAL.

Permabit Corporate OverviewCompany: Private Supplier of Data Efficiency Software to

OEMsHeadquarters: Cambridge, MAProducts: Easily integrated software for data deduplication, compression, thin provisioning of primary storageDeployment Model: Integrated into hardware systems or software-defined storage (SDS) stacksMarket: Deployed in $60B storage market (Gartner/IDC)Value Prop: We supply a tested solution that is superior to any other in the market, at a fraction of cost of development for compressed TTM

Licensees: HDS, LSI, Violin, Netgear – major SAN, NAS, Flash Array, SDS and Cloud Vendors

IP: 42 patents filed, 32 granted to date

Page 6: The Truth About All-Flash Array Deduplication

Polling Question – How Far Down The deduplication road Are You?

❏ Not Started❏ On A Backup Device❏ In Our Backup Software❏ On Primary Storage❏ On an All-Flash/Hybrid Array

Page 7: The Truth About All-Flash Array Deduplication

Polling Question – How Far Down The deduplication road Are You?

Page 8: The Truth About All-Flash Array Deduplication

What is Deduplication?

Page 9: The Truth About All-Flash Array Deduplication

What Are The Dedupe Use Cases

● Backup (software-devices)

● Hardware

● Software

● Archive

● Long term retention

● WAN

● Bandwidth reduction

● Primary Storage

Page 10: The Truth About All-Flash Array Deduplication

Why The All Flash Appeal?

Page 11: The Truth About All-Flash Array Deduplication

How Do Vendors Develop?

● Build Your Own

● Leverage Existing Code/File Systems (ZFS)

● Leverage an API Set

● Leverage a File System Extension

Page 12: The Truth About All-Flash Array Deduplication

What Are The Flash Dedupe Challenges?

● Performance Impact

● Extra process that gets in the way of I/O

● Increases Cost

● More processing power and RAM consumption

● Increases Data Vulnerability

● Hash table corruption

Page 13: The Truth About All-Flash Array Deduplication

How Do We Overcome These Challenges?

Page 14: The Truth About All-Flash Array Deduplication

14 Copyright © Permabit Technology Corporation - CONFIDENTIAL.

Albireo: The Next Generation of Data Optimization TechnologySoftware that integrates at the firmware, device driver,

file system, appliance or application level to deliver:

• Multiple GB/sec IO throughput• 5 – 35x reduction rates• Minimal Memory and CPU footprint• Petabyte scalability within a single device• Grid scale out for cloud infrastructures• Guaranteed data integrity• Flexible, simple integration • No risk, time-to-market advantage

Page 15: The Truth About All-Flash Array Deduplication

15 Copyright © Permabit Technology Corporation - CONFIDENTIAL.

How Albireo is delivered

Albireo SDKHigh performance deduplication index for any OS

Albireo VDOHigh performance, fine grained, inline, thin provisioning, deduplication and compression for the Linux storage stack

Albireo eVDOHigh performance, fine grained, inline, thin provisioning, deduplication and compression for any OS

Albireo is made to be deployed portfolio wide – any OS and any storage architecture

Albireo is made to be deployed portfolio wide – any OS and any storage architecture

Page 16: The Truth About All-Flash Array Deduplication

16 Copyright © Permabit Technology Corporation - CONFIDENTIAL.

Data Efficiency Comparison

Performance (4K IOPS)

500K 200K(Dedupe halts if performance

falls below threshold)

150K 400K

Memory Usage0.1

GB/TB4 GB/TB 25 GB/TB 1.2 GB/TB

Scalability 256 TB 23 TB 10TB 96TB

Deduplication

Inline Dedupe All the Time

Compression

Thin Provisioning

Data Optimized Replication

XtremIO Engenio EF550

Page 17: The Truth About All-Flash Array Deduplication

Thank you!

Storage Switzerlandhttp://[email protected] Swiss on Twitter: http://twitter.com/storageswissStorage Swiss Webinar Channel: http://storageswiss.com/category/webinarStorage Swiss on YouTube: http://www.youtube.com/user/storageswiss

To learn more about Permabit, visit: www.permabit.com/ Twitter: https://twitter.com/permabit