high performance nas, new design for new it · 2019-12-21 · linux, x86, tcp/ip striping, lb and...

33
High Performance NAS, New design for New IT Pierre Evenou – Philippe Nicolas Rozo Systems

Upload: others

Post on 16-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

High Performance NAS, New design for New IT

Pierre Evenou – Philippe Nicolas Rozo Systems

Page 2: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

Agenda

Company Profile Business Needs & Market Opportunity Product overview The Mojette Transform How it works ? Product Availability Configuration and use cases Competition A bit of future Conclusion

Page 3: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

Rozo Systems – Company profile

Management CEO: Pierre Evenou – COO: Michel Courtoy – CTO: Didier Feron

Advisors Philippe Nicolas and Eric Friis

Founded in 2010 as a Spin-off of University of Nantes Nantes (France) & San Mateo, California Ready for a Series A investment round (Seed Funding 700k€) 10 people Worldwide Develops RozoFS, a Software-Defined Scalable File Storage with

unique Erasure Code performance 10+ deployments Flexible go-to-market model

Page 4: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

Need for Enterprises

How to deliver a File Storage Service with TOP Performance with SUPER efficient Data Protection, HIGHLY Scalable in Capacity at a very ATTRACTIVE price at the SAME time ? Enterprise/High-end NAS are LIMITED even with established vendor

such Isilon… Real challenge to maintain Performance when Capacity is growing File Storage is rich and good BUT Data Protection is slow and impacts

Applications, Users and Business HW is proprietary – no real Software-Defined Storage philosophy

Object Storage are slow and need File Gateway for File Access – Too expensive, Too complex, Not scalable at File level Most of Object Storage implement Erasure Coding BUT it is ONLY good for

Secondary Storage, true Scalable in term of Capacity Even with Flash, Object Storage are slow! Not a native File Storage solution – Real impact on the bottom line

Page 5: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

Market Opportunity

NAS - File Storage $7B in 2017 (Global Industry Analysts)

Object Storage

$800M in 2014 (IDC)

Converged Systems

$1.5B in 2016 (CAGR ~94%, IDC)

Private Cloud

$69B in 2018 (CAGR 14%,Technology Business Research)

NAS, File Storage (High-End, Enterprise,

Scale-Out)

Object Storage

Converged Systems

Page 6: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

What is RozoFS ?

SCALE-OUT NAS It’s about File Storage & File Access

with industry standard file sharing protocols

It’s also about Scaling in any dimension

But it’s still a NAS i.e. no application integration just plug it in, configure it and run it

Page 7: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

What is RozoFS ?

SOFTWARE DEFINED SCALE-OUT NAS

Transform a rack of standard x86 servers into a high performance and high resiliency file service

Without vendor lock in

Pick your preferred brand and models and deploy them, it’s so simple

Page 8: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

What is RozoFS ?

ERASURE CODE BASED SOFTWARE DEFINED

SCALE-OUT NAS High data durability with innovative Erasure Coding

Delivers the protection level of 5 copies with just 1.5 redundancy factor while providing striping performance

Page 9: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

Internal Logical Architecture

Asymmetric Distributed Parallel File System

Horizontal independent scaling for File Server Heads, Meta-Data and Data Servers

All 3 components can reside on same systems

RozoFS Clients / File Servers Heads

Back-end Data Servers

Meta-Data Servers

Parallel Data Access

Page 10: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

Ready for high demanding applications

High Performance & Scalable File Storage with High Efficient Data Protection

Software-Defined Storage philosophy on Commodity Hardware (Lx, x86, Eth, TCP/IP, Multi-device: SATA, SSD…)

Distributed File System exposed as Scale-out NAS

Parallel data access & POSIX Shared-nothing and Asymmetric Industry File Sharing Protocols Mojette* Erasure Code Multi-tenant & Multi-sites

Page 11: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

Accessibility & Manageability

Full and seamless application support with no integration pain based on complex APIs – POSIX compliant

Industry and Standard File Sharing Protocols NFS (v3, v4), SMB via Samba, AFP, FTP, WebDAV, HTTP, AMZN/S3

Direct Access Method – Key/Value mode No lookup, very fast data access

Quota per user and group, Native ACL, extended attributes Super Easy Deployment & Operation model No LUN, Volume or RAID to manage Simple task to add or remove nodes Linux (CentOS, Debian) based software

VM environment supported Standard monitoring based on Nagios Powerful CLI, Puppet Labs integration

Page 12: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

Super Efficient Data Protection

Super fast Erasure Coding thanks to Mojette Transform for all files (works at file level) – 128 bits (v2.0)

Mojette Transform 2x faster in Encoding & 3x faster in Decoding vs. Intel ISA-L Seamless repair with no impact on data access Implicit encryption (non systematic EC effect) Efficient EC ratio for Mojette (1.5:1) vs. 3-way replication (3:1) Self Healing & Data Integrity Geo-Replication

Page 13: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

The Mojette Transform

The Mojette Transform: The magic behind RozoFS Evolution of Radon Transform (Radon Theorem) Based on Discreet Algebra Non-systematic EC (all datas are encoded) Use Mathematical projections with only

Addition and Subtraction operations so very fast In Development in University of Nantes

since 1994 !! (invented by Jean-Pierre Guédon, University Professor)

Use case: Storage, Networking, Medical, Image More information on Wikipedia

(https://en.wikipedia.org/wiki/Mojette_Transform)

Page 14: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

3

1 5 9

2 6 5

1 4

A Discrete Radon Transform

Page 15: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

12

A Discrete Radon Transform 6 18

10 4

13

2 7

2 3

11

5 15

3

1 5 9

2 6 5

1 4

Page 16: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

3

- - -

- - -

- -

12

An Exact Discrete Radon Transform

3 18

10 4

10

2 7

2 0

11

5 15

Page 17: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

3

- - -

- - -

- 4

12

An Exact Discrete Radon Transform

3 14

10 0

10

2 7

2 0

7

5 15

Page 18: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

3

- - -

2 - -

- 4

12

An Exact Discrete Radon Transform

1 14

10 0

10

0 7

2 0

5

5 15

Page 19: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

3

- - -

2 - 5

- 4

12

An Exact Discrete Radon Transform

1 9

10 0

5

0 7

2 0

5

0 15

Page 20: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

3

- 5 -

2 - 5

- 4

7

An Exact Discrete Radon Transform

1 9

10 0

0

0 7

2 0

0

0 15

Page 21: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

3

1 5 -

2 - 5

- 4

7

An Exact Discrete Radon Transform

0 9

10 0

0

0 6

1 0

0

0 15

Page 22: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

3

1 5 9

2 - 5

- 4

7

An Exact Discrete Radon Transform

0 0

1 0

0

0 6

1 0

0

0 6

Page 23: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

3

1 5 9

2 - 5

1 4

6

An Exact Discrete Radon Transform

0 0

0 0

0

0 6

0 0

0

0 6

Page 24: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

3

1 5 9

2 6 5

1 4

0

An Exact Discrete Radon Transform

0 0

0 0

0

0 0

0 0

0

0 0

Page 25: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

12

A Redundant Exact Discrete Radon Transform

6 18

10 4

13

2 7

2 3

11

5 15

2 1 9 5 6 9 4

3

1 5 9

2 6 5

1 4

Page 26: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

12

An Erasure Code

6 18

10 4

13

2 7

2 3

11

5 15

2 1 9 5 6 9 4

3

1 5 9

2 6 5

1 4

Page 27: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

Asymmetric Model

Linux, x86, TCP/IP Striping, LB and Fast

Failure detection 3 components

Exportd Manages meta data,

hierarchy and namespace

Storaged Manage storage devices

and chunk storage (multiple volumes)

Rozofsmount Delivers FS service to OS Erasure Codes and

distributes data

RozoFS Clients / File Servers Heads

Back-end Data Servers

Meta-Data Servers

Parallel Data Access

Page 28: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

Product Availability

Community Edition

GNU GPL v2 license Available on GitHub Standard EC code

Advanced Edition

Software License All Sales Channels Optimized EC code

Page 29: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

Configurations & Use Cases

Scale-Out NAS High Performance & High Resilient

Scalable File Service

Network File Access*

App. App. App. App. App.

Converged Architecture High Performance & High Resilient

Scalable Application Service

App. App. App. App. App.

App. App. App. App. App.

App. App. App. App. App.

App. App. App. App. App.

App. App.

* NFS, SMB, AFP, FTP, HTTP…

Vertical use cases: Media & Entertainment, Oil & Gas, Life Sciences/Genomics, Web/Cloud Applications, HPC, Big Data/Analytics…

Page 30: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

RozoFS vs. Competition

Solutions

Properties NAS Scale-Out

NAS Object Storage

Object Storage + Gateway

RozoFS (Scale-Out

NAS w/ EC)

Performance (IOPS, Throughput, Repair)

x x x

Scalability (PB scale, Billions of files)

x x x x

Durability (> 10 nines)

x1 x1 x3

Accessibility (File Sharing protocols and direct access)

x x x2 x3

Manageability (app. Integration, deployment and operation)

x x x

Cost Efficiency (Cloud Economics)

x x

1/ assuming solution provides Erasure Coding (EC) 2/ Gateway to provide file access 3/ Primary file storage with EC such RozoFS, Isilon

Page 31: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

A bit of future

Fast indexation Versioning File recycling on deletion Per Directory Snapshots Storage QoS Fast Disk Encryption SSD Caching

Page 32: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

Conclusion

Tens of PBs Real-Time Performance Strong Data Protection Reduced TCO

More info:

rozosystems.com github.com/rozofs [email protected]

Page 33: High Performance NAS, New design for New IT · 2019-12-21 · Linux, x86, TCP/IP Striping, LB and Fast Failure detection 3 components Exportd Manages meta data, hierarchy and namespace

2016 Data Storage Innovation Conference. © Rozo Systems. All Rights Reserved.

High Performance NAS, New design for New IT

Pierre Evenou – Philippe Nicolas Rozo Systems