snia emea virtual meetup · the virtual meetup a new venture by snia emea intended to disseminate...

SNIA EMEA Virtual Meetup

January 2020

© 2020 Storage Networking Industry Association. All Rights Reserved.

The virtual meetup

A new venture by SNIA EMEA intended to disseminate information about technology advancements to the storage communityQuarterly calls. Specials if there are significant technology announcementsThere will be time for questionsPlease switch to mute until question time

Any suggestions for future content or questions please email [email protected]


Agenda

Brief introduction to:Persistent MemoryComputational StorageSwordfishStorage Developer Conference EMEA

Questions

Paul TalbutGeneral Manager

SNIA EMEA

Alex McDonaldSNIA EMEA Chair and

Standards & Industry Associations Group, NetApp


SNIA-at-a-Glance


What We Do

Standards Development and AdoptionSpecification development; submissions for International Standard ratification (ISO/IEC)Open source software to accelerate adoption

Interoperability AssurancePlugfests & conformance testing

Technology Acceleration and PromotionSpecial Interest Groups to promote technologiesVendor collaboration to accelerate adoption

Global Vendor-Neutral EducationPeer-reviewed webcasts and tutorialsConferences and presentationsWhite papers, articles, blogs, etc.

5


Areas of Focus

6



Technical Work Group Activity

7

Persistent Memory


Everyone should know…

Persistent memory…Allows load/store access like memoryIs persistent like storageExposed to applications using SNIA NVM TWG model

What isn’t persistent memory:Something that can only speak blocks (like a disk/SSD)Something that is too slow for load/store access

TWG’s language: Would reasonably stall the CPU waiting for a load to complete

9


A Fundamental Change Requires An Ecosystem

SOFTWARE

HARDWARE

PLATFORMS

STANDARDS

§ JEDEC JESD245B.01: Byte Addressable Energy Backed Interface (released Jul’17)

§ JEDEC JESD248A: NVDIMM-N Design Standard (released Mar’18)

§ SNIA NVM Programming Model (v1.2 released Jun’17)

§ unfit ACPI NVDIMM Firmware Interface Table (v6.2 released May’17)

§ All major OEMs shipping platforms with NVDIMM support

§ Requires hardware and BIOS mods

OTHERS

§ Windows Server 2016§ Windows 10 Pro for Workstations§ Linux Kernel 4.2 and later§ VMware, Oracle, SAP HANA early

enablement programs

§ Multiple vendors shipping NVDIMMs§ SNIA NVDIMM Special Interest Group (formed

Jan’14)§ Successful demonstrations of interoperability

among vendors


No Application Modification

Using PM as a fast SSDStorage APIs work as expectedMemory-mapping files will page them into DRAM

Using PM as DAXStorage APIs work as expectedNo paging (DAX stands for “Direct Access”)

Using PM as volatile capacityJust big main memoryVendor-specific feature

11


Host is decoupled from the media (agnostic to PM type)New protocol to “hide” non-deterministic access

Capacity = PM (100’s GB+ to 10’s TB)Latency = PM (>> 10’s of nanoseconds)

Endurance = PM (finite)

JEDEC-Defined NVDIMM Types

DRAM DRAMFLASH

CNTLR

NVDIMM-N NVDIMM-P

§ Host has direct access to DRAM§ NAND flash is only used for backup§ Capacity = DRAM (10’s - 100’s GB)§ Latency = DRAM (10’s of nanoseconds)§ Endurance = DRAM (effectively infinite)§ No impact to memory bus performance§ Low cost controller can be implemented§ Specifications completed and released§ Ecosystem moving into mature stage

NOW

PERSISTENT MEMORY

DATA BUFFERS

CNTLR

NVDIMM Types Are Complementary, Not Competing

NVDIMM-PFITS HERE


NVDIMM Target Application Areas

Databases Storage Virtualization Big Data Cloud Computing/ IoT

Artificial Intelligence

USECASES

Log AccelerationIn-Memory Commit

FilesystemsFast Caching

SSD Wear-Out

Higher VM ConsolidationMore Virtual Users/System

Fast IOPs WorkloadsIn-Memory Processing

Byte-Level Data Processing

Metadata Store

Low Latency Look-Up & Processing

The same factors driving NAND Flash adoption apply to NVDIMMs: IOPS, Latency, PerformanceNVDIMM addressing is exactly like DRAM


Want to learn more about PM?

SNIA – Persistent Memory Resource Pagehttps://www.snia.org/PM

2019 Persistent Memory Summithttps://www.snia.org/pm-summit

14

https://www.snia.org/PM

https://www.snia.org/pm-summit


Many Factors driving a Need for Computational Storage

16

Three motivating factors for using Edge Computing1. Preserve privacy

2. Reduce latency3. Be robust to connectivity issues

Near-Data Computation: Looking Beyond Bandwidth


What is Computational Storage

When to Computational StorageLarge Data Transfers, PCIe is bottleneckData pre/post processing & analysis Data can bypass the host - video deliveryAbility to move Software App to Storage

When to USE NVMDIMMCompute heavy with small data-transferSmall data compute - in-memory compute Little to no parallelism

17


Let’s Go Fishing for Data

18


Where Are We Now?

Founded Oct 2018, the Computational Storage Technical Working group initially had 10 Founding companies

Interest and attention grew… Quickly…Now the single largest SNIA TWG with 40+ members

Adopted by the existing SSSI (Solid State Storage Initiative)

The name will change…

19


40+ Participating Companies128+ Individual Members

20


A New Product Category

Computational Storage Device (CSx)

Computational Storage Drive (CSD)Computational Storage Processor (CSP)Computational Storage Array (CSA)

21


Real-Time AI Genomics Improvement

22

DNA and Protein alignment Database Management

Up to 100% more performance at no cost in CPU or Memory

Resolves the IO Bottleneck between CPU and Storage

The Basic Local Alignment Search Tool (BLAST).

Compute in Storageremoves CPUs lack of bandwidth to the data


Hadoop: Job Throughput

23

3.1 w/ EC (6+3)

All benchmarks configurations use HDD as main storage24 Mapper/Reducers per Datanode *9 = 216 total

Better performance on CSS reported with lower Mapper/Reducers possible

Datanode Config:Dual E5-2640v3, 128GB DRAM, 12*6TB

SAS HDD

…14% ↓ vs. baseline

116% Job Throughput23% ↓ vs. baseline

131% Job Throughput

Compute Offload AND Flash Temp

37% ↓ vs. baseline160% Job Throughput

Baseline: Compute & Storage I/O

Bound Compute Offload Only

Flash Temp Only

One per server, 9

total


Want to learn more about Computational Storage?

SNIA – Computational Storage Technical Working Group Resource Pagehttps://www.snia.org/computational

24

https://www.snia.org/computational

SNIA Swordfish™ Scalable Storage Management


What is Swordfish?

Swordfish™ is an extension of the DMTF Redfish specification developed by the Storage Networking Industry Association (SNIA) to provide a unified approach for the management of storage equipment and services in converged, hyper-converged, hyperscale and cloud infrastructure environments, making it easier for IT administrators and DevOps to integrate scalable solutions into their data centers.


What are the Drivers for Swordfish?

Customers (and vendors) have asked for improvements in storage management APIs

Make them simpler to implement and consumeImprove access efficiency

Fewer transactions, with more useful information in each Provide useful access via a standard browserExpand coverage to include converged, hyper-converged, and hyper-scaleProvide compatibility with standard DevOps environments


The SNIA Swordfish Approach

The What:Refactor and leverage SMI-S schema into a simplified model that is client orientedMove to Class of Service based provisioning and monitoringCover block, file and object storageExtend traditional storage domain coverage to include converged environments (covering servers, storage and fabric together)

The How:Leverage and extend DMTF Redfish Specification Build using DMTF’s Redfish technologies

RESTful interface over HTTPS in JSON format based on OData v4 Implement Swordfish as an extension of the Redfish API


Want to learn more about Swordfish?

Find pointers to the latest technical content:http://snia.org/swordfishhttp://www.snia.org/publicreview#swordfish

Online Practical GuideSNIA Swordfish Practical Guide

NEW! Swordfish School: Swordfish School Playlist (YouTube)

Swordfish API SpecificationWebcasts

http://snia.org/swordfish

http://www.snia.org/publicreview

https://www.snia.org/forums/smi/swordfish/practical-guide

http://bit.ly/2vXQQsm

In summary &Questions?


Storage Developer Conference EMEA

SNIA EMEA organizes & hosts SDC EMEAStorage Developer ConferenceFebruary 4-5 2020Tel Aviv, Israelhttps://www.snia.org/events/sdcemeaPlatform for the storage development community to come together and share knowledgeEducations sessions delivered by storage developers

FeaturesSMB3 IO LabPersistent Memory HackathonSNIA Education tracksLocal Storagebeers meetup

https://www.snia.org/events/sdcemea


How to participate

Speaker Directory – register via http://www.snia.org/emeaIndustry eventsWebcastsRoundtables

Educational librarySubmit content in the form of presentations or white papersUsed as educational content – profile to the author

EventsSDC EMEA – Tel Aviv February 4-5 2020Sponsors, speakers, delegatesHelp spread the word

Media supportArticles for publicationPress interviews

Subscribe to our newsletter

http://www.snia.org/emea

Thank you for attending

snia emea virtual meetup · the virtual meetup a new venture by snia emea intended to disseminate...

Documents