snia-sa 100 chapter 8 emerging technologies (version 1.1)

8/22/2019 Snia-sa 100 Chapter 8 Emerging Technologies (Version 1.1)

1/53

COPYRIGHTED 2004

1

SNIA

-

SA 100

Introduction to

Network Storage

Chapter 8

Emerging Technologies

Version 1.1


2/53

COPYRIGHTED 2004

2

1. Storage Virtualization

2. IP Storage3. Other Emerging Technologies

4. Review Questions

Coverage


3/53

COPYRIGHTED 2004

3

Section 1


2. IP Storage3. Other Emerging Technologies

4. Review Questions


4/53

COPYRIGHTED 2004

4

Section 1: Storage Virtualization

1.1 Definition

1.2 Illustration

1.3 Need for Storage Virtualization1.4 Benefit of Storage Virtualization


5/53

COPYRIGHTED 2004

5

Storage Virtualisation

Definition (SNIA):

The act of abstracting, hiding, or isolating the internal

function of a storage (sub) system or service from

applications, computer servers or general network resourcesfor the purpose of enabling application and network

independent management of storage or date.


6/53

COPYRIGHTED 2004

6

Illustration

Tape

Storage Server

Storage Pool

Vendor A

Vendor B

Vendor C

DisksClient will see storage as

virtual storage pools


7/53 COPYRIGHTED 2004

7

Need for Storage Virtualization

Addresses increasing complexity of managing storage

Reduce associated costs

Ensures high availability and improved performance.

Enables the ability to choose multi-vendor storageindependent of the functionality

Virtualized storage not limited by the capacity, speed

or reliability limitations of the physical device.

Provides ability to change and upgrade hardware without

disrupting data.



8

Storage Virtualization-Benefits

Efficient Management of Data Storage Resources

Dynamic management of storage resources as virtualstorage pools with little regard to its physical

implementation.

Centralized management and data sharing withheterogeneous servers.

Easy Upgrades

Enables non-disruptive capacity expansion, which is criticalwhen storage is growing.

Simplified Configuration

Allocating volumes, migrating from or replacing obsoletestorage subsystems subsystems without server shutdownsor interrupting data access can be done on the fly.



9

Section 2


2. IP Storage

3. Other Emerging Technologies

4. Review Questions



10

Section 2: IP Storage

2.1 What is IP Storage

2.2 IP Storage Technologies

2.2.1 FCIP

2.2.2 iFCP

2.2.3 iSCSI



IP Storage

What is IP Storage?

A group of technologies that allows block-level storage data

to be transmitted over an IP-based network.

Why IP Storage?

Leverage on existing IP infrastructure

Quality of Service of IP network.

Security features- IPSec already available.

Use existing switching and routing elements. Existing pool of skills in IP Technology

Overcome the distance limitation in FC SAN(10 km)

Interconnect FC devices to dispersed SAN islands



IP Storage Technologies

Fibre Channel over IP (FCIP)

Internet Fiber Channel Protocol (iFCP)

Internet SCSI (iSCSI)

Internet Storage Name Server (iSNS)



What is FCIP?

Definition (SNIA)

TCP/IP based tunneling protocol for connecting geographicallydistributed Fibre Channel SANs transparently to both FC and IP.

FCIP gateway encapsulates FC frames into IP.

Only edge devices need to be added.

Goal is to interconnect geographically dispersed SANsthrough reliable high speed links.

IP PayloadIP Header CRC

SCSI DataFC

HeaderSOF CRC EOF Fibre Channel Frame

IP Datagram

FCIP



Overcome distance limitation of Fibre Channel (10km)

Cost-effective way to enable solutions such as remote

mirroring, replication, tape vaulting etc in existing FCinfrastructure.

Why FCIP?

Interconnect geographically dispersed SAN islands through

existing IP network.

FCIP



How it Works

Optical IP

Edge

Router

Edge

Router

Edge

Router

FCIP Gateway

SAN Island 1

SAN Island 2

SAN Island 3

FCIP tunnel

FC Frame

FC Frame

FC Frame

FCIP headers

TCP

headers

FC Frame

FC Frame

FC Frame

FC frame is encapsulated into FCIP packet,then into TCP packetand sent over FCIP tunnel to the destination device.

At the destination the FC frame is un encapsulated in the reverseorder.



16

Outsource Storage Hosting

Customer data can be hosted at a service provider data

center and

Servers at customer sites can efficiently access the

hosted storage over the network

FCIP enables SAN interconnectivity over long distances

Remote backup and restore

Data Replication

At higher link speeds, synchronous applications can beimplemented.

Eg. Synchronous mirroring or replication.

FCIP Applications



17

What is iFCP?

A gateway-to-gateway protocol for implementing a Fibre

Channel fabric with TCP/IP switching and routing elements.

Maps Fibre Channel transport services over TCP/IP,

allowing networked, connections among FC devices.

Why iFCP?

IP network providing switching and routing functions

for FC.

iFCP

Providing features of FC over IP network.



18

iFCP Frame

SCSI Data CRCTCP iFCP FCPEthernet

HeaderIP

The FC frame is encapsulated within the iFCP header

followed by the TCP and IP Headers



19

Implementation

Application Layer

Operating System

Standard SCSI Command set

Fibre Channel Protocol

TCP

IP

Ethernet

Lower Layer

FC

At the highest layer, Fibre Channel Protocol (FCP) provides a

serial SCSI interface to the operating system

iFCP



20

iFCP How it works

Tape Library

FC Loop

IP Network

Device to Device

iFCP Gateway

iFCP Gateway

Server

There can be different types of communication in an iFCPnetwork

Device to Device communicationSAN to SAN when there are existing FC fabrics

Device to SAN communication



21

Benefits of iFCP

Leverage on the existing IP network/infrastructure to deliver FC frames.

Enables routing of storage data over wide areas.

Facilitates interoperability with most of the storage devices in the market

today.

iFCP


22/53

COPYRIGHTED 200422

What is iSCSI?

Make IP as a transport for SCSI commands.

Allows SCSI block- I/O commands to be sent over existing IPnetwork.

Required iSCSI-enabled device (e.g. HBA or software layer).

Allow remote disk copying, tape backup and restore.

iSCSI

SCSI commands and data

iSCSI

Header

TCP

header

IP

Header

Contain routing

information

Information regarding

guaranteed delivery

Information to extract SCSI

commands and data


23/53

COPYRIGHTED 200423

iSCSI How it works

iSCSI iSCSI

IP Packet

IP network

IP Packet

Server with iSCSI controller

Storage Device

1

2 3

4


24/53

COPYRIGHTED 200424

iSCSI Protocol Model

SCSI

iSCSI

Link

TCP

IP

SCSI

iSCSI

Link

TCP

IP

Initiator Target

IP Network


25/53

COPYRIGHTED 200425

Pros

Ethernet network

already in place.

Support longerdistance network

Uses SCSI (Block) I/O

protocol

Lower Cost

Cons

Performance overhead

in using TCP/IP

iSCSI


26/53

COPYRIGHTED 200426

Who will get benefits?

iSCSI SANs are most suitable for organizations with a need forstreaming data and/ or large amounts of data to store andtransmit over the network.

Internet Service Providers (ISPs)

Storage Service Providers (SSPs) Organization that need remote data replication and disaster

recovery

Geographically distributed organizations that require accessto the same data on a real-time basis

Business and Institutions with limited IT resources,infrastructure and budget


27/53

COPYRIGHTED 200427

Deployment Examples (1)

Reference: iSCSI: The Future of Network Storage, Intel


28/53

COPYRIGHTED 200428




29/53

COPYRIGHTED 200429




30/53

COPYRIGHTED 200430

What is iSNS

Device Discovery in Fibre Channel

Discovery in IP Storage Networks

iSNS Discovery Process

iSNS and Entity Status Enquiry

iSNS Objects

iSNS Security

iSNS


31/53

COPYRIGHTED 200431

What is iSNS

Used for device discovery

Uses both FC and Internet discovery mechanisms.

End-nodes must register their presence in the network

Initiative that has been developed for facilitating devicediscovery in a large scale IP storage network is iSNS.

Enables discovery of iFCP and iSCSI devices using common

protocols .

iSNS


32/53

COPYRIGHTED 200432

Device Discovery in Fibre Channel

nodes log on the fabric to obtain 24bit network address

registers to the SNS within the fabric switch

SNS maintains a small database that contains the WWN,fabric address, COS parameters and other attributes.

SNS streamlines the discovery process but does not dictateassignment of initiators to targets.

iSNS


33/53

COPYRIGHTED 200433


iSNS provides support for iFCP and iSCSI

include the discovery of gateways

also discovery of storage nodes in an IP SAN

Address discovery related issues such as zoningand change notification

Minimize discovery processing requirements for IPstorage end devices.

Reduce administrative and managementoverheads.

iSNS


34/53

COPYRIGHTED 200434


iSNS

iSNS

iFCP Gateway

iFCP Gateway

iSCSI Server

iSCSI Server

iSCSI Storage

iSCSI Storage

FC Server

FC Server

FC Server

FC Server

FC Storage

FC Storage

FC Storage

FC Storage


35/53

COPYRIGHTED 200435


Device registration

Attributes and address information

Server builds a database of iSNS clients

iSNS


36/53

COPYRIGHTED 200436


iSNS

iSNS

Device C

Device BDevice A

Rgstr Entity (iFCP)

WWPN=PNA

PortID=010126FC4Types=FCP

Portal IP Address = 10.1.1.1

WWNN = NNA

SCNbitmap=AllEvents


37/53

COPYRIGHTED 200437

iSNS SCN and Entity Status Query

iSNS

iSNS

Device CDevice B

Device A

DD1

DD2

State

ChangeNotification

iSNS


38/53

COPYRIGHTED 200438

iSNS Objects iFCP iSNS network entity

iSNS

IP Network

FC Loop / Fabric

Portal

-IP Addr 1

-TCP Port 1

Portal

-IP Addr 2

-TCP Port 2

Storage Port-WWPN1-PortID1

-FWWN1

-FC COS

Storage Node-WWNN1-Symbolic Name

-FC Node IP Add-Type - Target

Storage Port-WWPN2-PortID2

-FWWN2-FC COS

Storage Node-WWNN2-Symbolic Name

-FC Node IP Add-Type - Target


39/53

COPYRIGHTED 200439

iSNS Objects iSCSI iSNS network entity

iSNS

IP Network

Portal

-IP Addr 1

-TCP Port 1

Portal

-IP Addr 2

-TCP Port 2

Storage Node

-WWUI

-AliasServer1

- Type - Initiator

Storage Node-WWUI-Alias Disk1

- Type - Target

Network Entity

-Entuty ID strg1.foo.com

-Type : iSCSI

Network Entity

-Entuty ID strg1.bar.com

-Type : iSCSI


40/53

COPYRIGHTED 200440

iSNS Security

iSNS

iSNS

Key Repository

Public Key Public Key Public Key

Device A Device B Device C

Management

Platform


41/53

COPYRIGHTED 200441

Section 3


2. IP Storage


4. Review Questions


42/53

COPYRIGHTED 200442

Section 3: Other Emerging

Technologies4.1 Policy Based Management

4.2 Object- Based Storage


43/53

COPYRIGHTED 2004

43

Policy Based Management

Policy as defined by SNIA is the measurable, enforceable,and

realizable specification of method, action, and/ or desired state

that meets service requirements in a storage based information

infrastructure

Policies define the relationship between SLOs (Service LevelObjectives) and a particular application

Policies also define the actions necessary to meet and enforce

those SLOs through the execution of storage management

processes.


44/53

COPYRIGHTED 2004

44

Object Based Storage

Storage devices that are treated as objects rather that blocks

or files.

Object-based storage technologies shield the application or

operating system from the low-level details of managing file

storage.

The intelligence is added to the storage device in order tooffload low-level storage management tasks traditionally

handled by the operating system, such as mapping files to

actual storage blocks on the disk drive and managing file

attributes and other associated metadata.

Enables cross-platform capable SANs

Platform-specific management routines can be offloaded to

the devices.

The storage device can serve data directly to the host.


45/53

COPYRIGHTED 2004

45

Object-Based Storage

Objects can be regarded as the convergence of files and blocks.

Files provide applications with a higher-level storageabstraction that enable secure data sharing across differentoperating system-platforms

But often at the cost of limited performance due to file-server contention

Blocks offer fast, scalable access to the shared data

But without a file server to authorize the I/O and maintainthe metadata, this direct access comes at the cost of

limited security and data sharing


46/53

COPYRIGHTED 2004

46

Contribution of Object-based

Storage Objects are primitive, logical units of storage that can be directly

accessed on a storage device no server needed

It is metadata that provides the information needed to

directly access objects, along with other information aboutdata including its attributes, security keys, and permissions


47/53

COPYRIGHTED 2004

47

OSD Object Abstraction

Source: T10 document;SCSI object based storage Device commands


48/53

COPYRIGHTED 2004

48

OSD Object Abstraction

In the block-based storage model, the file systems located in the

servers are responsible for the management of both files and

available disk blocks on the disk storage devices

In the OSD model, the file system is divided into two separate

parts that communicate through OSD interface. The file

manager only needs to manage objects while the management

of the individual blocks is moved to the storage devices.


49/53

COPYRIGHTED 2004

49

Block Based vs. Object Based

Disk

Source: Object based storage using OSD to solve Data, Intel Developer forum by Cameron and Satran.J

An Example of OSD Storage


50/53

COPYRIGHTED 2004

50

An Example of OSD Storage

Architecture


51/53

COPYRIGHTED 2004

51

Section 4


2. IP Storage


4. Review Questions


52/53

COPYRIGHTED 2004

52

Review Questions

How does SAN leverage on the existing LAN?

What is FC/IP and how is it different from iFCP?

How does iSCSI work?

Explain the Infiniband Architecture and its benefits.

References


53/53

53

References IBM Enterprise Solutions Handbook

IP Storage Forum White Paperhttp://www.snia.org

Delivering Storage Solutions over IP Networks, SNIA IP Storage Forum

Presentation

Clearing the Confusion: A Primer On Internet Protocol Storage Networks,

SNIA IP Storage Tutorial

http://www.dothill.com

http://www.dell.com/R&D

http://www.techtarget.com

http://www.seneschal.net.com

http://www.sysopt.earthweb.com/articles/infiniband

http://business.vsnl.com/spacemagnum

http://www.snwonline.com
http://www.snia.org/http://www.dothill.com/http://www.dell.com/R&Dhttp://www.techtarget.com/http://www.seneschal.net.com/http://www.sysopt.earthweb.com/articles/infinibandhttp://business.vsnl.com/spacemagnumhttp://www.snwonline.com/http://www.snwonline.com/http://business.vsnl.com/spacemagnumhttp://www.sysopt.earthweb.com/articles/infinibandhttp://www.seneschal.net.com/http://www.techtarget.com/http://www.dell.com/R&Dhttp://www.dothill.com/http://www.snia.org/

snia-sa 100 chapter 8 emerging technologies (version 1.1)

Documents