1

NetApp for Linux

3

Founded:1992 Headquarters: Sunnyvale, CA Year 2002: > 2,400 employees Distribution: 70+ countries Installed systems: > 38,000

Worldwide Presence

4

Network Appliance provides robust, open

enterprise storage infrastructure, software solutions, and support

that dramatically improve TCO and ROI

through simplicity.

The Appliance Difference

5

S&P 500 NASDAQ 100

$1B balance sheet$500M cash

$0 long-term debt

Revenues ($M)

1,006

FY01

579

FY00

166

FY98

289

FY99

93

FY97FY96

47

798

FY02

2005 Goal: One of Top 3 in Storage Industry

Financial Performance

6

NetApp - Leading the Industry

First NAS appliance certified for Oracle

1997First content

delivery appliance

1998

Co-founded DAFS Collaborative

2000

First iSCSIstorage system

2003

First unified SAN & NAS appliance

2002

First Nearline storage appliance

2001

1996

First network-based data backup protocol

First multiprotocol storage appliance

19961993

First network-attached storage appliance

7

Archive DataBackup / WORM Functions

Department/RemoteCustomer Presentations, Training

Business OperationsE-mail, CRM, Engineering

Business InternalHome Directories, Web, Marketing

Reference InformationBilling Statements, etc.

Business-CriticalERP, Transaction Processing

Recovery Investment

Low High

RecoveryRequirement

Real Time

Days

Optimum Solutions for Each Environment

F825F825

FAS940FAS940

FAS960CFAS960C

R150R150

FAS250/270FAS250/270

8

FAS 250

14 FC drives LED’s OPS panel

9

FAS 250 - Rear view

Power Supply Power SupplyTsantsa Filer Head

10

FAS 250 Filer Head

ProcessorMemory BatteryBackplane connectors

FC controller

11

FAS 250- Filer rear view

Console port2X GbE copperNICS

FC (copper)port

12

Unified Storage Architektur

SCSI, FC

DAS

ApplicationServer

ApplicationServer

File SystemRAID

FC Switch

SAN

ApplicationServer

ApplicationServer

File System

RAID

Ethernet Switch

ApplicationServer

ApplicationServer

NAS

File SystemRAID

FAS

ApplicationServer

ApplicationServer

File System

File SystemRAID

ApplicationServer

ApplicationServer

13

Network Appliance: Unifying Storage

11 3

2

NAS

\Eng\MktSAN

Host 1

Host 2

Host 3

Combines Resource & data sharing Ethernet and Fibre Channel networks File and block oriented protocolsFor long-term investment protection

Client 1

Client 2

Client 3

11 3

2

14

Exactly the Same Management Software

Host-Based Management– To flush file system to disk– To initiate use of NetApp® data management

solutions: Snapshot™, SnapRestore®, etc.– Using CLI, NetApp tools, or with third-party

solutions (VxVM)

NetApp Capability- Snapshot- SnapRestore

- SnapMirror®

- SyncMirror

- SnapVault™- SnapDrive™- SnapManager®

NAS SAN,iSAN

No HostCoordination

Required

Same Functionality,

However Host-Initiated

Same Functionality, Host-Initiated

15

NetApp (Logical) Data Protection

Data actually resided in block C on disk

A B C

Active File System

File: NETAPP.DAT

Disk blocks

16

Snapshot Internals

Snapshot.0

File: NETAPP.DAT

Data actually resided in block C on disk

A B C

Active File System

File: NETAPP.DAT

Disk blocks

- Makes copy of root inode- Updates Block Map File

17

Client modifies data at end of file

Snapshot Internals (3)

C’

Snapshot.0

File: NETAPP.DAT

Data actually resided in block C on disk

WAFL writes modified data block to new location on disk (C’)

A B C

Active File System

File: NETAPP.DAT

Disk blocks

18

Active file system version of NETAPP.DAT is now composed of disk blocks A, B & C’.

Snapshot Internals (4)

Snapshot.0 file system version of NETAPP.DAT is still composed of blocks A, B & C

C’

Snapshot.0

File: NETAPP.DAT

A B C

Active File System

File: NETAPP.DAT

Disk blocks

19

Snapshot.1 file system version of NETAPP.DAT is composed of blocks A, B & C’

Snapshot Internals (5)

C’

Snapshot.0

File: NETAPP.DAT

A B C

Active File System

File: NETAPP.DAT

Disk blocks

Snapshot.1

File: NETAPP.DAT

20

Snapshot™ Based Data Recovery

21

Writable Snapshots

C’

Snapshot.0

LUN: NETAPP.DAT

A B C

Active File System

LUN: NETAPP.DAT

Disk blocks

LUN:NETAPP1.DAT

C’

Active File System

22

Restore the 300 GB database Recover the database with the redologs Normal Restore/Recovery

– Daily tape backup– Tape recovers at 60 GB/hour– => 55 hours + recovery time hours + recovery time

Recovery time = Time needed to apply logs from Recovery time = Time needed to apply logs from backupbackup until time of until time of failurefailure

Restore/Recovery with Snapshots/SnapRestore – Every two hours a Snapshot was taken– SnapRestore reverts volume to the state of the selected Snapshot – few

seconds– => few seconds + recovery time=> few seconds + recovery time

Recovery time = Time needed to apply logs from Recovery time = Time needed to apply logs from last snapshotlast snapshot until until time of failuretime of failure

Lets assume the Oracle database is damaged

Snapshot Oracle Restore/Recovery

23

Writeable Snapshots in the Oracle Environment

Filer Fast system copy

No double disk space necessary

Share the same data for production system and a test system e.g. SAP upgrade testing

Example 100 GB Oracle Lun , copy with writable Snapshots -> Result 2 Systems with 100 GB each , need only 100 GB on the Storage .

High

End

Oracle Prodution

NetApp Filer

OracleTest System Vdisk

Vdisk

Active LUN/VLD

Writeable Snapshot

24

Windows Host Management Environment

SnapDrive™ – Virtual disk/Snapshot™ management to

Windows client and applications

Benefit– Common look/feel of standard MS

management utility– Simplified data management

administration– Same management interface for different

data access technologies

Features– Dynamic disk and volume management– Snapshot management– Operating system and file system support– Administration through MMC or CLI

25

Snapmanger Exchange Solution

iSCSI

FCP

SnapManager

SnapDrive

•SnapManager provides the GUI and automates Exchange-specific tasks

•SnapDrive provides disk and Snapshot™ management infrastructure.

ExchangeAPIExchange

2000

NTFS I/O Subsystem

VLD

•iSCSI support•Single mailbox restore

26

Business Continuance: MetroCluster™

BuildingA

BuildingB

LAN

Cluster interconnectA-loopB-loop

dark fibre

vol X

vol Y’ vol X’

vol YBenefitsDisaster protectionUp-to-date mirrorCompete redundancySite failover

10-30km

27

Step 5 Nearstore Archive Backup / DR Cosolidation

Data Center

HeterogeneousStorage

Filer UNIX®

ServerLinux®

ServerWindows®

Server

BackupServer

NearStore™

StorageNetwork

SnapVaultTM

Remote Office

WindowsServer Filer PCs

LANWAN

Data Center:Remote Mirrored Site

SnapMirror®

TapeLibrary

BackupServerWAN

28

vfiler C

NFS

vfiler A

500 500

CIFSNFS

vfiler B

CIFS

Site 2 Site 3

MultiStoreTM ConsolidationMulti-domain Server / Storage

MultiStoreTM

Use NetApp cluster for added downtime protection and load distribution

WIN ANIS A

NIS CWIN B

500 500 500 500

Site 1 Product Description:

• Optional licensed software

• Logical partitioning of storage/networking

• May contain volumes and/or qtrees

• Creates upto 10 Vfilers

• Individual WIN/NIS domains

• Separate IP domains

• Multiprotocol

• NFS, CIFS or Both

• Vfiler admin

• User Quotas

vfiler CAdmin

vfiler AAdmin

vfiler BAdmin

29

vfiler C

500 500

MultiStoreTM

500 500

vfiler Cvfiler B

500 500

vfiler A

500 500

An Industry Firsts - Disaster Recovery/Data Migration

MultiStoreTM

Issue: • Migrate Site 3 users from a Filer to new filer

500 500

WAN/LAN

Ethernet Switch Infrastructure

SnapMirrorTM

Data

500 500

Benefits: • Quick Disaster Recovery

• Easy Migration for Load Balancing

vfiler Cvfiler C

500 500

Site 2 Site 3Site 1

vfiler CAdmin

vfiler AAdmin

vfiler BAdmin

30

Data Management

• Extend Snap* benefits to block mode data access

• Instantaneous, disk-efficient Snapshot data protection• LUN-based SnapRestore

FC SAN

Chicago

• SnapMirror data replication for disaster recovery, data protection

Internet

London

San Francisco

Tokyo

DataFabric ManagerMult-Appliance Management

IP SAN

• Application specific SnapManager data protection

31

Fabric Attached Storage

ORACLE

FC iSCSI CIFS FTP DAFSNFS HTTP

LUN Semantics File Semantics

Performance Acceleration

Block Management

WAFL

NFSFC iSCSI

32

Oracle’s E-Business Applications Implementation

Linux Systems NetApp

33

IT Infrastructure - Today

StorageNetwork

InfrastructureEthernet

FC

Mostly FC

Mostly Ethernet

Lots of both

DRNetwork

DR Site

LAN WAN

Remote Offices

StorageNetwork

Layered ProductionBus. Internal, some Bus.

Operations

Core Production:Bus. Critical, some Bus.

Operations

Test/ Dev

34

IT Infrastructure – NetApp Participation

StorageNetwork

InfrastructureEthernet

FC

Mostly FC

Mostly Ethernet

Lots of both

DRNetwork

DR Site

LAN WAN

StorageNetwork

StorageNetwork

Layered ProductionBus. Internal, some Bus.

Operations

Core Production:Bus. Critical, some Bus.

Operations

Test/ Dev

Internet

Remote Offices

Adding Value Across the InfrastructureDecreased CostImproved Productivity and Service LevelsReduced Risk

NetApp Solutions

35

IT Infrastructure – The Evolution of Storage

StorageNetwork

InfrastructureEthernet

FC

Mostly FC

Mostly Ethernet

Lots of both

DRNetwork

DR Site

LAN WAN

Layered ProductionBus. Internal, some Bus.

Operations

Core Production:Bus. Critical, some Bus.

Operations

Test/ Dev

PrimaryStorage

SecondaryStorage

CDN

Archive

Internet

Remote Offices

Adding Value Across the InfrastructureDecreased CostImproved Productivity and Service LevelsReduced Risk

NetApp Solutions

36

Which Protocol should you use for DB?

NFS– Best choice for most UNIX/Linux deployments

• If FC infrastructure is not already in place– Best TCO (because of NetApp features & Network cost, not “NFS”)

iSCSI– Best choice for Windows deployments

• If FC infrastructure is not already in place– With NetApp SnapDrive, TCO approaches NFS

FC– Easy way to bring NetApp value into existing infrastructure

• Leverage investment in equipment and training– Consider for large RISC Servers with one large DB

• If performance is more important than cost or management • Consider NFS (and soon iSCSI) if cost is as important as performance

– With NetApp SnapDrive, storage portion of TCO approaches NFS

CIFS: Not for Database RDMA enabled NAS (DAFS and advanced NFS)

– For those who want to be on the leading edge of both performance and TCO

Real answer: use the one that makes sense for your environment– Flexibility = removal of risk

37

Fujitsu-Siemens Flexframe Solution for SAP/Oracle

38

Why NetApp for Linux ?

Open, Modular, Reliable and Scalable Lower Cost Simple to install, setup and administer Provides widest portfolio of Storage Solutions

for Linux Unified Storage (NAS and SAN) Effective building blocks that scale easily

39

Competitive Advantage

It’s a Filer too!!!!!!

The Swiss Army Knife of Storage!

40Network Appliance Confidential

iSCSI

41

What is iSCSI

Goal : Using Internet Infrastructure transporting SCSI Packets

The iSCSI protocol enables access to storage devices and Storage Area Networks (SANs) over TCP/IP (Port 3260)

iSCSI Standard Feb 2003 TCP as additional transport protocol for SCSI (others

are FC , Parallel SCSI , IE1394)

Ethernet CRCIP TCP iSCSI SCSI Data…

//

42Network Appliance Confidential

SQL Server(Application)

File(NTFS)

SCSI ClassDriver

iSCSIProtocol

TCP/IP TCP/IP

iSCSIProtocol

SCSI DeviceDriver

Disk(LU)

Link LinkEthernet

SCSI CommandsSCSI

SCSI Transport iSCSI

Wire

IP

iSCSI Session

File System

iSCSI Layers

43Network Appliance Confidential

SQL Server(Application)

File(NTFS)

SCSI ClassDriver

iSCSIProtocol

TCP/IP

Link

SCSI

SCSI Transport iSCSI

Wire

IP

Filesystem

SQL Server(Application)

File(NTFS)

SCSI ClassDriver

FCProtocol

FC

Link

SCSI

SCSI Transport FC

Wire

Fibre Channel

Filesystem

iSCSI Spec

FCSpec

iSCSI and FC Specification

44

iSCSI SessionsiSCSI Sessions

–Login Phase• enable one or more TCP connections for iSCSI use• negotiation of the session's parameters

– Used for LUN Masking and LUN Mapping– Number of parallel TCP connections fo a iSCSI Session– Athentication Method and Encryption

–Full Feature Phase• Exchanging Data (Read and Writes ..)• TCP Connections are open through the complete Session • Single Connections or Sessions can be ended

–Deliver SCSI commands in order–Recover from lost connections

iSCSI DeviceTarget

iSCSI Host

iSCSI SessioniSCSI Session

TCP Connection

TCP Connection

iSCSI Initiator

Server

GigE NIC(Network Interface Card)

45

10.2.1.3:3260

10.2.1.4:3260

Server 1

iqn.2003.02.com.example:iscsi.server1

iSCSI Adress- und Namenskonvention

IP Network

iSCSI node (initiator)

has iSCSI name, alias and network

portals (i.e. IP address and TCP

Port)

10.2.1.1:3260

Network Entity

Disk Array A

(iSCSI server)

10.2.1.2:3260

iqn..:arraya.target1iqn..:arraya.target1

iqn..:arraya.target1

Portal group

iSCSI nodes (targets) have iSCSI names, alias and

network portals (i.e. IP address and TCP Port)

iSCSI Node Nameiqn.1992-08.com.netapp:sn.35780522iqn.<date company obtained domain name>.<reserved domain name>:hostname

Encoded in the UTF8 character set Max size is 223 bytes

No white space is allowed

Upper case characters are converted to lower case

Valid characters are : ASCII dash ('-') , dot ('.'), colon (':')

ASCII lower-case characters ('a' through 'z‘, ('0' through '9') )

46

iSCSI Messages

Initiator Messages– NOP-out– SCSI Command

Encapsulates a SCSI CDB

– SCSI Task Management Command

– Login Command – Text Command– SCSI data

Output Data for Writes– Logout Command– SendTargets

Used in iSCSI Discovery

Target Messages– NOP-in– SCSI Response

Can contain status– SCSI Task Management

Response– Login Response– Text Response– SCSI data

Input Data from Reads– Logout Response– Ready to Transfer

R2T– Async Event

iSCSI DeviceTarget

iSCSI Host

iSCSI SessioniSCSI Session

TCP Connection

TCP Connection

iSCSI Initiator

Server

GigE NIC(Network Interface Card)

Ethernet CRCIP TCP iSCSI SCSI Data…

47

iSCSI Error Recovery and Security

Interface Failover (NIC,HCA)

iSCSI and SCSI level error recovery

Standard IP route redundancy (TCP,

VIF,Trunking)

ServerNIC/TOE

/(Network Interface Card)

Gig

aBit E

thern

et Sw

itch

NIC/TOE(Network Interface Card)

GigaBit Ethernet Kabel

GigaBit Ethernet Kabel

GigaBit Ethernet Kabel

GigaBit Ethernet Kabel

MultiPath

(MPIO)

iSCSI

Multipathing Software (Veritas , MPIO,...) Focus : iSCSI HCA IP Layer (VIF) , Trunking ... , Focus : iSCSI Software InitiatorTCP Layer – “in-order delivery”iSCSI Layer :

Error Recovery Level 0 = Fibre Channel ,Level 1 = Digest Recovery Level 2 = Connection Recovery

Number and Sequenz will be checked ,out-of-order delivery Paketts , initiate a

new requestChecksums check DatacorruptionACK-based Flow Control

Initiator and Client authentication (CHAP, SRP,Kerberos, SPKM )

48

iSCSI Target Discovery

Manual Config on the Host– iSCSI Discover PDU find all Targets inside a Portal

Service Location Protocol SLP– broadcast/multicast or dedicated SLP Server

Agent

Internet Storage Name Service iSNS– Dedicated Server– Zoning through Discovery Domains– Can serve Public Key Repository – Can serve Access Control Repository is normally

done from the Storage-System

49

iSNS

Server

Each iSCSI device registers itself and its attributes in the iSNS serverOptions:1 Monitoring: iSNS server polls storage devices to monitor their availability 2 Client Re-registration: Storage regularly re-register themselves before timeout period expires

ManagementConsole

Server

Zone Config :

“Server ” and FAS250 in

the same Discovery Domain

iSNS Server

50

ServerServer

Server

iSCSI Implementations Server and Storage

Block

File System

SCSI Driver

NIC Driver

iSCSI Driver

TCP/IP

NIC DriverTCP/IP

iSCSI Driver

File System

SCSI Driver

NIC Driver

iSCSI Driver

TCP/IP

File System

SCSI Driver

NIC Driver

iSCSI Driver

TCP/IPTCP/IPOffload Engine

iSCSI Software iSCSI

HCA

iSCSI Gateway FC

Switch DiskiSCSI Native Device : Example: Netapp Filer

iSCSI HCA

TOE HCA

GigaBit Ethernet Switch

51

iSCSI Boot

Boot can be configured static or dynamic – Static Configuration for iSCSI Boot:

• Admin configure authorized iSCSI Node Name and iSCSI Adresse

– Dynamic Config with DHCP oder SLP• DHCP assign the Host a IP Adress• DHCP get the option iSCSI Boot Service (Admin Set) – include

iSCSI Target node name• SLP can be used for searching the Boot Service without DHCP

– Alternative:• BootP is possible for Software-iSCSI Lösungen and Hardware • iSCSI HBA like a SCSI Adapter and doing (BIOS-Boot)

52

VLD

(No Jumbos)

ISCSI Microsoft

Driver

ISCSI Intel PRO/1000

Storage

FCP LP9002

TPUT Usecs/

IO TPUT

Usecs/IO

TPUT Usecs/

IO TPUT

Usecs/IO

64K Reads (MB/s) 114 741 74-95 460 100 67 187 48 Large

Cached (MB/s) 64K Writes

(MB/s) 78 826 85 241 106 59 158 44

4K Reads (IOPS) 15,000 143 14,100 123 12,200 32 28,400 33

4K Writes (IOPS) 18,100 156 18,400 76 12,500 28 25,200 32

512b Read (IOPS) 22,100 99 18,100 82 17,200 29 31,800 25

Small Cached (IOPS)

512b Writes (IOPS

23,500 107 21,200 69 15,700 34. 30,000 33

Basic Internal Initiator Comparisons (Win2K)

53

Initiator Comparisons (Win2K)

All cached workloads Host was IBM xSeries 345 with 2 x 2.0 GHz

hyperthreaded processors, PCI-X Microsoft driver is Pre-Beta 2 iSCSI numbers all used JUMBO frames

iSCSI SW Initiator „30 MB/sec -> 500 MHz“ , 30% of a 1.5 GHz CPU

54

Host Side Application Performance

SQL Server OLTP TPUT & CPU costs over VLD, FCP, iSCSI

0%

20%

40%

60%

80%

100%

VLD FCP iSCSI

CP

U U

tili

zati

on

0

2000

4000

6000

8000

10000

12000

tpm

tpm

Win2K Priv. CPU

F880 CPU

FCP & VLD runs w ere on 6.3iSCSI run w as on Fullsail (w / CP smoothing w hich has show n up to 10% tpm improvement)

SQL Server TPC-C Runs against F880 from 4-way Intel 550Mhz w/ Win2K. 800 Warehouses.

55

0

5

10

15

20

25

2002 2003 2004 2005 2006

Open Systems External Storage Market

NAS

SAN

DAS

SAN: $5.3 B in 2003CAGR 15%

$B

Source: IDC, Oct. 2002

NAS: $1.9 B in 2003CAGR 27%

56

Archive DataBackup / WORM Functions

Department/RemoteCustomer Presentations, Training

Business OperationsE-mail, CRM, Engineering

Business InternalHome Directories, Web, Marketing

Reference InformationBilling Statements, etc.

Business-CriticalERP, Transaction Processing

Recovery Investment

Low High

RecoveryRequirement

Real Time

Days

Optimum Solutions for Each Environment

F825F825

FAS940FAS940

FAS960CFAS960C

R150R150

FAS250FAS270FAS250FAS270

57

Network Appliance: Unifying Storage

11 3

2

NAS

\Eng\MktSAN

Host 1

Host 2

Host 3

Combines Resource & data sharing Ethernet and Fibre Channel networks File and block oriented protocolsFor long-term investment protection

Client 1

Client 2

Client 3

11 3

2

58

Introduces transport independent LUN storage object Usable as raw disk or host file system container Improves performance with efficient automatic

striping across multiple spindles Variable size, dynamic expansion, resize Simple Wizard-based LUN Setup Integrated LUN masking for SAN security Integrated multiprotocol security for unified storage

Virtualization Enhancements

WAFL Volume 1

D D D D P

RAID Group 1

D D D D P

RAID Group 2

LUN 2; Size 1MB

LUN 1; Size 10GB

LUN 3; Size 128KB

Virtualized Storage

LUN Properties- Up to 4TB- Up to 4096 / host- WWN/WWID masking

59

Writable Snapshots

C’

Snapshot.0

LUN: NETAPP.DAT

A B C

Active File System

LUN: NETAPP.DAT

Disk blocks

LUN:NETAPP1.DAT

C’

Active File System

60

Writeable Snapshots in the SAP , Oracle , SQL Server Environment

Filer Fast system copy

No double disk space necessary

Share the same data for production system and a test system e.g. SAP upgrade testing

Example 100 GB Database Lun , copy with writable Snapshots -> Result 2 Systems with 100 GB each , need only 100 GB on the Storage .

High

End

SAP Prodution

NetApp Filer

SAPTest System Vdisk

Vdisk

Active LUN/VLD

Writeable Snapshot

61

Windows Host Management Environment

SnapDrive™ – Virtual disk/Snapshot™ management to

Windows client and applications

Benefit– Common look/feel of standard MS

management utility– Simplified data management

administration– Same management interface for different

data access technologies

Features– Dynamic disk and volume management– Snapshot management– Operating system and file system support– Administration through MMC or CLI

62

Snapmanger Exchange Solution

iSCSI

FCP

SnapManager

SnapDrive

•SnapManager provides the GUI and automates Exchange-specific tasks

•SnapDrive provides disk and Snapshot™ management infrastructure.

ExchangeAPIExchange

2000

NTFS I/O Subsystem

VLD

•iSCSI support•Single mailbox restore

63

SnapManager® Exchange Customers

500+ customers for both Exchange 5.5 & Exchange 2000, worldwide

> 2 million Exchange seats

Some SnapManager reference customers on E2K:

– Weston Solutions– Trader Media Group– Commonwealth of Virginia– US Army - Soldier Biological Chemical Command

– DPR construction

–Barry University –Invesco–Telemundo –Metaldyne

64

SnapManager SQL Server features

Near Instantaneous Backups – Creates full backups of SQL Server databases of any size in seconds -

compared to hours by tape– Eliminates the need for incremental backups– Uses SQL Server Backup API (VDI) to ensure SQL Server availability

during backup– Backs up multiple databases simultaneously– Rapid snapshots allow more frequent backups

Near Online Restores– Restores SQL Server in seconds or minutes – compared to hours or days

by other solutions– Provides option to restore entire server or a single database– Restores multiple databases simultaneously– Recovers SQL Server to a point in time or rolls forward transaction logs

to recover up-to-the-minute– Option to restore databases to an alternative server

65

Questions