FY07 SAN Plans

Rich Loft

Tom Bettge

SAN Team

Oct 3, 2006

High-speed Shared File System – Fall 2006

CDP(dataportal)Sun V880

DSS(huron)

Sun V880

Mc DataSwitch

MetaData

Servers

Storage device

Storagedevice

Internet

DSS(bison)

Sun V880

TIGGE(ultrazone)Sun V890

TERAGRID(datagrid)Sun V890

Teragrid

2007

Storagedevice

Storagedevice

TIGGE Load Tests

• Question: Can TIGGE load coexist on SAN with DSS workload?

• Bill Anderson simulated this by measuring SAN performance as function of TIGGE process count for various numbers of “background” DSS threads.

• Results in all cases exceeded “mean” throughput requirements of TIGGE

• Decision: locate DSS workspace on SAN.

SAN Load Test Performance Results

Mean Aggregate Throughput of Tigge Workload (MB/sec)

0

20

40

60

80

100

120

140

160

180

0 5 10 15 20 25

number of concurrent streams in Tigge workload

throughput (MB/sec)

Tigge workload only

4 additional I/O streams

8 additional I/O streams

16 additional I/O streams

average throughput required for Tigge workload ( ~24 MB/sec)

Each stream wrote or read a 1 GB sized file using a request size of 64 KB.

SAN Filesystem to Physical Hardware Mapping Plan

AB112 TB

AB212 TB

SB216 TB

SB216 TB

/dsstmp:16 TB/cdp1: 7.5 TB

/gridbgc: 4.5 TB

/dsszone: 16 TB /tigge: 6 TB

/esg-cdp: 10 TB

SB316 TB

SB416 TB

/narccap: 16 TB /dsswork: 6 TB

/TBD: 10 TB

1, Purchase two SATABeasts…

5.1 TB of dss work files

5.1 TB of dss work files

2. Transfer dss work files to SB4…

/dsszone: 28 TB

3. Merge File Systems

Other Infrastructure

• In order to accommodate additional filesystems (8 will fill up the slots available in our current infrastructure) we will have to buy another metadata storage unit.

• The impact on machine room power is expected to be minimal, but we will have to verify this.

FY07 SAN Costs

• NARCCAP funds will cover SB3.

• Core Equipment funds will cover SB4.

• Estimated $15K for additional metadata infrastructure.

• Total (estimated) upgrade costs ~$65K.

Other Outcomes

• SE-3 in DSG will be cross trained on SAN management (Andersen)

• SAN mail list augmented with a cast of thousands: datasan@ucar.edu (Arnold)

• Datasan Wiki setup on VETS Basecamp project management system. (Scheitlin)

• This plan of record ppt presentation created (Loft)

• Monthly team meetings scheduled (Bettge)