solving the data access bottleneck · the need for a new solution • explosive data growth across...

16
SGI InfiniteStorage Solutions Solving The Data Access Bottleneck Gabriel Broner Senior Vice President and General Manager Storage and Software Group Silicon Graphics November 2003

Upload: others

Post on 15-Jul-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte

SGI InfiniteStorage SolutionsSolving The Data Access Bottleneck

Gabriel BronerSenior Vice President and General Manager Storage and Software GroupSilicon Graphics

November 2003

Page 2: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte

The Need For A New Solution

• Explosive data growth across industries• Energy: 38 TB of seismic data in a single file system, multi-

terabyte mirrors over a wide area network• Media: 200+ TB of data, 20 million files• Weather: 2TB of data ingested every day• Customers with Petabytes of data that need to be managed• Multi-terabyte NAS farms are increasingly common

• Data is growing beyond the limits of conventional storage solutions

Media ScienceEnergy Defense Manufacturing

Page 3: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte

The Workflow Problem

File A File A File A File A

Process 1 Process 2 Process 3 Process 4

•No file sharing means large files have to be moved over the network—taking time, slowing workflow.•Some media customers estimate 50% of their time is spent moving data

Digitization Color Correcting Effects Compositing Media

Design Visualization Structural CrashMfg.Analysis Analysis

Page 4: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte

SGI InfiniteStorageCXFS Shared File System

File B

File D

File E

File F

File G

File H

File I

With SGI InfiniteStorage Shared File System (CXFS)

• All files are shared• No copying• No wasted space• Saves time• Saves money

File A

File C

SwitchMetaData Server

SGI®Windows®

Sun™ Linux® AIX®

LAN

Page 5: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte

SGI SAN Server Simplified File Sharing

•Multiple hosts share files as if they were local•Avoids data copying•CXFS shared file system technology

SGI SAN Server

Page 6: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte

Workflow with File Sharing

Near-instantaneous access for data-intensive workflows

File A

File sharing means large files don’t have to be movedover the network—saving time, speeding workflow.

Process 1 Process 2 Process 3 Process 4

Digitization Color Correcting Effects Compositing Media

Design Visualization Structural CrashMfg.Analysis Analysis

Page 7: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte

SGI SAN ServerHeterogeneous support

SGI WindowsSun™ Linux®

IBM

SGI SAN Server

• SGI San Server offers heterogeneous support• Third generation CXFS shared file system

Future: Mac OS X

Page 8: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte

SGI SAN ServerNear-line Capabilities

SGI®

Other

SGI SAN Server

• Near-line capabilities provide for unlimited data growth

Near-line capabilities

Windows LinuxSun™

Page 9: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte

SGI InfiniteStorage DMF Data Life Cycle Management

Primary StorageOnline - high-performance disk

Demote> 7 days < 365

Demote> 1 Yr < 2 Yr

Promoteused last 24 hrs

Promoteused last 7 days

Nearline DiskHigh Capacity, Low cost, Lower performance Tape Libraries

Higher capacity, lower cost

Archive> 2 Yr

DMF manages data based on:• age of file• size of file• type of file

Page 10: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte

SGI SAN ServerNetworked Attached Storage (NAS) access

SGI ®

Other

SGI SAN Server

SGI Network Attached Storage access offers:•Lower cost access•Large number of clients•Virtually any kind of client

Network Attached Storage access

Windows NT® LinuxSun™

Near-line Capabilities

Page 11: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte

SGI® Cross-Country File Sharing

SGI SAN Server™ 1000 with CXFS

Windows®

SystemSunTM System

LightSand S-600 FC/SONET Gateway

Brocade®

Switch

SGI®System

100Mb per second Ethernet (Metadata)1Gb per second Fibre Channel (Data)622Mb per second OC-12 SONET (Data and Metadata)

LightSandTM S-600 FC/SONET Gateway Adtech AX/4000 WAN Simulator

Page 12: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte

SGI® NAS and SAN SolutionsTrue NAS SAN Convergence

NASIP network

SANFC network

SGI® SAN 3000

Upgrade

SGI® SAN 2000

Upgrade

SGI® NAS 2000

Page 13: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte

SGI InfiniteStorage Product Status• XFS

– Introduced 10 years ago– Made open Source, in Linux 2.5/2.6

• CXFS– Introduced 4 years ago, 400+ customers– Version 3.0 supports Irix, Solaris, Windows, Linux, AIX

• DMF– Introduced 10 years ago, hundreds of customers– Version 2.9

• Customers today manage more than 1 petabyte of data – www.sgi.com/storage

Page 14: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte

Customer Feedback

“For Medtronic, the transition from NFS over a LAN to CXFS over a SAN has been like going from a gravel road to a six-lane freeway.” —Tim Abraham, Surgical Simulator Development Coordinator, Medtronic“With our new data storage system, we get the best of both worlds. … CXFS has allowed us to tremendously increase our productivity while reducing nonproductive waiting time.” —Rico Magsipoc, LONI System Administrator“SGI DMF has greatly simplified our management of the thousands of tapes needed to store the bulk of the data.” —Jon Labrie, WETA Digital“The implementation of CXFS has enabled Contraves Space to be in a position to avoid bottlenecks in its LAN. It enables us to save an enormous amount of time during interactive processing on our workstations.” —Andreas Herren,Dynamics and CAE R&D Manager, Contraves Space“DMF is fantastic. It’s the seamless way the whole thing works and the performance you get out of it. It’s like disk space is infinite. It just works. It’s one of the jewels in SGI’s crown.” —Dr. Ian Atkinson, Manager, HPC, James Cook University

Page 15: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte

SGI InfiniteStorage Solutions

Designed for the world’s most data-intensive environments, SGI InfiniteStorageSolutions uniquely enable enterprise customers to:

• Transparently share data everywhere

• Scale data as the business and application grows

• Manage the data lifecycle without limiting access

• Accelerate workflows

Media ScienceEnergy Defense Manufacturing

Page 16: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte

© 2002 Silicon Graphics, Inc. All rights reserved. Silicon Graphics, SGI, IRIX, Origin, Octane, Onyx, Onyx2, and the SGI logo are registered trademarks and Silicon Graphics Fuel, Octane2, XFS, CXFS, SGI SAN Server and the Silicon Graphics logo are trademarks of Silicon Graphics, Inc., in the U.S. and/or other countries worldwide. Windows and Windows NT are registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries. Linux is a registered trademark of Linus Torvalds. Intel and Pentium are registered trademarks of Intel Corporation. UNIX is a registered trademark of The Open Group in the U.S. and other countries. Mac is a registered trademark of Apple Computer, Inc. All other trademarks mentioned herein are the property of their respective owners. (11/02)

www.sgi.com/storage