solving the data access bottleneck · the need for a new solution • explosive data growth across...
TRANSCRIPT
![Page 1: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte](https://reader034.vdocument.in/reader034/viewer/2022050112/5f498d7f6f55744d976f8d16/html5/thumbnails/1.jpg)
SGI InfiniteStorage SolutionsSolving The Data Access Bottleneck
Gabriel BronerSenior Vice President and General Manager Storage and Software GroupSilicon Graphics
November 2003
![Page 2: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte](https://reader034.vdocument.in/reader034/viewer/2022050112/5f498d7f6f55744d976f8d16/html5/thumbnails/2.jpg)
The Need For A New Solution
• Explosive data growth across industries• Energy: 38 TB of seismic data in a single file system, multi-
terabyte mirrors over a wide area network• Media: 200+ TB of data, 20 million files• Weather: 2TB of data ingested every day• Customers with Petabytes of data that need to be managed• Multi-terabyte NAS farms are increasingly common
• Data is growing beyond the limits of conventional storage solutions
Media ScienceEnergy Defense Manufacturing
![Page 3: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte](https://reader034.vdocument.in/reader034/viewer/2022050112/5f498d7f6f55744d976f8d16/html5/thumbnails/3.jpg)
The Workflow Problem
File A File A File A File A
Process 1 Process 2 Process 3 Process 4
•No file sharing means large files have to be moved over the network—taking time, slowing workflow.•Some media customers estimate 50% of their time is spent moving data
Digitization Color Correcting Effects Compositing Media
Design Visualization Structural CrashMfg.Analysis Analysis
![Page 4: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte](https://reader034.vdocument.in/reader034/viewer/2022050112/5f498d7f6f55744d976f8d16/html5/thumbnails/4.jpg)
SGI InfiniteStorageCXFS Shared File System
File B
File D
File E
File F
File G
File H
File I
With SGI InfiniteStorage Shared File System (CXFS)
• All files are shared• No copying• No wasted space• Saves time• Saves money
File A
File C
SwitchMetaData Server
SGI®Windows®
Sun™ Linux® AIX®
LAN
![Page 5: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte](https://reader034.vdocument.in/reader034/viewer/2022050112/5f498d7f6f55744d976f8d16/html5/thumbnails/5.jpg)
SGI SAN Server Simplified File Sharing
•Multiple hosts share files as if they were local•Avoids data copying•CXFS shared file system technology
SGI SAN Server
![Page 6: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte](https://reader034.vdocument.in/reader034/viewer/2022050112/5f498d7f6f55744d976f8d16/html5/thumbnails/6.jpg)
Workflow with File Sharing
Near-instantaneous access for data-intensive workflows
File A
File sharing means large files don’t have to be movedover the network—saving time, speeding workflow.
Process 1 Process 2 Process 3 Process 4
Digitization Color Correcting Effects Compositing Media
Design Visualization Structural CrashMfg.Analysis Analysis
![Page 7: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte](https://reader034.vdocument.in/reader034/viewer/2022050112/5f498d7f6f55744d976f8d16/html5/thumbnails/7.jpg)
SGI SAN ServerHeterogeneous support
SGI WindowsSun™ Linux®
IBM
SGI SAN Server
• SGI San Server offers heterogeneous support• Third generation CXFS shared file system
Future: Mac OS X
![Page 8: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte](https://reader034.vdocument.in/reader034/viewer/2022050112/5f498d7f6f55744d976f8d16/html5/thumbnails/8.jpg)
SGI SAN ServerNear-line Capabilities
SGI®
Other
SGI SAN Server
• Near-line capabilities provide for unlimited data growth
Near-line capabilities
Windows LinuxSun™
![Page 9: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte](https://reader034.vdocument.in/reader034/viewer/2022050112/5f498d7f6f55744d976f8d16/html5/thumbnails/9.jpg)
SGI InfiniteStorage DMF Data Life Cycle Management
Primary StorageOnline - high-performance disk
Demote> 7 days < 365
Demote> 1 Yr < 2 Yr
Promoteused last 24 hrs
Promoteused last 7 days
Nearline DiskHigh Capacity, Low cost, Lower performance Tape Libraries
Higher capacity, lower cost
Archive> 2 Yr
DMF manages data based on:• age of file• size of file• type of file
![Page 10: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte](https://reader034.vdocument.in/reader034/viewer/2022050112/5f498d7f6f55744d976f8d16/html5/thumbnails/10.jpg)
SGI SAN ServerNetworked Attached Storage (NAS) access
SGI ®
Other
SGI SAN Server
SGI Network Attached Storage access offers:•Lower cost access•Large number of clients•Virtually any kind of client
Network Attached Storage access
Windows NT® LinuxSun™
Near-line Capabilities
![Page 11: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte](https://reader034.vdocument.in/reader034/viewer/2022050112/5f498d7f6f55744d976f8d16/html5/thumbnails/11.jpg)
SGI® Cross-Country File Sharing
SGI SAN Server™ 1000 with CXFS
Windows®
SystemSunTM System
LightSand S-600 FC/SONET Gateway
Brocade®
Switch
SGI®System
100Mb per second Ethernet (Metadata)1Gb per second Fibre Channel (Data)622Mb per second OC-12 SONET (Data and Metadata)
LightSandTM S-600 FC/SONET Gateway Adtech AX/4000 WAN Simulator
![Page 12: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte](https://reader034.vdocument.in/reader034/viewer/2022050112/5f498d7f6f55744d976f8d16/html5/thumbnails/12.jpg)
SGI® NAS and SAN SolutionsTrue NAS SAN Convergence
NASIP network
SANFC network
SGI® SAN 3000
Upgrade
SGI® SAN 2000
Upgrade
SGI® NAS 2000
![Page 13: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte](https://reader034.vdocument.in/reader034/viewer/2022050112/5f498d7f6f55744d976f8d16/html5/thumbnails/13.jpg)
SGI InfiniteStorage Product Status• XFS
– Introduced 10 years ago– Made open Source, in Linux 2.5/2.6
• CXFS– Introduced 4 years ago, 400+ customers– Version 3.0 supports Irix, Solaris, Windows, Linux, AIX
• DMF– Introduced 10 years ago, hundreds of customers– Version 2.9
• Customers today manage more than 1 petabyte of data – www.sgi.com/storage
![Page 14: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte](https://reader034.vdocument.in/reader034/viewer/2022050112/5f498d7f6f55744d976f8d16/html5/thumbnails/14.jpg)
Customer Feedback
“For Medtronic, the transition from NFS over a LAN to CXFS over a SAN has been like going from a gravel road to a six-lane freeway.” —Tim Abraham, Surgical Simulator Development Coordinator, Medtronic“With our new data storage system, we get the best of both worlds. … CXFS has allowed us to tremendously increase our productivity while reducing nonproductive waiting time.” —Rico Magsipoc, LONI System Administrator“SGI DMF has greatly simplified our management of the thousands of tapes needed to store the bulk of the data.” —Jon Labrie, WETA Digital“The implementation of CXFS has enabled Contraves Space to be in a position to avoid bottlenecks in its LAN. It enables us to save an enormous amount of time during interactive processing on our workstations.” —Andreas Herren,Dynamics and CAE R&D Manager, Contraves Space“DMF is fantastic. It’s the seamless way the whole thing works and the performance you get out of it. It’s like disk space is infinite. It just works. It’s one of the jewels in SGI’s crown.” —Dr. Ian Atkinson, Manager, HPC, James Cook University
![Page 15: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte](https://reader034.vdocument.in/reader034/viewer/2022050112/5f498d7f6f55744d976f8d16/html5/thumbnails/15.jpg)
SGI InfiniteStorage Solutions
Designed for the world’s most data-intensive environments, SGI InfiniteStorageSolutions uniquely enable enterprise customers to:
• Transparently share data everywhere
• Scale data as the business and application grows
• Manage the data lifecycle without limiting access
• Accelerate workflows
Media ScienceEnergy Defense Manufacturing
![Page 16: Solving The Data Access Bottleneck · The Need For A New Solution • Explosive data growth across industries • Energy: 38 TB of seismic data in a single file system, multi- terabyte](https://reader034.vdocument.in/reader034/viewer/2022050112/5f498d7f6f55744d976f8d16/html5/thumbnails/16.jpg)
© 2002 Silicon Graphics, Inc. All rights reserved. Silicon Graphics, SGI, IRIX, Origin, Octane, Onyx, Onyx2, and the SGI logo are registered trademarks and Silicon Graphics Fuel, Octane2, XFS, CXFS, SGI SAN Server and the Silicon Graphics logo are trademarks of Silicon Graphics, Inc., in the U.S. and/or other countries worldwide. Windows and Windows NT are registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries. Linux is a registered trademark of Linus Torvalds. Intel and Pentium are registered trademarks of Intel Corporation. UNIX is a registered trademark of The Open Group in the U.S. and other countries. Mac is a registered trademark of Apple Computer, Inc. All other trademarks mentioned herein are the property of their respective owners. (11/02)
www.sgi.com/storage