the future of archivingkonferenz.dlr.de/pages/storage2016/present/1. konferenztag/05_16_… ·...
TRANSCRIPT
The Future of Archiving
Confidential Material, Versity Software, Inc.
Data Management Challenges• Exponential grow of the data• Cost of the data management operations• Refresh of the media to next generation• Integrity of the data• Compliance requirements of the data • Classification of the data throughout its lifecycle
Hardware has a short life cycle – DATA is forever!
Confidential Material, Versity Software, Inc.
Versity SoftwareThe only independent pure play Archiving software company
Confidential Material, Versity Software, Inc.
What we do?
• Versity Storage Manager (VSM)• High performance archiving• Open source SAM-QFS HSM technology on Linux• Focused on moving POSIX files to tiers of storage• Support tape, disk, and object storage
Confidential Material, Versity Software, Inc.
Versity Storage Manager (VSM)
Confidential Material, Versity Software, Inc.
VSM Benefits
• Virtualizes tiers of storage with a POSIX shared file system interface
• Archives data across those tiers according to policy• Keeps all data available, but NOT on high cost media• Disk, tape, and cloud agnostic• Seamless on demand application retrieval with fast
access to the first byte• Continuous data protection – no waiting until midnight
Confidential Material, Versity Software, Inc.
VSM Archive Manager• Policy based archiving
- Media can be disk, tape, or S3 object- Local or remote, on premise, public or hybrid cloud- Classification of data according to policies:
path, owner, group, size, wildcard, age, and date• Media format is GNU tar – open format
- Files are put in a tar container so data is streamed out of the storage tier at device speeds
Confidential Material, Versity Software, Inc.
VSM Tiering Functions
Ingest data from scratch file systemsPackage files into tar archive containersArchive automatically from disk cache to archive media based on policiesRelease archived files from disk cache to free up spaceStage automatically from archive media back to disk cache when requested Recycle removable media by repacking the media
Confidential Material, Versity Software, Inc.
VSM Platform
• Support Redhat and Centos Linux 6.5, 6.6, and 6.7
• Redhat and Centos Linux Metadata Server(MDS)
• Redhat and Centos Linux Clients
• Stay current with Redhat releases
Confidential Material, Versity Software, Inc.
VSM Features• LUN size is a maximum 4.5 PB• Maximum number of LUNs in one file system is 1020• Maximum file system size is in the Exabyte range• Inode is 1024 bytes – more direct blocks, all 64-bit• Supports md5 checksum• Object storage interface – S3• Ability to migrate from Oracle SAM-QFS to Linux VSM
with a samfsdump, sammkfs, samfsrestore• LINUX!!!!
Confidential Material, Versity Software, Inc.
VSM Samba
• Libvsm is a LGPL library with APIs for VSM• Libvsm enables the vfs-vsm plugin for SerNet Samba• Windows can display the offline status for files• SerNet Samba 4.0.26 and 4.1.23 are supported and
tested
Confidential Material, Versity Software, Inc.
VSM Reference Architecture
Tape
TCP/IP NFS SAMBA
FC/IB/Ethernet Switch
Metadata Cache
Metadata Server Client 2 Client 3…Client 1 & BackupMetadata Server
Disc ObjectPrivate Cloud
S3
ObjectPublic Cloud
Confidential Material, Versity Software, Inc.
Primary Verticals
• HPC and Scientific
• Government and Defense
• Healthcare, Medical, Genomics
• Banking & Finance
• Oil & Gas
• Media & Entertainment
• Data Center / Web
• Video Surveillance
Not just cold storage
Confidential Material, Versity Software, Inc.
Customers(partial)
North America Europe Middle East
Total Data Managed: + 250 PB
Confidential Material, Versity Software, Inc.
HPC Partner
Confidential Material, Versity Software, Inc.
HPCArchitecture
Confidential Material, Versity Software, Inc.
S3 Object Release
• Currently running at a Versity site in Houston Texas• Archiving, staging, and recycling• 10X faster performance compared to NFS
Archiving to Object
Confidential Material, Versity Software, Inc.
Archiving Data Rates - Mixed File Sizes
Confidential Material, Versity Software, Inc.
Staging Data Rates - Mixed File Sizes
Confidential Material, Versity Software, Inc.
Why Object Storage ?Archival cost and protection levels without the drawbacks of tape
• Dramatically faster time to first byte• High performance without FC / IB• Easier to manage• Low cost• Safe & Geo replicated
Confidential Material, Versity Software, Inc.
What’s Next?
• Scale out archiving application • Scale out POSIX archiving file system
Confidential Material, Versity Software, Inc.
Why Versity ?
• Pure play, software only • Subscription business model• No minimum contractual term• Perpetual ability to read your data - for free• Open source data format• Investing in the future!
