#mfsummit2016 operate: the race for space
TRANSCRIPT
The Race for Space
David Shepherd | Senior Solutions Consultant | 24th February 2016
Stephen Mogg | Senior Sales Engineer
Agenda
•Storage Then and Now
•Storage Requirements in the Enterprise
•The need for Data Retention
•Provisioning, Presentation and Consumption
Storage Then and Now
1986
A typical business class PC had a 10MB hard disk
2016
A typical mobile phone has 16GB of storage. (1600x)
A typical business class PC has 512 GB of storage. (51200x)
Enterprise Disk drives 6TB in size (614400x)
As a comparison…
If cars had improved at the rate of storage.
• Assume a car in 1986 had an average top speed of 100mph
• Average top speed in 2016 would be 5,120,000 mph or 1422 mps
• Or 0.09 c where c is the speed of light in a vacuum. It would probably be important to get your brakes checked…
Enterprise Storage in the 21st
Century
Industry Need for Storage is Expanding
Today’s Data Centre Challenges
The Value of Data
50-60%of Enterprise Data
20-25%
15-20%
1-3%
Tier 0
Ultra High
Performance
Tier 1
High-value, OLTP,
Revenue
Generating
Tier 2
Backup/Recovery,
Reference Data,
Bulk Data
Tier 3
Object, Archive,
Compliance
Archive,
Long-term Retention
Source: Horison Information Strategies - Fred Moore
Enterprise Storage Tomorrow
Differentiated “Tiered” Information
Timely Identification, Classification, and Efficient
Placement
Software-Based Storage (OPEX)
Separated Control Plane and Data Plane
Open, Extensible, Unified and Simplified
Industry Standard Hardware Building Blocks (CAPEX)
Commodity Off-the-Shelf Servers for Control Plane
Commodity Off-the-Shelf Drives for Data Plane
Enterprise Storage Market
Source : IT Brand PulseThe Epic Migration to Software Defined Storage
20% Open Source in next 2 years. (up from 1%)
How Do You Manage Growth ?
• Existing SAN Infrastructure
• Can existing SAN meet the capacity ?
• Is it cost effective to expand existing storage ?
• Software Defined Storage
• Clustered solution based on multiple servers to provide a fault tolerant storage solution based on Enterprise Servers and Storage.
SUSE Enterprise Storage
• Extensively Scalable
• Storage Appliance to Cost Effective Cloud Solution
• Industry Leading Storage Functionality (Hammer Release)
• Unified Block and Object with File Coming
• Thin Provisioning
• Erasure Coding
• Cache Tiering
• Built upon Clustered Servers
• Self Healing
• Self Managing
SUSE Enterprise Storage with Ceph
Optimise performance with minimal monitoring and storage administration
Block
Storage
File
System
Object
Storage
Monitor
Nodes
Management
Node
Build enterprise class storage with commodity servers and disk drives
$
Add capacity as needed
Reduce capital expense
Broaden choice of vendors
Public Network
OSD1 OSD2 OSD3 OSD4
Heterogeneous operating system support with iSCSI storage protocol
Cluster Network
iSCSI Gateway
RBD Module
iSCSI Gateway
RBD Module
iSCSI Initiator
RBD image
Provisioning, Presentation and Consumption
So What ?
• We have a software defined storage infrastructure
• We need to make the storage available.
• We need to be able to be able to utilise the storage from existing Enterprise Platforms.
• How do we then provision the storage, present it to the required systems, and consume the space provided..
The Need for Data Retention
Data Retention
• Major reason for storage growth
• Different Industries have different statutory requirements
• Banking
• Telecoms
• Health
UK Data Retention Regulations (2014)
UK Data Retention Regulations (2014)
Data Retention Challenges
• Storage is not the whole solution
• How do you provide access ?• Is historic data still available to applications ?
• How do you manage security ?• Backup and restore of retained data. Disaster recovery of
storage.
• How do you implement retention policies ?• Are files retained in accordance with age, file type etc.
Tools that can help
• File Reporter - Know what you have• Who has rights, how did they get rights
• What type of files have been added in the last month
• Who is taking up the most amount of storage
• Storage Manager - Manage File structure• Automate storage assignment / cleanup
• Policy based user / group storage
• No custom IDM scripts but clear policies
Enterprise Data Retention Solution
OES2015 as a Storage Gateway
Leveraging the use of SUSE Storage to multiple client types
OES2015 as a storage gateway
• Can present the block devices from SUSE Storage as native Kerberos CIFS volumes to Active Directory
• NFS also supported
• Can make use of Storage Tiering technology (Dynamic Storage).
• Dynamic Storage allows data to stay as one volume from a user perspective but to split the data based on policy to a primary and a shadow storage location.
• Allows SUSE Storage to act as shadow storage.
Dynamic Storage
Figure 1-1 User View of the File System Directory
Dynamic Storage (DST)
• The primary storage is your existing volume
• The secondary volume is your shadow storage• Data is moved by policy between the primary and the
secondary.
• Access to the data is seamless from the existing volume.
• Users do not notice that data moves.• The moves are transparent.
Benefits of Dynamic Storage
• Old data can be moved from the SAN primary storage to SUSE Storage seamlessly. (data is read-only during the move).
• Frees space on the SAN
• Can reduce backup and restore windows.
• Unlike SAN based functionality DST is file based not block based.
Data move is policy controlled.
Controlled from a server based web app or the command line.
Multiple Policies can be applied
Data can be moved from primary to secondary or secondary to primary
Data move can take place based on multiple conditions.
Management of large Volumes
• Simple management of large data sets
• NSS dynamic rights assignment with minimal server utilisation over very large volumes.
• Rights inheritance • Rights do not need assigning at each level.
• Volume size can be 8 Exabytes, file size 16TB
• NSS is the only file system designed to share files from the outset.
Integration with Active Directory
• Native Integration with AD
• SMB 2 with pipelining support
• Kerberos
• OES Servers join AD as member servers
• AD Tools used for management
• AD Security principals used to assign rights
Future Developments
• OES2015 SP1 will add the following
• AD Client access to Salvage and Purge
• Integration with multiple AD Forests
• Improved CIFS performance
• Dynamic Storage
• Implementation of a third tier to cloud.
Data Access to Mobile Clients
• Using Filr 2.0 (Available as part of OES)
• Gives access to all data from tablet and smart phone form factors from their original locations.
• Data does not need to be moved to another data store
Filr 2.0 IOS Client
Touch ID Supported for Authentication
IOS Pin code also supported
Filr 2 IOS Client
Documents can be loaded from any network drive exposed by Filr, edited and saved back
Any app written to IOS 8 or later can use the same functionality
Summary
• SUSE Storage can provide large amounts of storage that can replace more expensive SAN based options.
• OES 2015 can utilise the storage whilst providing class leading capabilities for data retention and full support for Active Directory
• Filr 2.0 can securely make that data available to mobile connected devices.
Questions ?