1 © Copyright 2013 EMC Corporation. All rights reserved.
EMC ISILON SCALE-OUT NAS Transform Your Business with Big Data Storage
2 © Copyright 2013 EMC Corporation. All rights reserved.
Isilon Technology
Summary
Isilon Overview
Big Data in the Enterprise
3 © Copyright 2013 EMC Corporation. All rights reserved.
What Is Big Data?
Data that challenges the capabilities of a system to capture, manage, and process it within an acceptable elapsed time
~ Wikipedia ~
4 © Copyright 2013 EMC Corporation. All rights reserved.
0
10
20
30
40
50
60
70
80
90
2009 2010 2011 2012 2013 2014
Exabyte
s
The Big Data Challenge
By 2013, 80% of all storage capacity sold will be for file-based data Source: “Scale Out Storage in the Content Driven Enterprise: Unleashing the Value of Information Assets,” IDC White Paper (2010 Enterprise Disk Storage Consumption Model), June 2011
File based: 61.8% CAGR Block based: 23.7% CAGR
Media & Entertainment
Design & Simulation
Financial Services
Bioinformatics Oil & Gas File Shares &
Archives
5 © Copyright 2013 EMC Corporation. All rights reserved.
Data growth
47%
CIOs Turning to Scale-Out to Deal with Massive File-Data Growth
Already using or planning to
use scale-out within the next 24 months
The#1 and#2 concerns of CIOs…
Source: Scale-out NAS Market Survey
System performance and scalability
37%
…are driving adoption of scale-out
Source: “User Survey Analysis: Key Trends Shaping the Future of Data Center Infrastructure Through 2011,” Gartner, October 2010
6 © Copyright 2013 EMC Corporation. All rights reserved.
Isilon Technology
Summary
Isilon Overview
Big Data in the Enterprise
7 © Copyright 2013 EMC Corporation. All rights reserved.
EMC Isilon Setting the standard for scale-out NAS
• Broad adoption across many markets
– High Performance Computing (HPC): Life Sciences, Oil & Gas,
Electronic Design Automation, Media & Entertainment, Financial Services
– Enterprise IT: Archive, File Shares, Home Directories, Hadoop Data
Analytics, Video Surveillance, Virtualization
• Over 3,000 global customers
– 60% Y/Y growth rate
• Isilon OneFS: Seventh generation, industry-proven, innovative
scale-out operating environment
8 © Copyright 2013 EMC Corporation. All rights reserved.
Single storage pool for application consolidation
Isilon Scale-Out Innovation
Simple to scale – Manage 20 PB like a 1 TB drive
Predictable performance – Grows linearly
Efficient to operate – Maximize utilization to 80%+
– Automate tiering
Highly resilient – Survives multiple failures
Enterprise proven – Management and protection
tools that customers expect
No data migrations
9 © Copyright 2013 EMC Corporation. All rights reserved.
The Cost Advantage of Isilon Ease of use and management simplicity
IDC: Isilon improves IT productivity by 48%, reduces OPEX*
Storage allocation
Storage provisioning
Managing capacity
Managing backup
Space reclamation
Adding new applications
Uploading of re-loading data
0.0 0.5 1.0 1.5 2.0
FTE H
ours
per
TB in U
se
Isilon Traditional
* Source: “Quantifying the Business Benefits of Scale-Out NAS Solutions,” IDC White Paper, November 2011
10 © Copyright 2013 EMC Corporation. All rights reserved.
Reduces Big Data storage costs by 40%
The Cost Advantage of Isilon
$0
$500
$1,000
$1,500
$2,000
$2,500
Traditional Isilon
Average Annual Cost Per TB in Use
OPEX IT Staff CAPEX
Source: “Quantifying the Business Benefits of Scale-Out NAS Solutions,” IDC White Paper, November 2011
11 © Copyright 2013 EMC Corporation. All rights reserved.
Big Data Apps Need Big Data Storage Data intensive, HPC workflows
Medical Imaging Gene Sequencing Seismic Exploration
Media & Entertainment Product Development Satellite Images
12 © Copyright 2013 EMC Corporation. All rights reserved.
Enterprise IT workload examples
Enterprise IT Needs Big Data Storage
• Archives / Data Repositories
• File Shares & Home Directories
• Hadoop Data Analytics
• Online Filing Sharing using On-Premise Storage
• Video Surveillance Data Storage
• Large-Scale Virtualization
13 © Copyright 2013 EMC Corporation. All rights reserved.
EMC Extends Choice & Flexibility for Online File Sharing with: • Isilon On-Premise Storage • Syncplicity Sync and Share
Enterprise Grade Single Vendor Solution
Cloud-based online file sharing with on-premise storage
designed to meet the needs of business users and IT
All EMC end-to-end infrastructure for one-stop product, install, config and
24x7 support
14 © Copyright 2013 EMC Corporation. All rights reserved.
EMC Online File Sharing with Isilon On-Premise Storage Strong IT Control
Files Controlled by IT
On-Premise Storage
IT Control
Cloud-based solution with files stored in on-premise cloud
Full policy control over storage layer
Meets compliance and governance requirements
15 © Copyright 2013 EMC Corporation. All rights reserved.
Isilon Technology
Summary
Isilon Overview
Big Data in the Enterprise
16 © Copyright 2013 EMC Corporation. All rights reserved.
Isilon Scale-Out NAS Architecture
OneFS Operating Environment
Intra-cluster Communication Layer
Servers
Client/Application Layer Ethernet Layer
Servers
Servers
Sin
gle
FS/V
olu
me CIFS NFS
FTP HTTP
HDFS for
Hadoop
17 © Copyright 2013 EMC Corporation. All rights reserved.
Isilon Core Innovation OneFS scale-out operating system
Single File System Simplicity
Leadership Efficiency
High Performance
Easy Growth
Automated Tiering
Linear Scalability
18 © Copyright 2013 EMC Corporation. All rights reserved.
Isilon Scale-out NAS product family
Linear Scaling of Performance and Capacity
Purpose-built for IOPS-intensive, random access,
file-based applications
Flexible solution for high concurrent and sequential throughput applications
Ideal for cost-effective, large-capacity storage
S-Series
X-Series
NL-Series
19 © Copyright 2013 EMC Corporation. All rights reserved.
Comprehensive Enterprise Software
SnapshotIQ Fast, efficient data backup and recovery
SyncIQ Fast and flexible asynchronous replication for disaster recovery protection
SmartConnect Policy-based client failover with load balancing
SmartLock Policy-based WORM data protection
SmartPools Policy-based automated tiering
SmartQuotas Quota management and thin provisioning
InsightIQ Performance monitoring and reporting to manage storage resources
Isilon for vCenter VMware integrated management features
DATA PROTECTION DATA MANAGEMENT
20 © Copyright 2013 EMC Corporation. All rights reserved.
Isilon Simplicity and Ease of Use
Single volume spans all nodes
– Directories and files striped across the cluster
Automation:
– NO manual intervention
– NO reconfiguration
– NO server or client mount point or application changes
– NO data migrations
EFFIC
IEN
CY
21 © Copyright 2013 EMC Corporation. All rights reserved.
More scalable than traditional storage systems
Largest and Most Scalable File System
OneFS scales from 18 TB to 20 PB in a single file system, single volume
Under 60 seconds to scale with no downtime
22 © Copyright 2013 EMC Corporation. All rights reserved.
Gain New Levels of Efficiency
• AutoBalance automatically moves content to new storage nodes while system is online and in production
• Eliminates “hot spots”
• Enables unmatched storage capacity utilization of more than 80%
AutoBalance Automated data balancing across nodes reduces costs, complexity, and risks for scaling storage
EMPTY
EMPTY
EMPTY
EMPTY
EMPTY
FULL
FULL
FULL
FULL
BALANCED
BALANCED
BALANCED
BALANCED
BALANCED
Isilon AutoBalance
23 © Copyright 2013 EMC Corporation. All rights reserved.
Optimize Resources with Automated Tiering
• Single point of management
– Single file system/single volume
– Multiple performance tiers
• Automatic data movement
– Policy-based tiering management
– Transparent reallocation
– NO application changes
• Optimize storage resources
– Automatically match storage resources with data requirements
– Eliminate data migration
Isilon SmartPools
S-Series Performance
NL-Series Active archives
X-Series Collaboration
Reduced c
ost/T
B
Files
24 © Copyright 2013 EMC Corporation. All rights reserved.
SPECsfs2008 CIFS: aggregate vendor performance
World’s Fastest NAS
ISILON RECORD-BREAKING P E R F O R M A N C E
Huaw
ei
Sym
ante
c
EM
C
EM
C
EM
C
NetA
pp
NetA
pp
NetA
pp
NetA
pp
Apple
Silic
on
Gra
phic
s
Apple
Fujits
u
Apple
Fujits
u
Sie
mens
Fujits
u
Fujits
u
Sie
mens
Fujits
u
Sie
mens
Fujits
u
Sie
mens
NSPLab
Fujits
u
1,600,000
1,500,000
1,400,000
1,300,000
1,200,000
1,100,000
1,000,000
900,000
800,000
700,000
600,000
500,000
400,000
200,000
300,000
100,000
EM
C I
silo
n
CIFS
IO
PS
World Record 1.6 million CIFS OPS
126% increase over competition
Source: “All SPEC SPECsfs2008_cifs Results Published by SPEC,” October 3, 2012 (http://www.spec.org/sfs2008/results/sfs2008cifs.html)
25 © Copyright 2013 EMC Corporation. All rights reserved.
Linear, Predictable Scalability
SPECsfs2008 performance test results
Predictable SLAs
7 14 28 56 140
1,800,000
1,600,000
1,400,000
1,200,000
1,000,000
800,000
600,000
400,000
200,000
Fil
e O
ps/
seco
nd
CIFS NFS
26 © Copyright 2013 EMC Corporation. All rights reserved.
With N+2, N+3, and N+4 protection, data is 100% available if multiple drives or nodes fail
With N+1 protection,
data is 100% available even if a single drive or node fails
Highly resilient, clustered architecture
Unmatched Data Protection and Availability
100%
100%
100%
100%
100%
100%
100%
100%
FAILED
FAILED
And with Isilon, the more nodes in the cluster, the faster drive rebuild time
27 © Copyright 2013 EMC Corporation. All rights reserved.
Enterprise Data Protection Options
• Isilon SyncIQ benefits
– Disaster recovery
– Business continuance
– Disk-to-disk backup
– Remote archive
– Push-button simple failover/failback
• Block efficient, file specific
• Leverages Isilon SnapshotIQ
– Per-directory policies and granularity
– Unlimited snapshots per cluster
– Minimal performance impact
– Allows tiered snapshots
SyncIQ Replication Architecture
Isilon NL-Series Cluster
Isilon S-Series and X-Series Cluster
Fast, easy backup and recovery and disaster recovery
28 © Copyright 2013 EMC Corporation. All rights reserved.
Robust Enterprise Security Options
Secure Role Separation
– Roles-based administration
– Administration and data access separated
Secure WORM Data Protection
– Isilon SmartLock
– SEC 17a-4 Compliance option
Secure Isolation
– Authentication Zones
29 © Copyright 2013 EMC Corporation. All rights reserved.
Interoperability for Operational Flexibility Platform REST API
– Simplify management and integration
– Third-party application integration
VMware integration
– VAAI: vStorage APIs for array integration
– VASA: vSphere APIs for storage awareness
– Virtual Server writeable clones
Multi-protocol support
– Integrated support for industry-standard protocols
– Native HDFS support
30 © Copyright 2013 EMC Corporation. All rights reserved.
Industry’s First and Only Scale-Out Storage Solution With Native Hadoop Integration
Accelerate the benefits of Hadoop for the enterprise – Proven Hadoop solution, faster implementation
– Greater interoperability with enterprise applications and Hadoop analytics through multi-protocol parallel access from any client
Reduce risk – Eliminates Hadoop NameNode single point of failure
Enterprise data protection – Fast snapshots, backup, and recovery
– Simple, reliable data replication for disaster recovery
Ultimate flexibility – Scale compute and storage resources separately
– Supports physical and virtualized server environments
31 © Copyright 2012 EMC Corporation. All rights reserved.
Technology Challenges of Hadoop
Hadoop DAS Environment 1
Dedicated Storage Infrastructure – One-off for Hadoop only
2 Single Point of Failure
– Namenode
3 Lacking Enterprise Data Protection
– No Snapshots, replication, backup
4 Poor Storage Efficiency
– 3X mirroring
5 Fixed Scalability
– Rigid compute to storage ratio
6 Manual Import/Export
– No protocol support
Name node
32 © Copyright 2012 EMC Corporation. All rights reserved.
Technology Challenges of Hadoop
Hadoop DAS Environment 1
Dedicated Storage Infrastructure – One-off for Hadoop only
2 Single Point of Failure
– Namenode
3 Lacking Enterprise Data Protection
– No Snapshots, replication, backup
4 Poor Storage Efficiency
– 3X mirroring
5 Fixed Scalability
– Rigid compute to storage ratio
6 Manual Import/Export
– No protocol support
1x
1x
2x
2x
3x
2x
3x
3x
1x
Namenode
33 © Copyright 2012 EMC Corporation. All rights reserved.
1 Scale-Out Storage Platform
– Multiple applications & workflows
2 No Single Point of Failure
– Distributed Namenode
3 End-to-End Data Protection
– SnapshotIQ, SyncIQ, NDMP Backup
4 Industry-Leading Storage Efficiency
– >80% Storage Utilization
5 Independent Scalability
– Add compute & storage separately
6 Multi-Protocol
– Industry standard protocols
– NFS, CIFS, FTP, HTTP, HDFS
The EMC Isilon Advantage for Hadoop
34 © Copyright 2012 EMC Corporation. All rights reserved.
EMC Addresses the Hadoop Challenge
1 Dedicated Storage Infrastructure
– One-off for Hadoop only
2 Single Point of Failure
– Namenode
3 Lacking Enterprise Data Protection
– No Snapshots, replication, backup
4 Poor Storage Efficiency
– 3X mirroring
5 Fixed Scalability
– Rigid compute to storage ratio
6 Manual Import/Export
– No protocol support
1 Scale-Out Storage Platform
– Multiple applications & workflows
2 No Single Point of Failure
– Distributed Namenode
3 End-to-End Data Protection
– SnapshotIQ, SyncIQ, NDMP Backup
4 Industry-Leading Storage Efficiency
– >80% Storage Utilization
5 Independent Scalability
– Add compute & storage separately
6 Multi-Protocol
– Industry standard protocols
– NFS, CIFS, FTP, HTTP, HDFS
35 © Copyright 2012 EMC Corporation. All rights reserved.
Flexible Packaging
Hadoop Software + Storage
Package Pivotal HD software on commodity x86 hardware
Isilon scale-out NAS
Hadoop Appliance + Storage – Q2 2013
Pivotal HD Data Computing Appliance
Isilon scale-out NAS
36 © Copyright 2013 EMC Corporation. All rights reserved.
Isilon Technology
Summary
Isilon Overview
Big Data in the Enterprise
37 © Copyright 2013 EMC Corporation. All rights reserved.
Isilon Scale-Out NAS Value
Scales to 20 PB in a single file system
Single file system, single volume, global namespace
Efficient backup and recovery, reliable disaster recovery, and N+1 thru N+4 redundancy
More than 80% storage utilization, and automated storage tiering
Over 100 GB/s throughput, 1.6M SPECsfs ops
Integrated support for industry-standard protocols including NFS, SMB, HTTP, FTP, and HDFS; platform REST API; VMware integration
Roles-based administration; Authentication Zones; SEC 17a-4 compliant WORM data security
38 © Copyright 2013 EMC Corporation. All rights reserved.
Questions and Answers
To type a question via WebEx, click on the Q&A tab
Please select “Ask: All Panelists”
to ensure your questions reach us. Thank you!
39 © Copyright 2013 EMC Corporation. All rights reserved.
Next Steps and Resources
• Get the IDG Big Data Reports – http://www.emc.com/collateral/white-papers/idg-bigdata-umbrella-wp.pdf – http://www.emc.com/collateral/white-papers/idg-bigdata-storage-wp.pdf – http://www.emc.com/collateral/white-papers/idg-bigdata-analytics-wp.pdf
• Learn more about EMC Isilon Big Data solutions – http://www.emc.com/collateral/software/white-papers/h10528-wp-hadoop-on-isilon.pdf – http://www.emc.com/big-data/index.htm
40 © Copyright 2013 EMC Corporation. All rights reserved.
THANK YOU