1 © copyright 2012 emc corporation. all rights reserved. sharepoint customer presentation september...
TRANSCRIPT
1© Copyright 2012 EMC Corporation. All rights reserved.
SharePoint Customer
Presentation
September 05, 2012Stefan Voss
Sr. Manager, USD Solutions Engineering
2© Copyright 2012 EMC Corporation. All rights reserved.
Relentless Growth of Unstructured DataPeople / Business Processes:
1. Disconnected information silos
2. Information not available to those who need it in real-time
3. Governance
IT Related:
4. TCO / Asset Utilization
5. Backup Windows / Recovery Processes
6. Version Control, user mapping, permissions
Source : IDC, The Digital Universe Decade
3© Copyright 2012 EMC Corporation. All rights reserved.
Why SharePoint? Why Now? Why VNX? Why SharePoint?
– Fastest growing platform in MSFT’s history– Accessible and extensible unified content
platform– $2B in 2011, 20,000 seats/DAY!
Why now?– New release (Wave 15) coming in November– 67% of customers report rolling out
SharePoint to the entire organization
Why EMC VNX and Metalogix?– Unified infrastructure for metadata and BLOBs– FAST Suite for performance & efficiency – Metalogix suite for file share consolidation and
flexible end point management
Gartner Magic Quadrant for Enterprise Content Management
4© Copyright 2012 EMC Corporation. All rights reserved.
EMC / Metalogix Solution
Legacy ECM
File Shares
Future content growth
Today Centralize & Take Control Consolidate & Optimize
5%
95%
BLOBs
Metadata
5© Copyright 2012 EMC Corporation. All rights reserved.
Metalogix StoragePoint Librarian Contoso
FinanceAP
ARHR
Employees
Training Materials
Handbooks and Policies
Invoices
Purchase Orders
File Share LibrarianContent stored on file
system.
ContosoFinance
AP
ARHR
Employees
Training Materials
Handbooks and Policies
Invoices
Purchase Orders
SQL Content DB
List Items and
MetadataContent stays on file share
StoragePoint CatalogsFile share
StoragePoint Creates
SharePoint Structure and Items
6© Copyright 2012 EMC Corporation. All rights reserved.
The Challenge with SharePoint BLOBs
10 x 100GB SharePoint Content Databases
1TB of SQL Content Database Storage
PPT
XLS
DOC TIFF
90-95% unstructured, rest metadata
“Typically, as much as 80 percent of data for an enterprise-scale deployment of SharePoint Foundation consists of file-based data streams that are stored as BLOB data. These BLOB objects comprise data associated with SharePoint files. However, maintaining large quantities of BLOB data in a SQL Server database is a suboptimal use of SQL Server resources. You can achieve equal benefit at lower cost with equivalent efficiency by using an external data store to contain BLOB data.”
Source: http://msdn.microsoft.com/en-us/library/bb802976.aspx
• Can’t easily or economically scale
• Asset Utilization SQL Servers
• BLOBs don’t benefit from SQL query engine. Why are they there?
• Long backups / long restores
• Lack of tiered storage = Poor TCO
7© Copyright 2012 EMC Corporation. All rights reserved.
StoragePoint RBS End-Point Mgmt
VNX/SAS VNX/NL-SAS Isilon
Active Near-active Archive
Stora
gePoi
nt Agin
g Rule
mov
es
BLOB fr
om T
ier 1
to T
ier 2
at In
voic
e Dat
e + 1
yea
r
Stora
gePoi
nt Agin
g Rule
mov
es
BLOB fr
om T
ier 2
to T
ier 3
at I
nvoic
e Dat
e + 3
yea
rs
Less significant content becomes less-expensive to store
Met
adat
a
BLOB
Cloud
Archive
Stora
gePoi
nt Agin
g Rule
mov
es
BLOB fr
om T
ier 3
to C
loud
at In
voic
e Dat
e + 5
yea
rs
8© Copyright 2012 EMC Corporation. All rights reserved.
StoragePoint RBS Advanced Filters
Storage Profile
FileSystem (Sync)
Filter: File Type = PDF, TIF, TIFF
Share1
FileSystem (Sync)Filter: List = HR DOCS
Share2
FileSystem (Sync)Filter: Site (Web) = Finance
BLOB Store 3
9© Copyright 2012 EMC Corporation. All rights reserved.
EMC / Metalogix Reference Architecture
Metadata5-10%
BLOBs90-95%
FC Network
CIFS Network
Share NL SAS
Share SAS
Share Deep Compressed
SQL Search DB
StoragePoint Rule moves BLOB from Tier 1 to Tier 2 At Invoice Date + 6 months
StoragePoint Rule moves BLOB from Tier 2 to Tier 3 At Invoice Date + 1 year
VNX FAST Cache enables faster indexing/crawl/search
Reference Architecture: http://www.emc.com/collateral/hardware/technical-documentation/h8185-sharepoint-vnx-metalogix-psg.pdf
• Flash 1st 75% Cost Reduction via VNX FAST and smart use of SSDs and NL-SAS
• FAST Cache Up to 90% Performance Improvement for Search
• FAST VP 80% less performance tuning for SQL
• Lower SQL Licensing Costs due to server virtualization and RBS
tempDBSearch Query
VNX FAST VP to reduce performance tuning
10© Copyright 2012 EMC Corporation. All rights reserved.
Flexible Endpoint Management - USD
Metadata FC Network
CIFS Network
Share FLR
Share NL SAS
LUNFAST Cache
Use Advanced Filters to move HR data to where retention /
compliance is ensured
Encrypt sensitive data before it is moved to storage endpoint
(up to 256-bit)
LUNFAST VP
• Set retention periods at file system creation • Default/minimum/maximum
• Automatic File Lock and Delete
VNX File Level Retention:
Archive / Big Data
Active Data
11© Copyright 2012 EMC Corporation. All rights reserved.
Virtualizing SharePoint is Essential Consolidation
• Achieve 2-10x consolidation ratio, especially for larger deployments
Performance• Improved front end performance with more, smaller WFEs rather than few large WFEs
Availability• VM based protection for SharePoint provides homogeneous high availability (WSFC, VMware HA)
Business Continuity• Simplified DR management (Geo-Clustering, vCenter Site Recovery Manager)
Maintenance• Live migration of virtual machines (Hyper-V Live Migration, VMware vMotion)
Load Balancing• Maximized overall performance with balanced cross farm HW utilization (SCVMM PRO , VMware DRS)
12© Copyright 2012 EMC Corporation. All rights reserved.
Three Sources of Savings and Efficiency
1. Better Asset Utilization– File Share typically not well utilized – VNX Utilization ~70% on SAS / NL-SAS and up to 90% on SSD
2. More Efficiency via Flash 1st – Results in fewer drives, lower energy bills, and lower $/GB– Also lower $/IOPS via FAST Suite
3. Lower SQL licensing via RBS and virtualization– Reduce database size and increase VM density per physical
server
13© Copyright 2012 EMC Corporation. All rights reserved.
Lower $/GB and $ / IOPS
Average
$/GB SAS–15K$2/GB
LOWEST
$/IOSSD
$.99/IOMetadata
5-10%
BLOBs90-95%M
eta
log
ixS
tora
geP
oin
t
Example:• Avg. Capacity VNX5300 = 50TB• Without RBS on SAS-15K: $100K• With RBS and 5% SSD and 95% NL-SAS: $40-50K
LOWEST
$/GB NL-SAS$.43/GB
No RBS With RBS
14© Copyright 2012 EMC Corporation. All rights reserved.
VNX FAST Cache boosts SQL2012Data Disk RAID FC
OLTP DB Files
600K SAS 5 ON
System DB 600K SAS 5 OFF
TempDBs 600K SAS 1/0 OFF
DB Logs 600K SAS 1/0 OFF
FAST Cache: 14 x 100GB SSDsWorking Set < FAST Cache
Results:• 5x Improvement of IOPS and TPS• 30 Minute Cache Warming
IOP
STP
S
15© Copyright 2012 EMC Corporation. All rights reserved.
Lower SQL Licensing Costs SQL Server is rarely CPU constrained
– For SharePoint the performance bottleneck tends to be the WFE
– Idle CPU = Wasted licensing $$
SQL2012 Server Enterprise Licensing:
– Physical: per physical core – Virtual: per vCPU (all you can eat
per physical core)– No cost difference between a
physical core and vCPU
Virtualization = greater VM density and lower SQL licensing costs
– Savings determined by vCPU : Core Ratio (e.g. 4:1 ratio =75% savings)
RBS leads to smaller databases – Fewer servers overall with fewer
cores / vCPUs to license
Have to weigh against performance / CPU utilization
– Perfmon and other tools to help determine the right mix
16© Copyright 2012 EMC Corporation. All rights reserved.
Results• Average page load time improved by 4x after RBS • Backup times from SQL and SharePoint reduced by a
factor of 13x• >90% moved from expensive SQL drives to NL-SAS
Challenge• Internally facing communications site, which included
large amounts of rapidly changing large objects• Page load times and backup / recovery times
Large Government Contractor EMC VNX and Metalogix StoragePoint Improves Operational Agility and Performance
“The dashboard reports showed that I was now saving >90% of my storage on the expensive SQL drives.”
Derek MartinCloud Solutions Architect
17© Copyright 2012 EMC Corporation. All rights reserved.
Recovery Options• All depends on the recovery objectives!
– Database, Database + BLOBs, Database + BLOBs + Farm– Local vs. Remote– Granularity
• Methods Used:– Native Microsoft tools including log shipping – Third-party backup products (e.g. Avamar)– Array-based replication (snapshots/clones)
• Issues with common approach aka native tools– Long and manual restore process (hours to days)
• Two options that are RBS aware are Metalogix Selective Restore Manager and EMC Replication Manager / VNX Snaps
– Reduce restore times down from hours to minutes – Item-level restore– Proper sequence of backup and recovery must be followed
18© Copyright 2012 EMC Corporation. All rights reserved.
Provisioning SharePoint - ESI Open / browse local or remote
SharePoint farm
Provision SharePoint Web Application:
– Create disks– Create content database– Create Web Application – Attach the content database
Create content database only (no WFE)
– Web Application can be created later using SharePoint admin and the database created in ESI
Users can select any SQL server that is part of the farm and any instance in
that server.
leave unchecked
19© Copyright 2012 EMC Corporation. All rights reserved.
Health Monitoring in the Private CloudEMC System Center Operations Manager (SCOM) Management Packs:
• Array discovery & health monitoring
• Full hierarchical storage schema and relationship view
• Dashboards incl. physical view (SPs, DAEs, NICs, HBAs, Drives) and logical view (RAID Groups, Volumes/Pools, LUNs, Protocols…)
• Performance Monitoring• End to end application service
view• Map / visualize relationships
between storage and SharePoint farm
EMC System Center Orchestrator (SCO) Management Packs:
• Focal point for automation of heterogeneous datacenter management
• Service Manager for workflows and pre-defined run books• 21 storage activities and
counting• Example Drive failure:
1. Gather SP Collects 2. Post on pre-defined share 3. Send alerts to admin
21© Copyright 2012 EMC Corporation. All rights reserved.
RBS Options & Feature ComparisonFeature RBS FILESTREAM StoragePoint SourceOne AvePoint
Catalogue Files into native SharePoint ribbon X √ X XBLOB Externalization (RBS) √ √ √* √
Offload BLOBs to remote storage platforms X
√ √ √BLOB store must be local to SQL Server
Outbound BLOB cache for off-premises (i.e. Cloud) operations X √ X X
Define multiple storage endpoints per content database X √ √ √
Filter endpoints by file type or scope (i.e. list or content type) X √ X X
Take endpoints offline (and/or send notifications) if they fill up or enter an error state
X √ √ X
Use SharePoint filename or folder on offloaded BLOBs X √ X X
Promote SharePoint properties to endpoint X √ X XSecurely delete (shred) BLOBs X √ X XReport and Health Monitor Dashboard X √ √ X
Administration User Interface X√
√ √Central Admin
PowerShell Support X √ √
Compression X √ X X
Encryption X√
X XTransmission and "at rest"
Tiered Storage (HSM) support X √ X X
Orphaned BLOB Garbage Collection √ √√ √ √
Basic Policy-based Basic
22© Copyright 2012 EMC Corporation. All rights reserved.
Storage Admin Database Admin SharePoint Admin
Log into UniSphere 5mCreate Data LUN – 100GB 3mCreate Log LUN – 10GB 3mAdd LUNs to Storage Group 3m
14m 14mRescan Storage in Device Manager 5mRescan Disks in Disk Management 5mIdentify correct Physical disks to LUNs 10m
Create partitions, format @ 64kb blocks 5m
Mount drive letters 2mCreate Database in correct place/collation 10m
Pre-grow Data file and log file 5m56m
56mConnect to Central Admin 5mCreate Web Application (if required – typically not)
10m
Manage Content DBs 5mCreate Content Database in SP, pointing to new SQL DB
10m
86m
86 min
EMC Storage Integrator
Open SharePoint Farm 0.5mEnumerate Farm and associated storage 3mStart ESI SharePoint Provisioning wizard; Provide input 4m
Create and Prepare Data LUN/Disk – 100 GB 2mCreate and Prepare Log LUN/Disk – 10GB 2mCreate Content Database ( 15M initial Size) 0.5mPre-grow Data file and log file 5mCreate Web Application 2m
Refresh Farm 1m20m
20 min
Remember, this traditional approach requires three Administrators, who may work in different departments. So there is a cross-department dependency, which would have an associated lead time.