fixing the broken storage model: a storage hypervisor at last
TRANSCRIPT
Fixing The Broken Storage Model: A Storage Hypervisor At Last
Jon Toigo CEO Toigo Partners International
Chairman Data Management Institute
Welcome and Overview
• Three questions to address: • What is the broken storage
model…and who broke it? • What is a “storage hypervisor?” • How can a storage hypervisor
help?
• All in 30 minutes! (Whew.)
Copy
right
© 2
011
by T
oigo
Par
tner
s Int
erna
tiona
l LLC
. Al
l Rig
hts R
eser
ved.
Define “Broken” • bro·ken [broh-kuh’n]
– Out of working order, malfunctioning – Disunited or divided – Bankrupt, ruined, lacking efficiency
• Storage technology is inefficient – From an engineering perspective – From an operational perspective – From a budgetary perspective
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
Engineering-wise • Disk keeps getting bigger and cheaper, but…
1980 2010 Sub-MB
TB+
CAPA
CITY
(A
real
Den
sity
= G
b pe
r in2 )
COST PER G
B
HIGH
LOW
ARRAY COSTS ACCELERATING
Source: “Avoiding the Storage Crunch,” Jon Toigo, Scientific Am
erican
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
“Creeping Featuritus”- Blurring the Lines…
Prob
abili
ty o
f Reu
se
100
0
“Primary Storage”
“Secondary Storage” Accesses to Data
0 days 30+ days 90+ 1 yr ∞ Time
milliseconds seconds minutes hours days Access Speed
“Retention Storage” “Tertiary Storage”
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
Why All of the “Value Add?” • Differentiation of otherwise commodity
hardware requires value-add functionality – Publicly-traded OEMs must “innovate” (aka “add
value via software embedded on array controller”) every 6-8 months, or risk losing market analyst interest
– Embedded software used to lock in customer/lock out competitors
– Portrayed as “one-stop-shop” or “pre-integrated” or “intelligent or smart(er) product” with purported TCO reduction value
– Software costs nearly $0 to mass produce – a plus
All drives and enclosures from
handful of OEMs
RAID dates to 1977: freeware
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
Oh, and Value Add adds Profit • For example: A popular de-duplication solution
vendor offers two kinds of de-duplication rigs A. Software only
• Licenses software separately for $2500 per TB • Run on a server, use any storage you have
B. Software plus hardware • 32 TB of commodity SATA disk storage with embedded
software = $410,000 MSRP (or $12,812.50 per TB) • 1 TB SATA disk costs $79 - $140 on NewEgg.com
(~$3200 for 32 TB) • Vendor’s “value-add” rig costs $80K for software, $330K
for disks or 100x the cost of the disks themselves
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
Resulting Infrastructure C
opyr
ight
© 2
011
by T
oigo
Par
tner
s In
tern
atio
nal L
LC.
All
Rig
hts
Res
erve
d.
Not to Mention • Inflexible infrastructure design in the face of
changing workload demands • Higher failure rates because of incomplete
interoperability testing matrix data • Scaling challenges (services and hardware) • Performance challenges • Lack of predictability (units of storage)
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
From the Operational Perspective • Heterogeneous “value-
add” storage is making life miserable – No unified cross-platform
management capability for “meta-management tasks”
• Capacity • Performance • Data protection
– No unified management for “hardware and plumbing” to facilitate troubleshooting or tuning
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
Last Year… • Roughly 7% of 40.5M disk drives failed = 2.8M drives
– per Google, Carnegie Mellon and IDC reports • Downtime from outages at 3000 US/European firms
= 127M hours (like paying 65,000 persons full time wages for a year-long holiday from productive work) – per a study commissioned by CA Technologies
• The annual operational costs of storage (administration, manual management, environmentals) were 4x the cost of hardware acquisition (and firms currently implementing server and desktop virtualization are expected to grow their storage infrastructure capacity 600% over the next three years) – per Gartner
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
• From a financial perspective, storage cost looks like a nail in search of a cost cutting hammer…
Not Surprising, The Bean Counters Aren’t Thrilled about the Cost…
Or maybe, something better outsourced to “clouds”…
(Got C.V.?)
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
Storage is Financially Inefficient
33-70%
of the IT hardware budget…
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
Add to That… • Warranty and maintenance agreement costs • Annualized value-add software license costs • Installed “hot spare” drives • “Signed drives” • Wire, switch, HBA/NICs… Few other industries make as
much money by cutting down their product…
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
And CAPEX is only a Fraction of Storage Total Cost of Ownership…
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
“Unsustainable” • So, what is the latest advice?
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
Another Option: A “Storage Hypervisor”
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
A Storage What? • Hypervisor.
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
A Storage Hypervisor Creates a Software Abstraction Layer – A Virtual Array Controller
VIRTUAL CONTROLLER
Copy
right
© 2
011
by T
oigo
Par
tner
s Int
erna
tiona
l LLC
. Al
l Rig
hts R
eser
ved.
Providing Centralized Management
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
And an Extensible Services Platform Thin Provisioning Replication Auto-Tiering CDP
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
In a Hardware Agnostic Way
Using “virtual storage pools” comprising any arrays interconnected via any interconnect technology…
Storage served as either block or file volumes…
Data provided with appropriate set of value-add services…
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
Server Hypervisor Computing Has Laid Bare Some Key Points
The x86 Server is a commodity…
Applications and operating systems don’t care about the brand of gear on which they are hosted.
Software is portable…
Done correctly, with careful planning and good management tools, abstracting software away from hardware can simplify
infrastructure and reduce cost of ownership…
Server hardware is just a building block with known resources and performance capabilities.
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
Equally Applicable to a Storage Hypervisor…
Media capacities and interfaces aside, storage arrays are commodity gear…
Most value-add applications don’t need to be hosted on HW array controllers.
Software is portable…
Done correctly, with careful planning and good management tools, abstracting software away from storage hardware can simplify
infrastructure and reduce cost of ownership…
Storage hardware is ideally just a building block with known resources and performance capabilities. It can be surfaced/presented as block or file storage readily…
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
Several Ways to Implement Storage Hypervisor implemented on a
generic server… Use array mount points already established
with server OS… Aggregate storage capacity as desired into
one or more virtual resource pools… Service I/O from server memory for 2X or
more performance bump, regardless of back-end hardware…
Manage capacity, performance and data protection in a unified way…
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
The Front Office Will Be Pleased, Too. Real “unified management” with fewer administrators
“Defense in depth” for critical data assets, with real-time monitoring and control
Failover/Failback for maintenance: no maintenance downtime
Improved power economics by using everything you have
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
Bending the Cost Curve
Cop
yrig
ht ©
201
1 by
Toi
go P
artn
ers
Inte
rnat
iona
l LLC
. A
ll R
ight
s R
eser
ved.
An Immediate Solution to the Big Problem of Server Virtualization…Storage Inflexibility!
Copy
right
© 2
011
by T
oigo
Par
tner
s Int
erna
tiona
l LLC
. Al
l Rig
hts R
eser
ved.
And Going Forward… Storage Hypervisors
Could Provide the “Rosetta Stone” For Cloud I/O Integration
EGYPTIAN
DEMOTIC
GREEK
Copy
right
© 2
011
by T
oigo
Par
tner
s Int
erna
tiona
l LLC
. Al
l Rig
hts R
eser
ved.
Best of Breed
Copy
right
© 2
011
by T
oigo
Par
tner
s Int
erna
tiona
l LLC
. Al
l Rig
hts R
eser
ved.
Hope it helps. • Questions? • Thanks.
• Keep in touch
– Email: [email protected] – Twitter: @jontoigo – Blog: www.drunkendata.com
• Copies of these slides available at http://www.toigopartners.com/Toigo_Storage_Hypervisor.ppt Co
pyrig
ht ©
201
1 by
Toi
go P
artn
ers I
nter
natio
nal L
LC.
All R
ight
s Res
erve
d.
YOUR YEAR-ROUND IT RESOURCE
– access to everything you’ll need to know
THE WHOLE TECHNOLOGY
STACK
from start to finish
COMMENT & ANALYSIS
Insights, interviews and the latest thinking on technology solutions
VIDEO Your source of live information
– all the presentations from our live events
TECHNOLOGY LIBRARY
Over 3,000 whitepapers, case studies, product overviews and press releases from all the
leading IT vendors
EVENTS, WEBINARS & PRESENTATIONS
Missed the event? Download the presentations that
interest you. Catch up with convenient webinars. Plan your next visit.
Directory A comprehensive A-Z listing
providing in-depth company overviews