naspt idf presentation
DESCRIPTION
NAS, Storage, Measurement, IntelTRANSCRIPT
Intel® Network Storage Performance Toolkit
NAS Measurements Developers can Use and Customers can Understand
2
Home Data/Storage Changing
More GBytes More Media More sharing More systems/home More Laptops NVM based storage
Diffusion Group ’05, Intel estimatesH
om
e D
ata
Siz
e (G
B)
Ho
me
Dat
a F
iles
(#)
Cumulative Home Data
00
500500
10001000
15001500
20002000
25002500
2005 2006 2007 2008 2009 2010
0
50000
100000
150000
200000
250000
300000Total GB
Total Files
Home storage changesleading to new NAS role Home storage changesleading to new NAS role
3
Home NAS Role is Changing
NAS
Time
BackgroundBackup
RuntimeFile
Storage
RealtimeMedia Access
NAS performance increasingly impacting end userNAS performance increasingly impacting end user
4
• Home NAS usage
• Intel® NAS Performance Toolkit
• Case study
• Home NAS performance survey
Agenda
5
NAS Usage: Backup and Restore
Backup Restore
Some NAS devices make the user wait and wait and wait…Some NAS devices make the user wait and wait and wait…
User Wait Time (Storage Rd/Wr)User Wait Time (Storage Rd/Wr)(30GB image, 5GB compressed)(30GB image, 5GB compressed)
Source: NASPT measurements
Actual performance may vary.
0 5 10 15 20
Backup
Restore
Minutes
FastNAS
SlowNAS
3x slower
4x slower
6
NAS Usage: Digital Photos
Photo Reads
Some NAS devices make the user wait and wait and wait…Some NAS devices make the user wait and wait and wait…
User Wait Time (Storage Rd)User Wait Time (Storage Rd)(10 Min Fetch of 100+ Photos)(10 Min Fetch of 100+ Photos)
Source: NASPT measurements
0 1 2 3 4
Pho
toA
lbum
Minutes
LocalHDD
FastNAS
SlowNAS
5x slower than LocalHDD, 2x slower than FastNAS
7
NAS Usage: Video Source
Streaming Application ThroughputStreaming Application Throughput
Video Rd/Wr
Many NAS devices don’t support reasonable media workloadsMany NAS devices don’t support reasonable media workloads
Source: NASPT measurements
0
5
10
15
20
25
1 2 3 4Number of Video Streams
Max
Th
rou
gh
pu
t (M
B/s
ec) SlowestNAS
FastestNAS
1080i1080iVideoVideo
8
Home NAS Performance Matters, but is Tough to Measure““ The bad part about NAS devices The bad part about NAS devices
is that they're typically fairly is that they're typically fairly expensive and slowexpensive and slow”.”.
Solving the network storage dilemma- George Ou May 9th 2007http://www.smallnetbuilder.com/content/view/30035/75/1/1/““ performance that doesn’t live up performance that doesn’t live up
to the promise of its gigabit to the promise of its gigabit Ethernet portEthernet port””
“performance that fails to performance that fails to impressimpress”
Smallnetbuilder NAS reviewshttp://www.smallnetbuilder.com
““ The most difficult part of this The most difficult part of this article was developing the article was developing the benchmarksbenchmarks””
SMB NAS Roundup – AnandTech Dec 5th 2006- Ross Whitehead, Jason Clark, Dave Muyssonhttp://www.anandtech.com/IT/showdoc.aspx?i=2881
Intel® NAS Performance Toolkit enables measurement and analysis for current & emerging workloads
9
Intel NAS Performance Toolkit
Library of traces representing home usage Replays each trace to target devices Traces response and measures performance achieved Visualizer for dissecting resulting traces
EthernetWireless
HomePlug A/VTrace ReplayTrace Replay
Delivers home user relevant measurementsDelivers home user relevant measurements
10
Application Based WorkloadsTest # files % seq. Description
HD Video Play 1 99.5% 720p HD stream from Windows Media Player* 256kB reads
2HD Video Play 2 18.1% 2x playback
3HD Video Play 3 6.6% 3x playback
4HD Video Play 4 9.6% 4x playback
HD Video Record 1 99.9% 720p HD stream, 256kB writes
HD Video Play & Record 2 17.8% 1 playback, 1 record simultaneously
2HD Video Play & Record 3 3.0% 2x playback, 2x record
Directory Copy From NAS 126 91.9% 64kB reads
Directory Copy To NAS 126 52.49% Predominantly 64kB writes, wide scattering under 16kB
File Copy From NAS 1 99.9% 4GB file copy, 64kB reads
File Copy To NAS 1 100% 64kB writes
Photo Album 169 80% All reads – wide distribution of sizes
Office Productivity 607 81.3% Reads & writes; small, 1kB & 4kB reads; Mostly 1kB writes
Content Creation 99 39.1% 95% writes; 1k, 4k & little reads; Writes up to 64kB
Backup 1 99.9% 30GB backup using Windows* built-in utility; 8kB writes
Restore 1 99.6% 30GB restore from above backup, 1MB reads
HD Play with Office Apps 608 53.2% Playback concurrent with office productivity
HD Play with Backup 2 65.3% Playback concurrent with backup
More realistic workloads than synthetic testsMore realistic workloads than synthetic tests
11
Intel NAS Performance Toolkit RequirementsIntel NAS Performance Toolkit Requirements
Easy to UseMinimal Learning CurveEasily configured and runNo special test hardware
AccurateMinimize test client impactReproducible measurementsComparable across NAS devices
End UserRelevant
Usage derived Test CasesEasy to Understand Measurements
12
Toolkit Exerciser Overview
Uses workloads home users will care about
Records system response
Organizes results
Various options for controlling traffic generation
Intel® NAS Performance Toolkit
13
Exerciser Results Dialog
Simple statistics- Throughput- Bytes Transferred- Transfer sizes- Service times
Average Maximums
Recorded in log files
Execute multiple runs to verify resultsExecute multiple runs to verify results
14
For Best Results… Capture all measurements on a single, high performance client Use a large, otherwise empty disk in the target device Use a single network cable, avoid hubs and switches Minimize independent variables wherever possible- identical hard drives
- identical network configurations
- perform multiple test runs
Be aware that file buffering and prefetching are active.
Minimum Client Installation Requirements•Intel® Pentium™ 4 Processor or later•Microsoft Windows XP* or Windows Vista*•1GB DRAM
15
Toolkit Analyzer Overview
Full trace listing Statistics Histograms Queue depth Throughput Visual “map” of file
system activity over time
Analyzer provides users with detailed insight into test results
Reads Writes
Transfer Size (bytes)
1000 1500 2000 2500 3000 3500 4000 4500 5000 5500 6000 6500 7000 7500
Obs
erv
ed
Tra
nsa
cti
on
s
0
1000
2000
3000
4000
5000
6000
7000
8000
Reads
Time (seconds)
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70
Th
rou
gh
pu
t (M
B/s
)
0
5
10
15
20
25
30
35
40
45
50
55
16
Case Study: “NAS” PC
Engineer configures a PC to act as a NAS device Experiment: Measure performance of identical
hardware running both Linux* and Windows* XP
Client PCrunning
Windows XP“ NAS” PC
OS
DATA
Gigabit Ethernet
17
Case Study: Experimental Results
User is surprised by differences between Windows XP and Linux
Tests with sequential writes seem alright
Tests with many opens compare favorably
Tests with sequential reads did poorly
1x, 2x, 3x, and 4x video playback tests don’t seem right
0
5
10
15
20
25
30
35
40
45
50
back
up2
rest
ore2
HD
_vid
play
2HD
_vid
play
3HD
_vid
play
4HD
_vid
play
HD
_vid
reco
rd
HD
_vid
play
_vid
reco
rd
2HD
_vid
play
_vid
reco
rd
Con
tent
Cre
atio
n
Off
iceP
rodu
ctiv
ity
File
Cop
yToN
AS
File
Cop
yFro
mN
AS
Pho
toA
lbum
HD
vidp
lay_
back
up
HD
vidp
lay_
offic
e
Th
rou
gh
pu
t (M
B/s
)
Back
up
Rest
ore
Vid
eo P
layb
ack
2x V
ideo P
layb
ack
3x V
ideo P
layb
ack
4x V
ideo P
layb
ack
Vid
eo R
eco
rd
Vid
eo P
layb
ack
& R
eco
rd
2x V
ideo P
layb
ack
& R
eco
rd
Con
ten
t C
reati
on
Offi
ce P
rod
uct
ivit
y
File
Cop
y F
rom
NA
S
File
Cop
y T
o N
AS
Ph
oto
Alb
um
Vid
eo P
layb
ack
& B
ack
up
Vid
eo P
layb
ack
& O
ffice
Windows XPWindows XP
LinuxLinux
Source: NASPT measurements
18
Reads Writes
Service Time (ms)
0 10 20 30 40 50 60 70 80 90 100
Ob
serv
ed
Tra
nsa
cti
on
s
0
100
200
300
400
500
600
700
800
900
Case Study: Histograms
Reads Writes
Service Time (ms)
0 10 20 30 40 50 60 70 80 90 100
Ob
serv
ed
Tra
nsa
ctio
ns
0
500
1000
1500
2000
2500
3000
3500
Windows* shows a very narrow distribution and predictable service time
Linux* has a much wider distribution with a very long tail - very unexpected for a sequentially accessed file
Source: NASPT measurements
19
Case Study: Throughput
Windows* throughput is very steady, as expected for reading a large, sequential file
Linux* throughput is all over the place What is getting in the way?
Reads
Time (seconds)
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70
Th
rou
ghp
ut
(MB
/s)
0
5
10
15
20
25
30
35
40
45
50
55
Reads
Time (seconds)
0 5 10 15 20 25 30 35 40 45 50 55 60 65 70
Th
rou
ghp
ut
(MB
/s)
0
5
10
15
20
25
30
35
40
45
50
55
WindowsLinux
Source: NASPT measurements
20
Case Study: Access Patterns
Access map shows file accesses over time
Zooming in, we find Windows* returns data at a very regular cadence
Linux* pattern is a mixture of quick and slow cycles
Perhaps file isn’t as sequential as it should be…
Intel ® NAS Performance Toolkit
Source: NASPT measurements
21
Case Study: Epilog
Hardware disk tracer confirms discontiguous file layout in Linux*
Windows* clients issue 1-byte writes to 128kbyte future offsets
Setting Samba “strict allocate” flag fixed the issue
Intel NAS Performance Toolkit provided needed clues. Full solution required further investigation.
22
Survey Shows Big NAS Performance Delta
Be a NAS performance leader – Users will notice
0
5
10
15
20
25
30
35T
hro
ug
hp
ut
(MB
/s)
Slowest
NAS B
NAS C
NAS D
NAS E
NAS F
Fastest
160%120%
130%230%
280%
320%
Source: NASPT measurements
350%
23
And NAS is much slower than local disk
Strive for “local-like” performance – Users will notice
Source: NASPT measurements
0
10
20
30
40
50
60
70T
hro
ug
hp
ut
(MB
/s) Slowest
NAS B
NAS C
NAS D
NAS E
NAS F
Fastest
LocalHDD
24
And often slower than USB HDDs
A Home NAS Challenge: Meet or beat USB Drives
Source: NASPT measurements
SlowestNAS
NAS B
NAS C
NAS D
NAS E
NAS F
USB 1
FastestNAS
USB 2
LocalHDD
Relative Performance
25
Summary
The role of NAS in the home is changing- Exposing NAS Performance to PC users
- And bringing a performance opportunity to NAS vendors
Intel NAS Performance Toolkit measures End User Visible Home NAS performance - It is easy to use and understand
Use NASPT (http://www.intel.com/software/NASPT) to:- Tune your NAS (HW and SW)
- Select a high performing NAS
Use NAS Performance Toolkit to be a NAS Performance Leader
Users Will Notice
26
Risk FactorsThis presentation contains forward-looking statements. All This presentation contains forward-looking statements. All statements made that are not historical facts are subject to a statements made that are not historical facts are subject to a number of risks and uncertainties, and actual results may differ number of risks and uncertainties, and actual results may differ materially. Please refer to materially. Please refer to our most recent Earnings Release our most recent Earnings Release and our most recent Form 10-Q or 10-K filing available on our and our most recent Form 10-Q or 10-K filing available on our website for more information on the risk factors that could website for more information on the risk factors that could cause actual results to differ.cause actual results to differ.
Rev. 4/17/07
27
Legal Disclaimer INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL® PRODUCTS. NO
LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL’S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER, AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL® PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT. INTEL PRODUCTS ARE NOT INTENDED FOR USE IN MEDICAL, LIFE SAVING, OR LIFE SUSTAINING APPLICATIONS.
Intel may make changes to specifications and product descriptions at any time, without notice. All products, dates, and figures specified are preliminary based on current expectations, and
are subject to change without notice. Intel, processors, chipsets, and desktop boards may contain design defects or errors known as
errata, which may cause the product to deviate from published specifications. Current characterized errata are available on request.
Performance tests and ratings are measured using specific computer systems and/or components and reflect the approximate performance of Intel products as measured by those tests. Any difference in system hardware or software design or configuration may affect actual performance.
Intel, Intel Inside, and the Intel logo are trademarks of Intel Corporation in the United States and other countries.
*Other names and brands may be claimed as the property of others. Copyright © 2007 Intel Corporation.
