8/3/2019 Aug2011 Riedel Death of Disk Panel Session

1/19

TheDeathofDiskPanelSession

ErikRiedel,EMCHECFSIOWorkshop

August2011toppicturefloppydisksforbreakfastbyBludeviaflickr/cc

rightpicturebyAusnMarshallviaflickr/cc

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

2/19

Conclusion

About80%ofstoreddatawillneverbeaccessedagain

About80%oftherestwillbeaccessedpredictably Thatleaves(maybe)4%ofstoreddatathatpotenallyrequiresquickrandomaccess

=>Buyasmuchflashasyoucanafford,usedisksfortherest

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

3/19

MostDataIsIdle

About80%ofstoreddatawillneverbeaccessedagain

Diskdriveshavelongbeendesignedaroundthiskeyfactofthedigitalworld Amorzearelavelysmallamountofexpensiveread/writeelectronicsandfancy

materialscienceoveralargeandcheap

magnecmedia

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

4/19

DavidAnderson,JamesDykes,ErikRiedelSCSIvs.ATA-Morethan

aninterface2ndConferenceonFileandStorageTechnology(FAST) .

SanFrancisco,CA.April2003.www.cs.cmu.edu/~riedel

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

5/19

ConsumerExample(AtMyHouse)

Dinosaur

Train

SidThe

ScienceKid

Super

Why!

Steelers

Games

Meetthe

Press

Nova

Baby

Einstein

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

6/19

MostDataAccessIsPredictable

Caching Prefetching Tiering Staging HierarchicalStorageMgmt allthesetoolshavebeenknownforyears justneedtoopenourtoolbox,sharpensomeofthemtoapplytotodaysinfrastructure/apps

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

7/19

NewToolsIntheCloud

MarkengbuzzIaaSInfrastructureasaService

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

8/19

NewToolsIntheCloud(2)

MarkengbuzzPaaSPlaormasaService

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

9/19

NewToolsintheCloud(3)

KeytakeawaysbothIaaSandPaaSareclosedloopinfrastructures

appscannotbedeployedexceptatthedireconofthesystem

loggingandmonitoringareconstant needtogethighulizaonrates($$) needtosendoutbills($$) wanthighratesofmul-tenancytobeefficient($$)

thisleadstoasignificantlevelofpredictability

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

10/19

GetPredictabilityIntoStorage

Keychallengeishowtotranslatewhatthesystemknowsaboutappsandbehaviorsand

SLAsintoguidanceforoursystem-leveltools(caching,prefetching,ering,etc.)

SecondarychallengeisavoidingsurpriseswhereperformanceoravailabilityordurabilitydontmeettheSLAs(qualityofservice)

Goodnewsisthatthenewinfrastructureshavesomepowerfulnewwaystohelpus

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

11/19

OneExampleNewToolStunning

Theamountofmethevirtualmachineisstunnedis

dependentontheamountof

memorytobewrientodiskforsuchanoperaon,and

thespeedand

responsivenessofthe

datastore'sbackingstorage.

VMwareKnowledgeBase

hp://kb.vmware.com/selfservice/microsites/search.do?

language=en_US&cmd=displayKC&externalId=1013163

picturebyYamashitaYoheiviaflickr/cc

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

12/19

WhatAboutTape?

picturesbyGillWildmanviaflickr/cc

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

13/19

WhatAboutTape?

Tapesarenotacommoditytechnology 2011totalworldwidemarketfortapecartridgesisabout8munits(justunder$1bannual

revenue) ComparetotheHDDbusinessat650munitsin2010(closeto$40bannualrevenue)

80diskdrivesaremanufacturedforeachtapecartridge;robotsarecomplicated

Fitsparcularapplicaonsegmentsverywell,butisnotageneral-purposesoluon

hp://www.storagenewsleer.com/news/tapes/sccg-ww-tape-market-lto-1q11

hp://techreport.com/discussions.x/20890

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

14/19

Conclusion

About80%ofstoreddatawillneverbeaccessedagain

About80%oftherestwillbeaccessedpredictably Thatleaves(maybe)4%ofstoreddatathatpotenallyrequiresquickrandomaccess

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

15/19

PragmacIssues

Power ifthedataispredictablyidle,thendontspinit

Wearout lookatthedataoccasionally(once/month,once/yr);suchaccessforscrubbingisverypredictable

Backupbackup1)isnotanapplicaonand2)ispredictable

Replicaonesmatesrunto75%ofstoreddataiscopies/replicas,only25%uniquebytes;replicaonispredictable

www.zdnet.com/blog/service-oriented/size-of-the-data-universe-12-zeabytes-and-growing-fast/4750

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

16/19

SummaryHowMuchData

1.2millionPBesmatedin2010 25%unique=>leaves300,000PB 80%idle=>leaves60,000PB 80%predictable=>leaves12,000PB at$1/GBforflash,thatrequires$12b isthataffordable? (remembertheworldbought~$40bofHDDin2010)

www.zdnet.com/blog/service-oriented/size-of-the-data-universe-12-zeabytes-and-growing-fast/4750

www.computerworld.com/s/arcle/9180943/NAND_flash_memory_pricing_to_plummet_to_1_per_GB

recentlythepriceofflashhasnotbeendroppingasfastasthesupplierspredicted,August2011

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

17/19

Conclusion

About80%ofstoreddatawillneverbeaccessedagain

About80%oftherestwillbeaccessedpredictably Thatleaves(maybe)4%ofstoreddatathatpotenallyrequiresquickrandomaccess

=>Buyasmuchflashasyoucanafford,usedisksfortherest

n.b.73.6%ofallstascsaremadeup,

dothecalculaonsforyourown

environments,yourmileagemayvarywww.businessinsider.com/736-of-all-

stascs-are-made-up-2010-2

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

18/19

Inthebaleofrustvs.silicon,bothwillsurviverustpicturebyJosFaberviaflickr/cc

siliconpicturefromChipbugvschipbugbyWindellOskayviaflickr/cc

8/3/2019 Aug2011 Riedel Death of Disk Panel Session

19/19

hp://www.emc.com/storage/atmos/atmos.htm

abriefwordfrommysponsors