iomark-vm datrium dvx benchmark certification report · iomark-vm-hc test report 3 iomark-vm test...

16
www.iomark.org IOmark-VM Datrium DVX Test Report: VM-HC-171024-a Test Report Date: 24, October 2017 Copyright © 2010-2017 Evaluator Group, Inc. All rights reserved. IOmark-VM, IOmark-VDI, VDI-IOmark, and IOmark are trademarks of Evaluator Group, Inc. in the United States and other jurisdictions.

Upload: ngokhanh

Post on 20-Aug-2018

219 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: IOmark-VM Datrium DVX benchmark certification report · IOmark-VM-HC Test Report 3 IOmark-VM Test Identifier: VM-HC-171024-a Report Date: 24, October 2017 Executive Summary This document

w w w . i o m a r k . o r g

IOmark-VM

DatriumDVXTestReport:VM-HC-171024-a

TestReportDate:24,October2017

Copyright©2010-2017EvaluatorGroup,Inc.Allrightsreserved.IOmark-VM,IOmark-VDI,VDI-IOmark,andIOmarkaretrademarksofEvaluatorGroup,Inc.intheUnitedStatesandotherjurisdictions.

Page 2: IOmark-VM Datrium DVX benchmark certification report · IOmark-VM-HC Test Report 3 IOmark-VM Test Identifier: VM-HC-171024-a Report Date: 24, October 2017 Executive Summary This document

2 IOmark-VM-HCTestReport

IOmark-VM:TestIdentifier:VM-HC-171024-a ReportDate:24,October2017

TableofContentsExecutiveSummary......................................................................................................................................3VendorSuppliedProductDescription..........................................................................................................3IOmark-VM-HCTestSummary.....................................................................................................................4IOmark-VM-HCResults.................................................................................................................................5TestedConfigurationDetails........................................................................................................................6

Hyper-ConvergedSystemDetails.............................................................................................................6HypervisorConfigurationforIOmark-VM-HCWorkload..........................................................................6StorageConfigurationforIOmark-VM-HCWorkload...............................................................................8ConfigurationDiagram.............................................................................................................................9Connectivity...........................................................................................................................................10TestedConfigurationPricing..................................................................................................................11DetailedResults......................................................................................................................................12IOmark-VMMeasurementsandUse......................................................................................................13HowIOmark-VMOperates.....................................................................................................................14BenchmarkApplicationWorkloadSet....................................................................................................14

WorkloadDetails................................................................................................................................15UnderstandingResults...........................................................................................................................15

BenchmarkCriteria.............................................................................................................................16MoreInformationaboutIOmark-VM.....................................................................................................16AboutEvaluatorGroup..........................................................................................................................16

Page 3: IOmark-VM Datrium DVX benchmark certification report · IOmark-VM-HC Test Report 3 IOmark-VM Test Identifier: VM-HC-171024-a Report Date: 24, October 2017 Executive Summary This document

IOmark-VM-HCTestReport 3

IOmark-VMTestIdentifier:VM-HC-171024-a ReportDate:24,October2017

ExecutiveSummaryThisdocumentistheofficialbenchmarkreportforthetestedconfigurationusingDatriumDVXasahyper-convergedsystem.IOmarkisastoragespecificworkloadandbenchmarkdesignedtoteststoragesystemsperformanceusingavarietyofrealworld,applicationcentricworkloads.TheIOmark-VMbenchmarkisaspecificworkload,whichmeasuresServerVirtualizationworkloads(VMs)runagainststoragesystems.ResultsarepublishedafterauditandcertifiedapprovalbyIOmarkauthorizedauditors.IOmark-VM-HCisabenchmarkthatcertifiesHyper-Convergedsystemsforvirtualserverresults.Themeasurementcriteriaarestorageperformance,withtherestrictionthatallstorageworkloadsmustbesupportedbythetestedHyper-Convergedsystem.AlthoughthereareCPUandmemoryconsiderations,theseaspectsarenottestedbytheIOmark-VMworkload.

TheresultsachievedbyDatriumDVXstoragewithDatriumcomputenodesrunningDVXsoftware:• A-nodeclusterachieved8,000IOmark-VM’satacostof$667.01perVM

Afulldescriptionoftheconfigurationstestedalongwithpricinginformationisprovidedinthisdocument.Thecriteriaandperformancerequirementsareasfollows:

• Forallapplicationworkloads:o Allworkloadsmustresideentirelyonthetestedhyper-convergedsystemo Workloadsarescaledinsetsof8workloadso 70%ofresponsetimesforI/Osmustnotexceed20mso Theaverageresponsetimeforeachapplicationtypemustnotexceed20mso Theexecutiontimemustd15secondsforeachworkload

• Forhypervisoroperations:o Clone,deploy,boot,softwareupgrade,VMdeletiono Storagemigration(akaStoragevMotion)betweenstoragevolumes

• ForIOmark-HCbenchmarkso ThesystemCPUandmemorymustbesufficienttoruntheequivalentapplicationso ThestoragesubsystemismeasuredbyIOmark,withsystemCPUandmemorycompared

torelevantpublishedperformancemetrics

VendorSuppliedProductDescriptionDatriumDVX

DVXdeliverstheworld’ssimplestandmostpowerfulprivatecloudplatformbyconvergingcompute,virtualization,primaryandsecondarystorageinaradicalnewway.DVXsplitsIOprocessingfromdurablecapacityusingtwobasicblocks:computenodesanddatanodes.AddcomputenodesforIOspeedanddatanodesforcapacitytoachieveindependent,un-bottleneckedscaling.Alldataservicessuchasdeduplication,compression,erasurecoding,snapshots,replicationandencryptionscalewithcomputenodes,arealways-onandultra-efficientforzero-knobdatamanagementatscale.

DatriumDVXprovidesthefollowingenterprisefeatures:• Scaleelasticallyfromonecomputenode&datanodeto128computenodes&10datanodesin

asingleDVXsystem.

Page 4: IOmark-VM Datrium DVX benchmark certification report · IOmark-VM-HC Test Report 3 IOmark-VM Test Identifier: VM-HC-171024-a Report Date: 24, October 2017 Executive Summary This document

4 IOmark-VM-HCTestReport

IOmark-VM:TestIdentifier:VM-HC-171024-a ReportDate:24,October2017

• Useexistinghosts&flashorbuyturn-keyDatriumcomputenodesforsinglepointofsupport.• Keepcomputenodesstatelessandmix-workloadswithback-upgradeefficiencyandeconomics.• Snap,clone,restoreorreplicateanyVM,vDisk,ISOfileorcontainervolumesaloneorasself-

updatingpolicygroupwithalloperationsfullydataefficientforextremeagility.• ConsolidatedevtoprodITacrossvSphere,RedHat,KVMandbare-metaldockercontainers.• FullyWANefficient,SSLencryptedElasticReplicationwhereallcomputenodestransferdata

fromlocalflashusingaggregatednetworkbandwidth.• Securedatawith100%SW-basedencryptionwithbuilt-inkeymanager.Dataencryptedin-flight

(fromcomputenodetodatanode)andat-restwithfulldatareduction.• ModernHTML5GUIandapowerfulvCenterplug-in(FlexandHTML5).Built-inreal-time

VM/containeranalytics&monitoringhistory.Integratedcallhomeforproactivesupport.

IOmark-VM-HCTestSummaryForthetestedconfiguration,thefollowingdataisprovided.

Item Value

TestingIdentifier: VM-HC-171024-a

Product(s): 10@DatriumDVXF12X2storagenodes• 23TBSSDraw,8x10GbE,2cntrlrs.

60@Datriumcomputenodes,eachwith:• 2xIntelXeonE5-6148v5processors• 4xSSDcache+DatriumDVXsoftware• VMwareESXihypervisor

TestSponsor: Datrium

Auditor: EvaluatorGroupInc.

Table1:TestIdentifierInformation

Item Value

IOmark-VMVersion: Version:IOmark-VM3.8

TestingCompleted: October2017

EquipmentAvailability: October2017

AuditCertificationDate: 24,October2017

ReportDate: 24,October2017

Table2:TestRevisionandDates

Page 5: IOmark-VM Datrium DVX benchmark certification report · IOmark-VM-HC Test Report 3 IOmark-VM Test Identifier: VM-HC-171024-a Report Date: 24, October 2017 Executive Summary This document

IOmark-VM-HCTestReport 5

IOmark-VMTestIdentifier:VM-HC-171024-a ReportDate:24,October2017

IOmark-VM-HCResultsShownbelowaretheIOmark-VM-HCresultsforthesystemundertest.ThedefinitionandworkloadcharacteristicsofthebenchmarkareprovidedinAppendixA.

PriceinformationprovidedbelowisexplainedindetailinTable8inthisreport.

Table3belowshowsanoverviewoftheIOmark-VM-HCresults.

IOmark-VMTotalVM’s

IOmark-VMResponse

Avg.

AvailableCapacity(wo/data-reduction)

UsedCapacity(w/data-reduction)

TestedRAIDLevel

TotalListPrice

IOmark-VM-HC$/VM

8,000 2.11ms 160TB 125TB RAID6 $5,336,112 $667.01

Table3:IOmark-VM-HCResultDetails

ThetotalnumberofIOmark-VM-HCvirtualmachinessupportedisshownaboveinTable3,basedontheIOmark-VMworkloadsetsshowninTable4below.Eachapplicationsetconsistsof8virtualmachines,thus1,000applicationsetsyields8,000VM’sreported.TheVMwarevCenterServer™operationvaluesarealsoshownbelow,withtwocomponentsbeingreported.The“CloneandDeploy”portionoftheworkloadcreatesaclonefromaspecificVMtemplate,startstheVMrunningandthenupgradesitsversionofVMwaretoolsinstalled.Thereportedvalueindicateshowmanyoperationcycleswerecompletedduringthe1-hourtestrun.Similarly,thestoragevMotionvaluereportedindicateshowmanymigrationcycleswerecompletedduringthe1-hourtestrun.Acombinedscoreiscalculated,knownasthe“HypervisorWorkloadScore,”whichistheratioofreportedresultstotheminimumrequiredresults.TheminimumnumbersofvCenteroperationsforpassingthetestare6cloneanddeployand3storagevMotionoperationsrespectivelyforconfigurationssupporting21IOmark-VMsetsormore.DetailsofpassingresultsshownbelowinTable4:

IOmark-VMSets

ReadResp.

Average

WriteResp.

Average

#vCenterCloneandDeploy

#vCenterstoragevMotion

HypervisorWorkload

Score(1-inf.)

1,000 0.76ms 2.46ms 6 5 1.5

Table4:IOmark-VMPassingResultDetails

Page 6: IOmark-VM Datrium DVX benchmark certification report · IOmark-VM-HC Test Report 3 IOmark-VM Test Identifier: VM-HC-171024-a Report Date: 24, October 2017 Executive Summary This document

6 IOmark-VM-HCTestReport

IOmark-VM:TestIdentifier:VM-HC-171024-a ReportDate:24,October2017

TestedConfigurationDetailsThissectioncoverstheconnectivity,configurationandpricinginformationforthesystemundertest.

Hyper-ConvergedSystemDetailsDetailedhardwarefeaturesforthesystemundertestareprovidedbelowinTable5.

HardwareFeatures Value

RackFootprint* Tested:50computenodes+10DVXnodes=45U(25+20)Reported:60computenodes+10DVXnodes=80U(60+20)

NumberofNodesperAppliance N/A:ComputenodesandDatriumdatanodesareindependent

NumberofDrivesperAppliance Cache:4SamsungPM863a/computenode=200totalCapacity:12SamsungPM1633a/datanode=120total

CPUspersystem/total* Tested:2xIntelE5-2699v4/nodeà100sockets;2,200coresReported:2xIntelXeon6184/nodeà120sockets;2,640cores

Memory* Tested:128GB/nodeà6.4TBfor50nodesReported:512GB/nodeà30TBfor60nodes

NetworkingPorts(1/10GbE) Tested:100@10GbEPorts(2PerComputeNode)Reported:120@10GbEPorts(2PerComputeNode)

Table5:Hyper-ConvergedHardwareFeatures

• *Note:Thetestedconfigurationisshownfortransparency.However,forpriceandofficialconfigurationpurposes,the“Reported”configurationrequiredtheCPUandmemoryresourcesasnoted.ThedeterminationismadebasedonthereferencedsystemrunningVMmark2.5.

Thetestedconfigurationutilized50DellC6320computenodesand10DatriumF12X2datanodes.Thereportedconfigurationconsistedof60Datriumcomputenodesand10DatriumTheCPUandmemorynecessarytosupporttheVMmark2.5workloadwasdeterminedtorequire60Datriumnodes,using2xIntelXeonScalable6148processorsand512GBofDRAM.ItisthedeterminationofEvaluatorGroupthatthisDatriumconfigurationiscapableofachieving1,000VMmarktilesbaseduponthepublishedresultsofaE5-2699v4Intel2nodesystemachieving32VMmarktiles,whichtranslatesinto900tilesfora60-nodeconfiguration.Intel’spublisheddataindicatesimprovementsofbetween5%-100%fortheXeonScalablesystem,thussupportingtheprojectionofa10%improvementrequiredtosupport1,000VMmarktiles,or8,000IOmark-VM-HCVM’s1.Withtheseguidelines,thetestedHyper-Convergedsystemachievedthestorageperformancerequiredandhassufficientcomputingresourcestoachievethestatedresults.

HypervisorConfigurationforIOmark-VM-HCWorkload• AsinglesharedNFSmountpointwasaccessedfromall60nodesinthecluster• VirtualdiskswerecreatedforeachofthereportedIOmark-VM’scertified(8,000total)• RAIDlevelisnotatunableparameteranddefaultDatriumpolicyisthinprovisioneddisks• Dedupe,compressionandencryptionwereenabledduringtesting

1VMmark2.5reportedresults:Huawei32TileswithE5-2699v4

Page 7: IOmark-VM Datrium DVX benchmark certification report · IOmark-VM-HC Test Report 3 IOmark-VM Test Identifier: VM-HC-171024-a Report Date: 24, October 2017 Executive Summary This document

IOmark-VM-HCTestReport 7

IOmark-VMTestIdentifier:VM-HC-171024-a ReportDate:24,October2017

Detailedhypervisorconfigurationparametersforthesystemundertest,includingconnectivityareprovidedbelowinTable6.

StorageSystemParameter Value

Hypervisor VMwarevSphere™ESXi6.0U3

Numberofinterfacestothestoragesystem: Tested:2@10GbEpercomputenode(100total)

Connectivitytostoragesystem: 4@10GbEthernet/Datriumstoragenode

Hypervisorstorageprotocolused: NFSv3

Hypervisorversion: VMwareESXi6.0U3

Thinprovisioning: Yes

HypervisorStorageAccess: NFSdatastore

DatastoreFilesystem: NFSaccesstoDatriumDVX

VAAI: N/A

SATP: N/A

PSP: N/A

TotalcapacityofsystemallocatedtoIOmark-VM: 10DVXNodes:10*16TB=160TBusable;320TBeffectivewith2:1datareduction

Table6:HypervisorConfigurationParameters

NOTE:PerIOmarkrequirements,a“write-only”workloadisrunpriortotheactualworkload.Thisprewritesdatatoallstoragelocationsreferencedduringtesting.Bypre-writingdatapriortoactualworkloadtesting,thereisnowriteallocationpenaltyassociatedwiththinprovisioning.Thisalsoensuresthatwhenreadsareperformedthestoragesystemreadsthemedia,ratherthanreturningzerosforunallocatedaddresses.

Page 8: IOmark-VM Datrium DVX benchmark certification report · IOmark-VM-HC Test Report 3 IOmark-VM Test Identifier: VM-HC-171024-a Report Date: 24, October 2017 Executive Summary This document

8 IOmark-VM-HCTestReport

IOmark-VM:TestIdentifier:VM-HC-171024-a ReportDate:24,October2017

StorageConfigurationforIOmark-VM-HCWorkload• AsingleNFSdatastorewascreatedusingthepooledcapacityacrossall10DVXstoragenodes• EachVM’sVMDKwasallocatedusing“thinprovisioning”perDatriumdefaultpolicy

DetailedStorageSystemconfigurationparametersforthestoragesystemundertest,includingconnectivityisprovidedbelowinTable7.

StorageSystemParameter Value

StorageSystemfirmware DatriumDVX4.0.1.0

HighAvailabilityAccesstoallLUNs Yes(active/passive)

Totalrawcapacityofsystemundertest(SUT) 230TB(acrossallnodesw/odatareduction)

Totalusablecapacityofsystemundertest(SUT) 320TB–960TB(2x–6xdatareductionrates)

NFSMountPoints 1(SinglesharedNFSmountpointforallnodes)

Thinprovisioning: Yes

RAIDLevel(s) ErasureCoding2parity(DVXstandard,nosetting)

TotalCacheCapacity: Readcacheperhost,NVRAMwritecacheperDVX

ReadCache: Tested:384TB([email protected])Reported:460.8TB([email protected])

WriteCache: 1NVRAMperDVXdatanode

VAAIFeaturesEnabled: No-NFSaccess

-BlockZero N/A

-FullCopy N/A

-HWLocking N/A

Automatedtieringwithinthestoragesystem: N/A

DataDeduplication: Enabled

DataCompression: Enabled

DataEncryption: Enabled

Storagesystemclones/writeablesnapshots: No,enablednotused

StorageMediaUtilized: HDDwithNVRAMinDVXstoragenode

-SSD’s(Note:CapacityTieronly,Cachenotedabove)

NVRAMcache,160TBusableon10DVXnodes

-HDD -

Table7:StorageSystemConfigurationParameters

Page 9: IOmark-VM Datrium DVX benchmark certification report · IOmark-VM-HC Test Report 3 IOmark-VM Test Identifier: VM-HC-171024-a Report Date: 24, October 2017 Executive Summary This document

IOmark-VM-HCTestReport 9

IOmark-VMTestIdentifier:VM-HC-171024-a ReportDate:24,October2017

ConfigurationDiagramThelogicaldatalayoutofthetestconfigurationisshownbelowinFigure1.WithDatriumDVX,asingleNFSmountpointispresentedtoallnodesinthecluster.Thus,onlyasingledatastoreisrequiredforallvirtualdisksforVMs.TheVMDK’sforeachVM’sworkloadallwereallocatedfromthesameDVXNFSdatastorecapacitypoolacross10storagenodes.

Figure1:LogicalSystemConfiguration

Page 10: IOmark-VM Datrium DVX benchmark certification report · IOmark-VM-HC Test Report 3 IOmark-VM Test Identifier: VM-HC-171024-a Report Date: 24, October 2017 Executive Summary This document

10 IOmark-VM-HCTestReport

IOmark-VM:TestIdentifier:VM-HC-171024-a ReportDate:24,October2017

ConnectivityThestorageconnectivitywastwo10GbEportspereachESXihostinthecluster.TestingdidutilizearedundantHAconfiguration.Note:Thepricedconfigurationincludesthecostofthe10GbEportswithineachserverand10GbEportsoneachDVXstoragenode.However,pricingdoesnotincludeswitchesorotherexternalnetworkcosts.ThetestedconfigurationconnectivitydiagramisshownbelowinFigure2.

Figure2:PhysicalSystemConnectivity

Page 11: IOmark-VM Datrium DVX benchmark certification report · IOmark-VM-HC Test Report 3 IOmark-VM Test Identifier: VM-HC-171024-a Report Date: 24, October 2017 Executive Summary This document

IOmark-VM-HCTestReport 11

IOmark-VMTestIdentifier:VM-HC-171024-a ReportDate:24,October2017

TestedConfigurationPricing

Item Description Qty. Ext.ListPrice

1 Datriumcomputenodes(2@22core6184CPUs,512GBDRAM+2@10GbEthernet+4Samsung1.92TBSSD)

60servers $1,865,040.00

2 VMwarevSphereEnterprisePlus 120sockets $419,400.00

4 DatriumDVXHostLicense 60licenses $720,000.00

5 DatriumDVX–F12X2DataNode 10nodes $1,860,000.00

6 3YearsSupportDatriumDVXdatanodeHW AllDatrium $169,704.00

7 3YearsVMwareSWSupport 120sockets $301,968.00

Total ListPriceHW+SW+3yearservice&support $5,336,112.00

Table8:IOmark-VM-HCPriceInformation(60NodeConfiguration)

Note:Supportincludedforallhardwareandsoftwareincludingstoragemedia.

Page 12: IOmark-VM Datrium DVX benchmark certification report · IOmark-VM-HC Test Report 3 IOmark-VM Test Identifier: VM-HC-171024-a Report Date: 24, October 2017 Executive Summary This document

12 IOmark-VM-HCTestReport

IOmark-VM:TestIdentifier:VM-HC-171024-a ReportDate:24,October2017

DetailedResultsIOmark-VMperformanceresultsaremeasuredbyapplicationworkload.TheeightapplicationsthatcompriseaworkloadsetareshownbelowinTable10,withaverageresponsetimesreportedperapplicationtype.

Figure3:PercentageofTotalResponseTimesatMeasuredValue

FromFigure3above,theprimaryresponsetime(s)ofinterestare:• Over96%ofresponsetimeswerelessthan5ms.forthecluster• Morethan99%ofresponsetimeswerelessthan20ms.forthecluster

ApplicationWorkloadAvg.ResponseTime

Read Write

DVDStoreDB 1.06ms 2.41ms

ExchangeMailServer 1.03ms 2.36ms

OlioWebServer 0.88ms 2.93ms

OlioDatabase 0.84ms 2.15ms

DVDStoreWebApp1 0.12ms 2.14ms

DVDStoreWebApp2 0.12ms 2.14ms

DVDStoreWebApp3 0.12ms 2.14ms

WindowsStandby 0.12ms 2.14ms

Table10:ApplicationWorkloadResponseTimes

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

120.0%

2 5 10 20 30 40 60 80 100

Percen

tageofV

alue

s

ResponseTimeinms.

CumulativeResponseTimes

CDF

Page 13: IOmark-VM Datrium DVX benchmark certification report · IOmark-VM-HC Test Report 3 IOmark-VM Test Identifier: VM-HC-171024-a Report Date: 24, October 2017 Executive Summary This document

IOmark-VM-HCTestReport 13

IOmark-VMTestIdentifier:VM-HC-171024-a ReportDate:24,October2017

AppendixA-IOmark-VMOverviewTheabilitytorecreateaknownworkloadisimportantforcomparingasystemagainstpotentialalternatives.EstablishingareferenceorbenchmarkworkloadenablessystemvendorsaswellasresellersandITuserstocompareseveralsystemsutilizingaknownworkload.Specifically,theIOmark-VMbenchmarkrecreatesastorageworkloadthattypicallyoccursinavirtualinfrastructureenvironment.Theworkloadisnon-syntheticandrecreatesseveralapplicationsthatarecommonlyfoundinvirtualizedserverenvironments.

Figure3:IOmark-VMConceptualOverview

IOmark-VMMeasurementsandUseDatacentersrunningapplicationsinavirtualinfrastructurecontainmultipleworkloadsrunningonavirtualizationplatform.OftenmultiplephysicalserverssharetheresourcesofasinglestoragesystemprovidingprimarystorageforbothvirtualmachineOSandapplications.Currently,severalbenchmarkshavebeendevelopedthatfocusontheserveraspectsofinfrastructure,includingtheCPU,memoryandI/Obandwidthcapabilitiesoftheinfrastructure.However,therehasbeennocorrespondingdevelopmentofstandardizedworkloadsdesignedtodrivestorageworkloadsfortheseapplicationenvironments.ByestablishingasetofstandardapplicationsandcapturingtheirI/Ostreams,itispossibletorecreateapplicationbasedstorageworkloadsforthesecomplexenvironments.IOmark-VMisdesignedutilizingtheseconcepts,andassuchisthefirstbenchmarkdesignedtoaccuratelygenerateapplicationworkloadsforstoragesystems,enablingdirectcomparisonofstoragesystemconfigurationsandtheirabilitytosupportaspecificnumberofapplications.

Hypervisor*

Linux*64b*

DVD*Store**

Web*Server*

Linux*64b*

DVD*Store**

Web*Server*

Linux*64b*

DVD*Store**

Web*Server*

Linux*64b*

DVD*Store**

Database*

Linux*64b*

Olio**

Web*Server*

Win*2008*

Standby***

Win*2008*

Mail*Server**

Web*Server*

Linux*64b*

Olio**

Database*

Storage(System((***(System*Under*Test)*

Page 14: IOmark-VM Datrium DVX benchmark certification report · IOmark-VM-HC Test Report 3 IOmark-VM Test Identifier: VM-HC-171024-a Report Date: 24, October 2017 Executive Summary This document

14 IOmark-VM-HCTestReport

IOmark-VM:TestIdentifier:VM-HC-171024-a ReportDate:24,October2017

Additionally,IOmark-VMrealizesthatasignificantimpactonstoragemayoccurfromadministrativefunctionscommoninvirtualinfrastructures.Forthisreason,severalhypervisor-basedfunctionsareapartoftheIOmark-VMworkload.Theseadditionaloperationsinclude;cloningavirtualmachine,bootingaVMandupdatingsoftware,whilealsomigratingavirtualmachinefromonestoragevolumetoanother.

HowIOmark-VMOperatesIOmark-VMusestheconceptofworkloadreplay.I/Ostreamsarecapturedfromactualrunningapplicationsandthen“replayed”sothattheexactsequenceandI/Ocommandsareissued.Thisallowsthecreationofaworkloadthatisindistinguishablefromanactualworkloadtothesystemundertest,whilebeingreproducibleandrequiringfewerresources.Additionally,thetestenvironmentislessexpensive,easierandfastertocreatesinceactualapplicationsarenotrequired.BecauseCPUandmemoryarenotconsumedrunningapplications,amuchhigherI/Oworkloadmaybegeneratedwithasetofserverresourcesthanispossibleusingnativeapplications.Thisratioistypically10:1,butmayvary.InFigure3onthepreviouspage,asinglesetofapplicationsisdepictedrunningonasinglephysicalhostinavirtualinfrastructure.Inordertoscaleuptheworkloadonastoragesystem,additionalapplicationssetsmaybeaddedtothesame,ortootherphysicalhosts.Theonlylimitationtothescaleofthetestisthephysicalinfrastructuresupportingtheworkload.Sufficient,CPU,memoryandI/Ocapabilitiesmustbeavailabletorunadditionalworkloadsets.Unlikeartificialworkloadgenerationtools,IOmark-VMrecreatesaccuratereadvs.writeandrandomvs.sequentialI/Orequests.AnothermeasurementofIOmark-VMisthatitcreatesaccurateaccesspatterns,thusenablingstoragecachealgorithmstoworkproperly.Finally,IOmark-VMmaintainsanaccurateratioofperformancetocapacityasworkloadsarescaled,ensuringthatstorageperformanceismeasuredwithrespecttostoragecapacityaccurately.Asaresult,IOmark-VMmaintainsanaccurateratioofI/Otocapacity,producingresultsapplicabletoITusers.

BenchmarkApplicationWorkloadSetAconceptutilizedfortestingmultipleapplicationsisthatof“Applicationsets”,alsoknownas“tiles.”Asetof8applicationsisruntogether,alongwithseveralcommonhypervisorinfrastructureoperations.Inordertoscaletheworkloadupandplaceahigherloadonthestoragesystem,additionalapplicationsetsarerun.Applicationsetsarealwaysruntogetherforofficialbenchmarkresults,alongwithadefinedsetofinfrastructureoperations.

Page 15: IOmark-VM Datrium DVX benchmark certification report · IOmark-VM-HC Test Report 3 IOmark-VM Test Identifier: VM-HC-171024-a Report Date: 24, October 2017 Executive Summary This document

IOmark-VM-HCTestReport 15

IOmark-VMTestIdentifier:VM-HC-171024-a ReportDate:24,October2017

ThespecificapplicationscomprisingaworkloadsetaredetailedbelowinTable10.

Application GuestOS StorageCapacity/Instance

MicrosoftExchange2007 MicrosoftWindowsServer2008,Enterprise,64bit

80GB

OlioDatabase SuSELinuxEnterpriseServer11,64bit

14GB

OlioWebserver SuSELinuxEnterprise11,64bit 80GB

IdleWindowsServer MicrosoftWindowsServer2003SP2EnterpriseEdition,32-bit

10GB

DVDStoreDatabase SuSELinuxEnterprise11,64bit 45GB

DVDStoreWebServer1 SuSELinuxEnterprise11,64bit 10GB

DVDStoreWebServer2 SuSELinuxEnterprise11,64bit 10GB

DVDStoreWebServer3 SuSELinuxEnterprise11,64bit 10GB

HypervisorClone&Deploy N/A-VMwarevCenterrequired 15GB

HypervisorStorageMigration N/A-VMwarevCenterrequired 30GB

-- -- Total=305GB

Table10:IOmark-VMApplicationOverview

Thetotalcapacityrequiredforeachsetofapplicationsisapproximately305GBofcapacity.Eachadditionalworkloadsetrequiresanadditional305GBofcapacity.

WorkloadDetailsTheOlioapplicationconsistsofbothadatabaseserver,andawebclientrunningondifferentvirtualmachineswithapre-loadeddataset.FormoredetailsonOliosee:http://incubator.apache.org/olio/TheDVDapplicationconsistsofasingledatabaseserveralongwiththreewebclients,eachrunningonadifferentvirtualmachineusingpredefinedworkloadanddataset.FormoredetailsonthepubliclyavailableDVDdatabaseapplicationsee:http://linux.dell.com/dvdstore/TheExchangeserverisaMicrosoftmessagingandemailserver.OnlytheserverportionofExchangeisrecreatedinthisworkloadset,withtheclientworkloadsnotbeingapartoftheI/O,onlyindirectlythroughtheirrequeststothemessagingserver.ThetwohypervisorworkloadsarebasedoncommonoperationsperformedinvirtualinfrastructureenvironmentsandrequiretheavailabilityofaVMwarevCenterservertoperformtheoperations.

UnderstandingResultsIOmark-VMproducesresultsindicatingtheresponsetimeofastoragesystemgivenaparticularworkload.Basedonestablishedcriteria,theseresultsinturndictatehowmanytotalvirtualmachinesetsaresupportedbyaspecificstorageconfigurationandtheaverageresponsetime.ThereportisauditedforaccuracyandissuedbyEvaluatorGroup,Inc.,anindependentstorageanalystfirm.Note:IOmark-VMresponsetimescannotbedirectlycomparedtoVMmarkresponsetimes.IOmarkmeasuresresponsetimesofindividualI/Orequests,whereasVMmarkmeasurestransactionresponsetimes,consistingofmultipleI/Ooperationsalongwithdatacalculations.

Page 16: IOmark-VM Datrium DVX benchmark certification report · IOmark-VM-HC Test Report 3 IOmark-VM Test Identifier: VM-HC-171024-a Report Date: 24, October 2017 Executive Summary This document

16 IOmark-VM-HCTestReport

IOmark-VM:TestIdentifier:VM-HC-171024-a ReportDate:24,October2017

BenchmarkCriteriaIOmarkhasestablishedthebenchmarkcriteriafortheIOmark-VMworkload.Theperformancerequirementsareestablishedasfollows:

• Forallapplicationworkloads:o Workloadsarescaledinsetsof8workloadso 70%ofresponsetimesforI/O’smustnotexceed20mso Theaverageresponsetimeforeachapplicationmustnotexceed30mso Allstoragemustresideonthestoragesystemundertesto Thereplaytimemustcompletewithin1hourand15secondsforeach1hourworkload

• Forhypervisoroperations:o Clone,deploy,boot,softwareupgrade,VMdeletiono Storagemigration(akaStoragevMotion)betweenstoragevolumes

MoreInformationaboutIOmark-VMFormoreinformationabouttheIOmarkbenchmark,atheoryofoperationsguide,publishedresultsandmore,visittheofficialwebsiteathttp://www.iomark.org.Somecontentisrestrictedtoregisteredusers,sopleaseregisteronthesitetoobtainallavailableinformationandthelatestresults.

AboutEvaluatorGroupEvaluatorGroupInc.isatechnologyresearchandadvisorycompanycoveringInformationManagement,StorageandSystems.ExecutivesandITManagersuseusdailytomakeinformeddecisionstoarchitectandpurchasesystemssupportingtheirdigitaldata.Wegetbeyondthetechnologylandscapebydefiningrequirementsandknowingtheproductsin-depthalongwiththeintricaciesthatdictatelong-termsuccessfulstrategies.www.evaluatorgroup.com@evaluator_group