london openstack meetup: measuring performance: the basics

Measuring Performance: the basicsby Stack Evolution

2 © Stack Evolution Ltd

Why?I just finished building my IaaS cloud.

But…

Is it any good?


Lots of metrics and measuresSystem monitoringSystem metric graphingLog file analysis

These are focused on the infrastructure, not the tenant workload


IaaS is a Shared PlatformTunable memory/processor/disk overcommitDynamic workloadsBatch jobsTime of day/month/yearMany variables


Measuring the tenant workloadsTenant only cares about workload

performanceHow does the disk perform?Is the processor faster or slower?What is performance of a specific Database?How do HPC jobs perform?


BenchmarksMany standard benchmark tools available:IperfUnixbenchFioSysbench_OLTPAerospikeRedisScimark2HPCC


Standardise Suite of BenchmarksSelect flavours to directly compare memoryVolumes of standard size (20GB)Network: Internal and ExternalSpecific applications

DatabaseLoggingStreamingHPC


Run on multiple platformsCollect data from

Public CloudsPrivate cloud deploymentsStaging/Test Clouds


CompareNow compare the data to evaluate how good your cloud really is.


Variability of performance for similar flavours across cloud providers, notice the latency and boot time graphs higher is worse, others higher is better


Overall Index score for combined benchmarks, notice the variability in providers is as much as 7 times as much performance for the same flavour size


Mimicking real world workloads: Database and Logging and measuring disk performance using a 20GB Volume of a standard type


A High Performance Computing Benchmark, then weighted by flavour hourly cost and finally weighted by Volume monthly cost (for 20GB Volume).

Notice how much the graphs change once you add in pricing information to the performance data.


Data provided by:

Thanks

Contact [email protected] if you want to find out more.

mailto:[email protected]

london openstack meetup: measuring performance: the basics

Internet