performance analysis of virtualization for high performance computing a practical evaluation of...
TRANSCRIPT
![Page 1: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/1.jpg)
Performance Analysis of Virtualization for
High Performance ComputingA Practical Evaluation of Hypervisor Overheads
Matthew Cawood University of Cape Town
![Page 2: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/2.jpg)
Overview
1. Background
2. Research Objectives
3. HPC
4. Virtualization
5. Performance Tuning
6. The Cloud Cluster
7. Benchmarks
8. Results
9. Conclusions
![Page 3: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/3.jpg)
1. Background
• BSc (Eng) final year research project
• CHPC Advanced Computer Engineering (ACE) Lab
• Cloud Cluster is currently being commissioned
• Research focused on evaluating the hardware and
software configurations
![Page 4: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/4.jpg)
2. Research Objectives
1. Present an in-depth report on the current technologies being developed in the field of High Performance Computing.
2. Provide a quantitative performance analysis of the costs associated with Virtualization, specifically in the field of HPC.
![Page 5: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/5.jpg)
3. High Performance Computing
• HPC data centres are rapidly growing in size and complexity
• Currently emphasis is placed on improving efficiency and utilization
• Wide selection of applications/requirements
• Bioinformatics
• Astrophysics
• Simulation
• Modelling
![Page 6: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/6.jpg)
4. Virtualization
![Page 7: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/7.jpg)
5. Performance Tuning
•Host memory reservation of Linux huge pages•KVM vCPU pinning to improve NUMA cell awareness
![Page 8: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/8.jpg)
![Page 9: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/9.jpg)
6. The Cloud Cluster
Compute Nodes:• 2x Intel Xeon E5-2690, 20MB L3 cache,
2.90 GHz
• 256GB, DDR3-1600, CL11
• Mellanox ConnectX-3 VPI FDR 56Gbps HCA
• Gigabit Ethernet NIC
Switch Infrastructure:
• Mellanox SX6036 FDR 36 port Infiniband Switch
![Page 10: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/10.jpg)
6. The Cloud Cluster
• CentOS 6.4
• OFED 2.0 (with SR-IOV)
• OpenNebula 4.2
![Page 11: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/11.jpg)
7. Performance Benchmarks
• HPC Challenge• HPLinpack
• MPI Random Access
• STREAM
• Effective bandwidth & latency
• OpenFOAM• 7 million cell, 5 millisecond transient simulation
• snappyHexMesh
![Page 12: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/12.jpg)
8. Results
![Page 13: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/13.jpg)
8.1 Software ComparisonHPLinpack throughput comparison of compiler selection
![Page 14: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/14.jpg)
8.2 Single Node Evaluation
HPLinpack throughput efficiency of virtual machines
MPI Random Access Performance
STREAM Memory Bandwidth
![Page 15: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/15.jpg)
8.3 Cluster EvaluationHPLinpack throughput efficiency of virtual machines
![Page 16: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/16.jpg)
8.3 Cluster EvaluationOpenFOAM runtime efficiency of virtual machines
![Page 17: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/17.jpg)
8.4 Interconnect Evaluation
Typical Verbs Latency of virtual machines Typical IPoIB Latency of virtual machines
Native Verbs Vs. IP over Infiniband
![Page 18: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/18.jpg)
8.5 Supplementary Tests
Intel® Hyper-threading
HPLinpack throughput
![Page 19: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/19.jpg)
8.5 Supplementary Tests
Virtual machine Scaling
OpenFOAM runtime
![Page 20: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/20.jpg)
9. Conclusions
• KVM typically provides good performance for HPC
• Tuning is necessary to further improve performance
• Efficiency is highly application dependant
• SR-IOV for Infiniband effectively reduced I/O Virtualization overheads
• Synthetic and real-world results often contradict
![Page 21: Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape](https://reader030.vdocument.in/reader030/viewer/2022032702/56649cbf5503460f94984fb6/html5/thumbnails/21.jpg)
Questions ?