the role of virtualization in exascale production systems jack lange assistant professor university...
TRANSCRIPT
![Page 1: The Role of Virtualization in Exascale Production Systems Jack Lange Assistant Professor University of Pittsburgh](https://reader036.vdocument.in/reader036/viewer/2022062520/5697bf911a28abf838c8e9b2/html5/thumbnails/1.jpg)
The Role of Virtualization in Exascale Production Systems
Jack LangeAssistant Professor
University of Pittsburgh
![Page 2: The Role of Virtualization in Exascale Production Systems Jack Lange Assistant Professor University of Pittsburgh](https://reader036.vdocument.in/reader036/viewer/2022062520/5697bf911a28abf838c8e9b2/html5/thumbnails/2.jpg)
Where are exascale OSes headed?• Linux is accepted on Petascale
– More than 80% of Top500– Significant push to run Linux on production systems
• Pros– Complex systems are easier to manage– Existing codebase– Familiar and portable environment
• Cons– Not as responsive to application requirements– Exascale is not a primary design goal
• Linux is great for Ops, but only OK for Apps
![Page 3: The Role of Virtualization in Exascale Production Systems Jack Lange Assistant Professor University of Pittsburgh](https://reader036.vdocument.in/reader036/viewer/2022062520/5697bf911a28abf838c8e9b2/html5/thumbnails/3.jpg)
Lightweight Kernels (LWKs)• What do Apps need?
– Simple memory management with little to no overhead– Low noise characteristics– Ability to perform large “bulk” I/O– …
• Traditional strengths of Lightweight Kernel architectures– Application driven resource management
• Lightweight kernels still have utility– But probably not as the primary system OS– App selectable runtime environment
• Challenge– Can we provide a lightweight environment on a heavyweight OS?
![Page 4: The Role of Virtualization in Exascale Production Systems Jack Lange Assistant Professor University of Pittsburgh](https://reader036.vdocument.in/reader036/viewer/2022062520/5697bf911a28abf838c8e9b2/html5/thumbnails/4.jpg)
Virtualization on Linux
• Bypass Linux management layers
• Palacios selectively takes over resource management– Memory, devices, CPUs– Repurpose existing mechanisms
• Allocate large chunks of resources and manage them internally
• Kernel module– Does not require kernel modifications – Implements lightweight interface– Compatible with CNL (~2.6.32)
Available in Palacios 1.3 (Nov. 2011)
![Page 5: The Role of Virtualization in Exascale Production Systems Jack Lange Assistant Professor University of Pittsburgh](https://reader036.vdocument.in/reader036/viewer/2022062520/5697bf911a28abf838c8e9b2/html5/thumbnails/5.jpg)
Virtualized Dual Software Stack
Hardware
Palacios VMM
Lightweight Kernel
ManagementProcesses
+System Daemons
Linux Module Interface
Linux derived Compute Node
OS
HPC Application
Palacios ResourceManagers
• LWKs manage large resource allocations from VMM• Apps can choose which allocators/management layers to deploy on• LWKs can be co-designed with Apps and deployed on production systems
![Page 6: The Role of Virtualization in Exascale Production Systems Jack Lange Assistant Professor University of Pittsburgh](https://reader036.vdocument.in/reader036/viewer/2022062520/5697bf911a28abf838c8e9b2/html5/thumbnails/6.jpg)
Performance isolationMemory Performance (GB/s)
Noise Comparison between native Linux and virtual LWK
![Page 7: The Role of Virtualization in Exascale Production Systems Jack Lange Assistant Professor University of Pittsburgh](https://reader036.vdocument.in/reader036/viewer/2022062520/5697bf911a28abf838c8e9b2/html5/thumbnails/7.jpg)
Thank you
• Jack Lange– [email protected]– http://www.cs.pitt.edu/~jacklange
• V3Vee Project – http://www.v3vee.org