stig telfer - openstack and the software-defined supercomputer
TRANSCRIPT
![Page 1: Stig Telfer - OpenStack and the Software-Defined SuperComputer](https://reader030.vdocument.in/reader030/viewer/2022033101/5877061d1a28ab890e8b56d5/html5/thumbnails/1.jpg)
SOFTWARE-DEFINED SUPERCOMPUTER
OPENSTACK AND THE
Stig Telfer, Research Computing Services, Cambridge University
![Page 2: Stig Telfer - OpenStack and the Software-Defined SuperComputer](https://reader030.vdocument.in/reader030/viewer/2022033101/5877061d1a28ab890e8b56d5/html5/thumbnails/2.jpg)
OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER
ABOUT ME
▸ HPC
▸ Distributed systems
▸ HPC
▸ Software-defined networking
▸ HPC
▸ OpenStack
▸ HPC on OpenStack
![Page 3: Stig Telfer - OpenStack and the Software-Defined SuperComputer](https://reader030.vdocument.in/reader030/viewer/2022033101/5877061d1a28ab890e8b56d5/html5/thumbnails/3.jpg)
“…AT THE SC14 SUPERCOMPUTING CONFERENCE IN NOVEMBER, CRAY ANNOUNCED THAT IT IS WORKING WITH CAVIUM TO DELIVER CLUSTERS BASED ON THE 48-CORE VARIANT OF THE THUNDERX CHIPS TO INVESTIGATE THE FEASIBILITY OF USING THESE CHIPS TO RUN HPC WORKLOADS…”
The Next Platform February 27, 2015
OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER
![Page 4: Stig Telfer - OpenStack and the Software-Defined SuperComputer](https://reader030.vdocument.in/reader030/viewer/2022033101/5877061d1a28ab890e8b56d5/html5/thumbnails/4.jpg)
OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER
HPC VS CLOUD
▸ Performance is king
▸ OS and software stack
▸ Network
▸ Storage
▸ Telemetry and analytics
![Page 5: Stig Telfer - OpenStack and the Software-Defined SuperComputer](https://reader030.vdocument.in/reader030/viewer/2022033101/5877061d1a28ab890e8b56d5/html5/thumbnails/5.jpg)
OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER
CLOUD VS HPC
▸ Flexibility
▸ Self-service
▸ Consistency
▸ User-friendly
![Page 6: Stig Telfer - OpenStack and the Software-Defined SuperComputer](https://reader030.vdocument.in/reader030/viewer/2022033101/5877061d1a28ab890e8b56d5/html5/thumbnails/6.jpg)
THE PROJECTCLOUD FOR HPC
![Page 7: Stig Telfer - OpenStack and the Software-Defined SuperComputer](https://reader030.vdocument.in/reader030/viewer/2022033101/5877061d1a28ab890e8b56d5/html5/thumbnails/7.jpg)
OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER
High-SpeedNetwork
Outside World
Compute
ManagementNetwork
Compute
Compute
Compute
Compute
Compute
Management
Monitoring
Storage
…
FIRST ITERATION
▸ Started with OpenStack Havana
▸ Economy hardware
▸ Diskless compute nodes
▸ Neutron networking
▸ Ironic bare metal
▸ Platform-as-a-Service use case
![Page 8: Stig Telfer - OpenStack and the Software-Defined SuperComputer](https://reader030.vdocument.in/reader030/viewer/2022033101/5877061d1a28ab890e8b56d5/html5/thumbnails/8.jpg)
MAKE LEMONADE
WHEN LIFE GIVES YOU LEMONS
![Page 9: Stig Telfer - OpenStack and the Software-Defined SuperComputer](https://reader030.vdocument.in/reader030/viewer/2022033101/5877061d1a28ab890e8b56d5/html5/thumbnails/9.jpg)
OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER
HACKED INTO SHAPE
▸ Ironic power driver for smart PDUs
▸ Neutron driver for SNMP-enabled switches
▸ Fixes for multi-homed bare metal hosts
▸ HPC-like diskless compute node instances
High-SpeedNetwork
Outside World
Compute
ManagementNetwork
Compute
Compute
Compute
Compute
Compute
Management
Monitoring
Storage
…
![Page 10: Stig Telfer - OpenStack and the Software-Defined SuperComputer](https://reader030.vdocument.in/reader030/viewer/2022033101/5877061d1a28ab890e8b56d5/html5/thumbnails/10.jpg)
OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER
Compute
Management
StorageNFS export
Instancemetadatacloud-init
Ephemeraltmpfs
Overlayrootfs
Read-only NFS
DISKLESS COMPUTE NODES
▸ NFS image exported read-only, common to all compute nodes
▸ Writeable ephemeral overlay mounted by initrd
▸ Instance metadata applied
▸ Largely implemented sideband of OpenStack
![Page 11: Stig Telfer - OpenStack and the Software-Defined SuperComputer](https://reader030.vdocument.in/reader030/viewer/2022033101/5877061d1a28ab890e8b56d5/html5/thumbnails/11.jpg)
OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER
Compute
Management
Storage
Cinder attachiSCSI/iSER
Instancemetadatacloud-init
Ephemeraltmpfs
Overlayrootfs
Read-only block device
Image filesystem
BETTER DISKLESS COMPUTE NODES
▸ Root image is Cinder volume
▸ Ironic + Cinder support
▸ Use iSER for Cinder protocol
▸ Read-only attach of Cinder volume
▸ Ramdisk applies ephemeral overlay
▸ Multi-attach of Cinder volume
![Page 12: Stig Telfer - OpenStack and the Software-Defined SuperComputer](https://reader030.vdocument.in/reader030/viewer/2022033101/5877061d1a28ab890e8b56d5/html5/thumbnails/12.jpg)
OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER
Storage
Compute
Workload
ManagementNetwork
Compute
Workload
High-SpeedNetwork
ManagementStorageWorkload ExternalWorkload Internal
OutsideWorld
NETWORKING FOR HPC
▸ Layer-2 protocols, eg RoCE
▸ RDMA is highly desirable
▸ Maximum latency dominates
![Page 13: Stig Telfer - OpenStack and the Software-Defined SuperComputer](https://reader030.vdocument.in/reader030/viewer/2022033101/5877061d1a28ab890e8b56d5/html5/thumbnails/13.jpg)
WORKLOAD MANAGEMENTITS NOT HPC WITHOUT
![Page 14: Stig Telfer - OpenStack and the Software-Defined SuperComputer](https://reader030.vdocument.in/reader030/viewer/2022033101/5877061d1a28ab890e8b56d5/html5/thumbnails/14.jpg)
OPENSTACK AND THE SOFTWARE-DEFINED SUPERCOMPUTER
ACHIEVING THE BEST OF BOTH WORLDS
▸ The flexibility of cloud without the performance overhead?
▸ The programming environment of HPC?
▸ A snowflake?
▸ What is next?
![Page 15: Stig Telfer - OpenStack and the Software-Defined SuperComputer](https://reader030.vdocument.in/reader030/viewer/2022033101/5877061d1a28ab890e8b56d5/html5/thumbnails/15.jpg)
THANK YOUWATCH THIS SPACE…