bsc slides v - riscv.org · 5/16/2018 · marenostrum 3 . 3456 nodes 394 tb ram 48 racks 72...
TRANSCRIPT
![Page 1: BSC Slides v - riscv.org · 5/16/2018 · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores](https://reader036.vdocument.in/reader036/viewer/2022081523/5fcdb77a41799933e73cb777/html5/thumbnails/1.jpg)
![Page 2: BSC Slides v - riscv.org · 5/16/2018 · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores](https://reader036.vdocument.in/reader036/viewer/2022081523/5fcdb77a41799933e73cb777/html5/thumbnails/2.jpg)
![Page 3: BSC Slides v - riscv.org · 5/16/2018 · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores](https://reader036.vdocument.in/reader036/viewer/2022081523/5fcdb77a41799933e73cb777/html5/thumbnails/3.jpg)
MareNostrum
Sergi Girona Operations Director
May, 2018 Barcelona
![Page 4: BSC Slides v - riscv.org · 5/16/2018 · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores](https://reader036.vdocument.in/reader036/viewer/2022081523/5fcdb77a41799933e73cb777/html5/thumbnails/4.jpg)
MareNostrum4 Total peak performance: 13,7 Pflops/s
12 times more powerful than MareNostrum 3
80%
Access: prace-ri.eu/hpc_acces
16%
Access: bsc.es/res-intranet
4%
![Page 5: BSC Slides v - riscv.org · 5/16/2018 · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores](https://reader036.vdocument.in/reader036/viewer/2022081523/5fcdb77a41799933e73cb777/html5/thumbnails/5.jpg)
From MN3 to MN4
![Page 6: BSC Slides v - riscv.org · 5/16/2018 · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores](https://reader036.vdocument.in/reader036/viewer/2022081523/5fcdb77a41799933e73cb777/html5/thumbnails/6.jpg)
General Purpose for current BSC
workload
11.15 Pflops/s
3,456 nodes of Intel Xeon Platinum
processors
390 Terabytes of Main Memory
14PB storage
![Page 7: BSC Slides v - riscv.org · 5/16/2018 · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores](https://reader036.vdocument.in/reader036/viewer/2022081523/5fcdb77a41799933e73cb777/html5/thumbnails/7.jpg)
General Purpose for current BSC
workload
11.15 Pflops/s
3,456 nodes of Intel Xeon Platinum
processors
390 Terabytes of Main Memory
14PB storage
![Page 8: BSC Slides v - riscv.org · 5/16/2018 · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores](https://reader036.vdocument.in/reader036/viewer/2022081523/5fcdb77a41799933e73cb777/html5/thumbnails/8.jpg)
General Purpose for current BSC
workload
11.15 Pflops/s
3,456 nodes of Intel Xeon Platinum
processors
390 Terabytes of Main Memory
14PB storage
![Page 9: BSC Slides v - riscv.org · 5/16/2018 · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores](https://reader036.vdocument.in/reader036/viewer/2022081523/5fcdb77a41799933e73cb777/html5/thumbnails/9.jpg)
Interconnected with OmniPath
network
![Page 10: BSC Slides v - riscv.org · 5/16/2018 · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores](https://reader036.vdocument.in/reader036/viewer/2022081523/5fcdb77a41799933e73cb777/html5/thumbnails/10.jpg)
Interconnected with OmniPath
network
![Page 11: BSC Slides v - riscv.org · 5/16/2018 · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores](https://reader036.vdocument.in/reader036/viewer/2022081523/5fcdb77a41799933e73cb777/html5/thumbnails/11.jpg)
Emerging Technologies, for evaluation
of 2020 Exascale systems
3 systems, each of more than 0,5
Pflops/s with
Power9+NVIDIA, ARMv8, “KNH”
![Page 12: BSC Slides v - riscv.org · 5/16/2018 · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores](https://reader036.vdocument.in/reader036/viewer/2022081523/5fcdb77a41799933e73cb777/html5/thumbnails/12.jpg)
Total peak performance
13,7 Pflops/s
12 times more powerful than
MareNostrum 3
![Page 13: BSC Slides v - riscv.org · 5/16/2018 · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores](https://reader036.vdocument.in/reader036/viewer/2022081523/5fcdb77a41799933e73cb777/html5/thumbnails/13.jpg)
3456 nodes
394 TB RAM
48 racks 72 nodes/rack 165 888 cores
3240 thin(2GB/core)
216 fat (8GB/core)
155 520 cores
10 368 cores
830 TB SSD
1.5 Mwatt (not to exceed)
2 x Intel Platinum, 24 cores, 2.1GHz, 32 flops/cycle, 512 AVX
General Purpose Cluster Rpeak: 11.15 Pflops HPL: 6.47 Pflops* (16th) HPCG: 0.122 Pflops* (15th)
Network: OPA, Full fat tree no-contention
![Page 14: BSC Slides v - riscv.org · 5/16/2018 · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores](https://reader036.vdocument.in/reader036/viewer/2022081523/5fcdb77a41799933e73cb777/html5/thumbnails/14.jpg)
Emerging Technology Cluster, POWER9 Rpeak: 1.57 Pflops
54 nodes
27 TB RAM
3 racks
345 TB NVME
105 Kw*
2 x Power9, 20 cores, 2.0GHz, (2.87GHz Turbo) 4 x Volta GPU, NVLINK 2.0, 16 GiB 2 x NVMe 3.2 TB 512 GB 2 x 1.9 GB SSD
Network: EDR, Full fat tree no-contention
![Page 15: BSC Slides v - riscv.org · 5/16/2018 · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores](https://reader036.vdocument.in/reader036/viewer/2022081523/5fcdb77a41799933e73cb777/html5/thumbnails/15.jpg)
HPC Storage
Disk storage total usable capacity of 14 PB Write: 126 GB/s Read: 203 GB/s GPFS – Spectrum Scale
7 x ESS GL6 2 x IBM Power System 822L
6 x DCS3700 JBOD expansions
348 x 8 TB NL-SAS , total 19.4 PB raw
2x Metadata block 2 x IBM Power System 822L
2 x Flash System V900
Total 228 TB
![Page 16: BSC Slides v - riscv.org · 5/16/2018 · MareNostrum 3 . 3456 nodes 394 TB RAM 48 racks 72 nodes/rack 165 888 cores 3240 thin(2GB/core) 216 fat (8GB/core) 155 520 cores 10 368 cores](https://reader036.vdocument.in/reader036/viewer/2022081523/5fcdb77a41799933e73cb777/html5/thumbnails/16.jpg)
Enjoy MareNostrum and Barcelona
8/05/2018