openhpc introduction
TRANSCRIPT
OpenHPC Introduction
Adrian ReberCentOS Dojo CERN 2018October 19
What is OpenHPC?
2 CENTOS DOJO CERN 2018
Software Repository
3 CENTOS DOJO CERN 2018
yum and zypper
4 CENTOS DOJO CERN 2018
CentOS 7 and SLES 12
5 CENTOS DOJO CERN 2018
x86_64 and aarch64
6 CENTOS DOJO CERN 2018
Why OpenHPC?
7 CENTOS DOJO CERN 2018
Multiple Compilers
8 CENTOS DOJO CERN 2018
Multiple MPIs
9 CENTOS DOJO CERN 2018
Three compilersTwo versions each
Already six permutations
10 CENTOS DOJO CERN 2018
Six compiler permutationsThree MPIs
Two versions eachAlready 36 permutations
11 CENTOS DOJO CERN 2018
Common setup formany HPC sites
12 CENTOS DOJO CERN 2018
What is OpenHPC?
13 CENTOS DOJO CERN 2018
Community effort toreduce duplication
14 CENTOS DOJO CERN 2018
OpenHPC: Mission and Vision
Vision: OpenHPC components and best practices will enable and accelerateinnovation and discoveries by broadening access to state-of-the-art, open-sourceHPC methods and tools in a consistent environment, supported by a collaborative,worldwide community of HPC users, developers, researchers, administrators, andvendors.
15 CENTOS DOJO CERN 2018
OpenHPC: Mission and Vision
Mission: to provide a reference collection of open-source HPC softwarecomponents and best practices, lowering barriers to deployment, advancement,and use of modern HPC methods and tools.
16 CENTOS DOJO CERN 2018
OpenHPC: Current Project Members
17 CENTOS DOJO CERN 2018
OpenHPC: Current TSC Members• Reese Baird, Intel (Maintainer)• Brayford, LRZ (Maintainer)• Coulter, Indiana University (End-User/Site Representative)• Chris Downing, Red Oak Consulting (Maintainer)• Craig Gardner, SUSE (Maintainer)• Renato Golin, Linaro (Testing Coordinator)• Michael Karo, Altair (Maintainer)• Janet Lebens, Cray (Maintainer)• Thomas Moschny, ParTec (Maintainer)• Takayuki Okamoto, Fujitsu (Maintainer)• Kevin Pedretti, Sandia National Laboratory (Maintainer)• Paul Peltz, Los Alamos National Laboratory (Maintainer)• Nam Pho, Harvard Medical School (Maintainer)• Cyrus Proctor, Texas Advanced Computing Center (Maintainer)• Adrian Reber, Red Hat (Maintainer)• Karl W. Schulz, UT Austin (Project Lead, Testing Coordinator)• Jeff Schutkoske, Cray (Component Development Representative)• Derek Simmel, Pittsburgh Supercomputing Center (End-User/Site Representative)• Chris Simmons, UT Dallas (Maintainer)• Nirmala Sundararajan, Dell (Maintainer)
18 CENTOS DOJO CERN 2018
Building Blocks: Pick and Choose
20 CENTOS DOJO CERN 2018
OpenHPC: Project History
21 CENTOS DOJO CERN 2018
OpenHPC: Number of Components
v1.0
v1.0.1
v1.1
v1.1.1
v1.2
v1.2.1
v1.3v1.3.1
v1.3.2
v1.3.3 v1.3.4
v1.3.5
40
45
50
55
60
65
70
75
80
85
Jul-15 Jan-16 Aug-16 Mar-17 Sep-17 Apr-18 Oct-18
# of
Com
pone
ts In
clud
ed
22 CENTOS DOJO CERN 2018
OpenHPC: Components Changed
1.8%
33.9%
8.1%
51.6%
4.5%
25.8%
40.9%
31.9%
26.7%
41.6%43.8%
0%
10%
20%
30%
40%
50%
60%
v1.0.1 v1.1 v1.1.1 v1.2 v1.2.1 v1.3 v1.3.1 v1.3.2 v1.3.3 v1.3.4 v1.3.5
% C
ompo
nets
Upd
ated
23 CENTOS DOJO CERN 2018
What is OpenHPC?
24 CENTOS DOJO CERN 2018
Software Repository
25 CENTOS DOJO CERN 2018
Including:Lmod
26 CENTOS DOJO CERN 2018
Including:Provisioning: Warewulf
27 CENTOS DOJO CERN 2018
Including:Provisioning: xCAT
28 CENTOS DOJO CERN 2018
Including:Monitoring: Nagios
29 CENTOS DOJO CERN 2018
Including:Monitoring: Ganglia
30 CENTOS DOJO CERN 2018
Including:Resource Manager: PBS Pro
31 CENTOS DOJO CERN 2018
Including:Resource Manager: Slurm
32 CENTOS DOJO CERN 2018
Including:Compiler: GCC
33 CENTOS DOJO CERN 2018
Including:Compiler: LLVM
34 CENTOS DOJO CERN 2018
Including:Compiler: Intel
35 CENTOS DOJO CERN 2018
Including:Compiler: ARM
36 CENTOS DOJO CERN 2018
Including:MPI: Open MPI
37 CENTOS DOJO CERN 2018
Including:MPI: MVAPICH2
38 CENTOS DOJO CERN 2018
Including:MPI: MPICH
39 CENTOS DOJO CERN 2018
Including:MPI: Intel
40 CENTOS DOJO CERN 2018
Including:EasyBuild
41 CENTOS DOJO CERN 2018
Including:Spack
42 CENTOS DOJO CERN 2018
Including:Charliecloud
43 CENTOS DOJO CERN 2018
Including:Singularity
44 CENTOS DOJO CERN 2018
Including:Lustre Client
45 CENTOS DOJO CERN 2018
Including:BeeGFS Client
46 CENTOS DOJO CERN 2018
Including:Lot’s of different libraries
47 CENTOS DOJO CERN 2018
But not just aSoftware Repository
48 CENTOS DOJO CERN 2018
Excellent DocumentationIncluding Recipes
49 CENTOS DOJO CERN 2018
Each Release iscompletely tested
50 CENTOS DOJO CERN 2018
OpenHPC: Same Interface Everywhere
51 CENTOS DOJO CERN 2018
Some Technical Details
52 CENTOS DOJO CERN 2018
Based on RPM
53 CENTOS DOJO CERN 2018
Tries to avoid Conflicts
# repoquery --whatprovides "libopenblas.so.0()(64bit)”openblas-0:0.2.20-3.el7.x86_64openblas-gnu7-ohpc-0:0.2.20-1.ohpc.x86_64
# repoquery --whatprovides "libltdl.so.7()(64bit)"libtool-ltdl-0:2.4.2-22.el7_3.x86_64libtool-ohpc-0:2.4.6-1.x86_64
54 CENTOS DOJO CERN 2018
RPM ColoringOpenHPC RPMs add ”(ohpc)” color string to shared objects (.so) for ”Provides:”and ”Requires:”:
# cat /usr/lib/rpm/fileattrs/ohpc.attr%__ohpc_provides /usr/lib/rpm/ohpc-find-provides%__ohpc_requires /usr/lib/rpm/ohpc-find-requires %{buildroot} /opt/ohpc
%__ohpc_path ^/opt/ohpc%__elf_exclude_path ^/opt/ohpc
%__ohpc_magic ^ELF (32|64)-bit.*$%__ohpc_flags magic_and_path
55 CENTOS DOJO CERN 2018
RPM Coloring# rpm -q --requires gnu7-compilers-ohpc | egrep “libc.so|libgc”
Without coloring With coloringlibgcc_s.so.1()(64bit) libgcc_s.so.1()(64bit)(ohpc)libgcc_s.so.1(GCC_3.0)(64bit) libgcc_s.so.1(GCC_3.0)(64bit)(ohpc)libgcc_s.so.1(GCC_3.3)(64bit) libgcc_s.so.1(GCC_3.3)(64bit)(ohpc)libgcc_s.so.1(GCC_4.2.0)(64bit) libgcc_s.so.1(GCC_4.2.0)(64bit)(ohpc)
libc.so.6()(64bit) libc.so.6()(64bit)libc.so.6(GLIBC_2.10)(64bit) libc.so.6(GLIBC_2.10)(64bit)libc.so.6(GLIBC_2.11)(64bit) libc.so.6(GLIBC_2.11)(64bit)libc.so.6(GLIBC_2.14)(64bit) libc.so.6(GLIBC_2.14)(64bit)
56 CENTOS DOJO CERN 2018
OpenHPC Home: https://openhpc.community/Primary GitHub Site: https://github.com/openhpc/ohpcBuildsystem: https://build.openhpc.community/Package Repositories: http://build.openhpc.community/OpenHPC:/Component Submission: https://github.com/openhpc/submissionsSystem Registry: System Registration FormCI Infrastructure: http://test.openhpc.community:8080/OpenHPC Wiki: https://github.com/openhpc/ohpc/wikiMailing Lists: https://openhpc.community/support/mail-lists/
57 CENTOS DOJO CERN 2018
THANK YOU