Meeting of the Technical Steering Committee (TSC) Board

Tuesday, July 10th 201811:00am ET

http://openhpc.community

2

Meeting Logistics

• https://zoom.us/j/556149142

• United States : +1 (646) 558-8656 -Meeting ID: 556 149 142

3

Antitrust Policy Notice

• Linux Foundation meetings involve participation by industry competitors, and it is the intention of the Linux Foundation to conduct all of its activities in accordance with applicable antitrust and competition laws. It is therefore extremely important that attendees adhere to meeting agendas, and be aware of, and not participate in, any activities that are prohibited under applicable US state, federal or foreign antitrust and competition laws.

• Examples of types of actions that are prohibited at Linux Foundation meetings and in connection with Linux Foundation activities are described in the Linux Foundation Antitrust Policy available at http://www.linuxfoundation.org/antitrust-policy. If you have questions about these matters, please contact your company counsel, or if you are a member of the Linux Foundation, feel free to contact Andrew Updegrove of the firm of Gesmer Updegrove LLP, which provides legal counsel to the Linux Foundation.

3

4

Agenda

• TSC selection for 2018-2019 is complete:

- welcome new members!• Chris Downing, Red Oak Consulting• Chris Simmons, UT Dallas• Michael Karo, Altair• Takayuki Okamoto, Fujitsu• Kevin Pedretti, Sandia National Laboratory• Paul Peltz, Los Alamos National Laboratory

- administrative note: TSC meeting slides get posted on github wiki:

https://github.com/openhpc/ohpc/wiki/Technical-Steering-Committee-Meetings

- first item of business: collect nominations for Project Lead• current TSC nominations: please send nominations for Project Lead to Jeff by Wednesday July 18, 2018• propose to complete voting by Monday, July 30, 2018.

• Follow up from previous meetings:

✓ %changelog sections in .spec files have been wiped out on v1.3.6 branch

✓ gcc 8.1 initial builds look ok, proceeding further with gcc8 variant

• Delimiter addition to RPM release string• SC’18 BoF submission• Review Cycle• Updated access stats• Hyperion Research draft question review

4

5

Follow up: Adding ohpc delimiter to package release numbering• Recall from previous discussion on RPM release numbering:- by default, OBS takes ownership of managing the release tag numbering (it bumps it up

when there are source changes or when an upstream package change triggers a rebuild)

- Release: <CI_CNT>.<B_CNT>

• Have tested updating the schema in OBS to append string of our choosing that maps to a given release branch:

• Confirm we are content with resulting RPM name examples as follows (release strings highlighted in orange):

5

# Add release tag attributeRelease: <CI_CNT>.<B_CNT>.ohpc.1.3.6

mpich-gnu8-ohpc-3.2.1-6.1.ohpc.1.3.6.x86_64.rpmohpc-warewulf-1.3.6-2.1.ohpc.1.3.6.x86_64.rpmohpc-slurm-server-1.3.6-2.1.ohpc.1.3.6.x86_64.rpmgnu8-compilers-ohpc-8.1.0-8.2.ohpc.1.3.6.x86_64.rpmopenmpi3-gnu8-ohpc-3.1.0-7.1.ohpc.1.3.6.x86_64.rpm

6

SC’18 BoF Submission

• Submissions are due July 31, 2018

• What we need:- Title: OpenHPC Community BoF- Additional Session Organizers:- Topic Area- Session Format- Amount of Time Requested

• 1 or 1.5 hours?

- Expected Attendance• 150

- Keywords (3):• system administration, community

HPC stack, development/runtime environments

- Abstract (100 words), Long Description (500 words)• propose to reuse what we had last time….

6

7

Review Cycle #7

• The deadline for next round of submissions just passed on July 6th

• Overview of process for new TSC members:- we have been reviewing submissions on

a roughly quarterly basis

- separate github repo for taking community requests:

https://github.com/openhpc/submissions

- minimum of 5 reviewers needed per submission• component development reps• end-user site reps• at least 3 others

- process overview:

https://docs.google.com/document/d/1po_yd-QvZJSIXYZ0fRo-IqyoQQIJkBQiQVqzilG-Tsw

• Normally, this would be the time when we would ask for review volunteers, however this is the first review cycle in which there were no new submissions

• Next submission deadline? September 30, 2018

7

8

Hyperion Research – OpenHPC survey

• Recall from previous meetings the intent to initiate an OpenHPC focused survey with Hyperion Research

• TSC and others submitted some draft motivation/questions and governing board approved funding to move forward with a “pulse study”- Respondents should be able to complete the q'aire in about 10 minutes.- No open-ended questions, with rare exceptions

• Have now received first draft of questions- let’s walk thru and I can take feedback to group coordinating with Hyperion- my initial take is that it doesn’t include much of the specific technical questions

we highlighted; believe there is room for 5-6 more questions….

8

OBJECTIVESBetter understand: • OpenHPC users• OpenHPC awareness (extent, depth) and perceptions• OpenHPC usage and satisfaction• OpenHPC preferences for the futureTARGET RESPONDENTS:• HPC data center managers• HPC users• HPC OEMs

9

Hyperion Research – OpenHPC survey (draft)

9

Q1: Does your organization (or those you sell to) use or sell high performance computing (HPC) server systems, either on premise on in a public cloud environment?

a. Yes [GO TO NEXT QUESTION] àb. No [END SURVEY / THANK RESPONDENT]c. Not sure/don't know [END SURVEY / THANK RESPONDENT]

Q2: Which of these categories best describes your own role? a. HPC data center manager or staff memberb. Government userc. Industrial/commercial userd. Academic usere. HPC system vendor (OEM)f. Other

Q3: (USERS ONLY) Which market segment best fits your organization?a. Academia/universityb. Bio-science/healthcarec. Commercial business (enterprise IT)d. Computer-aided design (CAD)e. Computer-aided engineering (CAE)f. Digital content creation & distributiong. Electronic design & analysis (EDA)h. Financial servicesi. Geosciencesj. Government labs/research centersk. National defensel. Weather forecasting/climate modelingm. Vendor-hardwaren. Vendor-softwareo. Not sure/don't know

Q4: Where does your organization (or those you sell to) use HPC systems?

a. Only on-premise b. Only in a public cloudc. Both on-premise and in a public cloudd. Not sure/don't know

Q5: What is the largest HPC server system your organization (or those you sell to) has access to? (Choose ONLY ONE)

a. Small cluster (<100 nodes)b. Medium cluster (100-1000 nodes)c. Large cluster (>1000 nodes)d. Not sure/don’t know

Q6: Which type of CPU is preferred by your organization (or those you sell to)? (Choose ONLY ONE)

a. x86-64b. aarch64c. ARM64d. IBM POWERe. Otherf. Not sure/don’t know

Q7: Which operating system is preferred by your organization (or those you sell to)? (Choose ONLY ONE)

a. CentOS or other open-source Linux distributionb. Red Hat Enterprise Linux (RHEL)c. SUSE Linux Enterprise Server (SLES)d. Windowse. Otherf. Not sure/don't know

perhaps identify Debian based distro?

??? pick one

sites may have multi, do we want to know what they are interested in supporting, or what they prefer?

why is this “USERS ONLY”?

10

Hyperion Research – OpenHPC survey (draft)

10

Q8: How familiar are you with OpenHPC?a. Very familiarb. Somewhat familiarc. Not familiar at all

Q9: In your opinion, which of these phrases best describes OpenHPC? (Choose ONLY ONE)

a. An open-source operating systemb. A collection of open-source software for deploying and

managing clustersc. An open-source job schedulerd. Not sure/don't know

Q10: How important is it for OpenHPC to exist?a. Very importantb. Somewhat importantc. Somewhat unimportantd. Very unimportante. No opinion

Q11: What do you think is the status of OpenHPC today?a. Not available yet b. Available but not very comprehensivec. Available and fairly comprehensived. Not sure/don't know

Q12: Which of these components do you think OpenHPCincludes? (Choose ALL that apply)

a. Provisioning toolsb. Resource management toolsc. I/O clientsd. Development toolse. Scientific librariesf. Cloud-bursting toolsg. Not sure/don't know

Q13: Which of the same software tools is most important to you (or those you sell to)? (Choose ONLY ONE)

a. Provisioning toolsb. Resource management toolsc. I/O clientsd. Development toolse. Scientific librariesf. Cloud-bursting toolsg. Not sure/don't know

Q14: Which of these best fits the needs of your organization (or those you sell to)? (Choose ONLY ONE)

a. Free open-source cluster management software, not supported by a vendor

b. Paid open-source cluster management software, supported by a vendor

c. A vendor's non-open-source cluster management softwared. Othere. Not sure/don't know

be consistent with changes to Q12

not sure where cloud-bursting came from. Perhaps augment with performance analysis tools and containerization tools?

11

Hyperion Research – OpenHPC survey (draft)

11

Q15: Which factor is MOST IMPORTANT in a software distribution for your organization (or those you sell to)? (Choose ONLY ONE)

a. Ease of use b. Functionality c. Comprehensivenessd. Affordabilitye. Otherf. Not sure/don't know

Q16: Which type of user interface is preferred by your organization (or those you sell to)? (Choose ONLY ONE)

a. Command line interfaceb. GUIc. Not sure/don't know

Q17: How OFTEN does your organization (or those you sell to) customize software developed externally? (Choose ONLY ONE)

a. Alwaysb. Oftenc. Seldomd. Nevere. Not sure/don't know

Q18: How HEAVILY does your organization (or those you sell to) customize software developed externally? (Choose ONLY ONE)

a. Very heavilyb. Moderatelyc. Very lightlyd. Not at alle. Not sure/don't know

Q19: What new release rate for cluster management software is preferred by your organization (or those you sell to)? (Choose ONLY ONE)

a. Once a yearb. Twice a yearc. Four times a yeard. No specific rate – whenever something important is addede. Not sure/don't know

Q20: How does your organization (or those you sell to) prefer to engage with the HPC community? (Choose ONLY ONE)

a. Emailb. IM (instant messaging)c. GitHubd. Slacke. Otherf. No single preference – it variesg. Not sure/don't know

do we gain much with these two Q’s?

12

Hyperion Research – OpenHPC survey (draft)

12

Q (users): How do you access OpenHPC builds?Q (users): Rate your satisfaction with OpenHPC installation recipes?Q (users): Rate your satisfaction with ability to perform upgrades with newer OpenHPC releases?Q (users): Are you aware of or have you used:• test-suite• source RPMs• binaries for multiple architectures• mechanism to request additional software• public email list• containerization options

Q (general): How important is it to adopt/support the latest versions of upstream releases?Q (general): Does your site prefer stateful of stateless provisioning

• Thoughts/discussion?- initial draft does not seem to ask questions specific to existing

users and their experience(s)- could suggest inclusion of questions specifically for users- potential q’s to revisit based on our previous discussions