![Page 1: Blue Waters User Monthly Teleconference · 2014 • software development activities • Computational and Data-Enabled Science & Engineering • Software Structure for Sustained Innovation](https://reader034.vdocument.in/reader034/viewer/2022042411/5f2a9acbd317e03aaf2acad7/html5/thumbnails/1.jpg)
Blue Waters User Monthly Teleconference
2/15/15
![Page 2: Blue Waters User Monthly Teleconference · 2014 • software development activities • Computational and Data-Enabled Science & Engineering • Software Structure for Sustained Innovation](https://reader034.vdocument.in/reader034/viewer/2022042411/5f2a9acbd317e03aaf2acad7/html5/thumbnails/2.jpg)
Agenda
• Utilization • Recent events • Recent changes • Upcoming changes • Blue Waters Data Sharing • 2015 Blue Waters Symposium • NSF Ebola CFP • PUBLICATIONS!
2
![Page 3: Blue Waters User Monthly Teleconference · 2014 • software development activities • Computational and Data-Enabled Science & Engineering • Software Structure for Sustained Innovation](https://reader034.vdocument.in/reader034/viewer/2022042411/5f2a9acbd317e03aaf2acad7/html5/thumbnails/3.jpg)
System Utilization
• Utilization since last BW User Call (January 20)
• Utilization trending downward. We are investigating. 3
![Page 4: Blue Waters User Monthly Teleconference · 2014 • software development activities • Computational and Data-Enabled Science & Engineering • Software Structure for Sustained Innovation](https://reader034.vdocument.in/reader034/viewer/2022042411/5f2a9acbd317e03aaf2acad7/html5/thumbnails/4.jpg)
Recent Issues
• Login node responsiveness • Since CLE 5.2 and Lustre 2.5.1. • Tied to modest loads with high IO. • We are investigating settings and patches.
4
![Page 5: Blue Waters User Monthly Teleconference · 2014 • software development activities • Computational and Data-Enabled Science & Engineering • Software Structure for Sustained Innovation](https://reader034.vdocument.in/reader034/viewer/2022042411/5f2a9acbd317e03aaf2acad7/html5/thumbnails/5.jpg)
Recent Changes
• darshan IO profiling • Enabled 1/20 • See darshan page on the portal.
• Portal User summary page • Multi-project support • Storage use and quotas for online and Nearline
5
![Page 6: Blue Waters User Monthly Teleconference · 2014 • software development activities • Computational and Data-Enabled Science & Engineering • Software Structure for Sustained Innovation](https://reader034.vdocument.in/reader034/viewer/2022042411/5f2a9acbd317e03aaf2acad7/html5/thumbnails/6.jpg)
Upcoming Changes
• CUDA 6.5 – to be determined • Modules
• Cleaning out unused modules and old modules. • Removing deprecated modules: old xt-xyz replaced
with cray-xyz.
6
![Page 7: Blue Waters User Monthly Teleconference · 2014 • software development activities • Computational and Data-Enabled Science & Engineering • Software Structure for Sustained Innovation](https://reader034.vdocument.in/reader034/viewer/2022042411/5f2a9acbd317e03aaf2acad7/html5/thumbnails/7.jpg)
Backfill with TAS
• Watch for maintenance notices or draining for large jobs.
• Realtime chart of backfill opportunities https://bluewaters.ncsa.illinois.edu/why-isn-t-my-job-running#backfill
7
> showbf -f xe -p nid11293 # XE nodes available!Partition Tasks Nodes Duration StartOffset StartDate Geometry!--------- ------ ----- ------------ ------------ -------------- --------!nid11293 3968 124 22:26:53 00:00:00 19:36:01_01/19 8x1x8!nid11293 3968 124 22:45:32 00:00:00 19:36:01_01/19 8x1x8!nid11293 3968 124 23:35:44 00:00:00 19:36:01_01/19 8x1x8!nid11293 1024 32 INFINITY 00:00:00 19:36:01_01/19 2x2x4!
![Page 8: Blue Waters User Monthly Teleconference · 2014 • software development activities • Computational and Data-Enabled Science & Engineering • Software Structure for Sustained Innovation](https://reader034.vdocument.in/reader034/viewer/2022042411/5f2a9acbd317e03aaf2acad7/html5/thumbnails/8.jpg)
Improve job wall clock accuracy
• Topology aware scheduling should reduce run to run variation two ways • Reduces job-job interference • Provides finite set of node allocation shapes
• Picking best performance/shape can further reduce run to run variation.
• Setting accurate wall clock times helps the scheduler reserve nodes for jobs in the future.
8
![Page 9: Blue Waters User Monthly Teleconference · 2014 • software development activities • Computational and Data-Enabled Science & Engineering • Software Structure for Sustained Innovation](https://reader034.vdocument.in/reader034/viewer/2022042411/5f2a9acbd317e03aaf2acad7/html5/thumbnails/9.jpg)
Blue Waters Data Sharing Service
• Prototype service for data sharing. • https://bluewaters.ncsa.illinois.edu/data-sharing • Sharing of data sets from on-line or Nearline /
projects/sciteam/xyz/share using Globus Online or web services (http).
• Metadata includes contact information, description, website, size and count, DOI*.
9
![Page 10: Blue Waters User Monthly Teleconference · 2014 • software development activities • Computational and Data-Enabled Science & Engineering • Software Structure for Sustained Innovation](https://reader034.vdocument.in/reader034/viewer/2022042411/5f2a9acbd317e03aaf2acad7/html5/thumbnails/10.jpg)
2015 Blue Waters Symposium
• May 10-14, 2015 • PI meeting for NSF PRAC teams. • Sunriver Resort in Sunriver, OR • Recreational opportunities: hiking, biking, fly fishing,
rafting, canoeing, rock climbing, … 10
![Page 11: Blue Waters User Monthly Teleconference · 2014 • software development activities • Computational and Data-Enabled Science & Engineering • Software Structure for Sustained Innovation](https://reader034.vdocument.in/reader034/viewer/2022042411/5f2a9acbd317e03aaf2acad7/html5/thumbnails/11.jpg)
NSF: Computing About the Ebola Virus
• Dear Colleague Letter announced November 13, 2014
• software development activities • Computational and Data-Enabled Science &
Engineering • Software Structure for Sustained Innovation
• Petascale computing on Blue Waters • Petascale Computing Resource Allocations
11
![Page 12: Blue Waters User Monthly Teleconference · 2014 • software development activities • Computational and Data-Enabled Science & Engineering • Software Structure for Sustained Innovation](https://reader034.vdocument.in/reader034/viewer/2022042411/5f2a9acbd317e03aaf2acad7/html5/thumbnails/12.jpg)
Blue Waters Internships
• Engage undergraduate students in petascale computing research. The program provides each student a stipend totaling $5000 and a two-week intensive high-performance computing workshop.
• Select students will travel to The Blue Waters Symposium.
• Applications must be submitted by March 20, 2015 • See https://bluewaters.ncsa.illinois.edu/internships
12
![Page 13: Blue Waters User Monthly Teleconference · 2014 • software development activities • Computational and Data-Enabled Science & Engineering • Software Structure for Sustained Innovation](https://reader034.vdocument.in/reader034/viewer/2022042411/5f2a9acbd317e03aaf2acad7/html5/thumbnails/13.jpg)
Request for Science Successes
• We need to be current on products that result from time on Blue Waters such as: • Publications, Preprints (e.g. arXiv.org ), Presentations. • Very interested in data product sharing.
• Appreciate updates sooner than annual reports. • Send to [email protected]
• NSF PRAC teams send information to PoCs. • See the Share Results section of the portal as well. • Be sure to include proper acknowledgment
• Blue Waters - National Science Foundation (ACI 1238993) • NSF PRAC – OCI award number
13
![Page 14: Blue Waters User Monthly Teleconference · 2014 • software development activities • Computational and Data-Enabled Science & Engineering • Software Structure for Sustained Innovation](https://reader034.vdocument.in/reader034/viewer/2022042411/5f2a9acbd317e03aaf2acad7/html5/thumbnails/14.jpg)
Future Topics?
• Please send us your suggestions on topics for future teleconferences / webinars
14