![Page 1: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/1.jpg)
![Page 3: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/3.jpg)
UPPMAX
Uppsala Multidisciplinary Center for Advanced Computational Science
http://www.uppmax.uu.se
2 clusters Tintin, 160 nodes à 16 cores (64GB RAM) Milou, 208 nodes à 16 cores (128GB RAM)
17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM))
~7 PB fast parallel storage
![Page 4: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/4.jpg)
UPPMAX
The basic structure of supercomputer
![Page 5: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/5.jpg)
UPPMAX
The basic structure of supercomputer
![Page 6: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/6.jpg)
UPPMAX
The basic structure of supercomputer
![Page 7: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/7.jpg)
UPPMAX
The basic structure of a supercomputer
Parallel computing is key Not one super fast
![Page 8: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/8.jpg)
UPPMAX
The basic structure of a supercomputer
Parallel computing is key Not one super fast
![Page 9: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/9.jpg)
Queue System
More users than nodes Need for a queue
![Page 10: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/10.jpg)
Queue System
More users than nodes Need for a queue
![Page 11: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/11.jpg)
Queue System
More users than nodes Need for a queue
![Page 12: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/12.jpg)
Queue System
More users than nodes Need for a queue
![Page 13: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/13.jpg)
Queue System
1 mandatory setting for jobs: Who pays for it? (-A)
3 settings you really should set: (default values NOT good)
Where should it run? (-p) (How wide is it? (-n)) How long is it? (-t)
![Page 14: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/14.jpg)
Queue System
Who pays for it? (-A) Only projects can be charged
You have to be a member
This course's project ID: g2016017
-A = account (the account you charge) No default value, mandatory
![Page 15: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/15.jpg)
Queue System
Where should it run? (-p) Use a whole node or just part of it?
1 node = 16 cores 1 hour walltime = 16 core hours = expensive Waste of resouces
Default project size: 2000 core hours
-p = partition (node or core) Default value: core
![Page 16: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/16.jpg)
Queue System
How wide is it? (-n) How much of the node should be booked?
1 node = 16 cores Any number of cores
1, 2, 5, 13, 15 etc
-n = number of cores Default value: 1 Usually used together with -p core
![Page 17: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/17.jpg)
Queue System
How long is it? (-t) Always overestimate ~50%
Jobs killed when timelimit reached Only charged for time used
-t = time (hh:mm:ss) 78:00:00 or 3-6:00:00 Default value: 7-00:00:00
![Page 18: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/18.jpg)
A job?
Job = what happen during the booked time Script file
Start programs Move files and more
![Page 19: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/19.jpg)
Queue System
How to submit a job Write a script (bash)
Queue options Rest of the script
![Page 20: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/20.jpg)
Queue System
How to submit a job Write a script (bash)
Queue options Rest of the script
![Page 21: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/21.jpg)
Queue System
How to submit a job Script written, now what?
![Page 22: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/22.jpg)
SLURM Output
Prints to a file instead of terminal slurm-<job id>.out
![Page 23: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/23.jpg)
SLURM Output
Prints to a file instead of terminal slurm-<job id>.out
![Page 24: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/24.jpg)
SLURM Output
Prints to a file instead of terminal slurm-<job id>.out
![Page 25: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/25.jpg)
Squeue
Shows information about your jobs
squeue -u <user>
![Page 26: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/26.jpg)
Squeue
Shows information about your jobs
squeue -u <user>
![Page 27: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/27.jpg)
Squeue
Shows information about your jobs
squeue -u <user>
jobinfo -u <user>
![Page 28: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/28.jpg)
SSH
Connects to a node
ssh -Y <node name>
![Page 29: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/29.jpg)
SSH
![Page 30: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/30.jpg)
SSH
![Page 31: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/31.jpg)
SSH
![Page 32: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/32.jpg)
Interactive
Books a node and connects you to it
interactive -A <proj id> -p <core or node> -t <time>
![Page 33: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/33.jpg)
Interactive
Books a node and connects you to it
interactive -A <proj id> -p <core or node> -t <time>
![Page 34: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/34.jpg)
Interactive
Books a node and connects you to it
interactive -A <proj id> -p <core or node> -t <time>
![Page 35: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/35.jpg)
Interactive
Books a node and connects you to it
interactive -A <proj id> -p <core or node> -t <time>
Add -n to get more cores if you need more memory
![Page 36: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/36.jpg)
UPPMAX Software
100+ programs installed
Managed by a 'module system' Installed, but hidden Manually loaded before use
module avail - Lists all available modules
module load <module name> - Loads the module
module unload <module name> - Unloads the module
module list - Lists loaded modules
module spider <word> - Searches all modules after 'word'
![Page 37: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/37.jpg)
UPPMAX Software
Most bioinfo programs hidden under bioinfo-tools
Load bioinfo-tools first, then program module
or
![Page 38: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/38.jpg)
![Page 39: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/39.jpg)
UPPMAX Commands
uquota
![Page 40: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/40.jpg)
UPPMAX Commands
projinfo
![Page 41: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/41.jpg)
UPPMAX Commands
projplot -A <proj-id> (-h for more options)
![Page 42: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/42.jpg)
UPPMAX
Summary All jobs are run on nodes through queue system A job script usually consists of
Job settings (-A, -p, -n, -t) Modules to be loaded Bash code to perform actions
Run a program, or multiple programs
More info on UPPMAX homepage http://www.uppmax.uu.se/milou-user-guide
![Page 43: UPPMAX Introduction - GitHub Pages...Milou, 208 nodes à 16 cores (128GB RAM) 17 with 256, 17 with 512 (Bianca, 100 nodes à 16 cores (128GB RAM)) ~7 PB fast parallel storage](https://reader036.vdocument.in/reader036/viewer/2022081621/61277d8801796311062634e3/html5/thumbnails/43.jpg)
Laboratory time! (again)