1 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

High Performance Computingon Windows

The Windows Cluster at CCC, RWTH AachenLogin, Using the Batchsystem

Christian Terboven

Center for Computing and CommunicationRWTH Aachen University

2 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Agenda

The Windows-HPC cluster

Login from Windows

Login from Linux

Using the Batchsystem

Short demo: HelloWorld-C-MPI

3 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Agenda

The Windows-HPC cluster

Login from Windows

Login from Linux

Using the Batchsystem

Short demo: HelloWorld-C-MPI

4 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

The Windows-HPC cluster

Name of the interactive machine: cluster-win.rz.rwth-aachen.de

Current interactive machine: winoc45 Sun Fire V40z: quad Opteron, 2.2 GHz, 8 GB Windows Server 2003, Enterprise Edition, 64bit Login node, no jobs are scheduled on this machine

Backup and lab interactive machine: winwcc00 Dell PowerEdge 1950: dual dual-core Woodcrest, 3.0 GHz, 16 GB Windows Server 2003, Enterprise Edition, 64bit Jobs may be scheduled on this machine

Future frontend machine: winctc00 Dell Power Edge 1950, dual quad-core Clovertown, 2.7 GHz, 16 GB Windows Server 2003, Enterprise Edition, 64bit Login node, no jobs are scheduled on this machine

Switch of the frontend machines in about two weeks or so

5 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

The Windows-HPC cluster

Cluster management node: winoc48

Compute nodes: winoc46, winoc47, winoc48 Sun Fire V40z: quad Opteron, 2.2 GHz, 8 GB Windows Compute Cluster Server 2003, 64bit

Compute nodes: winctc01, winctc02, winctc03 Dell PowerEdge 1950: dual quad-core Clovertown, 2.7 GHz, 16 GB Windows Compute Cluster Server 2003, 64bit InfiniBand network

Development software Visual Studio 2005, SP1 Intel C/C++ and FORTRAN compilers, version 9.1 / 10.0 beta Microsoft Compute Cluster Pack (Microsoft MPI)

6 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

The Windows-HPC cluster

Development software (contd) MPICH2 Intel VTune Performance Analyzer Intel Threading Tools: Thread Checker + Thread Profiler Intel Threading Building Blocks Intel Math Kernel Library (MKL)

Selected ISV applications: Matlab R2006a (64bit) Maple 10 Altair HyperView MSC Marc Mentat Fluent 6.2.16

7 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

The Windows-HPC cluster

Other software Microsoft Office 2003, StarOffice 8 Other development software: MSDN, .NET, Windows SDK, SSH-Client, X-Win 32, cygwin

File infrastructure: The My Documents folder is mapped to

H:\Eigene_Dateien\Win-HPC\ Unix $HOME is exported as \\vfsc4\userid and mounted as H:

during interactive login Unix $WORK is exported as \\vfsc5\work and mounted as W:

during interactive login Batchjobs need to mount H: and W: explicitly, or use the path

expression to access the directories Scratch filesystem $TMP / $TEMP is on local disc

8 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Agenda

The Windows-HPC cluster

Login from Windows

Login from Linux

Using the Batchsystem

Short demo: HelloWorld-C-MPI

9 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Login from Windows

Use the Remote Desktop Connection program, probably availableunder Accessoires Communication.

Specify the computer name, in general cluster-win.rz.rwth-aachen.de. Throughout the lab tomorrow, we will use separate machines.

You can save a set of settings undera named profile / link.

10 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Login from Windows

You can choose a resolution orfullscreen mode.

You can choose the color depth.

In fullscreen mode you should setthis flag for easier handling of theremote desktop window.

11 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Login from Windows

Take resources of your localcomputer with you:

Audio device

Printer Clipboard Local hard disc drives Locally mounted network drives

12 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Agenda

The Windows-HPC cluster

Login from Windows

Login from Linux

Using the Batchsystem

Short demo: HelloWorld-C-MPI

13 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Login from Linux

Use the rdesktop program available from www.rdesktop.org, probably already included in your distribution.

Basic usage: rdesktop [options] host with -u : Login as user -d WIN-HPC: Login to domain WIN-HPC -g WxH: Use resolution Width x Height -f: Use fullscreen resolution -a 24: Use 24bit color depth -k de: Use german keyboard layout -r sound:local: Play sound on local system

14 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Login from Linux

Important: choose WIN-HPC domain

as the login to other domains will fail.

15 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Agenda

The Windows-HPC cluster

Login from Windows

Login from Linux

Using the Batchsystem

Short demo: HelloWorld-C-MPI

16 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Using the Batchsystem

The Compute Cluster Job Manager is a GUI program to manage jobsof the Batchsystem, find it under All Programs Microsoft ComputeCluster Pack Compute Cluster Job Manager.

It is only possible to influence your ownjobs!

Show Filter: All Jobs Active Jobs Finished Jobs Failed Jobs Cancelled Jobs

17 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Using the Batchsystem

To submit a new Job choose File Submit Job. You are free to choose a Job Name

and a Project Name as you like.

In the not too far future, we mayevaluate the Project Name field to control resource allocation.

18 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Using the Batchsystem

Several options can be set for a Job. You have to specify the number of

processors your job needs. You may estimate the runtime for

your Job, but you are not requiredto do so.

Currently, there is not runtime limitfor a Job / Task. We may introducethat in the future (24h or so).

Problem without runtime limit: Malfunctioning jobs may be

overlooked. We cannot save Jobs from

dying in case of systemmaintenance.

19 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Using the Batchsystem

A Job consists of one or more Tasks. Tasks are the executable pieces of

a job. You can freely choose a Task Name.

For Command Line you can specifythe full path to a program includingprogram options or to a .bat or.cmd file.

You have to use \\vfsc4\useridinstead of H: and \\vfsc5\workinstead of W: throughout your Job.

For MPI Tasks just include mpiexecin the Command Line, do notspecify any other options.

20 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Using the Batchsystem

Several options can be set for a Task. Tasks are not allowed to use GUI

elements. You can specify Standard Input,

Standard Output and Standard Error for a Task, as well as theWorking Directory.

Using Task Dependencies you candefine an order in which Taskshave to be executed.

In the Environment register, youcan set environment variables for a Task, e.g. OMP_NUM_THREADS forOpenMP Tasks.

21 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Using the Batchsystem

A dedicated machine can be specified for a Job / for Tasks. If you do not need a special

machine just leave Use anyavailable nodes option set.

Problem for Shared-Memoryparallel Jobs: if you specify nprocessors, the assigned nprocessors may be distributedamong several machines.

Planned feature: If you specifyOpenMP in Project Name, wewill take care of finding nprocessors on one machine.

22 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

Agenda

The Windows-HPC cluster

Login from Windows

Login from Linux

Using the Batchsystem

Short demo: HelloWorld-C-MPI

23 HPC on Windows - 2007 Center forComputing and Comm unication

CCC

End of this part

Questions?