High Performance Computing ClusterOSCAR

Team MemberJin Wei , Pengfei

Xuan

CPSC 424/624 Project ( 2011 Spring )

InstructorDr. Grossman

Outline

Installation2

Management

3

Security4

Administration5

Backgroud1

?

DIY Supercomputer

HPC = Computer + Network

+ OS + Management

Software

Background Introduction

Clemson Palmetto

12,392 cores92.48 TeraFlops

TOP1:Tianhe-1A (China)

186, 368 cores4,701 TeraFlops

HPC Network Topology

3 Set of NetworksManagementParallel ComputingStorage

Centralized Storage

Installation

Easy ManagementBatch OS installBatch software install

ManagementCluster Management

Partition a cluster into multiple logical computersMaps logical computers (clusters) onto servers (nodes)Multiple independent OS configurationsManages and monitors logical computer (clusters) statusCluster status to management system

Job scheduling and managementManages and monitors operating system instances (nodes)Node status to management system

System Management Management of overall system configuration

Redundant management servers with automatic failoverDesigned to anticipate and tolerate failures

Management Server ManagementAutomatic discovery of server hardwareRemote server control (Power On/Off, Cycle)Scalable fast diskless or data-less booting for large node count systemsServer redundancy and failoverProvides server status to the management system

Network Management Automatic discovery of interconnect hardware

Multiple interconnect fabric topologiesRedundant paths and networksLoad balancing and failoverNetwork status to the management system

Storage Management Scalable root file systems for diskless or data-less nodes Multiple global storage configurations High BW to secondary storage for data and check pointing Provides server status to the management system

Security Control Model

Administration ( C3 Tool Suite ) cexec: executes any standard command on all

cluster nodes e.g. cexec mkdir /tmpckill: terminates a user specified process on all cluster nodes e.g. ckill my_program_abccget: retrieves files or directories from all cluster nodescpush: distribute files or directories to all cluster nodescpushimage: update the system image on all cluster nodes using an image captured by the System Imager toolcrm: remove files or directories from all cluster nodescshutdown: shutdown or restart all cluster nodescnum: returns a node range number based on node namecname: returns node names based on node rangesclist: returns all clusters and their type in a configuration file

'Cluster Command & Control' (C3)

Other Administration Tools

System Installation Suite (SIS) : Install the client nodes. SIS also provides the

database from which OSCAR obtains its cluster configuration information. The main concept to understand about SIS is that it is an image based install tool. An image is basically a copy of all the files that get installed on a client. This image is stored on the server and can be accessed for customizations or updates. You can even chroot into the image and perform builds.

Switcher Environment Manager: Provide a simple mechanism to allow users to

manipulate their environment

References

[1] http://svn.oscar.openclustergroup.org/trac/oscar/

wiki/InstallGuideIntroduction.[2] M.J. Brim, T.G. Mattson, "OSCAR: Open

Source Cluster Application Resources"..[3] B.Luethke, S. Scott and T. Naughton,

"OSCAR Cluster Administration With C3".[4] C3, http://www.csm.ornl.gov/torc/C3

Question?