workload management system + logging & bookkeeping installation and configuration

*Rabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011OutlineBrief introduction to WMS, LBBefore installationPreliminaries steps : Preparing the Linux machineInstalling the Middleware 3.1 Step 0 : Repository settings Step 1 : WMS and LB installation Step 2 : Yaim Configuration of installed servicesTesting of installed services

Algiers, Joint EPIKH/EUMEDGRID-Support Site Admin Tutorial, 27.06.2010

*Rabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011gLite Grid WM service : WMS


The Workload Management System (WMS) is the gLite service that allows users to submit jobs, and performs all tasks required to execute them, without exposing the user to the complexity of the Grid.The workload manager (WM) is the principal component in the WMS.Purpose of the Workload Manager (WM) is to accept and satisfy requests for job management coming from its clientsThe WM hands over the job to an appropriate Computing Element (CE) for execution taking into account requirements and the preferences expressed in the job description.

*Rabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011gLite Grid WM service : WMS


The Logging and Bookkeeping service (LB) tracks jobs in terms of event (important points of job life, e.g. submission, finding a matching CE, starting execution etc.) gathered from various WMS components as well as CEs.L&B collects informations about all important events in the Grid job lifetransitions between components or services (WMS components)results of matching and brokeragewaiting in queue systemsstart and end of execution

*Logging and Bookkeeping service (LB) Rabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011


The instructions provided in this presentation assume that you are going to use a machine with Scientific Linux 4.8 i386 32 bit installed. Virtual Machine image (GILDA VM Base_SLC4.8_i386) available at: https://gilda.ct.infn.it/VirtualServices.htmlWe will install a 3.1 Middleware version 32 bitThe YUM package manager is considered the default installation toolThe Yaim is a tool to configure the middleware Grid servicesFor this TEST installation: we are going to configure a VO Eumed*Before installationRabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011


Check that you have a valid hostnamepublic IP address with forward and reverse DNS resolution

to edit the hostname (must be root)

Network Time Protocol settings

to edit the hostname (must be root)

and configure the service to start at boot*Preparing the Linux machineRabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011bash# hostname -fbash# vi /etc/hostsbash# hostname bash# domainname bash# yum install ntp ybash# /etc/init.d/ntpd stopbash# ntpdate #retype it more timesbash# /etc/init.d/ntpd startbash# chkconfig ntpd on


To login to the VM you can use the winscp then open a terminal and write the password

Password: grid2011*Rabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011


Specify the mrepo host: export MREPO=http://repo.magrid.ma/yumrepo/glite31Configure the repository as follows:REPOS="dag glite-GENERIC lcg-CA jpackage glite-WMS glite-LB"Get repositories with:for name in $REPOS; do wget $MREPO/$name.repo -O /etc/yum.repos.d/$name.repo; done

*Step 0: Repository settingsRabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011


*Step 0: Repository settingsRabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011Repository description file sample (check it)


Modify the glite-GENERIC.repo as following: (vi /etc/yum.repos.d/glite-GENERIC.repo)## gLite generic repositories#[glite-generic]name = gLite 3.1 generic baseurl = $basearch enabled = 1protect = 0[glite-generic_updates]name = gLite 3.1 generic updates baseurl = http://repo.magrid.ma/mrepo/glite_sl4-$basearch/RPMS.generic-updates/enabled = 0protect = 0*Some ModificationsRabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011


Then update your host: yum clean all

Install CAs onALLprofiles: yum install ca-policy-egi-core -y

Install jdk:yum install jdk*YUM installRabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011


Install via YUM, the WMS and LB metapackages:yum install glite-WMS yyum clean allyum install glite-LB yMove the host certificate provided you by the CA to the right path /etc/grid-security

Give them the right UNIX permissions

All nodes, except UI, WN and BDII-Site require the host certificate/key files to be installed. Please Contact your national Certification Authority (CA) to understand how to obtain a host certificate

*Step 1: WMS and LB installationRabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011


Move the host cert to the right pathmv /root/pcXXcert.pem /etc/grid-security/hostcert.pemmv /root/pcXXkey.pem /etc/grid-security/hostkey.pemGive them the right permissionschmod 400 /etc/grid-security/hostkey.pemchmod 644 /etc/grid-security/hostcert.pem

[root@pc25 ~]# ll /etc/grid-security/total 32drwxr-xr-x 2 root root 20480 May 27 12:08 certificates-rw-r--r-- 1 root root 887 May 16 10:02 hostcert.pem-r-------- 1 root root 887 May 16 10:02 hostkey.pemdrwxr-xr-x 2 root root 4096 May 27 11:21 vomsdirNote !!! ImportantInstall the eumed voms certificate in /etc/grid-security/vomsdir/wget ftp://repo.magrid.ma/pub/WMS/voms-02.pd.infn.it.pem

*Host cetificatesRabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011


*site-info.defRabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011All the configuration samples files are located in /opt/glite/yaim/examples/siteinfo directoryits better to make a copy of the original files

Open your own site-info.def and customize it:

Copy the eumed profiles inside default ones:vi /opt/glite/yaim/etc/siteinfo/site-info.defmkdir /opt/glite/yaim/etc/siteinfo/cp /opt/glite/yaim/examples/siteinfo/site-info.def /opt/glite/yaim/etc/siteinfo/site-info.defcp /opt/glite/yaim/examples/siteinfo/users.conf /opt/glite/yaim/etc/siteinfo/users.confcp /opt/glite/yaim/examples/siteinfo/groups.conf /opt/glite/yaim/etc/siteinfo/groups.conf


*Step 2: Yaim configuration YAIM generic configuration variablesINSTALL_ROOT=/optMYSQL_PASSWORD=secretPX_HOST=myproxy.ct.infn.itWMS_HOST=pcXX.magrid.maSITE_NAME=Grid-SchoolSITE_EMAIL=admin@mailGLITE_LOCATION_LOG=/var/log/gliteVOS= "eumed" Add eumed here########## eumed ##########VO_EUMED_SW_DIR=$VO_SW_DIR/eumedVO_EUMED_DEFAULT_SE=$SE_HOSTVO_EUMED_STORAGE_DIR=$CLASSIC_STORAGE_DIR/eumedVO_EUMED_VOMS_SERVERS="'vomss://voms2.cnaf.infn.it:8443/voms/eumed?/eumed' 'vomss://voms-02.pd.infn.it:8443/voms/eumed?/eumed'"VO_EUMED_VOMSES="'eumed voms2.cnaf.infn.it 15016 /C=IT/O=INFN/OU=Host/L=CNAF/CN=voms2.cnaf.infn.it eumed' 'eumed voms-02.pd.infn.it 15016 /C=IT/O=INFN/OU=Host/L=Padova/CN=voms-02.pd.infn.it eumed'"VO_EUMED_VOMS_CA_DN="'/C=IT/O=INFN/CN=INFN CA' '/C=IT/O=INFN/CN=INFN CA'"VO_EUMED_WMS_HOSTS="pcXX.magrid.ma"Rabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011


WMS, LB specific configuration variables

WMS Pre configuration

LB Pre configuration

Configure WMS and LB via YAIM*Step 2: WMS, LB Yaim configurationRabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011# Hostname of the WMSWMS_HOST=pcXX.magrid.maLB_HOST=pcXX.magrid.mabash# vi /services/glite-wmsLB_HOST= "pcXX.magrid.ma:9000"GLITE_WMS_LCGMON_FILE= "/var/log/wms_logmon.log"bash# vi /opt/glite/etc/LB-super-user/C=MA/O=MaGrid/OU=CNRST/CN=pcXX.magrid.mabash# >/site-info.def n glite-WMS n glite-LB/opt/glite/yaim/bin/yaim c s

*Testing WMS-LB Rabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011


*Testing WMS, LB from a UIRabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011From your user interface:Voms-proxy-init voms eumedexport gLITE_WMS_WMPROXY_ENDPOINT=https://pc25.magrid.ma:7443/glite_wms_wmproxy_serverSubmit a job


*ReferencesRabat, Joint EPIKH/EUMEDGRID Support Site Admin 31.05.2011


****************

workload management system + logging & bookkeeping installation and configuration

Documents