lcg installation – lcfgng · 2005. 10. 31. · joining lcg • join a vo, probably dteam dteam:...

EGEE is a project funded by the European Union under contract IST-2003-508833

LCG Installation –LCFGng

Peer HasselmeyerGridKa, FZK

GridKa School, 20-23 September 2004

www.eu-egee.org

GridKa School, 21 September 2004 - 2

Outline

• What is LCFGng?• LCFGng Objects• Configurations• RPM Configuration• Node Installation Process• LCFGng Server Installation• EGEE/LCG Administrative

Procedures


Installation Methods

• Manualuseful for small sites (~ 5-10 nodes)

• AutomatedQuattor,Rocks,LCFGng, ...

requires dedicated hardware for installation serverfast installation of nodes, work required to install/maintain installation server


LCFGng

• Local Configuration system next generation• Developed by University of Edinburgh• later on by the EDG (European Data Grid)

project• does two things:

installation (RPMs)configuration

• Client/server architecture: LCFGng server configures an arbitrary number of clients

each client node can have different set up


LCFGng Objects

• Configuration is split into so-called “objects”not like objects in object-oriented programming languagesrather: componentse.g. network object: configures IP addresses etc.

• Objects are distributed among LCFGng server and clients

• Objects consist of three partsdefinitionsvaluesscript


LCFGng Objects

• Object definitionsdefine possible configuration parameter namese.g. servers (object: ntp)

• Parameter valuesassign concrete values to parameterse.g. timehost.fzk.de

• Object scriptenacts actual configuration, e.g.

• creates files from parameters (/var/obj/conf/ntp.conf)• starts external components (/usr/sbin/ntpd)

located in /etc/obj/


LCFGng Objects

LCFGng Server Client

Definition

Values validate XML XML

Script

OS configurationfiles

http

Actions

DB

mkxprof

Usually, youchange only

these


Configurations

• Based on C preprocessoruses #include, #ifdef directives etc.“componentize” configurations with includes

machine A

CEHW X

Globus Monitoring

machine B

BatchSystem M


Configurations

• Basic building block: assignment

notation: object.parameter valuee.g. ntp.servers timehost.fzk.de

• Usually assignment once, reconfiguration:+ntp.servers lcfg.fzk.de

Obj

ect parameter a

parameter b

parameter c

value x

value y

value z


Configurations

• Lists possiblenetwork.interfaces eth0 eth1network.ipaddress_eth0 192.108.45.38network.ipaddress_eth1 10.33.1.138

• List operatorsEXTRA(network.interfaces) eth2PREPEND(network.interfaces,eth2)DELETE(network.interfaces,eth2)


Configurations

• “Human readable” configurations are validated and translated to XML by mkxprof

• XML is transferred from LCFGng server to client via HTTP

• Default configurations for all LCG node types can be downloaded from CERN deployment repository

“just” customize the example configurations


RPM Configuration

• Software packages to be installed defined by list of RPMs

RPM lists handled by C preprocessor#include allows componentization

Globus MonitoringSystem

CE

GridIce Ganglia


RPM Configuration

• Basic building block: RPM namee.g. kernel-smp-2.4.20-30.7.legacy/i686

• Modeled as LCFGng object (updaterpms)points to “master” list, e.g. CEactual RPM lists outside the scope of regular LCFGngmethods!

• RPMs and RPM lists distributed via NFS from LCFGng server

• Lists also downloadable from CERN deployment repository


Node Configuration

• Get default configuration files• Customize them• Call mkxprof

• Installation: boot client node• Reconfiguration: wait

client node notified about configuration changes (rdxprof daemon on client node, log file /var/obj/log/client)changes are automatically enacted by LCFGng objects


Node Installation ProcessBoot a kernel (PXE, DHCP, TFTP)Mount root file system (“LiveOS”, NFS: /opt/local/linux/nginstallroot/7.3)

• Start /etc/rc_installGet network configuration (DHCP)Call /etc/obj/client install

Get LCFGng configuration (XML via HTTP)Synchronize clock (NTP)Mount RPMs and RPM lists (NFS: /opt/local/linux/7.3)

Call /etc/obj/install install• Format harddisk

Install base RPMs• Write configuration (LCFG objects)


Node Installation Process• Reboot (from harddisk)• Call /etc/obj/boot start

/etc/obj/nfsmount: mount RPMs and RPM lists (NFS)/etc/obj/updaterpms: install node specific RPMsWrite configuration (LCFG objects)

• Reboot (from harddisk)

Don’t forget the manual configuration steps (from the installation guide)!


LCFGng Server Services

• DHCP server (PXE, profile URL)• TFTP server (PXE)• NFS server (RPMs and RPM lists)• HTTP server (XML profiles)• NTP server (clock synchronization)


LCFGng Server Requirements

• LiveOS: root file system for first boot• LCFGng object definitions• LCFGng configurations

configurations in XML format

How is all this set up?


“Traditional”LCFGng Server Installation

• Take a machine with installed OS (RH7.3)• Install LCFGng setup packages• Check out an LCG tag, e.g. LCG2_2_0

contains default configuration files and RPM lists

• Download RPMs (updaterep)• Install LCFGng server packages

(lcfgng_server_update.pl)• Build LiveOS (lcfgng_installroot.pl)• Configure network services


Joining LCG

• Nice cluster installed what now?• Subscribe to the LCG rollout mailing list

hopefully done before

• Contact your local ROC (EGEE)maybe your P-site / tier (x-1) center works as well (LCG)send them your registration form (see install notes, appendix G), copy to [email protected]

• Get access to the GOC-DBto enter your resources for monitoring


GOC Monitoring


GOC Database


Joining LCG

• Join a VO, probably dteamdteam: system administrators, supported by all LCG sites

• Have ROC test your systemno agreed certification procedure yet

• Announce availability of resources to rollout list and to CERN deployment support

will put you into “test zone”run additional certification tests on your site


LCFGng Server Installation

• Take a machine with installed OS (RH7.3)• Check out an LCG tag, e.g. LCG2_2_0

contains default configuration files and RPM lists

• Install cg-lcfg-go RPM• Download RPMs (updateRPMCache.pl)

called from cg-lcfg-go -d

• Install LCFGng server packages (cg-lcfg-go -l)

• Build LiveOS (create-nginstallroot-rh73)• Configure network services


Links• LCFGng server installation guide:

http://lcgdeploy.cvs.cern.ch/cgi-bin/lcgdeploy.cgi/lcg2/docs/LCFGng_server_install.txt

• LCG Releases: http://grid-deployment.web.cern.ch/grid-deployment/cgi-bin/index.cgi?var=releases

• LCG configuration repository: http://lcgdeploy.cvs.cern.ch/cgi-bin/lcgdeploy.cgi/

• LCG User Guide: http://lcgdeploy.cvs.cern.ch/cgi-bin/lcgdeploy.cgi/lcg-docs/LCG2UserGuide/LCG-2-Userguide.pdf

All these and more can be found at http://lcg.fzk.de/


Links• Rollout list:

http://www.listserv.rl.ac.uk/archives/lcg-rollout.html• GOC Monitoring:

http://goc.grid-support.ac.uk/gridsite/gocmain/monitoring/• GOC trouble shooting wiki:

http://goc.grid.sinica.edu.tw/gocwiki/TroubleShootingHistory• GridPP support FAQ:

http://www.gridpp.ac.uk/tb-support/faq/

All these and more can be found at http://lcg.fzk.de/

lcg installation – lcfgng · 2005. 10. 31. · joining lcg • join a vo, probably dteam dteam:...

Documents