jan 31, 2006 see-grid nis training session hands-on v: standard grid usage dušan vudragović scl...
TRANSCRIPT
Jan 31, 2006
Acad
em
ic a
nd E
ducat ional Gr id Init iat ive o
f Serbia
A E G I S
SEE-GRID Nis Training Session
Hands-on V: Standard Hands-on V: Standard Grid UsageGrid Usage
Dušan VudragovićSCL and ATLAS groupInstitute of Physics, Belgrade
SEE-GRID Nis Training Session
A E G I S
Jan 31, 2006
Getting a proxy certificateGetting a proxy certificate Get onto a machine that understand grid
commands To create proxy
$ voms-proxy-init --voms <vo> To get information about proxy
$ voms-proxy-info To destroy proxy
$ voms-proxy-destroy To create long-term proxy
$ myproxy-init -s <host_name> -d -n To get information about a long-term
$ myproxy-info -s <host_name> –d Deleting a stored long-term proxy
$ myproxy-destroy -s <host_name> -d
SEE-GRID Nis Training Session
A E G I S
Jan 31, 2006
Data menagmentData menagment GUID Grid Unique Identifier
guid:bbffd56a-eff0-4b59-af7b-2a235986001c LFN Logical File Name
lfn:TestFile.dat SURL Storage URL
sfn://castorgrid.cern.ch/castor/cern.ch TURL Transport URL
gsiftp://castorgrid.cern.ch/castor/cern.ch
SEE-GRID Nis Training Session
A E G I S
Jan 31, 2006
Low Level Data Management ToolsChecks the existence of a file or directory on a SE$ edg-gridftp-exists URL
Lists a directory on a SE$ edg-gridftp-ls URL
Creates a directory on a SE$ edg-gridftp-mkdir URL
Renames a file on a SE$ edg-gridftp-rename sourceURL destURL
Removes a file from a SE$ edg-gridftp-rm URL
Removes a directory on a SE$ edg-gridftp-rmdir URL
Copies files between SEs$ globus-url-copy sourceURL destURL
SEE-GRID Nis Training Session
A E G I S
Jan 31, 2006
LCG Data Management Client ToolsCopies a Grid file to a local destinationlcg-cp --vo <vo> <lfn> <file>
Copies a file to a SE and registers the filelcg-cr --vo <vo> -d SURL –l <lnf> <file>
Registers in the the catalog lcg-rf --vo <vo> -l <lfn> <surl>
Unregisters in the the cataloglcg-uf --vo <vo> <guid> <surl>
Gets the GUID for a given LFN or SURL.lcg-lg --vo <vo> <lfn>
Lists the replicas for a given LFN, GUID or SURL.lcg-lr --vo <vo> <lfn>
SEE-GRID Nis Training Session
A E G I S
Jan 31, 2006
Some JDL attributesSome JDL attributes Type
for LCG2 only “Job” type supported JobType
values: “Normal”, “MPICH”, “Interactive”… Executable
command name Arguments
command line arguments StdOutput
file where the job standard output goes StdError
file where the job standard error goes InputSandbox
files for transfer from UI to the WN OutputSandbox
files for transfer from WN to the UI
SEE-GRID Nis Training Session
A E G I S
Jan 31, 2006
Requirements to send a job to a particular CE Requirements = other.GlueCEUniqueID ==
“ce.phy.bg.ac.yu:2119/jobmanager-pbs-seegrid”;
job must run on a CE where a particular experiment software is installed Requirements = Member("VO-atlas-release-11.0.2",
other.GlueHostApplicationSoftwareRunTimeEnvironment);
for MPI jobRequirements = Member("MPICH", other.GlueHostApplicationSoftwareRunTimeEnvironment)
Simple JDL fileExecutable = "/bin/sh";
Arguments = "HelloWorld.sh";
Stdoutput = "stdoutput";
StdError = "stderror";
InputSandbox={"HelloWorld.c","HelloWorld.sh"};
OutputSandbox={"stdoutput","stderror"};
Requirements = other.GlueCEUniqueID ==
“ce.phy.bg.ac.yu:2119/jobmanager-pbs-seegrid”;
SEE-GRID Nis Training Session
A E G I S
Jan 31, 2006
Job submissionJob submission To submit a job
$ edg-job-submit <jdl_file>$ edg-job-submit –o <job_ID_file> <jdl_file>$ edg-job-submit –r <CE_ID> <jdl_file>
Retrieving status of a job$ edg-job-status <job_ID>$ edg-job-status –i <job_ID_file>
Retrieving the output of a job$ edg-job-get-output <job_ID>$ edg-job-get-output –i <job_ID_file>$ edg-job-get-output –dir <path> <job_ID>
Canceling a job$ edg-job-cancel <job_ID>$ edg-job-cancel –i <job_ID_file>
Listing CE that match a job description$ edg-job-list-match <jdl_file>
SEE-GRID Nis Training Session
A E G I S
Jan 31, 2006
Possible job states in the LCG-2
SEE-GRID Nis Training Session
A E G I S
Jan 31, 2006
Information ServiceInformation Service Way to get information relative to the computing
resources for certain VO$ lcg-infosites --vo <vo> ce
To know the status of the storage resources$ lcg-infosites --vo <vo> se
$ lcg-infosites --vo <vo> closeSE To retrieve the tags corresponding to the
software installation of certain VO $ lcg-infosites --vo <vo> tag
To have a list of the supported attributes $ lcg-info --list-attrsto find CEs with OS SL or SLC and list RunningJobs and FreeCPUs on them
lcg-info --list-ce --query "OS=SC*" --attrs 'OS,RunningJobs,FreeCPUs'