lhc, wlcg and alien
TRANSCRIPT
LHC, WLCG and AliEn
Asif OsmanPAKGRID-LCG2 Site Administrator
First School on LHC Physics,(October 12th – 30th, 2009)NCP, Islamabad, Pakistan
Outline
LHCLarge Hadron Collider
WLCGWorldwide LHC Grid
AliEnAlice Analysis Environment for Grid
Particle Physics
To probe into the matter for finding Fundamental constituent particlesFundamental forces that control their behavior
Theory
Tools
Particle AcceleratorsParticle DetectorsComputing Power
The Large Hadron Collider
From LEP to LHC
LEP (end 2000) -> LHC (start 2009)
LHC Accelerators
The LHC Detectors
Optimization Of LHC Detectors (1/2)
ATLAS and CMS are two general-purpose detectors and therefore they are designed to measure the broadest range of signals. Their main goals are to find the Higgs boson and to look for evidence of physics beyond the standard model, such as Super-symmetry, or extra dimensions.
ALICE is optimized for studying heavy ion collisions. The temperature and density at a collision of lead nuclei is expected to be high enough to generate a quark-gluon-plasma. In this phase quarks and gluons are almost free. ALICE will be able to investigate heavy ion collision at an unprecedented particle and energy density.
LHCb's specialty is the b-physics ('B factory'). In particular it will measure the parameters of CP violation in the interactions of b-hadrons.
Optimization Of LHC Detectors (2/2)
THE ALICE DETECTOR
ALICE @ CERN LHC
Typical next generation HEP experiment~1000 scientists in ~100 of institutionsCPU & data intensive simulation & reconstruction
Results in need for heavily distributed processing and event storage Complex analysis of distributed data
Large files (one simulated event up to 2GB)Specific to Alice heavy ion events (but, we have to plan for 1PB/year of p+p data as well)
Many files 10^9 files/year (x n, n>2)
2 PB/year
Castor – CERN Advance Storage Manager
Castor Storage Capacity
Data Replication From Tier-0 to Tier-1 Centers
WLCG Tiers Model
Tier0 and Tier1
Tiers Model (UK)
Tiers Model (Italy)
Preparing Simulated and Experimental Data for Analysis
Physics Model Detector
Monte CarloEvent Generator
Detector Simulation
Digitization
Reconstruction
ESD
AOD
Digitization
Basic Operations (1/2)Each part of each detector is represented in volume
so that at any point in time, during the propagation of a particle inside the detector, a pointer gives the type of material the particle is traversing. An interaction with matter can then be triggered according to the basic law of particle interaction with matter. If the particle is an electron, this can be an ionization or the emission of a photon. Whether the particle is inside an active part of a detector or not, the contribution will or will not be added to the detector’s final signal. So, by following step by step each particle in the 3D representation of the experiment, the simulation package transforms the initial quadri vectors in hits, energy depositions and timing information.
Basic operations (2/2)Then comes the reconstruction program that can
use real or simulated as input. From all the detector data pieces, it reconstructs the full event and rebuilds the original interaction. By comparing the original simulated events and those that have been reconstructed, one can estimate the accuracy and the acceptance of the detectors. By comparing the simulated and the real data, one can check the validity of the underlying physics model. In principle, any difference between the simulated and the experimental data is a signal for new physics, not predicted by the SM: a physics discovery.
If no signal is observed in the experimental data, by comparison with the simulation, one may constrain the proposed GUT’s parameters space to the region yet to be explored or eventually reject some of these models.
Evolution of Workflow
Example of AOD, ESD and Raw Data
AOD Objects and ESD Equivalents
ESD/AODESD : Event Summary Data
Detailed output of reconstructionContains main reconstruction objects, such a EM clusters, track particles, muons, taus, jets…Gives as well list of cells belonging to a cluster, space-points belonging to a track….Thus refinements of combined reco. e.g. particle id, track refitting, jet calibration possible
AOD: Analysis Object DataOnly necessary information to perform most analysis availabledata organised into analysis objects whose classes have physical meaning
Electron, photon, jet, tau, muon, …Also TrackParticle
essential aspect is truth association, which directly links the original Monte Carlo data to the reconstructed objectsAOD is formed from the ESD through the use of AOD BuildersBack-navigation to ESD information possible
Naming Conventions (1/2)
Logical File Name (LFN) An alias created by a user to refer to some item of data e.g. “lfn:cms/20030203/run2/track1”
Site URL (SURL) (or Physical File Name (PFN))
The location of an actual piece of data on a storage system e.g. “srm://pcrd24.cern.ch/flatfiles/cms/output10_1”
Globally Unique Identifier (GUID)
A non-human readable unique identifier for an item of data e.g. “guid:f81d4fae-7dec-11d0-a765-00a0c91e6bf6”
Naming Conventions (2/2)
Logical File Name 1
Logical File Name 2
Logical File Name n
GUID
Physical File SURL n
Physical File SURL 1
Data Storage and Cataloging# Checking the value of LCG_GFAL_INFOSYS# LCG_GFAL_INFOSYS=bdii02.grid.sinica.edu.tw:2170
>export DPM HOST=se.pakgrid.org.pk>export DPNS_HOST=se.pakgrid.org.pk
# Create 10K file>dd if=/dev/zero of=samtest.dat bs=1000 count=0 seek=$[1000*10]>mv samtest.dat /tmp
# CE-sft-lcg-rm-free>ldapsearch -LLL -x -h bdii02.grid.sinica.edu.tw:2170 -b o=grid
'(&(GlueChunkKey=GlueSEUniqueID=se.pakgrid.org.pk)(GlueSAAccessControlBaseRule=ops))' GlueSAStateAvailableSpace
# CE-sft-lcg-rm-cr>lcg-cr -v --vo cms -d se.pakgrid.org.pk file:///tmp/samtest.dat
>dpns-ls -l /dpm/pakgrid.org.pk/home/cms/generated/
# CE-sft-lcg-rm-cp>lcg-cp -v --vo cms lfn:sft-lcg-rm-cr-pakwn1.pakgrid.org.pk.01234XyZtrytest file:///tmp/samtest.dat.cp
# CE-sft-lcg-rm-rep>lcg-rep -v --vo cms -d lxdpm104.cern.ch lfn:sft-lcg-rm-cr-pakwn1.pakgrid.org.pk.01234XyZtrytest
# CE-sft-lcg-rm-del>lcg-del -v --vo cms -a lfn:sft-lcg-rm-cr-pakwn1.pakgrid.org.pk.01234XyZtrytest
Replica Managerclient SRM
ReplicaCatalog
Storage6
2
34
1
1. The Client asks a catalog to provide the location of a file2. The catalog responds with the name of an SRM3. The client asks the SRM for the file4. The SRM asks the storage system to provide the file5. The storage system sends the file to the client through the SRM or 6. directly
5
6
Simplified Interaction Replica Manager - SRM
The HEP EnvironmentHEP collaborations are quite large■ Thousands of collaborators, globally distributedTypically resources are globally distributedResources organized in tiers of decreasing capacityRaw data partitioned between sites, highly processed ready-for analysisData accessible from everywhereComputing resources required when operational■ ~34 Million SpecInt2000■ ~16 PetaBytes of storage ■ ~20 PetaByte of tape■ Distributed across ~57 countries in ~4 continents
Data Management System
Manage Data and Meta-data created/used■ from production, online farm, calibration,
reconstruction, re-processing■ to where its being used for physics
Storage/retrieval of run/time dependent non-event data■ such as calibrations, alignment and configuration
The system of tapes, disk and networksMoving, placing, caching, pinning datasets■ such as calibrations, alignment and configuration
Computer Users (Standalone)
Cluster
Sharing Computing Resources
Batch ProcessingopenPBSCondorLSFetc…
Parallel ComputingMpich2OpenMPIGrid Engineetc...
Hybrid Batch/Parallel
Batch Processing
[cms020@ce ~]$ cat test.pbs#!/bin/sh#PBS -N PBS_EXAMPLE#PBS -l walltime=1:00:00#PBS -l mem=400mbecho "Job Starts..."datehostnamepwdsleep 10echo "Job finished!"date
[cms020@ce ~]$ qsub -q cms test.pbs57442.ce.pakgrid.org.pk[cms020@ce ~]$showqACTIVE JOBS--------------------JOBNAME USERNAME STATE PROC REMAINING STARTTIME57442 cms020 Running 1 1:00:00 Sun Oct 25 20:03:0455926 bio003 Running 1 3:54:32 Thu Oct 22 23:57:3657436 sgmlhb37 Running 1 2:23:59:39 Sun Oct 25 20:02:43
4 Active Jobs 4 of 6 Processors Active (66.67%)
[cms020@ce ~]$ cat PBS_EXAMPLE.o57442Job Starts...Sun Oct 25 20:03:04 PKT 2009wn020-x86-32.pakgrid.org.pk/home/cms020Job finished!Sun Oct 25 20:03:14 PKT 2009
Parallel Computing
WLCG -World Wide LHC GRID
Job and Data Flow
Grid
Alice Analysis Environment Types
LocalAlice StandaloneOn a Single Computer
Cluster PROOF – Parallel Root FacilityMPICH based Cluster of PC Nodes
Grid AliEn – Alice Grid EnvironmentWorld Wide LHC Grid
What is AliEn?Main features
Distributed file catalogue built on top of RDBMS File replica and cache manager with interface to MSS
CASTOR,HPSS,HIS…AliEnFS – Linux file system - uses AliEn File Catalogue and replica manager
SASL based authentication which supports various authentication mechanisms (including Globus/GSSAPI)Resource Broker with interface to batch systems
LSF,PBS,Condor,BQS,…Various user interfaces
command line, GUI, Web portalPackage manager (dependencies, distribution…)Metadata catalogueC/C++/perl/java APIROOT interface (TAliEn)SOAP/Web Services
EDG compatible user interfaceCommon authenticationCompatible JDL (Job description language) based on CONDOR ClassAds
Installation via the AliEn installer
Download the AliEn installer from:wget http://alien.cern.ch/alien-installerchmod ugo+rx alien-installer./alien-installerSelect in the version menu the highest version number with the 'stable' tag and follow the instructions of the installer until you are asked, which packages to install.Select 'gshell - Grid Shell UI' to install the client interface and ROOT to get an AliEn enabled ROOT package and proceed.Note: The installer asks you, where to install the packages. The default location is /opt/alien. To create this directory you need ROOT permissions on that machine. If you are not the administrator of that machine you can only install into your HOME directory or a directory, where you have write permissions.
AliEn Installation (1/2)
AliEn Installation (2/2)
Generating Proxy[batool@ui ~]$ voms-proxy-init -verify --voms aliceYour identity: /C=PK/O=PAEC-1/OU=DCG/CN=Naheed Batoolverify OKCreating temporary proxy .......................... DoneContacting voms.cern.ch:15000 [/DC=ch/DC=cern/OU=computers/CN=voms.cern.ch] "alice" DoneCreating proxy ....................................................... DoneYour proxy is valid until Thu Oct 8 09:38:18 2009
Getting Info About Proxy[batool@ui ~]$ voms-proxy-infosubject : /C=PK/O=PAEC-1/OU=DCG/CN=Naheed
Batool/CN=proxyissuer : /C=PK/O=PAEC-1/OU=DCG/CN=Naheed Batoolidentity : /C=PK/O=PAEC-1/OU=DCG/CN=Naheed Batooltype : proxystrength : 1024 bitspath : /tmp/x509up_u504timeleft : 11:58:45
Switching to AliEn Environment
[batool@ui ~]$ cat ./start.sh#!/bin/shexport PATH=/opt/alien/api/bin:$GLOBUS_LOCATION:$PATHexport PATH=/opt/alien/api/../i686-pc-linux-gnu/4.1.2/bin:$PATHexport LD_LIBRARY_PATH=/opt/alien/i686-pc-linux-gnu/4.1.2/lib/gcc/i686-pc-linux-gnu/4.1.2:$LD_LIBRARY_PATH
[batool@ui ~]$ . ./start.sh
[batool@ui ~]$ aliensh[ aliensh 2.1.18a (C) ARDA/Alice:
[email protected]/[email protected]]aliensh:[alice] [1] /alice/cern.ch/user/b/batool/ >
AliEn commands (gshell)
AliEn some important commands
whoamiclearpwdcdmkdirrmdireditfindlesssubmit
lscpwhereiskillqueuespypackagesdfadd/show/removeTagregisterOutput
Home Directoryaliensh:[alice] [1] /alice/cern.ch/user/b/batool/ >ls -ldrwxr-xr-x batool batool 0 Sep 27 03:10 .analysis.jdldrwxr-xr-x batool batool 0 Sep 27 03:26 .pp.xml-rwxr-xr-x batool batool 1199 Sep 27 03:10 analysis.jdldrwxr-xr-x batool batool 0 Aug 06 07:21 analysisdrwxr-xr-x batool batool 0 Aug 06 11:39 bindrwxr-xr-x batool batool 0 Aug 04 21:43 data-Shahiddrwxr-xr-x batool batool 0 Aug 05 11:20 datadrwxr-xr-x batool batool 0 Aug 06 11:39 jdldrwxr-xr-x batool batool 0 Oct 03 20:24 macrosdrwxr-xr-x batool batool 0 Aug 06 11:39 par-rwxr-xr-x batool batool 264 Sep 27 03:26 pp.xmldrwxr-xr-x batool batool 0 Sep 26 19:41 TutorialOuptutdrwxr-xr-x batool batool 0 Oct 02 06:00 Tutotrialdrwxr-xr-x batool batool 0 Sep 26 12:36 tagsdrwxr-xr-x batool batool 0 Sep 26 09:46 tmpdrwxr-xr-x batool batool 0 Oct 03 19:44 tutorialdrwxr-xr-x batool batool 0 Aug 06 11:39 xml
ALICE Data Repository at CERN SE
aliensh:[alice] [2] /alice/cern.ch/user/b/batool/ >ls -l /alicedrwxr-xr-x admin admin 0 Aug 14 10:06 bindrwxr-xr-x admin admin 0 Aug 14 10:06 cern.chdrwxr-xr-x alidaq alidaq 0 Aug 14 10:06 datadrwxr-xr-x admin admin 0 Aug 14 10:06 jdldrwxr-xr-x peters z2 0 Aug 14 10:06 macrosdrwxr-xr-x admin admin 0 Aug 14 10:06 packagesdrwxr-xr-x admin admin 0 Aug 14 10:06 productiondrwxr-xr-x admin admin 0 Aug 14 10:06 QAdrwxr-xr-x aliprod z2 0 Aug 14 10:06 simdrwxr-xr-x aliprod z2 0 Aug 14 10:06 simulationdrwxr-xr-x admin admin 0 Aug 14 10:06 tagsdrwxr-xr-x alidaq admin 0 Aug 14 10:06 testdatadrwxr-xr-x admin admin 0 Aug 14 10:06 triggers
Simulated Events Data at CERN SE
aliensh:[alice] [3] /alice/cern.ch/user/b/batool/ >ls -l /alice/simdrwxr-xr-x aliprod z2 0 Aug 03 16:17 2006drwxr-xr-x aliprod z2 0 Aug 03 16:17 2007drwxr-xr-x aliprod aliprod 0 Aug 03 16:17 LHC08d10drwxr-xr-x aliprod aliprod 0 Aug 03 16:17 LHC08d11drwxr-xr-x aliprod aliprod 0 Aug 03 16:17 LHC08d12drwxr-xr-x aliprod aliprod 0 Aug 03 16:17 LHC08d13---dwxr-xr-x aliprod aliprod 0 Aug 15 23:14 LHC09b5drwxr-xr-x aliprod aliprod 0 Aug 15 23:15 LHC09b6drwxr-xr-x aliprod aliprod 0 Aug 15 23:16 LHC09b7drwxr-xr-x aliprod aliprod 0 Aug 22 10:27 LHC09b8drwxr-xr-x aliprod aliprod 0 Aug 22 10:29 LHC09b9drwxr-xr-x aliprod aliprod 0 Aug 03 16:17 PDC_07drwxr-xr-x aliprod aliprod 0 Aug 03 16:17 PDC_08drwxr-xr-x aliprod z2 0 Aug 03 16:17 PDC_08adrwxr-xr-x aliprod aliprod 0 Aug 03 16:17 PDC_08bdrwxr-xr-x aliprod aliprod 0 Aug 03 16:17 PDC_09
Real Events Data at CERN SE
aliensh:[alice] [4] /alice/cern.ch/user/b/batool/ >ls -l /alice/data
drwxr-xr-x alidaq alidaq 0 Aug 14 10:06 2006drwxr-xr-x alidaq alidaq 0 Aug 14 10:06 2007drwxr-xr-x alidaq admin 0 Aug 14 10:06 2008drwxr-xr-x alidaq alidaq 0 Aug 14 10:09 2009-rwxr-xr-x alidaq alidaq 998 Aug 14 10:07
OCDBFoldervsRunRange.xmldrwxr-xr-x alidaq alidaq 0 Aug 14 10:06 Reference
Sample Raw Data in .root Filesaliensh:[alice] [6] /alice/cern.ch/user/b/batool/ >ls -l
/alice/data/2009/LHC09c_PHOSdrwxr-xr-x alidaq alidaq 0 Oct 07 18:59 000089050drwxr-xr-x alidaq alidaq 0 Oct 07 18:59 000089051drwxr-xr-x alidaq alidaq 0 Oct 07 19:00 000089053……..aliensh:[alice] [7] /alice/cern.ch/user/b/batool/ >ls -l
/alice/data/2009/LHC09c_PHOS/000089053crwxr-xr-x alidaq alidaq 1825234920 Oct 07 19:00 collectiondrwxr-xr-x alidaq alidaq 0 Oct 07 19:00 rawaliensh:[alice] [8] /alice/cern.ch/user/b/batool/ >ls –l
/alice/data/2009/LHC09c_PHOS/000089053/raw-rwxr-xr-x alidaq alidaq 986878405 Oct 07 19:00
09000089053003.10.root-rwxr-xr-x alidaq alidaq 838356515 Oct 07 19:00
09000089053003.20.root
Packages Tagged at CERN SE
aliensh:[alice] [11] /alice/cern.ch/user/b/batool/ >ls -l /alice/packages/
drwxr-xr-x aliprod z2 0 Aug 03 16:48 AliRootdrwxr-xr-x peters z2 0 Aug 03 16:48 APISCONFIGdrwxr-xr-x admin admin 0 Aug 03 16:48 aliendrwxr-xr-x admin admin 0 Aug 03 16:48 boostdrwxr-xr-x admin admin 0 Aug 03 16:48 cgaldrwxr-xr-x admin admin 0 Aug 03 16:48 fastjetdrwxr-xr-x aliprod z2 0 Aug 03 16:48 GEANT3drwxr-xr-x admin admin 0 Aug 03 16:48 loadgeneratordrwxr-xr-x admin admin 0 Aug 03 16:48 RFMD5CPdrwxr-xr-x aliprod z2 0 Aug 03 16:48 ROOT
Online Control Databasealiensh:[alice] [17] /alice/cern.ch/user/b/batool/ >ls -l
/alice/data//2009/OCDBdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 ACORDEdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 EMCALdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 FMDdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 GRPdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 HLTdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 HMPIDdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 ITSdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 MUONdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 PHOSdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 PMDdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 T0drwxr-xr-x alidaq alidaq 0 Aug 14 10:08 TOFdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 TPCdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 TRDdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 VZEROdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 ZDC
Online Control DatabaseAlignment and Calibration Data
aliensh:[alice] [24] /alice/cern.ch/user/b/batool/ >ls -l /alice/data//2009/OCDB/PHOS
drwxr-xr-x alidaq alidaq 0 Aug 14 10:08 Aligndrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 Calib
aliensh:[alice] [25] /alice/cern.ch/user/b/batool/ >ls -l /alice/data//2009/OCDB/PHOS/Calib/
drwxr-xr-x alidaq alidaq 0 Aug 14 10:08 CpvGainPedestalsdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 EmcBadChannelsdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 EmcGainPedestalsdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 Mappingdrwxr-xr-x alidaq alidaq 0 Aug 14 10:08 RecoParam
Copying Filesfrom CERN SE to Local PCfrom Local to CERN SE
aliensh:[alice][4]/alice/cern.ch/user/b/batool/TutorialOuptut/ >cp sLHC08q.Test.CheckGenCasc.ESD.root
file:sLHC08q.Test.CheckGenCasc.ESD.root[xrootd]Total 0.00 MB|====================|100.00 % [0.0 MB/s]aliensh:[alice][1]/alice/cern.ch/user/b/batool/TutorialOuptut/>cp file:Asif.txt .[xrootd]Total 0.00MB|====================|100.00 %[inf MB/s][batool@ui ~]$ ls -l sLHC08q.Test.CheckGenCasc.ESD.root-rw-r----- 1 batool batool 4960 Oct 3 21:36 sLHC08q.Test.CheckGenCasc.ESD.root===================================
[batool@ui ~]$ ls -l Asif.txt-rw-rw-r-- 1 batool batool 90 Oct 26 19:17 Asif.txtaliensh:[alice] [2] /alice/cern.ch/user/b/batool/TutorialOuptut/>ls -l Asif.txt-rwxr-xr-x batool batool 90 Oct 26 15:18 Asif.txt
The file catalog, where ALICE files will be registered, has the following structure:
Online data: /data/<Year>/<AcceleratorPeriod>/<RunNumber>/Simulated data: /sim/<Year>/<ProductionType>/<RunNumber>/
where:Year: Can take a value like 2007, 2008 etc.AcceleratorPeriod: Can take a value relevant to the LHC period (LHC07a, LHC08b,…)RunNumber: Is the run identifier (0001,...).ProductionType: Gives information about the specific simulation which was run, which includes the conditions applied: Ideal, Full, Residual (PDC06_Residual).It is also foreseen to have several subdirectories where the files will be grouped according to their type. The decided subdirectories are the following:raw/: Storage of raw data.reco/<PassX>/cond/: This will link to the directory where all the calibration and condition files used for this Pass will be stored.reco/<PassX>/ESD/: The directory where the ESDs and the tag files will be stored for each Pass.reco/<PassX>/AOD/: The directory where the AODs of this Pass will be stored.The file names of the stored ALICE data will be kept simple, and only unique in the current subdirectory, for example: <S>.AliESDs.root for ESD files, where ‹<S> is the identifier of the corresponding raw data file (<S>.raw.root, also called raw data chunk). Therefore different subdirectories (for example the reco/<PassX>/ESD directories for different <RunNumber> parent directories) may contain files with the same name but with different content. Nevertheless, the GUID scheme (and the directory structure) makes sure that these files can be distinguished.
Structure of the Files Catalog
Run/File Meta Data Tags
Tag Name Data Format Data Sourcerun comment Text DAQ logbook
run type Text (physics,pedestal,...) DAQ logbook
run start time yyyymmddhhmmss DAQ logbook
run stop time yyyymmddhhmmss DAQ logbook
run stop reason Text (normal,beam loss...) DAQ logbook
magnetic field setting Text(Full,Half,Zero,...)Fields DCS
collision system Text (PbPb,pp,...) DCS
collision energy Text (5.5TeV) DCS
trigger class DAQ logbook
detectors present in run bitmap: 0=not included, 1=included DAQ logbook
No. of events in this run Integer DAQ logbook
run sanity flag bit or bit mask, default 1=OK Manually
Meta Data for the Reconstructed Data
Tag Name Data Format Data Source
production tag Text reconstruction
production software library version
Text (AliRoot::v4-04-Rev-05)
reconstruction
calibration/alignment setting
Text reconstruction
Meta Data for the Simulated Data
Tag Name Data Format Data Source
generator Text (HIJING,PYTHIA,...)
offline
generator version Text offline
generator comments Text offline
generator parameters Text offline
detector geometry offline
detector configuration bitmap: 0=not included, 1=included
offline
simulation comments Text offline
JDL File For Submitting Grid Jobaliensh:[alice] [26] /alice/cern.ch/user/b/batool/ >cat analysis.jdlPackages = { "APISCONFIG::V2.4", "VO_ALICE@ROOT::v5-21-01-alice" };Executable = "Sh_AnaESD_MC_CheckGenCascade.sh";StdOutput = "testJob.out";StdError = "testJob.err";OutputSandbox = {"testJob.out","testJob.err"};InputFile = {"LF:/alice/cern.ch/user/b/batool/macros/runBatchESD_MC_CheckGenCascade.C", "LF:/alice/cern.ch/user/b/batool/macros/STEERBase.par", "LF:/alice/cern.ch/user/b/batool/macros/ESD.par", "LF:/alice/cern.ch/user/b/batool/macros/ANALYSIS.par","LF:/alice/cern.ch/user/b/batool/macros/AOD.par", "LF:/alice/cern.ch/user/b/batool/macros/ANALYSISalice.par","LF:/alice/cern.ch/user/b/batool/macros/AliTaskESD_MC_CheckGenCascade.h","LF:/alice/cern.ch/user/b/batool/macros/AliTaskESD_MC_CheckGenCascade.cxx"};OutputArchive = {"log_archive.zip:*.log,stdout,stderr@ALICE::CERN::SE","root_archive.zip:*.root@ALICE::CERN::SE"};InputDataListFormat = "xml-single";InputDataList = "wn.xml";InputData = {"LF:/alice/sim/PDC_08/LHC08q/230009/134/Run230009.Event0_100.ESD.tag.root,nodownload","LF:/alice/sim/PDC_08/LHC08q/230009/177/Run230009.Event0_100.ESD.tag.root,nodownload"};OutputDir= "/alice/cern.ch/user/b/batool/TutorialOuptut";Email="[email protected]";
Macros Referenced in JDL Filemacros directory
aliensh:[alice] [7] /alice/cern.ch/user/b/batool/ >ls -l macros/-rwxr-xr-x batool batool 16755 Oct 03 20:25
AliTaskESD_MC_CheckGenCascade.cxx-rwxr-xr-x batool batool 2503 Oct 03 20:25
AliTaskESD_MC_CheckGenCascade.h-rwxr-xr-x batool batool 34242 Oct 03 20:26
ANALYSIS.par-rwxr-xr-x batool batool 52820 Oct 03 20:25
ANALYSISalice.par-rwxr-xr-x batool batool 59179 Oct 03 20:26 AOD.par-rwxr-xr-x batool batool 170224 Oct 03 20:26 ESD.par-rwxr-xr-x batool batool 8145 Oct 03 20:26
runBatchESD_MC_CheckGenCascade.C-rwxr-xr-x batool batool 88856 Oct 03 20:27
STEERBase.par
Shell Scripts Used by JDL Jobbin directory
aliensh:[alice] [29] /alice/cern.ch/user/b/batool/bin/ >cat Sh_AnaESD_MC_CheckGenCascade.sh#!/bin/bash
# Do not put here any GCLIENT_SERVER_LIST.#”pcapiserv01.cern.ch:10000|pcapiserv02.cern.ch:10000|pcapiserv04.cern.ch:10000"# “pcapiserv04.cern.ch:10000|pcapiserv05.cern.ch:10000|pcapiserv06.cern.ch:10000”# By construction there is no need to supply this list. But in principle,# the APISCONFIG package creates the list on the fly.echo ===========================echo "Rootsys : $ROOTSYS"echo ""echo "Path ..."echo $PATHecho ""echo "Ld_Library_path ..."echo $LD_LIBRARY_PATHecho ==========================
root -b -q runBatchESD_MC_CheckGenCascade.C;
echo "Exit ..."
How to Query the File CatalogFor querying the file catalog and extract a collection of ESD files, apply the following criteria:They correspond to the 2008 run.They were created during the first period of the machine at that year.They were created from the third pass of the reconstruction.The first thing one should do is have an active alien session.$find -x collection /alice/data/2008/LHC08a/*/reco/Pass3/* AliESDs.rootIf he/she wants to store this collection then all is needed to be done is to redirect the output to a xml file:$find -x collection /alice/data/2008/LHC08a/*/reco/Pass3/* AliESDs.root > collection.xmlIf there is a need to restrict further the output by imposing some selection criteria at the run/file level then if for example we need that the ESDS from the previous example:Correspond to pp collisions.Were created between the 19th and the 20th of March 2008 (10:20:30).then the above command is modified accordingly:$find -x collection /alice/data/2008/LHC08a/*/reco/Pass3/* AliESDs.root Run:collision_system=”pp” and Run:stop<"2008-03-20 10:20:33" and Run:start>"2008-03-19" > collection.xml
wn.xml
Submit and Trace Jobsubmit analysis.jdl
aliensh:[alice] [11] /alice/cern.ch/user/b/batool/ >ps -trace 37035403 allMon Oct 26 16:00:19 2009 [state ]: Job 37035403 inserted from [email protected] Oct 26 16:00:25 2009 [state ]: Job state transition to STARTED |=| procinfotime: 1256569225 site:
Alice::NIHAM::PBS started: 1256569225 node: n10.aliceMon Oct 26 16:00:39 2009 [state ]: Job state transition from STARTED to RUNNING |=| procinfotime: 1256569239
site: Alice::NIHAM::PBS started: 1256569239 spyurl: n10.alice:8090 node: n10.aliceMon Oct 26 16:00:45 2009 [state ]: Job state transition from WAITING to ASSIGNED (Hgate.nipne.ro)Mon Oct 26 16:01:13 2009 [trace ]: The job has been taken by the jobagent 31676_4486Mon Oct 26 16:01:13 2009 [trace ]: The job needs 21600 secondsMon Oct 26 16:01:13 2009 [trace ]: Creating the working directory /scratch/alice/alien-job-37035403Mon Oct 26 16:01:13 2009 [trace ]: Putting the list of files in the file 'wn.xml'Mon Oct 26 16:01:13 2009 [trace ]: Downloading input file:
/alice/cern.ch/user/b/batool/bin/Sh_AnaESD_MC_CheckGenCascade.shMon Oct 26 16:01:13 2009 [trace ]: Downloading input file: /alice/cern.ch/user/b/batool/macros/ANALYSIS.parMon Oct 26 16:01:13 2009 [trace ]: Downloading input file:
/alice/cern.ch/user/b/batool/macros/ANALYSISalice.parMon Oct 26 16:01:13 2009 [trace ]: Downloading input file: /alice/cern.ch/user/b/batool/macros/AOD.parMon Oct 26 16:01:13 2009 [trace ]: Downloading input file:
/alice/cern.ch/user/b/batool/macros/AliTaskESD_MC_CheckGenCascade.cxxMon Oct 26 16:01:13 2009 [trace ]: Downloading input file:
/alice/cern.ch/user/b/batool/macros/AliTaskESD_MC_CheckGenCascade.hMon Oct 26 16:01:13 2009 [trace ]: Downloading input file: /alice/cern.ch/user/b/batool/macros/ESD.parMon Oct 26 16:01:13 2009 [trace ]: Downloading input file: /alice/cern.ch/user/b/batool/macros/STEERBase.parMon Oct 26 16:01:13 2009 [trace ]: Downloading input file:
/alice/cern.ch/user/b/batool/macros/runBatchESD_MC_CheckGenCascade.C
Tracing continued…Mon Oct 26 16:01:13 2009 [trace ]: Installing package VO_ALICE@ROOT::v5-21-01-aliceMon Oct 26 16:01:13 2009 [trace ]: Installing package APISCONFIG::V2.4Mon Oct 26 16:05:06 2009 [state ]: Job state transition from RUNNING to SAVING |=| procinfotime:
1256569506 site: Alice::NIHAM::PBS error:Mon Oct 26 16:05:15 2009 [state ]: Job state transition to SAVED |=| procinfotime: 1256569515 site:
Alice::NIHAM::PBS spyurl: jdl:Mon Oct 26 16:05:17 2009 [proc ]: 00:03:30 210 91.60 3.2 9 213348 291696 4 15 2992.838 50.88 140678
219528 12.7016393918919Mon Oct 26 16:05:17 2009 [trace ]: Finally, processing archives: root_archive.zip:*.root@ALICE::CERN::SE
log_archive.zip:*.log,stdout,stderr@ALICE::CERN::SEMon Oct 26 16:05:17 2009 [trace ]: Finally, processing files:Mon Oct 26 16:05:17 2009 [trace ]: MonALISA will be asked:
http://pcalimonitor.cern.ch/services/getBestSE.jsp?username=batool&se=ALICE::CERN::SE;1&count=1
Mon Oct 26 16:05:17 2009 [trace ]: SE list after asking MonALISA: ALICE::NIHAM::FILEMon Oct 26 16:05:17 2009 [trace ]: Effective SE list for the current file will be ALICE::NIHAM::FILEMon Oct 26 16:05:17 2009 [trace ]: Registering root_archive.zip in ALICE::NIHAM::FILE (guid )Mon Oct 26 16:05:17 2009 [trace ]: Successfully stored the file root_archive.zip on 1 of the 1 wished SEsMon Oct 26 16:05:17 2009 [trace ]: Effective SE list for the current file will be ALICE::NIHAM::FILEMon Oct 26 16:05:17 2009 [trace ]: Registering log_archive.zip in ALICE::NIHAM::FILE (guid )Mon Oct 26 16:05:17 2009 [trace ]: Successfully stored the file log_archive.zip on 1 of the 1 wished SEsMon Oct 26 16:05:17 2009 [trace ]: we had 2 files and archives to store, we successfully stored 2Mon Oct 26 16:05:17 2009 [trace ]: OK, SUCCESS. All files for this submit were sucessfully uploaded.Mon Oct 26 16:05:17 2009 [state ]: The job finished on the worker node with status SAVED
Outputaliensh:[alice] [12] /alice/cern.ch/user/b/batool/ >ls -l /proc/batool/37035403drwxr-xr-x admin admin 0 Oct 26 16:05 job-logdrwxr-xr-x batool batool 0 Oct 26 16:05 job-outputaliensh:[alice] [13] /alice/cern.ch/user/b/batool/ >ls -l /proc/batool/37035403/job-output/-rwxr-xr-x batool batool 6163 Oct 26 16:05 log_archive.zip-rwxr-xr-x batool batool 5127 Oct 26 16:05 root_archive.zip-rwxr-xr-x batool batool 4961 Oct 26 16:05 sLHC08q.Test.CheckGenCasc.ESD.root -rwxr-xr-x batool batool 6611 Oct 26 16:05 stderr-rwxr-xr-x batool batool 47147 Oct 26 16:05 stdout
WLCG Grid Sites in Pakistan
NCP (National Centre for Physics)NCP-LCG2http://goc.grid.sinica.edu.tw/gstat/NCP-LCG2/
PIEAS (Pakistan Institute of Engineering and Applied Sciences)
PAKGRID-LCG2http://goc.grid.sinica.edu.tw/gstat/PAKGRID-LCG2/
A Glimpse of PAKGRID-LCG2 Site in GOCDB
WLCG Resources on 27/10/2009Sites Countries Total
CPUsFreeCPUs
RunningJobs
Total 304 57 82224 51009 59119
WaitingJobs
SE Avail(TB)
SE Used(TB)
Max.CPUs
AverageCPU
Total 16484884 133866.94 62972.87 119213 79872
Major Grid ComponentsCE (Computing Elements)
Works as Grid GateSeveral Workers Nodes
SE (Storage Units)Act as Head node for Storage Units
BDII (Berkley Database Index ServerNS (Network)RB (Resource Broker)MON (Monitoring Box)UI (User Interface)
Grid Requirements
Computing Resources (CE and WNs)Storage Resources (SE and storage units)Security (SSL, X509, VOMS etc.)Monitoring (SAM, goc, grid-ice)Up-to-date data collection about resources (BDII and rgma)Data Transportation and CataloguingBook KeepingAccounting (Apel)
Jobs and Data Flow
JobsUI -> NS -> RB -> CE -> WNBack to WN-> CE -> NS -> UI
DataData Source -> WN -> Local SE -> Repository -> Replication
CataloguingAt Central Repository and Replication Centers
Job Flow on CE
GRAM gatekeeper -> LCAS -> LCMAPS -> JobManager -> Batch System (openPBS) ->Submitted to WNs
Grid Resource Allocation Manager (GRAM)Local Centre Authorization Service (LCAS)Local Credential Mapping Service (LCMAPS)
MILESTONES
Year Remarks
2002+ Project StartedCluster Based Production
2004+ Grid Deployment Started
2009+ Functional Grid
Year 2002+Started Participating in Collaboration
Cluster based productionHuman Resources 4PC Nodes 10Internet Dialup 64K
Year 2004+Started Deploying Grid
ResourcesHuman Resources 7PC Nodes
Core Nodes 5Physical Nodes 10Logical Nodes 10
Storage Capacity 1TbytesInternet Link (shared) 1Mbps
Year 2009 (1/2)Functional GRID
ResourcesHuman Resources 3PC Nodes
Physical Nodes 26Logical Nodes 58Core Nodes 5
Sub Clusters 3Break Up
32-bits PCs 1064-bits Core 2 Duo 1064-bits Quad Core 10
Year-2009 (2/2)Functional GRID
Resources
Storage Capacity 04TbytesInternet Link (shared) 24Mbps
Fabric
Configuration
Node Type Abrv CountUser Interface UI
CE
SE
Monitoring Box Mon 01
Net Address Translator NAT 01
VObox
01
Computer Elementsce .pakgrid.org.pkgcg01.pakgrid.org.pkgcg02.pakgrid.org.pk
03010101
Storage Elements 01
VOBOX 01
Monitoring Alice Production Sites(1/2)
Monitoring Alice Production Sites (2/2)
Activities of Grid Computing Group
Software Development for:Grid Operation/MonitoringProcurementNetwork AdministrationCluster DeploymentApplication Deployment on ClustersBDII failures controlProposing Performance Improvement Model for BDII
BDII Model
TopBDII Data Exchanges
Data Exchange in LDIF Format
Data Fetched By a TopBDIIDuring One Cycle
Attributes Frequency DistributionAttributes Freq (%)
GlueHostApplicationSoftwareRunTimeEnvironment 0.31GlueCEPolicyAssignedJobSlots 0.49GlueCEPolicyMaxRunningJobs 0.49GlueCEInfoTotalCPUs 0.49GlueCESEBindGroupSEUniqueID 0.50GlueCESEBindWeight 0.60GlueCESEBindMountInfo 0.60GlueCESEBind 0.61GlueGeneralTop 0.67GlueCESEBindCEUniqueID 0.70GlueSchemaVersionMajor 0.88GlueSchemaVersionMinor 0.88GlueSchemaVersion 0.89GlueServiceStartTime 0.94GlueCESEBindSEUniqueID 1.38GlueCEStateWaitingJobs 3.99GlueCEStateFreeCPUs 7.98GlueCEStateRunningJobs 8.97GlueCEStateTotalJobs 9.89GlueCEStateWorstResponseTime 12.41GlueCEStateEstimatedResponseTime 18.1GlueCEStateFreeJobSlots 22.97
Total: 94.74
Records level Changes(Unique Records)
LDIF/Records/Bytes Level Differences
Proposed ModelOnly Exchange Changes
Files Size Containing ChangesZipped Files Size
Decay Signatures of Higgs
Job Flow
The Big Bang
Big Bang Timeline
We are here
The Big Bang
Big Bang Timeline
We are here
Referenceshttp://alien.cern.ch/twiki/bin/view/AliEn/Home
User GuideAGUR v1.0AA-UserGuide-0.0m.pdf
http://alien.cern.ch/twiki/bin/view/AliEn/Home/primer.ps.gzhttp://aliceinfo.cern.ch/Offline/Activities/Analysis/CAF/index.htmlhttp://public.web.cern.ch/public/en/Science/Glossary-en.phphttp://public.web.cern.ch/public/en/LHC/ALICE-en.htmlhttp://lcg.web.cern.ch/LCG/http://www.olivier-art.com/gridTalk/Documents/GridBriefing_What_is_a_grid_2.pdf