your university or experiment logo here user board or user bored? glenn patrick gridpp19, 29 august...

18
Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

Upload: amelia-henry

Post on 28-Mar-2015

215 views

Category:

Documents


3 download

TRANSCRIPT

Page 1: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

Your university or experiment logo here

User Board or User Bored?

Glenn PatrickGridPP19, 29 August 2007

Page 2: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

2

Grids need users

GridPP

WLCGEGEEOSGNGS

USER

Page 3: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

3

Users need a Board?

Not quite –more of a User Forum

Page 4: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

4

Board needs a Chair

2006 -2005-2006

2004-20052003-20042001-2003

LHCb

LHCb

BaBar Other Experiments

CMS

Page 5: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

5

Experiments are really the users

Page 6: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

6

Tier 1 Fairshares – last 12 months

ATLASBaBarCMS

LHCb

ATLASBaBar

CMSLHCb

...Requested

Reality…

Page 7: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

7

Tier 1 CPU – 2007 ProfileUK Tier 1 Requests - 2007 CPU(KSI2K)

 May 07 Used

May 07 Alloc. Jan Feb Mar April May June July Aug Sept Oct Nov Dec

ALICE 18.6 60 20 30 40 50 60 70 113 113 113 113 113 113

ATLAS 222.7 500 320 320 320 500 500 500 500 500 600 600 690 690

CMS 20.7 150 200 150 150 150 150 150 150 150 450 450 450 600

LHCb 56.5 100 235 235 226 226 100 100 132 132 132 132 132 309

BaBar Plan B 445.2 300 300 300 300 300 300 300 300 300 300 300 300 300

CDF 0.0 10 10 10 10 10 10 10 10 10 10 10 10 10

D0 2.6 120 100 105 110 115 120 125 30 30 30 30 30 30

H1 6.4 65 65 65 65 65 65 65 65 65 65 65 65 65

MICE 0.0 1 1 1 1 1 1 1 1 1 1 10 10 10

MINOS 22.6 125 50 50 50 125 125 125 125 125 125 125 125 125

SNO 3.6 12 12 12 12 12 12 12 12 12 6 6 6 6

ZEUS 8.0 20 20 20 20 20 20 20 20 20 20 20 20 20

Pheno 1.6 20 20 20 20 20 20 20 20 20 20 20 20 20

UKQCD 0.0 0 0 0 0 0 0 0 0 0 0 0 0 0

Dteam/Ops 0.0 8 8 8 8 8 8 8 8 8 8 8 8 8

Other 48.4 0 0 0 0 0 0 0 0 0 0 0 0 0

TOTAL 856.9 1491.0 1361 1326 1332 1602 1491 1506 1486 1486 1880 1889 1979 2306

LCG Total 318.5 810.0 775 735 736 926 810 820 895 895 1295 1295 1385 1712

Fabric 0.0 0.0 0 0 0 0 0 0 0 0 0 0 0 0

CAPACITY 1508.0 1508.0 1546 1536 1541 1508 1508 1508 1506 1514 1514 1527 1525 1525

HEADROOM 651.1 17.0 185.0 210.0 209.0 -94.0 17.0 2.0 20.0 28.0 -366.0 -362.0 -454.0 -781.0

2007

2008

2009

2010

2011

Also an underlying profile for LHC!

Napes Needle

SuperL

HC

Page 8: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

8

2007 at the Tier 1

CPU. Largely met demand through the first half of the year. Resources start to become over-allocated in September when ATLAS and CMS activities are expected to peak. An increasing shortfall of CPU across Q4 is predicted, largely due to the LHC experiments ramping up in preparation for 2008.DISK. After the difficulties of 2006, the disk situation through the first 6 months of 2007 has been good with sufficient headroom to provide experiments with the requested capacity, as well as extra resources to assist with the testing of Castor and migration from dCache. There is still headroom through Q3, but Q4 will be challenging and experiments will probably have to wait for the new disk deployment in January 2008.TAPE. As always with tape (and the vagaries of Castor repacking, etc), it is difficult to be certain of the physical headroom. Estimates of the unwanted tape storage of the disk1tape0 storage class have had to be included for Castor (hopefully solved when v2.1.4 is deployed). Some allowance has also been made for migration from dCache to Castor.

Page 9: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

9

LHC Schedule – End/Start in Sight!

Interconnection of the continuous cryostat

Leak tests of the last sub-sectors

Inner Triplets repairs & interconnections

Global pressure test &Consolidation

Flushing

Cool-down

Warm up

Powering Tests

Global pressure test &Consolidation

Cool-down

Powering Tests

General schedule Baseline rev. 4.0

May 2008

We are here!8

mon

ths

Page 10: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

10

2008 Planning Underway

Tier 1 - 2008 Hardware (GridPP3)

CPU(KSI2K) Disk (TB) Tape (TB)Now 2008 Now 2008 Now 2008

ALICE 113 132 36 93 39 82

ATLAS 500 1925 164 1056 160 818

CMS 150 1131 140 527 230 1088

LHCb 132 309 79 162 64 137

BaBar 300 500 93 35 275 35

Other 291 0 53 15 61 153

TOTAL 1486 3997 565 1888 829 2313

x 2.7 x 3.3 x 2.8

Page 11: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

11

dCache – Castor2 Migration

Castor

Data

CastorCMS

dCacheLHCb

dCacheCastorATLAS

The migration to Castorcontinues to be a challenge!

At the UB meeting on 20 June it was agreed that 6 month notice be given for

dCache termination.

Experiments have to fund storage costs past March

2008 for ADS/vtp tape service.

Page 12: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

12

Castor Progress at RAL

Separate Instances for LHC ExperimentsATLAS Instance - Version 2.1.3 in production.CMS Instance - Version 2.1.3 in production.LHCb Instance - Version 2.1.3 in testing.

IssuesStrategy meetings and weekly experiment technical meetings helped a lot with progress. Current issues: • Tape migration rates.• Monitoring at RAL.• SRM development (v2.2 timescale).• disk1tape0 capability.• Repack.

But upcoming Data Challenges ofCMS (CSA07) and ATLAS (M4, FDR)

+ LHCb, ALICE will be the real test of Castor.

Page 13: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

13

physics group

regional group

les.

rob

ert

son

@ce

rn.c

h

CERNTier2

Lab a

Uni a

Lab c

Uni n

Lab m

Lab b

Uni bUni y

Uni x

Tier3physics

department

Desktop

Germany

Tier 1

USA

UK

France

Italy

……….

CERN Tier 1

……….

The LHC Computing

Centre

LHC Computing Model 2001

Page 14: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

14

Grid Only Tier 1

After several discussions, non-Grid access to the Tier 1 is scheduled to finish at the end of 2007 except for a few exceptions.

Use cases for the exceptions are being identified:• Debugging production jobs.• Maintaining experiment environment.• Start up of new experiments.• etc

Limited User Interface Service. Important to retain functionality and flexibility.

Implications for RAL AFS service (cell). This is bad news for BaBar who rely on AFS for software distribution.

Page 15: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

15

SL4 and 64 Bit Migration

Migration to SL4 discussed several times. A new SL4 CE with 20% of the batch capacity commissioned at Tier 1 during the first week of August.

Generally, not an issue with experiments, but some teething problems (e.g. LHCb and CMS).

Experiment attitudes towards true 64 bit applications (as opposed to 32 bit applications running in compatibility mode) surveyed:

ATLAS - not important at the moment.

LHCb – Can test, but what about middleware?

BaBar/MINOS – No immediate interest.

MICE plan to move to 64 bit computing as soon as underlying computing resources become available.

Page 16: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

16

Real LHC Data now on Horizon

Already here in the case ofATLAS cosmics!

10331033

1032 cm-2 s-1 1032 cm-2 s-1

10341034

CMSCMS

Need to be prepared for increasing luminosity and surprises (good and bad).

Important to handle issues as they arise (and if possible anticipate).More direct communication needed in addition to quarterly UB meetings.

VariableBackgrounds

ChangingBeam Energies

Page 17: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

17

User Board Future

UB and experiment interaction needs to progress as experiments evolve.

Suggestions on this are welcome.

Page 18: Your university or experiment logo here User Board or User Bored? Glenn Patrick GridPP19, 29 August 2007

18

The End (and The Start)