EGEE User ForumEGEE User Forum 01/03/200601/03/2006

International Telecommunication International Telecommunication Union Regional Radio Conference Union Regional Radio Conference

and the EGEE gridand the EGEE grid

Andrea ManaraAndrea ManaraITU-Radiocommunication BureauITU-Radiocommunication Bureau

Terrestrial Service DepartmentTerrestrial Service Department

SummarySummary

International Telecommunication Union International Telecommunication Union (ITU) and the Radiocommunication (ITU) and the Radiocommunication Bureau (ITU-BR)Bureau (ITU-BR)

Regional Radio Conference RRC-04/06Regional Radio Conference RRC-04/06 The dataThe data Planning processPlanning process The computational problemThe computational problem The ITU-BR distributed computing systemThe ITU-BR distributed computing system Experience with the EGEE gridExperience with the EGEE grid Experience with DianeExperience with Diane

The International The International Telecommunication Union (ITU)Telecommunication Union (ITU)

ITU: oldest UN agency (17 May 1865) ITU: oldest UN agency (17 May 1865) historyhistory

Telecommunication Standardization Sector (ITU-T)Telecommunication Standardization Sector (ITU-T)• Production of standards covering all fields of Production of standards covering all fields of

telecommunicationstelecommunications Telecommunication Development Sector (ITU-D)Telecommunication Development Sector (ITU-D)

• Assist developing countries in bridging the “Digital Divide”Assist developing countries in bridging the “Digital Divide” Radiocommunication Sector (ITU-BR)Radiocommunication Sector (ITU-BR)

• Management of the radio-frequency spectrum and satellite Management of the radio-frequency spectrum and satellite orbits for fixed, mobile, broadcasting and many other orbits for fixed, mobile, broadcasting and many other communication servicescommunication services

ITU-BR RRC-04/06ITU-BR RRC-04/06

Regional Radio Conference for the introduction of digital broadcasting in the UHF (470-862 MHz) and VHF (174-230 MHz) bands.

RRC-04 (May 2004, 95 countries) established the technical basis (planning criteria and parameters) for the RRC-06 and defined the work for the intersessional activities

Amongst the intersessional activities: • First planning exercise (28/02/05-> 15/07/05)• Second planning exercise (31/10/05 -> 28/02/06): Draft Plan

RRC-06 (15 May–16 June 2006), 120 countries will negotiate the new frequency plan in Geneva. This plan will be part of a new international agreement.

The dataThe data

Digital broadcasting requirements (~75 K)• T-DAB and DVB-T : many system variants (i.e. data

capacity/reception modes) ->Reference Planning Configurations

• Assignments (location and features of transmitter known)• Allotments (service area known) -> Reference Networks

(number, location, power of transmitters) to approx. real networks

Existing and planned analogue radio and television stations (~95 K)

Existing and planned fixed and mobile stations (~10 K)

Propagation model for field strength prediction to be used for planning based on ITU-R P.1546-1 (statistical model)

Planning is to be based on the protection of service area for assignments and allotments

The Planning processThe Planning process

Compatibility analysisCompatibility analysis• D2d, d2a-a2d, d2o-o2dD2d, d2a-a2d, d2o-o2d

For each digital requirement :For each digital requirement : List of available channelsList of available channels List of incompatibilitiesList of incompatibilities

SynthesisSynthesis• Determine a suitable frequency Determine a suitable frequency

for each requirementfor each requirement to maximize the number of to maximize the number of

requirements satisfiedrequirements satisfied to avoid harmful interference to avoid harmful interference

Results of draft planResults of draft plan

The computational problemThe computational problem

Running compatibility analysis Running compatibility analysis very CPU demandingvery CPU demanding

Very limited time to perform Very limited time to perform the calculation at the RRC06the calculation at the RRC06• Full scale calculation in < 1dayFull scale calculation in < 1day• Smaller parallel regional areas Smaller parallel regional areas

(CNG) runs during the week(CNG) runs during the week

First planning exercise (06/2005)First planning exercise (06/2005)• CPU time: 90 daysCPU time: 90 days• Elapsed time: > 1week!Elapsed time: > 1week!

First Planning Exercise

d2dUHF Jobs: 428 CPU time: 1300 hours

~20 1-2 GHz Desktop PCs

6 dedicated 3GHz PCs

After the first planning exercise:•Look for more resources in BR•Look for resources elsewhere -> EGEE

BR distributed computing systemBR distributed computing system

Client-Server architectureClient-Server architecture Perl and Windows servicesPerl and Windows services UDP protocol for client-server UDP protocol for client-server

communication, XML-RPC communication, XML-RPC protocol for monitoring and protocol for monitoring and controlcontrol

Easily scalableEasily scalable 2 jobs in parallel on hyper-2 jobs in parallel on hyper-

threading dedicated PCs (~30% threading dedicated PCs (~30% gain on elapsed time)gain on elapsed time)

Hardware resourcesHardware resources:: 100 dedicated 3.6 GHz hyper-100 dedicated 3.6 GHz hyper-

thread PCs(~35 available for thread PCs(~35 available for draft plan run)draft plan run)

6 dedicated 3.0 GHz PCs6 dedicated 3.0 GHz PCs 70 auxiliary medium speed PCs70 auxiliary medium speed PCs

AnalysisAnalysis CPU (h)CPU (h) Elaps(h)Elaps(h) PCsPCs JobsJobs

d2dVHFd2dVHF 114114 33 2020 34763476

d2dUHFd2dUHF 453453 88 3232 1117011170

d2aVHFd2aVHF 4646 2.52.5 2525 34763476

d2aUHFd2aUHF 6262 55 2525 1117011170

a2dVHFa2dVHF 88 1.51.5 2525 34763476

a2dUHFa2dUHF 2828 44 2525 1117011170

d2o-o2dd2o-o2d 1616 1.21.2 3535 29302930

Draft Plan

Experience with the EGEE gridExperience with the EGEE grid

• Technical kick-off meeting at CERN (21 October)Technical kick-off meeting at CERN (21 October)• Feasibility studies at CERN (24-26 October) Feasibility studies at CERN (24-26 October)

Learned how the GRID works, submit jobs and retrieve Learned how the GRID works, submit jobs and retrieve results results

Run a small d2dVHF job on all LCG sites (98% efficiency)Run a small d2dVHF job on all LCG sites (98% efficiency)Run workflow:

•ITU_all.tar (ascii files, fortran exes, data binaries), ~350MB, self-contained•Copy and register tar file in two Storage Elements (CERN, CNAF)•Submit jdl jobs to Resource Broker via edg-job-submit

•Input SandBox: itu.pl, input.dat (exe, pointer to first/last record in bin)•Output SandBox: two results file (incompatibilities/available channels)

•Working Node: itu.pl retrieves/untar package from SE, run job•Retrieve results ( < 2 MB for 5 reqs/batch)

Too much overhead for ITU requirements! DIANE framework

Experience with DianeExperience with Diane

Run on the Grid using DIANE (1 November)Run on the Grid using DIANE (1 November)• Master-worker system optimise the usage of resources (see Master-worker system optimise the usage of resources (see

K.Moscicki talk n. 100 on “Special Type of Jobs” session)K.Moscicki talk n. 100 on “Special Type of Jobs” session)• Verification of the results quality (porting): Verification of the results quality (porting):

results files comparison btw LCG (Linux) and ITU (Windows) results files comparison btw LCG (Linux) and ITU (Windows) resourcesresources

• Full-scale test with Draft Plan data (Feb. 2006)Full-scale test with Draft Plan data (Feb. 2006) d2d and d2a analysis (5 requirements/batch) ~30k jobsd2d and d2a analysis (5 requirements/batch) ~30k jobs

AnalysisAnalysis CPU(h)CPU(h) Elaps( h)Elaps( h) CPUsCPUs TasksTasks

d2dVHFd2dVHF 153153 2.32.3 116116 34763476

d2dUHFd2dUHF 581581 6.36.3 142142 1117011170

d2aVHFd2aVHF 6262 4.34.3 6262 34763476

d2aUHFd2aUHF 8080 44 101101 1117011170

Institutions which will provide resources for the RRC-06:

CERN, CNAF (I), PIC (E), DESY (D), MSU (Russia), CYFRONET (PL)

Experience with DianeExperience with Diane

Draft Plan

d2dUHF

ConclusionConclusion

A key ingredient for the success of the ITU Regional Radio A key ingredient for the success of the ITU Regional Radio Conference RRC-06 is the capability of performing Conference RRC-06 is the capability of performing calculations in a very limited amount of time.calculations in a very limited amount of time.

Two independent distributed systems are available for the Two independent distributed systems are available for the RRC-06RRC-06

The EGEE infrastructure insure adequate support for an The EGEE infrastructure insure adequate support for an important CPU-demanding international event and opens the important CPU-demanding international event and opens the possibility to allow faster and more detailed studies during possibility to allow faster and more detailed studies during the Conferencethe Conference

Need to study how to share the runs (full planning area + Need to study how to share the runs (full planning area + smaller regional areas) between EGEE grid and ITU smaller regional areas) between EGEE grid and ITU distributed computing infrastructure to minimize overall distributed computing infrastructure to minimize overall running time.running time.

AcknowledgmentAcknowledgment

The ITU-CERN collaboration on the The ITU-CERN collaboration on the EGEE grid was possible thanks to the EGEE grid was possible thanks to the work of many people:work of many people:

CERN: CERN: M.Lamanna, P.Mendez, K. MoscickiM.Lamanna, P.Mendez, K. Moscicki

ITU: ITU: T.Gavrilov, P.N.Hai, D.Botha, M.CosicT.Gavrilov, P.N.Hai, D.Botha, M.Cosic