[email protected] italian national agency for new tecnology, energy and the environment diesis...
TRANSCRIPT
ITALIAN NATIONAL AGENCYFOR NEW TECNOLOGY, ENERGY
AND THE ENVIRONMENT
DIESIS Meeting – Portici 09.03.2008
ContentsENEA-GRID infrastructure (www.afs.enea.it/project/eneagrid )
CRESCO project and the “Virtual Lab” (www.cresco.enea.it)
Silvio Migliori *
* ENEA-Dipartimento Tecnologie Fisiche e Nuovi Materiali (FIM)
ENEA-GRID and CRESCO project as part of DIESIS infrastructure
THE CONCEPT OF ENEA GRID INFRASTRUCTURETHE CONCEPT OF ENEA GRID INFRASTRUCTURE
QuickTime™ and a YUV420 codec decompressor are needed to see this picture.
Cell Centered Data Base Cell Centered Data Base ““CCDB”CCDB”
IMAGING-INSTRUMENTSIMAGING-INSTRUMENTS COMP.-RESOURCESCOMP.-RESOURCES MULTI-SCALE-DATA-BASESMULTI-SCALE-DATA-BASES
NETWORKNETWORK
ADV.-COMP.-GRAPHICSADV.-COMP.-GRAPHICSDATA ANALYSISDATA ANALYSISDATA ACQUISITIONDATA ACQUISITION
By-Mark EllismanBy-Mark Ellisman
ENEA-GRID
Sensor nets
ENEA-GRID
Born in 1998 with 6 Italian geographic clusters Main aim
– Give to ENEA researchers a unified environment to use in an easy way heterogeneous computers and applications software
– Build an homogeneous ICT infrastructure but with a distributed and delegated control
– Integrate the ENEA-GRID with National and International GRIDS
www.afs.enea.it/project/eneagrid
Data archivesColleagues & 3D
Softwarecatalogs
ComputersApplication
Fabric
Connectivity
Resource
Collective
User
ENEA-GRID from the user point of view Main feature:
– Access from any kind of connection– Sharing data in world wide areas (geographical file system AFS) – Access to the data from any kind of digital device client – Running any kind of programs – Access to National and International GRIDS
Sensor nets
Data archives
Computers
Portici (
Roma-1
Bologna EU…Brindisi Roma-2
Trisaia
Software catalogs
ComputersComputersComputers
Computers
Sensor netsEN
EA
-GR
ID
ENEA-GRID from application point of view Potentiality:
– Running all Software Model for any kind of computer architecture – Only one installation for each software for all geographical computers– All authorized users can have access the software from local site – Any application can share the data in the common geographical file system– All sensors can share the data easily using the geographical file systems
Sensor nets
Computers
Portici (
Roma-1
Bologna EU…Brindisi Roma-2
Trisaia
Software catalogs
Computers
Computers
Sensor netsEN
EA
-GR
ID
Software Model 1
Software Model 2
Software Model 3
Software Model ..
Rules
Computers
AFS Geographical cross platform & File System
AIX SGI SUN HP Win
Linux
Linux Alpha
…
LSF
User programs and commercial codes
LSF multi-cluster as integrator
XTERM
Graphical User Interface
Application Portal (ICA-Protocol)
ICAWEB
Qu
ality
of
serv
ice
Mon
itori
ng
, A
uto
mati
c r
ecovery
Accau
nti
ng
ENEA GRID
Load Leveler LSF
Graphic User Interface LSF multi-cluster as integratorTelnet
User programs & commercial code
ICAWEB
Cluster 5° ( Portici)
& File System
Load Leveler LSF
Graphic User Interface
Telnet
ICAWEB
Cluster 6° ( Brindisi)
AFS Geographical cross platform& File System
Load Leveler LSF
Graphic User Interface LSF multi-cluster as integrator
Telnet
User programs & commercial code
ICAWEB
Cluster 2° (Casaccia)
AFS Geographical cross platform& File System
Load Leveler LSF
Graphic User Interface LSF multi-cluster as integrator
Telnet
User programs & commercial code
ICAWEB
Cluster 4° (Trisaia )
AFS Geographical cross platform& File System
Load Leveler LSF
Graphic User Interface LSF multi-cluster as integrator
Telnet
User programs & commercial code
ICAWEB
Cluster 3° (Frascati)
AFS Geographical cross platform& File System
Load Leveler LSF
Graphic User Interface LSF multi-cluster as integrator
Telnet
User programs & commercial code
ICAWEB
Cluster 1° ( Bologna)
A Simple view of ENEA GRID
8
CASACCIACASACCIA
FRASCATIFRASCATI
S.TeresaS.Teresa
SaluggiaSaluggia
IspraIspra
BOLOGNABOLOGNA
PORTICIPORTICI
TRISAIATRISAIA
BRINDISIBRINDISI
ManfredoniaManfredonia
ENEA-GRID Computational & 3D Centers
902750
400
140
30
#CPU/Core
45
ENEA-GRID Computational Resources
Computational resources of Portici (NA) , Brindisi e Trisaia (MT) have been financed by Ministry of Research PON TELEGRID (Avv. MIUR 68) CRESCO (Avv. MUR 1575)
Frascati(4), Portici(34),Trisaia(4), Brindisi(4)
10046Windows 32/64
Frascati(1), Trisaia(13)6014Mac OS X
Trisaia(4), Casaccia(2), Bologna(2)108Solaris
Frascati(8), Casaccia(4), Portici(1),Trisaia(8), Brindisi(1), Bologna(5)
4026IRIX
Casaccia30064Linux IA64 (Altix)
Frascati(140), Casaccia(54), Portici(2700),Trisaia(20), Brindisi(84)
25000>3000Linux x86 32/64
Frascati(258), Bologna(24), Portici(18),Brindisi(2)
3000>300AIX
Gflops#CPU/Core OS
HPC CRESCO INFRASTRUCTURE
Portici LAN
Interconnections InfiniBand4XDDR SERVERS GPFS
4 Nodi IBM 3650
IBFC
High speed disc2 GByte/s
160 TByte IBM/DDN 9550
Backup system300 TByte
IBM Tape Library TS3500 with 4 drives
SERVERS BACKUP3 Nodi IBM 3650
FCIB
GARR(WAN)
Section 1(Large memory)
42 Nodi SMP IBM x3850-M2 with 4 Xeon Quad-Core Tigerton E7330 (32/64 GByte RAM 2.4GHz/ 1066MHz/6MB L2) total 672 cores Intel Tigerton
Section 3(Special)
4 Nodi blades IBM QS21 con 2 Cell BE Processors 3.2 Ghz each.6 Nodi IBM x3755, 8 Core AMD 8222 FPGA VIRTEX54 Nodi IBM x 3755, 8 core AMD 8222 with NVIDIA Quadro FX 4500 X2 4 Nodi windows 8 core 16 Byte RAM
Double interconnection at 1 Gbit& 1 network at 1 Gbit for management
Section 2(MPP)
256 Nodi blades IBM HS21 with 2 Xeon Quad-Core Clovertown E5345 (2.33GHz/1333MHz/8MB L2), 16 GB RAM total 2048 cores Intel Clovertown
4x10 Gbits 400 /1000 Mbits
35 Node for services
Servers for :•Front-end•installations•AFS•…
CRESCO17 TFlops
CRESCO HPC details
Sections 1 & 3 Section 2 & DDN
Control room backup systemnetwork: IB/GB
Corridor hotSections 1 &2
Jack Dongarra 2002
CRESCO in the Top500 List June 2008
Italy (06/2008)
90 CINECA
125 ENEA
131 ENI
135 CILEA
156 CINECA
226 Telecom
Computational abilityENEA-GRID & CRESCO
An heterogeneous system with more than 3000 CPU/cores
Code Risorsa
Serial Section 1 & ENEA-GRID
Parallel hardly coupled Section 2
Embarrassing parallel Section 1, 2, ENEA-GRID
System with several parallel codes
Section 1, 2, Section 1+2
Special ( FPGA, GB, CELL) Section 3
windows (serial and parallel) Section 3
Not LINUX ENEA-GRID
Large date “Data Base” Section 1,2,3 e GPFS
DB_1
CPUSENEA GRID
WEBICASSH
DNA Sequence system
( ABI Prism 3700)Trisaia
DB_3
DB_2
Electron Microscope (Brindisi)
300 KeV (sept. 2004)
ENEA GRID and experimental facilities
Controlled Nuclear Fusion:
FTUFrascati Tokamak
UpgradeVideo Acquisition
GARR
PI2S2
GARR Others Entity
La ENEA-GRID interoperability with others GRID
ENEA has been developing the “shared proxy” solution
•Maintain the GRID internal architecture and autonomy
•Allow multiplatform impementations
•Under production on EGEE
•Under production on GRISU•Required by EFDA for EGEE
EFDAEGEE
CASACCIACASACCIA
FRASCATIFRASCATI
S.TeresaS.Teresa
SaluggiaSaluggia
IspraIspra
BOLOGNABOLOGNA
PORTICIPORTICI BRINDISIBRINDISI
ManfredoniaManfredonia
ENEA-GRID & GRISU & IGI
ENEA-GRID
SPACI
TRISAIATRISAIA
GRISU
INFN-GRID
IGIItalian GRID Infrastructure
CRESCO for EUROPEAN FUSION
Cresco 25 Tflops pick System for development and test of
computational codes for ITER (EFDA contract)
1 Tflops pick
IB
AccessoClient
AccessoWEB
sp4_-1.frascati.enea.it
boquad.bologna.enea.it
dafne.casaccia.enea.it
2 0 0 8
GEANT
infocal.trisia.enea.it
Gatewayto
EGEE & GRISU
Portici
Brindisi
Kleos.portici.enea.it
ercules.brindisi.enea.it
AccessoDiretto www.afs.enea.it/project/eneagrid
Main Interface
ENEA GRID makes use of Citrix Metaframe to publish an application providing a unified GUI interface all the available resources
Application components:●Java (GUI)●shell scripts●EnginFrame
Submissions optionsSubmissions options
Fluent optionsFluent options
Example of use of FLUENT on Example of use of FLUENT on ENEA-GRIDENEA-GRID
External Users
Sicu
rezz
a i
ndus
tria
le
Sicu
rezz
a E
NE
A
ENEA-GRID & Virtual Labarchitecture
Li
ENEA
University and research institute
Enterprise
New collaborations
