Baltic Grid Event, Vilnius, 2004-10-07 - 1
NE ROC Sweden
• Interaction, Integration and Interface with other grid projects and infrastructures• SWEGRID
• Six 100 cpu clusters at 6 sites• Up to 1/3 of the resources available for egee• Six sites using ARC (Nordugrid)• Three sites LCG2
• ARC aka NorduGrid • Used on SWEGRID for primarily for Atlas VO but a number of other users have joined
• Nordic Data Grid Facility• Until end 2004 competence and software development
• EuroGrid (Codine)• Parallab (Bergen) expertise on enabling of applications and grid technologies
• More…
Baltic Grid Event, Vilnius, 2004-10-07 - 2
NE ROC Sweden
HPC2N
PDC
NSC
3
National Supercomputer Center, NSC
Linköping University, Sweden
• Established 1989
• 10 full time and 3 half time employees
• EGEE: Leif Nixon and Johan Gunnarsson
• More than 250 users from the Swedish academic HPC community.
• Partnerships with
• Saab AB
• Swedish Meteorological and Hydrological Institute
4
National Supercomputer Center, NSC
Linköping University, Sweden
• HPC resources
• Cluster resources: more than 850 proc.
• High speed interconnects: Infiniband, Scali
• Shared memory resources: SGI3K, 128 proc
• Organizes the annual workshop on Linux Clusters for Supercomputing, LCSC
5
Grid activities at NSC
• First Grid activities at NSC were initiated 2002.
• SweGrid, GRID test bed for computing and storage
• technical manager, Niclas Anderson, NSC
• NSC is representing Sweden in Grid Deployment Board of the LHC Computing Grid
• Parterns in EU-FP6 grid related projects:
• EGEE, Enabling Grids for E-science in Europe
• ENACTS, Technology watch programme
• HPC4U, Highly Predicable Clusters For Internet Grids
HPC2N 2004 all rights reserved
HPC2N – Some History° 1989 – 95: Supercomputing Center North
° Bank grant (IBM 3090VF-600J)° 1996: HPC2N consortium established
° HPDR contract, KAW grant (IBM SP - knut)° 1997-2002 Grants from HPDR, FRN and VR° 2003– VR/SNIC grants, SweGrid (ingrid)° HPC systems financed by grants from
° Knut and Alice Wallenberg Foundation (knut, alice, and sarek)
° Kempe Foundations (seth)
HPC2N 2004 all rights reserved
Research and Development #1
° Public Domain Software Libraries° HPC systems demand software that utilize their special
architectures efficiently° Software contributions and international
collaboration:LAPACK, ScaLAPACK, SLICOT, IBM-ESSL
° Novel algorithms for deep memory hierarchies° Recursive blocked algorithms, hybrid data formats, with
IBM T.J. Watson Res. Center
° NICONET - Numerics in Control Network (EC)° Web computing environment
HPC2N 2004 all rights reserved
Research and Development #2
° VR/SNIC: Generic Grid research for resource management, portals and algorithms° Resource brokering° Accounting and bookkeeping
° HPC2N Portal SNIC Portal° Web site for submitting jobs, job status information,
access to data files, project management, grid access etc.
° VISTA - Visual Interactive Simulation - Tools and Applications° with VRlab, EC Mål 1 funding
10
NE ROC Technical MeetingAmsterdam, October 28-29, 2004
Background
• Research in parallel computation since about 1985
• Formalized as a Center at KTH in 1990
• Successfully competed for the national HPC center in 1995
• Assumed role as main national center in 1996
• Successful review of center buildup in the fall of 1996
• HPDR closed in 1998. One-year continuation funding 1999 – 2002. First three-year award from SNIC in 2003.
11
NE ROC Technical MeetingAmsterdam, October 28-29, 2004
Representative R&D Projects• EDG – EGEE (EU)• NextGrid (EU)• VR-IT Grid Research (VR)
SGAS, Grid Accounting System
• SweGrid (SNIC, KA Wallenberg)• Jaco3: Java and Corba Collaborative Computing
environment (EU)• EnsCUBE: European Numerical Services for SMEs (EU)• Neurogenerator (EU), Neurodisseminator (EU)• BINS (SSF)• Universe (EU)• Virtual Fires (EU)• FHS (Swedish National Defense College)• SEPTools (EU)• PDCTTN (EU)
12
NE ROC Technical MeetingAmsterdam, October 28-29, 2004
Collaborations• Globus Alliance• Global Grid Forum• European Grid Support Center• International Summer School on Grid Computing• Gelato Federation• LACSI• HP• IBM (KTH Open Source Lab, IBM Research)• Intel• PSCI (Parallel Scientific Computing Institute)• KCSE (KTH Computational Science and Engineering
centre)• VIC (Visualization, Interaction and Communication
centre)
13
NE ROC Technical MeetingAmsterdam, October 28-29, 2004
High-Performance Networking
• Distributed simulation at SC97, San Jose (Sunet, NorduNet, Startap, and Internet2)
• Interactive distributed virtual reality at Alliance‘98 (NCSA, Utah, EVL, UH, PDC, Sunet, NorduNet, Startap, NSF and Internet2) strong influence on Nordunet transatlantic upgrade schedule, UCAID and Eurolink agreements
• Distributed Visualization ENVIS @SC99 (Exhibit, PDC)• Computational Steering at iNET2000, Yokohama (PDC,
UH, EVL, Sunet, NorduNet, Startap, and APAN)• λ-technology for tele-microscopy (NorduNet, Surfnet,
Starlight, Internet2, KI, UCSD/NCMIR)
14
NE ROC Technical MeetingAmsterdam, October 28-29, 2004
• ImmersaDesk 1996 (Alliance)• VR-Cube 1998• Innovative Projects
Technology• An extensible simulation and navigation system “Navier”• A simulation environment for spatial sound
Applications• High-performance visualization of CFD• Visualization and computational steering of very large CEM data sets• High quality visualization of architectural models• Visualization of fires in tunnels (EU project starting 2001)• Virtual Exhibits, Art
• Undergraduate Advanced Visualization Courses • Advanced CAVE workshop, October 2001,
with CAVE Research Network support
Visualization
15
NE ROC Technical MeetingAmsterdam, October 28-29, 2004
Storage services• Space data (Telefoton, Odin, Pamela):
Data repository for the research satellite Odin (260 GB raw data, 270GB processed data, Growth 220 GB/yr collaboration between SE, FI, CA, FR)
• Genomics:Data repository for SSF Genotyping
Laboratory at UU (Data Migration service)• Mutual back-ups PDC – HPC2N (~12 TB)• Brain Images (Neurogenerator):
Data repository and data analysis of PET and fMRI images (a few MB/image, 10 – 100 GB/object, 10 – 100 TB/study)
• Human Proteome Resource, 30 TB 2004, possibly 300TB by 2007 (10,000 anti-bodies, 30 GB/anti-body)
• Amanda 5 TB 2004, 15 – 20 TB 2005• Pamela, ~7TB/yr• SweGrid• SNIC, ~5 TB/yr
16
NE ROC Technical MeetingAmsterdam, October 28-29, 2004
Computer Systems at PDC
17
NE ROC Technical MeetingAmsterdam, October 28-29, 2004
OpenAFS/Arla ECCE PSEs Web portals Gridapps Kerberos travel-kit TSM
User applications
Gaussian Jaguar ABAQUS Fluent StarCD NWChem MacroModel Matlab GeneHunter DL-Poly CHARMM GAMESS Dalton GROMACS Numerical Libraries TotalView Vampir TAU PAPI
Robot
Servers Disk
Switches100/1k/10k
Routers
Computeresources
AFS GPFS Lustre PVFS HSM/DMF TSM
Kerberos Packet filtering
FTP WEB DNS MAIL SSH PKI Grid services
NetCDF HDF4 HDF5 MPI
PDC HSMcommands
SRBBatch system
EASYCompilersDebuggers
MyrinetInfiniband
Fabri
cServ
ices
Tools
Computers Storage Networking
Use
rC
lients
“lambda”
Tape
LAPIGM
Applic
ati
ons
Baltic Grid Event, Vilnius, 2004-10-07 - 18
NE ROC Items for Discussion
Support• Single point of contact?
• Six 100 cpu clusters at 6 sites• Up to 1/3 of the resources available for egee• Six sites using ARC (Nordugrid)• Three sites LCG2
• ARC aka NorduGrid • Used on SWEGRID for primarily for Atlas VO but a number of other users have joined
• Nordic Data Grid Facility• Until end 2004 competence and software development
• EuroGrid (Codine)• Parallab (Bergen) expertise on enabling of applications and grid technologies
• More…