indian e-infrastructure · national knowledge networks • idea is to synergize, integrate and...
TRANSCRIPT
Overview
• National Knowledge Network • WLCG Computing • DAE Grid • Garuda Grid • Garuda Resources and Partners • Garuda Interoperability • Tools, Services & Applications in Garuda • Scientific Cloud • Cloud Enabled Applications
2
National Knowledge networks • Idea is to Synergize, Integrate and leverage to form National
Information Highways
• Take everyone onboard (5000 institutes of learning).
• Provide quality of service. Outlay of Rs.100 crores for Proof of Concept
• Envisaged applications are:
– Countrywide Classrooms,
– Telemedicine,
– E-Governance,
– Grid Technology …..
3
NKN Topology
4
Worldwide LHC Computing Grid (WLCG)
• 170 computing centers in 36 countries, linking up national and international grid infrastructures.
– TIFR (Tata institute of fundamental research)
– VECC (variable energy cyclotron centre)
• Provide global computing resources to store, distribute and analyze the ~25 Petabytes (25 million Gigabytes) of data annually generated by the Large Hadron Collider (LHC) at CERN on the Franco-Swiss border.
5
19 – March - 2013 ISGC 2013 6
DAE-wide Applications on NKN
• DAE-Grid : Grid resources at BARC, IGCAR, RRCAT and VECC
• WLCG and GARUDA
• Videoconferencing: with NIC, IITs, IISc • Collab-CAD : Collaborative design of sub assembly of the
prototype 500 MW Fast Breeder Reactor from NIC, BARC & IGCAR
• Remote classrooms : Amongst different Training schools
7
GARUDA OVERVIEW
8
The Garuda Grid
GARUDA – India’s national grid computing
initiative bringing together academic, scientific and
research communities for developing their data and
compute intensive applications.
Partners – More than 70 institutes
International collaborations – EGI, CaBig
9
Creating a Collaborative
Framework for solving applications which are
interdisciplinary requiring experts from
multiple domains and distributed
locations
Garuda - Motivation
Addressing the requirements of emerging HPC applications by
integrating geographically
distributed resources
Sharing of high-end
computational resources with the
larger scientific and engineering
community
Universal access to
Supercomputing resources
10
GARUDA Architecture
Programming
Development
Environment
Computing Resources and Virtual Organizations
Research Organizations
Educational institutions Computing Centers
WSRF+GT4 + other Services + Cloud S/W (Nimbus/ VMware)
NKN
Grid PSE
Virtualization support
Workflows
Grid Security and High-Performance Grid Networking
Data
Grid
Re
so
urce
En
ab
ler &
Mo
nito
rin
g
CDAC Resource centers
Access Portal CLI Visualization
Federated
Information Server
Job Scheduler
Programming Environments Grid Applications Security
Resource Management
User Environments Middleware Data Grid Resources
Hand held
devices
GARUDA – enabled Applications
Non – Research
Organizations
Cloud
Interface
11
Garuda Resources • CDAC Resources
• 4TF HPC clusters each at
Bangalore, Chennai &
Hyderabad
• PARAM Yuva at Pune and
PARAM Padma at Bangalore
• Fourteen of the partner institutions are also contributing resources
• Total computing power is more than 6000 CPUs equivalent to 70TF
• Storage space 220 TB
12
Garuda Partners
• Motivation
• To Collaborate on Research and Engineering Technologies, Architectures, Standards and Applications
• To Contribute to the aggregation of GARUDA resources
• Participation
• Over 50 research & academic institutions in the 17 cities
• 8 centres of C-DAC
• Additional over 20 labs
13
Garuda Virtual Organizations (VO) Group Name Description
Bioinformatics Application of statistics and computer science to the molecular biology
ClimateModelling Deals with the dynamics of the climate system.
OSDD Community dedicated to develop drugs for tropical infectious diseases like malaria, tuberculosis
GeoPhysics Study related to physics of the Earth and its environment in space
CAE usage of computer software to solve engineering problems
IndianHeritage Focused on technology products for preserving & processing Heritage texts
HealthInformatics Focused on utilizing compute power for health informatics
MaterialScience Interdisciplinary field applying the properties of matter to science and engineering
Euindia The vision of a worldwide Grid for Research by both Europe and India
ToolsDeveloper Forum to communicate and collaborate on developing Garuda Tools
GarudaAdmin Meant for administrators from resource providers & Garuda Operation team members
14
Garuda Applications
• Computational Fluid Dynamics – OpenFOAM: free, open source CFD software package.
• OpenFOAM 1.6 and 1.7 are already available in Garuda • OpenFOAM 2.1 is planned to enable
– CFDExpert – Reactor safety – Winglet Application
• Designing of the winglet to reduce the drag and hence improve the fuel efficiency.
• Winglet application simulation has been grid enabled to achieve remarkable improvements in the simulation time
• In collaboration with Zeus Numerix
• Climate Modeling (SFM, WRF, RegCM) • Collaborative Class Room • Disaster Management • Genomic applications (through OSDD )
15
GARUDA INTEROPERABILITY
16
Garuda - Interoperability
• EUIndiaGrid – Integrating technological components of Garuda and
EGI • gLite and Globus • Customizing Gridway meta-scheduler
• Collaboration between CaBig and Garuda – Interoperation of technological service among these
two grids – Cancer Research application portability – Contribution to standards for using distributed
computing in Healthcare
17
GARUDA - CHAIN Interoperability
C-DAC Activities for CHAIN • Facilitating authentication and
authorization of Science Gateway users in Garuda
• Implemented a mechanism for processing job requests from the Science Gateway to Garuda
• Data transfer between Science Gateway and Garuda
• Providing collated information about Garuda resources to Science Gateway
• Applications deployed – Computer Science and Mathematics:
Octave and R – Arts and Humanities : ASTRA and
SONIFICATION – Life Sciences : GROMACS – Weather prediction system: WRF
18
Garuda ROC
• Garuda Grid Operations & Administration (GGOA)
– Monitoring, Management and Issues & Incidence handling
– Request Tracker (RT)
• Bug tracking, help desk ticketing, customer service and workflow processes
– Job Accounting
19
GARUDA TOOLS & SERVICES
20
Megha
Garuda Tools
Garuda Access Portal
Paryavekshanam
Garuda GridFTP GUI
Garuda Information Registry
GVG Hub
GSRM 21
Garuda Services & Utilities
• Garuda SLCs
• Garuda Registration Service
• Login Service, VOMS Service
• Compiler Service
• Job Management Service
• Accounting Service
• Automatic Grid Service Generator
22
SCIENTIFIC CLOUD
23
Scientific Cloud
• Benefits – Easy access to large infrastructures and completely
customize their execution environment – On demand access to HPC resources. – Scalable Computing – Infrastructures tailored for research and application
requirements. – Virtual Ownership of resources – Easy deployment , backup and restoration
• CDAC’s Scientific Cloud – IaaS – Infrastructure as Services – SaaS – Software as Service
24
IaaS
• VMs with Pre-defined Machine Instances (OS flavours Ubuntu, Fedora & RHEL )
• RHEL based Virtual Clusters pre-loaded with NFS, Torque, Ganglia.
– MPI to run Parallel Applications.
– HADOOP environment to run map reduce application
25
SaaS
• Currently Available applications
– Scilab: Open Source Equivalent of Matlab
– VRGeo: Collaborative mapping platform for Geospatial information
– SFM : Seasonal Forecast Model, a weather prediction application.
– FASTA: Protein Sequence Analysis, a bio-informatics application
26
SaaS
• Coming Soon: – Scilab Web Application – Sahana Eden - Disaster Management application
• Future plans – GNU Octave: Numerical computations package with graphics
capabilities – Gromacs : Molecular dynamics package to study proteins and lipids. – R : Statistical computing package with Graphics capabilities. – OpenFOAM: open source CFD software package – OpenSees: The Open System for Earthquake Engineering Simulation – WRF : Mesoscale numerical weather prediction system – Visualization environments : Gnu plot, pov-Ray
27
THANK YOU!
?
28