Oct 28-29, 2009 Cloud Computing & NKN 1
Cloud Computing and NKN
P.S.Dhekne,
Raja Ramanna Fellow, BARC
Oct 28-29, 2009 Cloud Computing & NKN 2
Information Explosion
– Due to the popularity of Internet digital content is growing
exponentially and needs to be accessed quickly by all
– Today’s science is based on worldwide collaborations by
sharing computations, data, expensive equipments,
information/knowledge/wisdom across the Internet
– Researchers need more accurate & precise solutions to
their problems (from 1D to 3D) in shortest possible time
Oct 28-29, 2009 Cloud Computing & NKN 3
Collaborative environments
Trends: The e-Science
� e-Science is about using leading edge IT to deliver new science
� High-quality scientific computing services
� Management and exploitation of large scale scientific data
� Collaborative R&D
� Support for collaborative working
� Sharing expertise - technology transfer
� Based on core strengths:
Data analysis and
Computation
Data storageData management
Data driven e-Science
Oct 28-29, 2009 Cloud Computing & NKN 4
Mega Science Projects
•The LHC and Astro-
particle physics
experiments offer new
glimpses beyond the
current frontiers.
� LHC experiments will produce 10-15 million Gigabytes of data each year (about 20 million CDs!)
� LHC data analysis requires a computing power equivalent to ~ 100,000 of today's fastest PC processors.
� Requires many cooperating computer centres, CERN providing only ~20% of the CPU power
And the computing infrastructure to support such physics
research needs to look beyond the cutting edge.
Oct 28-29, 2009 Cloud Computing & NKN 5
LHC Data Grid Hierarchy
Tier 1
Tier2 Center
Online System
CERN 700k SI95 ~1 PB Disk; Tape Robot
FNAL: 200k SI95; 600 TBIN2P3 Center INFN CenterRAL Center
InstituteInstituteInstituteInstitute ~0.25TIPS
Workstations
~100-400 MBytes/sec
2.5-10 Gbps
0.1–10 Gbps
Physicists work on analysis “channels”
Each institute has ~10 physicists working on one or more channels
Physics data cache
~PByte/sec
~2.5-10 Gbps
Tier2 CenterTier2 CenterTier2 Center
~2.5-10 Gbps
Tier 0 +1
Tier 3
Tier 4
Tier2 Center Tier 2
Experiment
CERN/Outside Resource Ratio ~1:2Tier0/(ΣΣΣΣ Tier1)/(ΣΣΣΣ Tier2) ~1:1:1
Oct 28-29, 2009 Cloud Computing & NKN 6April 22, 2009 Developing e-inftrastructures in India 6
TIFR : CMS Tier II
Regional WLCG Tier II Grid in India 4 Mbps
Links
VECC/SINP: ALICE
Tier II
0.6/1 Gbps link
to CERN/GEANT100 Mbps
Link
Tier III 2 Mbps
IPLC
LC
Original Network started operating since 2007 and upgraded on regular basis
175 Mbps
Link to GEANT
Oct 28-29, 2009 Cloud Computing & NKN 7
International Connectivity
� Current status- TIFR-CERN link ( 0.6/1Gbps)
- ERNET-GEANT link(175 Mbps)
� Participation in TEIN3 � From India, ERNET was nominated to participate in South Asia
Feasibility Study(SAFS) meetings of TEIN3.
� SAFS report accepted by EC
� During SAFS meeting, we had projected 2.5 Gbps connectivity to India toward GEANT PoP in Europe and toward East Asia PoP of TEIN3
� We are going to participate in network procurement phase of TEIN3 for South Asia
� Connectivity to Internet2� To connect to TEIN3 PoP at Singapore at 622 Mbps from India
� Proposal from Japan for PoP in Chennai
Oct 28-29, 2009 Cloud Computing & NKN 8
Indian Grid Certification Authority
� ASGC played the role of Grid CA for India till recently
� First Grid CA in India was established at C-DAC, Banglore; Indian Grid
Certification Authority (IGCA) accredited by APGridPMA
� C-DAC presented IGCA in APGridPMA Face to Face meeting on 16th
Sep 2008 @ OGF24, Singapore.
� Reference: http://www.ogf.org/OGF24
http://www.apgridpma.org/meetings/index.html
� IGCA formally inaugurated on Jan 14, 2009 by Dr. R Chidambaram ,
PSA to Govt. of India and presided by Secretary, DIT
� IGCA is fully operational now and issuing user and host certificates
Oct 28-29, 2009 Cloud Computing & NKN 9
Trend: Network Infrastructure
� Grid has demanded deployment of an advanced network infrastructure for
Research & Education to be effective
� Light (lambda network facility) is the response to the need for high-quality
research and education. It will
� help create a viable economy-of-scale model for the region to
reduce networking costs per country,
� serve as a testbed for development of new services, and allow the
R&E community to participate in international networking
activities
� support the growth of National Research & Education Networks
(NRENs), accelerate research, fuel national and regional economic
growth, and aid their integration with the rest of world.
� Many countries today have Lambda Network Facility – an e-infrastructure
Oct 28-29, 2009 Cloud Computing & NKN 10
E-infrastructure
� E-infrastructure includes:
� Networks (internet, light paths…)
� Computers (workstations, servers, HPC…)
� Access controls (security, AAA…)
� Middleware (metadata…)
� Finding tools (portals, search engines…)
� Digital libraries (bibliographic, text, images, sound…)
� Scientific Databases
� Research data (national and scientific databases, individual
data…)
Oct 28-29, 2009 Cloud Computing & NKN 11
New Challenges in ICT
� Today’s ICT infrastructure is much more complex
� Distributed Computing (Clusters & Grids: PetaFlop Computing)
� Internet & Connectivity (OFC: e-infrastructures: Terabit Networking)
� Virtualisation (Distributed File System: Exabyte Storage)
� Heterogeneity and multidisciplinary information
� Software (Open Source Software and Open Standards)
� ICT isn’t glamorous any more – it just needs to keep working – reliability is everything
� Reliability and robustness are expensive and typically mean less flexibility
� Cost effectiveness and flexibility usually mean less reliability
� Need for Improved Efficiency, Business Continuity & Increased Agility
� Users no longer want to manage ICT infrastructures on 24X7 basis but would like to out source
Oct 28-29, 2009 Cloud Computing & NKN 12
Green Computing Initiative
– Almost half of recurring expenses on data centres come from
power bills (24/7 operation; example EKA)
– Measures like consolidation and virtualization are used to achieve
optimal utilization of IT infrastructure (Grids)
– Green Computing Initiatives and energy efficient technologies
(reduce emissions& increase cooling efficiency)
– Data centres are being redesigned to go green business processes
(Use of energy efficient technology like blade servers, thin client, LCD’s
etc; Global warming culprits)
– Only 20% computing resources come from Tier o centre at CERN
and rest come from collaborators (methods to improve operational
efficiencies)
Oct 28-29, 2009 Cloud Computing & NKN 13
Paradigm shift in Computing
Oct 28-29, 2009 Cloud Computing & NKN 14
Cloud Computing: Computing as a Service
Provision of virtualized resources on a commercial Cloud for example by
Amazon, IBM, Google, Yahoo, Microsoft, so that user need not own the
resources or invest on it but can use it transparently & dynamically as per
his demand paying only for the usage
What is Cloud Computing?
A style of computing where
massively scalable IT-enabled
capabilities are provided "as a
service" over the Internet to
multiple users
Grid is a enabling technology for
Cloud computing
India
USA
Europe
Oct 28-29, 2009 Cloud Computing & NKN 15
What is Cloud Computing?
4+ billion phones by 2010 [Source: Nokia]
Web 2.0-enabled PCs, TVs, etc.
Businesses, from startups to enterprises
An emerging computing paradigm where data and services reside in massively
scalable data centers that can be ubiquitously accessed from any connected
devices over the Internet. The cloud – a service oriented business/
software/hardware platform on the Internet -- rather than from a specific
identifiable device -- aims to deliver supercomputing power over the Internet --
any subscription-based or pay-per-use service that in real time, extends IT's
existing capabilities over the Internet
Oct 28-29, 2009 Cloud Computing & NKN 16
Benefits of Cloud Computing
• Cloud computing providing unlimited infrastructure to store and
execute customer data and program. As customers you do not
need to own the infrastructure, they are merely accessing or
renting, they can forego capital expenditure and consume
resources as a service, paying instead for what they use.
Benefits of Cloud Computing :
• Minimized Capital expenditure
• Location and Device independence
• Utilization and efficiency improvement
• Very high Scalability (expand on-the-fly as needed)
• High Computing power
Oct 28-29, 2009 Cloud Computing & NKN 17
Players in Cloud Computing
Commercial Cloud: Amazon EC-2
Scientific Cloud: Nimbus (University of Chicago)
Open Source technologies: Globus VWS (Globus
compatible), Eucalyptus (Interface similar to EC2),
OpenNEbula
Google's App Engine
Windows Azure
Gogrid (www.gogrid.com)
IBM Cloud Computing Initiative
Oct 28-29, 2009 Cloud Computing & NKN 18
Major types of clouds
� Compute and Data Cloud
� EC2 Amazon (Elastic Computing Cloud), Google Map Reduce, Science clouds
� Provision platform for running science codes
� Open source infrastructure: workspace, eucalyptus, hub0
� Virtualization: providing environments as VMs
� Hosting Cloud
� GoogleApp Engine
� Highly-available, fault tolerance, robustness, etc for Web capabilities
� Community example: IU hosting environment (quarry)
Oct 28-29, 2009 Cloud Computing & NKN 19
The Science Clouds
� Powered by workspace tools
� EC2-like interfaces (PKI credential vs credit card)
� More clouds on the way
� http://workspace.globus.org/clouds
“Stratus”University of Florida
16x4 nodes
“Nimbus”University of Chicago
16x2 nodes
Public IPsPrivate IPs(via VPN)
Oct 28-29, 2009 Cloud Computing & NKN 20
Oct 28-29, 2009 Cloud Computing & NKN 21
Pricing on GoGrid
CPU RAMDisk Space
Cost per Hour *
1 x Core 0.5 GB 30 GB as low as $0.04
1 x Core 1 GB 60 GB as low as $0.08
1 x Core 2 GB 120 GB as low as $0.19
3 x Core 4 GB 240 GB as low as $0.36
6 x Core 8 GB 480 GB as low as $0.76
Data Transfer **
•Outbound: as low as $0.17 / GB •Inbound: FREE
Cloud Storage
•FREE 10GB per month •$0.15 per GB per month(in excess of 10GB)
* Cloud Server Pricing based on Enterprise Cloud Plan** Outbound Data Transfer Pricing based on 6TB Data Transfer plan
Oct 28-29, 2009 Cloud Computing & NKN 22
Cloud Server Pricing
With Pay-as-you-go Plan, Server RAM hours are billed at $0.19 per GB of deployedRAM per Hour. Per server, that breaks down to:
CPU RAM Disk Size Cost per Hour
1 x Xeon 0.5 GB 30 GB $0.095
1 x Xeon 1 GB 60 GB $0.19
1 x Xeon 2 GB 120 GB $0.38
3 x Xeon 4 GB 240 GB $0.76
6 x Xeon 8 GB 480 GB $1.52
Oct 28-29, 2009 Cloud Computing & NKN 23
IDG News Service | 14.10.2009
The US Department of Energy will spend $32 million on a
project that will deploy a large cloud computing test bed with
thousands of Intel Nehalem CPU cores and explore the work of
commercial cloud offerings from Amazon, Microsoft and
Known as Magellan project, it will look at cloud computing as a
cost-effective and energy-efficient way for scientists to
accelerate discoveries in a variety of disciplines, including
analysis of scientific data sets in biology, climate change and
physics
Oct 28-29, 2009 Cloud Computing & NKN 24
National Knowledge Network: Objective
� The objective of the National Knowledge Network is to
bring together all the stakeholders in Science, Technology,
Higher Education, Research and Development, GRID
Computing, e-governance with speeds scalable eventually
up to the order of 10s of gigabits per second coupled with
extremely low latencies.
� NKN will interconnect all the research, higher education
and scientific institutions in the country, over a period of
three years.
� The joint proposal for the establishment of NKN was
initiated by the PSA’s Office and the National Knowledge
Commission and then taken up by the Department of IT.
Oct 28-29, 2009 Cloud Computing & NKN 25
Action Taken
�NKN was first announced in the budget/2008 - 100 Cr. initial allocation
�High Level Committee ( HLC) was formed
� Technical Advisory Committee was set up for designing NKN
�NIC will manage the implementation of the project and prepare the DPR
�HLC decided to implement the same in two phases
�Initial Phase
�Final Phase
� Initial Phase: By augmenting NIC’s Points of Presence at 15 locations (2.5
gbps) and to provide 1 Gbps links to 57 institutions
�NKN will enable Sectoral Overlay Network
� Agreement with PSU’s (BSNL/PGCIL/Railtel) for supporting fiber for 10
years
Oct 28-29, 2009 Cloud Computing & NKN 26
NKN Design Philosophy
�Common National e-infrastructure like national
highway, wherein different categories of users
shall be supported
�To build a scalable network, which can expand
both in Reach (spread across the entire country)
and Speed (capacity)
Oct 28-29, 2009 Cloud Computing & NKN 27
NKN Features
� High Capacity, Highly Scalable Backbone
� Provide Quality of Service (QoS) and Security
� Wide Geographical Coverage
� Bandwidth from many NLD’s
� Highly Reliable & Available by Design
� Test beds ( for various implementation)
� Dedicated and Owned.
� Connectivity for International & other global R&D Networks
Oct 28-29, 2009 Cloud Computing & NKN 28April 22, 2009 Developing e-inftrastructures in India 28
NKN
TOPOLOGY
Oct 28-29, 2009 Cloud Computing & NKN 29
NKN of INDIA
Oct 28-29, 2009 Cloud Computing & NKN 30
Implementation of Initial Phase of NKN
� Core links of 2.5 gbps created by various NLD on an
experimental basis for 6 months.
� Equipment at NIC Backbone upgraded to cater to
multiples of 2.5 gbps
� 57 institutions / organisations to be connected (42 already
connected)
� Creation of 48 virtual Class Rooms at various Mentoring &
Mentored IITs. (16 Already in place)
Oct 28-29, 2009 Cloud Computing & NKN 31
Status on NKN (initial phase)
� Design of the NKN is complete. (including final phase)
� The Backbone of the initial Phase is ready and operational.
� 42 Institutes have been connected so far. 50 more will be
connected in the next 6-8 months.
� 16 Class rooms have been equipped with the Virtual Class Room
facilities
� Rest are getting ready for Mentoring / Mentored IIT’s.
Oct 28-29, 2009 Cloud Computing & NKN 32
Inaugurated by President of
India on April 9, 2009
Oct 28-29, 2009 Cloud Computing & NKN 33
NKN connectivity
� NKN Highway will have minimum of 100mbps
connectivity. Hence all the nodes that hook on to
NKN will be on that speed.
� All the colleges and Polytechnics needs to be
aggregated and brought on to NKN.
� Routers and switches to take connections from
User Organizations
Oct 28-29, 2009 Cloud Computing & NKN 34
Typical End Node Design
NKN
MPLS SERVICE
PEVLAN1VLAN1--VPN GreenVPN Green
VLAN2VLAN2--BlueBlue
VLAN3VLAN3--RedRed
Each Sub Interface
associated with different VPN
vv
vv
802.1 Q
VPN VPN BlueBlue SiteSite
BIO TECHBIO TECH
VPN VPN RedRed SiteSite
IIT HIIT H
Multi-VRF
Bio-Tech Lab
Phy Lab
Class RoomVPN Green SiteVPN Green Site
DAE LABDAE LAB
Ingress NKN RouterEgress NKN Router
Oct 28-29, 2009 Cloud Computing & NKN 35
Integrating existing networks on NKN
NICNET POPs are upgraded to implement initial phase of
NKN
The major PoPs of ERNET are already a part of NKN - IISC,
VECC, RRCAT, IIT(Chennai, Kanpur, Guwahati), IUCAA,
University of Rajasthan
Out of 45 institutes participating on Garuda application 24
are already in the initial phase of NKN
Most of WLCG, EU-IndiaGrid and DAE Grid sites are
included in the initial phase of NKN
Oct 28-29, 2009 Cloud Computing & NKN 36
Applications to show cased
• Education & Research
• Countrywide Real Time Classroom (IITs)
• GRID Applications
• Agriculture
• Health Care
• Industry
• e-governance
• Knowledge content creation
Oct 28-29, 2009 Cloud Computing & NKN 37
What is running on NKN?
� Readiness during inauguration of NKN on 9th April 2009
� Virtual real-time Classrooms in IIT’s (Chennai-Hyd, Mumbai-
Gandhinagar and Guwahati- Patana)
� Grid Computing using DAE Grid (BARC-IGCAR-RRCAT-
VECC)
� Weather Modeling on Garuda Grid of C-DAC (C-DAC-IISC)
� Collab-CAD application for reactor component design from
IGCAR-NIC-BARC
� Open source Drug discovery from CSIR
Oct 28-29, 2009 Cloud Computing & NKN 38
NKN Events
• The initial phase of the NKN was inaugurated by the
President of India on 9th April, 2009
• NKN workshop at NIC Delhi on 4th July 2009 to train
network administrators on NKN
• NKN workshop at BARC, Mumbai on December 10-11
December 2008 for training users and systems people
• User Workshop on NKN Applications at NIC, Delhi during
Nov 2008
Oct 28-29, 2009 Cloud Computing & NKN 39
Model Projects
Funds are allotted for implementing about 20-25 model projects
(with unique application in each domain using NKN
backbone) as a proof-of-concept project to demonstrate the
feasibility, capability and effective use of high bandwidth.
Projects under consideration (max 25 with up to Rs 1 Cr each)
- e_Mentoring in Maths Science (IISER, CBS, CMI, HBCSE, TIFR, BARC – Prof
Sujatha Ramdorai)
- Cancer Research & Education (TMH- Dr. Badve)
- Grid for Eye Care (Shankar Netralaya -Dr. Lingam Gopal )
- Climate Modeling (MOES- Dr. Goswami)
- E_governance from Planning Commission (Dr. Pani)
- Public Health Education (Dr. Mohandas)
- Knowledge Hub at Hyderabad
Oct 28-29, 2009 Cloud Computing & NKN 40
Working as a Close User Group (CUG) of connected Institutions
UOHYD
INTERNET
IIT, Hyderabad
LVP,Hyd
NKN Connectivity for each Model project
IIIT, Hyd
NKN POP
NKN Japanese Collaboration to set up IIT, Hyderabad
Virtual Community NKN
SV Univ, Tirupati Japan REN
IIT, Chennai
Possible NKN-JPREN International link 10 Gbps
Oct 28-29, 2009 Cloud Computing & NKN 41
NetworkStorageServers
Messaging
OSS Based
Directory
OSS Based
File Systems
OSS Based
Database
OSS Based
Workflow
OSS Based
Security
OSS Based
Web Services
Services Framework for evolution of Knowledge Hub
Foundation Technologies &Defining work packages
LAMP and open tools
Open Services Framework
Client Portal InterfaceWeb Interface
Web Services (SOA)
API
Open source software & tools
Physical
Oct 28-29, 2009 Cloud Computing & NKN 42
NKN Grid brings Climate Change modelling for
capacity building
NKN Grid brings Climate Change modelling for
capacity building
High Speed NKN
Grid Links
High Speed NKN
Grid Links
CRL, Pune
IISC,
Banglore
PARAM, C-DAC
IITM, Pune
IMD, Delhi
LINUXLINUX
LINUXLINUX
Researcher
IIT Delhi
Secretary MOES has requested for connecting their sites to NKN
Oct 28-29, 2009 Cloud Computing & NKN 43
Concerns about Cloud Computing
– Performance, reliability, and SLAs,
– Control of data, and service parameters,
– Application features and choices,
– Interaction between Cloud providers,
– No standard APIs – mix of SOAP and REST!
– Privacy, security, compliance, trust…
Oct 28-29, 2009 Cloud Computing & NKN 44
Security issues
• Security issues must be addressed, these include the
following:
– User Authentication,
– Access control (Authorization),
– Data security,
– Credential security,
– Client security,
– Acceptable use of new tools
Oct 28-29, 2009 Cloud Computing & NKN 45
Summary
• NREN have become major platform for e_science users
• Cloud Computing is seen as the next generation
architecture of IT Enterprise – a flexible & affordable IT
infrastructure
There is no need for the user to own the IT infrastructure, it
can be merely accessed or rented, by paying for the actual use
thus saving huge cost & headaches of IT management
• We are learning creation, operation and negotiations of
Virtual organizations (VO) in NKN
• Issues in security or security problems, quality and
reliability in NKN have to be handled with care
Oct 28-29, 2009 Cloud Computing & NKN 46
Thanks for your attention
Oct 28-29, 2009 Cloud Computing & NKN 47
Benefits of NKN
• National Research & Education Network(NREN): e-
infrastructure
- Ultra High speed (OFC), low latency network with scalability in
terms of reach & capacity
• Cost advantage due to consolidation and sharing - virtualization
• Central depository of software services & data bases for
multidisciplinary applications - effective usage
• Foundation for seamless & secure collaboration over network – uniform interfaces