nkn future roadmapworkshop.nkn.in/2013/images/presentation/talk-2ndnkn... · 2013-10-24 · nkn...
TRANSCRIPT
National Knowledge Network Page 1
NKN Future Roadmap
Challenges & Opportunities
Prabhakar Dhekne
Scientific Consultant to Principal Scientific
Adviser to GOI & Former Associate
Director E&I Group, BARC
2nd Annual NKN workshop at IISC, Bangalore from Oct 17-19, 2013
National Knowledge Network Page 2
Outline of Talk
• Global Research Collaborations
• Trends in e-infrastructure
• National Knowledge Network(NKN)
• Major Challenges & Opportunities
• Testing of Dark Fiber for NKN scaling
• Conclusions
National Knowledge Network Page 3
Research Collaborations
India is effectively participating in the major international experimental
programmes in Europe such as Large Hadron Collider (LHC), ITER, and
others. Participation in the European Framework Programmes has been very
fruitful and has enabled Indian scientists to collaborate in frontier research
activities with European colleagues.
Cooperation with Global Virtual Research Communities (GVRCs) through
projects like LHC Grid & EU-IndiaGrid gave India much needed impetus
for creating an e-infrastructure within the country. The cooperation has been
enhanced by two closely related EU-funded projects – EU-IndiaGrid2 and
CHAIN.
The EU-IndiaGrid project, which has allowed Indian scientists to access
major European and Indian Grid infrastructures exposing them to the grid
technology, made significant progress in last two years.
National Knowledge Network Page 4
Trend: Network Infrastructure
Grid & Cloud computing has demanded deployment of an advanced network infrastructure for Research & Education to be effective
Light (lambda network facility) is the response to the need for high-quality research and education. It will
help create a viable economy-of-scale model for the region to reduce networking costs per country,
serve as a test-bed for development of new services, and allow the R&E community to participate in international networking activities
support the growth of National Research & Education Networks (NRENs), accelerate research, fuel national and regional economic growth, and aid their integration with the rest of world.
Many countries today have Lambda Network Facility – an e-infrastructure
National Knowledge Network Page 5
The e-Infrastructure of India
Indian Grid
Certification
Authority
EU-IndiaGrid
CHAIN
TIFR-CERN link
National Knowledge Network: Enabling a Paradigm Shift in Research
Infrastructure And Global Science Cooperation
NKN is a state-of-the-art multi-gigabit pan-India network: www.nkn.in
National Knowledge Network Page 6
How Testing of NKN was done?
• Exhaustive testing was conducted
– Functional Testing (ping, test route, latency, packet loss)
– Sustainability Testing by HD Video-Con tests (Light weight,
lossy data permitted)
– End-to-End Performance & Reliability Testing using FTP data
transfer for short & long periods (Heavy weight, lossless data)
– Application testing
• Collab-CAD connecting BARC-IGCAR-NIC
• Grid Computing (DAE grid BARC-IGCAR-TIFR-VECC)
National Knowledge Network Page 7
Interconnect-Related Terms
Most critical component of HPC still remains to be interconnect
technology and network topology
Latency:
Networks: How long does it take to start sending a "message"?
Measured in microseconds- startup time
Round Robin Delay & Number of Hops
Processors: How long does it take to output results of some
operations, such as floating point add, divide etc., which are
pipelined?)
Bandwidth: What data rate can be sustained once the message is
started? Measured in Mbytes/sec or Gbytes/sec
National Knowledge Network Page 8 8
Best Effort is not Good Enough …
- Set up optimized
path
- Select Level 2,3
,4 switching
- Trade-off
between buffer
size & Appln
- Guaranteed end-
to-end
performance
Choice for QOS
National Knowledge Network Page 9 9
On the Network: Big Problems!
• Network Traffic Profile
• Mixing Traffic
• Trade of between buffer
size Vs Appln
## Better Data handling methods, Innovative Algorithms in Data analytics are
needed. Also high resolution data visualisation techniques & tools needed to be
developed !!!
National Knowledge Network Page 10
National Knowledge Network Progress Chart
NKN User Nodes Commissioned, Mar-14, 58
NKN User Nodes Commissioned, Apr-14, 60
NKN User Nodes Commissioned, May-14, 66
NKN User Nodes Commissioned, Jun-14, 69
NKN User Nodes Commissioned, Jul-14, 73
NKN User Nodes Commissioned, Aug-14, 75
NKN User Nodes Commissioned, Sep-14, 78
NKN User Nodes Commissioned, Oct-14, 81
NKN User Nodes Commissioned, Nov-14, 83
NKN User Nodes Commissioned, Dec-14, 85
NKN User Nodes Commissioned, Jan-15, 89
NKN User Nodes Commissioned, Feb-15, 104
NKN User Nodes Commissioned, Mar-15, 104
NKN User Nodes Commissioned, Apr-15, 152
NKN User Nodes Commissioned, May-15, 179
NKN User Nodes Commissioned, Jun-15, 199
NKN User Nodes Commissioned, Jul-15, 210
NKN User Nodes Commissioned, Aug-15, 248
NKN User Nodes Commissioned, Sep-15, 358
NKN User Nodes Commissioned, Oct-15, 382
NKN User Nodes Commissioned, Nov-15, 467
NKN User Nodes Commissioned, Dec-15, 606
NKN User Nodes Commissioned, Jan-16, 638
NKN User Nodes Commissioned, Feb-16, 672
712
NKN User Nodes Commissioned, Mar-17, 1500
NKN User Nodes Provisioned, Mar-14, 65
NKN User Nodes Provisioned, Apr-14, 67
NKN User Nodes Provisioned, May-14, 70
NKN User Nodes Provisioned, Jun-14, 72
NKN User Nodes Provisioned, Jul-14, 78
NKN User Nodes Provisioned, Aug-14, 79
NKN User Nodes Provisioned, Sep-14, 85
NKN User Nodes Provisioned, Oct-14, 91
NKN User Nodes Provisioned, Nov-14, 104
NKN User Nodes Provisioned, Dec-14, 121
NKN User Nodes Provisioned, Jan-15, 139
NKN User Nodes Provisioned, Feb-15, 157
NKN User Nodes Provisioned, Mar-15, 185
NKN User Nodes Provisioned, Apr-15, 224
NKN User Nodes Provisioned, May-15, 259
NKN User Nodes Provisioned, Jun-15, 270
NKN User Nodes Provisioned, Jul-15, 276
NKN User Nodes Provisioned, Aug-15, 418
NKN User Nodes Provisioned, Sep-15, 446
NKN User Nodes Provisioned, Oct-15, 471
NKN User Nodes Provisioned, Nov-15, 557
NKN User Nodes Provisioned, Dec-15, 667
NKN User Nodes Provisioned, Jan-16, 711
NKN User Nodes Provisioned, Feb-16, 754 774
NKN User Nodes Provisioned, Mar-17, 1500
No. of NKN User
Nodes
NKN Progress Chart
NKN User Nodes Commissioned NKN User Nodes Provisioned No. of user nodes
Virtual Classrooms,
Collab-CAD
Model
Projects
Immersive
Classrooms
Global Science Research Collaboration
through TIEN3, GEANT & European Grid
Initiative (EGI)
No. of user nodes projected
High Energy Physics experiment at Large
Hadron Collider, Climate Change Modeling,
OSDD
ESRF Synchrotron Lab at Grenoble, France,
Material Science, Bioscience, Brain Grid etc.
831
980
NKN crosses 1000 Plus !!!
National Knowledge Network Page 11
NKN Project Management
High Level Com
DIT TAC
Grid Appln Com
Security Adv Imp Com
Policy
e_Gov Com
NIC
Climate Change, HEP, Bio, Cancer, Brain, Agriculture, S&T
NKN - PIU
Implementing Agency
DG, NIC
Prof P.S.Dhekne
Dr. R.Chidambaram, PSA to GOI
Prof S.V.Raghavan
R.S.Mani, Project Director
NICSI
G.P.Srivastava
Dr. B.K.Gairola
Prof S.V.Raghavan
Model Projects Eval Com
National Knowledge Network Page 12
Performance Monitoring, Enhancement, and Scaling
Development of newer High-End Applications
Cyber Security attacks and Solutions
Make or Buy decisions
Establishment of Test labs & Certification
Major Challenges in the Future
National Knowledge Network Page 13
Explore Feasibility of setting up Sanitization Lab
Indigenization of Key NKN Components
Manufacturing & Quality Assurance
Deployment & Testing
Building Capacity & Capability in HR
Establishing International NKN PoPs
HLC Decisions
National Knowledge Network Page 14
NKN R&D Programme
Model Projects e-class rooms, edu-Medical, Collab-DDS, E-Foundry, DAE
outreach centre, Brain Grid, NBG
Design & Development of Indigenized Products
ITMA (SETS, BARC,NIC,ECIL)
SNAS (BARC, ECIL)
Optics Switch Router ESR series (IITB, ECIL)
Enterprise Router (C-DOT)
NMS (BARC, C-DAC, NIC, NTRO)
Establishing National Test Labs
Setting up of National Data Centres
National Knowledge Network Page 15
Participation in Model Projects
• Participation for model projects for key applications and to
take active part in feasibility, capability and sustainability
testing and ensuring effective use of high bandwidth of NKN
• Approach for using NKN
- Proposal in specific format to PSA’s office
- Make plan to implement close user group on NKN
- To demonstrate the potential/benefits of NKN
- Connecting additional sites to NKN
• Approx. 4-6 projects per year
National Knowledge Network Page 16
Via CERN NKN PoP
Via Singapore NKN PoP Singapore, Japan, Australia, and rest of Asia Pacific
Via USA NKN PoP
1. East Coast – NY
/ Wash DC / Chicago
2. West Coast –
Los Angeles / Seattle
NKN International Connectivity
Model Project scheme to showcase the
applicability across a spectrum of applications
focusing on education, health and life sciences
NKN HLC has cleared establishment of NKN PoPs overseas - US - Europe - Asia Pacific including Japan and Australia).
National Knowledge Network Page 17
Few aspects to be considered
• Sustainable applications of common
interest such as weather/climate
modeling & simulation, biodiversity,
Cancer and Brain Grids, Education
contents
• Agreeing on standard data formats
and data sharing policy
• R & D in advanced networking (100G
& above), software development etc
Enhancing Global Research Collaborations by enhancing network connectivity between NKN and the Research and Education Networks (RENs) of the world is becoming an absolute necessity.
Global Research Collaborations
National Knowledge Network Page 18
COMPUTE (more FLOPS)
DA
TA
(m
ore
BY
TE
S)
NETWORK
(more
BW)
Today’s Applications
Data and
High Performance
Computing
Data and
Cyberinfrastructure
Services
These applications, are both
data-intensive and compute-
intensive.
National Knowledge Network Page 19
ICFA Report 2009 - Main Trends Accelerate: Dark
Fiber Nets, Dynamic Circuits, 40-100G
Current generation of 10 Gbps network backbones and major Int’l links arrived in 2002-8 in US, Europe, Japan, Korea; Now China, Brazil
Bandwidth Growth: from 16 to 10,000X in 7 Yrs. >> Moore’s Law
Proliferation of 10G links across the Atlantic & Pacific since 2005
Bandwidth for LHC well above 100 Gbps in aggregate
Rapid Spread of “Dark Fiber” and DWDM: Emergence of Continental, Nat’l, State & Metro N X 10G “Hybrid” Networks in Many Nations
Appearance of terrestrial 40 and 100G MAN/WAN: 40G optical backbones in commercial and R&E networks are common
100G pilots/tests in 2009, first service deployments started
Point-to-point “Light-paths” for HEP and “Data Intensive Science”
Now Dynamic Circuits, and Managed Bandwidth Channels
Technology continues to drive Performance Higher, Costs Lower
Commoditization of GE now 10 GE ports on servers
Cheaper and faster storage ($ < 100/Tbyte); 100+ Mbyte/sec disks
National Knowledge Network Page 20
Dark Fiber Deployment & Testing
• NKN, NIC Team • Led by R S Mani
• IITB & ECIL Team • Led by Prof A Gumaste
• Railtel Team • Led by Mr. Bahuguna,CMD
: Evaluation & Testing on NKN
: Fiber lighting & Swiching
: Dark Fiber Provisioning
Dark Fiber was deployed for the first time in the
country using locally developed equipment
Experiment Coordinated by the PSA Office:
Organizations involved
National Knowledge Network Page 21
Test Setup Using ESR Router
• 5 ESRs (Routers developed by IIT Bombay & manufactured
by ECIL) operated at 10 G
• 2 Cisco ASR 9010
• 1 Cisco ASR 1002
• 1 Juniper MX 80
Devices Used :
National Knowledge Network Page 22
Network Connectivity
• Belapur ASR 9010 connected to Pune ASR 9010 through NKN
Cloud.
• Belapur ASR 1002 connected to Pune ASR 9010 through Railtel
dark fiber.
• 5 ESRs connected through Railtel dark fiber in the following
sequence.
NKN Belapur-Panvel-Lonavala-Pune Railway-NIC Pune
• Node A connected to Belapur ASR 9010.
• Node B connected to Belapur ASR 1002.
National Knowledge Network Page 23
Railtel dark fiber
Demo Institute at
Belapur
NKN
Cloud
LAN
ASR 1002
Belapur ESR
A
ASR 9K
Belapur
ESR
ASR 9K
Pune
B
14.139.4.62
14.139.109.244
FTP tested between A and B
Skype tested from B
Connectivity Diagram
ESR ESR
ESR
NIC Pune
Pune Railway
Lonavala Panvel NKN Belapur
National Knowledge Network Page 24
Applications Tested
• We have tested successfully following
applications through this darkfiber link
FTP.
Ping & Trace.
Internet.
Video Conferencing through Skype.
National Knowledge Network Page 25
Report Dated 27.09.2013
IP Address 14.139.4.62(Node A) connected to NKN cloud
IP Address 14.139.109.244 (Node B) connected to Pune ASR through Railtel dark fiber
Wan IP address Belapur Juniper MX80 end 10.119.252.45
Wan IP address Pune ASR9010 end 10.119.252.46
Test Reports with Juniper MX 80
1.Ping Report
2.Trace Report (Node B to Node A)
Sr. No. Time Source IP Address
Destination IP
Address
Minimum
Latency
Average
Latency Maximum Latency
Success
Rate
1 10:25 AM 10.119.252.45 10.119.252.46 3.53ms 11.53ms 29.19ms 100%
2 1:14 PM 10.119.252.45 10.119.252.46 3.43ms 7.41ms 81.25ms 100%
3 2:31 PM 10.119.252.45 10.119.252.46 3.24ms 3.78ms 6.66ms 100%
4 4:00 PM 10.119.252.45 10.119.252.46 3.28ms 3.77ms 7.70ms 100%
5 5:02 PM 10.119.252.45 10.119.252.46 3.59ms 3.70ms 3.78ms 100%
Sr. No. Time IP Address No. of Hops Latency
1 10:25 AM 14.139.4.62 4 6ms
2 1:21 PM 14.139.4.62 4 6ms
3 2:34 PM 14.139.4.62 4 6ms
4 4:00 PM 14.139.4.62 4 6ms
5 8:21 PM 14.139.4.62 4 6ms
National Knowledge Network Page 26
3.FTP Test report
3a. Date : 27.09.2013 ( FTP server IP:14.139.109.244)
Serial No File Size Transfer Rate Source IP Address Destination IP Address Errors if any Remarks
1 12.9 MB 0.220 MB/sec 14.139.4.62 14.139.109.244 0
2 82.8 MB 0.243 MB/sec 14.139.4.62 14.139.109.244 0
3 336 MB 0.324 MB/sec 14.139.4.62 14.139.109.244 0
4 521 MB 0.214 MB/sec 14.139.4.62 14.139.109.244 0
5 1.08 GB 0.378 MB/sec 14.139.4.62 14.139.109.244 3 Unable to transfer
NOTE : 1.08 GB file has not transferred and getting error (Could not write to transfer socket:
ECONNABORTED - Connection aborted ) while transferring the file.
3b. Date : 27.09.2013 ( FTP server IP:14.139.109.244)
Serial No File Size Transfer Rate Source IP Address Destination IP Address Errors if any Remarks
6 12.9 MB 1.201 MB/sec 14.139.109.244 14.139.4.62 0
7 82.8 MB 1.230 MB/sec 14.139.109.244 14.139.4.62 0
8 336 MB 1.262 MB/sec 14.139.109.244 14.139.4.62 0
9 521 MB 1.240 MB/sec 14.139.109.244 14.139.4.62 0
10 1.08 GB 1.252 MB/sec 14.139.109.244 14.139.4.62 1 Unable to transfer
NOTE : 1.08 GB file has not transferred and getting error (Could not write to transfer socket:
ECONNABORTED - Connection aborted ) while transferring the file.
National Knowledge Network Page 27
Report Dated 28.09.2013
IP Address 14.139.4.62(Node A) connected to NKN cloud
IP Address 14.139.109.244 (Node B) connected to Pune ASR through Railtel dark fiber
Wan IP address Belapur ASR1002 end 10.119.252.45
Wan IP address Pune ASR9010 end 10.119.252.46
Test Reports with Cisco ASR 1002
Sr. No. Time Source IP
Address Destination IP Address
Minimum
Latency Average Latency
Maximum
Latency
Success
Rate
1 10:32 AM 10.119.252.45 10.119.252.46 2ms 2ms 103ms 100%
2 12:12 PM 10.119.252.45 10.119.252.46 2ms 2ms 27ms 100%
3 2:39 PM 10.119.252.45 10.119.252.46 2ms 2ms 32ms 100%
4 6:09 PM 10.119.252.45 10.119.252.46 2ms 5ms 42ms 100%
5 7:09 PM 10.119.252.45 10.119.252.46 2ms 5ms 40ms 100%
6 7:45 PM 10.119.252.45 10.119.252.46 2ms 2ms 16ms 100%
TIME Serial No IP Address No. of Hops Latency
10:33 AM 1 14.139.4.62 4 6ms
12:12 PM 2 14.139.4.62 4 6ms
6:10 PM 3 14.139.4.62 4 6ms
7:10 PM 4 14.139.4.62 4 6ms
7:45 PM 5 14.139.4.62 4 6ms
1.Ping Report
2.Trace Report (Node B to Node A)
National Knowledge Network Page 28
3a. Date : 28.09.2013 ( FTP server IP:14.139.109.244)
Serial No File Size Transfer Rate Source IP Address Destination IP Address Errors if any Remarks
1 12.9 MB 0.330 MB/sec 14.139.4.62 14.139.109.244 0
2 82.8 MB 0.359 MB/sec 14.139.4.62 14.139.109.244 0
3 336 MB 0.366 MB/sec 14.139.4.62 14.139.109.244 0
4 521 MB 0.363 MB/sec 14.139.4.62 14.139.109.244 0
5 1.08 GB 0.381 MB/sec 14.139.4.62 14.139.109.244 0
3b. Date : 28.09.2013 ( FTP server IP:14.139.109.244)
Serial No File Size Transfer Rate Source IP Address Destination IP Address Errors if any Remarks
6 12.9 MB 1.201 MB/sec 14.139.109.244 14.139.4.62 0
7 82.8 MB 1.230 MB/sec 14.139.109.244 14.139.4.62 0
8 336 MB 1.235 MB/sec 14.139.109.244 14.139.4.62 0
9 521 MB 1.236 MB/sec 14.139.109.244 14.139.4.62 0
10 1.08 GB 1.236 MB/sec 14.139.109.244 14.139.4.62 0
3c. Date : 28.09.2013 ( FTP server IP:14.139.4.62)
Serial No File Size Transfer Rate Source IP Address Destination IP Address Errors if any Remarks
1 12.9 MB 0.287 MB/sec 14.139.4.62 14.139.109.244 0
2 82.8 MB 0.307 MB/sec 14.139.4.62 14.139.109.244 0
3 336 MB 0.283 MB/sec 14.139.4.62 14.139.109.244 0
4 521 MB 0.315 MB/sec 14.139.4.62 14.139.109.244 1
5 1.08 GB 0.288 MB/sec 14.139.4.62 14.139.109.244 0
3d. Date : 28.09.2013 ( FTP server IP:14.139.4.62)
Serial No File Size Transfer Rate Source IP Address Destination IP Address Errors if any Remarks
6 12.9 MB 4.404 MB/sec 14.139.109.244 14.139.4.62 0
7 82.8 MB 4.715 MB/sec 14.139.109.244 14.139.4.62 0
8 336 MB 4.785 MB/sec 14.139.109.244 14.139.4.62 0
9 521 MB 4.857 MB/sec 14.139.109.244 14.139.4.62 0
10 1.08 GB 4.845 MB/sec 14.139.109.244 14.139.4.62 0
3.FTP Test report
National Knowledge Network Page 29
Outcome from Tests
• Tested over 6 months for short term & long
term for
• Reliability
• Sustainability
• Compatibility across CISCO & Juniper
• Successful deployment of Dark Fibers from
PSU
• Suitability for NKN use
National Knowledge Network Page 30 30
Conclusions
Demand on Computations & Communication is likely to grow
exponentially in the future
Open access to publicly funded research results and data is
now becoming a reality Institutional Repositories will be important elements of the national information
infrastructure
Institutional repositories will need to address data issues as well as research
publications
Establishment of National Data Centres to provide advice,
guidance and data curation services for user community will be
essential
NKN must scale well constantly in terms of users, bandwidth,
end-to-end performance and QOS to be in the race !!!
National Knowledge Network Page 31
Faith of a user !!!
Thanks for your Attention !!!
2011
National Knowledge Network Page 32
Typical End Node Design
NKN
MPLS SERVICE
PE VLAN1-VPN Green
VLAN2-Blue
VLAN3-Red
Each Sub Interface
associated with different
VPN
v
v
802.1 Q
VPN Blue Site
BIO TECH
VPN Red Site
IIT H
Multi-VRF
Bio-Tech Lab
Phy Lab
Class Room VPN Green Site
DAE LAB
Ingress NKN Router Egress NKN Router
National Knowledge Network Page 33
Multiple Zones in NKN Router
User-
end-
Router
WLCG
Segment at
site
To NKN NKN Router at Site
Internet
Segment
at site Segment
at site
Additional CUG
National Knowledge Network Page 34
Linux server with 1 Gbps LAN, TCP/IP window (4MB, 8MB, 15.3 MB), Test Pgm: Iperf, Netpipe, Pathload
Test Set UP at BARC
Linux
Linux
MPLS-L3-VPN
BARC, Trombay
10.117.128.50
IGCAR, Kalppakam
10.117.136.5
VECC, Kolkata
10.118.56.10
TIFR, Mumbai
10.117.160.10
Max rate: 923.08 Mbits/s
Min rate: 333 Mbits/sec
1 Gbps
links with
babkbone
2.5 Gbps
National Knowledge Network Page 35
Collaborative design of sub assembly of the prototype 500 MW Fast Breeder Reactor from three remote locations from NIC, BARC & IGCAR
Test Set UP for Collab-CAD
Collab-CAD Collab-CAD
MPLS-L3-VPN
NIC, Delhi
10.x.x.x IGCAR, Kalppakam
10.117.136.5
BARC, Trombay
10.117.128.50
National Knowledge Network Page 36
Test Set UP at C-DAC
Garuda Grid at C-DAC, Banglore accessed from IISC, Bangalore by Prof Ravi S. Nanjundiah for running weather application
MPLS-L3-VPN
Atmospheric Sciences Dept. IISC, Bangalore
Weather Modeling
Garuda at C-DAC, Bangalore