janet update martin dunmore multi-service networks 2012 cosener’s house, abingdon, 12 th july 2012
TRANSCRIPT
Area Sites
Higher Education 211
Further Education 520
Local Authority123
Self-funded53
Research Council 41
948
Use of Janet
LA / Schools
HE/FE
Adult
Relative sizes of sectors: from funding body statistics on staff & student numbers
18 million possible users of JANET.
ConnectionsUsers
Network Figures
Routing equipment: ~100 routers in the core of JANET ~300 regional area routers ~520 end organisation routers
Circuits/fibres: ~1,500 circuits make up JANET
non-trivial task to monitor~80% of total outage time
The SuperJanet5 Network
•Six core points of presence.
•A core across the UK of 20Gbit/s, 80Gbit/s and 100Gbit/s.
•19 regional distribution areas.
•Multiple connections for resilience.
•~900 organisations connected.
•Point to point “light path” connections for research.
•~400Gbit/s external connectivity.
Global Transit#2
Global Transit#1
Glasgow
Leeds
London
Bristol
Warrington
Reading
Telecity HX
Telehouse
10G40G
100G
The Network
Telecity Manchester
Global Transit#3
Regularly Hitting > 100Gb/s of Traffic
From Janet To JanetMean 18.5 Gb/s 58.6 Gb/sMax 29.7 Gb/s 115 Gb/sMin 5.72 Gb/s 9.57 Gb/s
Typical week in May…
Total Janet Traffic PredictionJa
n'10
Mar
'10
May
'10
Jul'1
0
Sep'
10
Nov'
10
Jan'
11
Mar
'11
May
'11
Jul'1
1
Sep'
11
Nov'
11
Jan'
12
Mar
'12
May
'12
Jul'1
2
Sep'
12
Nov'
12
Jan'
13
Mar
'13
May
'13
Jul'1
3
Sep'
13
Nov'
13
Jan'
14
Mar
'14
May
'14
Jul'1
4
Sep'
14
Nov'
14
Jan'
15
Mar
'15
May
'15
Jul'1
5
Sep'
15
Nov'
15
0
100
200
300
400
500
600
All External TrafficActuals Projected If Traffic doubles every 2 Years (from Jan'2010)
Gbps
SuperJanet5 Janet6
• Similar topology to SJ5.• Two north-south paths• New east-west path from
Birmingham to Nottingham– Erdington to Lowdham
• No backbone PoP at Reading– Still have a regional PoP
• New PoP in Acton, West London
Janet6: Backbone Resilience
• Contractual– Favourable: Mandated 40Gbit/s in 2006 contract– Favourable: Worked with Verizon for deployment of
100GE– Less Favourable: Maximum bandwidth available for use
on each link• Increasing those needed technical and legal negotiations
• Engineering– Legacy of layered optical systems
• Provide 40G SDH and 100GE over system not designed for it
• Large “guard bands” of wasted bandwidth
Limits of SuperJANET5
• Manage the optical layer directly• For more detail see Networkshop presentation
– ROADM• Flexible optical platform
– DWDM– Theoretically 80 channels
– 100Gbit/s per lambda from day 1– Plans for 400Gbit/s and 1Tbit/s with better spectral
density• “Data DelugeBonanza”
– Big Science• LHC, SKA, Bioinformatics, ITER, Radio Astronomy, Climate
Data– Day-to-day usage
Removing SJ5’s limits
• Original 2006 T-640 chassis still in service– 40Gbit/s per slot, 32 10Gbit/s ports per chassis
• Most upgraded to T-1600– Same chassis, new switching fabric and PSUs– 100Gbit/s per slot
• T-4000– Same chassis, new switching fabric and PSUs– 240Gbit/s per slot, 192 10Gbit/s ports per chassis– Two power supplied for resilience
• Each one takes 6, 60A, 48VDC feeds – 17kVA!
• Migration– Janet6 will be in new PoPs– Can’t move all the connections overnight– New routers and hand back the old
Janet6 IP Platform
• Investigated provisioning over optical platform– Not enough competitive offers for smaller chassis
• Investigated merging Lightpath and IP platforms– IP platforms are already short on chassis space, some
locations would require additional chassis• Keep on current MX960 platforms
– Upgrade interconnects to 100GE– Move 10GE lightpaths from lambdas to EoMPLS circuits
• Scope for point to point circuits without committed bandwidth– Shared with Janet IP access
Janet6 Lightpath Network
Janet6 Procurement Strategy
• Options appraisal
• Procure dark fibre infrastructure
• Procure optical transmission equipment
• Management in-house by the Janet NOC
• Why? Agility
• Janet NOC will have a view from the fibre up the stack to the routers
• Fewer contract/administrative boundaries or chains to cross• Directly translate the community’s requirements into engineering
• Why? Different contractual vehicles for fibre and equipment
• Fibre: long-term, little need to change
• Optical equipment: rapidly evolving, highly competitive
competitive dialogue procedure
Progress to date
• Procurement kicked off October 2011
• Dialogue with 6 bidders during first half of 2012
• Bids received from 2 suppliers
Procurement Update – Fibre
Current Status
• SSET selected as preferred supplier
• Design optimisation
• Finalising contract & schedules
• Signature by end July 2012
Procurement Update – Fibre
Progress to date
• Procurement kicked off November 2011
• Dialogue with 6 bidders during first half of 2012
Procurement Update – Equipment
Current Status
• Bids received from all 6 suppliers
• Evaluation underway
• Selection by end July 2012
• Signature by mid September 2012
Procurement Update – Equipment
• Fibre delivery by end March 2013
• Equipment delivery by end April 2013
• Commissioning
• Migration by end July 2013
Rollout & Transition
Stuff we can help with
•Router configs•Network diagrams•Access to Netsight (SNMP data)
– Be careful what you wish for!
•Netflow data– SBR exporters (1:10 to 1:50)– Some BAR exporters– Regional routers as and when we can
• TVN, Eastern– Subject to agreement data is non-anonymised– We don’t have much disk space to store it – 100GB!
UK Testbed for Loc / ID Research
•Loc / ID – Decoupling Location and Identity from the IP address– LISP, HIP, ILNP, SHIM6, others
•Stimulate synergy between UK researchers in this area•Janet wants to get a handle on the operational pros/cons•Call for proposals should go out later this year
– Has been ready for a while but we need to resource internally
•Modest funding: max 30k•12 months but testbed would stay up after that
SDN / OpenFlow Testbed?
•Start off small scale– 3x OF switches in Core PoPs– 10G inter-switch– 1G switch to user
• ‘Usual Suspects’– 1 or 2 controllers
•Scale up organically•Who manages the
– HW ?– Service ?