a metropolitan 10gbps dwdm
TRANSCRIPT
-
7/27/2019 A Metropolitan 10Gbps DWDM
1/26
NORTEL NETWORKS CONFIDENTIAL 1
OMNInet: A Metropolitan 10Gb/s DWDMPhotonic Switched Network Trial
April 13, 2004
Paul Daspit
Advanced Technology Investments Group,
Nortel Networks
-
7/27/2019 A Metropolitan 10Gbps DWDM
2/26
NORTEL NETWORKS CONFIDENTIAL 2
Agenda Rationale and Applications
Network Architecture
Photonic Switch Implementation
Control Plane
Results Research Projects
-
7/27/2019 A Metropolitan 10Gbps DWDM
3/26
NORTEL NETWORKS CONFIDENTIAL 3
Optical Metro Network Initiative
Partnership
Nortel Networks
SBC Communications
International Corporation for Advanced Internet Research
(iCAIR)/Northwestern University
Experimental metropolitan photonic network field tr ial
10Gb/s Ethernet WAN and LAN service over a
wavelength-granularity photonic switched network
G.ASON, GMPLS Control Plane
-
7/27/2019 A Metropolitan 10Gbps DWDM
4/26
NORTEL NETWORKS CONFIDENTIAL 4
Enhanced metro photonic
services
O-VPNs
Dial-a-lambda service
Router by-pass
Emerging applications Optical GRIDs
Storage on demand
Data Mining 3D teleconferencing
Visualization
Large-Science Apps
Services and Applications
3D Virtual Museum
3D Multi-media
Virtual Design
-
7/27/2019 A Metropolitan 10Gbps DWDM
5/26
presentation name NORTEL NETWORKS CONFIDENTIAL PG 5
Site SSite L
Site T
12.3 km7.6 km
24.8 km7.2 km
24.6 km7.4 km
= Glass-Thru Central Office
Starlight Photonic
Labs
Site F
CA*Net 3
Network Configuration
4 sites in Chicago
6 fiber spans
4 wavelength planes
Partial mesh network
Visualization Lab
Data Mining Lab
-
7/27/2019 A Metropolitan 10Gbps DWDM
6/26
NORTEL NETWORKS CONFIDENTIAL 6
OMNInet Network Configuration-2004
10 GigE
10 GigE
Photonic
Node
PhotonicNode
PhotonicNode
10/100/GigE
10/100/GigE
10/100/
GigE
10/100/GigE
10 GigE
Optera5200
10Gb/sTSPR
PhotonicNode
4
PP
8600
10 GigE
PP
8600
PP
8600
234
1
23
1
Optera5200
10Gb/sTSPR
10 GigE
10 GigE
Optera5200
10Gb/sTSPR
234
1
Optera5200
10Gb/s
TSPR
234
1
1310 nm 10 GigEWAN PHY interfaces
10 GigE
10 GigE
PP
8600
SBC Fiber
KM MI
[1*] 35.3 22.0
[2] 10.3 6.4
[3*] 12.4 7.7[4] 7.2 4.5
[5] 24.1 15.0
[6] 24.1 15.0
[7*] 24.9 15.5
[8] 6.7 4.2
[9] 5.3 3.3
[10]
NWUEN
Link
Span Length
* not in use
CAMPUS
FIBER (16)
EVL/UIC
OM5200
LAC/UIC
OM5200
CAMPUS
FIBER (4)
INITIALCONFIG:
10 LAMBDA
(all GigE)StarLight /Lakeshore
Interconnectwith otherresearch
networks
10GE LAN PHY (Apr 04)
8x8x8 Scalable photonic switch Trunk side 10G DWDM
OFA on all trunks
TECH/NU-E
OM5200
CAMPUS
FIBER (4)
INITIAL
CONFIG:
10 LAMBDAS
(ALL GigE)
Optera Metro 5200 OFA
[1*]
[5]
[6][2]
[3*]
[4]
[8] [9]
[7*]
Fiber in use
Fiber not in use
5200 OFA
5200 OFA
Optera 5200 OFA
5200 OFA
[10]
-
7/27/2019 A Metropolitan 10Gbps DWDM
7/26
presentation name NORTEL NETWORKS CONFIDENTIAL PG 7
Fiber Infrastructure
SBC metro G.652/SMF-28 single mode fiber
Next pair selected from installed fiber plant Longest span ~25km
2 to 5 Glass thru per span
Span losses from 6dB to 13dB (1550nm) 0.5dB/km to 1.2dB/km
Characterization tests ORL, PMD, CD, OTDR
-
7/27/2019 A Metropolitan 10Gbps DWDM
8/26
presentation name NORTEL NETWORKS CONFIDENTIAL PG 8
C-band ITU-T grid 200GHz spacing
4 wavelengths installed in the test bed:
1550.92 nm 1552.52 nm
1547.72 nm 1549.32 nm
Switch supports 8 wavelengths
Per-wavelength power grooming enabled a mix ofhigh and low performance TRx (FEC, ModulatorDriver)
24 possible light paths on each wavelength
plane: 96 total Longest lightpath ~75 km
DWDM Lightpaths
-
7/27/2019 A Metropolitan 10Gbps DWDM
9/26
NORTEL NETWORKS CONFIDENTIAL 9
Optical Link Impairments
Electrical crosstalk
Receiver noise
Timing jitter
Electric
Sensitivity
Fiber Losses
Chromatic dispersion
Back reflections
Polarization mode dispersion
Nonlinear effects
Tx Rx
Optical power tolerance
Modulator chirp
Laser wavelength stability
Laser relative intensity noise
Electrical cross-talk
Extinction ratio
Back reflection effects
Timing jitter
Losses
Optical amplifier effects on OSNR
Amplifier Transient DWDM filter shape
Optical crosstalk
Back reflections
Polarization-dependent loss
Built Into
Transmission
Margin
ActivelyControlled
-
7/27/2019 A Metropolitan 10Gbps DWDM
10/26
presentation name NORTEL NETWORKS CONFIDENTIAL PG 10
Link budget is deterministic and computed to workin all 24 network configuration.
Link loss diversity 6dB to 13dB
Node loss diversity 6dB to 10dB
Commercial optical amplifiers pre-amp and/or post-amp configurations
23dB constant-gain
Minimum OSNR 32dB for LAN interfaces (experimental hardware)
24dB for WAN interfaces (product hardware)
FEC RS(255, 239) implemented on WAN wavelengths Dispersion compensated on longest span (chirpy
EML on experimental hardware)
Link Budget
-
7/27/2019 A Metropolitan 10Gbps DWDM
11/26
NORTEL NETWORKS CONFIDENTIAL 11
Transmitter IDPower monitoring and signal
tagging system implemented.
Transmitter signal tagged withunique 100kHz - 400kHz AM tone.
Tone sensing using simple
photo-detection circuits and
DSP-based analyzer.
Tone power proportional to the
optical power.
Used to sense power and ID bothmuxed and single wavelength fibers.
0.1dB precision, 0.5dB accuracy.
Tone Modulation on data
carrier (Exaggerated).
-
7/27/2019 A Metropolitan 10Gbps DWDM
12/26
NORTEL NETWORKS CONFIDENTIAL 12
Node Configuration.
Client
interfaces:
10/100
Gigabit
Ethernet
1234
Inter-
Node
Fibers
PP8600
Switch
Router
10 Gb/s
Transponder
1310nm
WAN
1310nm
WANEDFA
10 Gb/s
Transponder
LAN
LAN
OPTera
Metro 5200
Opetra Metro
5200
10 Gb/s
Transponder
Photonic Switch Node
OPM & VOA
2-D MEMs switch
mux/demux OFA
Passport 8600
Ethernet
Switch/Router
(Commercial and
Experimental Interfaces)
Monitors
Metro Amplifiers
ITU-T
C-band
waves
-
7/27/2019 A Metropolitan 10Gbps DWDM
13/26
NORTEL NETWORKS CONFIDENTIAL 13
Site InstallationMosaic of node at Site F
Passport 8600 OPTera 5200
Transponder
10GE LAN Blades10GE WAN Blade
OPTera 5200
Optical Amplifier
Photonic Switch
Node Control ler
and DSP
PhotonicSwitch Node
Overlay Management
Network hub/switch
Power Inverter
-
7/27/2019 A Metropolitan 10Gbps DWDM
14/26
NORTEL NETWORKS CONFIDENTIAL 14
1-23-4
5-6
7-8
From
EthernetSwitch /
OTR
#1 TributaryLine Card
+
Monitor
1-23-4
5-6
7-8
FromInter-
Node
Fiber
#8 TrunkLine
Cards
Fiber Shuffles
Optical Backplanes
5-6
7-8
1-23-4
5-6
7-8
ToEthernet
Switch /
OTR
#1TributaryLine Card
+
Monitor
ToInter-
Node
Fiber
INPUTS OUTPUTS
3-4
1-2
2x 8X8Switch Fabric
VOA
1-23-4
5-6
7-8
#8TrunkLine
Cards
Photonic Switch Architecture
Wavelength plane architecture can connect any input signal of aspecific wavelength to any output without wavelength translation.
Could switch 8 instances of 8 wavelengths.
Larger Photonic Switch Node 640 x 640 wavelengths using the
same architecture was developed.
Much more efficient switch architectures are subject of multiplepatent applications
-
7/27/2019 A Metropolitan 10Gbps DWDM
15/26
NORTEL NETWORKS CONFIDENTIAL 15
Node LNode T Node S
Node F
Network Optical Link
(Data Plane)
Photonic Switch
TCP/IP connectivity
(Control Plane)
(Routing Card)
O-UNI-N
WRP WDP
OLMPP
SCP
Management or
User Workstation
Access Optical Link
Optical Service Client
(or CPE)
Proxy
O-UNI-C
Server
I-NNI
UNI Service I/FO-UNI-C
G.ASTN Control Plane with O-UNI
UNI control interface
-
7/27/2019 A Metropolitan 10Gbps DWDM
16/26
NORTEL NETWORKS CONFIDENTIAL 16
OMNInet Control Plane:
Protocols & Interfaces System configuration/maintenance
Consolidated optical link/interfaceconfiguration
Support on-line static/dynamic
link/interface provisioning
Module start/stop, memory andresource management
Configuration data storage
Wavelength Routing Protocol (WRP)
Optical topology discovery andinventory of physical link resource
New path selection/optimizationalgorithm to support trafficengineering and constraint-basedrouting
O-UNI interworking & controlintegration
Integrated path selection andprotection/restoration with WDP
O-VPN support
Wavelength Distribution Protocol (WDP)End-to-End, on-demand light path signaling
for I-NNI
Bi-directional LSP
Optical Connection Admission Control (CAC)
Generalized label and wavelength label set
1:1 & 1:N Light path restoration
Optical Link Management Protocol (OLMP)Control channel monitoring
TE link resource management
Optical link fault isolation
Verify dark fiber connectivity
O-UNI serverClient register/de-register
TNA address resolution
VPN group auto discovery
On-demand light path creation/deletion
Light path status enquiry
-
7/27/2019 A Metropolitan 10Gbps DWDM
17/26
presentation name NORTEL NETWORKS CONFIDENTIAL PG 17
Network has been operating since 2001
Most l ightpaths have less than 10 packets lost permil lion (Measurement limited)
Stressed l ightpath 50 packets lost per mil lion (~10-10BER)
More than 1000 lightpath setup/teardown operations
No optical component failures
Results
Site SSite L3
Site T
12.34 km7.60 km
24.75 km7.20 km
24.57 km7.37 km
StarLight Photonic
Labs
Site F
CA*Net 3
IXIA
Tester
~75km path
Visualization Lab
Data Mining Lab
-
7/27/2019 A Metropolitan 10Gbps DWDM
18/26
presentation name NORTEL NETWORKS CONFIDENTIAL PG 18
Technology field tr ial
Photonic switched network
Highly managed photonic layer Scalable photonic switch architecture
Standards-based control plane
For bandwidth intensive applications
Network continues to operate as infrastructure forcontent networking research (DARPA DWDM-RAM
project)
Summary
-
7/27/2019 A Metropolitan 10Gbps DWDM
19/26
NORTEL NETWORKS CONFIDENTIAL 19
References to experiments using OMNInet
Photonic TeraStream demonstration over OMNInet
http://www.startap.net/starlight/igrid2002/photonicTeraStream02.html A Case for the Global Access to Large Distributed Data Sets using Data
Webs Employing Photonic Data Services http://storageconference.org/2003/papers/08_Grossman-Case.pdf
Distributed Optical Testbed (OMNInet provides one leg of the DOT) http://www.dotresearch.org/about.html
SABUL experiments over OMNInet http://www.rgrossman.com/pdf/sabul-hpdtp-11-02.pdf
Northwestern University Information Technology Annual Report - 2002(pp14 & 17 refers) http://www.it.northwestern.edu/AR02/report.pdf
FAST TCP Experiments (see last 4-5 charts for OMNInet reference)
FAST v3
-
7/27/2019 A Metropolitan 10Gbps DWDM
20/26
NORTEL NETWORKS CONFIDENTIAL 20
DWDMRAM
DWDMRAM
Data@LIGHTspeed
-
7/27/2019 A Metropolitan 10Gbps DWDM
21/26
NORTEL NETWORKS CONFIDENTIAL 21
DWDM-RAM
DARPA funded research project
Architecture for data-intensive services
Manage extremely large sets of distributed data
Dynamic on-demand light path and e-path provisioning
Network resource scheduling
Demonstrations
GGF9 (Chicago, Oct 2003)
SC2003 (Phoenix, Nov 2003)
Chicago, Jun 2004 (SUPERComm)
Current research/experiment activity:
Multiple sequential service requests
File transfer performance measurements and metrics
Other transport protocols
-
7/27/2019 A Metropolitan 10Gbps DWDM
22/26
NORTEL NETWORKS CONFIDENTIAL 22Data Transmission Plane
ConnectionControl
Data
storage
switch Data
Center
1
n
1
n
DataPath
Data
Center
Applications
Optical ControlPlane
Data Path Control
Data Transfer
Scheduler
Storage
Resource
Service
Dynamic Optical Network
Basic Network
Resource
Service
OtherServices
Processing
Resource
Service
Network
Resource
Scheduler
Basic Data
Transfer ServiceData Transfer
Service
Network
Transfer
Service
External Services
-
7/27/2019 A Metropolitan 10Gbps DWDM
23/26
NORTEL NETWORKS CONFIDENTIAL 23
Chicago
OMNInet Tetsbed Node Locations
-
7/27/2019 A Metropolitan 10Gbps DWDM
24/26
NORTEL NETWORKS CONFIDENTIAL 24
End-to-end Transfer time(Not Optimized)
ODIN Server
Processing
File transfer
complete,
path released
File transfer
request
arrives
Request Path
Deallocation
Data
Transfer
(10 GB)
Path ID returned
ODIN Server Processing
Path Allocation request
Network
reconfiguration
FTP
setup
Path setup: ~48.7s
Data Transfer (10GB): ~464s
Path Teardown: ~ 11.3s
0.5s 2.6s 0.5s 464s 0.3s 11s45s 0.14s
-
7/27/2019 A Metropolitan 10Gbps DWDM
25/26
presentation name NORTEL NETWORKS CONFIDENTIAL PG 25
-
7/27/2019 A Metropolitan 10Gbps DWDM
26/26
NORTEL NETWORKS CONFIDENTIAL 26
DWDMRAM
DWDMRAM
Data@LIGHTspeed