trial of the infinera pxm guy roberts, mian usman

Trial of the Infinera PXM

Guy Roberts, Mian Usman

LHC Workshop Recap

• Rather than maintaining distinct networks, the LHC community should aim to unify its network infrastructure

• Traffic aggregation on few links

• Concerns• If the T1s and T2s upgrade to 100G, then the global infrastructure

needs to follow

• LHCONE Evolution• Currently LHCONE exists side-by-side with general R&E infrastructure• Traffic is segregated but what's the real benefit?

LHCOPN

• NRENs are providing LHC with point-to-point Layer2 circuits

• LHC centers built a virtual routed network out of the circuits

• LHC centers are providing Network Services to each other:• CERN is providing un-restricted transit• Some centers are providing limited transit• Some LHC centers are peering

• NRENs support individual link operations & management

• LHC Sites are responsible for network management (layer 3 configurations) including operations, monitoring, troubleshooting, capacity planning, security management, AUP enforcement, etc.

LHCONE – as it exists at the moment

• LHCONE is currently setup as an overlay VRF on existing NREN infrastructure which are interconnected via regional networks and Open Exchanges

• NRENs provide the network including core links and routers as a virtual overlay on their regular infrastructure

• NRENs have a peering or transit relationship with each other• LHC centers are strictly users of the services• Restrictions apply to the advertised IP Space • LHCONE infrastructure includes dedicated access, Trans-Atlantic and

some backbone links

Use case– LHCOPN/LHCONE

LHCOPN: High capacity TDM, but not flexibleLHCONE: flexibility of L3 VPN, but no reserved bandwidth

Can we give users the best of both solutions?

Packet Switching Module 16x10GE or 16x1GE 1 x 100GE

Built-In 200G Packet Switch Enables QoS Packet Classification VLAN and QinQ MPLS-TP on network side

MEF services Point-to-point services EP-LINE, EVP-LINE Multipoint services EP/EVP-LAN, EP/EVP-TREE

PXM – available 1Q 2015

DTN-X Family

Open Transport Switch

Open Transport Switch (OTS) provides an Open Flow interface to the DTN-X

OTS adds transport extensions to the Open Flow interface

Initially REST based interface

On Infinera roadmap for Q4 2015 (R12), however, early versions available now for evaluation.

Using OTS to control OTN transport circuits – not that useful

OTS would make a useful API to allow big science users to request EVP-LINE and EVP-LAN services via PXM

NRENGÉANT 500G fiber cloud

NREN Tier 1 site

Wigner Data Center

User servicerequests

Tier 2 Campus

CERN

Packet OPX optimized EPL & EVPL Services over Layer 1 VPN

MEF type EVP-LAN or EVP-Line pool of provisionable OTN B/W OTS REST/OF API to allow experimenter’s applications

to manage connectivity

OF/REST


NREN

Tier 1 site


Tier 1 site

Tier 1 site

Tier 1 site

Tier 1 site

NREN


NREN

Tier 1 site

Tier 2 Campus


Tier 1 site

Tier 1 site

Tier 1 siteTier 2 Campus

Tier 1 site

DFNLHCONEGÉANT 500G fiber cloud

JANET

DE-KIT

Tier 2 Campus


UK RAL

NORDUNETLHCONE

ESnetLHCONEInternet2

LHCONE

CANARIELHCONE

NL-T1 (via Surfnet)NDGF (via NORDUNET)

TRIUMF(via CANARIE –ANA)BNL (via ESnet)

FERMI (via ESNet)

NL-T1 (via Surfnet)NDGF (via NORDUNET)

TRIUMF(via CANARIE –ANA)BNL (via ESnet)

FERMI (via ESNet)

Tier 2 Campus

PXM Evaluation and trial

Field trial in Q2 2015.

Pre-release PXM cards could be trialled.

Evaluation and service development

Field trial integration of PXM and OTS.

Evaluate OTS and PXM together.

LHC Workshop Recap

• Rather than maintaining distinct networks, the LHC community should aim to unify its network infrastructure

• Traffic aggregation on few links

• Concerns• If the T1s and T2s upgrade to 100G, then the global infrastructure

needs to follow

• LHCONE Evolution• Currently LHCONE exists side-by-side with general R&E infrastructure• Traffic is segregated but what's the real benefit?

Questions??

GEANT IP Backbone

Primary

VIAOLE

LEVEL 3AS3356

.81

.82

GoogleAS15169

.49

200 .122

.121

.50

.217

.177 .178

.245 .246

.21

.22

.61

.2

.184

105

.18

.34

.33

.62

.37

ETH200

.46

.45

.41

.30

.198

.197

62.40.112.54/31

182

181

.218

.2

.1

ETH100

.137

.157

.158

ETH100

.105

.106

.161

.162

.93

.138

.137

350

.118

ETH100

.185

.81

.46

.6

.185

105

.125

.205

ETH150

.77

.78

.29

SDH150

Primary

.50

.49

90

150.38

Primary

Backup

.125.157 .125.158

.46

350

.25

.26

.33

.125.18

CZ.5.6

Primary

.125.53 .125.54

Primary

.125.89.125.90

.249

.250

.162.161 Primary

Backup

DK.48.47

.253

.13

100

UK.53

.186

.13

.14

.97

.98

100

HU.19.20

RO.9

.10

50

EE

.205

.206

CH.3.4

GR2

.230

500

LV

ETH50

.170

ETH445

PL.35.36

LT

IT.57.58

.138

.254

.221

.229

.169

.174

.173

.2

125

.17

.129 / .181

.14

.82

.125.117

125.141

.50

.54

211.79.48.144

.145

.146

DE.7.8

BG

125.65

125.66

.226 .225

MaltaAS12046

124.233

124.234

FCCN Backup AS1930

IUCC AS378

JANET AS786

HEAnet AS1213

UBUNTUNET AS36944

CANARIE BackupAS6509

NORDUnet BackupAS2603

SURFnetAS1103

NORDUnetAS2603

NISN AS297

URAN AS12687

HEAnet BackupAS1213

GARR BackupAS137

TIFRAS2697

IUCCBackupAS378

RESTENAAS2602

DFN BackupAS680

RENATERAP1

AS2200

DFNAS680

ACOnet AS1853

HUNGARnet BackupAS1955

CESnetAS2852

PSNCAS8501

LITnetAS2847

SigmaNetAS5538

EEnetAS3221

HUNGARnetAS1955

SWITCHAS559CERNAS513

SWITCH/CERN Backup

AS559 / AS513

RedIRIS BackupAS766

JANET BackupAS786

MARnetAS5379

BRENAS6802

GRnet AS5408

RoEduNetAS2614

SAnetAS2607

GRnet BackupAS5408

GARRAS137

ACOnet BackupAS1853

TWAREN AS7539

CANARIE AS6509

SINET AS2907

ESNET AS293

Internet2 AS11537

ESNET AS293

Internet2 AS11537

TEIN3 AS24490

RedIRIS AS766

FCCNAS1930

CARnetBackupAS2108

CARnetAS2108

ARNESBackupAS2107

ARNESAS2107

CESnet BackupAS2852

.9

ETH

.162

.161

.10

VIXAS1121

DE-CIXAS15169

MRENAS40981

GÉANT IP Topology06/01/2015 TB

ETH90

KAUST AS50999

BASNET AS21274

GoogleAS36040

AT.1.2

.1

NL.49.50

ASGCAS24167

.165

.166

CARENAS197118

.222

LEVEL 3AS3356

LEVEL 3AS3356

124.149

124.

150

CynetAS3268

CynetBackupAS3268

UlakbimAS8517

Ulakbim BackupAS8517

CogentAS 174

149.

6.42

.73

CogentAS 174

TEIN3 AS23911

.154

500

AMRESAS13092

195

.69.

146.

137

CogentAS 174

STM-128OC-384 20 GE

STM-4OC-12622 Mbps

STM-1T3 / E3155 / 45 / 34 Mbps

STM-16OC-482.4 Gbps

SDH SDH / ETH

GÉANT

GÉANT PoP

Single international connection provided by GÉANT

AS20965

GigE / 1 Gbps

10 GigE / Shared

STM-192OC-57630 GE

STM-256OC-76840 GE

T3 / 45 Mbps

STM-64OC-19210 GE

ETH100

.63

.64

CAT

ARNAS3208

CARIBNETAS54308

FR.55.56

RedCLARA AS27750

AMS-IXAS

ES

RENATER AP2

AS2200.61 .62

HR

.1128

.41.254

.0/30

SILK AS132467

SI

PT

98.89

98.8

8

ETH200

98.103

98.1

02

ETH100

98.1

06

ETH250 BE

BELnetAS2611

BELNET BackupAS2611

.98.154 .98.138

.98.

155

300 Mbps

SK

ETH250

UBUNTUNET AS36944

100G

SINET AS2907

NORDUnet PeeringAS2603

LUX

HR

ETH175

175

RESTENA BackupAS2602

ENSTINetAS6879

.189

.19062.40.124.188/30

62.40.124.92/30 .93.94

ETH1000

IE

ETH500

.130

.154

.153

SURFnet Backup AS1103

194.149.130.105 (protection)

194.149.130.109

GEANT Dark Fibre Foot Print

LON

PAR

AMS Ham

FRA

GEN

MIL

PRA

VIE

BRA

8 ila 5

8 ila

~ 10

11 ila

8ila

15

0

~4 ila

~19 ila

5558

58

511

58

515

511

510*

54

50

5X Number of ILAs

Dark Fiber

2

trial of the infinera pxm guy roberts, mian usman

Documents