International Interconnect International Interconnect Options in the USAOptions in the USA

John Silvester John Silvester silvester@usc.edusilvester@usc.edu

Vice-Provost for Scholarly Technology, USCVice-Provost for Scholarly Technology, USCChair, CENICChair, CENICBoard Member, NLRBoard Member, NLR

22

International R&E Networks International R&E Networks connecting to USconnecting to US

Europe

S. America

Mexico

Asia

Australia

Canada

33

International Links to US – some International Links to US – some issuesissues

Fairly Complex picture!Fairly Complex picture! How to link up with US networks?How to link up with US networks? How interconnect between other networks in How interconnect between other networks in

N/S America?N/S America? Current interest in dedicated waves and Current interest in dedicated waves and

reconfigurable waves (GLIF, Lambdagrid, reconfigurable waves (GLIF, Lambdagrid, etc) – how to participate?etc) – how to participate?

NationalLambda Rail project provides new NationalLambda Rail project provides new optionsoptions

44

NLR – Financial StructureNLR – Financial Structure

Non-profit corporationNon-profit corporation Cover costs over a 5 year windowCover costs over a 5 year window Owned by R&E community - participation based on Owned by R&E community - participation based on

a commitment of $5M (US) over 5 yearsa commitment of $5M (US) over 5 years Initial build is a sparse network with 4 wavelengths Initial build is a sparse network with 4 wavelengths

litlit Ability to add wavelengths (up to 40) at incremental Ability to add wavelengths (up to 40) at incremental

costcost NLR supports Production and Experimental NLR supports Production and Experimental

(breakable) infrastructures at each layer (1,2, and 3)(breakable) infrastructures at each layer (1,2, and 3)

55

Current NLR ParticipantsCurrent NLR Participants

Corporation for Education Network Initiatives in California (CENIC)Corporation for Education Network Initiatives in California (CENIC) Pacific Northwest GigaPOP (PNWGP)Pacific Northwest GigaPOP (PNWGP) Carnegie Mellon-Pittsburgh Supercomputing CenterCarnegie Mellon-Pittsburgh Supercomputing Center Duke (representing a coalition of North Carolina universities)Duke (representing a coalition of North Carolina universities) Mid-Atlantic Terascale PartnershipMid-Atlantic Terascale Partnership Cisco SystemsCisco Systems Internet2Internet2 Florida LambdaRailFlorida LambdaRail Georgia Institute of TechnologyGeorgia Institute of Technology Committee on Institutional Cooperation (CIC)Committee on Institutional Cooperation (CIC) Oak Ridge National LaboratoryOak Ridge National Laboratory Lone Star Education and Research Network (LEARN) - TexasLone Star Education and Research Network (LEARN) - Texas Cornell University – New YorkCornell University – New York Louisiana Board of RegentsLouisiana Board of Regents University of New MexicoUniversity of New Mexico ONENet (Oklahoma)ONENet (Oklahoma) Southeastern Universities Research Association (SURA)Southeastern Universities Research Association (SURA)

66

NLR - Potential Use ExamplesNLR - Potential Use ExamplesU

se E

xam

ple

s

Inte

rnet

BG

P

visi

bil

ity

AU

P-f

ree

Inte

rnet

ser

vice

New

ro

uti

ng

p

roto

cols

Det

erm

inis

tic

Ult

raL

igh

t ac

cess

XC

P r

efer

ence

im

ple

men

tati

on

ET

F d

istr

ibu

ted

b

ackp

lan

e

Op

tica

l p

acke

t sw

itch

ing

ar

chit

ectu

re

Exp. L3

NetworksProd. L3 Networks

Additional Fiber Pairs

Infr

astr

uct

ure

1st pair Fiber

Ex

pe

rim

en

tal

L1

-3

Ne

two

rks

Production DWDM Network

Production Routed IP Network

Ex

pe

rim

en

tal

L2

-3 N

etw

ork

s

Pro

du

cti

on

L2

-3

Ne

two

rks

Production Switched Ethernet

Adapted from: Network and computing research infrastructure: back to the future, Robert J. Aiken, Javad Boroumand, Stephen Wolff, Communications of the ACM,Volume 47, Number 1 (2004), Pages 93-98

77

Architecture and Initial ConfigurationArchitecture and Initial Configuration

Obtained fiber (initial build from Level 3, Obtained fiber (initial build from Level 3, second stage includes other providers) – 20 second stage includes other providers) – 20 year IRU’syear IRU’s

Base NLR lambdas operated at 10 Gbps -- up Base NLR lambdas operated at 10 Gbps -- up to 40/32 lambdasto 40/32 lambdas

Lit with Cisco gearLit with Cisco gear Initial deployment is 4 Initial deployment is 4 10 Gig wavelengths10 Gig wavelengths

– One 10 Gig layer threeOne 10 Gig layer three– One 8One 81 Gig layer two1 Gig layer two– One dedicated to Internet2 HOPIOne dedicated to Internet2 HOPI– One hot spareOne hot spare

88

SunnyvaleDenver

Seattle

LA

San Diego

ChicagoPitts

Wash DC

Raleigh

Jacksonville

Atlanta

KC

Portland

Clev

Boise

Ogden

NLR MetaPOP

NLR Regen or OADM

NLR Route

NLR – Optical Infrastructure - Phase 1NLR – Optical Infrastructure - Phase 1

99

Seattle

Denver

Los Angeles

Cleveland

Pitts

Raleigh

Wash DC

Kansas

OgdenPortland

StarLight

Chicago

Atlanta

Boise

15808 LH System

15808 ELH System

15454 Metro System

Jacksonville

Sunnyvale

San Diego

15808 Terminal

15808 Regen (or Terminal)

15808 OADM

15454 Terminal

CENIC 15808 LH System

NLR Phase 1 - Installation ScheduleWill Complete Aug 2004

Complete

Complete

Complete

May

May

August

June

July

1010

Denver

Seattle

Sunnyvale

LA

San Diego

Chicago Pitts

Wash DC

Raleigh

Jacksonville

Atlanta

KC

Baton Rouge

El Paso - Las Cruces

Phoenix

Pensacola

Dallas

San Ant.Houston

Albuq. Tulsa

New YorkClev

NLR Phase 2 – the Southern RouteNLR Phase 2 – the Southern Route

1111

‘‘Abilene’ backboneAbilene’ backbone

1212

AbileneAbilene / / NLR NLR OverlayOverlay

1313

FeaturesFeatures

AbileneAbilene– 10G IP Backbone10G IP Backbone– ““Production” high performance advanced networkProduction” high performance advanced network

NLRNLR– Dedicated Waves Dedicated Waves – 10 x 1GE channels10 x 1GE channels– (10G IP Backbone – details of use not yet (10G IP Backbone – details of use not yet

determined)determined)– HOPI – Hybrid Optical Packet (Internet2)HOPI – Hybrid Optical Packet (Internet2)– Focus on Experimental and Research UseFocus on Experimental and Research Use– AUP freeAUP free

1414

Possibilities to considerPossibilities to consider

US shares land borders with CANDA and MEXICOUS shares land borders with CANDA and MEXICO Rest of connections are submarine (or satellite)Rest of connections are submarine (or satellite) Important to look at landing points for fiber (east Important to look at landing points for fiber (east

and west coasts).and west coasts). Typically expensive to backhaul from coasts to Typically expensive to backhaul from coasts to

Chicago (say) using commercial providers – NLR Chicago (say) using commercial providers – NLR provides another low cost alternativeprovides another low cost alternative

Build exchange POPS close to landing points – or Build exchange POPS close to landing points – or provide a shared fiber backhaul to an exchangeprovide a shared fiber backhaul to an exchange

1515

Related Developments - Pacific Related Developments - Pacific WaveWave

Takes advantage of NLR to connect the two Takes advantage of NLR to connect the two exchanges point in Seattle and Los Angeles exchanges point in Seattle and Los Angeles

Link (10G) is now upLink (10G) is now up Exchange to come into operation later this summerExchange to come into operation later this summer Extension to Sunnyvale (and into other US research Extension to Sunnyvale (and into other US research

nets) soon.nets) soon. Link to Chicago also likely soon to allow additional Link to Chicago also likely soon to allow additional

inter-exchange options. inter-exchange options. CENIC is considering developing an exchange POP in CENIC is considering developing an exchange POP in

San Luis Obispo (near Los Osos cable landing) with San Luis Obispo (near Los Osos cable landing) with a CalREN link to LA exchange point.a CalREN link to LA exchange point.

1616

Related Developments - IEEAFRelated Developments - IEEAF

The links donated by TYCO to IEEAF and The links donated by TYCO to IEEAF and made available to the R&E community have made available to the R&E community have similar use model to NLR waves.similar use model to NLR waves.

Both trans-Atlantic and trans-Pacific links are Both trans-Atlantic and trans-Pacific links are now operational. (recent event at Interop in now operational. (recent event at Interop in Japan)Japan)

1717

Final CommentsFinal Comments

New exchange and interconnect options taking advantage of New exchange and interconnect options taking advantage of NLR facilitiesNLR facilities

GLIF, Lightpaths, Lambdagrids are providing new opportunities GLIF, Lightpaths, Lambdagrids are providing new opportunities in support of data and compute intensive science.in support of data and compute intensive science.

Availability of reconfigurable waves allows this to move forward.Availability of reconfigurable waves allows this to move forward.

Contact PointsContact Points

National LambdaRail – www.nlr.netTom West (CEO) – twest@nlr.netJohn Silvester – silvester@usc.edu