International Connectivity and

Atlantic Wave Overview

SURA IT and HPC Committee Joint Meeting

March 22, 2005

Don Riley

2

New SURA IT Strategy – Highest Priorities

• Foundation-Building– Connectivity

• Regional (USA Waves, Crossroads)• National (National Lambda Rail, Internet2)• International Opportunities

– High Performance Computing– “Grids”

• Data storage• Middleware

• Program Development– SCOOP– Bio-Informatics/ Medical Research

3

Program PlanRegional and National Connectivity

• Goals– Secure new resources/tools to facilitate infrastructure improvements

• New partnerships• Secure federal and other sources of funding

– Build the Regional Infrastructure: SURA Crossroads• Evolving new role for MAX as key resource• AT&T Collaboration: Fiber First; Waves next (?)• Support and leverage SURA region NLR nodes• Facilitate other regional partnership and efforts

– Establish National and International Connectivity and Visibility• Leverage AT&T Collaboration Agreement

– USAWaves and National Buyers Consortium– Help complete/enhance NLR backbone to advantage of SURA region

– Impact digital divide issues• Drive down cost while improving physical connectivity

4

Program PlanInternational Connectivity

• Program Elements– Identify and engage with strategic international networking forums and projects

• National and Regional Networking groups– Internet2, NLR, CENIC, etc.– CANARIE, GEANT/DANTE, SURFNet, UKERNA, CERN, NORDUNet, etc.– APAN, TRANSPAC, AMPATH, ALICE/CLARA, etc.

• International Networking Initiatives– TransLight, EuroLink, SurfLight, UKLight, NorthernLight. Etc.– GLIF - Global Lambda Integrated Facility– HOPI (UCAID)

– Support and partner with international research collaborations• HENP, GOOS/IOS, BioGrid, eVLBI, etc.

– Partnership with IEEAF• New international fiber and lambda donations• Link and leverage with SURA/USAWaves and NLR

5

6

7

NSF International Research Network Connections (IRNC)(Kick-off March 11, 2005)

8

Map of International GLIF Initiative:Global Lambda Integrated Facility

www.glif.is Visualization courtesy of Bob Patterson, NCSA.

9

Thailand Regional Initiative: Next Generation Internet Announced by H.E.Dr. Surapong Suebwonglee, Minister of ICT, Thailand

January 26, 2005

10

International Connectivity for Collaboration

• Lots of point-to-point OC-x’s• Now increasing waves: 2.5G ’s, 10G ’s• NSF IRNC solicitation is generating more• GLIF

• Multiple POPs, connection points, “owners”• Numerous exchange agreements, AUPs, barriers to

transparent communications

• Increasing focus on neutral, open exchanges, distributed peering infrastructure

11

Another view of NSF IRNC

GLORIAD: Global Ring to China and RussiaGLORIAD: Global Ring to China and Russia

To EuropeTo EuropeTo Japan,To Japan,HongKong,HongKong,SingaporeSingapore P-WaveP-Wave

To Hawaii,To Hawaii,AustraliaAustralia

To AustraliaTo Australia

To Latin AmericaTo Latin America

12

U.S. International Peering Fabric

13

Removing Geographic Barriers

• Concept: an extensible, geographically dispersed peering fabric -- with open, neutral exchange/peering points

• Result: you connect at any one location on the fabric and have the option to peer with any other participant, regardless of where they are connected

Atlantic Wave: A New Paradigm for

International Peering (and more)on the East Coast

15

SURA and FIU/AMPATH: Now WHREN (Western Hemisphere Research and Education Network)

• SURA and FIU committed to interconnect AMPATH and NYC/MANLAN– Initially with 1Ge that SURA has under its

agreement with NLR– Then with 10G

• Important to include connectivity to MAX and its federal connections in DC area; leverage SURA investment in MAX

• Leverage SURA investment in SoX, role of SoX/SLR as southeast exchange point

16

Important East Coast International Peerings

• FIU/AMPATH, Miami - Latin America• NYC/MANLAN - multiple• MAX - Feds + GEANT

17

MANLAN, MAX & AMPATH

18

The Strategic Picture…

19

SURA Atlantic Wave Proposal

• ITSG (IT Steering Group) recommended and SURA Executive Committee approved:

– That SURA acquire a 10Gbps wavelength on the NLR backbone from Jacksonville to NYC and a switch to be placed in NYC, in support of the Atlantic Wave initiative (background and details follow).

– The estimated one-time expenditure of $481,472 be funded from the I.T. Fund.

20

Atlantic Wave Matching Commitments

• Significant matching funds are being committed by the various partners in Atlantic Wave (based on initial estimate):

• a. AMPATH (FIU): recurring costs of 10G wave from JAX to NYC - $ 35,823 per yr

• b. FLR and FIU/AMPATH: 10G wave from JAX to Miami – cost not yet known

• c. AMPATH: switch in Miami - estimated $150K• d. FLR: switch in Jacksonville - estimated $150K• e. ATL/SoX switch: SoX/SLR - estimated $150K• f. MAX: switch in DC/MAX - estimated $150K

21

AtlanticWave

• AtlanticWave is an International Peering Fabric along the East Coast– US, Canada, Europe, South America Plus….– Distributed IP peering points:

• NYC, WDC, ATL, MIA, SPB

• Described as an integral component of the WHREN-LILA proposal to extend LILA on the Atlantic side to MANLAN in NYC

• Establishes 10Gb wave from Miami to MAX/NGIX-E in DC and MANLAN/NYC over FLR and NLR with interconnects in Jacksonville and Atlanta

• Interconnects the Atlantic with international peering exchanges in TransLight/Chicago and the Pacific through CA*net4 and Pacific Wave (P-Wave)

• SURA, FIU-AMPATH-CHEPREO, the IEEAF, MAX, SoX/SLR, MANLAN, and in partnership with the Academic Network of Sao Paulo (ANSP) are combining efforts to establish AtlanticWave

• Complements the PacificWave distributed peering facility on the west coast

22

The Strategic Picture…

23

AtlanticWave Topology

• A-Wave will provide multi-layer/multi-protocol services between participating networks

– Layer 3 peering services over ethernet

– GLIF “light path” services– Others TBD

• A-Wave will provide a Layer 3 distributed exchange capability

– Ethernet based– Best effort packet exchange– Linear topology –

unprotected (NLR based)– 1 GE, 10GE LAN, 10GE

WAN client access– Jumbo frame support

24

A-Wave Layered Services

STS-(x)cLight Path 1

Inter-switchVLAN 1

Ethernet

…

GLIF Light Path ServicesDynamically Allocated

STS-(?)cLight Path 2

STS-(?)cLight Path 3

STS-(?)cLight Path n

…

Inter-switchVLAN 2

IP IP

IP (POS)

IP

Ethernet

IP

A-Wave backbone: OC192c Sonet wave over NLR

IP Peering ServicesStatically Provisioned

User defined sonet payload framing

VLAN(s)

VCAT/LCAS

VCAT = Virtual ConcatenationLCAS = Link Capacity Adjustment Scheme

Prepared by Jerry Sobieski

25

AtlanticWave Design

Prepared by Jerry Sobieski

26

Deployment Plans & Timeline

• Phase 1: Deploy backbone OC192c Sept 05– Between MIA-ATL, ATL-WDC, WDC-NYC

– 10Gbs WAN PHY ethernet over NLR wave initially.

– Migration of existing exchange switches/networks• Regional backhaul

• Reconfiguration of existing exchange services and networks

• Phase 2: Sonet switch deployment Dec 05– Map IP/Ethernet Peering Fabric across “appropriate” sized VCG (GFP-F &

VCAT)

– Engineer and deploy GLIF Common Services in conjunction with other GLIF domains

• Phase 3: Deploy dynamic light path services Mar 06

• Phase 4: Expansion Aug 06 ->– Integrate links between A-Wave, P-Wave, Northern Tier, etc