uclpv2-hopi issues bof joint techs workshop vancouver, bc 2005

ResearchRutherford

ResearchRutherford

ResearchRutherford

UCLPv2-HOPIIssues BoF

Joint Techs Workshop

Vancouver, BC

2005

Project Networks

• Transition phases

•Ramp up

•Core Competency Tasks

•Ramp Down

Project Network – APN concept

national

ron

metro

campus

national

ron

metro

campus

vlan vlan

node node

lightpath

Project Networks

• Ramp up

•Reserve light paths

•Config metro/campus network

•Config project specific apps

Project Networks - example

9k DDS Project

Enterasys N7

gigE

10,239 bytes

gigE

ONS15454

gigE

Preliminary 9k DDS Project - Target List

gigE

SM 22 km

long range ZX GBICs fromCANARIE -extend loanperiod to cover 9k DDSproject

10/8 VLAN

ZX GBICZX GBIC SONET

10/8 VLAN 10/8 VLAN

dedicatedgigE port

IBM p650 AIX

Routed IPv4 = 206.12.24.15Lightpath IPv4 = 172.31.24.15Reference IPv4 = 10.12.24.15MAC = 00:09:6b:ce:3c:19

devstore.westgrid.ca

7

0

route all 10.0.0.0/8 (10/8)todedicated port of 5 portgigE link aggregator

route all 10.0.0.0/8 (10/8)toone VLAN of 6 on 4 portgigE link aggregator

WestGrid

monitor 10/8 VLAN for leakage orunusual activity of ARP/Broadcast/Multicast

SFU MainEnterasys ER16

64,000 bytesIRMACS

Cisco 6509

9,216 bytes

10/8VLAN

MM

SGIIRMACS

ONYX 4

vizserver.westgrid.caRouted IPv4 = 206.12.24.8Lightpath IPv4 = 172.31.24.8Reference IPv4 = 10.12.24.8MAC = 08:00:69:13:eb:21

gigE

SM

gigE

Molecular Biology and Biochemistry

10/8 VLAN

9k SwitchSummit-1i

Supplied and set up bySFU-WestGrid, reimbursedby 9k DDS Project

Supplied by MBB

9k DDS Phase 1: tap existing lightpath infrastructure9k DDS Phase 2: setup dedicated lightpath infrastructure

9k DDS phase 2reconfigure todedicated gigE portfrom ONS

9k DDS phase 1 tapWestGrid-IRMACS gigE portfrom ONS for setup

note: replace all lightpath 10.NNN.XXX.XXX with172.31.XXX.XXX for DDS phase 1 ... due to 10/8 conflicts at SFU... however keep all 10/8 address for reference alias andpossible switch over to 10/8 for handoff in DDS phase 2 ...notably either can be used interchangeably if no addressspace conlicts are present ... ;-)

ONS15454

STS-24c

max of 2 STS-24c per card and 1 STS-24cper port ... drop lightpath from Calary onone G1000 and light path from Victoria onother G1000 use switch to combine onlink to SFU for collaboration re: DonMcWilliam

SONETgigE Linux

gigE

Dell L39,018 bytes

UofASubatomic Physics lightpath.phys.ualberta.ca

Routed IPv4 = 129.128.241.113Lightpath IPv4 = 172.31.241.113Reference IPv4 = 10.128.241.113MAC = 00:e0:81:24:45:3a

10/8 VLAN

dual port

TRIUMFgigE

campus router

gigE

LinuxgigE

9k SwitchSummit-1i UofA

Biochemistry lightpath.pence.caRouted IPv4 = 129.128.139.2XXLightpath IPv4 = 172.31.139.2XXReference IPv4 = 10.128.139.2XXMAC =

10/8 VLAN

dual port

PENCEgigE

campus router

Supplied byBiochem

Supplied and set up byTRIUMF, reimbursedby 9k DDS Project

gigE

gigE

Cisco 6509

UVicNetwork Services

Linux

phys02.comp.uvic.caRouted IPv4 = 142.104.21.13Lightpath IPv4 = 172.31.21.13Reference IPv4 = 10.104.21.13MAC =

HEPnet

9,216 bytes

10/8 VLAN

campus router

dual port

Supplied byBiochem

gigE

gigE

UVicBiochemistry & Microbiology

Linux

lightpath.bioc.uvic.caRouted IPv4 = 142.104.33.XXXLightpath IPv4 = 172.31.33.XXXReference IPv4 = 10.104.33.XXXMAC =

TVBR

10/8 VLAN

campus router

dual port

9k SwitchSummit-1i

Supplied and set up byHEPnet, reimbursed by9k DDS Project

9k DDS phase 2reconfigure todedicated gigE portfrom ONS

9k DDS phase 2reconfigure todedicated gigE portfrom ONS 9k DDS phase 1 tap

TRIUMF gigE portfrom ONS for setup

9k DDS phase 1 tap HEPnetgigE port from ONS for setup

CANARIENETERA

CALGARY

ONS15454

STS-24c

9k SwitchSummit-5i

STS-24cSONET

CANARIEBCNET

VICTORIA

SX GBICs

CANARIEBCNET

VANCOUVER

ONS15454CANARIENETERA

EDMONTON

Cisco 3750

9,216 bytes

GT CO-LO

CWDM supplied and set upby BCNET, reimbursed by9k DDS Project

GT CO-LOCWDM

BCNET TXCWDM

SX GBICs SX GBICs

BioScienceCWDM

Netera TXCWDM

SXGBICs

9k SwitchSummit-1i

UofC

Linux

lightpath.mbb.sfu.caRouted IPv4 = 142.58.213.XXXLightpath IPv4 = 172.31.213.XXXReference IPv4 = 10.58.213.XXXMAC =

MBB

campus router

dual port

campus router

BioScience

dual portLinux

UofC

dual G1000 ports forcollaboration SX GBICssupplied by BCNET re:Don McWilliam

Supplied and set up byNetera, reimbursed by9k DDS Project

CWDM supplied byNetera re: Gary Finley

Supplied byBioScience

Dove tail ONS G1000 portsvia VLAN re: Gary Finley

Lightpaths from Edmontonand Vancouver drop on twoONS G1000 ports re: GaryFinley

9k DDS phase 1split lightpathsfrom ONS for setup

Supplied and set up byBCNET, reimbursed by9k DDS Project

SXGBICs

SXGBICsNetera TX

CWDM

LX GBICs

Fibre in place ... ?



BCNET TX

lightpath.bioscience.ucalgary.caRouted IPv4 = 136.159.XXX.XXXLightpath IPv4 = 172.31.XXX.XXXReference IPv4 = 10.159.XXX.XXXMAC =

blowfish.westgrid.caRouted IPv4 = 206.12.24.6Lightpath IPv4 = 172.31.24.6Reference IPv4 = 10.12.24.6MAC = 00:09:6b:f1:f4:85

Routed IPv4 = 206.12.24.65Lightpath IPv4 = 172.31.24.65Reference IPv4 = 10.12.24.65MAC =

gridstore.westgrid.ca

Project Network – some issues

• ONS to campus & cross campus fiber

• Black Hole (unrouted) IPv4 – ARP

Leakage – 10.XXX.XXX.XXX conflicts

• VLAN – Configuration – Layer 2 sniffing

• Mystery behavior – protocol & MTU

specific drops

Project Network – user APN control ?OS Window Fcts

Status: Connected to http://uclp.canet4.net

TRIUMF

File Edit View Tools Window HelpV2

ONS OME APN

TRIUMFAPNs

ons-nyc01-enet_2/4

ons-van02-enet_2/2

10.168.1.1

10.168.1.2

APN-2

VLAN-1

VLAN-1

APN-1

APN-2

APN-1

CERN-1

CERN-1

APN-1

APN-1 APN-2

APN-2

OXC Wizard-1

SURFnet-CERN

10.168.1.1 10.168.1.2

VLAN-1

ons-van02-enet_2/2 ons-nyc01-enet_2/4

APN-1CERN-1 CERN-1APN-2

OS Window Fcts


TRIUMF


ONS OME APN

TRIUMFAPNs

ons-nyc01-enet_2/4

ons-van02-enet_2/2

10.168.1.1

10.168.1.2

APN-2

VLAN-1

VLAN-1

APN-1

APN-2

APN-1

CERN-1

CERN-1

APN-1

APN-1 APN-2

APN-2

OXC Wizard-1

SURFnet-CERN

10.168.1.1 10.168.1.2

VLAN-1



Project Networks

• Core Competency Tasks

•project specific apps

•work flow (transfer/process)

•visualization

•distributed file systems

Mockup TRIUMF to CERN APNs

APN-1 APN-2

CERN-1

TRIUMF BCNET CA*net4 SURFnet CERN

Project Network – some issues

• APN representations

•import/export/reserve ?

• work flow (grid) model

•explicit APN representation ?

•Task_1(use APN CERN-1)

TRIUMFAPNs

OS Window Fcts


ONS OME APN

TRIUMF

New >

Open...

Close

Save

Save as ...

APN Diagram

ONS Diagram

OME Diagram

ADM Diagram

Exit

Edit View Tools Window HelpV2 File

Left click File – mouse over – select New – mouse over – select – APN Diagram – left click

Assume Logged on as TRIUMF - New APN Diagram

Key new APN name in highlight – hit enter – renames from – New APN – CERN-1 – creates blank CERN-1 APN diagram

Create APN tree

OS Window Fcts


CERN-1

TRIUMF


ONS OME APN

CERN-1 CERN-1

CERN-1

TRIUMFAPNs

CERN-1 CERN-1

OS Window Fcts


CERN-1

TRIUMF


ONS OME APN

TRIUMFAPNs

New >

Copy

Paste

Delete

Import ...

Interface

Node

Link

Resource

Export...

Refresh

Tools >

Properties

CERN-1

Right click in blank APN diagram CERN-1 – mouse over – select New – mouse over – select – Interface - left click – creates – New Interface – at location in diagram – and under CERN-1 – APN map tree

Add new TRIUMF Interface

OS Window Fcts


CERN-1

Alpha Layout


ONS OME APN

TRIUMFAPNs

Interface-1

CERN-1

Interface-1

CERN-1 CERN-1

Select New Interface in tree - right click - select – Properties – from popup menu

Select Interface Properties – per Gary Finley mods

New >

Copy

Paste

Delete

Import ...

Export...

Rename

Tools >

Properties

Select Location Property Value select icon - left click – select Vancouver

Set Interface Location Property – modified: rename eliminated – location property added – Gary Finley

OS Window Fcts


CERN-1

Alpha Layout


ONS OME APN

TRIUMFAPNs

Interface-1

CERN-1

Interface-1

CERN-1 CERN-1

Interface-1Interface

NameTypeLocation

ether-1000

IPv4MAC

nonenonenone

OS Window Fcts


CERN-1

Alpha Layout


ONS OME APN

TRIUMFAPNs

10.198.1.1

CERN-1

10.198.1.1

CERN-1 CERN-1

10.198.1.1Interface

NameTypeLocation

ether-1000

IPv4MAC

Vancouver10.198.1.1none

Select Location Property Value select drop down icon - left click – select Vancouver – IPv4 algorithm cuts in and autogenerates 10.198.1.1 from /2X – also sets Name = IPv4(value)

Set Interface Location Property autogenerates unrouted black hole IPv4 from pre-assigned range for logon TRIUMF updates config so used IPv4 from range not available –– Gary Finley

Find a local gigapop TRIUMF MAN gigE (green) interface in the ONS tree – left click – hold – drag – release on CERN-1 APN diagram

Find TRIUMF ONS MAN interface drag into APN

OS Window Fcts


CERN-1

TRIUMF


ONS OME APN

canet4

ons-vic01

ons-van02

ons-cal01

oxc

wan

man

ons-van01

enet_2/1

enet_2/2

enet_2/3

enet_2/4

enet_3/1

enet_3/2

enet_3/3

enet_3/4

enet_4/1

enet_4/2

enet_4/3

enet_4/4

CERN-1 CERN-1

10.168.1.1 ons-van02-enet_2/2

manual select

Scroll down to NYC01 find SURFnet MAN gigE (green) interface in the ONS tree – left click – hold – drag – release on CERN-1 APN diagram

Find SURFnet ONS MAN interface drag into APN

OS Window Fcts


CERN-1

TRIUMF


ONS OME APN

ons-ott01

ons-nyc01

oxc

wan

man

ons-mon01

enet_2/1

enet_2/2

enet_2/3

enet_2/4

enet_3/1

enet_3/2

enet_3/3

enet_3/4

enet_4/1

enet_4/2

enet_4/3

enet_4/4

ons-tor01

ons-fre01

CERN-1 CERN-1

10.168.1.1 ons-van02-enet_2/2 ons-nyc01-enet_2/4

manual select

Right click in blank APN diagram CERN-1 – mouse over – select New – mouse over – select – Interface - left click – creates – New Interface – at location in diagram – and under CERN-1 – APN map tree – properties location select – CERN – autogenerates IPv4 - 10.168.1.2

Add new CERN interface –Gary Finley – to eliminate manual select of intermediate ONS G1000 interfaces

OS Window Fcts


CERN-1

Alpha Layout


ONS OME APN

TRIUMFAPNs

10.198.1.1

CERN-1

CERN-1 CERN-1

10.198.1.2Interface

NameTypeLocation

ether-1000

IPv4MAC

CERN10.198.1.2none

10.198.1.1 10.198.1.210.198.1.2

OS Window Fcts


CERN-1

Alpha Layout


ONS OME APN

TRIUMFAPNs

10.198.1.1

CERN-1

CERN-1 CERN-1

10.198.1.2Interface

NameTypeLocation

ether-1000

IPv4MAC

CERN10.198.1.2none

10.198.1.1 10.198.1.210.198.1.2

Select then right click – 10.198.1.2 IF in tree model – mouse down – select Tools – select ONS IF Wizard … - left click

Add available ONS IF using wizard – mod Gary Finley – to eliminate manual select of intermediate ONS G1000 interfaces

New >

Copy

Paste

Delete

Import ...

Export...

Rename

Tools >

PropertiesOXC Wizard...

ONS IF Wizard...

OS Window Fcts


CERN-1

Alpha Layout


ONS OME APN

TRIUMFAPNs

10.198.1.1

CERN-1

CERN-1 CERN-1

10.198.1.2Interface

NameTypeLocation

ether-1000

IPv4MAC

CERN10.198.1.2none

10.198.1.1 10.198.1.210.198.1.2

Select ons-nyc01-enet_2/4 left click available ONS IF – left click Add button – repeat - select – ons-nyc01-enet_2/4 – left click Add – left click Close button


ONS IF Wizard

Add Close

Available ONS IF

ons-nyc01-enet_2/4

wizard select

OS Window Fcts


CERN-1

Alpha Layout


ONS OME APN

TRIUMFAPNs

10.198.1.1

CERN-1

CERN-1 CERN-1

InterfaceNameTypeLocation

ether-1000

IPv4MAC

Vancouver10.198.1.1none

10.198.1.1 10.198.1.2

10.198.1.2

ons-nyc01-enet_2/4 ons-nyc01-enet_2/4

10.198.1.1

Select left click IF 10.198.1.1 – repeat – popup menu – ONS IF Wizard - select ons-van01-enet_2/4 left click available ONS IF – left click Add button – repeat - select – ons-nyc01-enet_2/4 – left click Add – left click Close button


ONS IF Wizard

Add Close

Available ONS IF

ons-van02-enet_2/2

wizard select

OS Window Fcts


CERN-1

TRIUMF


ONS OME APN

TRIUMFAPNs

10.168.1.1

10.168.1.2

CERN-1 CERN-110.168.1.1 10.168.1.2ons-van02-enet_2/2 ons-nyc01-enet_2/4

CERN-1

ons-van02-enet_2/2

ons-nyc01-enet_2/4

Select left click property close tab – select left click palette open tab

Close property sub window – expand palette

Left click on palette expand tab – click Link header to expand – click drag VLAN link – drop near 10.168.1.1 – click hold VLAN left end clip to right point of interface – end handle should turn green if ok – repeat drag drop connect for APN-1 link and APN-2 link – double click on APN-1 link to edit new APN-1 diagram…

Expand Palette select drag VLAN and APN links clip to interfaces

Interface

Link

Node

Resource

VLAN

WAN

APN

OS Window Fcts


TRIUMF


ONS OME APN

TRIUMFAPNs

ons-nyc01-enet_2/4

ons-van02-enet_2/2

10.168.1.1

10.168.1.2

VLAN-2

VLAN-1

VLAN-1

APN-1

VLAN-2

APN-1

CERN-1

CERN-1

APN-1

10.168.1.1 10.168.1.2

VLAN-1


APN-1

APN-1 APN-2

APN-2

CERN-1 CERN-1APN-2

Left click on Resource Palette to expand – left click – hold – drag – OXC Wizard to APN-1 diagram – connect OXC Wizard end points to both APN-1 terminus – instantiates with default instance name of OXC Wizard-1

APN-1 install OXC Wizard

Interface

Link

Node

Resource

OS Window Fcts


TRIUMF


ONS OME APN

TRIUMFAPNs

CERN-1 APN-1 APN-2

APN-1 APN-1OXC Wizard-1

OXC Wizard

ons-nyc01-enet_2/4

ons-van02-enet_2/2

10.168.1.1

10.168.1.2

APN-2

VLAN-1

VLAN-1

APN-1

APN-2

APN-1

CERN-1

APN-1

APN-2

OXC Wizard-1

Interface

Link

Node

Resource

OS Window Fcts


TRIUMF


ONS OME APN

TRIUMFAPNs

CERN-1 APN-1 APN-2


OXC Wizard

ons-nyc01-enet_2/4

ons-van02-enet_2/2

10.168.1.1

10.168.1.2

APN-2

VLAN-1

VLAN-1

APN-1

APN-2

APN-1

CERN-1

APN-1

APN-2

OXC Wizard-1

Once connected to APN-1 terminus double click on OXC Wizard-1 to start process …

APN-1 invoke OXC Wizard

Interface

Link

Node

Resource

OS Window Fcts


TRIUMF


ONS OME APN

TRIUMFAPNs

CERN-1 APN-1 APN-2


OXC Wizard

ons-nyc01-enet_2/4

ons-van02-enet_2/2

10.168.1.1

10.168.1.2

APN-2

VLAN-1

VLAN-1

APN-1

APN-2

APN-1

CERN-1

APN-1

APN-2

OXC Wizard-1

While OXC Wizard-1 is working – left click APN-2 diagram

Edit APN-2

Left click select APN-2 terminus – right click – mouse down – left click select Import …

Import existing APN

New >

Copy

Paste

Delete

Import ...

Export...

Rename

Tools >

Properties

Interface

Link

Node

Resource

OS Window Fcts


TRIUMF


ONS OME APN

TRIUMFAPNs

CERN-1 APN-1 APN-2

APN-2 APN-2

OXC Wizard

ons-nyc01-enet_2/4

ons-van02-enet_2/2

10.168.1.1

10.168.1.2

APN-2

VLAN-1

VLAN-1

APN-1

APN-2

APN-1

CERN-1

APN-1

APN-2

OXC Wizard-1

Select - left click - SURFnet-CERN in Import dialogue – click ok button

Select SURFnet-CERN APN

Import APN

OK Cancel

External APNs

SURFnet-CERN

Interface

Link

Node

Resource

OS Window Fcts


TRIUMF


ONS OME APN

TRIUMFAPNs

CERN-1 APN-1 APN-2

APN-2 APN-2

OXC Wizard

ons-nyc01-enet_2/4

ons-van02-enet_2/2

10.168.1.1

10.168.1.2

APN-2

VLAN-1

VLAN-1

APN-1

APN-2

APN-1

CERN-1

APN-1

APN-2

OXC Wizard-1

Interface

Link

Node

Resource

OS Window Fcts


TRIUMF


ONS OME APN

TRIUMFAPNs

CERN-1 APN-1 APN-2

APN-2 APN-2

OXC Wizard

SURFnet-CERN

SURFnet-CERN

ons-nyc01-enet_2/4

ons-van02-enet_2/2

10.168.1.1

10.168.1.2

APN-2

VLAN-1

VLAN-1

APN-1

APN-2

APN-1

CERN-1

APN-1

APN-2

OXC Wizard-1

External APN is imported - APN-2 completed – CERN-1 is completed – left click Palette close tab – left click select CERN-1 diagram tab

External SURFnet-CERN APN imported CERN-1 complete

OS Window Fcts


TRIUMF


ONS OME APN

TRIUMFAPNs

CERN-1 APN-1 APN-2

10.168.1.1 10.168.1.2

VLAN-1



ons-nyc01-enet_2/4

ons-van02-enet_2/2

10.168.1.1

10.168.1.2

APN-2

VLAN-1

VLAN-1

APN-1

APN-2

APN-1

CERN-1

APN-1

APN-2

OXC Wizard-1

SURFnet-CERN

Left click select CERN-1 diagram tab

Select CERN-1 diagram

OS Window Fcts


TRIUMF


ONS OME APN

TRIUMFAPNs

ons-nyc01-enet_2/4

ons-van02-enet_2/2

10.168.1.1

10.168.1.2

APN-2

VLAN-1

VLAN-1

APN-1

APN-2

APN-1

CERN-1

CERN-1

APN-1

APN-1 APN-2

APN-2

OXC Wizard-1

SURFnet-CERN

10.168.1.1 10.168.1.2

VLAN-1



Left click select File – mouse down – select SAVE –left click – CERN-1 diagram and all subtree components are saved

Save CERN-1 diagram

New >

Open...

Close

Save

Save as ...

Exit

Mouse down select OXC Wizard-1 in tree – right click – mouse over – select – double click

Select OXC Wizard-1 and display status – Gary Finley mods

OS Window Fcts


TRIUMF


ONS OME APN

TRIUMFAPNs

ons-nyc01-enet_2/4

ons-van02-enet_2/2

10.168.1.1

10.168.1.2

APN-2

VLAN-1

VLAN-1

APN-1

APN-2

APN-1

CERN-1

CERN-1

APN-1

APN-1 APN-2

APN-2

OXC Wizard-1

SURFnet-CERN

10.168.1.1 10.168.1.2

VLAN-1



OXC Wizard-1 creates a status panel displaying out currently available shortest path links – select start lease – drop down and select start date – select end lease date – left click show available button

OXC Wizard-1 Status Display – Gary Finley mods – lease system

OS Window Fcts


TRIUMF


ONS OME APN

TRIUMFAPNs

ons-nyc01-enet_2/4

ons-van02-enet_2/2

10.168.1.1

10.168.1.2

APN-2

VLAN-1

VLAN-1

APN-1

APN-2

APN-1

CERN-1

CERN-1

APN-1

APN-1 APN-2

APN-2

OXC Wizard-1

SURFnet-CERN

OXC Wizard-1

STS-24c

STS-12c

Legend

Show Available Rediscover Reserve

start lease

end lease

OXC Wizard-1 creates a new status panel displaying all available shortest path links – hold shift key down and successibvely click lightpath segments to reserve – segment shows green handles when selected - when complete - select left click reserve to hold OXC path segments for lease period

OXC Wizard-1 Status Display – Gary Finley mods – reserve OXC path

OS Window Fcts


TRIUMF


ONS OME APN

TRIUMFAPNs

ons-nyc01-enet_2/4

ons-van02-enet_2/2

10.168.1.1

10.168.1.2

APN-2

VLAN-1

VLAN-1

APN-1

APN-2

APN-1

CERN-1

CERN-1

APN-1

APN-1 APN-2

APN-2

OXC Wizard-1

SURFnet-CERN

OXC Wizard-1

STS-24c

STS-12c

Legend

Show Available Rediscover Reserve

12:00 AM January 1, 2006

12:00 PM March 31, 2006

OXC Wizard-1 creates a new OXC Reservation-1 in tree – double left click OXC Reservation-1 icon in tree to display reservation panel - select left click Cancel button to remove reservation and return lightpath segments to the available pool

OXC Wizard-1 Reservation Display – Gary Finley mods – reserved OXC path

OS Window Fcts


TRIUMF


ONS OME APN

TRIUMFAPNs

ons-nyc01-enet_2/4

ons-van02-enet_2/2

10.168.1.1

10.168.1.2

APN-2

VLAN-1

VLAN-1

APN-1

APN-2

APN-1

CERN-1

CERN-1

APN-1

APN-1 APN-2

APN-2

OXC Wizard-1

SURFnet-CERN

OXC Wizard-1

STS-24c

STS-12c

Legend

Cancel

OXC Reservation-1

12:00 AM January 1, 2006

12:00 PM March 31, 2006

OXC Reservation-1

Project Networks

• Ramp Down

•cancel light paths

•release metro/campus

network custom configs

Questions?

uclpv2-hopi issues bof joint techs workshop vancouver, bc 2005

Documents

new apn cern

ons tree

triumf ons man interface

use apn cern

new cern interface gary

blank apn diagram cern

new mouse

surfnet ons man interface