June 1999

www.canarie.ca

www.canet3.net

Bernard TurcotteDirector Special projectsTURCOTTE@canarie.ca

““Canada’s National Optical Internet”Canada’s National Optical Internet”

Background: Yesterday Telcos: What is the Internet anyway? If you want a real network use X.25! You will never need anything faster that DS3! Commercial institutions will NEVER use the

Internet because it can NEVER be secure. Home users will NEVER be able to understand IP

Background: Today World’s largest bookstore is Amazon.com Most major banks offer Internet based services Major retailers all offer Internet based shopping Transmission speed limitations are starting to fade Basic Internet usage is thought in grade school Telework is becoming a reality

Background: Tomorrow IP telephony will be common and will

fundamentally alter the business model for carriers

MP3 is becoming a defacto standard for music and will fundamentally alter the business model for recording and distribution houses.

MPEG2 is the standard for digital video and will fundamentally alter the business model for the film, video, television, cable and satellite industries

Telework, telelearning and telehealth will become commonplace.

Mission: To facilitate the development of Canada’s communications infrastructure and stimulate next generation products, applications and services

Canadian equivalent to Internet 2 and NGI private-sector led, not-for-profit consortium consortium formed 1993 federal funding of $104.5 M (1993-99) total project costs estimated over $500 M currently over 140 members; 21 Board members Phase III funding to be announced 1998-2001

$55 million announced for Optical Internet -March 1998

CANARIE Inc

CA*net II 2xOC3

GigaPOP

T3 + OC3 to USOC3 to Europe

CA*net 2 Network

Vancouver

Calgary ReginaWinnipeg

Windsor

Ottawa

Montreal

Toronto

Halifax

St. John’s

FrederictonCharlottetown

RAN

BCnet

WURCnetSRnet

MRnet

ONet

RISQ

ACORN

OC3

OC3 DS3 OC12

OC12 - OC3

OC48

DS3

ARDNOC to provide traditional NOC as well as advanced network services

support to the CA*net II/3 user (R&E) community. to facilitate and coordinate development, testing and deployment

of next generation Internet networks, applications and services between CA*net II users as well as international R&E users

to explore, modify, test and deploy new services, tools, and techniques that could be required in future commercial NOCs

to document and disseminate knowledge

The Year in Review 13 GigaPOPs up and running

over 30 universities and research institutes connected Over 20 Demos of advanced applications

about half between Europe and North America Several “persistent” high performance applications e.g.

NRC BioInformatics Callisto video server

ARDNOC up and running with 8 staff Qbone about to start in 5 sites

The Year in Review Still some problems with ATM switches and SVCs MBGP multicast now working Native IPv6 network up and running Hierarchical Cache now working with 5 GigaPOPs & 12

universities Stats & Measurements - Surveryor and OC3mon working Peering with 5 international next gen Internets - 12 more

expected next year Close collaboration with Internet 2, NSF and NGI

CA*net 3 Objectives In partnership with industry, universities and research

community carry out R&D in optical Internet technologies, services and applications

To showcase different Canadian technologies, applications and services - Cambrian, PMC Sierra, Newbridge, etc

To facilitate a partnership between industry, carriers, RAN’s and R&E community in order to accelerate the deployment of next generation Internet products and services; and

To catalyze the building of a sustainable virtual high performance R&E network

1999 Program Network to be fully deployed 1st quarter

2 x OC-48 wavelengths with POS - 5 Gbps Layer 3 restoral & route diversity provided by CA*net 2 (IP over ATM) running in

parallel Fast restoral and explicit routing with MPLS Optical Internet Exchange - 3rd quarter Gigabit Ethernet over WDM in metro - 1st quarter 10xGbE on additional wavelengths- 3rd quarter Cut through wavelengths - 4th quarter Use of both sides of fiber ring with layer 3 restoral - 4th quarter Several Schoolnet Caching Pilots underway - 2nd quarter High Speed Video Delivery - 3rd quarter Advanced route diversity - 1st qtr 2000

GigaPOP

CA*net 3 National Optical Network

Vancouver

Calgary ReginaWinnipeg

Ottawa

Montreal

Toronto

Halifax

St. John’s

FrederictonCharlottetown

RAN

BCnet

WURCnet SRnet MRnet

ONetRISQ

ACORNOC3

OC3 DS3 OC12

OC48

ChicagoSTAR TAP

CA*net 3

OC12 Teleglobe

Seattle

New York

National IP/WDM Network

Ottawa

Montreal

Toronto

Winnipeg

ReginaCalgary

Edmonton

Vancouver

Saskatoon

- CANARIE Drop Site Halifax

Fredericton

Chicago

CANARIE OC-192 Route

CANARIE OC-48 Route

Charlettown

St. John’s

Teleglobe

16 Wavelengths per route8 for CANARIE8 reserved for traditional SONET 4/BLSR by carrier

Possible 10xGbE over DWDM

Seattle

New York

Exciting Developments in 10xGbE Several companies have announced long haul 10xGbE CWDM with

transceivers at 50km spacing Costs are less than $12K US per node (or transceiver) for OC-192 data

rates Future versions will allow rate adaptive clocking for use with “gopher

bait” fiber, auto discovery, CPE self manage Excellent jitter specification Most network management and signaling done at IP layer Anybody with LAN experience can build a long haul WAN – all you

need is dark fiber Maybe the beginning of the end of managed bandwidth

Interesting parallel with time share computing of the 60s & 70s

Third Generation Router Terabit routing - 32 x OC 192 - “Tiny Tera”

Juniper, Pluris, Nortel Avici, CISCO, Argonne, Ironbridge, Torrent, Nexabit, Terabit Corp, Netcore

5 Tiny Tera = all existing switch capacity in North America Routing on a chip with no caching

wire speed routing with HPCC techniques BGP+, CBQ and MPLS Only “let it smoke” packets

Integrated OADM with SONET path/link protection services and Fast IP framing

Advanced routing functions like multicast, interior routing be handled by GigaPOP or CPE router

National Film Board of CanadaVOD Project

Joint project between NFB, CANARIE and RISQ 800 documentary films on-line on CA*Net 2 and soon on

CA*Net 3. 100 simultaneous connections Currently looking at:

Creating an international VOD exchange site IP owners workshop MPEG2 version Integration the Canadian Broadcasting Corporation (CBC)

Connectedness

Canada has highest penetration of telephone and cable Highest ranking of G7 countries on technology potential World leader in optical networking technology Major government initiative on connecting all schools Major government initiative on community access World first high speed optical Internet backbone Connectedness seems to be a unique Canadian strength So, maybe our next grand challenge is…..

Gigabit Internet to Every Canadian School, Library &

eventually Home? Building on CA*net 3, a new research initiative in

partnership with industry, R&E, federal government provinces to explore and develop the technology that can be used deliver extreme high speed Internet to every school and library in Canada, and eventually to every home

Why should we do this?? Many school boards and provinces are deploying T1 and DSL

services to the schools But is this fast enough? Particularly if want to connect every class room And each class room is downloading their own video stream

Soon we will need 10/100/1000 Mbps each school Schools and universities are in many ways early adopters of

information technology By leveraging our research in optical Internets this might enable

early deployment of high speed Internet to the school and then eventually an architecture for high speed Internet to the home

Promote Canadian Content One of the big costs of Internet delivery is not the network, but

buying Internet access from a US service provider But a Gigabit Network to every school could be used to

promote development of Canadian high speed multimedia content Canadian content would be fast, immediate and exciting and

very low cost Foreign content would be slow and expensive

Early examples of GITS Palo Alto has built a municipal owned regional network to

deliver 100 Mbps Internet to every home and school Cost $40 per month MFS has proposed building a new sewer system for Palo Alto

so it can pull fiber into the home Bell South has a 10/100 Mbps Internet service trial

no telephone, no video - just the Internet Washington State is deploying Gigabit Ethernet to every school

approx $100 month Sweden has deployed Gigabit Internet to major universities

$3500 per month including Internet access

Possible GITS program CANARIE, industry and government establish a research program to

investigate the technologies and develop a possible framework for GITS

Build on the lessons and technology that we are developing with CA*net 3 and the regional optical Internets

Many research issues in scalability, management, low cost DWDM, layer 3 optical Internet services, IPv6, etc

Leading to early field trials and pilots across Canada Actual deployment will be done by private sector Competitive equal access at all levels essential

competition not technology that drives innovation and reduced pricing

Possible GITS Concepts A third commercial network running in parallel to telephone

and cable Avoids regulatory and technical issues of 911, number

portability, etc Encourages SMEs and entrepreneurs to build the infrastructure

Deliver high speed Internet only IP telephony and IP video maybe can be added at a later date

Build on the infrastructure we are putting in place for CA*net 3 with optical RANs, GigaPOPs, etc

Possible GITS Concepts Federal and Provincial government encourages deployment by

funding schools as first customer and early adopter But governments specify an architecture that guarantees

competitive access that can lead to deployment to every home Electric utility companies, municipal governments, CLECs,

and traditional telco and cableco can participate equally

Preliminary Analysis Early Fiber to the Home was too expensive because it assumed

fiber from every home to a CO expensive terminal equipment required to provide voice and video but voice traffic is going wireless and broadcast is going by satellite

GITS requires no CPE, only 10/100/1000 NIC card With low cost DWDM, PON, new architectures that feature

competitive equal access ... GITS may be marginally more expensive than xDSL or cable

modems and with 1000 times the bandwidth!!!

Possible GITS Architecture

ATM GigaBit Ethernet

OADM

Optical RAN ringin partnership with cableco, telco, or CLEC

OADM

OADMOADM

OADM

OADM

POS

ISP A ISPC

Commercial InternetCA*net 3 GigaPOP

OADM

Local WDM Fiber Ring Provided by Cable Company, Telco or CLEC

OADM

OADM

OADM

OADM

Local WDM Fiber Ring Provided by Cable Company, Telco or CLEC

OADM

OADM

Major University

POM

Gigabit to the Home

ISP A

ISP B

ISP B

CompetitiveAccessPedestal

House Dual Homed

RoutingPuck

OADMPOM

2 Fibers

OA

DM

Multi carrier ring provided by competitiveaccess provider withseparate wavelengthsor fiber assigned toeach ISP

Single carrier ringwith individual fibersusing POM

OADM

ISPC Internet Connection

ISPA Internet Connection

CopperPair

ISP C

POM

100 Base T

10 Base T

2 wavelengths

Opportunity for Canada World leadership in optical Internet technologies

PMC Sierra, QNX, Cambrian, Nortel, Newbridge, CISCO, etc Opportunity to quickly incorporate and act on lessons learned from

CA*net 3 and ORANs Opportunity to promote and encourage Canadian high bandwidth

multimedia content for schools and libraries Canada has the highest penetration and lowest cost first residential

network Canada was the first country to build the second residential network -

cable TV Canada can be the first country to build a “third” residential network -

high speed Internet- and continue to be the most connected nation in the world