gh1 architecting the network geoff huston network technical manager [email protected]
TRANSCRIPT
![Page 1: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/1.jpg)
GH 1
Architecting the NetworkArchitecting the Network
Geoff Huston
Network Technical Manager
Telstra
[email protected]@telstra.net
![Page 2: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/2.jpg)
GH 2
Architecture and DesignArchitecture and Design
• Definition of Architectural Principles• Translating Architecture into a Design• Generating an Engineering Plan• Implementing the Network• Operational Considerations• Policy Considerations
![Page 3: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/3.jpg)
GH 3
Personal ExperiencePersonal ExperienceThe Australian Internet - AARNet
• Constructed in May 1990• Initially 45 client sites (now 450)• Modest implementation budget initially $US 1.2M)• Modest initial staff resources (2)• June 95: $10M p.a. with 5 staff
Telstra• commenced July 95• telco Internet provider
![Page 4: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/4.jpg)
GH 4
Architectural PrinciplesArchitectural Principles
Assumption:• Implementation of Public Infrastructure on a
National Scope
Design issues will vary for commercial and/or corporate networks
![Page 5: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/5.jpg)
GH 5
Architectural PrinciplesArchitectural Principles
• Simplicity• Functional Adequacy• Affordability• Implementable today• Designed to meet actual end client requirements• Uses (and develops) local expertise• Where feasible uses locally available components
![Page 6: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/6.jpg)
GH 6
Architectural PrinciplesArchitectural Principles
Simplicity is the key attribute of any network architecture
Diverse, complex and uncoordinated architectures result in very high implementation and operational costs, and are resistant to subsequent incremental engineering.
![Page 7: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/7.jpg)
GH 7
Design ConsiderationsDesign Considerations
• Design objective is to minimise costs and maximise capability
• Unless you are a telco bandwidth lease will dominate all other cost elements• even then it will probably
dominate all other costs!• The unit cost of bandwidth is
the major design parameter
Domestic Bandwidth
Intnl Bandwidth
Equipment
Staff & Admin
Domestic Carriage
International Carriage
Staff
Equipment
![Page 8: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/8.jpg)
GH 8
Design ConsiderationsDesign Considerations
• Implementation and operational cost• Network performance• Operational reliability• Manageability• Extensibility
![Page 9: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/9.jpg)
GH 9
Design StrategyDesign Strategy
• Affordable capacity defines delivered service quality• Solve today's problems first• Define a service which matches current needs before
matching future expectations
![Page 10: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/10.jpg)
GH 10
Design ComponentsDesign Components
• Internet Transport Service Core• Leased circuits• Routers
![Page 11: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/11.jpg)
GH 11
Design ComponentsDesign Components
• Access Services• Routers• Modems
![Page 12: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/12.jpg)
GH 12
Design ComponentsDesign Components
• Application Service Elements
Servers:DNS
USENET
WWW
FTP
ARCHIE
![Page 13: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/13.jpg)
GH 13
Abstract DesignAbstract Design
Router Interface design model
Client Interface
Peer Network Interface
Network Infrastructure
![Page 14: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/14.jpg)
GH 14
The Client InterfaceThe Client Interface
![Page 15: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/15.jpg)
GH 15
The Client InterfaceThe Client Interface
• Single Homed Clients• Client uses single service provider offering
"default" service• Client's networks are advertised via provider
![Page 16: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/16.jpg)
GH 16
The Client InterfaceThe Client Interface
• Use of RIP as Network / client boundary routing protocol? simple widely implementedXNOT applicable in all casesX no support for classless address exchange
![Page 17: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/17.jpg)
GH 17
The Client InterfaceThe Client Interface
• Use of STATIC ROUTES as Network / client boundary routing protocol?simplewidely implementedcan support classless address advertisementsO requires careful design to scaleX cannot support dynamic multi-homed connections
![Page 18: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/18.jpg)
GH 18
The Client InterfaceThe Client Interface
• Use of Classless Client boundary routing protocol?• EIGRP - propriatary B-F Distance Vector• OSPF - IETF Std Link State• RIPV2 - IETF Std B-F Distance Vector• BGP4 - IETF Std Inter Domain Routing Protocol
![Page 19: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/19.jpg)
GH 19
The Client InterfaceThe Client Interface
Static routing
Client Network150.10.0.0
0.0.0.0
(default)
150.10.0.0
ip route 150.10.0.0 255.255.0.0 serial1 ip route 150.10.0.0 255.255.0.0 loopback0 230
![Page 20: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/20.jpg)
GH 20
The Client InterfaceThe Client Interface
Dynamic Routing Guidelines• Use of inbound routing filters to preserve network
integrity• prevent client advertising bogus routes• preserve integrity of client network
![Page 21: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/21.jpg)
GH 21
The Client InterfaceThe Client Interface
• Dynamic Routing Guidelines• Use of outbound static default route to simplify
client routing• stability of presented service• simplicity of presented service• client sees only an external default path
![Page 22: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/22.jpg)
GH 22
The Client InterfaceThe Client Interface
150.10.0.0
Client Network
0.0.0.0 (default)
Input Routing Filter 150.10.0.0 all else
150.10.0.0
RIP
![Page 23: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/23.jpg)
GH 23
The Client InterfaceThe Client Interface
• Clear demarcation of boundary between client and network is required for consistency of service
• Single demarcation model is required for the network to ensure manageability and operability.
• The network service should never transit a client network
![Page 24: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/24.jpg)
GH 24
The Client InterfaceThe Client Interface
Routing Filters
Client Network
Host Access Filters Firewall Filters Service Definition Filters
Tail Loop
Client Site Router
Network POP Router
![Page 25: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/25.jpg)
GH 25
The Client InterfaceThe Client Interface• The POP Access Model
• Client is responsible for CPE router and tail loop• Network Provider provides router attachment points
at a number of locations• Network Boundary located at POP interface
![Page 26: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/26.jpg)
GH 26
The Client InterfaceThe Client Interface• The Comprehensive Service Model
• Network provider installs and operates CPE router and tail loop
• Network provider attaches to client LAN• Network Boundary located at LAN attachment point
![Page 27: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/27.jpg)
GH 27
The Client InterfaceThe Client Interface
• The Confused Model• Network Provider installs tail loop• Network Provider installs router interface card in
client router• Client and network provider operate client router
simultaneously
![Page 28: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/28.jpg)
GH 28
The Client InterfaceThe Client Interface
• POP or end-to-end model depends on:• telco bulk purchase tariff discounting• router vendor bulk purchase discounting• staff availability• client expertise levels• defined service level
• Client Site service model is preferable from a commercial perspective
![Page 29: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/29.jpg)
GH 29
The Client InterfaceThe Client Interface
• You can do both POP and end-to-end• as long as all routing integrity is maintained within
the POP locations for all clients• The integrity of the system is maintained within the set of
"core" routers
![Page 30: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/30.jpg)
GH 30
The Client ConnectionThe Client Connection
• Routers provide:• security capability• management capability
• routing management• traffic management• service management
• efficiency• integration
![Page 31: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/31.jpg)
GH 31
The Client ConnectionThe Client Connection
• SLIP / PPP implementations in hosts• cheap!• Capital price differential between hosts and router is
small• Operating cost is higher using hosts as routers• use as single end host access system
![Page 32: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/32.jpg)
GH 32
Routing to the ClientRouting to the Client• Multiple client interfaces
• bifurcation of client and provider network - multiple default paths
• asymmetric routes can be generated• client network internal breakage causes black hole
routing• requires careful management and clear understanding
of the routing issues
![Page 33: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/33.jpg)
GH 33
Routing to the ClientRouting to the Client• Multiple providers
• Only one provider can provide "default"• other connected providers must resort to explicit
provision of routes to enumerated networks• All providers must ensure that the client is not used
as a transit facility through explicit route management on the part of all providers
![Page 34: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/34.jpg)
GH 34
Distributed Client supportDistributed Client support• VPN architecture issues
• VPNs via filtering• VPNs via tunnelling
• Why Support VPNs?
![Page 35: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/35.jpg)
GH 35
Network Peer InterfaceNetwork Peer Interface
![Page 36: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/36.jpg)
GH 36
Network Peer InterfaceNetwork Peer Interface
• Who is my peer?• Differentiating between:
• client network (they pay me!)• service provider network (I pay them!)• peer network (we pay each other!)
• There are no Internet mechanisms to determine who is a peer network
![Page 37: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/37.jpg)
GH 37
Network Peer InterfaceNetwork Peer Interface
• Where do I peer?• Onshore 1:1• Onshore at a layer 2 exchange• Offshore via Service Provider• Offshore at a layer 2 exchange
![Page 38: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/38.jpg)
GH 38
Network Peer InterfaceNetwork Peer Interface
• Routing Considerations• Export routes via BGP4 using CIDR• Import routes using whatever works easily!
• Operational Considerations• Minimise bandwidth used by routing• maximise operational stability
![Page 39: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/39.jpg)
GH 39
Network Route ManagementNetwork Route Management
• Obtain registered Autonomous System number (AS) • from IANA or your Regional Registry
• Generate aggregate mask which covers all announced networks
• Announce CIDR aggregate to peer via BGP4 session
![Page 40: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/40.jpg)
GH 40
Single Exterior PeerSingle Exterior Peer
• Announce local nets via CIDR aggregate using BGP4• Synthesise static default route directed to exterior peer
gateway
default route
CIDR Aggregate statically configured in exterior gateway
![Page 41: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/41.jpg)
GH 41
Multiple Exterior PeersMultiple Exterior Peers
• Externally Imposed Policy differentiation• For example:
• Academic & Research peer external network• Commercial peer external network
• Routing is Destination address-based - not source address• Default route based on best policy match• Explicit routes are imported from other network peers• Traffic path based on destination net - not local source
policy
![Page 42: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/42.jpg)
GH 42
Multiple Exterior PeersMultiple Exterior Peers
default route
Explicit routes imported via BGP4
Policy Matched CIDR Aggregate announcement statically configured in exterior gateways
![Page 43: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/43.jpg)
GH 43
Multiple Exterior PeersMultiple Exterior Peers• Transit Arrangement
• Importation of transiting AS network numbers• Announcement of transiting networks via AS path
mechanism
![Page 44: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/44.jpg)
GH 44
Exterior PeeringExterior Peering
• Importing a default route is cost effective and highly efficient as long as there is a suitable policy and capability match with the peer
• Default-less routing is expensive, time-consuming, and can be unstable
• Default-less routing allows greater levels of self-determination of policy - with an operational cost
![Page 45: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/45.jpg)
GH 45
Exterior PeeringExterior Peering
• Use a simple model initially:• Single exterior peer• Derived default route• Announce CIDR aggregate to peer
![Page 46: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/46.jpg)
GH 46
Network InfrastructureNetwork Infrastructure
![Page 47: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/47.jpg)
GH 47
Network InfrastructureNetwork Infrastructure
• Bandwidth is a coarse control tool
0
10
20
30
40
50
60
70
80
Effective Data Throughput under TCP Load
RTT failure
Retransmission
Peak Efficiency
![Page 48: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/48.jpg)
GH 48
Network InfrastructureNetwork Infrastructure
• Engineer capacity for peak demand periods• Understand end-to-end flow patterns• Attempt to avoid sustained (> 15 minutes) acute
congestion on any link• Constantly monitor bandwidth utilisation and flow
patterns• Generate trend patterns and plan accordingly
![Page 49: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/49.jpg)
GH 49
Network InfrastructureNetwork Infrastructure
![Page 50: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/50.jpg)
GH 50
Network InfrastructureNetwork Infrastructure
• Communications techology choices:• Dedicated Facilities
• point to point leased circuit• point to point radio
• Common Switched Facilities• X.25• Frame Relay• SMDS access • ATM
![Page 51: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/51.jpg)
GH 51
Network InfrastructureNetwork Infrastructure
• Leased circuit design• Performance• Reliability• (In)Flexibility• Cost
![Page 52: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/52.jpg)
GH 52
Network InfrastructureNetwork Infrastructure
• Hierarchy (Star) Topology
+ Minimal Cost
+ Simple Topology
+ Maximal efficiency
- Critical points of failure
![Page 53: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/53.jpg)
GH 53
Network DesignNetwork Design
![Page 54: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/54.jpg)
GH 54
Network DesignNetwork Design
Darwin
Brisbane
Sydney
Canbe rra
Hobart
Ade laide
Perth
Melbourne
128K ISDN
2Mbps Megalink
2Mbps Megalink
256K ISDN
2M2M
2M
1.5M Cable
US Internet
Within each State a hub configuration provides a connection point for all local sites.
The Australian Academic and Research Network Trunk Configuration - September 1993
![Page 55: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/55.jpg)
GH 55
Network DesignNetwork DesignTelstra Internet Network - June 1996
![Page 56: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/56.jpg)
GH 56
Network InfrastructureNetwork Infrastructure• Mesh Topology
+ Resiliancy against link or site failure
- Higher communications lease cost
![Page 57: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/57.jpg)
GH 57
Network InfrastructureNetwork Infrastructure
• Hybrid - Resiliancy via Dial-on-Demand• Establish backup circuits using ISDN, X.25 or
modems• Issue of matching backup capacity against primary
capacity
![Page 58: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/58.jpg)
GH 58
Network InfrastructureNetwork Infrastructure
• Access to common switched services• X.25• Frame Relay• SMDS• ATM
![Page 59: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/59.jpg)
GH 59
Network InfrastructureNetwork Infrastructure
• Switched Network Design Issues• Delivered Service contract (and enforceability)• Tariff issues• Dynamic vs static virtual channels• Efficiency• Congestion behaviour
![Page 60: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/60.jpg)
GH 60
Network Infrastructure DesignNetwork Infrastructure Design
• “Core” routers driving major internal trunk lines• “Boundary Routers” providing client connection point• “Access Routers” used on client site
![Page 61: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/61.jpg)
GH 61
Routing within the NetworkRouting within the Network
• Choosing an Interior Routing Protocol• RIP (V2)• OSPF• (E)IGRP
• Classless routing protocols are now essential for this domain
![Page 62: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/62.jpg)
GH 62
Routing within the NetworkRouting within the Network
• Integrity and stability of the routing domain is essential• The routing protocol is not used to learn new routes
• authenticity of the route• security and integrity of the routing domain
• The routing protocol is only used to promulgate the route within the network
![Page 63: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/63.jpg)
GH 63
Routing within the NetworkRouting within the Network
• Use of static routes to dampen down route flaps• A transition of a route (up / down) causes all
routers to undertake a cache dump and rebuild the route table from received routing information
• Route Flapping can destroy network performance• default is synthesised to all network clients through
presentation to the client of a static default route
![Page 64: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/64.jpg)
GH 64
Service ManagementService Management
• Use of router facilities to define service levels• form of bandwidth management:
• transmission priority lists• bandwidth class scheduling
• Can improve performance of defined services under load• Effectively such measures are within the area of
"congestion management"• The intent is to provide resources to some services when
the bandwidth resource is under load
![Page 65: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/65.jpg)
GH 65
Service ManagementService Management• Priority Example:
• High priority on packets to and from port 23 (telnet) and 513 (rlogin)
• Low priority on packets to/from port 119 (net news)• Class Scheduling
• Allow telnet and rlogin up to 50% of available bandwidth when under contention
• Allow nntp up to 2% of bandwidth when under contention• Class Scheduling is a more stable approach to congestion
management
![Page 66: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/66.jpg)
GH 66
Network OperationNetwork Operation
• Management of IP numbers is critically important:• Ensure network number registration information is
accurate• Publish correct IP numbers to external network
peers• Ensure that correct IP numbers are routed• Ensure that end clients are using correctly allocated
numbers
![Page 67: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/67.jpg)
GH 67
Operation of a ServiceOperation of a Service
• Service Quality is achieved by a match of capability to demand:• technical capability to carry user load• financial capability to provide adequate resource
![Page 68: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/68.jpg)
GH 68
Stitching it all TogetherStitching it all Together
• roll out• shipping• end site training / interaction
![Page 69: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/69.jpg)
GH 69
Operational ManagementOperational Management
• All active elements of the network centrally managed• SNMP used as platform for management• routers are the central component of operations
![Page 70: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/70.jpg)
GH 70
Operational ManagementOperational Management
• snmp traps used for exception reporting• never underestimate the power of ping !• traceroute - the route reporter• dig - DNS diagnosis
![Page 71: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/71.jpg)
GH 71
Operational ManagementOperational Management
• Each management environment has particular requirements
• Routers are the most reliable network element• carrier services are the greatest point of vulnerability• careful router configuration will isolate LAN faults
![Page 72: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/72.jpg)
GH 72
Operational ManagementOperational Management
• Internet issues - working within a larger muti-provider environment:• NOC obligations• trouble ticket management
![Page 73: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/73.jpg)
GH 73
ReportingReporting
• Goals of data collections and reporting:• operational management• trend analysis of traffic volumes• monitor levels of delivered service• monitor usage patterns• marketing material!
![Page 74: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/74.jpg)
GH 74
ReportingReporting
• Balance of cost of data collection and analysis against benefit of resultant data sets
• Data collection points affect ability to gather data
![Page 75: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/75.jpg)
GH 75
ReportingReporting
• Routers:• Interface volumes• Line errors• routing tables• router resource use
![Page 76: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/76.jpg)
GH 76
ReportingReporting
• nnstat - ethernet monitoring with a host• gather packet header information• source - destination volumes• application generated volumes• highly flexible data gathering ability• expensive to deploy!
![Page 77: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/77.jpg)
GH 77
Example Data Collection Example Data Collection ArchitectureArchitecture
• Routers• 15 minute interface volumes and error count
• nnstat• Deployed at network peer boundary
SMTP
NNSTAT
![Page 78: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/78.jpg)
GH 78
Network ReportsNetwork Reports
• weekly report of 15 minute link load levels
![Page 79: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/79.jpg)
GH 79
Weekly Link ReportWeekly Link Report
15 minute line samplenormalized to % utilization
Histogram of samples as load
signature
![Page 80: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/80.jpg)
GH 80
Network ReportsNetwork Reports• monthly reports• quarterly trend reports and projections
![Page 81: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/81.jpg)
GH 81
Policy ConsiderationsPolicy Considerations
• This space intentionally left blank!
![Page 82: GH1 Architecting the Network Geoff Huston Network Technical Manager Telstragih@telstra.net](https://reader034.vdocument.in/reader034/viewer/2022050920/55148cc2550346b0158b5e17/html5/thumbnails/82.jpg)
GH 82
SummarySummary
• Network Design defined by router interaction• Client Service interface• Network Peer interface• Internal network design
• Operational Considerations• Policy Considerations