The Management The Management Infrastructure of a Infrastructure of a

Network Measurement Network Measurement System for QoS System for QoS

ParametersParametersAlexandru Bikfalvi, Paul PAlexandru Bikfalvi, Paul Pătraş, ătraş,

Mihai Cristian Vancea, Virgil DobrotMihai Cristian Vancea, Virgil DobrotăăTechnical University of Cluj-NapocaTechnical University of Cluj-Napoca

Communications DepartmentCommunications Department26-28 Baritiu Street, 400027 Cluj-Napoca, Romania, Tel/Fax: +40-26-28 Baritiu Street, 400027 Cluj-Napoca, Romania, Tel/Fax: +40-

264-597083264-597083

AgendaAgenda

• Scenario based on existing toolsScenario based on existing tools• Overview of a network management Overview of a network management

systemsystem• Design of the management Design of the management

infrastructureinfrastructure• Experimental resultsExperimental results• Conclusions and future workConclusions and future work

• Vendor specific Vendor specific applications for specific applications for specific platformsplatforms

• Not all applications are Not all applications are QoS capableQoS capable

• Some require complex Some require complex commands, scripts, commands, scripts, procedural stepsprocedural steps

• Manual measurement Manual measurement control (especially on control (especially on different tools)different tools)

• Additional software and Additional software and computations to obtain computations to obtain targeted resultstargeted results

Existing Tools ScenariosExisting Tools Scenarios

MeasuremeMeasurement nt

ApplicationApplicationss

Tested NetworkTested Network

Our Software SolutionOur Software Solution

Tested NetworkTested Network

Network Network Measurement Measurement SystemSystem

ManagemenManagement Consolet Console

MeasuremenMeasurement Agentst Agents

Management Management StationStation

ConsoleConsole• Straightforward user Straightforward user

interfaceinterface• User focuses on scenarios, User focuses on scenarios,

topology, test objectivestopology, test objectives• Runtime operations Runtime operations

performed by the computerperformed by the computer• Measured QoS parameters Measured QoS parameters

available automaticallyavailable automatically

InfrastructureInfrastructure• Software module used by Software module used by

both applicationsboth applications• Measurement information Measurement information

communicationcommunication• Accomplish the task using a Accomplish the task using a

management protocolmanagement protocol

Network Management Network Management OverviewOverviewArchitecture – collection Architecture – collection

of…of…• Managing devices – Managing devices –

management stationsmanagement stations• Managed devices – Managed devices –

network elementsnetwork elements• Management messages Management messages

– management protocol– management protocol

ManagersManagers

AgentsAgents

A comprehensive management architecture is A comprehensive management architecture is usually specific to a management technologyusually specific to a management technology

Managers and AgentsManagers and Agents

Managers handle management Managers handle management taskstasks

• Network Management Systems Network Management Systems (NMS) or Operation Support (NMS) or Operation Support Systems (OSS)Systems (OSS)

• Communicate with the agents Communicate with the agents within the managed deviceswithin the managed devices

• Provide a console or an interface for Provide a console or an interface for user administrationuser administration

• Perform predefined or user-defined Perform predefined or user-defined automated actionsautomated actions

Management ConsoleManagement Console

QoS QoS Measurement Measurement

AgentAgentAgents run on managed Agents run on managed

devicesdevices• Service managers’ requestsService managers’ requests• Notify of unexpected eventsNotify of unexpected events

Message CommunicationMessage Communication

It is done using a management protocol such as SNMP, CMIPIt is done using a management protocol such as SNMP, CMIP

Polling…Request Request message message sent to the sent to the agentagent

Process Process request request and reply and reply backback

Event-driven…

!!An An event event occursoccurs

A notification A notification is sent to is sent to inform the inform the managermanager

The event The event is is processedprocessed

Management Information

• Meaning of data transported by the management Meaning of data transported by the management protocol between the managers and the agentsprotocol between the managers and the agents

There are manyThere are many• ManufacturersManufacturers• EquipmentsEquipments• ApplicationsApplications• ParametersParameters

Repository Repository of of manageable manageable informationinformation

What is requiredWhat is required

• Should contain the managed objects and their Should contain the managed objects and their relationshipsrelationships

• Must provide a base of identifying those Must provide a base of identifying those objectsobjects

• Must be build on widely accepted rulesMust be build on widely accepted rules

Infrastructure DesignInfrastructure Design

NMS NMS ManagemeManageme

ntnt

Structural LogicStructural Logic

The user interacts with The user interacts with these items to perform a these items to perform a measurementmeasurement

Organizes Organizes measurement measurement operations as a set of operations as a set of abstract itemsabstract items

SessionsSessionsGroupsGroupsTasksTasks

Management MessagesManagement MessagesIdentification messages relay information Identification messages relay information about agents’ capabilitiesabout agents’ capabilitiesTask control messages request agents to Task control messages request agents to start a measurement taskstart a measurement taskData messages are used to collect QoS Data messages are used to collect QoS results from a set of agentsresults from a set of agents

Infrastructure DesignInfrastructure Design

The fundamental QoS measurement The fundamental QoS measurement scenarioscenarioA data structure comprising the A data structure comprising the agents and parameters used in the agents and parameters used in the QoS testQoS testReusability: can be saved and later Reusability: can be saved and later loadedloadedSeveral sessions mapped with one Several sessions mapped with one referencereferenceContain unrelated sessions Contain unrelated sessions distributed in timedistributed in timeBased on a single session with a Based on a single session with a variable parametervariable parameter

A session or a group to be executedA session or a group to be executedThe start time can be user-definedThe start time can be user-definedThe execution process done entirely The execution process done entirely by the management softwareby the management software

Infrastructure DesignInfrastructure DesignDefining SessionsDefining Sessions • Agent (s) Agent (s)

involvedinvolved• Generation / Generation / AnalysisAnalysis• Traffic typeTraffic type

• Packet Packet distributiondistribution• Protocol specificProtocol specific

• Desired resultsDesired results

Session 1Session 1Agent 1 Agent 1 ►► Agent Agent

33Session 2Session 2Agent 2 Agent 2 ►► Agent Agent

44

Agent Agent 11

Agent 2Agent 2Agent 3Agent 3

Agent 4Agent 4

Task 1Task 1Session 2Session 2 @ 1 o’clock @ 1 o’clock

Task 2Task 2Session 1Session 1 @ 3 o’clock @ 3 o’clock

(pending(pending))

(pending(pending))

(running(running))

(finishe(finished)d)

(runnin(running)g)

QoS P

ara

mete

r

TimeTime

Management StationManagement Station

Scheduling and Running TasksScheduling and Running Tasks

CollectingResultsCollectingResults

Management MessagesManagement Messages

Access ProceduresAccess Procedures

Set RequestSet Request

Request ResponseRequest Response

Get RequestGet Request

Request ResponseRequest Response

Get RequestGet Request

ResponseResponse

Structure of Structure of Management Management InformationInformation

isoisoisoiso

orgorgorgorg

doddoddoddod

interneinternett

interneinternett

experimentexperimentalal

experimentexperimentalal

11

33

66

11

33

connectionconnectionconnectionconnection

systemsystemsystemsystem

traffictraffictraffictraffic

advancedadvancedadvancedadvanced

11

22

33

44

Object Object ClassesClasses

The management infrastructure uses The management infrastructure uses the Simple Network Management the Simple Network Management

ProtocolProtocol

ManagemenManagement Stationt Station AgentAgent

Software ArchitectureSoftware Architecture

Measurement Measurement ServicesServices

Communication Communication ServicesServices

ManagemeManagement Consolent Console

ManagemeManagement Consolent Console

MeasuremeMeasurement Agentnt Agent

User User InterfaceInterface

User User InterfaceInterface

Session Session ManagerManager

Queuing Queuing ServiceService

SNMP SNMP ServiceServiceSNMP SNMP

ServiceService

ManagemeManagement Servicent Service

• Management console’s QoS Management console’s QoS measurement intelligencemeasurement intelligence

• Enables user control through Enables user control through various windows and dialogsvarious windows and dialogs

• Allows creation of measurement Allows creation of measurement sessions, groups and taskssessions, groups and tasks

• Runs the measurement task; Runs the measurement task; collects and stores resultscollects and stores results

• Synchronous service for Synchronous service for asynchronous messagesasynchronous messages

• Message retransmissions, Message retransmissions, duplicates deletion, timeoutduplicates deletion, timeout

• Encapsulation of messages to Encapsulation of messages to SNMP PDUsSNMP PDUs

• SNMP data verification, buffer SNMP data verification, buffer overflow checking overflow checking

• A thread for each assigned local A thread for each assigned local network interfacenetwork interface

• Socket I/O operations with SNMP Socket I/O operations with SNMP datadata

Management ConsoleManagement Console

Session ManagerSession ManagerSession ManagerSession Manager

The primary application that enables the The primary application that enables the users to perform QoS measurementsusers to perform QoS measurements

GUIGUIGUIGUI Task Task SchedulingScheduling

Task Task SchedulingScheduling

Queuing ServiceQueuing ServiceQueuing ServiceQueuing Service

SNMP ServiceSNMP ServiceSNMP ServiceSNMP Service Management Management ServiceService

Management Management ServiceService

Service Control ManagerService Control ManagerService Control ManagerService Control Manager

Configuration ServiceConfiguration ServiceConfiguration ServiceConfiguration Service

Hard

ware

Man

ager

Hard

ware

Man

ager

Hard

ware

Man

ager

Hard

ware

Man

ager

Message Message WrapperWrapperMessage Message WrapperWrapper

Running Core ServicesRunning Core Services

I want to schedule I want to schedule my first my first measurement task measurement task using using Agent 1Agent 1

I want to schedule I want to schedule my first my first measurement task measurement task using using Agent 1Agent 1

GUIGUI SessionSession ManagerManager

TaskTask

PendingPendingRunningRunning

OutboundOutbound

InboundInbound

Level 1Level 2

Level 3Level 4

Level 1Level 2

Level 3Level 4

MessagMessagee

MessagMessagee

MessagMessagee

MessagMessagee

MessagMessagee

ACKACK

MessagMessagee

MessagMessagee

Queuing ServiceQueuing Service

Management Management ServiceService

MessagMessagee

SNMP ServiceSNMP Service

222200001111

SNMPSNMP

Experimental ScenarioExperimental Scenario

Management Management StationStation

Cisco Catalyst Cisco Catalyst 29502950

AgentAgent

1Gpbs 1Gpbs SysKonnect SysKonnect

Measurement Measurement Endace DAGEndace DAG

AgentAgent

ObjectivesObjectives• SysKonnect system SysKonnect system

performanceperformance• ThroughputThroughput

• Packet delay variationPacket delay variation

• Packet lossPacket loss

1000 Base SX1000 Base SX

ParametersParameters• Frame rate: 200 to 100,000 Frame rate: 200 to 100,000

ppspps• Frame size: 1500 bytesFrame size: 1500 bytes

• Test duration: 100 secondsTest duration: 100 seconds

• Packet distribution: Packet distribution: periodicperiodic

Experimental ResultsExperimental Results

• Series of tests vs. packet rate at 1500 byte Series of tests vs. packet rate at 1500 byte framesframes

0

1

2

3

4

5

6

7

0 20 40 60 80 100Packet Rate [103 pps]

Num

ber of

Pac

kets

[10

6 pac

kets

]

Tx Packets

Rx Packets

0

1

2

3

4

5

6

7

0 20 40 60 80 100Packet Rate [103 pps]

Num

ber of

Pac

kets

[10

6 pac

kets

]

Tx Packets

Rx Packets

• Packet countPacket count• ThroughputThroughput• Delay Delay

variationvariation• Packet loss Packet loss ratioratio

6 million 6 million packets per packets per 100 100 seconds seconds testtest

0

100

200

300

400

500

600

700

800

0 20 40 60 80 100Packet Rate [103 pps]

Thro

ughp

ut [M

bps]

Throughput (Mbps)

0

100

200

300

400

500

600

700

800

0 20 40 60 80 100Packet Rate [103 pps]

Thro

ughp

ut [M

bps]

Throughput (Mbps)

Almost 700 Almost 700 MbpsMbps

-5

-4

-3

-2

-1

0

1

2

3

4

5

0 20 40 60 80 100

Packet Rate [103 pps]

Del

ay [m

s]

Avg Delay Variation (ms)Min Delay Variation (ms)

Max Delay Variation (ms)-5

-4

-3

-2

-1

0

1

2

3

4

5

0 20 40 60 80 100

Packet Rate [103 pps]

Del

ay [m

s]

Avg Delay Variation (ms)Min Delay Variation (ms)

Max Delay Variation (ms)

Up to 4 Up to 4 millisecondsmilliseconds

-1

0

1

2

3

4

5

6

7

0 20 40 60 80 100

Packet rate [103 pps]

Pack

et L

oss Ra

tio

[%]

Packet Loss Ratio (%)

-1

0

1

2

3

4

5

6

7

0 20 40 60 80 100

Packet rate [103 pps]

Pack

et L

oss Ra

tio

[%]

Packet Loss Ratio (%)

Up to 6.5 Up to 6.5 percentpercent

• Real-time Real-time failurefailure

-1

0

1

2

3

4

5

6

0 20 40 60 80 100

Packet Rate [106 pps]

Real

-tim

e Fa

ilure

s [1

06 tim

es]

Real-time Failure (times)

-1

0

1

2

3

4

5

6

0 20 40 60 80 100

Packet Rate [106 pps]

Real

-tim

e Fa

ilure

s [1

06 tim

es]

Real-time Failure (times)

Conclusions and Future Conclusions and Future WorkWork

• Faster experiment setup and results Faster experiment setup and results processingprocessing

AdvantagesAdvantages

• No human attendance during testing requiredNo human attendance during testing required• Extra features to make network testing easier to Extra features to make network testing easier to

performperform• User focuses on experiment target rather on User focuses on experiment target rather on implementationimplementation• Greater availability of data after a test is Greater availability of data after a test is completedcompleted

• Not portable on all existing platformsNot portable on all existing platforms• Not optimized for local resources usage and all Not optimized for local resources usage and all

measurement proceduresmeasurement procedures• Does not implement a fine-grained analysis to Does not implement a fine-grained analysis to

conserve management bandwidthconserve management bandwidth

DrawbacksDrawbacks

Future WorkFuture Work

• Extend support for other management Extend support for other management protocolsprotocols• Improve communication control procedures Improve communication control procedures between management console and agentsbetween management console and agents

• Include support for other networking Include support for other networking technologiestechnologies

Thank YouThank You