microsoft powerpoint - iit - voip performance management
TRANSCRIPT
![Page 1: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/1.jpg)
Managing the Performance of Enterprise and Residential
VoIP Services
Alan ClarkTelchemy
![Page 2: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/2.jpg)
Outline
• Problems affecting Residential VoIP and Teleworkers
• VoIP Performance and Quality Challenges• VoIP Performance Measurement and Problem
Diagnosis• Passive Monitoring using Embedded Agents• Active Testing using Downloadable Agents• Looking forward to IPTV
![Page 3: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/3.jpg)
Problems affecting Residential VoIP and Teleworkers
• Net Neutrality issues– Deliberate downgrading of priority– Artificial congestion
• Residential gateways– Performance– Difficult to control bandwidth allocation– “Bugs” affecting SIP/RTP connectivity
• Home networks– Home environment– Unexpected sources of congestion
![Page 4: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/4.jpg)
VoIP Performance and Quality Challenges
• Lost packets and jitter due to network congestion– Typically time varying/ transient
• Packet loss due to layer 1-2 problems– Duplex mismatch, bit errors…..
• Delay– High delays lead to conversational problems– Even small delays make echo more obvious
• Echo– Many phone services suffer from echo– Not obvious if delay is very short
• Signal levels– High – clipping, Low – noisy speech, gaps
• Noise levels– Obvious but – should this be a factor in QoE metrics?
![Page 5: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/5.jpg)
Jitter measurements can be misleading!!!
50
75
100
125
150
0 0.5 1 1.5 2
Time (Seconds)
De
lay (
mS
)
Average jitter level (PPDV) = 4.5mSPeak jitter level = 60mS
![Page 6: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/6.jpg)
Packet Loss is time varying
0
10
20
30
40
50
30 35 40 45 50 55 60 65 70
Time (seconds)
50
0m
S A
vg
e P
ack
et
Loss
Ra
te
Average packet loss rate = 2.1%Peak packet loss = 30%
![Page 7: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/7.jpg)
Passive Monitoring using Embedded Agents
• Basic premise– Measure performance close to the user
• Integrate a performance monitoring agent into the IP endpoint (IP phone)
– Send fewer but more meaningful reports• Capture information and report info on transient
problems– Incorporate signal, noise, echo information but avoid
the need to decode the signal• Leverage data already available from the endpoint’s
codec/ echo canceller– Conversational quality calculation requires some
information from the remote endpoint• Need combined information exchange/ reporting
protocol
![Page 8: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/8.jpg)
VoIP Performance Reporting Architecture
RTCP XR
RTCP XR
EmbeddedAgent
EmbeddedAgent
RTCP XR exchanged every5-15 seconds during call
QoS
End of call QoSreport
![Page 9: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/9.jpg)
How to measure performance?
• Subjective quality – “MOS”– Listening quality– Conversational quality
• Objective measurement
![Page 10: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/10.jpg)
What is MOS?
• Extract from an ITU subjective test
• Mean Opinion Score (MOS) was 2.4
• 1=Unacceptable• 2=Poor• 3=Fair• 4=Good• 5=Excellent
0
10
20
30
40
50
Votes
1 2 3 4 5
Opinion Score
![Page 11: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/11.jpg)
Objectively estimating MOS
• VQmon– Passive measurement algorithm, widely used in VoIP test
tools and IP phones/ gateways (tested vs P.562)• ITU G.107
– Transmission planning model– Used for monitoring but does not comply with P.562
• ITU P.562– Standard for testing IP based passive measurement
algorithms• ITU P.563
– Voice sample based passive measurement algorithm, very compute intensive
– Only accurate when averaged over many calls• ITU P.862 – PESQ
– Full reference
![Page 12: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/12.jpg)
E model
Packet lossrate
Ie mapping
CalculateRo, Is
Signal level
Noise level
CalculateId
Remote EchoReturn Loss
Symmetric OneWay Delay
CalculateR-CQMOS-CQ
![Page 13: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/13.jpg)
Problems with the E Model
• Additivity problem– Impairments aren’t additive
• Inaccurate for time varying loss
• Inaccurate for consecutive loss
• Conversational quality only
![Page 14: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/14.jpg)
VQmon computational model
Burst lossrate
Gap lossrate
Ie mapping
Perceptual modelETSI TS 101 329-5
CalculateR-LQMOS-LQ
CalculateRo, Is
Signal level
Noise level
CalculateId
Remote EchoReturn Loss
Symmetric OneWay Delay
CalculateR-CQMOS-CQ
Non-linearImpairmentCombinationmodel
ConsecutiveLoss Model
![Page 15: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/15.jpg)
1.5
2
2.5
3
3.5
4
1.5 2 2.5 3 3.5 4Actual Subjective Test Score
Esti
mat
ed S
ubje
ctiv
e Te
st S
core
Impact of TS 101 329-5 model
VQmon - models impactof transient IP problems
“E Model” - basedon average packet loss rate
Ideal
Independent test by France Telecom and University of Bochum
![Page 16: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/16.jpg)
VQmon
Discarded
CODEC
Jitterbuffer
Loss/ Discardevents
Metricscalculation
Markov ModelGather detailedpacket loss infoin real time
MOS-LQMOS-CQR-LQR-CQBurst statisticsDiagnostic data
CODEC,Signal/ Noise/Echo level
PacketStream
![Page 17: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/17.jpg)
VoIP Performance Reporting Architecture
RTCP XR
RTCP XR
VQmonAgent
VQmonAgent
RTCP XR exchanged every5-15 seconds during call
SIP QoS
End of call SIP QoSreport
![Page 18: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/18.jpg)
RTCP XR Reports
Loss Rate Discard Rate Burst Density Gap Density
Burst Duration (mS) Gap Duration (mS)
Round Trip Delay (mS) End System Delay (mS)
Signal level RERL Noise Level Gmin
R Factor Ext R MOS-LQ MOS-CQ
Rx Config - Jitter Buffer Nominal
Jitter Buffer Max Jitter Buffer Abs Max
![Page 19: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/19.jpg)
Information exchange using RTCP XR
RTCP XR
RTCP XR
VQmonAgent
VQmonAgent
Remote Echo Return LossRemote End System DelayRemote Signal Level
![Page 20: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/20.jpg)
RTCP XR as a reporting protocol
RTCP XR
RTCP XR
VQmonAgent
VQmonAgent
Probe or Analyzer-can incorporate signal, noise, echo, delay from XR reports- Can report for both midpoints and endpoints
![Page 21: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/21.jpg)
SIP as a reporting protocol
RTCP XR
RTCP XR
VQmon/EP VQmon/EP
SIP QoS
SIP RTCP SummaryReports
“Collector”(e.g. SQmediator)
![Page 22: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/22.jpg)
SIP RTCP Summary
PUBLISH sip:[email protected] SIP/2.0
………
Content-Type: application/rtcpxr
VQSessionReport
LocalMetrics:
TimeStamps=START:10012004.18.23.43 STOP:10012004.18.26.02
SessionDesc=PT:0 PD:G.711 SR:8000 FD:20 FPP:2 PLC:3 SSUP:on
………
Signal=SL:2 NL:10 RERL:14
QualityEst=RLQ:90 RCQ:85 EXTR:90 MOSLQ:3.4 MOSCQ:3.3
QoEEstAlg:VQMonv2.1
![Page 23: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/23.jpg)
Passive Monitoring – Pro’s and Con’s
• Pro’s– Understand problems affecting actual calls– Capture information that can be post-analyzed to
address customer problem reports– Generates virtually no overhead traffic
• Con’s– Can’t detect a problem until it impacts a live call– Limited ability to run additional diagnostic tests to
isolate and diagnose problem– Can’t deal with failed connections
![Page 24: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/24.jpg)
Downloadable Active Test Agents
• Test agents (VoIP, IPTV…) downloadable from web server
• Agents run tests against a network based server
• Agents initiate tests – minimizes firewall problems
• Results retained by server• Agents can be static or transient
![Page 25: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/25.jpg)
Downloadable Agent - Architecture
AgentBuilder
AgentDeliveryServer
AgentConfigAgentConfigAgentConfigAgentConfig
ServerAgent
ResultsDatabase
User/Test ID
Agent Request/Download
Active Test(s)
![Page 26: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/26.jpg)
Example VoIP test process
• Call connect– Try SIP on port 5060– Try SIP on alternate port– Try encrypted SIP on alternate port– Agent reports what it had to do in order to connect
• Media path quality– Establish bidirectional RTP stream using voice
payloads, measure quality– Establish bidirectional “non-RTP” stream, measure
quality
![Page 27: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/27.jpg)
What can active tests discover?
• Call connect tests– Service provider may be blocking SIP– Residential gateways can (mistakenly) block SIP– Problem accessing server– ……..
• Media path quality– Network congestion– Layer 1-2 problems, duplex mismatch, bit error
problems……– Net (non) neutrality
![Page 28: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/28.jpg)
Use Active or Passive tests?
• Need both• Active tests
– Predeployment testing– SLA monitoring– Troubleshooting
• Passive monitoring– Service assurance– SLA monitoring– Customer service
![Page 29: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/29.jpg)
Looking forward to IPTV
• IP Video is much more sensitive to transmission impairments than VoIP
• Much more complex video structure makes quality estimation more difficult
• IPTV is usually encrypted, which makes quality estimation even more difficult
• Making IPTV work over existing DSL infrastructure
• Service providers need to prove that IP based services work
![Page 30: Microsoft PowerPoint - IIT - VoIP Performance Management](https://reader034.vdocument.in/reader034/viewer/2022042614/555bda3bd8b42adf478b54a2/html5/thumbnails/30.jpg)
Summary
• Problems affecting Residential VoIP and Teleworkers
• VoIP Performance and Quality Challenges• VoIP Performance Measurement and Problem
Diagnosis• Passive Monitoring using Embedded Agents• Active Testing using Downloadable Agents• Looking forward to IPTV