etsi€¦ · init app start-up call set-up call session time session success rate call fail rate...

13

Upload: others

Post on 24-Jun-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ETSI€¦ · Init App start-up Call set-up Call Session Time Session Success Rate Call Fail Rate Set-up time Call Drop Rate MOS e L N L 9 9 2 8 1 3 6 9 4 7 7 9 2 3 2 2 4 6 R L N L
Page 2: ETSI€¦ · Init App start-up Call set-up Call Session Time Session Success Rate Call Fail Rate Set-up time Call Drop Rate MOS e L N L 9 9 2 8 1 3 6 9 4 7 7 9 2 3 2 2 4 6 R L N L
Page 3: ETSI€¦ · Init App start-up Call set-up Call Session Time Session Success Rate Call Fail Rate Set-up time Call Drop Rate MOS e L N L 9 9 2 8 1 3 6 9 4 7 7 9 2 3 2 2 4 6 R L N L
Page 4: ETSI€¦ · Init App start-up Call set-up Call Session Time Session Success Rate Call Fail Rate Set-up time Call Drop Rate MOS e L N L 9 9 2 8 1 3 6 9 4 7 7 9 2 3 2 2 4 6 R L N L
Page 5: ETSI€¦ · Init App start-up Call set-up Call Session Time Session Success Rate Call Fail Rate Set-up time Call Drop Rate MOS e L N L 9 9 2 8 1 3 6 9 4 7 7 9 2 3 2 2 4 6 R L N L
Page 6: ETSI€¦ · Init App start-up Call set-up Call Session Time Session Success Rate Call Fail Rate Set-up time Call Drop Rate MOS e L N L 9 9 2 8 1 3 6 9 4 7 7 9 2 3 2 2 4 6 R L N L

(various scenarios) Success Rate and end-to-end session time

(e.g.: News apps) Sucess Rate and time until action was completed

(text messaging/file transfer) End-to-end success rate and roundtrip time

Page 7: ETSI€¦ · Init App start-up Call set-up Call Session Time Session Success Rate Call Fail Rate Set-up time Call Drop Rate MOS e L N L 9 9 2 8 1 3 6 9 4 7 7 9 2 3 2 2 4 6 R L N L

Init Select image from gallery Upload image Validate image

Session Time

Session Success Rate

Upload MDR Download MDR

Page 8: ETSI€¦ · Init App start-up Call set-up Call Session Time Session Success Rate Call Fail Rate Set-up time Call Drop Rate MOS e L N L 9 9 2 8 1 3 6 9 4 7 7 9 2 3 2 2 4 6 R L N L

Init App start-up Call set-up Call

Session Time

Session Success Rate

Call Fail Rate

Set-up time

Call Drop Rate

MOS

Page 9: ETSI€¦ · Init App start-up Call set-up Call Session Time Session Success Rate Call Fail Rate Set-up time Call Drop Rate MOS e L N L 9 9 2 8 1 3 6 9 4 7 7 9 2 3 2 2 4 6 R L N L

Avg. Session Time TM NL KPN VF NL

CHIP App 9,9 10,9 9,2

Facebook 18,8 23,1 18,3

SMS 22,6 24,9 24,4

WhatsApp 11,7 10,7 11,9

Web (Kepler SP) 3,2 3 2,2

Web (Spiegel.de) 13,2 13,4 10,6

Avg. MDR TM NL KPN VF NL

HTTP DL 2040 1680 5570

HTTP UL 1390 280 1120

Note for this example: Measurement done in 2014 using Prepaid SIM. Huge difference in MDR (between TM NL and VF NL) , but only small effect in actual session time. Please contact FI to ask for full study.General picture also consistent with other measurements: App based testing is typically a bit “tougher” than comparable conventional test cases.

Page 10: ETSI€¦ · Init App start-up Call set-up Call Session Time Session Success Rate Call Fail Rate Set-up time Call Drop Rate MOS e L N L 9 9 2 8 1 3 6 9 4 7 7 9 2 3 2 2 4 6 R L N L

XGMA Script

SAM script

SAM script FIMAS Database

CVD File QoS Report

GTM Engine

Page 11: ETSI€¦ · Init App start-up Call set-up Call Session Time Session Success Rate Call Fail Rate Set-up time Call Drop Rate MOS e L N L 9 9 2 8 1 3 6 9 4 7 7 9 2 3 2 2 4 6 R L N L
Page 12: ETSI€¦ · Init App start-up Call set-up Call Session Time Session Success Rate Call Fail Rate Set-up time Call Drop Rate MOS e L N L 9 9 2 8 1 3 6 9 4 7 7 9 2 3 2 2 4 6 R L N L