1 ip cablecom and mediacom 2004 instrumental speech quality measures: market needs and...

16
1 IP Cablecom and MEDIACOM 2004 IP Cablecom and MEDIACOM 2004 Instrumental speech quality Instrumental speech quality measures: market needs and measures: market needs and standardisation within the ITU standardisation within the ITU Harald Klaus – T-Systems Rapporteur of Q9/12 [email protected]

Upload: isaac-neal

Post on 27-Mar-2015

216 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: 1 IP Cablecom and MEDIACOM 2004 Instrumental speech quality measures: market needs and standardisation within the ITU Harald Klaus – T-Systems Rapporteur

1

IP Cablecom and MEDIACOM 2004IP Cablecom and MEDIACOM 2004

Instrumental speech quality Instrumental speech quality measures: market needs and measures: market needs and standardisation within the ITUstandardisation within the ITU

Harald Klaus – T-SystemsRapporteur of Q9/12

[email protected]

Page 2: 1 IP Cablecom and MEDIACOM 2004 Instrumental speech quality measures: market needs and standardisation within the ITU Harald Klaus – T-Systems Rapporteur

IP Cablecom and MEDIACOM 2004IP Cablecom and MEDIACOM 20042

OutlineOutline

IntroductionInstrumental speech quality measures

Classification and basic principles Today’s coverage Market needs

Standardisation within ITU-T Study Group 12 Acitivies within Question 9/12 Activities within other Questions

Conclusions

Page 3: 1 IP Cablecom and MEDIACOM 2004 Instrumental speech quality measures: market needs and standardisation within the ITU Harald Klaus – T-Systems Rapporteur

IP Cablecom and MEDIACOM 2004IP Cablecom and MEDIACOM 20043

IntroductionIntroduction

Harald KlausStudied electrotechnical engineering

at the Technical University of BerlinResearch assistant for speech recognition

applications and speech quality assessmentHead of quality assessment of tele-services

at T-Systems Nova Berkom in BerlinRapporteur in ITU-T Study Group 12 for instrumental

speech quality assessment methodsRapporteur in ETSI Technical Committee STQ

Page 4: 1 IP Cablecom and MEDIACOM 2004 Instrumental speech quality measures: market needs and standardisation within the ITU Harald Klaus – T-Systems Rapporteur

IP Cablecom and MEDIACOM 2004IP Cablecom and MEDIACOM 20044

T-Systems Nova BerkomQuality assessment of Tele-Services ===!"§==Systems=

User-centred Quality Engineering.For successful products.

... is an integrative, customer-anduser-oriented approach to includeaspects of Usability, Acceptability and Quality assessment for development and management of products.

Build

Run

Plan

IntroIntro

Page 5: 1 IP Cablecom and MEDIACOM 2004 Instrumental speech quality measures: market needs and standardisation within the ITU Harald Klaus – T-Systems Rapporteur

IP Cablecom and MEDIACOM 2004IP Cablecom and MEDIACOM 20045

T-Systems Nova BerkomQuality assessment of Tele-Services ===!"§==Systems=

User-centred Quality Engineering.Quality assessmentat T-Systems Nova.Consulting

Test conceptsand test design Quality Monitoringand Reporting Process Optimization

Speech, audioand A/V quality measures According to international

recommendationsandstandards Optimized, efficienttestprocedures Tests withrepresentative user groups Intrusiveand non-intrusive

measurement methods Measurements with Head-and-Torso

simulators (HATS)

Our Labs High quality accordingto ITU

requirements for auditoryand instrumental

quality assessment for recordings usingHATS for speechand audioproduction

IntroIntro

Page 6: 1 IP Cablecom and MEDIACOM 2004 Instrumental speech quality measures: market needs and standardisation within the ITU Harald Klaus – T-Systems Rapporteur

IP Cablecom and MEDIACOM 2004IP Cablecom and MEDIACOM 20046

Instrumental speech quality measuresInstrumental speech quality measures

Classification of models (listening quality)Single-ended models

In-service non-intrusive measurement devices Call clarity index

Models based on signal comparison ITU-T Rec. P.862 TOSQA, PACE, PAMS, PSQM, ...

Speech quality analysis tools

Page 7: 1 IP Cablecom and MEDIACOM 2004 Instrumental speech quality measures: market needs and standardisation within the ITU Harald Klaus – T-Systems Rapporteur

IP Cablecom and MEDIACOM 2004IP Cablecom and MEDIACOM 20047

Instrumental speech quality measures (2)Instrumental speech quality measures (2)

Classification of models (others)Planning tools

E-Model Other planning models

Analysis systems for Quality of service parameters Conversational quality aspects

Page 8: 1 IP Cablecom and MEDIACOM 2004 Instrumental speech quality measures: market needs and standardisation within the ITU Harald Klaus – T-Systems Rapporteur

IP Cablecom and MEDIACOM 2004IP Cablecom and MEDIACOM 20048

Principle of comparison methodsPrinciple of comparison methods

Page 9: 1 IP Cablecom and MEDIACOM 2004 Instrumental speech quality measures: market needs and standardisation within the ITU Harald Klaus – T-Systems Rapporteur

IP Cablecom and MEDIACOM 2004IP Cablecom and MEDIACOM 20049

Today‘s coverage of modelsToday‘s coverage of models

Sufficient (validated!) accuracy forAnalogue and ISDN connections with INMDPerformance of known codecsVoice over IP with small amount of packet loss and

jitter (electrical-electrical network access only!)Background noiseCodec tandemings... (cf. ITU-T Rec. P.862 Table 1)

Page 10: 1 IP Cablecom and MEDIACOM 2004 Instrumental speech quality measures: market needs and standardisation within the ITU Harald Klaus – T-Systems Rapporteur

IP Cablecom and MEDIACOM 2004IP Cablecom and MEDIACOM 200410

Today‘s coverage of models (2)Today‘s coverage of models (2)

Insufficient or unknown accuracy for

End-to-end speech quality including terminals

Electrical-acoustical or acoustical-electrical access

Acoustical-acoustical access

Performance of proprietary codecs

Voice over IP with high percentage of packet loss

... (cf. ITU-T Rec. P.862, Table 2 and 3)

Page 11: 1 IP Cablecom and MEDIACOM 2004 Instrumental speech quality measures: market needs and standardisation within the ITU Harald Klaus – T-Systems Rapporteur

IP Cablecom and MEDIACOM 2004IP Cablecom and MEDIACOM 200411

Market needsMarket needs

Instrumental methods that cover end-to-end speech quality including the terminal

Single-ended speech quality monitoring tools for packet-oriented networks

Robust speech quality measures for speech quality enhancement effects in the network

Instrumental models that consider conversational speech quality aspects

Page 12: 1 IP Cablecom and MEDIACOM 2004 Instrumental speech quality measures: market needs and standardisation within the ITU Harald Klaus – T-Systems Rapporteur

IP Cablecom and MEDIACOM 2004IP Cablecom and MEDIACOM 200412

Market needs (2)Market needs (2)

Scalable measurement solutions (for e.g. different classes / profiles of application, price, accuracy, ...)

Speech quality assessment using knowledge of network parameters and of the psycho-acoustics

Speech quality analysis systems

Page 13: 1 IP Cablecom and MEDIACOM 2004 Instrumental speech quality measures: market needs and standardisation within the ITU Harald Klaus – T-Systems Rapporteur

IP Cablecom and MEDIACOM 2004IP Cablecom and MEDIACOM 200413

Standardisation within ITU-T SG12Standardisation within ITU-T SG12

Activities of Question 9/12 until 2004Development of new Recommendations for

End-to-end speech quality including acoustical interfaces Non-intrusive measurement 7 kHz wideband Talker quality

Rapporteur‘s Meeting in Berlin (March 2002) to define requirements and test plans

Model selection and characterization starting in Summer 2002

Recommendations to be expected in 2003

Page 14: 1 IP Cablecom and MEDIACOM 2004 Instrumental speech quality measures: market needs and standardisation within the ITU Harald Klaus – T-Systems Rapporteur

IP Cablecom and MEDIACOM 2004IP Cablecom and MEDIACOM 200414

Standardisation within ITU-T SG12 (2)Standardisation within ITU-T SG12 (2)

Activities of other Questions of SG12 related to speech quality assessment Q2: Speech Transmission Characteristics and Measurement

methods for Terminals and Gateways interfacing Packet-Switched (IP) Networks

Q6: Analysis methods using complex measurement signals Q7: Methods, tools and test plans for the subjective

assessment of speech and audio quality Q16: In-service non-intrusive assessment of voice

transmission performance on non-linear systems

Page 15: 1 IP Cablecom and MEDIACOM 2004 Instrumental speech quality measures: market needs and standardisation within the ITU Harald Klaus – T-Systems Rapporteur

IP Cablecom and MEDIACOM 2004IP Cablecom and MEDIACOM 200415

ConclusionsConclusionsToday‘s instrumental speech quality measurement

measures cover a rather limited range of application require an expert knowledge to prevent ill-usage Have to be handled with caution for new technologies

There is a strong demand for assessment of a wider range of applications (e.g. end-to-

end transmission including acoustical interfaces, wideband speech, talker quality)

Scalable and flexible solutions for different business models of network providers

a revised develompent procedure to create new ITU-T Recommendations with low budget and time-to-market

Page 16: 1 IP Cablecom and MEDIACOM 2004 Instrumental speech quality measures: market needs and standardisation within the ITU Harald Klaus – T-Systems Rapporteur

IP Cablecom and MEDIACOM 2004IP Cablecom and MEDIACOM 200416

Thank you!Phone: +49 30 3497-2382

[email protected]