1

Platform and terminal aspects

IP-Networking and Mediacom 2004 Workshop

Session MM3/MM4: Convergence / Interactive Broadcast

Simão F. Campos NetoVice-Chair, SG16 (Brazil); Chair WP 3/16 (Media Coding)

Lockheed Martin Global Telecommunications

LMGT LOGO

2

Objective

• Present an overview of ITU-T perspective on provisioning Multimedia Services (MM)

3

MM Applications Development

Factors:•Users needs•Market Trend•System Design•Architecture•Interoperable

Common Multimedia Parts, e.g., Coding (G,H,T-series), Security (X-series), Directory (X-series)

Integration or Assembling of

Multimedia Parts(Terminal Design; J,H-Series)

Users

Media (CS, PS, Cable)Wired/Wireless

(ITU and non-ITU)

Recommendations for Applications &Services (F,T series)Interoperability

Numbering,Charging Specs.(E-series)

4

F.MDS

Se

rvice D

escriptio

nsT

echn

ical D

escrip

tions

T.130

H.263

H.262H.261

H.243

H.231

H.320

H.242

H.230

H.221

Q.931

ISDN

ISDN

F.MCS.1 = F.731

F.MCV.1

F.MRS.1

F.MDS.1

N. A.

H.324

H.245

H.223

Q.23

PSTN

PSTN

F.MCS.3

F.MCV.3

F.MRS.3

F.MDS.3

N. A.

H.324

H.245

H.223

F.MCS.4

F.MCV.4

F.MRS.4

F.MDS.4

Q.---

Mobiles

Mobiles

Terminals or End-points

Multipoint

In-band Signalling

Multiplex

Call Control

B-ISDN

B-ISDN

H.247

H.321

H.310

H.245

H.222.1

H.222.0

Q.2931

F.MCS.2 = F.732

F.MCV.2

F.MRS.2

F.MDS.2

Network Independent Recommendations Network Specific Recommendations

Video CodingAudio CodingProtocols

G.729

G.728

G.723G.722

Communication Capabilities :

F.700Service Description Process

F.MRS

F.MCVS

F.MCS = F.702

Generic Multimedia Services

H.332

H.323

H.245

H.225.0

Packets

Packets

F.MCS.5

F.MCV.5

F.MRS.5

F.MDS.5

G.711

Media Comp.

Comm. Tasks

MSEs

MSEs = middleware service elements

T.120

H.248

MM Element InterdependenceU

ser

pers

pect

ive

Equ

ipm

ent/

prot

ocol

per

spec

tive

5

Services

6

MM Service Descriptions

• Several MM tasks:– Conferencing (multipoint, bi-directional, real-time)

– Conversation (point-to-point, bi-directional, real-time)

– Distribution (point-to-multipoint, unidirectional)

– Sending (point-to-point distribution, Tx controlled, UD; info pushing)

– Receiving (point-to-point distribution, Rx controlled, UD; info retrieval)

– Collecting (multipoint-to-point distrib., UD, Rx controlled; info polling)

• Media components: audio, video, text, graphics, still-pictures, and data

• Quality level for media components: {-1, 0, 1, 2, 3, 4}

Service definition and requirements are available in the F-series. F.700 contains the umbrella definitions:

Integration of media components from the user’s point-of-view

7

MM Service Descriptions (2)

F.70x: network-independent definitions• F.702 (F.MCV)-Multimedia conference services

• F.703 (F.MCS)-MM conversational services

Network-specific definitions• F.731- N-ISDN MM conference services

• F.732- B-ISDN MM conference services

8

Terminals

9

Multimedia terminals

• H.320: Communications over N-ISDN

• H.310: Communications over B-ISDN

• H.323: Communications over packet networks (mainly IP)

• H.324: Communications using circuit-switched services (fixed and mobile, including

3GPP)

• H.246: Terminal Interworking

Integration of media components from the equipment/protocol point-of-view

10

Multimedia terminals (2)

Example: Functional model for H.320 N-ISDN Terminal

NetworkInterface

Video Coding (H.261)

Audio Coding (G.711)

System Control (H.242)

Call Control (Q.931)

MM Mux & Sync

(H.221)

Data Coding (T.120)

UserInterface

11

Multimedia terminals (3)

Example: Functional model for H.323 Terminal

NetworkInterface

Audio Coding (e.g. G.711, G.729)

Video Coding (e.g. H.261, H.263)

User Data Coding (T.120)

System Control (H.245)

Call Control (H.225.0, Q.931)

MM Mux & Sync

(H.225.0)

UserInterface

12

Multimedia terminals (4)

Example: Functional model for H.324 Terminal

NetworkInterface

Audio Coding (e.g. G.723.1)

Video Coding (e.g. H.261, H.263)

Data Coding (T.120; V.14, LAPM)

System Control (H.245,SRP/LAPM)

Call Control (National standards; V.250)

MM Mux & Sync(Fixed network: H.223;

Mobile: H.223 Annexes A-D)User

Interface

13

MM terminals (5): InteroperabilityH.324 H.310

H.320H.323

Audio/Video

User data

User data

User data

User data

Audio/Video

Audio/Video

Audio/Video

Mux

QoS

RTP/Non-QoS

H.223

H.225.0

H.222.0H.222.1

H.221

Call Control (H.245)

Call Control (H.242/H.243)

Call Control (H.245)

Call Control (H.245)

H.223 Anx.A-D

Fixed

Mob

ile

Scope for H.246

14

Media components

15

Data

• T.120-T.140,T.17x provide definitions for data exchange and control in MM conferencing applications. For example:– T.120 defines data protocols for multipoint

multimedia conferencing (Annex C describes a light version of T.120). E.g. White-board applications.

– T.140 adds text conversation (“chat” e.g. for hearing-impaired people)

– T.17x: MHEG for information retrieval

16

Media Coding

Four aspects:

• Audio

• Video

• Still-image

• Other media coding

17

Media Coding: Audio

• Three “classic” quality tiers: audio, wideband speech, and telephony speech.

• ITU-T focus on interactive communications, hence mainly produced wideband and telephony speech compression standards (F.700’s A0 and A1 Quality Levels).

18

Media Coding: A2/A3 Audio

• A2 coding for broadcast applications J.41 (logarithmic PCM compression, 15kHz, 384kb/s) 1988

• A2&A3 Audio coding: ISO MPEG– MPEG2/Audio (e.g. MP3) – MPEG4/Audio

19

Media Coding: A1 Audio

A1: Wideband speech coders (50-7000Hz)• J.42 11-bit logarithmic PCM compression

(192 kbit/s) 1988• G.722 Split-band ADPCM Coding of 7 kHz speech

(64,56&48 kbit/s) 1988• G.722.1 Transform coding (32&24 kbit/s) 1999• G.16kWB Coding of 7 kHz speech at around 16 kbit/s

(planned mid 2001)

20

Media Coding: A0 Audio

A0: Telephony speech coders (300-3400 Hz)• G.711 PCM coding (64 kbit/s) late 60’s• G.726 ADPCM coding (32; 40, 24 & 16 kbit/s) 1988• G.727 Embedded ADPCM coding (40-16 kbit/s) 1990• G.728 LD-CELP coding (16; 40, 11.8 &9.6 kbit/s) 1992• G.723.1 Dual-rate coding (5.3 & 6.3 kbit/s) 1995• G.729 CS-ACELP coding (8; 12.8 & 6.4 kbit/s) 1996-98• G.4kbit/s Coding of speech at 4 kbit/s• G.VBR Variable bitrate speech coding New

Ongoing

21

Media Coding: Video

• ITU standards:– H.261 Video Codec for N-ISDN– H.262 = MPEG2/Video (“Common text”)– H.263 and Annexes IP, wireless, and N-ISDN– H.26L: successor to H.263 Ongoing

22

Media Coding: Still Image

• Still image (B/W & color) is used in facsimile services, in Internet applications, digital photography, etc.

• Standards work performed by a “Collaborative ITU|ISO/IEC Team” working under ISO/IEC SC29 rules and organization

• ITU has “common-text” for JPEG/JBIG (T.80 series); soon-to-be JPEG2000 (T.800 series)

23

Other media coding

Currently not performed in ITU-T:• Character coding (ISO/IEC SC2 activity)• Speech synthesis (text-to-speech)• Speech recognition (new developments)

24

Conclusion

• Service definitions provide the user perspective for MM communication

• Terminals & protocols integrate different media components for specific applications

• Interoperability adaptations are necessary

• Existing terminals are network-specific, however there is a trend towards more flexible specifications.

25

Media Coding Supplemental Slides

26

Telephony-band Speech Coding Families

Channel

Formant

Homomorphic

LPC

MBE

Parametric(Vocoding)

WaveformCoding

PCM

DPCM

ADPCM

DM

ADM

CSVD

HybridCoding

APC

RELP

MPLPC

CELP

SELP

SBC

ATC

Sinusoidal

Harmonic

Phase

27

Telephony-band Speech Coding Families

1 2 4 8 16 32 64

Vocoding

Waveform Coding

Hybrid Coding

LPC10e

MBE

CELP

APC

MPLPC

ATC

RELP

DPCMADPCM

LogPCM

Quality

Bit rate (kbit/s)

28

A2/A3 Non-ITU Standards

• MPEG2/Audio: audio coding > 64 kbit/s (1992)• MPEG4/Audio: audio + speech coding at bit rates

between 64 and 2 kbit/s (1998)

29

A0-A1 Non-ITU Standards

• ETSI/3GPP: – 13 kbit/s RPE-LTP (Full rate GSM, 1988)– 6.5 kbit/s VSELP (Half-rate GSM, 1993)– 12.2 kbit/s EFR (Enhanced full-rate GSM, 1996)– 12.2 - 4.75 kbit/s AMR (Adaptive Multi Rate, 1999)– 6.6 - 23.85 kbit/s AMR-WB (Wideband AMR, 2001)

• ARIB (Japan)– Full-rate PDC (Personal Digital Communication) 6.7 kbit/s VSELP

– Half-rate PDC 3.45 kbit/s Pitch Synchronous Innovation CELP

30

A0-A1 Non-ITU Standards (cont’d)

• US TIA (ANSI)– CDMA

• IS96 8,4,2 kbit/s QCELP (Qualcomm CELP, 1992)• IS127 8.55, 4, 0.8 kbit/s EVRC (Enhanced Var. Rate Codec, 1996)• IS733 13.3, 6.2, 2.7, 1 kbit/s VRC (Variable Rate Codec, 1998)• CDMA2000 9.6,4,2.4,0.8 kbit/s SMV (Selec.Mode Vocoder, ?2002)

– TDMA• IS54 7.95 kbit/s VSELP (Vector-Sum Excitation Lin.Pred., 1990)• IS641 7.4 kbit/s ACELP (Algebraic CELP, 1997)

– PCS1800 (GSM upbanded to 1800 MHz)• IS136-410 12.2 kbit/s US1 (1999)

31

Still Image Coding Summary (1)

• Umbrella: T.80 [1992]

• JPEG: T.81 (Part I), lossy and loss-less [1992]; T.83 (Compliance testing) [1994]; T.85 (Extensions, defs & testing) [1996]; T.85 Corr.1 [1999]; T.86 Registration of JPEG Profiles [1998]; T.87 (Baseline) Lossless and near-lossless compression of continuous-tone still images [1998]

• JBIG: T.82, loss-less [1993]; T.82 Corr.1 [1995]; T.85 JBIG for fax terminals; T.85 Amd.1 [1996], 2 [1997]; T.85 Corr.1 [1997]; T.88 Lossy/lossless coding of bi-level images [2000]; T.89 Application profiles for Recommendation T.88 [2000]

32

Still Image Coding Summary (2)

Planned new common texts: • T.800: Part 1, JPEG 2000 Image Coding System: Core

Coding System• T.801: Part 2, JPEG 2000 Image Coding System:

Extensions• T.802: Part 3, Motion JPEG 2000• T.803: Part 4, Conformance Testing• T.804: Part 5, Reference Software• T.805: Part 6, Compound Image File Format• T.806: Part 7, Technical Report: Guideline of minimum

support function of Part-1

33

ITU-T Video Coding• H.261: Video Codec for A/V services at p x 64 kbit/s

– The first practical video coding standard (1990)– Used today in (ISDN) video conferencing systems– Bit rates commonly 40 kbit/s to 2 Mbit/s

• H.262: Same as MPEG-2/Video (ISO/IEC 13818-2)– Commonly used for entertainment-quality video applications– The first practical standard for interlaced video– Used in digital cable, digital broadcast, satellite, DVD, etc.– Bit rates commonly 4-20 Mbit/s

34

ITU-T Video Coding(continued)

• H.263: Video Coding for Low Bit Rate Communication– Significantly improved video coding compression

performance (especially at very low rates, but also at higher rates as well)

– The first error and packet loss resilient video coding standard– Used in Internet protocol, wireless, and ISDN video

conferencing terminals (H.323, H.324, 3GPP, etc.)– “Baseline” core mode interoperable with MPEG-4/Video– Rich set of features for many applications– Very wide range of bit rates and possible applications

35

Non-ITU-T Video Coding• MPEG-1/Video (ISO/IEC 11172-2)

– The first video coding standard using half-pel motion compensation

– Typical bit rates 1-2 Mbits/s

• MPEG-4/Visual (ISO/IEC 14496-2)– The first video coding standard defining arbitrary object shapes– Many creative features for synthetic and synthetic-natural hybrid

content– Contains essentially all features of all prior standard codec

designs– Interoperable with ITU-T H.263 “baseline”– Very wide range of bit rates and possible applications