part 7 time-division multiplexing and delta-sigma...

74
Part 7 Time-Division Multiplexing and Delta-Sigma Modulation

Upload: others

Post on 13-Dec-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

Part 7 Time-Division Multiplexing and Delta-Sigma Modulation

Page 2: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-2

Regeneration

o Regenerative repeater for PCM systemn It can completely remove the distortion if the decision

making device makes the right decision (on 1 or 0).

EqualizerDecision-makingdevice

Timingcircuit

AmplifierDegraded

PCM waveRegeneratedPCM wave

Page 3: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-3

Decoding & Filtering

o After regenerating the received pulse at the last stage, the receiver decodes and regenerates the original message signal (with acceptable quantization error).

o Finally, a lowpass reconstruction filter whose cutoff frequency is equal to the message bandwidth W is applied at the end (to remove the unnecessary high-frequency components due to “quantization”).

Page 4: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-4

Impact of Noise in PCM Systems

o Two major noise sources in PCM systemsn (Message-independent) Channel noisen (Message-dependent) Quantization noise

o The quantization noise is often under designer’s control, and can be made negligible by taking adequate number of quantization levels.

Page 5: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-5

o The main effect of channel noise is to introduce bit errors.n Notably, the symbol error rate is quite different from

the bit error rate.n A symbol error may be caused by one-bit error, or two-

bit error, or three-bit error, or …; so, in general, one cannot derive the symbol error rate from the bit error rate (or vice versa) unless some special assumption is made.

n Considering the reconstruction of original analog signal, a bit error in the most significant bit is more harmful than a bit error in the least significant bit.

Impact of Noise in PCM Systems

Page 6: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-6

Error Threshold

o Eb/N0

n Eb: Transmitted signal energy per information bito E.g., information bit is encoded using three-times

repetition code, in which each code bit is transmitted using one symbol with symbol energy Ec.

o Then Eb = 3 Ec.n N0: One-sided noise spectral density

o The bit error rate (BER) is a function of Eb/N0 andtransmission speed (and implicitly bandwidth, etc).

Page 7: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-7

Error Threshold

o Error thresholdn The minimum Eb/N0 to achieve the required BER.

o By knowing the error threshold, one can always add a regenerative repeater when Eb/N0 is about to drop below the threshold; hence, long-distance transmission becomes feasible. n Unlike the analog transmission, of which the distortion

will accumulate for long-distance transmission.

Page 8: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-8

Time-Division Multiplexing System

o An important feature of sampling process is a conservation-of-time.n In principle, the communication link is used only at the

sampling time instances.o Hence, it may be feasible to put other message’s samples

between adjacent samples of this message on a time-shared basis.

o This forms the time-division multiplex (TDM) system.n A joint utilization of a common communication link by

a plurality of independent message sources.

Page 9: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-9

Time-Division Multiplexing System

o The commutator (1) takes a narrow sample of each of the Ninput messages at a rate fs slightly higher than 2W, where Wis the cutoff frequency of the anti-aliasing filter, and (2) interleaves these N samples inside the sampling interval Ts.

LPF

LPF

LPF

LPF

LPF

LPF

LPFChannelPCM PCM

synchronized

commutator commutator

(anti-aliasing) (reconstruction)

1

2

N

1

2

N

Page 10: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-10

Time-Division Multiplexing System

o The price we pay for TDM is that N samples be squeezed in a time slot of duration Ts.

LPF

LPF

LPF

LPF

LPF

LPF

LPFChannelPCM PCM

synchronized

commutator commutator

(anti-aliasing) (reconstruction)

1

2

N

1

2

N

Page 11: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-11

Time-Division Multiplexing System

o Synchronization is essential for a satisfactory operation of the TDM system.n One possible procedure to synchronize the transmitter

clock and the receiver clock is to set aside a code element or pulse at the end of a frame, and to transmit this pulse every other frame only.

Page 12: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-12

T1 System

o T1 systemn Carries 24 64kbps voice channels with regenerative

repeaters spaced at approximately 2-km intervals.n Each voice signal is essentially limited to a band from

300 to 3100 Hz.o Anti-aliasing filter with W = 3.1 KHzo Sampling rate = 8 KHz (> 2W = 6.2 KHz)

n ITU G.711 µ-law is used with µ = 255.n Each frame consists of 24 ´ 8 + 1 = 193 bits, where a

single bit is added at the end of the frame for the purpose of synchronization.

Page 13: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-13

T1 System

n In addition to the 193 bits per frame (i.e., 1.544 Megabits per second), a telephone system must also pass signaling information such as “dial pulses” and “on/off-hook.”o The least significant bit of each voice channel is

deleted in every sixth frame, and a signaling bit is inserted in its place.

193 bit/frame⇥ 11 sample (from each of 24 voice channels)/frame ⇥ 8000 sample/sec = 1.544 Megabits/sec

(DS=Digital Signal)

1 2 3 24F

DS1 Frame (24 DS0)

Framing bit

Page 14: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-14

Digital Multiplexers

o The introduction of digital multiplexer enables us to combine digital signals of various natures, such as computer data, digitized voice signals, digitized facsimile and television signals.

Multiplexer Demultiplexer

1

2

N

1

2

N

High-speedtransmission line

Page 15: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-15

Digital Multiplexers

o The multiplexing of digital signals is accomplished by using a bit-by-bit interleaving procedure with a selector switch that sequentially takes a (or more) bit from each incoming line and then applies it to the high-speed common line.

(3 channels/frame)

PCM

PCM

PCM

TDM4k Hz Analog Voices

64 kbps Digital Voices

1 frame

Page 16: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-16

Digital Multiplexers

o Digital multiplexers are categorized into two major groups.1. 1st Group: Multiplex digital computer data for TDM

transmission over public switched telephone network.n Require the use of modem technology.

2. 2nd Group: Multiplex low-bit-rate digital voice data into high-bit-rate voice stream.n Accommodate in the hierarchy that is varying from

one country to another.n Usually, the hierarchy starts at 64 Kbps, named a

digital signal zero (DS0).

Page 17: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-17

North American Digital TDM Hierarchy

o The first level hierarchyn Combine 24 DS0 to obtain a primary rate DS1 at 1.544

Mb/s (T1 transmission)o The second-level multiplexer

n Combine 4 DS1 to obtain a DS2 with rate 6.312 Mb/so The third-level multiplexer

n Combine 7 DS2 to obtain a DS3 at 44.736 Mb/so The fourth-level multiplexer

n Combine 6 DS3 to obtain a DS4 at 274.176 Mb/so The fifth-level multiplexer

n Combine 2 DS4 to obtain a DS5 at 560.160 Mb/s

Page 18: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

T4=6 DS3(274.176 Mbps)

© Po-Ning [email protected] 7-18

North American Digital TDM Hierarchy

n The combined bit rate is higher than the multiple of the incoming bit rates because of the addition of bit stuffing and control signals.

M01

M12

M23

M34

T1=24 DS0(1.544 Mbps)

T2=4 DS1(6.312 Mbps)

T3=7 DS2(44.736 Mbps)

DS0

DS1DS2

DS3

DS4

Voice(64 kbps)

Page 19: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-19

North American Digital TDM Hierarchy

o Basic problems involved in the design of multiplexing systemn Synchronization should be maintained to properly

recover the interleaved digital signals.n Framing should be designed so that individual can be

identified at the receiver.n Variation in the bit rates of incoming signals should be

considered in the design.o A 0.01% variation in the propagation delay produced

by a 1℉ decrease in temperature will result in 100 fewer pulses in the cable of length 1000-km with each pulse occupying about 1 meter of the cable.

Page 20: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-20

Digital Multiplexers

o Synchronization and rate variation problems are resolved by bit stuffing.

o AT&T M12 (second-level multiplexer)n 24 control bits are stuffed, and separated by sequences

of 48 data bits (12 from each DS1 input).M0

M1

M1

M1

48

48

48

48

CI

CII

CIII

CIV

48

48

48

48

F0

F0

F0

F0

48

48

48

48

CI

CII

CIII

CIV

48

48

48

48

CI

CII

CIII

CIV

48

48

48

48

F1

F1

F1

F1

48

48

48

48

Framemarkers

Framemarkers

Subframemarkers

Stuffingindicators

Stuffingindicators

Stuffingindicators

Page 21: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-21

M 48 C 48 F 48 C 48 C 48 F 48

DS2 M-Subframe: 294 bits (6 blocks)

For each block:

DS1 #1

DS1 #2

DS1 #3

DS1 #4Bit interleave

Page 22: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-22

AT&T M12 Multiplexer

o The control bits are labeled F, M, and C.n Frame markers: In sequence of F0F1F0F1F0F1F0F1, where F0

= 0 and F1 = 1.n Subframe markers: In sequence of M0M1M1M1, where M0 = 0

and M1 = 1.n Stuffing indicators: In sequences of CI CI CI CII CII CII CIII CIII

CIII CIV CIV CIV, where all three bits of Cj equal 1’s indicate that a stuffing bit is added in the position of the first information bit associated with the first DS1 bit stream that follows the F1-control bit in the same subframe, and three 0’s in CjCjCj imply no stuffing.o The receiver should use majority law to check whether a

stuffing bit is added.

Page 23: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-23

AT&T M12 Multiplexer

o These stuffed bits can be used to balance (or maintain) the nominal input bit rates and nominal output bit rates.n S = nominal bit stuffing rate

o The rate at which stuffing bits are inserted when both the input and output bit rates are at their nominal values.

n fin = nominal input bit raten fout = nominal output bit raten M = number of bits in a framen L = number of information bits (input bits) for one input

stream in a frame

Page 24: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-24

AT&T M12 multiplexer

o For M12 framing,

bits 288bits 1176244288

Mbps312.6 Mbps544.1

==+´=

==

LMff

out

in

ininout fL

SfL

SfM )1(1 framea of Duration

bit. stuffeda by replaced isbit One

-+-

==!"#

334601.01176312.6544.1288 =-=-=Þ M

ff

LSout

in

M

fout= S

4(L� 1)

4fin+ (1� S)

4L

4fin

L� 1

fin= 185.88082902 µs M

fout= 186.31178707 µs L

fin= 186.52849741 µs

Page 25: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-25

AT&T M12 Multiplexer

o Allowable tolerances to maintain nominal output bit ratesn A sufficient condition for the existence of S such that

the nominal output bit rate can be matched.

úû

ùêë

é-+

-³³ú

û

ùêë

é-+

-ÎÎ

ininS

outininS f

LS

fL

SfM

fL

SfL

S )1(1

min)1(1

max]1,0[]1,0[

outinoutinoutin

fML

ffML

fL

fM

fL 11 -

³³Û-

³³Û

54043.1312.61176287312.6

11762885458.1 =³³= inf

Page 26: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-26

AT&T M12 Multiplexer

n This results in an allowable tolerance range:

n In terms of ppm (pulse per million pulses),

o This tolerance is already much larger than the expected change in the bit rate of the incoming DS1 bit stream.

kbps 36735.51176/312.654043.15458.1 ==-

18.2312 and 8.11645458.1

10544.1

1054043.1

10 666

==Þ

+==

-

ppmppm

ppmppm

ba

ab

Page 27: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-27

Summary of PCM

o Virtues of PCM systemsn Robustness to channel noise and interferencen Efficient regeneration of coded signal along the transmission pathn Efficient exchange of increased channel bandwidth for improved

signal-to-noise ratio, obeying an exponential law.n Uniform format for different kinds of baseband signal

transmission; hence, facilitate their integration in a common network.

n Message sources are easily dropped or reinserted in a TDM system.

n Secure communication through the use of encryption/decryption.

Page 28: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-28

Summary of PCM

o Two limitations of PCM system (in the past)n Complexityn Bandwidth

o Nowadays, with the advance of VLSI technology, and with the availability of wideband communication channels (such as fiber) and compression technique (to reduce the bandwidth demand), the above two limitations are greatly released.

Page 29: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-29

Delta Modulation

o Delta Modulation (DM)n The message is oversampled (at a rate much higher than

the Nyquist rate) to purposely increase the correlation between adjacent samples.

n Then, the difference between adjacent samples is encoded instead of the sample value itself.

Page 30: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

10

© Po-Ning [email protected] 7-30

Staircaseapproximation

mq(t)m(t)

Ts1

0

11

11

11 01

01

00

0

1

Page 31: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-31

Math Analysis of Delta Modulation

Then

. at time )( of ionapproximat DM thebe ][Let ).(][Let

sq

s

nTtmnmnTmnm =

mq[n]=mq[n−1]+ eq[n]= eq[ j]j=−∞

n

∑ ,

where eq[n]= Δ ⋅sgn(m[n]−mq[n−1]).

.}2/]1)/][[({ is wordcode ed transmittThe ¥-¥=+D nq ne

Page 32: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

7-32

o The principle virtue of delta modulation is its simplicity.n It only requires

the use of comparator, quantizer, and accumulator.

Bandwidth W of m(t)

Delta Modulation]).1[][sgn(][ where

,][][]1[][

--×D=

=+-= å-¥=

nmnmne

nenenmnm

qq

n

jqqqq

Decoderfor DM

z-1

++

Lowpassfilter

1-bitquantizer

Encoderfor DM

z-1

++

+_

Accumulator

Accumulator

(See Slide 7-53)

Page 33: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-33

Delta Modulation

o Distortions due to delta modulationn Slope overload distortionn Granular noise

© Po-Ning [email protected] 7-33

m(t) mq(t)

Slope-overloaddistortion

Granularnoise

Ts

Page 34: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-34

Delta Modulation

o Slope overload distortionn To eliminate the slope overload distortion, it requires

n So, increasing step size D can reduce the slope-overload distortion.

n An alternative solution is to use dynamic D. (Often, a delta modulation with fixed step size is referred to as a linear delta modulator due to its fixed slope, a basic function of linearity.)

condition) overload (slope )(

maxdttdm

Ts³

D

Page 35: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-35

Delta Modulation

o Granular noisen mq[n] will hunt around a relatively flat segment of m(t).n A remedy is to reduce the step size.

o A tradeoff in step size is therefore resulted for slope overload distortion and granular noise.

Page 36: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-36

Delta-Sigma Modulation

o Delta-sigma modulationn In fact, the delta modulation distortion can be reduced

by increasing the correlation between samples.n This can be achieved by integrating the message signal m(t) prior to delta modulation.

n The “integration” process is equivalent to a pre-emphasis of the low-frequency content of the input signal.

Page 37: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-37

Delta-Sigma Modulation

n A side benefit of “integration-before-delta-modulation,” which is named delta-sigma modulation, is that the receiver design is further simplified (at the expense of a more complex transmitter).

Decoderfor DM

z-1

++

Lowpassfilter

1-bitquantizer

Encoderfor DM

z-1

++

+_

Accumulator

Accumulator

Move the accumulatorto the transmitter.

Page 38: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-38

Delta-Sigma Modulation

A straightforward structure

Since integration is a linear operation, the two integrators before comparator can be combined into one after comparator.

1-bitquantizer

Encoderfor DM+_

z-1

++

Accumulator

z-1

+ +

Accumulator

Decoderfor DM

Lowpassfilter

1-bitquantizer

Encoderfor DM+ _

z-1

+ +

Accumulator

z-1

combineinto one

Page 39: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-39

Math Analysis of Delta-Sigma Modulation

.}2/]1)/][[({ is wordcode ed transmittThe ¥-¥=+D nq ns

Since

we only need a lowpass filter to smooth out the received signal at the receiver end. (See the previous slide.)

Let iq[n] be the DM approximation of i[n].

Page 40: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-40

Delta-Sigma Modulation

o Final notesn Delta(-sigma) modulation trades channel bandwidth

(e.g., much higher sampling rate) for reduced system complexity (e.g., the receiver only demands a lowpass filter).

n Can we trade increased system complexity for a reduced channel bandwidth? Yes, by means of prediction technique.

n In Section 3.13, we will introduce the basics of prediction technique. Its application will be addressed in subsequent sections.

Page 41: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-41

Linear Prediction

o Consider a finite-duration impulse response (FIR) discrete-time filter, where p is the prediction order, with linear prediction

å=

-=p

kk knxwnx

1

][][ˆ

z-1 z-1 z-1

w1 w2 wp-1 wp

x[n] x[n-1] x[n-2] x[n-p]x[n-p+1]

prediction

Page 42: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-42

Linear Prediction

o Design objectiven To find the filter coefficient w1, w2, …, wp so as to

minimize index of performance J:

].[ˆ][][ where]],[[ 2 nxnxneneEJ -==

Page 43: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

÷÷ø

öççè

æ+-+-=

--+--=

úúû

ù

êêë

é÷÷ø

öççè

æ--=

åååå

ååå

å

== >=

= ==

=

p

kXk

p

k

p

kjXjk

p

kXkX

p

k

p

jjk

p

kk

p

kk

RwjkRwwkRwR

jnxknxEwwknxnxEwnxE

knxwnxEJ

1

2

11

1 11

2

2

1

]0[][2][2]0[

]][][[]][][[2]][[

][][

0][2][2

]0[2][2][2][2

1

1

11

=-+-=

÷÷ø

öççè

æ+-+-+-=

¶¶

å

åå

=

-

=+=

p

jXjX

Xi

i

kXk

p

ijXjX

i

jiRwiR

RwikRwjiRwiRJw

© Po-Ning [email protected] 7-43

Page 44: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

.1for ][][1

piiRjiRw X

p

jXj ££=-å

=

© Po-Ning [email protected] 7-44

The above optimality equations are called the Wiener-Hopf equations for linear prediction. It can be rewritten in matrix form as:

úúúú

û

ù

êêêê

ë

é

=

úúúú

û

ù

êêêê

ë

é

úúúú

û

ù

êêêê

ë

é

--

--

][

]2[]1[

]0[]2[]1[

]2[]0[]1[]1[]1[]0[

2

1

pR

RR

w

ww

RpRpR

pRRRpRRR

X

X

X

pXXX

XXX

XXX

!!

"!#!!

$$

or RXw = rX ⇒Optimal solution wo =RX−1rX

Page 45: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-45

Toeplitz (Square) Matrix

o Any square matrix of the form

is said to be Toeplitz.o A Toeplitz matrix (such as RX) can be uniquely determined

by p elements, [a0, a1, …, ap-1].

pppp

p

p

aaa

aaaaaa

´--

-

-

úúúú

û

ù

êêêê

ë

é

021

201

110

!"#""

$$

Page 46: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-46

Linear Adaptive Predictor

o The optimal w0 can only be obtained with the knowledge of autocorrelation function.

o Question: What if the autocorrelation function is unknown?o Answer: Use linear adaptive predictor.

Page 47: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

o To minimize J, we should update wi toward the bottom of the J-bowel.

n So, when gi > 0, wi should be decreased.n On the contrary, wi should be increased if gi < 0.n Hence, we may define the update rule as:

where µ is a chosen constant step size, and ½ is included only for convenience of analysis.

© Po-Ning [email protected] 7-47

Idea Behind Linear Adaptive Predictor

ii w

Jg¶¶

º

][21][ˆ]1[ˆ ngnwnw iii ×-=+ µ

Page 48: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

o gi[n] can be approximated by:

© Po-Ning [email protected] 7-48

) wi[n+ 1] = wi[n] + µ · x[n� i]

0

@x[n]�pX

j=1

wj [n]x[n� j]

1

A

= wi[n] + µ · x[n� i]e[n]

Page 49: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-49

Structure of Linear Adaptive Predictor

z-1 Linear predictor

+ _

x[n]

x[n-1]

Errore[n]

Page 50: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-50

Least Mean Square Algorithm

o The pairs in the form of the popular least-mean-square(LMS) algorithm for linear adaptive prediction

8><

>:

wj [n+ 1] = wj [n] + µ · x[n� j]e[n]

e[n] = x[n]�pX

j=1

wj [n]x[n� j]

Page 51: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-51

Differential Pulse-Code Modulation (DPCM)

o Basic idea behind differential pulse-code modulationn Adjacent samples are often found to exhibit a high

degree of correlation.n If we can remove this adjacent redundancy before

encoding, a more efficient coded signal can be resulted.n A way to remove the redundancy is to use linear

prediction.

Page 52: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-52

DPCM

o For DPCM, the quantization error is on e[n], rather on m[n] as for PCM.

o So, the quantization error q[n] is supposed to be smaller.

Bandwidth W of m(t)

Decoderfor DPCM++

Lowpassfilter

Quantizer Encoderfor DPCM

++

+_

Predictionfilter

Predictionfilter

Page 53: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-53

DPCM

o Derive:

][][][ nqneneq +=

][][][][][ˆ

][][ˆ][

nqnmnqnenm

nenmnm qq

+=++=

+=Þ

So, we have the same relation between mq[n] and m[n] (as in Slide 7-32) but with smaller q[n].

Bandwidth W of m(t)

Decoderfor DPCM++

Lowpassfilter

Quantizer Encoderfor DPCM

++

+_

Predictionfilter

Predictionfilter

][ˆ nm

Page 54: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-54

DPCM

o Notesn DM system can be treated as a special case of DPCM.

Prediction filter => single delayQuantizer => single-bit

1-bitquantizer

Encoderfor DM

z-1

++

+_

Accumulator

Page 55: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-55

DPCM

o Distortions due to DPCMn Slope overload distortion

oThe input signal changes too rapidly for the prediction filter to track it.

n Granular noise

Page 56: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-56

Processing Gain

o The DPCM system can be described by:

o So, the output signal-to-noise ratio is:

o We can re-write SNRO as:

][][][ nqnmnmq +=

]][[]][[

2

2

nqEnmESNRO =

QpO SNRGnqEneE

neEnmESNR ×==

]][[]][[

]][[]][[

2

2

2

2

error. prediction theis ][ˆ][][ where nmnmne -=

Page 57: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-57

Processing Gain

o In terminologies,

ïïî

ïïí

ì

=

=

ratio noise onquantizati tosignal ]][[]][[

gain processing ]][[]][[

2

2

2

2

nqEneESNR

neEnmEG

Q

p

Notably, SNRQ can be treated as the SNR for system of eq[n]= e[n]+ q[n].

Page 58: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-58

Processing Gain

o Usually, the contribution of SNRQ to SNRO is fixed.n One additional bit in quantization results in 6 dB

improvement.o Gp is the processing gain due to a nice “prediction.”

n The better the prediction is, the larger Gp is.

Page 59: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-59

DPCM

o Final notes on DPCMn Comparing DPCM with PCM in the case of voice

signals, the improvement is around 4-11 dB, depending on the prediction order.

n The greatest improvement occurs in going from no prediction to first-order prediction, with some additional gain, resulting from increasing the prediction order up to 4 or 5, after which little additional gain is obtained.

n For the same sampling rate (8KHz) and signal quality, DPCM may provide a saving of about 8~16 Kbps compared to standard PCM (64 Kpbs).

Page 60: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected]

Speech Quality(Mean Opinion Scores)

Source: IEEE Communications Magazine, September 1997.

2 4 8 16 32 64Unacceptable

Poor

Fair

Good

Excellent

Bit Rate (kb/s)

FS-1015

MELP 2.4 FS-1016

JDC2G.723.1

GSM/2JDCIS54IS96

GSM

G.723.1 G.729 G.728 G.726 G.711

G.727IS-641

PCMADPCM

DPCM

IS = Interim Standard GSM = Global System for Mobile Communications JDC = Japanese Digital Cellular FS = Federal Standard MELP = Mixed-Excitation Linear Prediction

Page 61: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-61

Adaptive Differential Pulse-Code Modulation

o Adaptive prediction is used in DPCM.o Can we also combine adaptive quantization into DPCM to

yield a comparably voice quality to PCM with 32 Kbps bit rate? The answer is YES from the previous figure.n 32 Kbps: 4 bits for one sample, and 8 KHz sampling

raten 64 Kbps: 8 bits for one sample, and 8 KHz sampling

rateo So, “adaptive” in ADPCM means being responsive to

changing level and spectrum of the input speech signal.

Page 62: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-62

Adaptive Quantization

o Adaptive quantization refers to a quantizer that operates with a time-varying step size D[n].

o D[n] is adjusted according to the power of input sample m[n].n Power = variance, if m[n] is zero-mean.

n In practice, we can only obtain an estimate of E[m2[n]].

]][[][ 2 nmEn ×=D f

Page 63: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-63

Adaptive Quantization

o The estimate of E[m2[n]] can be done in two ways:n Adaptive quantization with forward estimation (AQF)

o Estimate based on unquantized samples of the input signals.

n Adaptive quantization with backward estimation (AQB)o Estimate based on quantized samples of the input

signals.

Page 64: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-64

AQF

o AQF is in principle a more accurate estimator. However, it requiresn an additional buffer to store unquantized samples for the

learning period.n explicit transmission of level information to the receiver

(the receiver, even without noise, only has the quantized samples).

n a processing delay (around 16 ms for speech) due to buffering and other operations for AQF.

o The above requirements can be relaxed by using AQB.

Page 65: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-65

AQB

A possible drawback for a feedback system is its potential unstability.However, stability in this system can be guaranteed if mq[n] is bounded.

Quantizer De-quantizer

Levelestimator

Levelestimator

m[n] mq[n]

Page 66: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-66

APF and APB

o Likewise, the prediction approach used in ADPCM can be classified into:n Adaptive prediction with forward estimation (APF)

o Prediction based on unquantized samples of the input signals.

n Adaptive prediction with backward estimation (APB)o Prediction based on quantized samples of the input

signals.o The pro and con of APF/APB is the same as AQF/AQB.o APB/AQB are a preferred combination in practical

applications.

Page 67: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-67

ADPCM

Adaptive prediction with backward estimation (APB).

Quantizer Encoderfor DPCM

++

+_

Predictionfilter

Estimate

Page 68: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-68

MPEG Audio Coding Standard

o The ADPCM and various voice coding techniques introduced above did not consider the human auditory perception.

o In practice, a consideration on human auditory perception can further improve the system performance (from the human standpoint).

o The MPEG-1 standard is capable of achieving transparent, “perceptually lossless” compression of stereophonic audio signals at high sampling rate.n A human subjective test shows that a 6-to-1

compression ratio are “perceptually indistinguishable” to human.

Page 69: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-69

Characteristics of Human Auditory System

o Psychoacoustic characteristic of human auditory systemn Critical band

o The inner ear will scale the power spectra of incoming signals nonlinearly in the form of limited frequency bands called the critical bands.

o Roughly, the inner ear can be modeled as 25 selective overlapping band-pass filters with bandwidth < 100Hz for the lowest audible frequencies, and up to 5kHz for the highest audible frequencies.

Page 70: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-70

Characteristics of Human Auditory System

n Auditory maskingo When a low-(power-)level signal (i.e., the maskee)

and a high-(power-)level signal (i.e., the masker) occur simultaneously in the same critical band, and are close to each other in frequency, the low-(power-)level signal will be made inaudible (i.e., masked) by the high-(power-)level signal, if the low-(power-)level one lies below a masking threshold.

Page 71: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

o Masking threshold is frequency-dependent.

© Po-Ning [email protected] 7-71

Characteristic of Human Auditory System

Within a critical band, the quantization noise is inaudible as long as the NMR = SMR - SNR for the pertinent quantizer is negative.

Maskingthreshold

Signal level(masker)

Critical band NeighboringCritical band

Neighboringcritical band

Quantizationnoise level

Minimum masking threshold at the critical band

SMR = signal-to-mask ratio

SNR

Page 72: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-72

MPEG Audio Coding Standard

Framepacking

Quantization & coding

Analysisfilter-bank

Psychoacousticmodel

Bit allocation

PCMaudiosignal

Outputbit

stream

Page 73: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-73

MPEG Audio Coding Standard

o Analysis filter-bankn Divide the audio signal into a proper number of subbands, which is

a compromise design for computational efficiency and perceptual performance.

o Psychoacoustic modeln Analyze the spectral content of the input audio signal and thereby

compute the signal-to-mask ratio (SMR).o Quantization & coding

n Decide how to apportion the available number of bits for the quantization of the subband signals.

o Frame packingn Assemble the quantized audio samples into a decodable bit stream.

Page 74: Part 7 Time-Division Multiplexing and Delta-Sigma Modulationshannon.cm.nctu.edu.tw/comtheory/p7-2019.pdf · oThe price we pay for TDM is that Nsamples be squeezed in a time slot of

© Po-Ning [email protected] 7-74

Summary

o TDM (Time-Division Multiplexing)o PCM, DM, DPCM, ADPCMo MPEG audio coding