communications - ib paper 6 handout 4: digital modulation

44
Communications IB Paper 6 Handout 4: Digital Modulation and Bits Through Channels Jossy Sayir Signal Processing and Communications Lab Department of Engineering University of Cambridge [email protected] Lent Term Jossy Sayir (CUED) Communications: Handout 4 Lent Term 1 / 44

Upload: others

Post on 15-Apr-2022

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Communications - IB Paper 6 Handout 4: Digital Modulation

CommunicationsIB Paper 6

Handout 4: Digital Modulation and Bits Through Channels

Jossy Sayir

Signal Processing and Communications LabDepartment of Engineering

University of [email protected]

Lent Term

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 1 / 44

Page 2: Communications - IB Paper 6 Handout 4: Digital Modulation

Outline

1 Digital ModulationAmplitude ModulationPhase ModulationFrequency Modulation

2 Practical ExamplesThe GSM ModulationMulticarrier Modulation

3 Bits Through ChannelsError Probability and RateShannon’s Theorem

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 2 / 44

Page 3: Communications - IB Paper 6 Handout 4: Digital Modulation

Introduction and Motivation

Recap from Handout 3We represent digital signals as a pulse train

x(t) =∑

k

akp(t − kT )

ak is the k -th bit (or more in general, symbol) in the messagesequence, ak = ±A

2

T is the symbol periodp(t) is the pulse such that

p(t) =

{1 t = 00 t = ±T ,±2T , . . .

Spectrum of unmodulated signal |X (f )|2 = 1T |P(f )|2

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 3 / 44

Page 4: Communications - IB Paper 6 Handout 4: Digital Modulation

Digital Modulation

IntroductionWe will use digital modulation techniques when the informationsignal is digitalAgain the information signal modulates the amplitude, phase orfrequency of a carrier wave

s(t) = a cos(2πfc t + φ)

A few interesting differences wrt analog modulationFor example, phase digital modulation widely employedThe BSC (see end of this Handout) summarises digital modulationand demodulation effects through ε, the probability of the channelgiving an output in error

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 4 / 44

Page 5: Communications - IB Paper 6 Handout 4: Digital Modulation

Digital ModulationASK Modulation

Amplitude Shift Keying (ASK)ASK is the digital counterpart of AM. Considering binary ASK only wehave

sASK(t) =

{a cos(2πfc t) for information bit 10 for information bit 0

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 5 / 44

Page 6: Communications - IB Paper 6 Handout 4: Digital Modulation

Digital ModulationASK Modulation

0 1 0 1 1 0

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 6 / 44

Page 7: Communications - IB Paper 6 Handout 4: Digital Modulation

Digital ModulationPSK Modulation

Phase Shift Keying (PSK)PSK is the digital counterpart of PM. Considering binary PSK (BPSK)only we have

sPSK(t) =

{a cos(2πfc t) for information bit 1a cos(2πfc t + π) for information bit 0

Note that a phase shift of π corresponds to a change of sign

sPSK(t) =

{a cos(2πfc t) for information bit 1−a cos(2πfc t) for information bit 0

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 7 / 44

Page 8: Communications - IB Paper 6 Handout 4: Digital Modulation

Digital ModulationPSK Modulation

0 1 0 1 1 0

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 8 / 44

Page 9: Communications - IB Paper 6 Handout 4: Digital Modulation

Digital ModulationPSK Modulation

Spectrum CalculationAs we have just seen, we can write the BPSK signal as

sBPSK(t) =∑

k

akp(t − kT )︸ ︷︷ ︸information signal x(t)

a cos(2πfc t)︸ ︷︷ ︸carrier

From Handout 3, the spectrum of a digital signal is given by

|X (f )|2 =1T|P(f )|2

where P(f ) = F [p(t)] is the Fourier transform of the pulse p(t).

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 9 / 44

Page 10: Communications - IB Paper 6 Handout 4: Digital Modulation

Digital ModulationPSK Modulation

Spectrum CalculationTherefore, the BPSK spectrum is

SBPSK(f ) =12

[X (f − fc) + X (f + fc)]

If p(t) is a rectangular pulse of unit amplitude and duration T , we havethat

P(f ) = Tsinc (πfT ) and |X (f )|2 = T sinc2 (πfT )

Assuming no overlap between X (f − fc) and X (f + fc) we obtain

|SBPSK(f )|2 =14

[|X (f − fc)|2 + |X (f + fc)|2

]

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 10 / 44

Page 11: Communications - IB Paper 6 Handout 4: Digital Modulation

Digital ModulationSpectrum of PSK Modulation

-20 -15 -10 -5 0 5 10 15 20

Frequency (Hz)

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 11 / 44

Page 12: Communications - IB Paper 6 Handout 4: Digital Modulation

Digital ModulationSpectrum of PSK Modulation

-50

-40

-30

-20

-10

0

6 8 10 12 14

Pow

er S

pect

ral D

ensi

ty (

dB)

Frequency (Hz)

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 12 / 44

Page 13: Communications - IB Paper 6 Handout 4: Digital Modulation

Digital ModulationSpectrum of PSK Modulation

PropertiesAs opposed to analogue modulation, strictly speaking, thebandwidth is infinite due to sidelobesUsually bandwidth corresponds to the main lobeCan also define the bandwidth that contains the 99% of the power

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 13 / 44

Page 14: Communications - IB Paper 6 Handout 4: Digital Modulation

Digital ModulationError Probability of BPSK Modulation

+ y(t)x(t)

z(t)

Equivalent Digital ModelAssuming x(t) =

∑k akp(t − kT ) (after de-modulation) and

sampling when the pulse is at its peak (i.e., p(t) = 1) we haveY = X + Z

where X ∈ {±A} and Z is a Gaussian random variable with zeromean and variance σ2, i.e., Z ∼ N(0, σ2).Detection rule

I if Y > 0 decide X̂ = +AI if Y < 0 decide X̂ = −A

We want to calculate the error probability Pe = p(X̂ 6= X )

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 14 / 44

Page 15: Communications - IB Paper 6 Handout 4: Digital Modulation

Digital ModulationError Probability of BPSK Modulation

Error ProbabilityThe error probability can be expressed asPe = p(X̂ 6= X )

= p(X̂ = +A|X = −A)p(X = −A) + p(X̂ = −A|X = +A)p(X = +A)

=12(p(X̂ = +A|X = −A) + p(X̂ = −A|X = +A)

)=

12(p(Y > 0|X = −A) + p(Y < 0|X = +A)

)= p(Y < 0|X = +A)

due to the symmetry of the problem. Conditioned on X = +A, Y is aGaussian random variable, with mean +A and variance σ2, i.e.,Y ∼ N(+A, σ2).

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 15 / 44

Page 16: Communications - IB Paper 6 Handout 4: Digital Modulation

Digital ModulationError Probability of BPSK Modulation

Error Probability

Given that Y ∼ N(+A, σ2), the error probability can be expressed as

Pe = p(Y < 0|X = +A) =

∫ 0

−∞pY (y)dy =

∫ 0

−∞

1√2πσ2

e−1

2σ2 (y−A)2dy

=

∫ − Aσ

−∞

1√2π

e−u22 du = Φ

(−Aσ

)= Q

(Aσ

)= Q

(√A2

σ2

)= Q

(√2SNR

)where Φ(x) is the Gaussian cumulative (see Probability notes, handout3), Q(x)

∆= 1− Φ(x) and SNR ∆

= A2

2σ2 .

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 16 / 44

Page 17: Communications - IB Paper 6 Handout 4: Digital Modulation

Digital ModulationError Probability of BPSK Modulation

0 2 4 6 8 10 1210

−8

10−7

10−6

10−5

10−4

10−3

10−2

10−1

Pe

SNR (dB)

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 17 / 44

Page 18: Communications - IB Paper 6 Handout 4: Digital Modulation

Digital ModulationFSK Modulation

Frequency Shift Keying (FSK)FSK is the digital counterpart of FM. Considering binary FSK only wehave

sFSK(t) =

{a cos(2πf 1

c t) for information bit 1a cos(2πf 0

c t) for information bit 0

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 18 / 44

Page 19: Communications - IB Paper 6 Handout 4: Digital Modulation

Digital ModulationFSK Modulation

0 1 0 1 1 0

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 19 / 44

Page 20: Communications - IB Paper 6 Handout 4: Digital Modulation

The GSM Modulation

Remember FM modulation?An FM modulated signal is given by

sFM(t) = a0 cos(

2πfc t + 2πkf

∫ t

0x(τ)dτ

)where x(t) is the information signal.

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 20 / 44

Page 21: Communications - IB Paper 6 Handout 4: Digital Modulation

The GSM Modulation

GMSK ModulationThe GSM system uses Gaussian Minimum Shift Keying (GMSK)modulation, which is a digital version of FM

sGMSK(t) = a0 cos(

2πfc t + 2πkf

∫ t

0x(τ)dτ

)x(t) =

∑k akp(t − kT ) is the digital information signal

p(t) = ce−πc2t2is the Gaussian pulse

GMSK controls bandwidth expansion and has a compactspectrum

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 21 / 44

Page 22: Communications - IB Paper 6 Handout 4: Digital Modulation

Multicarrier ModulationFrequency Selective Fading Channels

Remember when B ' Bc , the wireless channel introduces severedistortion to the transmitted signal. More formally, the channel is saidto be frequency selective.

Broadband signal

f

B

f

|X(f)|

B

|H(f)|

Multipath

Channel

We need to equalise the channel, since different frequencies sufferdifferent attenuations. We will now study what WiFi does...

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 22 / 44

Page 23: Communications - IB Paper 6 Handout 4: Digital Modulation

Multicarrier Modulation

The Key Idea...... is to modulate the signal with multiple carriers, so that the signalmodulated onto each carrier looks narrowband and experiences a flatfading coefficient.

|H(f)X(f)|

f

|X(f)|

B

Multipath

Channel

f

B

Broadband multicarrier signal

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 23 / 44

Page 24: Communications - IB Paper 6 Handout 4: Digital Modulation

Multicarrier Modulation

How do we implement it?Consider that we have Nc subcarriers whose frequencies are f1, . . . , fNc

and that we divide our bits in Nc classes a1, . . . ,aNc to modulate eachcarrier. We can write the n-th modulated signal as

sn(t) = an cos 2πfnt 0 ≤ t ≤ T

and the multicarrier signal is

sMC(t) =Nc∑

n=1

sn(t) =Nc∑

n=1

an cos 2πfnt 0 ≤ t ≤ T

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 24 / 44

Page 25: Communications - IB Paper 6 Handout 4: Digital Modulation

Multicarrier Modulation

sMC(t)

..

.

a1 s1(t)

cos(2πf1t)

aNc sNc(t)

cos(2πfNct)

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 25 / 44

Page 26: Communications - IB Paper 6 Handout 4: Digital Modulation

Multicarrier Modulation

The choice of the sub-carriersWe choose the sub-carrier frequencies to be orthogonal, i.e.,∫ T

0cos(2πfnt) cos(2πfmt) = 0 ∀m 6= n

this can be achieved by choosing fn = nfc and fm = mfcWe can recover the data streams a1, . . . ,aNc if the sub-carriersare orthogonalWe can have a much more compact spectrum than if we hadnon-orthogonal carriersOrthogonal Frequency Division Multiplexing (OFDM), used inADSL, WiFi, and many future wireless systems

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 26 / 44

Page 27: Communications - IB Paper 6 Handout 4: Digital Modulation

Basic Block Diagramfrom Handout 1

Source

Destination

Channel

received

signal

transmitted

signal

Channel

Encoder

Source

Channel

Encoder

Decoder

Source

Decoder

Transmitter

Receiver

message

received

message

Modulator

Demodulator

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 27 / 44

Page 28: Communications - IB Paper 6 Handout 4: Digital Modulation

Communications Channels

DefinitionThe medium used to transmit the signal from transmitter to receiver.

and...introduces attenuation and noise so that the received signal is a fadedand noisy version of what the transmitter sent.

which implies that...noise and attenuation introduce errors.

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 28 / 44

Page 29: Communications - IB Paper 6 Handout 4: Digital Modulation

Communications Channels

Error ProbabilityWe define the bit error probability Pe (also bit error rate (BER)) as theprobability that one bit is detected in error at the receiver.

Fundamental measure of the reliability of transmissionTells us what the percentage of errors isPe depends on the amount of noise in the channelAlso measures the quality of service (QoS) requirements(acceptable quality) of a given system

I Pe ≈ 10−3 for voice (GSM)I Pe ≈ 10−15 magnetic recording

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 29 / 44

Page 30: Communications - IB Paper 6 Handout 4: Digital Modulation

An Illustrative ExampleThe Binary Symmetric Channel

1− ǫ

0

1

0

1

x[n] y[n]

1− ǫ

ǫ

ǫ

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 30 / 44

Page 31: Communications - IB Paper 6 Handout 4: Digital Modulation

An Illustrative ExampleThe Binary Symmetric Channel

or equivalently...

z[n] = ...1000010000...

x[n] = ...0101000110... y[n] = ...1101010110...

x [n], y [n] transmitted and received binary sequencesz[n] additive binary noise sequence with Pr(z = 1) = ε, namely,with probability ε the channel introduces an error

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 31 / 44

Page 32: Communications - IB Paper 6 Handout 4: Digital Modulation

An Illustrative ExampleThe Binary Symmetric Channel

1− ǫ

0

1

0

1

x[n] y[n]

1− ǫ

ǫ

ǫ

Error ProbabilityThe bit error probability is

Pe = Pr(y = 1|x = 0) Pr(x = 0) + Pr(y = 0|x = 1) Pr(x = 1)

= ε12

+ ε12

= ε

Can we improve it? How? Let’s repeat the bits and see...

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 32 / 44

Page 33: Communications - IB Paper 6 Handout 4: Digital Modulation

An Illustrative ExampleThe Binary Symmetric Channel

Repeat 3 TimesIntroducing redundancy: channel codingWe transmit 1 information bit every 3 transmissionsWe need at least 2 out of 3 bits in error to declare an informationbit error

Pe = p(3 errors) + p(2 errors) = ε3 + 3ε2(1− ε)

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 33 / 44

Page 34: Communications - IB Paper 6 Handout 4: Digital Modulation

An Illustrative ExampleThe Binary Symmetric Channel

10-10

10-9

10-8

10-7

10-6

10-5

10-4

10-3

10-2

10-1

10-4 10-3 10-2 10-1

ε

Pe

No Repetition

Repetition 3

Repetition 5

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 34 / 44

Page 35: Communications - IB Paper 6 Handout 4: Digital Modulation

An Illustrative ExampleThe Binary Symmetric Channel

Repetition CodesAs we increase the repetition factor, we can achieve reliablecommunication, i.e., Pe → 0.Unfortunately R → 0 as well!!It was widely thought that in order to achieve Pe → 0 we had tohave R → 0.Until 1948

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 35 / 44

Page 36: Communications - IB Paper 6 Handout 4: Digital Modulation

Shannon’s Theorem

Theorem(Shannon 1948) For any communications channel, there exist codes(with the corresponding encoders and decoders) of rate R < C thathave Pe → 0, where C is the channel capacity. Conversely, if R > C,Pe cannot approach 0, and reliable transmission is not possible.

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 36 / 44

Page 37: Communications - IB Paper 6 Handout 4: Digital Modulation

Shannon’s TheoremThe Binary Symmetric Channel

Capacity of the BSCIn the case of the binary symmetric channel

c = 1− h(ε) bits/channel use,where

h(ε)∆= ε log2

+ (1− ε) log21

1− εis the binary entropy function.

For ε = 0 (noiseless channel) we can transmit up to c = 1 bitsevery time we use the channelFor ε = 1

2 , the channel generates a random output, so we guess,and c = 0 bits per transmissionIf every use of the channel corresponds to T seconds, then wedefine C = c

T bit/second

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 37 / 44

Page 38: Communications - IB Paper 6 Handout 4: Digital Modulation

Shannon’s TheoremThe Binary Symmetric Channel

0 0.1 0.2 0.3 0.4 0.50

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

p

C

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 38 / 44

Page 39: Communications - IB Paper 6 Handout 4: Digital Modulation

An Illustrative ExampleThe Binary Symmetric Channel

10-8

10-7

10-6

10-5

10-4

10-3

10-2

10-1

10-4 10-3 10-2 10-1

No Repetition (uncoded)

εε?

Pe

Repetition 3 Shannon

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 39 / 44

Page 40: Communications - IB Paper 6 Handout 4: Digital Modulation

An Illustrative ExampleThe Binary Symmetric Channel

10-8

10-7

10-6

10-5

10-4

10-3

10-2

10-1

10-4 10-3 10-2 10-1

No Repetition (uncoded)

εε?

Pe

Repetition 3 Shannon

ε? = c−1“

R = 13

”−→

= h−1 (1− R)

= 1.74 10−1 ≈ 17%

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 40 / 44

Page 41: Communications - IB Paper 6 Handout 4: Digital Modulation

The Additive Gaussian Noise Channel

CapacityThe capacity (in bits/second) of the additive white Gaussian channelwith bandwidth B is given by (Shannon 1948)

C = B log2

(1 +

PN0B

)= B log2 (1 + SNR)

where SNR = PN = P

N0B . This formula is in the data book.Optimally relates our precious resources: P,B and RThe spectral efficiency c = C

B = log2(1 + SNR) is the normalized(wrt B) capacity in bits per second per HertzA linear increase in power (or SNR) implies logarithmic increase inrate.

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 41 / 44

Page 42: Communications - IB Paper 6 Handout 4: Digital Modulation

The Additive Gaussian Noise Channel

Recap...With sufficiently involved coding techniques, we can transmit binarydigits at a rate

R < B log2 (1 + SNR)

bits per second, with arbitrarily small probability of decoding in error,namely Pe → 0. Conversely, if R > C reliable communication is notpossible since Pe cannot vanish.

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 42 / 44

Page 43: Communications - IB Paper 6 Handout 4: Digital Modulation

The Additive Gaussian Noise Channel

0

1

2

3

4

5

6

7

8

9

10

-15 -10 -5 0 5 10 15 20 25 30

c=C/

B (b

it/s/

Hz)

SNR (dB)

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 43 / 44

Page 44: Communications - IB Paper 6 Handout 4: Digital Modulation

The Additive Gaussian Noise Channel

−15 −10 −5 0 5 1010

−8

10−7

10−6

10−5

10−4

10−3

10−2

10−1

SNR (dB)

Pe

uncoded BPSK

GSM codeLDPCShannon

SNR? = c−1 (R = 12

)= 2R − 1 = 0.41←→ N? = 2.41P?

Jossy Sayir (CUED) Communications: Handout 4 Lent Term 44 / 44