qr history dec 17, 2010 j i qr decomposition: history and...

37
QR History Asymptotic result QR iteration EE Home Page Title Page Page 1 of 37 Go Back Full Screen Close Quit Mathematics & Statistics Auburn University, Alabama, USA Dec 17, 2010 QR decomposition: History and its Applications Tin-Yau Tam email: [email protected] Website: www.auburn.edu/tamtiny

Upload: others

Post on 08-Oct-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 1 of 37

Go Back

Full Screen

Close

Quit

Mathematics & StatisticsAuburn University, Alabama, USA

Dec 17, 2010

QR decomposition: History and itsApplications

Tin-Yau TamèèèUUUÎÎÎ

Æâ�w

f��ÆêÆ�ÆÆ�

email: [email protected] Website: www.auburn.edu/∼tamtiny

Page 2: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 2 of 37

Go Back

Full Screen

Close

Quit

1. QR decomposition

Recall the QR decomposition of A ∈ GLn(C):

A = QR

where Q ∈ GLn(C) is unitary and R ∈ GLn(C) is upper ∆ with positive

diagonal entries. Such decomposition is unique. Set

a(A) := diag (r11, . . . , rnn)

where A is written in column form

A = (a1| · · · |an)

Geometric interpretation of a(A):

rii is the distance (w.r.t. 2-norm) between ai and span {a1, . . . , ai−1},

i = 2, . . . , n.

Page 3: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 3 of 37

Go Back

Full Screen

Close

Quit

Example: 12 −51 4

6 167 −68

−4 24 −41

=

6/7 −69/175 −58/175

3/7 158/175 6/175

−2/7 6/35 −33/35

14 21 −14

0 175 −70

0 0 35

.

• QR decomposition is the matrix version of the Gram-Schmidt orthonor-

malization process.

• QR decomposition can be extended to rectangular matrices, i.e., if A ∈Cm×n with m ≥ n (tall matrix) and full rank, then

A = QR

where Q ∈ Cm×n has orthonormal columns and R ∈ Cn×n is upper ∆

with positive “diagonal” entries.

Page 4: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 4 of 37

Go Back

Full Screen

Close

Quit

2. QR history

• When Erhard Schmidt presented the formulae on p. 442 of his

E. Schmidt, Zur Theorie der linearen und nichtlinearen Integralgle-

ichungen. I. Teil: Entwicklung willkulicher Funktionen nach Systemen

vorgeschriebener, Math. Ann., 63 (1907) 433–476.

he said that essentially the same formulae were in

J. P. Gram, Ueber die Entwickelung reeler Funtionen in Reihen mittelst

der Methode der kleinsten Quadrate, Jrnl. fur die reine und angewandte

Math. 94 (1883) 71–73.

•Modern writers, however, distinguish the two procedures, sometimes us-

ing the term “Gram-Schmidt” for the Schmidt form and “modified Gram-

Schmidt” for the Gram version.

Page 5: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 5 of 37

Go Back

Full Screen

Close

Quit

• But Gram-Schmidt orthonormalization appeared earlier in the work of

Laplace and Cauchy.

• In the theory of semisimple Lie grougs, Gram-Schmidt process is

extended to the Iwasawa decomposition G = KAN .

• A JSTOR search: the term “Gram-Schmidt orthogonalization process”

first appears on p.57 of

Y. K. Wong, An Application of Orthogonalization Process to the Theory

of Least Squares,” Annals of Mathematical Statistics, 6 (1935), 53–75.

Page 6: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 6 of 37

Go Back

Full Screen

Close

Quit

• In 1801 Gauss predicted the orbit of the steroid Ceres using the method

of least squares. Since then, the principle of least squares has been the

standard procedure for the analysis of scientific data.

• Least squares problem

Ax ≈ b

i.e., finding x that would yield

minx‖Ax− b‖2.

The solution is characterized by r ⊥ R(A), where r = b − Ax is the

residual vector, or equivalently, given by the normal equation

A∗Ax = A∗b.

• With A = QR and A ∈ Cm×n tall with full rank

R∗Rx = (QR)∗QRx = R∗Q∗b ⇔ Rx = Q∗b.

Page 7: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 7 of 37

Go Back

Full Screen

Close

Quit

There are several methods for computing the QR decomposition:

• GS or modified GS,

• Givens rotations (real A), or

• Householder reflections.

Disadvantage of GS: sensitive to rounding error (orthogonality of the

computed vectors can be lost quickly or may even be completely lost) →modified Gram-Schmidt.

Idea of modified GS: do the projection step with a number of projections

which will be against the errors introduced in computation.

Page 8: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 8 of 37

Go Back

Full Screen

Close

Quit

Example:

A =

1 + ε 1 1

1 1 + ε 1

1 1 1 + ε

with very small ε such that 3+2ε will be computed accurately but 3+2ε+ε2

will be computed as 3 + 2ε. For example, |ε| < 10−10. Then

Q =

1+ε√3+2ε

−1√2

−1√2

1√3+2ε

1√2

01√

3+2ε0 1√

2

and cos θ12 and cos θ13 ≈ π/2 but and cos θ23 ≈ π/3.

See http://www-db.stanford.edu/TR/CS-TR-69-122.html for a heuristic

analysis of why Gram-Schmidt not stable.

Page 9: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 9 of 37

Go Back

Full Screen

Close

Quit

Computing QR by Householder reflectionsA Householder reflection is a reflection about some hyperplane. Consider

Qv = I − 2vv∗, ‖v‖2 = 1.

Qv sends v to −v and fix pointwise the hyperplane ⊥ to v. Householder

reflections are Hermitian and unitary.

Let e1 = (1, 0, ..., 0)T . Recall

A = (a1| · · · |an) ∈ GLn(C)

If ‖a1‖2 = α1, set

u = a1 − α1e1, v =u

‖u‖2, Q1 = I − 2vv∗

so that

Qa1 = (α1, 0, · · · , 0)T = α1e1.

Page 10: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 10 of 37

Go Back

Full Screen

Close

Quit

Then

Q1A =

α1 ∗ . . . ∗0... A1

0

After t iterations of this process, t ≤ n− 1,

R = Qt · · ·Q2Q1A

is upper ∆. So, with

Q = Q1Q2 · · ·Qt

A = QR is the QR decomposition of A.

• This method has greater numerical stability than GS.

• On the other hand, GS produces the qj vector after the jth iteration,

while Householder reflections produces all the vectors only at the end.

Page 11: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 11 of 37

Go Back

Full Screen

Close

Quit

3. An Asymptotic result

Theorem 3.1. (Huang and Tam 2007) Given A ∈ GLn(C). Let A =

Y −1JY be the Jordan decomposition of A, where J is the Jordan form of

A,

diag J = diag (λ1, . . . , λn)

satisfying |λ1| ≥ · · · ≥ |λn|. Then

limm→∞

a(Am)1/m = diag (|λω(1)|, . . . , |λω(n)|),

where the permutation ω is uniquely determined by the Gelfand-Naimark

decomposition of Y = LωU :

rank ω(i|j) = rank (Y )(i|j), 1 ≤ i, j ≤ n.

Here ω(i|j) denotes the submatrix formed by the first i rows and the first

j columns of ω, 1 ≤ i, j ≤ n.

Page 12: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 12 of 37

Go Back

Full Screen

Close

Quit

• Gelfand-Naimark decomposition of Y = LωU is different from the

Guassian decomposition Y = P TLU obtained by Gaussian elimination

with row exchanges.

• None of P , U and L in the Gaussian decomposition is unique.

• But ω and diag U are unique in the Gelfand-Naimark decomposition.

H. Huang and T.Y. Tam, An asymptotic behavior of QR decomposition,

Linear Algebra and Its Applications, 424 (2007) 96-107.

H. Huang and T.Y. Tam, An asymptotic result on the a-component in Iwa-

sawa decomposition, Journal of Lie Theory, 17 (2007) 469-479.

Page 13: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 13 of 37

Go Back

Full Screen

Close

Quit

Numerical experiments:Computing the discrepancy between

[a(Am)]1/m and |λ(A)|

of randomly generated A ∈ GLn(C).

20

200 8060

40

40

60

100

100

80

The graph of

‖[a(Am)]1/m − diag (|λ1|, . . . , |λn|)‖2

versus m (m = 1, . . . , 100)

Page 14: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 14 of 37

Go Back

Full Screen

Close

Quit

If we consider

|a1(Am)1/m − |λ1(A)||

instead of ‖[a(Am)]1/m − diag (|λ1|, . . . , |λn|)‖2 for the above example,

convergence occurs.

200

60

50

40

10

8040

70

30

10060

20

The graph of

|a1(Am)1/m − |λ1(A)||

versus m (m = 1, . . . , 100)

Page 15: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 15 of 37

Go Back

Full Screen

Close

Quit

4. QR iteration

• Because of Abel’s theorem (1824), the roots of a general fifth order

polynomial cannot be solved by radicals. Thus the computation of eigen-

values of A ∈ Cn×n has to be approximative.

• Given A ∈ GLn(C), define a sequence {Ak}k∈N of matrices with

A1 := A = Q1R1

and if Ak = QkRk,, k = 1, 2, . . . then

Ak+1 := RkQk = Q∗kQkRkQk = Q∗

kAkQk

So the eigenvalues are fixed in the process.

• One hopes to have “some sort of convergence” of the sequence {Ak}k∈N

so that the “limit” would provide the eigenvalue approximation of A.

Page 16: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 16 of 37

Go Back

Full Screen

Close

Quit

Theorem 4.1. (Francis (1961/62), Kublanovskaja (1961), Huang and Tam

(2005)) Suppose that the moduli of the eigenvalues λ1, . . . , λn of A ∈GLn(C) are distinct:

|λ1| > |λ2| > · · · > |λn| (> 0).

Let

A = Y −1diag (λ1, . . . , λn)Y.

Assume

Y = LωU,

where ω is a permutation, L is lower ∆ and U is unit upper ∆. Then

1. the strictly lower ∆ part of Ak converge to zero.

2. diag Ak → diag (λω(1), . . . , λω(n)).

H. Huang and T.Y. Tam, On the QR iterations of real matrices, Linear

Algebra and Its Applications, 408 (2005) 161-176.

Page 17: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 17 of 37

Go Back

Full Screen

Close

Quit

• It rates as one of the most important algorithmic developments of the

past century

• Parlett (2000): “The QR algorithm solves the eigenvalue problem in

a very satisfactory way ... What makes experts in matrix computations

happy is that this algorithm is a genuinely new contribution to the field

of numerical analysis and not just a refinement of ideas given by Newton,

Gauss, Hadamard, or Schur.”

• Higham (2003): “The QR algorithm for solving the nonsymmetric

eigenvalue problem is one of the jewels in the crown of matrix compu-

tations.”

Page 18: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 18 of 37

Go Back

Full Screen

Close

Quit

A common misconception• Horn and Johnson’s “Matrix Analysis” (p.114):

Under some circumstances (for example, if all the eigenvalues of A0 has

distinct absolute values), the QR iterates Ak will converge to an upper

triangular matrix as k →∞....

• Quarteroni, Sacco, and Saleri’s “Numerical Mathematics” (p.201-202):

Let A ∈ Rn×n be a matrix with real eigenvalues such that |λ1| > |λ2| >

· · · > |λn|. Then

limk→∞

T (k) =

λ1 t12 . . . t1n

0 λ2 t23 . . .

0 · · · . . .

0 · · · λn

• Wikipedia: Under certain conditions, the matrices Ak converge to a

triangular matrix, the Schur form of A.

Page 19: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 19 of 37

Go Back

Full Screen

Close

Quit

D. Serre’s “Theory of Matrices” (p.176-177):

Let us recall that the sequence Ak is not always convergent. For example,

if A is already triangular, its QR factorization is Q = D, R = D−1A, with

dj = ajj/|ajj|. Hence, A1 = D−1AD is triangular, with the same diagonal

as that of A. By induction, Ak is triangular, with the same diagonal as that

of A so that Ak = D−kADk.... Hence, the part above the diagonal of Ak

does not converge.

Summing up, a convergence theorem may concern only the diagonal of

Ak and what is below it.

Page 20: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 20 of 37

Go Back

Full Screen

Close

Quit

More on QR algorithm

• The QR algorithm is numerically stable because it proceeds by orthog-

onal/unitary similarity transforms.

•A → Hessenberg form → QR algorithm

It would be cost effective if we convert A to an upper Hessenberg form,

with a finite sequence of orthogonal similarities. Then determine the QR

decomposition of an upper Hessenberg matrix costs 6n2+O(n) arithmetic

operations.

•A practical algorithm will use shifts to increase separation and accelerate

convergence.

• The QR iteration is further extended to semisimple Lie groups:

H. Huang. R.R. Holmes and T.Y.Tam, Asymptotic behavior of Iwasawa

and Cholesky iterations, manuscript.

Page 21: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 21 of 37

Go Back

Full Screen

Close

Quit

5. Application in MIMO

In radio, multiple-input and multiple-output, or MIMO, is the use of mul-

tiple antennas at both the transmitter and receiver to improve communica-

tion performance.

Page 22: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 22 of 37

Go Back

Full Screen

Close

Quit

• MIMO is one of several forms of smart antenna technology.

• MIMO offers significant increases in data throughput and link range

without additional bandwidth or transmit power.

• MIMO is an important part of modern wireless communication stan-

dards such as IEEE 802.11n (Wifi) and 4G.

Page 23: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 23 of 37

Go Back

Full Screen

Close

Quit

• In MIMO systems, a transmitter sends multiple streams by multiple

transmit antennas. The transmit streams go through a matrix channel

which consists of all NtNr paths between the Nt transmit antennas at the

transmitter and Nr receive antennas at the receiver.

• Then, the receiver gets the received signal vectors by the multiple re-

ceive antennas and decodes the received signal vectors into the original

information.

Page 24: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 24 of 37

Go Back

Full Screen

Close

Quit

Mathematical descriptionLet x = (x1, . . . , xn)T be a vector to be transmitted over a noisy channel.

Each xi is chosen from a finite-size alphabet X .

A general MIMO system is modeled as

r = Hx + ξ

• H is the m × n full column rank channel (tall, i.e., m ≥ n) matrix

(known to the receiver)

• ξ = (ξ1, . . . , ξm)T is a white Gaussian noise vector where E(ξξ∗) = σ2I

• r = (r1, . . . , rm)T is the observed received vector.

• Our task is to detect/estimate the vector x = (x1, . . . , xn)T ∈ X n given

the noisy observation r.

• QR decomposition of the channel matrix H can be used to form the

back-cancellation detector.

Page 25: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 25 of 37

Go Back

Full Screen

Close

Quit

A. Successive Cancellation Detection Using QR Decomposition(1) QR decomposition

Let H = QR be the QR decomposition of the m × n channel matrix H,

i.e.,

•Q = m× n matrix with orthonormal columns

•R = n× n upper ∆ matrix.

So

r = Hx + ξ ⇒ Q∗r = Rx + Q∗ξ

Set

r := Q∗r, ξ := Q∗ξ

So r1

r2

...

rn

=

r11 r12 · · · r1n

0 r22 · · · r2n

... ... . . . ...

0 0 · · · rnn

x1

x2

...

xn

+

ξ1

ξ2

...

ξn

Page 26: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 26 of 37

Go Back

Full Screen

Close

Quit

(2) Hard decision

Estimate xn by making the hard decision:

xn := Quant [rn

rnn]

where Quant (t) is the element X that is closest w.r.t. 2-norm to t.

(3) Cancellation

Backward substitutions:

xn := Quant [rn

rnn]

xk := Quant [rk −

∑ni=k+1 rkmxi

rkk], k = n− 1, n− 2, . . . , 1

• The algorithm is essentially least squares solution via QR decomposi-

tion.

Page 27: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 27 of 37

Go Back

Full Screen

Close

Quit

B. Optimally Ordered Detection• Golden et al proposed a vertical Bell Laboratories layered space-time

(V-BLAST) system with an optimal ordered detection algorithm that

maximizes the signal-to-noise ratio (SNR).

G.D. Golden, G.J. Foschini, R.A. Valenzuela, and P.W. Wolniansky,

Detection algorithm and initial laboratory results using V-BLAST space-

time communication architecture, Electron. Lett., vol. 35, pp. 14õ15,

Jan. 1999.

• The idea is (equivalently) to find an n × n permutation matrix P such

that if

H′ := HP = QR

then the distance between h′n and the other columns h′1, . . . ,h′n−1 is max-

imal. Then repeat the process by stripping off the column vectors one.

Page 28: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 28 of 37

Go Back

Full Screen

Close

Quit

• Doing so amounts to finding a subchannel whose SNR is the highest

among all n possible subchannels. Geometrically it is to find the column

of H whose distance to the span of the other columns of H is maximum.

Then do it recursively.

• Equivalently

r = H′x′ + ξ

where

H′ := HP, x = Px′

i.e., if we precode a vector with the permutation matrix P, and apply Algo-

rithm A to detect x′, we get the optimally ordered successive-cancellation

detector of Golden et al.

Page 29: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 29 of 37

Go Back

Full Screen

Close

Quit

A recent optimal QR decomposition, called equal-diagonal QR decompo-

sition, or briefly the QRS decomposition in introduced in

J.K. Zhang, A. Kavcic and K. M. Wong, Equal-Diagonal QR Decompo-

sition and its Application to Precoder Design for Successive-Cancellation

Detection, IEEE Transactions on Information Theory, 51 (2005) 154–172.

The QRS decomposition is applied to precode successive-cancellation de-

tection, where we assume that both the transmitter and the receiver have

perfect channel knowledge.

Page 30: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 30 of 37

Go Back

Full Screen

Close

Quit

Theorem 5.1. (Zhang, Kavcic and Wong 2005) For any channel matrix H,

there exists a unitary precoder S, such that the nonzero diagonal entries of

the upper ∆ matrix R are all equal where

HS = QR.

Nice propertiesThe precoder S and the resulting successive-cancellation detector have

many nice properties.

• The minimum Euclidean distance between two signal points at the

channel output is equal to the minimum Euclidean distance between two

constellation points at the precoder input up to a multiplicative factor that

equals the diagonal entry in the R-factor.

Page 31: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 31 of 37

Go Back

Full Screen

Close

Quit

• The superchannel HS naturally exhibits an optimally ordered column

permutation, i.e., the optimal detection order for the vertical Bell Labs

layered spaceõtime (V-BLAST) detector is the natural order.

• The precoder S minimizes the block error probability of the QR succes-

sive cancellation detector.

• A lower and an upper bound for the free distance at the channel output

is expressible in terms of the diagonal entries of the R-factor in the QR

decomposition of a channel matrix.

• The precoder S maximizes the lower bound of the channels free distance

subject to a power constraint.

• For the optimal precoder S, the performance of the QR detector is

asymptotically (at large signal-to-noise ratios (SNRs)) equivalent to that

of the maximum-likelihood detector (MLD) that uses the same precoder.

Page 32: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 32 of 37

Go Back

Full Screen

Close

Quit

• Recall the QRS decomposition HS = QR Let

H = UΣV

be the SVD of H where Σ =

s1

. . .sn

O

. Then set S = V∗S

HS = HV∗S = UΣS = U

(diag (s1, . . . , sn)S

0

)

where the unitary S is to be determined so that R has equal diagonal entries.Clearly the R factors of ΣS and UΣS are the same.WLOG, assume that m = n, i.e., Σ = diag (s1, . . . , sn). The problem is reducedto finding a unitary S such that

ΣS = QR

and R has identical diagonal entries.

Page 33: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 33 of 37

Go Back

Full Screen

Close

Quit

Theorem 5.2. (Kostant 1973) Let Σ =

s1

. . .

sn

∈ Cn×n s1 ≥ · · · ≥

sn > 0. For any unitary S ∈ Cn×n, if ΣS = QR, where Q ∈ Cm×n has

orthonormal columns, R ∈ Cn×n is upper ∆, then

k∏i=1

r′ii ≤k∏

i=1

si, k = 1, . . . , n− 1 (1)

n∏i=1

r′ii =

n∏i=1

si, (2)

where r′11 ≥ · · · ≥ r′nn are the rearrangement of r11, . . . , rnn. Conversely

if (1) and (2) are satisfied, then there is an n × n unitary S such that the

diagonal entries of R in ΣS = QR are those rii, i = 1, . . . , n.

Page 34: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 34 of 37

Go Back

Full Screen

Close

Quit

B. Kostant, On convexity, the Weyl group and Iwasawa decomposition.

Ann. Sci. Ecole Norm. Sup. (4), 6 (1973) 413–460.

• Clearly Kostant (1973) ⇒ Zhang, Kavcic and Wong (2005).

• The proof of Kostant is not constructive. Indeed his result is true for

semisimple Lie groups.

• The construction of the S precoder in [ZKW] is not very cost effective

and involves a number of steps. Determinant is also involved.

Shuangchi He and Tin-Yau Tam, On equal-diagonal QR decomposition,

manuscript.

Page 35: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 35 of 37

Go Back

Full Screen

Close

Quit

Use induction. WLOG assume that m = n.

2× 2 case:

ΣS =

(s1 0

0 s2

)(cos θ − sin θ

sin θ cos θ

)=

(s1 cos θ −s1 sin θ

s2 sin θ s2 cos θ

)Then for any s1 ≥ µ ≥ s2,

‖(s1 cos θ, s2 sin θ)T‖2 = s1 cos2 θ + s2 sin2 θ = µ

for some θ ∈ R. In particular µ =√

s1s2

Suppose that the statement holds true for n− 1.

For r = n > 2, suppose that k is the smallest index such that sk−1 ≥ λ ≥sk, where

λ := (

n∏i=1

si)1/n.

Page 36: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 36 of 37

Go Back

Full Screen

Close

Quit

There is a unitary S1 ∈ C2×2 such that

diag (s1, sk)S1 = A1 :=

(λ ∗0 s1sk

λ

).

Set S2 = S1 ⊕ In−2. Then

A2 := diag (s1, sk, s2, · · · , sk−1, sk+1, · · · , sn)S2

= A1 ⊕ diag (s2, · · · , sk−1, sk+1, · · · , sn) .

Note that

λn−1 =s1sk

λ

n∏i=2,i 6=k

si.

By the inductive hypothesis, there exists a unitary S3 ∈ C(n−1)×(n−1) such

that

A3 = diag(s1sk

λ, s2, · · · , sk−1, sk+1, · · · , sn

)S3

is upper ∆ with equal-diagonal entries λ. Then S4 = 1⊕ S3.

Page 37: QR History Dec 17, 2010 J I QR decomposition: History and ...people.duke.edu/.../References/Tam-QR-history-2010.pdf · • QR decomposition is the matrix version of the Gram-Schmidt

QR

History

Asymptotic result

QR iteration

EE

Home Page

Title Page

JJ II

J I

Page 37 of 37

Go Back

Full Screen

Close

Quit

T HANK YOU FORYOUR AT T ENT ION