solving the controller design problem - stanford universityboyd/lcdbook/out8.pdfsolving the...

66
Chapter 15 Solving the Controller Design Problem 351

Upload: others

Post on 15-Sep-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

Chapter 15

Solving the Controller DesignProblem

In this chapter we describe methods for forming and solving �nite�dimensionalapproximations to the controller design problem� A method based on theparametrization described in chapter � yields an inner approximation of the re�gion of achievable speci�cations in performance space� For some problems� anouter approximation of this region can be found by considering a dual problem�By forming both approximations� the controller design problem can be solved toan arbitrary� and guaranteed� accuracy�

In chapter � we argued that many approaches to controller design could be describedin terms of a family of design speci�cations that is parametrized by a performance

vector a � RL�

H satis�es Dhard� ���H� � a�� � � � � �L�H� � aL� ������

Some of these speci�cations are unachievable� the designer must choose amongthe speci�cations that are achievable� In terms of the performance vectors� thedesigner must choose an a � A� where A denotes the set of performance vectors thatcorrespond to achievable speci�cations of the form ������� We noted in chapter �that the actual controller design problem can take several speci�c forms� e�g�� aconstrained optimization problem with weightedsum or weightedmax objective�or a simple feasibility problem�

In chapters ��� we found that in many controller design problems� the hardconstraint Dhard is convex �or even a�ne� and the functionals ��� � � � � �L are convex�we refer to these as convex controller design problems� We refer to a controllerdesign problem in which one or more of the functionals is quasiconvex but notconvex as a quasiconvex controller design problem� These controller design problemscan be considered convex �or quasiconvex� optimization problems over H� since H

351

Page 2: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

352 CHAPTER 15 SOLVING THE CONTROLLER DESIGN PROBLEM

has in�nite dimension� the algorithms described in the previous chapter cannot bedirectly applied�

15.1 Ritz Approximations

The Ritz method for solving in�nitedimensional optimization problems consists ofsolving the problem over larger and larger �nitedimensional subsets� For the controller design problem� the Ritz approximation method is determined by a sequenceof nz � nw transfer matrices

R�� R�� R�� � � � � H� ���� �

We let

HN��

���R� �

X��i�N

xiRi

������ xi � R� � � i � N

���

denote the �nitedimensional a�ne subset of H that is determined by R� and thenext N transfer matrices in the sequence� The Nth Ritz approximation to thefamily of design speci�cations ������ is then

H satis�es Dhard� ���H� � a�� � � � � �L�H� � aL� H � HN � ������

The Ritz approximation yields a convex �or quasiconvex� controller design problem�if the original controller problem is convex �or quasiconvex�� since it is the originalproblem with the a�ne speci�cation H � HN adjoined�

The Nth Ritz approximation to the controller design problem can be considereda �nitedimensional optimization problem� so the algorithms described in chapter ��can be applied� With each x � RN we associate the transfer matrix

HN �x��� R� �

X��i�N

xiRi� ������

with each functional �i we associate the function ��N�i � RN � R given by

��N�i �x�

�� �i�HN �x��� ������

and we de�ne

D�N� �� fx j HN �x� satis�es Dhardg � ������

Since the mapping from x � RN into H given by ������ is a�ne� the functions

��N�i given by ������ are convex �or quasiconvex� if the functionals �i are� similarly

the subsets D�N� � RN are convex �or a�ne� if the hard constraint Dhard is� In

Page 3: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

15.1 RITZ APPROXIMATIONS 353

section ���� we showed how to compute subgradients of the functions ��N�i � given

subgradients of the functionals �i�

Let AN denote the set of performance vectors that correspond to achievablespeci�cations for the Nth Ritz approximation ������� Then we have

A� � � � � � AN � � � � � A�

i�e�� the Ritz approximations yield inner or conservative approximations of theregion of achievable speci�cations in performance space�

If the sequence ���� � is chosen well� and the family of speci�cations ������ iswell behaved� then the approximations AN should in some sense converge to A asN � �� There are many conditions known that guarantee this convergence� seethe Notes and References at the end of this chapter�

We note that the speci�cation Hslice of chapter �� corresponds to the N � Ritz approximation�

R� � H�c�� R� � H�a� �H�c�� R� � H�b� �H�c��

15.1.1 A Specific Ritz Approximation Method

A speci�c method for forming Ritz approximations is based on the parametrization of closedloop transfer matrices achievable by stabilizing controllers �see section � ����

Hstable � fT� � T�QT� j Q stableg � �����

We choose a sequence of stable nu � ny transfer matrices Q�� Q�� � � � and form

R� � T�� Rk � T�QkT�� k � �� � � � � ������

as our Ritz sequence� Then we have HN � Hstable� i�e�� we have automaticallytaken care of the speci�cation Hstable�

To each x � RN there corresponds the controllerKN �x� that achieves the closedloop transfer matrix HN �x� � HN � in the Nth Ritz approximation� we search overa set of controllers that is parametrized by x � RN � in the same way that the familyof PID controllers is parametrized by the vector of gains� which is in R�� But theparametrization KN �x� has a very special property� it preserves the geometry of the

underlying controller design problem� If a design speci�cation or functional is closedloop convex or a�ne� so is the resulting constraint on or function of x � RN � Thisis not true of more general parametrizations of controllers� e�g�� the PID controllers�The controller architecture that corresponds to the parametrizationKN �x� is shownin �gure �����

Page 4: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

354 CHAPTER 15 SOLVING THE CONTROLLER DESIGN PROBLEM

Knom

Q

KN �x�

u y

v e

Q�

QN

x�

xN

r

r

r

��

��

q

q

q

Figure ���� The Ritz approximation ��������� corresponds to aparametrized controller KN �x that consists of two parts� a nominal con�troller Knom� and a stable transfer matrix Q that is a linear combination ofthe �xed transfer matrices Q�� � � � � QN � See also section ��� and �gure ����

15.2 An Example with an Analytic Solution

In this section we demonstrate the Ritz method on a problem that has an analyticsolution� This allows us to see how closely the solutions of the approximations agreewith the exact� known solution�

15.2.1 The Problem and Solution

The example we will study is the standard plant from section ��� We consider theRMS actuator e�ort and RMS regulation functionals described in sections ��� ��and ����� �

RMS�yp��� �rms yp�H� �

�kH��Wsensork

�� � kH��Wprock

��

����RMS�u�

�� �rms u�H� �

�kH��Wsensork

�� � kH��Wprock

��

�����

Page 5: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

15.3 AN EXAMPLE WITH NO ANALYTIC SOLUTION 355

We consider the speci�c problem�

min�rms yp�H� � ���

�rms u�H�� ������

The solution� ��rms u � ������ can be found by solving an LQG problem withweights determined by the algorithm given in section �����

15.2.2 Four Ritz Approximations

We will demonstrate four di�erent Ritz approximations� by considering two di�erentparametrizations �i�e�� T�� T�� and T� in ������ and two di�erent sequences of stableQ�s�

The parametrizations are given by the formulas in section �� using the twoestimatedstatefeedback controllers K�a� and K�d� from section �� �see the Notesand References for more details�� The sequences of stable transfer matrices weconsider are

Qi �

s� �

i

� �Qi �

s� �

i

� i � �� � � � �������

We will denote the four resulting Ritz approximations as

�K�a�� Q�� �K�a�� �Q�� �K�d�� Q�� �K�d�� �Q�� �������

The resulting �nitedimensional Ritz approximations of the problem ������ turnout to have a simple form� both the objective and the constraint function are convex quadratic �with linear and constant terms� in x� These problems were solvedexactly using a special algorithm for such problems� see the Notes and Referencesat the end of this chapter� The performance of these four approximations is plotted in �gure ��� along with a dotted line that shows the exact optimum� ������Figure ���� shows the same data on a more detailed scale�

15.3 An Example with no Analytic Solution

We now consider a simple modi�cation to the problem ������ considered in theprevious section� we add a constraint on the overshoot of the step response fromthe reference input r to the plant output yp� i�e��

min�rms yp�H� � ����os�H��� � ���

�rms u�H�� ����� �

Unlike ������� no analytic solution to ����� � is known� For comparison� the optimaldesign for the problem ������ has a step response overshoot of �����

Page 6: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

356 CHAPTER 15 SOLVING THE CONTROLLER DESIGN PROBLEM

RMS�u�

N

����K�a�� Q

����

�K�a�� Q

���

�K�d�� Q���

�K�d�� Q

��Iexact

� � � � � �� �� �� �� �� ���

����

����

����

����

���

����

����

����

����

���

Figure ���� The optimum value of the �nite�dimensional inner approxi�mation of the optimization problem ����� versus the number of terms Nfor the four di�erent Ritz approximations ������� The dotted line showsthe exact solution� RMS�u � �������

RMS�u�

N

����K�a�� Q

��I �K�a�� Q��I �K�d�� Q

����

�K�d�� Q

��Iexact

� � � � � �� �� �� �� �� �������

����

�����

�����

�����

�����

�����

Figure ���� Figure ���� is re�plotted to show the convergence of the �nite�dimensional inner approximations to the exact solution� RMS�u � �������

Page 7: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

15.3 AN EXAMPLE WITH NO ANALYTIC SOLUTION 357

The same four Ritz approximations ������� were formed for the problem ����� ��and the ellipsoid algorithm was used to solve them� The performance of the approximations is plotted in �gure ����� which the reader should compare to �gure ��� �The minimum objective values for the Ritz approximations appear to be convergingto ������ whereas without the step response overshoot speci�cation� the minimumobjective is ������ We can interpret the di�erence between these two numbers asthe cost of reducing the step response overshoot from ���� to ����

RMS�u�

N

����K�a�� Q

����K�a�� Q

����K�d�� Q

����K�d�� Q

��Iwithout step spec�

� � � � � �� �� �� �� �� ���

����

����

����

����

���

����

����

����

����

���

Figure ���� The optimum value of the �nite�dimensional inner approxi�mation of the optimization problem ������ versus the number of terms Nfor the four di�erent Ritz approximations ������� No analytic solution tothis problem is known� The dotted line shows the optimum value of RMS�uwithout the step response overshoot speci�cation�

15.3.1 Ellipsoid Algorithm Performance

The �nitedimensional optimization problems produced by the Ritz approximationsof ����� � are much more substantial than any of the numerical example problemswe encountered in chapter ��� which were limited to two variables �so we could plotthe progress of the algorithms�� It is therefore worthwhile to brie�y describe howthe ellipsoid algorithms performed on the N � � �K�a�� Q� Ritz approximation� asan example of a demanding numerical optimization problem�

The basic ellipsoid algorithm was initialized with A� � ����I� so the initialellipsoid was a sphere with radius ��� All iterates were well inside this initialellipsoid� Moreover� increasing the radius had no e�ect on the �nal solution �and�indeed� only a small e�ect on the total computation time��

Page 8: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

358 CHAPTER 15 SOLVING THE CONTROLLER DESIGN PROBLEM

The algorithm took �� iterations to �nd a feasible point� and � �� iterations forthe maximum relative error to fall below ����� The maximum and actual relativeerrors versus iteration number are shown in �gure ����� The relative constraintviolation and the normalized objective function value versus iteration number areshown in �gure ����� From these �gures it can be seen that the ellipsoid algorithm produces designs that are within a few percent of optimal within about ����iterations�

�error

k

���

maximumrelative error

���actual

relative error

� ���� ���� ���� ���� �������

��

���

Figure ���� The ellipsoid algorithm maximum and actual relative errorsversus iteration number� k� for the solution of the N � �� �K�a�� Q Ritzapproximation of ������� After �� iterations a feasible point has been found�and after ���� iterations the objective has been computed to a maximumrelative error of ����� Note the similarity to �gure ������ which shows asimilar plot for a much simpler� two variable� problem�

For comparison� we solved the same problem using the ellipsoid algorithm withdeepcuts for both objective and constraint cuts� with the same initial ellipsoid�A few more iterations were required to �nd a feasible point ����� and somewhatfewer iterations were required to �nd the optimum to within ���� � � ��� Itsperformance is shown in �gure ���� The objective and constraint function valuesversus iteration number for the deepcut ellipsoid algorithm were similar to the basicellipsoid algorithm�

The number of iterations required to �nd the optimum to within a guaranteedmaximum relative error of ���� for each N �for the �K�a�� Q� Ritz approximation�is shown in �gure ���� for both the regular and deepcut ellipsoid algorithms� �ForN � � the step response overshoot constraint was infeasible in the �K�a�� Q� Ritzapproximation��

Page 9: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

15.3 AN EXAMPLE WITH NO ANALYTIC SOLUTION 359

�violation

k

�����rms u � ��rms u���

rms u

�����rms yp � ������������os � �������

� ���� ���� ���� ���� ����

��

��

��

��

Figure ���� The ellipsoid algorithm constraint and objective functionalsversus iteration number� k� for the solution of the N � �� �K�a�� Q Ritzapproximation of ������� For the constraints� the percentage violation isplotted� For the objective� �rms u� the percentage di�erence between thecurrent and �nal objective value� ��rms u� is plotted� It is hard to distinguishthe plots for the constraints� but the important point here is the �steady�stochastic� nature of the convergence� Note that within ���� iterations�designs were obtained with objective values and contraints within a fewpercent of optimal and feasible� repsectively�

Page 10: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

360 CHAPTER 15 SOLVING THE CONTROLLER DESIGN PROBLEM

�error

k

���

maximumrelative error

���actual

relative error

� ��� ���� ���� ���� ���� �������

��

���

Figure ���� The deep�cut ellipsoid algorithm maximum and actual rel�ative errors versus iteration number� k� for the solution of the N � ���K�a�� Q Ritz approximation of ������� After �� iterations a feasible pointhas been found� and after ���� iterations the objective has been computedto a maximum relative error of ����� Note the similarity to �gure �����

Page 11: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

15.3 AN EXAMPLE WITH NO ANALYTIC SOLUTION 361

iterations

N

��Rregular ellipsoid

��Ideep�cut ellipsoid

� � � � � �� �� �� �� �� ���

���

����

����

����

����

����

����

����

����

����

Figure ���� The number of ellipsoid iterations required to compute upperbounds of RMS�u to within ����� versus the number of terms N � is shown

for the Ritz approximation �K�a�� Q� The upper curve shows the iterationsfor the regular ellipsoid algorithm� The lower curve shows the iterationsfor the deep�cut ellipsoid algorithm� using deep�cuts for both objective andconstraint cuts�

Page 12: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

362 CHAPTER 15 SOLVING THE CONTROLLER DESIGN PROBLEM

15.4 An Outer Approximation via Duality

Figure ���� suggests that the minimum value of the problem ����� � is close to������ since several di�erent Ritz approximations appear to be converging to thisvalue� at least over the small range of N plotted� The value ����� could reasonablybe accepted on this basis alone�

To further strengthen the plausibility of this conclusion� we could appeal to someconvergence theorem �one is given in the Notes and References�� But even knowingthat each of the four curves shown in �gure ���� converges to the exact value ofthe problem ����� �� we can only assert with certainty that the optimum value liesbetween ����� �the true optimum of ������� and ������ �the lowest objective valuecomputed with a Ritz approximation��

This is a problem of stopping criterion� which we discussed in chapter �� in thecontext of optimization algorithms� accepting ����� as the optimum value of ����� �corresponds to a �quite reasonable� heuristic stopping criterion� Just as in chapter ��� however� a stopping criterion that is based on a known lower bound may beworth the extra computation involved�

In this section we describe a method for computing lower bounds on the valueof ����� �� by forming an appropriate dual problem� Unlike the stopping criteria forthe algorithms in chapter ��� which involve little or no additional computation� thelower bound computations that we will describe require the solution of an auxiliaryminimum H� norm problem�

The dual function introduced in section ���� produces lower bounds on the solution of ����� �� but is not useful here since we cannot exactly evaluate the dualfunction� except by using the same approximations that we use to approximatelysolve ����� �� To form a dual problem that we can solve requires some manipulationof the problem ����� � and a generalization of the dual function described in section ���� � The generalization is easily described informally� but a careful treatmentis beyond the scope of this book� see the Notes and References at the end of thischapter�

We replace the RMS actuator e�ort objective and the RMS regulation constraintin ����� � with the corresponding variance objective and constraint� i�e�� we squarethe objective and constraint functionals �rms u and �rms yp� Instead of consideringthe step response overshoot constraint in ����� � as a single functional inequality�we will view it as a family of constraints on the step response� one constraint foreach t � �� that requires the step response at time t not exceed ����

min�rms yp�H�� � ����

�step�t�H� � ���� t � �

�rms u�H�� �������

where �step�t is the a�ne functional that evaluates the step response of the ��� entryat time t�

�step�t�H� � s���t��

Page 13: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

15.4 AN OUTER APPROXIMATION VIA DUALITY 363

In this transformed optimization problem� the objective is quadratic and the constraints consist of one quadratic constraint along with a family of a�ne constraintsthat is parametrized by t � R��

This suggests the following generalized dual functional for the problem ��������

���u� �y� �s�

�� minH � H

�u�rms u�H�� � �y�rms yp�H�� �

Z �

�s�t��step�t�H� dt

� �������

where the �weights� now consist of the positive numbers �u and �y� along withthe function �s � R� � R�� So in equation ������� we have replaced the weightedsum of �a �nite number of� constraint functionals with a weighted integral over thefamily of constraint functionals that appears in ��������

It is easily established that �� is a convex functional of ��u� �y� �s� and thatwhenever �y � � and �s�t� � � for all t � �� we have

���� �y� �s�� �����y �

Z �

����s�t� dt � �pri

where �pri is the optimum value of ����� �� Thus� computing ���� �y� �s� yields alower bound on the optimum of ����� ��

The convex duality principle �equations ��������� � of section ���� suggests thatwe actually have

�pri � max�y � �� �s�t� � �

���� �y� �s�� �����y �

Z �

����s�t� dt

� �������

which in fact is true� So the optimization problem on the righthand side of �������can be considered a dual of ����� ��

We can compute ���� �y� �s�� provided we have a statespace realization withimpulse response �s�t�� The objective in ������� is an LQG objective� with theaddition of the integral term� which is an a�ne functional of H� By completingthe square� it can be recast as an H�optimal controller problem� and solved by �anextension of� the method described in section � � � Since we can �nd a minimizerH��� for the problem �������� we can evaluate a subgradient for ���

�sg��u� �y� �s� � ��u�rms u�H���

� � �y�rms yp�H���

� �

Z �

�s�t��step�t�H�

�� dt

�c�f� section ��������By applying a Ritz approximation to the in�nitedimensional optimization prob

lem �������� we obtain lower bounds on the righthand� and hence lefthand sidesof ��������

Page 14: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

364 CHAPTER 15 SOLVING THE CONTROLLER DESIGN PROBLEM

To demonstrate this� we use two Ritz sequences for �s given by the transferfunctions

�� � �� �i�s� �

s�

i

� ��i�s� �

s� �

i

� i � �� � � � � �������

We shall denote these two Ritz approximations �� ��� The solution of the �nitedimensional inner approximation of the dual problem ������� is shown in �gure ����for various values of N � Each curve gives lower bounds on the solution of ����� ��

RMS�u�

N

��R�

��I �

��Iwithout step spec�

� � � � � �� �� �� �� �� ������

�����

����

�����

����

�����

����

Figure ��� The optimum value of the �nite�dimensional inner approxi�mation of the dual problem ������ versus the number of termsN for the twodi�erent Ritz approximations ������� The dotted line shows the optimumvalue of RMS�u without the step response overshoot speci�cation�

The upper bounds from �gure ���� and lower bounds from �gure ���� are showntogether in �gure ������ The exact solution of ����� � is known to lie between thedashed lines� this band is shown in �gure ����� on a larger scale for clarity�

The best lower bound on the value of ����� � is ������ corresponding to theN � � f��g Ritz approximation of �������� The best upper bound on the valueof ����� � is ������� corresponding to the N � � �K�a�� Q� Ritz approximationof ����� �� Thus we can state with certainty that

���� � min�rms yp�H� � ����os�H��� � ���

�rms u�H� � ������

We now know that ����� is within ������ �i�e�� ��� of the minimum value of theproblem ����� �� the plots in �gure ���� only strongly hint that this is so�

Page 15: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

15.4 AN OUTER APPROXIMATION VIA DUALITY 365

RMS�u�

N

����K�a�� Q

����K�a�� Q

����K�d�� Q

����K�d�� Q

��I�

��I ���I

without step spec�

� � � � � �� �� �� �� �� ���

����

����

����

����

���

����

����

����

����

���

Figure ���� The curves from �gures ���� and ���� are shown� The solu�tion of each �nite�dimensional inner approximation of ������ gives an upperbound of the exact solution� The solution of each �nite�dimensional innerapproximation of the dual problem ������ gives a lower bound of the exactsolution� The exact solution is therefore known to lie between the dashedlines�

RMS�u�

N

�K�a�� Q���

�K�a�� Q

���

�K�d�� Q

����K�d�� Q

��I�

��I �

�� �� �� � �� �� �������

�����

����

�����

�����

����

�����

Figure ����� Figure ����� is shown in greater detail� The exact solutionof ������ is known to lie inside the shaded band�

Page 16: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

366 CHAPTER 15 SOLVING THE CONTROLLER DESIGN PROBLEM

We should warn the reader that we do not know how to form a solvable dualproblem for the most general convex controller design problem� see the Notes andReferences�

15.5 Some Tradeoff Curves

In the previous three sections we studied two speci�c optimization problems� andthe performance of several approximate solution methods� In this section we consider some related twoparameter families of design speci�cations and the sameapproximate solution methods� concentrating on the e�ect of the approximationson the computed region of achievable speci�cations in performance space�

15.5.1 Tradeoff for Example with Analytic Solution

We consider the family of design speci�cations given by

�rms yp�H� � �� �rms u�H� � �� ������

for the same example that we have been studying�Figure ���� shows the tradeo� curves for the �K�a�� Q� Ritz approximations

of ������� for three values of N � The regions above these curves are thus AN � Ais the region above the solid curve� which is the exact tradeo� curve� This �guremakes clear the nomenclature �inner approximation��

15.5.2 Tradeoff for Example with no Analytic Solution

We now consider the family of design speci�cations given by

D����� � �rms yp�H� � �� �rms u�H� � �� �os�H��� � ���� �������

Inner and outer approximations for the tradeo� curve for ������� can be computed using Ritz approximations to the primal and dual problems� For example� anN � � �K�d�� Q� Ritz approximation to ������� shows that the speci�cations in thetop right region in �gure ����� are achievable� On the other hand� an N � � � Ritzapproximation to the dual of ������� shows that the speci�cations in the bottomleft region in �gure ����� are unachievable� Therefore the exact tradeo� curve isknown to lie in the shaded region in �gure ������

The inner and outer approximations shown in �gure ����� can be improved bysolving larger �nitedimensional approximations to ������� and its dual� as shownin �gure ������

Figure ����� shows the tradeo� curve for ������� for comparison� The gapbetween this curve and the shaded region shows the cost of the additional stepresponse speci�cation� �The reader should compare these curves with those of�gure ����� in section ����� which shows the cost of the additional speci�cationRMS� �yp� � ���� on the family of design speci�cations ��������

Page 17: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

15.5 SOME TRADEOFF CURVES 367

RMS�yp�

RMS�u�

���N � �

���N � �

���N � ��

���exact

� ���� ��� ���� ��� ���� ����

����

���

����

���

����

���

Figure ����� The exact tradeo� between RMS�yp and RMS�u for theproblem ������ can be computed using LQG theory� The tradeo� curves

computed using three �K�a�� Q Ritz inner approximations are also shown�

RMS�yp�

RMS�u�

achievable

unachievable

� ���� ��� ���� ��� �����

����

���

����

���

����

Figure ����� With the speci�cation �os�H�� � ���� speci�cations on�rms yp and �rms u in the upper shaded region are shown to be achievable

by solving an N � � �K�d�� Q �nite�dimensional approximation of ������Speci�cations in the lower shaded region are shown to be unachievable bysolving an N � � � �nite�dimensional approximation of the dual of ������

Page 18: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

368 CHAPTER 15 SOLVING THE CONTROLLER DESIGN PROBLEM

RMS�yp�

RMS�u�

����K�d�� Q� N � �

����� N � �

� ���� ��� ���� ��� �����

����

���

����

���

����

Figure ����� From �gure ����� we can conclude that the exact tradeo�curve lies in the shaded region�

RMS�yp�

RMS�u�

����K�d�� Q� N � ��

����

�� N � ��

� ���� ��� ���� ��� �����

����

���

����

���

����

Figure ����� With larger �nite�dimensional approximations to ����� andits dual� the bounds on the achievable limit of performance are substantiallyimproved� The dashed curve is the boundary of the region of achievableperformance without the step response overshoot constraint�

Page 19: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

NOTES AND REFERENCES 369

Notes and References

Ritz Approximations

The term comes from Rayliegh�Ritz approximations to in�nite�dimensional eigenvalueproblems� see� e�g�� Courant and Hilbert �CH��� p����� The topic is treated in� e�g��section ��� of Daniel �Dan���� A very clear discussion of Ritz methods� and their conver�gence properties� appears in sections and � of the paper by Levitin and Polyak �LP����

Proof that the Example Ritz Approximations Converge

It is often possible to prove that a Ritz approximation �works�� i�e�� that AN � A �insome sense as N � �� As an example� we give a complete proof that for the four Ritzapproximations ������ of the controller design problem with objectives RMS actuatore�ort� RMS regulation� and step response overshoot� we have

�N

AN � A� ������

This means that every achievable speci�cation that is not on the boundary �i�e�� not Paretooptimal can be achieved by a Ritz approximation with large enough N �

We �rst express the problem in terms of the parameter Q in the free parameter represen�tation of Dstable�

���Q�� �rms yp�T� � T�QT� � k G� �G�Qk��

���Q�� �rms u�T� � T�QT� � k G� �G�Qk��

���Q�� �os��� ���T� � T�QT��� � ��T � k G� �G�Qkpk step � ��

where the Gi depend on submatrices of T�� and the Gi depend on the appropriate sub�matrices of T� and T�� �These transfer matrices incorporate the constant power spectraldensities of the sensor and process noises� and combine the T� and T� parts since Q isscalar� These transfer matrices are stable and rational� We also have G��� � �� since P�has a pole at s � ��

We have

A � fa j �i�Q � ai� i � �� �� �� for some Q � H�g �

AN �

�a

����� �i�Q � ai� i � �� �� �� for some Q �

NXi��

xiQi

�H� is the Hilbert space of Laplace transforms of square integrable functions from R� intoR�

We now observe that ��� ��� and �� are continuous functionals on H�� in fact� there is anM �� such that

���i�Q� �i� Q�� �MkQ� Qk�� i � �� �� �� ������

Page 20: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

370 CHAPTER 15 SOLVING THE CONTROLLER DESIGN PROBLEM

This follows from the inequalities�����Q� ��� Q�� � kG�k�kQ� Qk�������Q� ��� Q�� � kG�k�kQ� Qk�������Q� ��� Q�� � kG��sk�kQ� Qk��

�The �rst two are obvious� the last uses the general fact that kABkpk step � kA�sk�kBk��which follows from the Cauchy�Schwarz inequality�

We now observe that the sequence �s � ��i� i � �� �� � � �� where � � �� is complete� i�e��has dense span in H�� In fact� if this sequence is orthonormalized we have the Laplacetransforms of the Laguerre functions on R��

We can now prove ������� Suppose a � A and � � �� Since a � A� there is a Q� � H�

such that �i�Q� � ai� i � �� �� �� Using completeness of the Qi�s� �nd N and x� � RN

such that

kQ� �Q�Nk� � ��M�

where

Q�N��

NXi��

x�iQi�

By ������� �i�Q�

N � ai � �� i � �� �� �� This proves �������

The Example Ritz ApproximationsWe used the state�space parametrization in section ���� with

P std� �s � C�sI � A��B�

where

A �

���� � �� � �� � �

�� B �

����

�� C �

�� �� ��

��

The controllers K�a� and K�b� are estimated�state�feedback controllers with

L�a�est �

��������

�������������

�� K

�a�sfb �

��������� ������� �������

��

L�d�est �

��������

���������������

�� K

�d�sfb �

������� ������� �������

��

Page 21: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

NOTES AND REFERENCES 371

Problem with Analytic SolutionWith the Ritz approximations� the problem has a single convex quadratic constraint� anda convex quadratic objective� which are found by solving appropriate Lyapunov equations�The resulting optimization problems are solved using a standard method that is describedin� e�g�� Golub and Van Loan �GL��� p�������� Of course an ellipsoid or cutting�planealgorithm could also be used�

Dual Outer Approximation for Linear Controller DesignGeneral duality in in�nite�dimensional optimization problems is treated in the book byRockafellar �Roc���� which also has a complete reference list of other sources covering thismaterial in detail� See also the book by Anderson and Nash �AN��� and the paper byReiland �Rei���

As far as we know� the idea of forming �nite�dimensional outer approximations to a convexlinear controller design problem� by Ritz approximation of an appropriate dual problem�is new�

The method can be applied when the functionals are quadratic �e�g�� weighted H� normsof submatrices of H� or involve envelope constraints on time domain responses� We do notknow how to form a solvable dual problem of a general convex controller design problem�

Page 22: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

372 CHAPTER 15 SOLVING THE CONTROLLER DESIGN PROBLEM

Page 23: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

Chapter 16

Discussion and Conclusions

We summarize the main points that we have tried to make� and we discuss someapplications and extensions of the methods described in this book� as well as somehistory of the main ideas�

16.1 The Main Points

An explicit framework� A sensible formulation of the controller design problemis possible only by considering simultaneously all of the closedloop transferfunctions of interest� i�e�� the closedloop transfer matrix H� which shouldinclude every closedloop transfer function necessary to evaluate a candidatedesign�

Convexity of many speci�cations� The set of transfer matrices that meet adesign speci�cation often has simple geometry�a�ne or convex� In manyother cases it is possible to form convex inner �conservative� approximations�

E�ectiveness of convex optimization� Many controller design problems canbe cast as convex optimization problems� and therefore can be �e�ciently�solved�

Numerical methods for performance limits� The methods described in thisbook can be used both to design controllers �via the primal problem� and to�nd the limits of performance �via the dual problem��

16.2 Control Engineering Revisited

In this section we return to the broader topic of control engineering� Some of themajor tasks of control engineering are shown in �gure �����

373

Page 24: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

374 CHAPTER 16 DISCUSSION AND CONCLUSIONS

The system to be controlled� along with its sensors and actuators� is modeledas the plant P �

Vague goals for the behavior of the closedloop system are formulated as a setof design speci�cations �chapters ������

If the plant is LTI and the speci�cations are closedloop convex� the resultingfeasibility problem can be solved �chapters �������

If the speci�cations are achievable� the designer will check that the design issatisfactory� perhaps by extensive simulation with a detailed �probably nonlinear� model of the system�

System

Goals

Plant

Specs�

Feas�Prob�

OK�yes yes

nono

Figure ���� A partial �owchart of the control engineer�s tasks�

One design will involve many iterations of the steps shown in �gure ����� Wenow discuss some possible design iterations�

Modifying the Specifications

The speci�cations are weakened if they are infeasible� and possibly tightened if theyare feasible� as shown in �gure ��� � This iteration may take the form of a searchover Pareto optimal designs �chapter ���

System

Goals

Plant

Specs�

Feas�Prob�

OK�yes yes

nono

Figure ���� Based on the outcome of the feasibility problem� the designermay decide to modify �e�g�� tighten or weaken some of the speci�cations�

Page 25: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

16.2 CONTROL ENGINEERING REVISITED 375

Modifying the Control Configuration

Based on the outcome of the feasibility problem� the designer may modify thechoice and placement of the sensors and actuators� as shown in �gure ����� If thespeci�cations are feasible� the designer might remove actuators and sensors to seeif the speci�cations are still feasible� if the speci�cations are infeasible� the designermay add or relocate actuators and sensors until the speci�cations become achievable�The value of knowing that a given set of design speci�cations cannot be achievedwith a given con�guration should be clear�

System

Goals

Plant

Specs�

Feas�Prob�

OK�yes yes

nono

Figure ���� Based on the outcome of the feasibility problem� the designermay decide to add or remove sensors or actuators�

These iterations can take a form that is analogous to the iteration describedabove� in which the speci�cations are modi�ed� We consider a �xed set of speci�cations� and a family �which is usually �nite� of candidate control con�gurations�Figure ���� shows fourteen possible control con�gurations� each of which consists ofsome selection among the two potential actuators A� and A� and the three sensorsS�� S�� and S�� �These are the con�gurations that use at least one sensor� and one�but not both� actuators� A� and A� might represent two candidate motors for asystem that can only accommodate one�� These control con�gurations are partiallyordered by inclusion� for example� A�S� consists of deleting the sensor S� from thecon�guration A�S�S��

These di�erent control con�gurations correspond to di�erent plants� and therefore di�erent feasibility problems� some of which may be feasible� and others infeasible� One possible outcome is shown in �gure ����� nine of the con�gurationsresult in the speci�cations being feasible� and �ve of the con�gurations result inthe speci�cations being infeasible� In the iteration described above� the designercould choose among the achievable speci�cations� here� the designer can chooseamong the control con�gurations that result in the design speci�cation being feasible� Continuing the analogy� we might say that A�S�S� is a Pareto optimal controlcon�guration� on the boundary between feasibility and infeasibility�

Page 26: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

376 CHAPTER 16 DISCUSSION AND CONCLUSIONS

A�S�S�S�

A�S�S� A�S�S� A�S�S�

A�S� A�S� A�S�

A�S�S�S�

A�S�S� A�S�S� A�S�S�

A�S� A�S� A�S�

Figure ���� The possible actuator and sensor con�gurations� with thepartial ordering induced by achievability of a set of speci�cations�

A�S�S�S�

A�S�S� A�S�S� A�S�S�

A�S� A�S� A�S�

A�S�S�S�

A�S�S� A�S�S� A�S�S�

A�S� A�S� A�S�

D achievable

D unachievable

Figure ���� The actuator and sensor con�gurations that can meet thespeci�cation D�

Modifying the Plant Model and Specifications

After choosing an achievable set of design speci�cations� the design is veri�ed� doesthe controller� designed on the basis of the LTI model P and the design speci�cations D� achieve the original goals when connected in the real closedloop system If the answer is no� the plant P and design speci�cations D have failed to accurately represent the original system and goals� and must be modi�ed� as shown in�gure �����

Perhaps some unstated goals were not included in the design speci�cations� Forexample� if some critical signal is too big in the closedloop system� it should beadded to the regulated variables signal� and suitable speci�cations added to D� toconstrain the its size�

Page 27: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

16.3 SOME HISTORY OF THE MAIN IDEAS 377

System

Goals

Plant

Specs�

Feas�Prob�

OK�yes yes

nono

Figure ���� If the outcome of the feasibility problem is inconsistent withdesigner�s criteria then the plant and speci�cations must be modi�ed tocapture the designer�s intent�

As a speci�c example� the controller designed in the rise time versus undershoottradeo� example in section � ��� would probably be unsatisfactory� since our designspeci�cations did not constrain actuator e�ort� This unsatisfactory aspect of thedesign would not be apparent from the speci�cations�indeed� our design cannotbe greatly improved in terms of rise time or undershoot� The excessive actuatore�ort would become apparent during design veri�cation� however� The solution� ofcourse� is to add an appropriate speci�cation that limits actuator e�ort�

An achievable design might also be unsatisfactory because the LTI plant P isnot a su�ciently good model of the system to be controlled� Constraining varioussignals to be smaller may improve the accuracy with which the system can bemodeled by an LTI P � adding appropriate robustness speci�cations �chapter ���may also help�

16.3 Some History of the Main Ideas

16.3.1 Truxal’s Closed-Loop Design Method

The idea of �rst designing the closedloop system and then determining the controller required to achieve this closedloop system is at least forty years old� Anexplicit presentation of a such a method appears in Truxal�s ���� Ph�D� thesis !Tru��"� and chapter � of Truxal�s ���� book� Automatic Feedback Control

System Synthesis� in which we �nd !Tru��� p���"�

Guillemin in ��� proposed that the synthesis of feedback control systems take the form � � �

�� The closedloop transfer function is determined from the speci�cations�

� The corresponding openloop transfer function is found�

�� The appropriate compensation networks are synthesized�

Page 28: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

378 CHAPTER 16 DISCUSSION AND CONCLUSIONS

Truxal cites his Ph�D� thesis and a ���� article by Aaron !Aar��"�On the di�erence between classical controller synthesis and the method he pro

poses� he states �!Tru��� p�������"��

The word synthesis rigorously implies a logical procedure for the transition from speci�cations to system� In pure synthesis� the designer is ableto take the speci�cations and in a straightforward path proceed to the�nal system� In this sense� neither the conventional methods of servodesign nor the root locus method is pure synthesis� for in each case thedesigner attempts to modify and to build up the openloop system untilhe has reached a point where the system� after the loop is closed� willbe satisfactory�

� � � !The closedloop design" approach to the synthesis of closedloop systems represents a complete change in basic thinking� No longer is thedesigner working inside the loop and trying to splice things up so thatthe overall system will do the job required� On the contrary� he is nowsaying� �I have a certain job that has to be done� I will force the systemto do it��

So Truxal views his closedloop controller design method as a �more logical synthesispattern� �p �� than classical methods� He does not extensively justify this view�except to point out the simple relation between the classical error constants and theclosedloop transfer function �p ���� �In chapter � we saw that the classical errorconstants are a�ne functionals of the closedloop transfer matrix��

The closedloop design method is described in the books !NGK��"� !RF���ch�"� !Hor� x����"� and !FPW��� x���" �see also the Notes and References fromchapter on the interpolation conditions��

16.3.2 Fegley’s Linear and Quadratic Programming Approach

The observation that some controller design problems can be solved by numericaloptimization that involves closedloop transfer functions is made in a series of papersstarting in ���� by Fegley and colleagues� In !Feg�" and !FH�"� Fegley applieslinear programming to the closedloop controller design approach� incorporatingsuch speci�cations as asymptotic tracking of a speci�c command signal and anovershoot limit� This method is extended to use quadratic programming in !PF�BF�"� In !CF�" and !MF��"� speci�cations on RMS values of signals are included�A summary of most of the results of Fegley and his colleagues appears in !FBB��"�which includes examples such as a minimum variance design with a step responseenvelope constraint� This paper has the summary�

Linear and quadratic programming are applicable � � � to the design ofcontrol systems� The use of linear and quadratic programming frequently represents the easiest approach to an optimal solution and often

Page 29: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

16.3 SOME HISTORY OF THE MAIN IDEAS 379

makes it possible to impose constraints that could not be imposed inother methods of solution�

So� several important ideas in this book appear in this series of papers by Fegleyand colleagues� designing the closed�loop system directly� noting the restrictionsplaced by the plant on the achievable closed�loop system� expressing performancespeci�cations as closed�loop convex constraints� and using numerical optimizationto solve problems that do not have an analytical solution �see the quote above��

Several other important ideas� however� do not appear in this series of papers�Convexity is never mentioned as the property of the problems that makes e�ectivesolution possible� linear and quadratic programming are treated as useful toolswhich they apply to the controller design problem� The casual reader mightconclude that an extension of the method to inde�nite �nonconvex� quadratic pro�gramming is straightforward� and might allow the designer to incorporate someother useful speci�cations� This is not the case� numerically solving nonconvexQP�s is vastly more di�cult than solving convex QP�s �see section ���� ��

Another important idea that does not appear in the early literature on theclosed�loop design method is that it can potentially search over all possible LTIcontrollers� whereas a classical design method �or indeed� a modern state�spacemethod� searches over a restricted �but often adequate� set of LTI controllers� Fi�nally� this early form of the closed�loop design method is restricted to the designof one closed�loop transfer function� for example� from command input to systemoutput�

16.3.3 Q-Parameter Design

The closed�loop design method was �rst extended to MAMS control systems �i�e�� byconsidering closed�loop transfer matrices instead of a particular transfer function��in a series of papers by Desoer and Chen �DC��a� DC��b� CD��b� CD��� andGustafson and Desoer �GD��� DG��b� DG��a� GD���� These papers emphasizethe design of controllers� and not the determination that a set of design speci�cationscannot be achieved by any controller�

In his ��� Ph� D� thesis� Salcudean �Sal��� uses the parametrization of achiev�able closed�loop transfer matrices described in chapter � to formulate the controllerdesign problem as a constrained convex optimization problem� He describes many ofthe closed�loop convex speci�cations we encountered in chapters �� �� and discussesthe importance of convexity� See also the article by Polak and Salcudean �PS����

The authors of this book and colleagues have developed a program called qdes�which is described in the article �BBB���� The program accepts input writtenin a control speci�cation language that allows the user to describe a discrete�timecontroller design problem in terms of many of the closed�loop convex speci�cationspresented in this book� A simple method is used to approximate the controllerdesign problem as a �nite�dimensional linear or quadratic programming problem�

Page 30: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

380 CHAPTER 16 DISCUSSION AND CONCLUSIONS

which is then solved� The simple organization and approximations made in qdesmake it practical only for small problems� The paper by Oakley and Barratt �OB��describes the use of qdes to design a controller for a �exible mechanical structure�

16.3.4 FIR Filter Design via Convex Optimization

A relevant parallel development took place in the area of digital signal processing�In about ���� several researchers observed that many �nite impulse response �FIR��lter design problems could be cast as linear programs� see� for example� the arti�cles �CRR��� Rab�� or the books by Oppenheim and Schaefer �OS� x���� andRabiner and Gold �RG�� ch���� In �RG�� x����� we even �nd designs subject toboth time and frequency domain speci�cations�

Quite often one would like to impose simultaneous restrictions on boththe time and frequency response of the �lter� For example� in the designof lowpass �lters� one would often like to limit the step response over�shoot or ripple� at the same time maintaining some reasonable controlover the frequency response of the �lter� Since the step response is alinear function of the impulse response coe�cients� a linear program iscapable of setting up constraints of the type discussed above�

A recent article on this topic is �OKU����Like the early work on the closed�loop design method� convexity is not recognized

as the property of the FIR �lter design problem that allows e�cient solution� Nor isit noted that the method actually computes the global optimum� i�e�� if the methodfails to design an FIR �lter that meets some set of convex speci�cations� then thespeci�cations cannot be achieved by any FIR �lter �of that order��

16.4 Some Extensions

16.4.1 Discrete-Time Plants

Essentially all of the material in this book applies to single�rate discrete�time plantsand controllers� provided the obvious changes are made �e�g�� rede�ning stability tomean no poles on or outside the unit disk�� For a discrete�time development� thereis a natural choice of stable transfer matrices that can be used to form the �analogof the� Ritz sequence � ���� described in section �� �

Qijk�z� � Eijz��k���� � i � nu� � j � ny� k � � �� � � � �

�Eij is the matrix with a unit i� j entry� and all other entries zero�� which correspondsto a delay of k� time steps� from the jth input of Q to its ith output� Thus in theRitz approximation� the entries of the transfer matrix Q are polynomials in z���i�e�� FIR �lters� This approach is taken in the program qdes �BBB����

Page 31: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

16.4 SOME EXTENSIONS 381

Many of the results can be extended to multi�rate plant and controllers� i�e��a plant in which di�erent sensor signals are sampled at di�erent rates� or di�er�ent actuator signals are updated at di�erent rates� A parametrization of stabi�lizing multi�rate controllers has recently been developed by Meyer �Mey��� thisparametrization uses a transfer matrix Q�z� that ranges over all stable transfermatrices that satisfy some additional convex constraints�

16.4.2 Nonlinear Plants

There are several heuristic methods for designing a nonlinear controller for a non�linear plant� based on the design of an LTI controller for an LTI plant �or a familyof LTI controllers for a family of LTI plants�� see the Notes and References for chap�ter �� In the Notes and References for chapter �� we saw a method of designing anonlinear controller for a plant that has saturating actuators� These methods oftenwork well in practice� but do not qualify as extensions of the methods and ideasdescribed in this book� since they do not consider all possible closed�loop systemsthat can be achieved� In a few cases� however� stronger results have been obtained�

In �DL���� Desoer and Liu have shown that for stable nonlinear plants� there isa parametrization of stabilizing controllers that is similar to the one described insection ������ provided a technical condition on P holds �incremental stability��

For unstable nonlinear plants� however� only partial results have been obtained�In �DL��� and �AD���� it is shown how a family of stabilizing controllers can beobtained by �rst �nding one stabilizing controller� and then applying the resultsof Desoer and Liu mentioned above� But even in the case of an LTI plant andcontroller� this two�step compensation approach can fail to yield all controllersthat stabilize the plant� This approach is discussed further in the articles �DL��a�DL��b� DL����

In a series of papers� Hammer has investigated an extension of the stable factor�ization theory �see the Notes and References for chapter �� to nonlinear systems�see �Ham��� and the references therein� Stable factorizations of nonlinear systemsare also discussed in Verma �Ver����

Page 32: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

382 CHAPTER 16 DISCUSSION AND CONCLUSIONS

Page 33: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

Notation and Symbols

Basic Notation

Notation Meaning

f � � � g Delimiters for sets� and for statement grouping inalgorithms in chapter ��

� � � � � Delimiters for expressions�

f � X � Y A function from the set X into the set Y �

� The empty set�

� Conjunction of predicates� and�

k � k A norm� see page ��� A particular norm is indicatedwith a mnemonic subscript�

���x� The subdi�erential of the functional � at the point x�see page ����

�� Equals by de�nition�

� Equals to �rst order�

� Approximately equal to �used in vague discussions��

� The inequality holds to �rst order�

�X A �rst order change in X�

argmin A minimizer of the argument� See page ���

C The complex numbers�

Cn The vector space of n�component complex vectors�

Cm�n The vector space of m� n complex matrices�

EX The expected value of the random variable X�

�z� The imaginary part of a complex number z�

383

Page 34: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

384 NOTATION AND SYMBOLS

inf The in�mum of a function or set� The readerunfamiliar with the notation inf can substitute minwithout ill e�ect�

j A square root of � �lim sup The asymptotic supremum of a function� see page ���

Prob�Z� The probability of the event Z�

�z� The real part of a complex number z�

R The real numbers�

R� The nonnegative real numbers�

Rn The vector space of n�component real vectors�

Rm�n The vector space of m� n real matrices�

�i�M� The ith singular value of a matrix M � the square rootof the ith largest eigenvalue of M�M �

�max�M� The maximum singular value of a matrix M � thesquare root of the largest eigenvalue of M�M �

sup The supremum of a function or set� The readerunfamiliar with the notation sup can substitute maxwithout ill e�ect�

TrM The trace of a matrix M � the sum of its entries on thediagonal�

M � � The n� n complex matrix M is positive semide�nite�i�e�� z�Mz � � for all z � Cn�

M � � The n� n complex matrix M is positive de�nite� i�e��z�Mz � � for all nonzero z � Cn�

� � � The n�component real�valued vector � hasnonnegative entries� i�e�� � � Rn

��

MT The transpose of a matrix or transfer matrix M �

M� The complex conjugate transpose of a matrix ortransfer matrix M �

M��� A symmetric square root of a matrix M �M� � ��i�e�� M���M��� �M �

Page 35: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

NOTATION AND SYMBOLS 385

Global Symbols

Symbol Meaning Page

� A function from the space of transfer matrices to realnumbers� i�e�� a functional on H� A particularfunction is indicated with a mnemonic subscript�

��

� The restriction of a functional � to a�nite�dimensional domain� i�e�� a function from R

n toR� A particular function is indicated with amnemonic subscript�

���

D A design speci�cation� a predicate or boolean functionon H� A particular design speci�cation is indicatedwith a mnemonic subscript�

��

H The closed�loop transfer matrix from w to z� ��

Hab The closed�loop transfer matrix from the signal b tothe signal a�

��

H The set of all nz � nw transfer matrices� A particularsubset of H �i�e�� a design speci�cation� is indicatedwith a mnemonic subscript�

��

K The transfer matrix of the controller� ��

L The classical loop gain� L � P�K� ��

nw The number of exogenous inputs� i�e�� the size of w� ��

nu The number of actuator inputs� i�e�� the size of u� ��

nz The number of regulated variables� i�e�� the size of z� ��

ny The number of sensed outputs� i�e�� the size of y� ��

P The transfer matrix of the plant� �

P� The transfer matrix of a classical plant� which isusually one part of the plant model P �

��

S The classical sensitivity transfer function or matrix� ��� �

T The classical I�O transfer function or matrix� ��� �

w Exogenous input signal vector� ��

u Actuator input signal vector� ��

z Regulated output signal vector� ��

y Sensed output signal vector� ��

Page 36: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

386 NOTATION AND SYMBOLS

Other Symbols

Symbol Meaning Page

� A feedback perturbation� ��

� A set of feedback perturbations� ��

kxk The Euclidean norm of a vector x � Rn or x � Cn�i�e��

px�x�

��

kuk� The L� norm of the signal u� �

kuk� The L� norm of the signal u� ��

kuk� The peak magnitude norm of the signal u� ��

kukaa The average�absolute value norm of the signal u� ��

kukrms The RMS norm of the signal u� ��

kukss� The steady�state peak magnitude norm of the signal u� ��

kHk� The H� norm of the transfer function H� ��� �

kHk� The H� norm of the transfer function H� �� �

kHk��a The a�shifted H� norm of the transfer function H� ��

kHkhankel The Hankel norm of the transfer function H� ��

kHkpk step The peak of the step response of the transfer functionH�

��

kHkpk gn The peak gain of the transfer function H� ���

kHkrms�w The RMS response of the transfer function H whendriven by the stochastic signal w�

��

kHkrms gn The RMS gain of the transfer function H� equal to itsH� norm�

��� �

kHkwc A worst case norm of the transfer function H� ��

A The region of achievable speci�cations in performancespace�

��

AP � Bw� Bu�

Cz� Cy�Dzw�

Dzu�Dyw�Dyu

The matrices in a state�space representation of theplant�

��

CF�u� The crest factor of a signal u� �

Dz��� The dead�zone function� ���

I��H� The �entropy of the transfer function H� �

nproc A process noise� often actuator�referred� ��

nsensor A sensor noise� ��

Page 37: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

NOTATION AND SYMBOLS 387

Fu�a� The amplitude distribution function of the signal u� ��

h�t� The impulse response of the transfer function H attime t�

��

H�a�� H�b��

H�c�� H�d�

The closed�loop transfer matrices from w to z achievedby the four controllers K�a�� K�b�� K�c�� K�d� in ourstandard example system�

��

K�a�� K�b��

K�c�� K�d�

The four controllers in our standard example system� ��

P A perturbed plant set� �

P std� The transfer function of our standard example

classical plant��

p� q Auxiliary inputs and outputs used in the perturbationfeedback form�

��

s Used for both complex frequency� s � � � j� and thestep response of a transfer function or matrix�although not usually in the same equation��

Sat��� The saturation function� ���

sgn��� The sign function� ��

T�� T�� T� Stable transfer matrices used in the free parameterrepresentation of achievable closed�loop transfermatrices�

��

� A submatrix or entry of H not relevant to the currentdiscussion�

��

�� The minimum value of the function �� �

x� A minimizing argument of the function �� i�e���� � ��x���

Tv�f� The total variation of the function f � ��

Page 38: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

388 NOTATION AND SYMBOLS

Page 39: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

List of Acronyms

Acronym Meaning Page

�DOF One Degree�Of�Freedom ��

��DOF Two Degree�Of�Freedom ��

ARE Algebraic Riccati Equation ��

FIR Finite Impulse Response ���

I�O Input�Output ��

LQG Linear Quadratic Gaussian ���

LQR Linear Quadratic Regulator ���

LTI Linear Time�Invariant ��

MAMS Multiple�Actuator� Multiple�Sensor ��

MIMO Multiple�Input� Multiple�Output �

PID Proportional plus Integral plus Derivative �

QP Quadratic Program ���

RMS Root�Mean�Square ��

SASS Single�Actuator� Single�Sensor ��

SISO Single�Input� Single�Output ��

389

Page 40: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

390 LIST OF ACRONYMS

Page 41: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

Bibliography

�Aar��� M� R� Aaron� Synthesis of feedback control systems by means of the closedloop function� Trans� AIEE� ����������� ����

�ABJ��� B� Anderson� R� Bitmead� C� Johnson� P� Kokotovic� R� Kosut� I� Mareels� L�Praly� and B� Riedle� Stability of Adaptive Systems� Passivity and AveragingAnalysis� MIT Press� �� �

�ac���� ac���� manual� Integrated Systems� Inc�� ����

�Ack��� J� Ackermann� Sampled�Data Control Systems� Springer�Verlag� ����

�AD��� V� Anantharam and C� A� Desoer� On the stabilization of nonlinear systems�IEEE Trans� Aut� Control� AC��� ��� ���� June ����

�AF��� M� Athans and P� Falb� Optimal Control� McGraw�Hill� � �

�AIE��� AIEE Committee Report� Proposed symbols and terms for feedback controlsystems� Electrical Engineering� ������� ����

�Akg��� M� Akg�ul� Topics in Relaxation and Ellipsoidal Methods� Volume � of Re�search Notes in Mathematics� Pitman� ����

�AL��� W� F� Arnold and A� J� Laub� Generalized eigenproblem algorithms and soft�ware for algebraic Riccati equations� Proc� IEEE� ���������� ����� December����

�All��� R� Allan� New applications open up for silicon sensors� Electronics� �������November ����

�AM��� B� Anderson and J� B� Moore� Linear system optimization with prescribeddegree of stability� Proc� IEE� �� �������������� December � �

�AM��� B� Anderson and J� B� Moore� Optimal Control� Linear Quadratic Methods�Prentice�Hall� ���

�AN�� E� J� Anderson and P� Nash� Linear Programming in In�nite�DimensionalSpaces� Theory and Applications� John Wiley � Sons� ����

�And�� B� Anderson� An algebraic solution to the spectral factorization problem�IEEE Trans� Aut� Control� AC�������������� � ��

�AP��� E� J� Anderson and A� B� Philpott� editors� In�nite Programming� Springer�Verlag Lecture Notes in Economics and Mathematical Systems� September����

�AS�� Y� I� Al�ber and S� V� Shil�man� A uni�ed approach to the problem of minimiz�ing smooth and nonsmooth functions� Engineering Cybernetics� ���������������

391

Page 42: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

392 BIBLIOGRAPHY

�AS��� P� J� Antsaklis and M� K� Sain� Feedback controller parameterizations� �nitehidden modes and causality� In S� G� Tzafestas� editor� Multivariable Control�pages ������ D� Reidel� ����

�Ast��� K� J� �Astr�om� Computer aided modelling� analysis and design of controlsystems�A perspective� IEEE Control Syst� Mag�� �� � May ����

�AT��� D� Auslander and C� Tham� Real�time Software for Control� Program Exam�ples in c� Prentice�Hall� ���

�Ath�� M� Athans� Special issue on the Linear�Quadratic�Gaussian problem� IEEETrans� Aut� Control� AC�� � December ����

�Aub�� J� P� Aubin� Applied Functional Analysis� John Wiley � Sons� ���

�AV�� J� P� Aubin and R� Vinter� editors� Convex Analysis and Optimization� Pitman�����

�AW��� K� J� �Astr�om and B� Wittenmark� Adaptive Control� Addison�Wesley� ���

�AW��� K� J� �Astr�om and B� Wittenmark� Computer Controlled Systems� Theory andDesign� Prentice�Hall� second edition� ���

�BB��� C� Barratt and S� Boyd� Example of exact tradeo�s in linear controller design�IEEE Control Syst� Mag�� ����� ��� January ���

�BB��� S� Boyd and V� Balakrishnan� A regularity result for the singular values ofa transfer matrix and a quadratically convergent algorithm for computing itsL��norm� Syst� Control Letters� ������ ���

�BBB��� S� Boyd� V� Balakrishnan� C� Barratt� N� Khraishi� X� Li� D� Meyer� and S�Norman� A new CAD method and associated architectures for linear con�trollers� IEEE Trans� Aut� Control� AC�������� ����� March ����

�BBK��� S� Boyd� V� Balakrishnan� and P� Kabamba� A bisection method for computingthe H� norm of a transfer matrix and related problems� Mathematics ofControl� Signals� and Systems� ����������� ���

�BBN��� S� Boyd� C� Barratt� and S� Norman� Linear controller design� Limits ofperformance via convex optimization� Proc� IEEE� ������������ March ���

�BD��� S� Boyd and C� A� Desoer� Subharmonic functions and performance boundson linear time�invariant feedback systems� IMA J� of Mathematical Controland Information� ��������� ����

�BD��� A� Bhaya and C� A� Desoer� Necessary and su�cient conditions on Q��C�I � PC���� for stabilization of the linear feedback system S�P�C�� Syst�Control Letters� ���������� February �� �

�BD�� S� Boyd and J� Doyle� Comparison of peak and RMS gains for discrete�timesystems� Syst� Control Letters� �� � June ����

�Ben�� S� Bennett� The emergence of a discipline� Automatic control ����� ��Automatica� ���������� �� �

�Ben�� S� Bennett� A History of Control Engineering �������� Volume � of IEEControl Engineering Series� IEE� ���

�Ber��� J� E� Bertram� Factors in the design of digital controllers for sampled�datafeedback systems� AIEE Transactions� �������� July �� �

�BF��� S� Blum and K� A� Fegley� A quadratic programming solution of the minimumenergy control problem� IEEE Trans� Aut� Control� �� ���� April � ��

Page 43: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

BIBLIOGRAPHY 393

�BGT��� R� G� Bland� D� Goldfarb� and M� J� Todd� The ellipsoid method� a survey�Operations Research� �� ��������� ����

�BH�� A� E� Bryson and Y� C� Ho� Applied Optimal Control� Hemisphere Publishing�����

�Big��� S� C� Bigelow� The design of analog computer compensated control systems�AIEE Transactions� �������� November ����

�BJ�� G� Box and G� Jenkins� Time Series� Data Analysis and Theory� Holden�Day�����

�Bla��� H� S� Black� Stabilized feedback ampli�ers� Bell Syst� Tech� J�� ������� ����

�Bod��� H� W� Bode� Network Analysis and Feedback Ampli�er Design� Van Nostrand�����

�Boy��� S� Boyd� A note on parametric and nonparametric uncertainties in controlsystems� In Proc� American Control Conf�� pages �������� June �� �

�BP�� V� Barbu and T� Precupanu� Convexity and Optimization in Banach Spaces�Sijtho� and Noordho�� ����

�Bro�� R� W� Brockett� Finite Dimensional Linear Systems� John Wiley � Sons�����

�BS� R� Bartels and G� Stewart� Solution of the equation AX �XB � C� Comm�Assoc� Comp� Mach�� �������� � ����

�BS��� R� K� Brayton and R� Spence� Sensitivity and Optimization� Elsevier Scienti�c�����

�Cai��� P� E� Caines� Linear Stochastic Systems� John Wiley � Sons� ����

�Can�� R� Cannon� Dynamics of Physical Systems� McGraw�Hill� � ��

�CD�a� F� M� Callier and C� A� Desoer� Multivariable Feedback Systems� Springer�Verlag� ����

�CD�b� M� J� Chen and C� A� Desoer� Necessary and su�cient condition for robuststability of linear distributed feedback systems� Int� J� Control� ���������� ������

�CD��� M� J� Chen and C� A� Desoer� The problem of guaranteeing robust disturbancerejection in linear multivariable feedback systems� Int� J� Control� ������������� ����

�CF��� A� J� Calise and K� A� Fegley� Quadratic programming in the statistical designof sampled�data control systems� IEEE Trans� Aut� Control� ����� February� ��

�CG��� E� Cheney and A� Goldstein� Newton�s method for convex programming andTchebyche� approximation� Numer� Math�� ���� �� ���

�CH��� R� Courant and D� Hilbert� Methods of Mathematical Physics� Volume I� JohnWiley � Sons� ����

�Che�� C� S� Chen� Application of one�chip signal processor in digital controller im�plementation� IEEE Control Syst� Mag�� � ��� September ����

�Che��� C� T� Chen� Linear System Theory and Design� Holt� Rinehart and Winston�����

�Che�� C� T� Chen� Linear Control System Design and Analysis� Holt� Rinehart andWinston� ����

Page 44: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

394 BIBLIOGRAPHY

�Cif��� A� Cifuentes� Using msc�nastran� Springer�Verlag� ���

�CKK��� S� Crandall� D� Karnopp� E� Kurtz� and D� Pridmore�Brown� Dynamics ofMechanical and Electromechanical Systems� McGraw�Hill� � ��

�Cla��� F� H� Clarke� Optimization and Nonsmooth Analysis� Canadian Math� Soc�Series� John Wiley � Sons� ����

�CP��� J� Cruz and W� Perkins� New approach to the sensitivity problem in multi�variable feedback system design� IEEE Trans� Aut� Control� AC���� ����� ��

�CP�� N� O� Da Cunha and E� Polak� Constrained minimization under vector�valuedcriteria in �nite dimensional spaces� J� Math� Anal� and Appl�� ���������� ��

�CRR��� R� Calvin� C� Ray� and V� Rhyne� The design of optimal convolutional �ltersvia linear programming� IEEE Trans� Geoscience Elec�� ������������ July� �

�Cru�� J� Cruz� editor� System Sensitivity Analysis� Dowden� Hutchison� and Ross�����

�Dan�� J� Daniel� The Approximate Minimization of Functionals� Prentice�Hall� ����

�DC�� C� A� Desoer and W� S� Chan� The feedback interconnection of lumped lineartime�invariant systems� J� Franklin Inst�� ����� and ��������� ����

�DC��a� C� A� Desoer and M� C� Chen� Design of multivariable feedback systems withstable plant� IEEE Trans� Aut� Control� AC�� ����������� April ����

�DC��b� C� A� Desoer and M� C� Chen� Extension of the design algorithm of �designof multivariable feedback systems with stable plant� to the tracking problem�IEEE Trans� Aut� Control� AC�� ������ ���� April ����

�Deb��� G� Debreu� Theory of Value� Volume �� of Cowles Foundation Monographs�Yale University Press� ���

�Del��� D� F� Delchamps� State�Space and Input�Output Linear Systems� Springer�Verlag� ����

�Dem��� J� Demmel� lapack� A portable linear algebra library for supercomputers�In Proceedings of the Workshop on Computer�Aided Control System Design�pages ��� IEEE Control Systems Society� December ���

�Den��� M� J� Denham� Design issues for CACSD systems� Proc� IEEE� ���������������� December ����

�DeS��� C� DeSilva� Control Sensors and Actuators� Prentice�Hall� ���

�DG��a� C� A� Desoer and C� L� Gustafson� Algebraic theory of linear multivariablefeedback systems� IEEE Trans� Aut� Control� AC����������� October����

�DG��b� C� A� Desoer and C� L� Gustafson� Design of multivariable feedback systemswith simple unstable plant� IEEE Trans� Aut� Control� AC������������October ����

�DGK��� J� Doyle� K� Glover� P� P� Khargonekar� and B� A� Francis� State�space solu�tions to standard H� and H� control problems� IEEE Trans� Aut� Control�������������� August ���

Page 45: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

BIBLIOGRAPHY 395

�DL�� C� A� Desoer and R� W� Liu� Global parametrization of feedback systems withnonlinear plants� Syst� Control Letters� �������� January ����

�DL��� C� A� Desoer and C� A� Lin� Two�step compensation of nonlinear systems�Syst� Control Letters� ���������� June ����

�DL��a� C� A� Desoer and C� A� Lin� Non�linear unity�feedback systems and Q�parametrization� Int� J� Control� ����������� ����

�DL��b� C� A� Desoer and C� A� Lin� Simultaneous stabilization of nonlinear systems�IEEE Trans� Aut� Control� AC������������� May ����

�DL��� C� A� Desoer and C� A� Lin� A comparative study of linear and nonlinearMIMO feedback con�gurations� Int� J� Systems Sci�� � ���������� ����

�DLM��� C� A� Desoer� R� W� Liu� J� Murray� and R� Saeks� Feedback system design�The fractional representation approach to analysis and synthesis� IEEE Trans�Aut� Control� AC������������ June ����

�DMB�� J� Dongarra� C� Moler� J� Bunch� and G� Stewart� linpack users� guide� SIAM����

�Doo��� P� Van Dooren� A generalized eigenvalue approach for solving Riccati equa�tions� SIAM J� Sci� Stat� Comp�� ��������� ����

�Dor�� P� Dorato� editor� Robust Control� IEEE Press� ����

�Dor��� R� C� Dorf� Modern Control Systems� Addison�Wesley� �th edition� ����

�Doy�� J� Doyle� Guaranteed margins for LQG regulators� IEEE Trans� Aut� Control�AC��������� ���� August ����

�Doy�� J� Doyle� Analysis of feedback systems with structured uncertainties� IEEProc�� ���D� ��������� November ����

�Doy��� J� Doyle� Matrix Interpolation Theory and Optimal Control� PhD thesis�University of California� Berkeley� ����

�DP�a� M� A� Dahleh and J� B� Pearson� Jr� L��Optimal compensators for continuous�time systems� IEEE Trans� Aut� Control� AC������������� October ����

�DP�b� M� A� Dahleh and J� B� Pearson� Jr� l��Optimal feedback controllers forMIMO discrete�time systems� IEEE Trans� Aut� Control� AC��������������April ����

�DP��a� M� A� Dahleh and J� B� Pearson� Jr� Minimization of a regulated response toa �xed input� IEEE Trans� Aut� Control� AC������������� October ����

�DP��b� M� A� Dahleh and J� B� Pearson� Jr� Optimal rejection of persistent distur�bances� robust stability� and mixed sensitivity minimization� IEEE Trans�Aut� Control� AC�������������� August ����

�DS��� J� Doyle and G� Stein� Multivariable feedback design� Concepts for a clas�sical�modern synthesis� IEEE Trans� Aut� Control� AC�� ������ � February����

�DV�� C� A� Desoer and M� Vidyasagar� Feedback Systems� Input�Output Properties�Academic Press� ����

�DV��� V� F� Demyanov and L� V� Vasilev� Nondi�erentiable Optimization� Optimiza�tion Software �Springer�Verlag�� ����

�DWS�� J� Doyle� J� E� Wall� and G� Stein� Performance and robustness analysisfor structured uncertainties� In Proc� IEEE Conf� on Decision and Control�pages � � � ����

Page 46: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

396 BIBLIOGRAPHY

�ECC��� DC Motors� Speed Controls� Servo Systems� including Optical Encoders� Hop�kins� MN� �fth edition� ����

�EK��� J� Ecker and M� Kupferschmid� An ellipsoid algorithm for nonlinear program�ming� Math� Program� Studies� ������� � ����

�EK��� J� Ecker and M� Kupferschmid� A computational comparison of the ellipsoidalgorithm with several nonlinear programming algorithms� SIAM J� Controland Opt�� ������ �� ��� September ����

�EM�� J� Elzinga and T� Moore� A central cutting plane algorithm for the convexprogramming problem� Math� Program� Studies� ��������� ����

�Eva��� W� R� Evans� Control system synthesis by root locus method� AIEE Trans�actions� � � ����

�Evt��� Y� Evtushenko� Numerical Optimization Techniques� Translation Series inMathematics and Engineering� Optimization Software �Springer�Verlag�� ����

�FBB�� K� A� Fegley� S� Blum� J� Bergholm� A� J� Calise� J� E� Marowitz� G� Porcelli�and L� P� Sinha� Stochastic and deterministic design and control via linearand quadratic programming� IEEE Trans� Aut� Control� AC�� � ����� �December ����

�FBS�� D� Flamm� S� Boyd� G� Stein� and S� Mitter� Tutorial workshop onH��optimalcontrol� December ���� Preconference workshop� CDC�

�Feg��� K� A� Fegley� Designing sampled�data control systems by linear programming�IEEE Trans� on Appl� and Ind�� ��������� May � ��

�FH��� K� A� Fegley and M� I� Hsu� Optimum discrete control by linear programming�IEEE Trans� Aut� Control� ������� January � ��

�FL��� J� S� Freudenberg and D� P� Looze� Right half plane poles and zeros and designtrade�o�s in feedback systems� IEEE Trans� Aut� Control� AC���� ������ ��June ����

�FL��� J� S� Freudenberg and D� P� Looze� Frequency Domain Properties of Scalarand Multivariable Feedback Systems� Lecture Notes in Control and InformationSciences� Springer�Verlag� ����

�FPE��� G� F� Franklin� J� D� Powell� and A� Emami�Naeni� Feedback Control of Dy�namic Systems� Addison�Wesley� �� �

�FPW��� G� F� Franklin� J� D� Powell� and M� L� Workman� Digital Control of DynamicSystems� Addison�Wesley� ���

�Fra�� B� A� Francis� A course in H� Control Theory� Volume �� of Lecture Notesin Control and Information Sciences� Springer�Verlag� ����

�Fra��� B� A� Francis� Snippets of H� Control Theory� Technical Report �����Systems Control Group� Department of Electrical Engineering� University ofToronto� Toronto� Canada� July ����

�Fuk��� M� Fukushima� A descent algorithm for nonsmooth convex optimization�Math�Program� Studies� ���� ����� ����

�FWK��� M� Fan� L� Wang� J� Koninckx� and A� Tits� Software package for optimization�based design with user�supplied simulators� IEEE Control Syst� Mag�� ���� ��� ���

Page 47: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

BIBLIOGRAPHY 397

�GD��� C� L� Gustafson and C� A� Desoer� Controller design for linear multivari�able feedback systems with stable plants� using optimization with inequalityconstraints� Int� J� Control� ������������ ����

�GD��� C� L� Gustafson and C� A� Desoer� A CAD methodology for linear multivari�able feedback systems based on algebraic theory� Int� J� Control� ������ �� ��� ����

�GD��� K� Glover and J� Doyle� State�space formulae for all stabilizing controllersthat satisfy an H��norm bound and relations to risk sensitivity� Syst� ControlLetters� ���� ����� ����

�GJ�� M� R� Garey and D� S� Johnson� Computers and Intractability� A guide to thetheory of NP�Completeness� W� H� Freeman� ���

�GL��� P� G�acs and L� Lov�asz� Khachiyan�s algorithm for linear programming� Math�Program� Studies� ��� � �� ����

�GL��� G� Golub and C� Van Loan� Matrix Computations� Johns Hopkins Univ� Press�second edition� ���

�Glo��� K� Glover� All optimal Hankel�norm approximations of linear multivariablesystems and their L��error bounds� Int� J� Control� �� ���������� ����

�GLS��� M� Gr�otschel� L� Lov�asz� and A� Schrijver� Geometric Algorithms and Combi�natorial Optimization� Volume � of Algorithms and Combinatorics� Springer�Verlag� ����

�GM��� K� Glover and D� Mustafa� Derivation of the maximum entropy H��controllerand a state�space formula for its entropy� Int� J� Control� �������� � ���

�GNL�� G� Golub� S� Nash� and C� Van Loan� A Hessenberg�Schur method for thematrix problem AX �XB � C� IEEE Trans� Aut� Control� AC�����������

�Gof��� J� L� Go�n� Convergence rates of the ellipsoid method on general convexfunctions� Math� Operations Research� ������������ ����

�Gof��� J� L� Go�n� Variable metric relaxation methods� part II� the ellipsoid method�Math� Program� Studies� ������� �� ����

�GP�� C� Gonzaga and E� Polak� On constraint dropping schemes and optimalityfunctions for a class of outer approximation algorithms� SIAM J� Control andOpt�� ������������ ���

�GPS��� Global positioning system� ���� Two volume set of reprinted articles fromNavigation� published by the Institute of Navigation�

�GS��� G� Goodwin and K� Sin� Adaptive Filtering� Prediction� and Control� Prentice�Hall� ����

�GV��� A� Gelb and W� E� Vander Velde� Multiple�Input Describing Functions andNonlinear System Design� McGraw�Hill� � ��

�Ham��� J� Hammer� Assignment of dynamics for non�linear recursive feedback systems�Int� J� Control� ��������������� ����

�Han�� H� Hanselmann� Implementation of digital controllers�a survey� Automatica����� January ����

�HeP��� hp����a Control Systems Analyzer� Hewlett�Packard Co�� ���

�Het�� R� Hettich� editor� Semi�In�nite Programming� Springer�Verlag� ����

Page 48: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

398 BIBLIOGRAPHY

�Hor��� I� M� Horowitz� Synthesis of Feedback Systems� Academic Press� � ��

�Hor�� M� F� Hordeski� Transducers for Automation� Van Nostrand Reinhold� ����

�HS�� C� A� Harvey and G� Stein� Quadratic weights for asymptotic regulation prop�erties� IEEE Trans� Aut� Control� AC����������� ����

�HSM��� L� Hunt� R� Su� and G� Meyer� Global transformations of nonlinear systems�IEEE Trans� Aut� Control� AC��������� ����

�Ise��� R� Isermann� Process fault detection based on modeling and estimationmethods�A survey� Automatica� ������������� ����

�Isi��� A� Isidori� Nonlinear Control Systems� An Introduction� Springer�Verlag�second edition� ���

�JH��� M� Jamshidi and C� J� Herget� editors� Computer�Aided Control Systems En�gineering� North�Holland� ����

�JNP�� H� James� N� Nichols� and R� Philips� Theory of Servomechanisms� McGraw�Hill� ����

�JTP��� V� J� Jaswa� C� E� Thomas� and J� T� Pedicone� CPAC�concurrent processorarchitecture for control� IEEE Trans� on Computers� � �� � February ����

�KA�� L� V� Kantorovich and G� P� Akilov� Functional Analysis� Pergamon Press�����

�Kai��� T� Kailath� Linear Systems� Prentice�Hall� ����

�Kel��� J� E� Kelley� The cutting�plane method for solving convex programs� J� Soc�Indust� Appl� Math� ������������ December � ��

�KF�� A� N� Kolmogorov and S� V� Fomin� Introductory Real Analysis� Dover� ����

�Kha�� L� Khachiyan� A polynomial algorithm in linear programming� Soviet Math�Doklady� �������� ���

�Kiw��� K� C� Kiwiel� Methods of Descent for Nondi�erentiable Optimization� Vol�ume ���� of Lecture Notes in Mathematics� Springer�Verlag� ����

�KKO��� P� Kokotovic� H� Khalil� and J� O�Reilly� Singular Perturbation Methods inControl� Analysis and Design� Academic Press� �� �

�KL��� T� Kane and D� Levinson� Dynamics� Theory and Application� McGraw�HillSeries in Mechanical Engineering� McGraw�Hill� ����

�KL��� N� T� Koussoulas and C� T� Leondes� The multiple Linear Quadratic Gaussianproblem� Int� J� Control� ������������ �� �

�KME��� M� Kupferschmid� K� Mohrmann� J� Ecker� and H� Kaufman� The ellipsoidalgorithm� a new method for feedback gain optimization� In Control Applica�tions of Nonlinear Programming and Optimization� pages ���� IFAC� June����

�KS� H� Kwakernaak and R� Sivan� Linear Optimal Control Systems� John Wiley� Sons� ����

�Kuc�� V� Ku cera� Discrete Linear Control� The Polynomial Equation Approach�John Wiley � Sons� ���

�Lau�� A� J� Laub� A Schur method for solving algebraic Riccati equations� IEEETrans� Aut� Control� AC���� ������� December ���

Page 49: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

BIBLIOGRAPHY 399

�Lau��� A� J� Laub� Numerical linear algebra aspects of control design computations�IEEE Trans� Aut� Control� AC������������ February ����

�Lem�� C� Lemarechal� An extension of Davidon methods to nondi�erentiable prob�lems� In M� L� Balinski and P� Wolfe� editors� Math� Programming Study �Nondi�erentiable Optimization� pages ���� North�Holland� ����

�Lev��� A� Levin� An algorithm for the minimization of convex functions� Soviet Math�Doklady� ��� ��� � ��

�Lju��� L� Ljung� System Identi�cation Toolbox for use with pro�matlab� User�sGuide� The MathWorks� Inc�� �� �

�Lju�� L� Ljung� System Identi�cation� Theory for the User� Prentice�Hall� ����

�LL�� A� Laub and J� Little� Control System Toolbox for use with pro�matlab�User�s Guide� The MathWorks� Inc�� ����

�LM�� Y� I� Lyubich and G� D� Maistrovskii� The general theory of relaxation pro�cesses for convex functions� Russian Mathematical Surveys� ������ ����

�LP��� E� Levitin and B� Polyak� Constrained minimization methods� USSR Compu�tational Math� and Math� Physics� �������� � �

�Luc��� D� T� Luc� Theory of Vector Optimization� Volume �� of Lecture Notes inEconomics and Mathematical Systems� Springer�Verlag� ���

�Lue��� D� G� Luenberger� Optimization By Vector Space Methods� John Wiley �Sons� � �

�Lue��� D� G� Luenberger� Linear and Nonlinear Programming� Addison�Wesley� �ndedition� ����

�Lun��� J� Lunze� Robust Multivariable Feedback Control� Prentice�Hall� ���

�Mac�� A� G� J� MacFarlane� editor� Frequency Response Methods in Control Systems�Selected Reprints� IEEE Press� ���

�Mac��� J� Mackerle� Survey of general purpose �nite element and boundary ele�ment computer programs for structural and solid mechanics applications� InA� Niku�Lari� editor� Structural Analysis Systems� pages ������ PergamonPress� �� �

�Mac��� J� M� Maciejowski� Multivariable Feedback Design� Addison�Wesley� ���

�mat��� matrix�x system identification manual� Integrated Systems� Inc�� ����

�Max��� J� C� Maxwell� On governors� Proc� Royal Soc�� � �������� �� ��

�May�� O� Mayr� The Origins of Feedback Control� MIT Press� ����

�MB�� A� Mees and A� Bergen� Describing functions revisited� IEEE Trans� Aut�Control� ���������� August ����

�Mey��� D� Meyer� A parametrization of stabilizing controllers for multirate sampled�data systems� IEEE Trans� Aut� Control� ������������� February ���

�MF�� J� E� Marowitz and K� A� Fegley� System design using quadratic programming�IEEE Trans� Aut� Control� AC�� ����������� June ����

�MG��� D� Mustafa and K� Glover� Minimum Entropy H� Control� Lecture Notes inControl and Information Sciences� Springer�Verlag� ���

�MGT��� J� B� Moore� K� Glover� and A� Telford� All stabilizing controllers as frequency�shaped state estimate feedback� IEEE Trans� Aut� Control� ����������������

Page 50: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

400 BIBLIOGRAPHY

�MLB�� C� Moler� J� Little� S� Bangert� and S� Kleiman� pro�matlab for Sun Work�stations� User�s Guide� The MathWorks� Inc�� ����

�Moo��� J� B� Moore� A circle criterion generation for relative stability� IEEE Trans�Aut� Control� ���������� � ��

�MT�� P� M� M�akil�a and H� T� Toivonen� Computational methods for parametricLQ minimization� A survey� IEEE Trans� Aut� Control� AC������� �� ���August ����

�Mus��� D� Mustafa� Minimum Entropy H� Control� PhD thesis� Cambridge Univer�sity� May ���

�MZ��� M� Morari and E� Za�rou� Robust Process Control� Prentice�Hall� ���

�Net��� C� N� Nett� Algebraic aspects of linear control system stability� IEEE Trans�Aut� Control� AC�������� October �� �

�New��� D� J� Newman� Location of the maximum on unimodal surfaces� J� of theAssoc� for Computing Machinery� ����������� July � ��

�NG��� K� S� Narendra and R� M� Goldwyn� A geometrical criterion for the stabilityof certain nonlinear nonautonomous systems� IEEE Trans� Circuit Theory�CT������ ���� September � ��

�Ng��� W� Y� Ng� Interactive Multi�Objective Programming as a Framework forComputer�Aided Control System Design� Lecture Notes in Control and In�formation Sciences� Springer�Verlag� ���

�NGK�� G� Newton� L� Gould� and J� Kaiser� Analytical Design of Linear FeedbackControls� John Wiley � Sons� ����

�Nik��� A� Niku�Lari� editor� Structural Analysis Systems� Volume �� Pergamon Press��� �

�NM��� J� Von Neumann and O� Morgenstern� Theory of Games and Economic Be�havior� Princeton Univ� Press� third edition� ����

�Nor��� J� P� Norton� An Introduction to Identi�cation� Academic Press� �� �

�NT��� W� Nye and A� Tits� An application�oriented� optimization�based methodologyfor interactive design of engineering systems� Int� J� Control� ��� ��� �������� �

�NY��� A� Nemirovsky and D� Yudin� Problem Complexity and Method E ciency inOptimization� John Wiley � Sons� ����

�OB��� C� Oakley and C� Barratt� End�point controller design for an experimental two�link !exible manipulator using convex optimization� Proc� American ControlConf�� ���

�OF��� S� D� O�Young and B� A� Francis� Sensitivity tradeo�s for multivariable plants�IEEE Trans� Aut� Control� AC������� �� ��� July ����

�OF��� S� D� O�Young and B� A� Francis� Optimal performance and robust stabiliza�tion� Automatica� ������������� �� �

�Oga�� K� Ogata� Discrete�Time Control Systems� Prentice�Hall� ����

�Oga��� K� Ogata� Modern Control Engineering� Prentice�Hall� second edition� ���

�OKU��� Y� Ohashi� H� Kando� H� Ukai� and T� Iwazumi� Optimal design of FIR linearphase �lters via convex quadratic programming method� Int� J� Systems Sci��������� ����� ����

Page 51: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

BIBLIOGRAPHY 401

�OS�� A� V� Oppenheim and R� W� Schafer� Digital Signal Processing� Prentice�Hall�����

�Par��� V� Pareto� Cours d� �Economie Politique� Rouge� �� �

�Pet�� K� E� Petersen� Silicon as a mechanical material� Proc� IEEE� �������������May ����

�PF��� G� Porcelli and K� A� Fegley� Optimal design of digitally compensated systemsby quadratic programming� J� Franklin Inst�� ����������� � �

�PIE��� Special issue on CACSD� IEEE Proceedings� December ����

�PM�� I� Postlethwaite and A� G� J� MacFarlane� A Complex Variable Approach tothe Analysis of Linear Multivariable Feedback Systems� Springer�Verlag� ���

�PMS��� E� Polak� D� Mayne� and D� Stimler� Control system design via semi�in�niteoptimization� A review� Proc� IEEE� ��������������� December ����

�Pol�� E� Polak� An historical survey of computational methods in optimal control�SIAM Rev�� ������������� April ����

�Pol��� E� Polak� Semi�in�nite optimization in engineering design� In A� Fiacco andK� Kortanek� editors� Semi�in�nite Programming and Applications� Springer�Verlag� ����

�Pol�� E� Polak� On the mathematical foundations of nondi�erentiable optimizationin engineering design� SIAM Rev�� ������ March ����

�Pon��� L� Pontryagin� Optimal Regulation Processes� Volume ��� American Mathe�matical Society Translations� � ��

�Pon�� L� Pontryagin� The Mathematical Theory of Optimal Processes� John Wiley� Sons� � ��

�PR�� P� M� Pardalos and J� B� Rosen� Constrained Global Optimization� Algorithmsand Applications� Springer�Verlag� ����

�Pre��� LM��� Precision Motion Controller� National Semiconductor� ���

�PS��� E� Polak and S� Salcudean� On the design of linear multivariable feedbacksystems via constrained nondi�erentiable optimization in H� spaces� IEEETrans� Aut� Control� AC�������� ��� � ���

�PSW��� E� Polak� P� Siegel� T� Wuu� W� Nye� and D� Mayne� delight mimo� Aninteractive� optimization�based multivariable control system design package�In M� Jamshidi and C� J� Herget� editors� Computer�Aided Control SystemsEngineering� North�Holland� ���� Reprinted from IEEE Cont� Sys� Mag�� No�� �Dec� �����

�PW�� E� Polak and Y� Wardi� A nondi�erentiable optimization algorithm for thedesign of control systems subject to singular value inequalities over a frequencyrange� Automatica� ������� ����� ����

�Rab� L� Rabiner� Linear program design of �nite impulse response �FIR� digital�lters� IEEE Trans� Audio and Electroacoustics� ������������� October ����

�Rei��� T� Reiland� Optimality conditions and duality in continuous programming I�Convex programs and a theorem of the alternative� J� Math� Anal� and Appl����������� ����

�RF��� J� R� Ragazzini and G� F� Franklin� Sampled�Data Control Systems� McGraw�Hill� ����

Page 52: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

402 BIBLIOGRAPHY

�RG�� L� Rabiner and B� Gold� Theory and Application of Digital Signal Processing�Prentice�Hall� ����

�Rob��� G� Robel� On computing the in�nity norm� IEEE Trans� Aut� Control� AC�������������� August ���

�Roc�� R� T� Rockafellar� Convex Analysis� Princeton Univ� Press� second edition�����

�Roc�� R� T� Rockafellar� Conjugate Duality and Optimization� Volume � of RegionalConference Series in Applied Mathematics� SIAM� ����

�Roc��� R� T� Rockafellar� The Theory of Subgradients and its Application to Problemsof Optimization� Heldermann Verlag� ����

�Roc�� R� T� Rockafellar� Convex Analysis and Optimization� Pitman� ����

�Ros�� H� H� Rosenbrock� State�space and Multivariable Systems� John Wiley � Sons�����

�RS��� D� Rosenthal and M� Sherman� High performance multibody simulations viasymbolic equation manipulation and Kane�s method� J� Astronautical Sci�ences� ������������ �� �

�SA��� M� G� Safonov and M� Athans� A multiloop generalization of the circle criterionfor stability margin analysis� IEEE Trans� Aut� Control� AC�� �������� ����

�Saf��� M� G� Safonov� Stability and Robustness of Multivariable Feedback Systems�MIT Press� ����

�Saf�� M� G� Safonov� Stability margins of diagonally perturbed multivariable feed�back systems� IEE Proc�� ���D������ � ����

�Sal��� S� Salcudean� Algorithms for Optimal Design of Feedback Compensators� PhDthesis� University of California� Berkeley� �� �

�San��� I� W� Sandberg� A frequency�domain condition for the stability of feedbacksystems containing a single time�varying nonlinear element� Bell Syst� Tech�J�� ������� ��� ��� July � ��

�SB�� C� Slivinsky and J� Borninski� Control system compensation and implemen�tation with the tms������ In K� S� Lin� editor� Digital Signal ProcessingApplications with the tms�� Family� pages ��� � Prentice�Hall� ����

�SB��� S� Sastry and M� Bodson� Adaptive Control� Stability� Convergence� and Ro�bustness� Prentice�Hall� ����

�SBD�� B� Smith� J� Boyle� J� Dongarra� B� Garbow� Y� Ikebe� V� Klema� and C�Moler� Matrix eigensystem routines� eispack guide� Springer�Verlag� �� �

�SD��� M� G� Safonov and J� Doyle� Minimizing conservativeness of robust singularvalues� In S� G� Tzafestas� editor� Multivariable Control� pages ������ D�Reidel� ����

�SFL��� S� C� Shah� M� A� Floyd� and L� L� Lehman� matrix�x� Control design andmodel building CAE capability� In M� Jamshidi and C� J� Herget� editors�Computer�Aided Control Systems Engineering� North�Holland� ����

�Sho��� N� Z� Shor� Minimization Methods for Non�di�erentiable Functions� SpringerSeries in Computational Mathematics� Springer�Verlag� ����

�SL��� D� Schaechter and D� Levinson� Interactive computerized symbolic dynamicsfor the dynamicist� J� Astronautical Sciences� � ����� ����� ����

Page 53: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

BIBLIOGRAPHY 403

�SNT��� Y� Sawaragi� H� Nakayama� and T� Tanino� Theory of Multiobjective Opti�mization� Volume �� of Mathematics in Science and Engineering� AcademicPress� ����

�SR��� M� Sherman and D� Rosenthal� sdexact User�s Manual� Symbolic Dynamics�Inc�� Mountain View� CA� February ����

�SS��� J� Stokes and G� Sohie� Implementation of PID controllers on the Motoroladsp������dsp������ ��� Motorola� Inc�

�Ste�� G� Stein� Generalized quadratic weights for asymptotic regulator properties�IEEE Trans� Aut� Control� AC������� � ���

�SW�� J� Stoer and C� Witzgall� Convexity and Optimization in Finite DimensionsI� Springer�Verlag� ����

�Tan��� A� Tannenbaum� Feedback stabilization of linear dynamical plants with un�certainty in the gain factor� Int� J� Control� �������� � ����

�Tan�� A� Tannenbaum� Modi�ed Nevanlinna�Pick interpolation and feedback stabi�lization of linear plants with uncertainty in the gain factor� Int� J� Control�� ��������� � ����

�TL��� D� Tabak and G� Lipovski� Move architecture in digital controllers� IEEETrans� Comp�� ����������� February ����

�TM��� H� T� Toivonen and P� M� M�akil�a� Computer�aided design procedure for mul�tiobjective LQG control problems� Int� J� Control� ����� �� � ���

�Toi��� H� T� Toivonen� A multiobjective linear quadratic Gaussian control problem�IEEE Trans� Aut� Control� AC������������ March ����

�Tra��a� IEEE� Transducers ��� �th International Conference on Solid�State Sensorsand Actuators� ���

�Tra��b� Transducers� Pressure and Temperature� National Semiconductor� ���

�Tru��� J� G� Truxal� Servomechanism Synthesis through Pole�Zero Con�gurations�Technical Report � �� M� I� T� Research Laboratory of Electronics� Cambridge�Massachusetts� August ����

�Tru��� J� G� Truxal� Automatic Feedback Control System Synthesis� McGraw�Hill�����

�Ver��� M� S� Verma� Coprime fractional representations of stability of non�linearfeedback systems� Int� J� Control� ����������� ����

�Vid�� M� Vidyasagar� Nonlinear Systems Analysis� Prentice�Hall� ����

�Vid��� M� Vidyasagar� Control System Synthesis� A Factorization Approach� MITPress� ����

�Vid��� M� Vidyasagar� Optimal rejection of persistent bounded disturbances� IEEETrans� Aut� Control� AC���� ��������� June �� �

�War��� I� Warnock� Programmable Controllers� Operations and Application� Prentice�Hall International� ����

�Wel�� D� Wells� Guide to GPS Positioning� Canadian GPS Associates� ����

�WH��� E� Wong and B� Hajek� Stochastic Processes in Engineering Systems� Springer�Verlag� ����

�Whi��� P� Whittle� Risk�Sensitive Optimal Control� John Wiley � Sons� ���

Page 54: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

404 BIBLIOGRAPHY

�Wie�� A� Wierzbicki� A mathematical basis for satis�cing decision making� Mathe�matical Modelling� �������� ����

�Wil��� J� C� Willems� The Analysis of Feedback Systems� Volume � of ResearchMonographs� MIT Press� � �

�Wil�� J� L� Willems� The circle criterion and quadratic Lyapunov functions forstability analysis� IEEE Trans� Aut� Control� �������� � ����

�Wol�� W� A� Wolovich� Linear Multivariable Systems� Springer�Verlag� ����

�Wol�� P� Wolfe� A method of conjugate subgradients for minimizing nondi�erentiablefunctions� In M� L� Balinski and P� Wolfe� editors� Math� Programming Study� Nondi�erentiable Optimization� pages ������� North�Holland� ����

�Won��� W� M� Wonham� Linear Multivariable Control� Springer�Verlag� ����

�WSG��� R� A� Walker� S� C� Shah� and N� K� Gupta� Computer�aided engineering�CAE� for system analysis� Proc� IEEE� ���������������� December ����

�YBJ�� D� C� Youla� J� J� Bongiorno� and H� A� Jabr� Modern Wiener�Hopf design ofoptimal controllers�Part I� The single�input�output case� IEEE Trans� Aut�Control� AC�������� February �� �

�YJB�� D� C� Youla� H� A� Jabr� and J� J� Bongiorno� Modern Wiener�Hopf designof optimal controllers�Part II� The multivariable case� IEEE Trans� Aut�Control� AC���������� June �� �

�YN� D� Yudin and A� Nemirovsky� The e�ectiveness of random search in controlproblems� Engineering Cybernetics� ���������� ����

�You��� D� C� Youla� On the factorization of rational matrices� IRE Trans� IT� IT������������ July � ��

�ZA�� V� Zakian and U� Al�Naib� Design of dynamical and control systems by themethod of inequalities� Proc� IEE� ������������� ����

�Zad��� L� A� Zadeh� Optimality and non�scalar�valued performance criteria� IEEETrans� Aut� Control� � �� January � ��

�Zam��a� G� Zames� On the input�output stability on nonlinear time�varying feedbacksystems�Part I� conditions derived using concepts of loop gain� conicity� andpositivity� IEEE Trans� Aut� Control� AC����������� April � �

�Zam��b� G� Zames� On the input�output stability on nonlinear time�varying feedbacksystems�Part II� conditions involving circles in the frequency plane and sectornonlinearities� IEEE Trans� Aut� Control� AC����� ��� � July � �

�Zam��� G� Zames� Feedback and optimal sensitivity� Model reference transforma�tions� multiplicative seminorms� and approximate inverses� IEEE Trans� Aut�Control� AC�� ����������� April ����

�ZD��� L� A� Zadeh and C� A� Desoer� Linear System Theory� The State Space Ap�proach� McGraw�Hill� � �� Reprinted by Krieger� ���

�ZF��� G� Zames and B� A� Francis� Feedback� minimax sensitivity and optimalrobustness� IEEE Trans� Aut� Control� AC���������� ��� May ����

�ZN�� J� Ziegler and N� Nichols� Optimum settings for automatic controllers� ASMETrans�� ����� �� ����

Page 55: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

Index

��relaxed problem� ���� ���kHk�� ��� ���� ���kHk�� ��� ���� ���� ���kHkhankel� ���� ���� ���kHkL� gn

� ���

kHkL� gn� ��

kHkpk gn� �� ���� ���� ��kHkpk step� �� ���� ��kHkrms�w� �� ���kHkrms gn� ��� ���kHkwc� �� ��kuk�� ��� ��kuk�� ��� ��kuk�� �� ��kukaa� �� �kukitae� ��kukrms� �� ����DOF control system� �� ���� �����DOF control system� ��

MAMS� ���

AAbsolute tolerance� ���Achievable design speci�cations� ��� �Actuator� �

boolean� �e ort� ��� �� ��� ���� ��� �� ����

�� ��e ort allocation� ���integrated� ��multiple� ��placement� �referred process noise� �� ��RMS limit� ��� �� ���saturation� ���� ���� ���� ���� ���selection� �� �signal� �

Adaptive control� ��� �� ��Adjoint system� ���

A�necombination� ���de�nition for functional� ���de�nition for set� ���

Amplitude distribution� �� ��Approximation

�nite�dimensional inner� ���nite�dimensional outer� ���inner� ��� ���� ���� ���outer� ��� ���

ARE� ��� ��� ���� ��� �� ���� ���argmin� ���a�shifted H� norm� ���Assumptions� ��� ��

plant� ��Asymptotic

decoupling� ��disturbance rejection� ��tracking� ��� ��

Autocorrelation� vector signal� ��

Average�absolutegain� ��� ���norm� �vector norm� �

Average poweradmittance load� ��resistive load� �

BBandwidth

generalized� ���limit for robustness� ���regulation� ���signal� ���� ���tracking� ���

Bilinear dependence� ��� �Bit complexity� ���Black box model� �Block diagram� �

405

Page 56: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

406 INDEX

Bode plot� ��� ���Bode�s log sensitivity� ���

MAMS system� ���Book

outline� ��purpose� ��

Booleanactuator� �algebra of subsets� ��sensor� �

Branch�and�bound� ��

CCACSD� ��� ��Cancellation

unstable pole�zero� ��Chebychev norm� ��Circle theorem� ��Classical

controller design� � ��� ��� ���� ��optimization paradigm� regulator� ��� ��

Closed�loopcontroller design� ��� ��� ��� ����

��convex speci�cation� ��design� �realizable transfer matrices� ��stability� ��� ��stability� stable plant� �system� ��transfer matrices achieved by stabi�

lizing controllers� ��� ��transfer matrix� ��

Commanddecoupling� ��following� ���input� ��interaction� ��signal� ��

Comparing norms� ��� ��Comparison sensitivity� ���Complementary sensitivity transfer func�

tion� ��Complexity

bit� ���controller� �information based� ���quadratic programs� ���

Computing norms� ���Concave� ���

Conservative design� ���Constrained optimization� ���� ���� ���

��Continuous�time signal� �� ��Control con�guration� �� �Control engineering� �Controllability

Gramian� ���� ��Control law�

irrelevant speci�cation� ��speci�cation�

Controller� ��DOF� �� ���� �� ���� �����DOF� ��adaptive� ��� �� ��assumptions� ��complexity� �� ��decentralized� �diagnostic output� ��digital� ��discrete�time� �� ���estimated�state feedback� ���� ���gain�scheduled� ��� ��H��optimal� ��H� bound� ���implementation� � �� ��LQG�optimal� � ��LQR�optimal� �minimum entropy� ���nonlinear� ��� �� ���� ���� ���observer�based� ���open�loop stable� ���order� ��� ��parameters� ��parametrization� ��PD� � ��� ��PID� � ��� ��rapid prototyping� ��state�feedback� �state�space� ��structure� ��

Controller design� �analytic solution� �challenges� ��classical� � ��� ��� ��convex problem� ��empirical� feasibility problem� �� ��goals� ��modern�� open vs� closed�loop� ��

Page 57: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

INDEX 407

problem� �� ��� ��software� ��state�space� trial and error� ��

Control processor� �� �� ��DSP chips� ��power� ��

Control system� ���DOF� �� ���� �����DOF� ����DOF MAMS� ��� ���architecture� �classical regulator� ��� ��continuous�time� �speci�cations� ��� �testing� �

Control theoryclassical� geometric� �optimal� ��� �state�space�

Convexanalysis� ���combination� ���controller design problem� ��de�nition for functional� ���de�nition for set� ���duality� ���functional� ���inner approximation� ��� ���� ����

���optimization� ���outer approximation� ��set� ���supporting hyperplane for set� ���

Convexitymidpoint rule� ���multicriterion optimization� ���Pareto optimal� ���performance space� ���

Convex optimization� ��� �����relaxed problem� ���� ���complexity� ��cutting�plane algorithm� ���descent methods� ���duality� ���ellipsoid algorithm� ���linear program� ���� ��� ���� ����

���� ���� ��quadratic program� ��� ��� ���stopping criterion� ��

subgradient algorithm� ���upper and lower bounds� ��

Convolution� ��Crest factor� ��Cutting�plane� ���

algorithm� ���algorithm initialization� ���deep�cut� ���

DDamping ratio� ���dB� ��Dead�zone nonlinearity� ���� ���Decentralized controller� �Decibel� ��Decoupling

asymptotic� ��exact� ���

Deep�cut� ���ellipsoid algorithm� ��

Descentdirection� ��� ���method� ���

Describing function� ���� ���Design

closed�loop� �conservative� ���FIR �lters� ���Pareto optimal� � ���� ��� ���procedure� ��trial and error� ��

Design speci�cation� ��� �achievable� ��� �as sets� ��boolean� ��comparing� ��consistent� �families of� �feasible� �hardness� �inconsistent� �infeasible� �nonconvex� ��ordering� ��qualitative� ��quantitative� �robust stability� ���time domain� ���total ordering� �

Diagnostic output� ��� �

Page 58: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

408 INDEX

Di erential sensitivity� � ��versus robust stability� ���� ���� ���

Digitalcontroller� ��signal processing� ��� ���

Directional derivative� ��Discrete�time

plant� ���signal� �� ��

Disturbance� �� �modeling� ��stochastic� ���� ���unknown�but�bounded� ���

Dualfunctional� ��� ���� ���� ���functional via LQG� ���objective functional� ��optimization problems� ���problem� ��� ���

Duality� ��� ���� ���� ���convex optimization� ���for LQG weight selection� ���gap� ���in�nite�dimensional� ��

EEllipsoid� ���� ���Ellipsoid algorithm� ���

deep�cut� ��initialization� ���

Empirical model� �Entropy� ���� ���� ���

de�nition� ���interpretation� ���state�space computation� ���

Envelope speci�cation� �� ���Error

model reference� ���nulling paradigm� ��signal� ��� ��� ��tracking� ��

Estimated�state feedback� ���� ��� ���controller� ���

Estimator gain� ���Exact decoupling� ���Exogenous input� �

FFactorization

polynomial transfer matrix� ���spectral� ��� ���

stable transfer matrix� ���Failure modes� � �� ���False intuition� ��� ���� ��� ��Feasibility problem� �� ���� �

families of� �RMS speci�cation� ���� ��

Feasibility tolerance� ���Feasible design speci�cations� �Feedback

estimated�state� ���� ��� ���linearization� ��� �output� �paradigm� ��perturbation� ���plant perturbations� ���random� ���state� �well�posed� ��� ���

Fictitious inputs� �Finite�dimensional approximation

inner� ��outer� ���

Finite element model� ��FIR� ���

�lter design� ���Fractional perturbation� ���Frequency domain weights� ��� ���Functional

a�ne� ���bandwidth� ���convex� ���de�nition� �dual� ��� ���� ���equality speci�cation� ���� ��general response�time� �inequality speci�cation� �� ���level curve� ��linear� ���maximum envelope violation� �objective� �of a submatrix� ���overshoot� ��quasiconcave� ���quasiconvex� ���� ��� ���� ���relative overshoot� ��relative undershoot� ��response�time� �rise time� �settling time� �subgradient of� ���sub�level set� ���

Page 59: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

INDEX 409

undershoot� ��weighted�max� ��� ���� ���� ���weighted�sum� �� ���� ���� ���

GGain� ��� ��� ���

average�absolute� ��� ���cascade connection� ��feedback connection� ���generalized margin� ���� ���margin� ��� ��� ���� ���peak� ���scaling� ��scheduling� �small gain theorem� ���variation� ���

Generalizedbandwidth� ���gain margin� ���response time� ���stability� ��� ���

Geometric control theory� �Global

optimization� ��� ��� ��positioning system� �� ��

Goal programming� ��Gramian

controllability� ���� ��observability� ���� ���� ��

G�stability� ��

HH� norm� ��

subgradient� ���H��optimal

controller� ��H� norm� ��� ���

bound and Lyapunov function� ��shifted� ���subgradient� ���

Half�space� ���Hamiltonian matrix� ���� �� ���Hankel norm� ���� ���� ���Hardness� �History

closed�loop design� �feedback control� ��� ���stability� ���

Hunting� ���

II�O speci�cation� ��� ��Identi�cation� �� ��� ��� ��Impulse response� ��� ��� ���� ��� ���Inequality speci�cation� ���Infeasible design speci�cation� �Information based complexity� ���Inner approximation� ��� ���� ���� ���

de�nition� ���nite�dimensional� ��

Input� �actuator� �exogenous� ��ctitious� �signal� �

Input�outputspeci�cation� ��� ��transfer function� ��

Integratedactuators� ��sensors� �� ��

Interaction of commands� ��Interactive design� ��Internal model principle� ���Internal stability� ��

free parameter representation� ��with stable plant� �

Interpolation conditions� �� ���� ������

Intuitioncorrect� ���� ���� ��� ���false� ��� ���� ��� ��

ITAE norm� ��

JJerk norm� ��� ���

LLaguerre functions� ��Laplace transform� ��Level curve� ��Limit of performance� ��� ��� ���� ����

��Linear

fractional form� ��� �functional� ���program� ���� ��� ���� ���� ����

���� ��time�invariant system� ��transformation� ��

Linearity consequence� ���� ���

Page 60: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

410 INDEX

Linearly ordered speci�cations� ���� ���Logarithmic sensitivity� ��

MAMS system� ���Loop gain� ��LQG� ��� ��� ��� ���

multicriterion optimization� ���optimal controller� � ��

LQG weightsselection� ���� ���trial and error� ��tweaking� ���� ��via dual function� ��

LQR� � �LTI� �� ��Lumped system� ��Lyapunov equation� ���� ���� ��� ���

��Lyapunov function� ��� ��

MMAMS system� ��

logarithmic sensitivity� ���Margin� ���Matrix

Hamiltonian� ���� �� ���Schur form� ���� �weight� ��� ��

Maximum absolute step� ���Maximum value method for weights� ��M �circle constraint� ���Memoryless nonlinearity� ���Midpoint rule� ���Minimax� ��Minimizer� ���

half�space where it is not� ���Model� �� ��� ��� ��

black box� �detailed� ���empirical� �LTI approximation� �physical� �� ��� ��reference� ���

Modi�ed controller paradigm� �for a stable plant� ���observer�based controller� ���

Multicriterion optimization� �convexity� ���LQG� ���� ���

Multipleactuator� ��sensor� ��

Multi�rate plants� ��� ���

NNeglected

nonlinearities� ���plant dynamics� ���� ��� ���

Nepers� ��Nested family of speci�cations� ���� ���

���Noise� �

white� ��� ���� ���� ���� �� ��Nominal plant� ���Nominal value method for weights� ��Nonconvex

convex approximation for speci�ca�tion� ��

design speci�cation� ��speci�cation� ��� ��

Noninferior speci�cation� Nonlinear

controller� ��� �� ���� ���� ���plant� ��� �� ���� ���� ���� ���

Nonlinearitydead�zone� ���describing function� ���memoryless� ���neglected� ���

Non�minimum phase� ���Nonparametric plant perturbations� ���Norm� ��

kHk�� ��� ���� ���� ��kHk�� ��� ���� ���� ���� ���kHkhankel� ���� ���� ���kHkL� gn

� ���

kHkL� gn� ��

kHkpk gn� �� ���� ���� ��kHkpk step� �� ���� ��kHkrms�w� �� ���kHkrms gn� ��� ���kHkwc� �� ��kuk�� ��� ��kuk�� ��� ��amusing� ��average�absolute value� �Chebychev� ��comparing� ��comparison of� ��computation of� ���� ��de�nition� ��� ��false intuition� ��

Page 61: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

INDEX 411

frequency domain weight� ��gains� ��� ��Hankel norm� ���� ���� ���inequality speci�cation� ���� ��ITAE� ��jerk� ��� ���maximum absolute step� ���MIMO� ���multivariable weight� ��� ��peak� �peak acceleration� ��peak gain� �� ���� ���� ��� ����

��peak�step� �� ��RMS� �RMS gain� ��� ���RMS noise response� �� ���scaling� ��� ��seminorm� ��shifted H�� ���signal� ��SISO� �snap� crackle and pop� ��stochastic signals� time domain weights� ��total absolute area� ��total energy� ��using an average response� ��using a particular response� ��using worst case response� ��vector average�absolute value� �vector peak� ��vector RMS� ��vector signal� ��vector total area� ��vector total energy� ��weight� ��� ��worst case response� �� ���

Notation� ��� ���Nyquist plot� ���

OObjective functional� �

dual� ��weighted�max� ��weighted�sum� �� ���

ObservabilityGramian� ���� ���� ��

Observer�based controller� ���� ���Observer gain� ���

Open�loopcontroller design� ��equivalent system� ���

Operating condition� ��Optimal

control� ��� �controller paradigm� �Pareto� � ���� ���� ���� ��� ���

���� ��Optimization

branch�and�bound� ��classical paradigm� complexity� ��constrained� ���convex� ���cutting�plane algorithm� ���descent method� ���� ��ellipsoid algorithm� ���feasibility problem� ���global� ��� ��linear program� ���� ��� ���� ����

���� ���� ��multicriterion� �� �� ���quadratic program� ��� ��� ���unconstrained� ���

Order of controller� ��� ��Outer approximation� ��� ���

de�nition� ���nite�dimensional� ���

Output� ��diagnostic� ��referred perturbation� ���referred sensitivity matrix� ��regulated� ��sensor� ��

Overshoot� ��� ��� ��

PP� ���Parametrization

stabilizing controllers in state�space����

Pareto optimal� � ���� ���� ��� ������� ��� ���� ��

convexity� ���interactive search� ��

Parseval�s theorem� ��� ���PD controller� � ��� ��Peak

acceleration norm� ��gain from step response� �

Page 62: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

412 INDEX

gain norm� �� ���� ���� ��� ���signal norm� �step� �� ��subgradient of norm� ��vector signal norm� ��

Performancelimit� ��� ��� ���� ��loop� ���speci�cation� �� ��

Performance space� �achievable region� ���convexity� ���

Perturbation� fractional� ���nonlinear� ���� ���output�referred� ���plant gain� ���plant phase� ���singular� ��step response� ��time�varying� ���� ���

Perturbed plant set� ���Phase

angle� ��margin� ���unwrapping� ��variation� ���

Physicalmodel� �units� ��

PID controller� ��� ��Plant� ��

assumptions� ��� ��discrete�time� ���failure modes� ���gain variation� ���large perturbation� ���multi�rate� ���neglected dynamics� ���� ��� ���nominal� ���nonlinear� ��� �� ���� ���� ���� ���parameters� ���perturbation feedback form� ���perturbation set� ���phase variation� ���pole variation� ���� ���� ���relative uncertainty� ��� ���� ���small perturbation� ��standard example� ��� ���� ��� ����

��� ���� ���� ���� ��� �������� ��� ��

state�space� ��� ���strictly proper� ��time�varying� ���� ���transfer function uncertainty� ���typical perturbations� ���

Poleplant pole variation� ���� ���zero cancellation� ��

Polynomial matrix factorization� ���Power spectral density� Predicate� ��Primal�dual problems� ���Process noise

actuator�referred� �Programmable logic controllers� �� ��

Qqdes� ��Q�parametrization� ���� ���� ��� ���

���Quadratic program� ��� ��� ���Quantization error� �Quasiconcave� ���Quasiconvex functional� ���� ��� ����

���relative overshoot� undershoot� �

Quasigradient� ���settling time� ���

RRealizability� ��Real�valued signal� �Reference signal� ��� ��Regulated output� ��Regulation� �� ��� ��� ��

bandwidth� ���RMS limit� ���

Regulatorclassical� ��� ��

Relativedegree� ��overshoot� ��tolerance� ��

Resource consumption� ��Response time� �

functional� �generalized� ���

Riccati equation� ��� ���� �� ���� ���Rise time� �

unstable zero� ���

Page 63: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

INDEX 413

Ritzapproximation� ���� ��� ���

RMSgain norm� ��� ���noise response� �� ���signal norm� �speci�cation� ���� ���vector signal norm� ��

Robustness� �bandwidth limit� ���de�nition for speci�cation� ���speci�cation� � ���� ���

Robust performance� ���� ���� ���Robust stability� ���� ���

classical Nyquist interpretation� ���norm�bound speci�cation for� ���versus di erential sensitivity� ���� ����

���via Lyapunov function� ��

Root locus� ��� ��� �� ��Root�mean�square value� �

SSaturation� ��� ���� ���� ���� ���� ���

actuator� ���� ���� ���Saturator� ���Scaling� ��� ��Schur form� ���� �Seminorm� ��Sensible speci�cation� ��� ���� �� ���

��Sensitivity

comparison� ���complementary transfer function� ��logarithmic� ��� ���matrix� ��output�referred matrix� ���step response� ��� ���transfer function� ��� ���versus robustness� ���� ���� ���

Sensor� �boolean� �dynamics� ���integrated� �� ��many high quality� ��multiple� ��noise� �� ��output� ��placement� �selection� �� �

Seta�ne� ���boolean algebra of subsets� ��convex� ���representing design speci�cation� ��supporting hyperplane� ���

Settling time� �� ��quasigradient� ���

Shifted H� norm� ���� ���Side information� ��� �� ��� ��� ��Signal

amplitude distribution of� �average�absolute value norm� �average�absolute value vector norm�

�bandwidth� ���� ���comparing norms of� ��continuous� �continuous�time� ��crest factor� ��discrete�time� �� ��ITAE norm� ��norm of� ��peak norm� �peak vector norm� ��real�valued� �RMS norm� �size of� ��stochastic norm of� total area� ��total energy� ��transient� �� ��� ��unknown�but�bounded� �� ���vector norm of� ��vector RMS norm� ��vector total area� ��vector total energy� ��

Simulation� �� ��Singing� ��Singular

perturbation� ��� ���structured value� ��value� ���� ���� ���� ���value plot� ���

Sizeof a linear system� ��of a signal� ��

Slew rate� ��� ���� ��limit� �

Small gainmethod� ���� ���� ���

Page 64: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

414 INDEX

method state�space connection� ��theorem� ��� ���

Snap� crackle and pop norms� ��Software

controller design� ��Speci�cation

actuator e ort� ��� ���� ��� ���circle theorem� ��closed�loop convex� ��� ��controller order� ��di erential sensitivity� ��disturbance rejection� ��functional equality� ���functional inequality� �� �� ���input�output� ��� ��jerk� ���linear ordering� ���� ���M �circle constraint� ���model reference� ���nested family� ���� �� ���nonconvex� ��� ��� ��� ���noninferior� norm�bound� ��on a submatrix� ���open�loop stability of controller� ���overshoot� ��� ��Pareto optimal� PD controller� ��peak tracking error� ���� ���performance� ��realizability� ��regulation� ��� ��� ��relative overshoot� ��rise time� �RMS limit� ��� ���� ���� ��robustness� ���� ���sensible� ��� ���� �� ��� ��settling time� �slew�rate limit� ���stability� ���step response� ���� ��step response envelope� �time domain� ���undershoot� ��unstated� ��well�posed�

Spectral factorization� ��� ��� ���Stability� ��

augmentation� �closed�loop� ��� ��controller� ���

degree� ���� ���� ���� ���� ���for a stable plant� ���free parameter representation� ��generalized� ��� ���historical� ���internal� ��modi�ed controller paradigm� �robust� ���speci�cation� ���transfer function� ��� ��� ��transfer matrix� ���� ��transfer matrix factorization� ���using interpolation conditions� ��

���via Lyapunov function� ��via small gain theorem� ��

Stabletransfer matrix� ��

Standard example plant� ��� ���� ������� ��� ���� ���� ���� ������� ���� ��� ��

tradeo curve� ��� ���� ���State�estimator gain� ��State�feedback� �

gain� ���� ��State�space

computing norms� ���� ��controller� ��parametrization of stabilizing con�

trollers� ���plant� ��small gain method connection� ��

Step response� �and peak gain� ��envelope constraint� �interaction� ��overshoot� ��� ��� �overshoot subgradient� ���perturbation� ��relative overshoot� ��sensitivity� ��settling time� ��slew�rate limit� ���speci�cation� ���� ��total variation� ��undershoot� ��

Stochastic signal norm� Stopping criterion� ���� ���

absolute tolerance� ���convex optimization� ��relative tolerance� ��

Page 65: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

INDEX 415

Strictly proper� ��Structured singular value� ��Subdi erential

de�nition� ���Subgradient� ���

algorithm� ���computing� ���de�nition� ���H� norm� ���H� norm� ���in�nite�dimensional� ���peak gain� ��quasigradient� ���step response overshoot� ���tools for computing� ���worst case norm� ���

Sub�level set� ���Supporting hyperplane� ���System

failure� �identi�cation� �� ��� ��� ��linear time�invariant� ��lumped� ��

TTechnology� �Theorem of alternatives� ���Time domain

design speci�cation� ���weight� ��

Tolerance� ���feasibility� ���

Totalenergy norm� ��fuel norm� ��variation� ��

Trackingasymptotic� ��bandwidth� ���error� �� ���� ��peak error� ���� ���RMS error� ���

Tradeo curve� ��� � ���� ���� ���interactive search� ��norm selection� ���rise time versus undershoot� ���RMS regulated variables� ��� ����

���standard example plant� ��� ���� ���surface� � ���

tangent to surface� ��tracking bandwidth versus error� ���

Transducer� ��Transfer function� ��

Chebychev norm� ��G�stable� ��maximum magnitude� ��peak gain� �RMS response to white noise� ��sensitivity� ���shifted� ���stability� ��� ��� ��uncertainty� ���unstable� ��

Transfer matrix� ��closed�loop� ��factorization� ���singular value plot� ���singular values� ���size of� ��stability� ���� ��� ��weight� ��

Transient� �� ��� ��Trial and error

controller design� ��LQG weight selection� ��

Tuning� �rules� � ��

Tv�f�� ��Tweaking� ��

UUnconstrained optimization� ���Undershoot� ��

unstable zero� ���Unknown�but�bounded

model� �signal� ���� ���

Unstablepole�zero cancellation rule� ��� ���transfer function� ��zero and rise time� ���zero and undershoot� ���

VVector signal

autocorrelation� ��

Page 66: Solving the Controller Design Problem - Stanford Universityboyd/lcdbook/out8.pdfSolving the Controller Design Problem In this c hapter w e describ e metho ds for forming and solving

416 INDEX

WWcontr� ���Wobs� ���Weight

a smart way to tweak� ���constant matrix� ��diagonal matrix� ��for norm� ��frequency domain� ��� ���H�� ���informal adjustment� ��L� norm� ���matrix� ��� ��� ��maximum value method� ��multivariable� ��nominal value method� �� ��selection for LQG controller� ����

���time domain� ��transfer matrix� ��tweaking� ��tweaking for LQG� ���� ��vector� �

Weighted�max functional� ��� ���� �������

Weighted�sum functional� �� ���� �������

Well�posedfeedback� ��� ���problem�

White noise� ��� ���� ���� ���� �� ��Worst case

norm� ��response norm� �� ��subgradient for norm� ���

ZZero

unstable� ���