5.1 length and dot product in r n
DESCRIPTION
5.1 Length and Dot Product in R n. Chapter 5 Inner Product Spaces. Notes: The length of a vector is also called its norm. Notes:. is called a unit vector. Notes: The process of finding the unit vector in the direction of v is called normalizing the vector v. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/1.jpg)
5-1
5.1 Length and Dot Product in Rn
Notes: 0 iff 0 3
1 2
0 1
vv
vv
v
is called a unit vector.
Notes: The length of a vector is also called its norm.
Chapter 5
Inner Product Spaces
![Page 2: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/2.jpg)
5-2
![Page 3: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/3.jpg)
5-3
![Page 4: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/4.jpg)
5-4
• A standard unit vector in Rn:
1,,0,0,0,,1,0,0,,0,1,,, 21 neee
Ex:
the standard unit vector in R2:
the standard unit vector in R3:
1,0,0,1, ji
1,0,0,0,1,0,0,0,1,, kji
• Notes:
The process of finding the unit vector in the direction of v is called normalizing the vector v.
![Page 5: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/5.jpg)
5-5
Notes: (Properties of distance)
(1)
(2) if and only if
(3)
0),( vud
0),( vud vu
),(),( uvvu dd
![Page 6: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/6.jpg)
5-6
![Page 7: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/7.jpg)
5-7
• Euclidean n-space:
Rn was defined to be the set of all order n-tuples of real nu
mbers. When Rn is combined with the standard operation
s of vector addition, scalar multiplication, vector length,
and the dot product, the resulting vector space is called E
uclidean n-space.
![Page 8: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/8.jpg)
5-8
Dot product and matrix multiplication:
nu
u
u
2
1
u
nv
v
v
2
1
v(A vector in Rn
is represented as an n×1 column matrix)
),,,( 21 nuuu u
![Page 9: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/9.jpg)
5-9
Note: The angle between the zero vector and another vector
is not defined.
![Page 10: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/10.jpg)
5-10
Note: The vector 0 is said to be orthogonal to every vector.
![Page 11: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/11.jpg)
5-11
Note:
Equality occurs in the triangle inequality if and only if
the vectors u and v have the same direction.
![Page 12: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/12.jpg)
5-12
5.2 Inner Product Spaces
• Note:V
Rn
space for vectorproduct inner general,
)for product inner Euclidean (productdot
vu
vu
![Page 13: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/13.jpg)
5-13
Note:
A vector space V with an inner product is called an inner
product space.
, ,V Vector space:
Inner product space: , , , ,V
![Page 14: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/14.jpg)
5-14
![Page 15: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/15.jpg)
5-15
〉〈 uuu ,|||| 2 Note:
![Page 16: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/16.jpg)
5-16
Properties of norm:
(1)
(2) if and only if
(3)
0|||| u
0|||| u 0u
|||||||||| uu cc
![Page 17: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/17.jpg)
5-17
Properties of distance:
(1)
(2) if and only if
(3)
0),( vud
0),( vud vu
),(),( uvvu dd
![Page 18: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/18.jpg)
5-18
Note:
If v is a init vector, then .
The formula for the orthogonal projection of u onto v
takes the following simpler form.
1||||, 2 vvv 〉〈
vvuuv ,proj
![Page 19: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/19.jpg)
5-19
![Page 20: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/20.jpg)
5-20
5.3 Orthonormal Bases: Gram-Schmidt Process
0,
,,, 21
ji
n VS
vv
vvv
Note:
If S is a basis, then it is called an orthogonal basis or an or
thonormal basis.
ji
ji
VS
ji
n
0
1,
,,, 21
vv
vvv
![Page 21: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/21.jpg)
5-21
![Page 22: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/22.jpg)
5-22
![Page 23: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/23.jpg)
5-23
![Page 24: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/24.jpg)
5-24
![Page 25: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/25.jpg)
5-25
![Page 26: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/26.jpg)
5-26
5.4 Mathematical Models and Least Squares
Analysis
![Page 27: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/27.jpg)
5-27
Let W be a subspace of an inner product space V.
(a) A vector u in V is said to orthogonal to W,
if u is orthogonal to every vector in W.
(b) The set of all vectors in V that are orthogonal to W is
called the orthogonal complement of W.
(read “ perp”)
} ,0,|{ WVW wwvv
W W
Orthogonal complement of W:
0(2) 0(1) VV Notes:
![Page 28: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/28.jpg)
5-28
• Notes:
WW
WW
VW
VW
)((3)
(2)
of subspace a is (1)
of subspace a is
0
WW
WW
RyW
xWRV
)( (3)
)0,0( (2)
of subspace a isaxis- (1)Then
axis , If2
2
Ex:
![Page 29: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/29.jpg)
5-29
![Page 30: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/30.jpg)
5-30
![Page 31: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/31.jpg)
5-31
![Page 32: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/32.jpg)
5-32
• Notes:
(1) Among all the scalar multiples of a vector u, the
orthogonal projection of v onto u is the one that is
closest to v.
(2) Among all the vectors in the subspace W, the vector
is the closest vector to v.vWproj
![Page 33: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/33.jpg)
5-33
• The four fundamental subspaces of the matrix A:
N(A): nullspace of A N(AT): nullspace of AT
R(A): column space of A R(AT): column space of AT
![Page 34: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/34.jpg)
5-34
![Page 35: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/35.jpg)
5-35
Least squares problem:
(A system of linear equations)
(1) When the system is consistent, we can use the Gaussian
elimination with back-substitution to solve for x
bx A11 mnnm
(2) When the system is inconsistent, how to find the “best possibl
e” solution of the system. That is, the value of x for which the
difference between Ax and b is small. Least squares solution:
Given a system Ax = b of m linear equations in n unknowns,
the least squares problem is to find a vector x in Rn that mini
mizes with respect to the Euclidean inner produc
t on Rn. Such a vector is called a least squares solution of A
x = b.
bx A
![Page 36: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/36.jpg)
5-36
)(
)of subspace a is ()(
ACSW
RACSACSA
R
MA
m
n
nm
x
x
bx
xb
xb
xb
bx
AAA
AA
ANSACSA
ACSA
projA W
ˆi.e.
0)ˆ(
)())((ˆ
)()ˆ(
ˆLet
(the normal equations of the least squares problem Ax = b)
![Page 37: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/37.jpg)
5-37
• Note:
The problem of finding the least squares solution of
is equal to he problem of finding an exact solution of the
associated normal system .
bx A
bx AAA ˆ
Thm:
For any linear system , the associated normal system
is consistent, and all solutions of the normal system are least sq
uares solution of Ax = b. Moreover, if W is the column space of
A, and x is any least squares solution of Ax = b, then the orthog
onal projection of b on W is
bx A
bx AAA ˆ
xb AW proj
![Page 38: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/38.jpg)
5-38
• Thm:
If A is an m×n matrix with linearly independent column vectors, then for every m×1 matrix b, the linear system Ax = b has a unique least squares solution. This solution is given by
Moreover, if W is the column space of A, then the orthogonal projection of b on W is
bx AAA 1)(
bxb AAAAAW1)(proj
![Page 39: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/39.jpg)
5-39
5.5 Applications of Inner Product Spaces
![Page 40: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/40.jpg)
5-40
![Page 41: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/41.jpg)
5-41
• Note: C[a, b] is the inner product space of all continuous functions on [a, b].
![Page 42: 5.1 Length and Dot Product in R n](https://reader036.vdocument.in/reader036/viewer/2022062322/5681481a550346895db5468b/html5/thumbnails/42.jpg)
5-42