tma4115 matematikk 3 - wiki.math.ntnu.no€¦ · mathematics: the language of description estate...

91
TMA4115 Matematikk 3 Andrew Stacey Norges Teknisk-Naturvitenskapelige Universitet Trondheim Spring 2010

Upload: others

Post on 13-Jul-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

TMA4115 Matematikk 3

Andrew Stacey

Norges Teknisk-Naturvitenskapelige UniversitetTrondheim

Spring 2010

Page 2: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Lecture 17: Suitable for a First–TimeBuyer

Andrew Stacey

Norges Teknisk-Naturvitenskapelige UniversitetTrondheim

12th March 2010

Page 3: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Key Points

I Concrete description of subspaces bycontents.

I Characteristics of a good description:1. Describes unique subspace2. Minimal list of contents

Page 4: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Recap

I Subspace: subset of Rn with sameproperties:1. Add2. Scale3. Zero

I Linear combinations: new vectors from oldI Span of {v1, . . . ,vk }: subspace of vectors

generated from {v1, . . . ,vk }

Page 5: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Mathematics: the Language of Description

Estate Agents: the Manglers of Language

Phrase Meaning

Close to Bus routes Bus-stop right outside yourdoor.

Compact and Bijou Too small for you and thecat.

Deceptively spacious Tardis for sale.

Easy to manage 1 room -10’ square.

Exposed beams Ceiling in need of repair.

Ideal Project Only 4 walls standing.

Secluded More than 3 miles from thenearest McDonalds.

Page 6: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Mathematics: the Language of Description

Estate Agents: the Manglers of Language

Phrase Meaning

Close to Bus routes Bus-stop right outside yourdoor.

Compact and Bijou Too small for you and thecat.

Deceptively spacious Tardis for sale.

Easy to manage 1 room -10’ square.

Exposed beams Ceiling in need of repair.

Ideal Project Only 4 walls standing.

Secluded More than 3 miles from thenearest McDonalds.

Page 7: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Mathematics: the Language of Description

Estate Agents: the Manglers of Language

Phrase

Meaning

Close to Bus routes Bus-stop right outside yourdoor.

Compact and Bijou Too small for you and thecat.

Deceptively spacious Tardis for sale.

Easy to manage 1 room -10’ square.

Exposed beams Ceiling in need of repair.

Ideal Project Only 4 walls standing.

Secluded More than 3 miles from thenearest McDonalds.

Page 8: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Mathematics: the Language of Description

Estate Agents: the Manglers of Language

Phrase

Meaning

Close to Bus routes

Bus-stop right outside yourdoor.

Compact and Bijou

Too small for you and thecat.

Deceptively spacious

Tardis for sale.

Easy to manage

1 room -10’ square.

Exposed beams

Ceiling in need of repair.

Ideal Project

Only 4 walls standing.

Secluded

More than 3 miles from thenearest McDonalds.

Page 9: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Mathematics: the Language of Description

Estate Agents: the Manglers of Language

Phrase Meaning

Close to Bus routes Bus-stop right outside yourdoor.

Compact and Bijou Too small for you and thecat.

Deceptively spacious Tardis for sale.

Easy to manage 1 room -10’ square.

Exposed beams Ceiling in need of repair.

Ideal Project Only 4 walls standing.

Secluded More than 3 miles from thenearest McDonalds.

Page 10: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Describing a Subspace

QuestionWhat makes a good description?

I [ xy ] with x = 2y

I [ xy ] with 2x = 4y

I [ xy ] with x = 2y and xy ≥ 0

I Multiples of [ 21 ]

I Linear combinations of [ 21 ] and [ 4

2 ]

Page 11: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Describing a Subspace

QuestionWhat makes a good description?

I [ xy ] with x = 2y

I [ xy ] with 2x = 4y

I [ xy ] with x = 2y and xy ≥ 0

I Multiples of [ 21 ]

I Linear combinations of [ 21 ] and [ 4

2 ]

Page 12: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Describing a Subspace

QuestionWhat makes a good description?

I [ xy ] with x = 2y

I [ xy ] with 2x = 4y

I [ xy ] with x = 2y and xy ≥ 0

I Multiples of [ 21 ]

I Linear combinations of [ 21 ] and [ 4

2 ]

Page 13: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Description by Contents

W ⊇ {w1,w2, . . . ,wk }

Example

R3⊇W ⊇

147

,258

,369

Pros and ConsPro Concrete

Con Not unique

Page 14: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Description by Contents

W ⊇ {w1,w2, . . . ,wk }

Example

R3⊇W ⊇

147

,258

,369

Pros and ConsPro Concrete

Con Not unique

Page 15: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Description by Contents

W ⊇ {w1,w2, . . . ,wk }

Example

R3⊇W ⊇

147

,258

,369

Pros and ConsPro Concrete

Con Not unique

Page 16: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Description by Contents

W ⊇ {w1,w2, . . . ,wk }

Example

R3⊇W ⊇

147

,258

,369

Pros and ConsPro Concrete

Con Not unique

Page 17: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Good Descriptions

R2⊇

{[10

]}⊇

{[10

],

[01

]}⊇

{[11

],

[−1

1

]}⊇

{[11

],

[−1

1

],

[10

],

[01

]}

QuestionWhich are “good”?

Page 18: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Good Descriptions

R2⊇

{[10

]}⊇

{[10

],

[01

]}⊇

{[11

],

[−1

1

]}⊇

{[11

],

[−1

1

],

[10

],

[01

]}

QuestionWhich are “good”?

Page 19: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Upside-Down Question

Question

What subspace(s) does

147

,258

,369

best describe?

Two Choices

1. R3

2. A certain plane in R3

Reason

The plane is Span

147

,258

,369

.

Page 20: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Upside-Down Question

Question

What subspace(s) does

147

,258

,369

best describe?

Two Choices

1. R3

2. A certain plane in R3

Reason

The plane is Span

147

,258

,369

.

Page 21: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Upside-Down Question

Question

What subspace(s) does

147

,258

,369

best describe?

Two Choices

1. R3

2. A certain plane in R3

Reason

The plane is Span

147

,258

,369

.

Page 22: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Upside-Down Question

Question

What subspace(s) does

147

,258

,369

best describe?

Two Choices

1. R3

2. A certain plane in R3

Reason

The plane is Span

147

,258

,369

.

Page 23: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Describing via Span

LemmaSpan

(v1, . . . ,vk

)is the

smallestsubspace containing

{v1, . . . ,vk }.

To say W = Span(v1, . . . ,vk

)means

1. v1, . . . ,vk ∈W2. Every vector in W is a linear combination of{v1, . . . ,vk }

Explicit description, so very concrete.

Page 24: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Describing via Span

LemmaSpan

(v1, . . . ,vk

)is the

smallestsubspace containing

{v1, . . . ,vk }.

To say W = Span(v1, . . . ,vk

)means

1. v1, . . . ,vk ∈W2. Every vector in W is a linear combination of{v1, . . . ,vk }

Explicit description, so very concrete.

Page 25: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Describing via Span

LemmaSpan

(v1, . . . ,vk

)is the

smallestsubspace containing

{v1, . . . ,vk }.

To say W = Span(v1, . . . ,vk

)means

1. v1, . . . ,vk ∈W2. Every vector in W is a linear combination of{v1, . . . ,vk }

Explicit description, so very concrete.

Page 26: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Time for a Con

Not unique.

Span

135

,246

= Span

135

,024

Which is best? Hard to tell.

Span

135

,246

= Span

135

,246

,024

Which is best? The first! Why? Second hasredundancies.

Can throw out, say,

024 without changing subspace.

Page 27: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Time for a Con

Not unique.

Span

135

,246

= Span

135

,024

Which is best?

Hard to tell.

Span

135

,246

= Span

135

,246

,024

Which is best? The first! Why? Second hasredundancies.

Can throw out, say,

024 without changing subspace.

Page 28: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Time for a Con

Not unique.

Span

135

,246

= Span

135

,024

Which is best? Hard to tell.

Span

135

,246

= Span

135

,246

,024

Which is best? The first! Why? Second hasredundancies.

Can throw out, say,

024 without changing subspace.

Page 29: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Time for a Con

Not unique.

Span

135

,246

= Span

135

,024

Which is best? Hard to tell.

Span

135

,246

= Span

135

,246

,024

Which is best? The first! Why? Second hasredundancies.

Can throw out, say,

024 without changing subspace.

Page 30: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Time for a Con

Not unique.

Span

135

,246

= Span

135

,024

Which is best? Hard to tell.

Span

135

,246

= Span

135

,246

,024

Which is best?

The first! Why? Second hasredundancies.

Can throw out, say,

024 without changing subspace.

Page 31: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Time for a Con

Not unique.

Span

135

,246

= Span

135

,024

Which is best? Hard to tell.

Span

135

,246

= Span

135

,246

,024

Which is best? The first!

Why? Second hasredundancies.

Can throw out, say,

024 without changing subspace.

Page 32: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Time for a Con

Not unique.

Span

135

,246

= Span

135

,024

Which is best? Hard to tell.

Span

135

,246

= Span

135

,246

,024

Which is best? The first! Why?

Second hasredundancies.

Can throw out, say,

024 without changing subspace.

Page 33: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Time for a Con

Not unique.

Span

135

,246

= Span

135

,024

Which is best? Hard to tell.

Span

135

,246

= Span

135

,246

,024

Which is best? The first! Why? Second hasredundancies.

Can throw out, say,

024 without changing subspace.

Page 34: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Minimality: Linear Independence

DefinitionSay that{v1, . . . ,vk }

islinearly independent

if throwing any out changes the span.

Span

135

,246

= Span

135

,246

,024

So

135

,246

,024

not linearly independent.

(we say linearly dependent)

Page 35: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Minimality: Linear Independence

DefinitionSay that{v1, . . . ,vk }

islinearly independent

if throwing any out changes the span.

Span

135

,246

= Span

135

,246

,024

So

135

,246

,024

not linearly independent.

(we say linearly dependent)

Page 36: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Minimality: Linear Independence

DefinitionSay that{v1, . . . ,vk }

islinearly independent

if throwing any out changes the span.

Span

135

,246

= Span

135

,246

,024

So

135

,246

,024

not linearly independent.

(we say linearly dependent)

Page 37: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Minimality: Linear Independence

DefinitionSay that{v1, . . . ,vk }

islinearly independent

if throwing any out changes the span.

Span

135

,246

= Span

135

,246

,024

So

135

,246

,024

not linearly independent.

(we say linearly dependent)

Page 38: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Linear Independence

Is

135

,246

linearly independent?

Throw some out and check span:

Is Span

135

,246

= Span

135

? No. Done? No.

Is Span

135

,246

= Span

246

? No. Done? Yes.

Linearly independent.

Page 39: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Linear Independence

Is

135

,246

linearly independent?

Throw some out and check span:

Is Span

135

,246

= Span

135

?

No. Done? No.

Is Span

135

,246

= Span

246

? No. Done? Yes.

Linearly independent.

Page 40: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Linear Independence

Is

135

,246

linearly independent?

Throw some out and check span:

Is Span

135

,246

= Span

135

? No.

Done? No.

Is Span

135

,246

= Span

246

? No. Done? Yes.

Linearly independent.

Page 41: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Linear Independence

Is

135

,246

linearly independent?

Throw some out and check span:

Is Span

135

,246

= Span

135

? No. Done?

No.

Is Span

135

,246

= Span

246

? No. Done? Yes.

Linearly independent.

Page 42: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Linear Independence

Is

135

,246

linearly independent?

Throw some out and check span:

Is Span

135

,246

= Span

135

? No. Done? No.

Is Span

135

,246

= Span

246

? No. Done? Yes.

Linearly independent.

Page 43: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Linear Independence

Is

135

,246

linearly independent?

Throw some out and check span:

Is Span

135

,246

= Span

135

? No. Done? No.

Is Span

135

,246

= Span

246

?

No. Done? Yes.

Linearly independent.

Page 44: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Linear Independence

Is

135

,246

linearly independent?

Throw some out and check span:

Is Span

135

,246

= Span

135

? No. Done? No.

Is Span

135

,246

= Span

246

? No.

Done? Yes.

Linearly independent.

Page 45: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Linear Independence

Is

135

,246

linearly independent?

Throw some out and check span:

Is Span

135

,246

= Span

135

? No. Done? No.

Is Span

135

,246

= Span

246

? No. Done?

Yes.

Linearly independent.

Page 46: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Linear Independence

Is

135

,246

linearly independent?

Throw some out and check span:

Is Span

135

,246

= Span

135

? No. Done? No.

Is Span

135

,246

= Span

246

? No. Done? Yes.

Linearly independent.

Page 47: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Linear Independence

Is

135

,246

linearly independent?

Throw some out and check span:

Is Span

135

,246

= Span

135

? No. Done? No.

Is Span

135

,246

= Span

246

? No. Done? Yes.

Linearly independent.

Page 48: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

In Pictures

Page 49: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Minimality

The PointSaying

W = Span(v1, . . . ,vk )

with {v1, . . . ,vk } linearly independent says that this isminimal: no simpler description exists.

Remark

1. Still not unique2. “Minimal” not “minimum”

Page 50: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Minimality

The PointSaying

W = Span(v1, . . . ,vk )

with {v1, . . . ,vk } linearly independent says that this isminimal: no simpler description exists.

Remark

1. Still not unique2. “Minimal” not “minimum”

Page 51: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Existence and Uniqueness

Given v1, . . . ,vk ∈W :

I W = Span(v1, . . . ,vk ) every w ∈W is a linearcombination of v1, . . . ,vk

I {v1, . . . ,vk } linearly independent this is unique

036 = 2

147 − 1

258 + 0

369

= 1

147 + 1

258 − 1

369

not linearly independent

Page 52: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Existence and Uniqueness

Given v1, . . . ,vk ∈W :

I W = Span(v1, . . . ,vk ) every w ∈W is a linearcombination of v1, . . . ,vk

I {v1, . . . ,vk } linearly independent this is unique

036 = 2

147 − 1

258 + 0

369

= 1

147 + 1

258 − 1

369

not linearly independent

Page 53: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Existence and Uniqueness

Given v1, . . . ,vk ∈W :

I W = Span(v1, . . . ,vk ) every w ∈W is a linearcombination of v1, . . . ,vk

I {v1, . . . ,vk } linearly independent this is unique

036 = 2

147 − 1

258 + 0

369

= 1

147 + 1

258 − 1

369

not linearly independent

Page 54: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Easier Test

Lemma{v1, . . . ,vk } linearly independent

the only solution ofa1v1 + a2v2 + · · ·+ ak vk = 0

isa1 = a2 = · · · = ak = 0

Proof.Suppose Span(v1, . . . ,vk ) = Span(v1, . . . ,vk−1)Then there are a1, . . . ,ak−1 ∈ R such that

vk =

a1v1 + a2v2 + · · ·+ ak−1vk−1

− vk = 0

Page 55: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Easier Test

Lemma{v1, . . . ,vk } linearly independent

the only solution ofa1v1 + a2v2 + · · ·+ ak vk = 0

isa1 = a2 = · · · = ak = 0

Proof.Suppose Span(v1, . . . ,vk ) = Span(v1, . . . ,vk−1)

Then there are a1, . . . ,ak−1 ∈ R such that

vk =

a1v1 + a2v2 + · · ·+ ak−1vk−1

− vk = 0

Page 56: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Easier Test

Lemma{v1, . . . ,vk } linearly independent

the only solution ofa1v1 + a2v2 + · · ·+ ak vk = 0

isa1 = a2 = · · · = ak = 0

Proof.Suppose Span(v1, . . . ,vk ) = Span(v1, . . . ,vk−1)Then there are a1, . . . ,ak−1 ∈ R such that

vk = a1v1 + a2v2 + · · ·+ ak−1vk−1

− vk = 0

Page 57: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Easier Test

Lemma{v1, . . . ,vk } linearly independent

the only solution ofa1v1 + a2v2 + · · ·+ ak vk = 0

isa1 = a2 = · · · = ak = 0

Proof.Suppose Span(v1, . . . ,vk ) = Span(v1, . . . ,vk−1)Then there are a1, . . . ,ak−1 ∈ R such that

vk =

a1v1 + a2v2 + · · ·+ ak−1vk−1 − vk = 0

Page 58: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Examples

135

,246

,

135

,246

,024

a

135 + b

246 =

[00

]a = b = 0

linearly independent

2

135 −

246 −

024 =

000

not linearly independent (linearly dependent)

Page 59: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Examples

135

,246

,

135

,246

,024

a

135 + b

246 =

[00

]a = b = 0

linearly independent

2

135 −

246 −

024 =

000

not linearly independent (linearly dependent)

Page 60: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Examples

135

,246

,

135

,246

,024

a

135 + b

246 =

[00

]a = b = 0

linearly independent

2

135 −

246 −

024 =

000

not linearly independent (linearly dependent)

Page 61: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Examples

135

,246

,

135

,246

,024

a

135 + b

246 =

[00

]a = b = 0

linearly independent

2

135 −

246 −

024 =

000

not linearly independent (linearly dependent)

Page 62: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Examples

135

,246

,

135

,246

,024

a

135 + b

246 =

[00

]a = b = 0

linearly independent

2

135 −

246 −

024 =

000

not linearly independent (linearly dependent)

Page 63: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Basis

DefinitionFor a subspace W ⊆ Rn,

a subset {v1, . . . ,vk } ⊆W is called abasis

for W if it is linearly independent andW = Span(v1, . . . ,vk )

Example

1.{[

10

],

[01

]}for R2

2.{[

11

],

[−1

1

]}for R2

3.{[

11

],

[10

],

[−1

1

]}not

for R2

Page 64: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Basis

DefinitionFor a subspace W ⊆ Rn,

a subset {v1, . . . ,vk } ⊆W is called abasis

for W if it is linearly independent andW = Span(v1, . . . ,vk )

Example

1.{[

10

],

[01

]}for R2

2.{[

11

],

[−1

1

]}for R2

3.{[

11

],

[10

],

[−1

1

]}not

for R2

Page 65: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Facts

Elementary Facts1. Linearly independent basis for something

2. Linearly dependent cannot be a basis3. 0 in collection not linearly independent

Not So Elementary Facts

1. The size of a basis depends on the subspace not onthe basis. Call this the dimension of the subspace.

2. For a given subspace, any two of the followingproperties of a collection of vectors imply the third

2.1 Linearly indepedent2.2 Spanning (i.e. W = Span(v1, . . . ,vk ))2.3 Right size

Page 66: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Facts

Elementary Facts1. Linearly independent basis for something2. Linearly dependent cannot be a basis

3. 0 in collection not linearly independent

Not So Elementary Facts

1. The size of a basis depends on the subspace not onthe basis. Call this the dimension of the subspace.

2. For a given subspace, any two of the followingproperties of a collection of vectors imply the third

2.1 Linearly indepedent2.2 Spanning (i.e. W = Span(v1, . . . ,vk ))2.3 Right size

Page 67: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Facts

Elementary Facts1. Linearly independent basis for something2. Linearly dependent cannot be a basis3. 0 in collection not linearly independent

Not So Elementary Facts

1. The size of a basis depends on the subspace not onthe basis. Call this the dimension of the subspace.

2. For a given subspace, any two of the followingproperties of a collection of vectors imply the third

2.1 Linearly indepedent2.2 Spanning (i.e. W = Span(v1, . . . ,vk ))2.3 Right size

Page 68: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Facts

Elementary Facts1. Linearly independent basis for something2. Linearly dependent cannot be a basis3. 0 in collection not linearly independent

Not So Elementary Facts

1. The size of a basis depends on the subspace not onthe basis. Call this the dimension of the subspace.

2. For a given subspace, any two of the followingproperties of a collection of vectors imply the third

2.1 Linearly indepedent2.2 Spanning (i.e. W = Span(v1, . . . ,vk ))2.3 Right size

Page 69: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Facts

Elementary Facts1. Linearly independent basis for something2. Linearly dependent cannot be a basis3. 0 in collection not linearly independent

Not So Elementary Facts

1. The size of a basis depends on the subspace not onthe basis. Call this the dimension of the subspace.

2. For a given subspace, any two of the followingproperties of a collection of vectors imply the third

2.1 Linearly indepedent2.2 Spanning (i.e. W = Span(v1, . . . ,vk ))2.3 Right size

Page 70: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Facts

Elementary Facts1. Linearly independent basis for something2. Linearly dependent cannot be a basis3. 0 in collection not linearly independent

Not So Elementary Facts

1. The size of a basis depends on the subspace not onthe basis. Call this the dimension of the subspace.

2. For a given subspace, any two of the followingproperties of a collection of vectors imply the third

2.1 Linearly indepedent2.2 Spanning (i.e. W = Span(v1, . . . ,vk ))2.3 Right size

Page 71: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Facts

Elementary Facts1. Linearly independent basis for something2. Linearly dependent cannot be a basis3. 0 in collection not linearly independent

Not So Elementary Facts

1. The size of a basis depends on the subspace not onthe basis. Call this the dimension of the subspace.

2. For a given subspace, any two of the followingproperties of a collection of vectors imply the third2.1 Linearly indepedent

2.2 Spanning (i.e. W = Span(v1, . . . ,vk ))2.3 Right size

Page 72: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Facts

Elementary Facts1. Linearly independent basis for something2. Linearly dependent cannot be a basis3. 0 in collection not linearly independent

Not So Elementary Facts

1. The size of a basis depends on the subspace not onthe basis. Call this the dimension of the subspace.

2. For a given subspace, any two of the followingproperties of a collection of vectors imply the third2.1 Linearly indepedent2.2 Spanning (i.e. W = Span(v1, . . . ,vk ))

2.3 Right size

Page 73: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Facts

Elementary Facts1. Linearly independent basis for something2. Linearly dependent cannot be a basis3. 0 in collection not linearly independent

Not So Elementary Facts

1. The size of a basis depends on the subspace not onthe basis. Call this the dimension of the subspace.

2. For a given subspace, any two of the followingproperties of a collection of vectors imply the third2.1 Linearly indepedent2.2 Spanning (i.e. W = Span(v1, . . . ,vk ))2.3 Right size

Page 74: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Another Test

Lemma{v1, . . . ,vk }

is linearly independent[v1 · · · vk

]x = 0

has only one solution

Proof.Linearly dependent

a1v1 + · · ·+ ak vk = 0, a1, . . . ,ak not all zero.[v1 · · · vk

] a1...

ak

= 0 �

Page 75: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Another Test

Lemma{v1, . . . ,vk }

is linearly independent[v1 · · · vk

]x = 0

has only one solution

Proof.Linearly dependent

a1v1 + · · ·+ ak vk = 0, a1, . . . ,ak not all zero.[v1 · · · vk

] a1...

ak

= 0 �

Page 76: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Another Test

To test linear independence

use Gauss Elimination!Apply Gauss–Jordan to

[v1 · · · vk

]

I

1 0 · · · 00 1 · · · 0....... . .

...0 0 · · · 1....... . .

...0 0 · · · 0

linearly independent

I Anything else linearly dependentI Bonus: if linearly dependent, the “free” columns can

be removed without changing the span.

Page 77: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Another Test

To test linear independence use Gauss Elimination!

Apply Gauss–Jordan to[v1 · · · vk

]

I

1 0 · · · 00 1 · · · 0....... . .

...0 0 · · · 1....... . .

...0 0 · · · 0

linearly independent

I Anything else linearly dependentI Bonus: if linearly dependent, the “free” columns can

be removed without changing the span.

Page 78: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Another Test

To test linear independence use Gauss Elimination!Apply Gauss–Jordan to

[v1 · · · vk

]

I

1 0 · · · 00 1 · · · 0....... . .

...0 0 · · · 1....... . .

...0 0 · · · 0

linearly independent

I Anything else linearly dependentI Bonus: if linearly dependent, the “free” columns can

be removed without changing the span.

Page 79: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Another Test

To test linear independence use Gauss Elimination!Apply Gauss–Jordan to

[v1 · · · vk

]

I

1 0 · · · 00 1 · · · 0....... . .

...0 0 · · · 1....... . .

...0 0 · · · 0

linearly independent

I Anything else linearly dependent

I Bonus: if linearly dependent, the “free” columns canbe removed without changing the span.

Page 80: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Another Test

To test linear independence use Gauss Elimination!Apply Gauss–Jordan to

[v1 · · · vk

]

I

1 0 · · · 00 1 · · · 0....... . .

...0 0 · · · 1....... . .

...0 0 · · · 0

linearly independent

I Anything else linearly dependentI Bonus: if linearly dependent, the “free” columns can

be removed without changing the span.

Page 81: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Example

147 ,

258 ,

369

Form matrix and apply GE:1 2 34 5 67 8 9

7→1 0 −10 1 20 0 0

Linearly dependent can throw out

369 because

147 + 2

258 +

369 =

000

Page 82: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Example

147 ,

258 ,

369

Form matrix and apply GE:1 2 34 5 67 8 9

7→1 0 −10 1 20 0 0

Linearly dependent can throw out

369 because

147 + 2

258 +

369 =

000

Page 83: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Example

147 ,

258 ,

369

Form matrix and apply GE:1 2 34 5 67 8 9

7→1 0 −10 1 20 0 0

Linearly dependent

can throw out

369 because

147 + 2

258 +

369 =

000

Page 84: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Example

147 ,

258 ,

369

Form matrix and apply GE:1 2 34 5 67 8 9

7→1 0 −10 1 20 0 0

Linearly dependent can throw out

369 because

147 + 2

258 +

369 =

000

Page 85: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Example

147 ,

28

14

,036

,369

Form matrix and apply GE:1 2 0 34 8 3 67 14 6 9

7→1 2 0 30 0 1 −20 0 0 0

Linearly dependent can throw out

28

14

and

369 because

−2

147 +

28

14

=

000 , and 3

147 + −2

036 +

369 =

000

Page 86: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Example

147 ,

28

14

,036

,369

Form matrix and apply GE:1 2 0 3

4 8 3 67 14 6 9

7→1 2 0 30 0 1 −20 0 0 0

Linearly dependent can throw out

28

14

and

369 because

−2

147 +

28

14

=

000 , and 3

147 + −2

036 +

369 =

000

Page 87: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Example

147 ,

28

14

,036

,369

Form matrix and apply GE:1 2 0 3

4 8 3 67 14 6 9

7→1 2 0 30 0 1 −20 0 0 0

Linearly dependent

can throw out

28

14

and

369 because

−2

147 +

28

14

=

000 , and 3

147 + −2

036 +

369 =

000

Page 88: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Example

147 ,

28

14

,036

,369

Form matrix and apply GE:1 2 0 3

4 8 3 67 14 6 9

7→1 2 0 30 0 1 −20 0 0 0

Linearly dependent can throw out

28

14

and

369 because

−2

147 +

28

14

=

000 , and 3

147 + −2

036 +

369 =

000

Page 89: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Circle of Ideas

Matrix

Columns as VectorsSubspace

add lines

take span

find spanning set

Definition

A =[v1 · · · vk

]= Span(v1, . . . ,vk )

Called the column space of A.

Page 90: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Circle of Ideas

Matrix

Columns as VectorsSubspace

add lines

take span

find spanning set

Definition

A =[v1 · · · vk

]= Span(v1, . . . ,vk )

Called the column space of A.

Page 91: TMA4115 Matematikk 3 - wiki.math.ntnu.no€¦ · Mathematics: the Language of Description Estate Agents:the Manglers of Language Phrase Meaning Close to Bus routes Bus-stop right

Summary

I Describe subspaces by spanning setsI Best are linearly independent (bases)I Gather into matrices and use GE to test