Chapter 5 Eigenvalues and Eigenvectors

Section 5A Invariant Subspaces

5A.1

Suppose and is a subspace of .

(a) Prove that if , then is invariant under .

Proof:

Assume ,

(b) Prove that if , then is invariant under .

Proof:

If , then .

5A.2

Suppose that and are subspaces of invariant under . Prove that is invariant under .

Proof:

Assume , then we have

So

Since , then .

5A.3

Suppose . Prove that the intersection of every collection of subspaces of invariant under is invariant under .

Proof:

Let

where is invariant under .

If , then , then , so .

5A.4

Prove or give a counterexample: If is finite-dimensional and is a subspace of that is invariant under every operator on , then or .

Proof:

The statement is correct. We prove by contradition.

Assume is a subspace and and .

Let be a basis of and we can extends it to a basis of by adding .

Define such that . So is an operator.

Then is not an invariant under . We reach a contradition.

5A.5

Suppose is defined by . Find the eigenvalues of .

Solution:

So does not have any eigenvalues.

5A.6

Define by . Find all eigenvalues and eigenvectors of .

Solution:

Note can either be or .

If , then the eigenvectors are . If , then the eigenvectors are .

5A.7

Define by . Find all eigenvalues and eigenvectors of .

Proof:

Note can either be or .

If , then . Also we have , so , so the eigenvectors for will be for .

If , then , then . Since the eigenvectors cannot be , so , so . And the eigenvectors will be for .

5A.8

Suppose is such that . Prove that if is an eigenvalue of , then or .

Proof:

First we have the assumption that is a vector space over or .

If is a eigenvalue and is a an eigenvector, then

Since , then . Since is a real or complex number, then or .

5A.9

Define by . Find all eigenvalues and eigenvectors of .

Proof:

Assume

Then

If is an eigenvalue and is an eigenvector,

then

So we have

If , then , so the eigenvectors are .

If , then , so there is no eigenvectors.

5A.10

Define by for all . Find all eigenvalues and eigenvectors of .

Proof:

Assume

Then

If is an eigenvalue and is an eigenvector,

then

So we have

If , then , so the eigenvectors are .

If , then we can have to be any positive integer , and then eigenvectors will be for .

5A.11

Suppose is finite-dimensional, , and . Prove that there exists such that is invertible for all such that .

Proof:

Note is either or .

Since is finite-dimensional, then from "5.12 operator cannot have more eigenvalues than dimension of vector space", has at most eigenvalues.

Then we can find such that where is an eigenvalue.

So if , then is not an eigenvalue.

Then from "5.7 equivalent conditions to be an eigenvalue" we know is invertible.

5A.12

Suppose , where and are nonzero subspaces of . Define by for each and each . Find all eigenvalues and eigenvectors of .

Proof:

Assume is an eigenvalue, then

If and , then we must have , then is not an eigenvector, as a result, is not an eigenvalue.

If , then every nonzero vector in is an eigenvector. Indeed, given , then .

If , then every nonzero vector in is an eigenvector. Indeed, given , then .

5A.13

Suppose . Suppose is invertible.

(a) Prove that and have the same eigenvalues.

Proof:

If is an eigenvalue of , then we can find such that . Since is invertible, we can find such that . Since is invertible and , then .

On the other hand, if is an eigenvalue of , and assume such that

Then we have

Since and is invertible, then . So is an eigenvector of .

(b) What is the relationship between the eigenvectors of and the eigenvectors of ?

Proof:

From (a), if is an eigenvector of , then is an eigenvector of .

Conversely, if is an eigenvector of , then is an eigenvector of .

5A.14

Give an example of an operator on that has no (real) eigenvalues.

Solution:

Consider this operator (borrowed from 5.9(b))

Assume is an real eigenvalue, then

Then

If , then so means . Similarly , then , so is not an eigenvalue.

If , then , then , so is still not an eigenvalue.

5A.15

Suppose is finite-dimensional, , and . Show that is an eigenvalue of if and only if is an eigenvalue of the dual operator .

Proof

Given be a basis of and be its dual basis.

Let be the matrix of under basis and be the matrix of under basis .

From "3.132 matrix of is transpose of matrix of ", we know .

Let be the identity matrix, then the matrix for operator is . Similarly, the matrix for operator , is .

Note that .

Then from "5.7 equivalent conditions to be an eigenvalue" we have the following equivalent relation.

The following is my original thought, but it seems not working.

Assume is an eigenvalue of , and let be an eigenvector so .

Note , we can extend it to a basis of by adding

Then we can find a group of linear independent vectors such that .

Then we can find a basis of : .

Together forms a basis of .

Furthermore, we can extend to a basis of by adding vectors

Then consider the dual basis of .

Let

$$

$$

Then

5A.16

Suppose is a basis of and . Prove that if is an eigenvalue of , then

, where denotes the entry in row , column of the matrix of with respect to the basis .

Proof:

Let , and .

Assume is an eigenvector and .

Also assume

So we have

On the other hand

So we have

Compare the coefficients of on both sides, we have

Assume , then we must have . This is because as an eigenvector cannot be .

5A.17

Suppose , and . Prove that is an eigenvalue of 𝑇 if and only if is an eigenvalue of the complexification .

The complexification is defined in Exercise 1B.8 See Exercise 33 in Section 3B for the definition of .

Proof:

Assume is an eigenvalue of and is an eigenvector, then .

Now consider

Since , then . Then is an eigenvector and is an eigenvalue.

Assume is an eigenvalue of and is an eigenvector. Then or .

So one of or is an eigenvector for sure. And is an eigenvalue.

5A.18

Suppose , and . Prove that is an eigenvalue of the complexification if and only if is an eigenvalue of .

Proof:

is an eigenvalue of the complexification , then there is a such that

So we have

Now consider

So is also an eigenvalue of .

The other direction is similar.

5A.19

Show that the forward shift operator defined by

has no eigenvalues.

Proof:

We use contradition.

Assume is an eigenvalue and is an eigenvector So we can find .

Also

If , then , so we have contradition.

If , then since , we have , similarly, , we reach a contradition.

So has no eigenvalues.

5A.20

Define the backward shift operator by

(a) Show that every element of is an eigenvalue of .

Proof:

Let .

If , then is an eigenvector.

If , then is an eigenvector.

(b) Find all eigenvectors of .

Solution:

From part (a), the eigenvectors are with and .

5A.21

Suppose is invertible.

(a) Suppose with . Prove that is an eigenvalue of if and only if is an eigenvalue of .

Proof:

Since , then an eigenvalue of .

The reverse side is similar.

(b) Prove that and have the same eigenvectors.

Proof:

The proof in (a) already showed if is an eigenvector of , it's also a eigenvector of and vice versa.

5A.22

Suppose and there exist nonzero vectors and in such that

Prove that 3 or βˆ’3 is an eigenvalue of .

Proof:

If , then , since , then is an eigenvalue.

If , then consider

Since , then . So is an eigenvalue.

5A.23

Suppose is finite-dimensional and . Prove that and have the same eigenvalues.

Proof:

If is an eigenvalue of and is an eigenvector such that .

Then we have .

If , then is an eigenvalue of .

If , then , then we need to show .

If is invertible, then we can find such that . Note can not be since . Then . So .

If is not invertible, then we can find , such that . Then , so .

In any case, . And is also an eigenvalue of .

The reverse side is similar.

5A.24

Suppose is an -by- matrix with entries in . Define by , where elements of are thought of as -by- column vectors.

(a) Suppose the sum of the entries in each row of equals . Prove that is an eigenvalue of .

Proof:

Consider the vector

So and is an eigenvalue of .

(b) Suppose the sum of the entries in each column of equals . Prove that is an eigenvalue of .

Proof:

Consider is the dual map of in . Then its matrix under dual basis is . Then the sum of the entries in each row of equals . Then we can apply part (a) and know is an eigenvalue of .

No we use the Exercise 5A.15 in this section which states is an eigenvalue of if and only if is an eigenvalue of the dual operator . And then we know is an eigenvalue of .

5A.25

Suppose and are eigenvectors of such that is also an eigenvector of . Prove that and are eigenvectors of corresponding to the same eigenvalue.

Proof:

Assume

Then

If , then and is independent, so .

Then , we have an contradition.

So .

5A.26

Suppose is such that every nonzero vector in is an eigenvector of . Prove that is a scalar multiple of the identity operator.

Proof:

Consider , and their eigenvalues are .

If , then , then . Then .

Since then , i.e. .

If , then is also an eigenvector of . From the last Exercise, we know .

So for any , . Then is a scalar multiple of the identity operator.

5A.27

Suppose that is finite-dimensional and . Suppose is such that every subspace of of dimension is invariant under . Prove that is a scalar multiple of the identity operator.

Proof:

Let . Consider , we can extend to a basis of by adding .

Assume

If , then let . is an invariant of .

So . Since can be represented by uniquely, we have .

Similarly we can show . So is an eigenvector.

That means every vector is an eigenvector of .

From last Exercise, we know is a scalar multiple of the identity operator.

5A.28

Suppose is finite-dimensional and . Prove that has at most distinct eigenvalues.

Proof:

We prove by contradition. Assume there are more than , then there are a least nonzero eigenvalues.

Let , we can find eigenvectors with different eigenvalues, i.e.

So we reached an contradition.

5A.29

Suppose and , , and are eigenvalues of . Prove that there exists such that .

Proof:

, , and are eigenvalues of , and from 5.12, we know operator cannot have more eigenvalues than dimension of vector space. Since , then cannot have other eigenvalues, so is not an eigenvalue of .

Since is not an eigenvalue of , then is invertible. Then we can find such that .

5A.30

Suppose and . Suppose πœ† is an eigenvalue of . Prove that πœ† = 2 or πœ† = 3 or πœ† = 4.

Proof:

We prove by contradition. Assume is an eigenvalue of , where . If is an eigenvector and , then

Since , then .

But this contradicts to the fact .

So or or .

5A.31

Give an example of such that .

Proof:

Consider the matrix of is

Then since then .

5A.32

Suppose has no eigenvalues and . Prove that .

Proof:

Since has no eigenvalues then are invertible. So is .

So for any , we can find , such that

So .

So , then .

5A.33

Suppose and is a positive integer.

(a) Prove that is injective if and only if is injective.

Proof:

Assume is injective and if , then , we have . Similarly , so , That means is injective.

Assume then , so , then is injective.

(b) Prove that is surjective if and only if is surjective.

Proof:

We prove by induction. First, is surjective. Assume is surjective, and given .

Since is surjective, we can find such that . Since is also surjective, we can find such that , then .

So is also surjective. Then we finish the induction.

is surjective, and given . We can find such that , then we have .

5A.34

Suppose is finite-dimensional and . Prove that the list is linearly independent if and only if there exists such that are eigenvectors of corresponding to distinct eigenvalues.

Proof:

It is an immediate results from "5.11 linearly independent eigenvectors".

Since is finite-dimensional, and is linearly independent, we can extend it to a basis of by adding .

Let and , then is a linear map and are eigenvectors of corresponding to distinct eigenvalues

5A.35

Suppose that is a list of distinct real numbers. Prove that the list is linearly independent in the vector space of real-valued functions on 𝐑.

Hint: Let , and define an operator by . Find eigenvalues and eigenvectors of .

Proof:

Based on the hint, is a linear operator of . Also note from calculus, we know

Then are eigenvectors with different eigenvalues.

From "5.11 linearly independent eigenvectors", we know is linearly independent.

5A.36

Suppose that is a list of distinct positive numbers. Prove that the list is linearly independent in the vector space of real-valued functions on 𝐑.

Proof:

We know that is a linear operator of .

Also note from calculus, we know

Since are distinct positive numbers, so are also distinct.

From "5.11 linearly independent eigenvectors", we know is linearly independent.

5A.37

Suppose is finite-dimensional and . Define by for each . Prove that the set of eigenvalues of equals the set of eigenvalues of .

Proof:

Assume is an eigenvalue of . Then we can find , such that . We need to fine such that .

Let be a basis of , let , then .

So .

Now assume is an eigenvalue of , then we can find , such that .

Since , we can find such that . Let , then

So is an eigenvalue of .

5A.38

Suppose is finite-dimensional, , and is a subspace of invariant under . The quotient operator is defined by

for each .

(a) Show that the definition of makes sense (which requires using the condition that is invariant under 𝑇) and show that is an operator on .

Proof:

Assume , then from "3.101 two translates of a subspace are equal or disjoint", we know .

So is well defined.

Next, we will prove is linear map.

First

Second

(b) Show that each eigenvalue of is an eigenvalue of .

Proof:

Assume is an eigenvalue of . Then is not injective, so we can find such that , that means we can find such that .

Since is invariant under , so we can consider limited on , i.e. .

If is not invertible, we can find and , such that , since . Then . So is eigenvalue of .

If is invertible, we can find such that , then we also have .

Since , we have . And .

Therefore, is an eigenvalue of .

5A.39

Suppose is finite-dimensional and . Prove that has an eigenvalue if and only if there exists a subspace of of dimension that is invariant under .

Proof:

Let be a invariant space under and .

Then consider the quotient space and the operator on it defined in the last exercise.

Since , then has an eigenvalue. From the previous exercise part (b), each eigenvalue of is an eigenvalue of . So has an eigenvalue.

We will use induction. Let . First if , then is invariant and it's dimension is . The statement is true.

Now assume the statement holds for all , and we will prove when .

Assume is an eigenvalue, consider the linear mapping .

Consider . From "5.18 null space and range of are invariant under ", we know is invariant under .

Since is not surjective, then

If , then we are done.

If , then from fundamental theorem of linear maps (3.21), we know .

Then we can find which are linear independent.

Let

Now we can use exercise 5A.38 and consider the quotient space and its operator .

Note that is an eigenvalue of and is an eigenvector since

Since , then . And has an eigenvalue , so we can apply the induction and get an invariant subspace and .

Now assume is a basis of .

Then we can cosider the space .

Since is invariant under , then we have

And since , it means

Also . So is invariant under .

Now if

So are linear independent.

The , this completes the induction.

Here is the anwser from AI:

Let be an eigenvalue of and let . By 5.18, is invariant under . Since is not surjective ( is an eigenvalue, so is not injective, and is finite-dimensional), .

Case 1: . Then is the desired invariant subspace.

Case 2: .

Since is invariant under , the quotient operator is well-defined. For any :

So .

Let be the preimage of under the quotient map .

Then is invariant under , for ,

Then note and

So .

5A.40

Suppose and is invertible. Suppose is a polynomial. Prove that

Proof:

Note since is invertible, then .

So .

If

Then

5A.41

Suppose and is a subspace of invariant under . Prove that is invariant under for every polynomial .

Proof:

We use the induction to show is invariant under . Since is invariant under , assume is invariant under .

For any , since , then , so is invariant under .

Then given any , .

So is invariant under for every polynomial .

5A.42

Define by .

(a) Find all eigenvalues and eigenvectors of 𝑇.

Proof:

For any such that , is an eigenvalue, because let be the ith item of standard basis of .

Since , then can only have distinct eigenvalues. Then we found all eigenvalue.

If is an eigenvector with eigenvalue of , then

so with . That's all eigenvectors of .

(b) Find all subspaces of that are invariant under .

Solution:

Assume is invariant under and and , let

If , we want to show . If when , then , we are done.

Other we have some with .

Since is invariant subspace, then , so we have . We also have

So, for , but . For other , if then . If , then .

So the number of non zero coefficients is reduced by . By continuing this process, we can show .

That means , on the other hand . So .

That means all subspaces of that are invariant under are the form of .

5A.43

Suppose that is finite-dimensional, , and . Prove that .

Proof:

Assume .

One strategy is that: since , we should prove .

We will use the results from section about next section, i.e. section 5.3.

Assume is the minimal polynomial of . Then from 5.22 we know .

Given any , from 4.9 division algorithm for polynomials, we know we can find such that , where .

That means , since , then .

Since , then we have

Since , then .

Another strategy (not working so far) is we should find some such that or is not trivial invariant subspace.

We consider the . Since we know from exercise 5A.41, is invariant under , we want to find a operator such that is not invariant under .

Case 1: , then , then . Let be linear independent, then let , then .

Case 2: , we can find a basis of : . We can also extend it to a basis of by adding . Let , then is not invariant under .

Section 5B The Minimal Polynomial

5B.1

Suppose . Prove that is an eigenvalue of if and only if or is an eigenvalue of .

Proof:

Assume is an eigenvector and . Then we have .

If , then is an eigenvalue and is an eigenvector.

If , let . We have . Then is an eigenvalue and is an eigenvector.

If is an eigenvalue and is an eigenvector such that , then

So is an eigenvalue of and is an eigenvector. Similarly for the case when is an eigenvalue of .

5B.2

Suppose is a complex vector space and has no eigenvalues. Prove that every subspace of invariant under is either or infinite- dimensional.

Proof:

Assume is subspace that is invariant under . Then we can restrict under to get . Then is an operator on .

Assume is a finite-dimensional space.

Then from "5.19 existence of eigenvalues", it must have an eigenvalue and an eigenvector of such that .

But since , then we also have . This means has an eigenvalue and an eigenvector of .

Then we reached an contradition. So if , then is infinite-dimensional.

5B.3

Suppose is a positive integer and is defined by

anwser the following:

(a) Find all eigenvalues and eigenvectors of .

Solution:

Assume is an eigenvalue and is an eigenvector,

Then

Then we have

If , then any satisfy , is an eigenvector. So if , then , then is not an eigenvalue.

If , then and .

So in summary, there are 2 possible eigenvalues when :

  1. , and satisfy
  2. , and with .

if , then only case 2 is valid.

(b) Find the minimal polynomial of 𝑇.

Solution:

We first assume .

Let be the minimal polynomial of .

From "5.27 eigenvalues are the zeros of the minimal polynomial", we know

This means is a multiple of .

Now we consider applied on where is one of the standard basis.

Then for any . That means .

Then from "5.29 is a polynomial multiple of the minimal polynomial", we know is a multiple .

Since is a monic polynomial, and we must have .

Now we assume . In this case because . so . On the other hand is a zero of so . So .

5B.4

Suppose , and 𝛼 ∈ 𝐂. Prove that 𝛼 is an eigenvalue of 𝑝(𝑇) if and only if 𝛼 = 𝑝(πœ†) for some eigenvalue πœ† of 𝑇.

Proof:

Consider the polynomial . And consider . Since is an eigenvalue of , .

From "5.18 null space and range of are invariant under ", we know is invariant under . And then we can restrict on to get .

Let be the minimal polynomial of . Since is on , from "5.29 is a polynomial multiple of the minimal polynomial", we have

Since , from fundamental theorem of algebra, we can find one of its zero, say .

So . Since , then is not a multiple of , then is not on again from 5.29. We can find , such that . Let , then we have .

Since , then we have , so , i.e. . So is an eigenvalue of .

Since and is a zeor of , we have .

If , and , then

So is an eigenvalue of .

5B.5

Give an example of an operator on that shows the result in Exercise 4 does not hold if 𝐂 is replaced with 𝐑.

Solution:

Consider is an operator, it rotates a vector by 90 degree counterclock-wise.

So .

So , then if we reuse the symbol in exercise 4, we have , then it's not possible to find a real number such that .

5B.6

Suppose is defined by . Find the minimal polynomial of .

Solution:

Consider

And

That means and .

So . so is a multiple of minimal polynomial.

On the other hand, if is , then

This is no possible, so .

So is the minimal polynomial.

5B.7

(a) Give an example of such that the minimal polynomial of does not equal the minimal polynomial of .

Solution:

Consider and .

Then so , then the minimal polynomial of is .

On the other hand,

, so , and , so the minimal polynomial of is .

(b) Suppose is finite-dimensional and . Prove that if at least one of is invertible, then the minimal polynomial of equals the minimal polynomial of .

Hint: Show that if 𝑆 is invertible and 𝑝 ∈ 𝒫(𝐅), then .

Proof:

Assume is invertible. is the minimal polynomial of . is the minimal polynomial of .

We will show and .

Just use exercise 5A.40,

Then use "5.29 is a polynomial multiple of the minimal polynomial", we know is an multiple of .

On the other hand,

So is a multiple of .

In summary, .

5B.8

Suppose is the operator of counterclockwise rotation by . Find the minimal polynomial of .

Because , the degree of the minimal polynomial of is at most . Thus the minimal polynomial of is not the tempting polynomial , even though .

Solution:

We write the standard basis in polar form

Then note

Similarly,

So .

On the other hand, since is a rotation, does not have eigenvalue, so the minimal polynomial cannot be degree 1.

Therefore, the minimal polynomial is .

5B.9

Suppose is such that with respect to some basis of , all entries of the matrix of are rational numbers. Explain why all coefficients of the minimal polynomial of are rational numbers.

Proof: unsolved.

5B.10

Suppose is finite-dimensional, , and . Prove that

for all integers .

Proof:

Let be the minimal polynomial of , from the polynomial division algorithm, we know given , we can find such that

with . So . Let .

So we have

So That means

On the other hand, since , we have

So we have

5B.11

Suppose is a two-dimensional vector space, , and the matrix of with respect to some basis of is

Prove that

(a) Show that .

Proof:

So .

(b) Show that the minimal polynomial of equals

Proof:

Assume the minimal polynomial of is .

If then assume .

So , .

If , then from part (2) we know , since minimal polynomial is unique, then is the minimal polynomial.

5B.12

Define by . Find the minimal polynomial of .

Proof:

Let be the minimal polynomial of .

Let be the standard basis of . Then note , then is an eigenvalue of .

So from "5.27 eigenvalues are the zeros of the minimal polynomial", part (b) has the form of . with .

On the other hand, , so .

5B.13

Suppose and . Prove that there exists a unique such that and is less than the degree of the minimal polynomial of .

Proof:

Let be the minimal polynomial of , from the division algorithm of polynomials, we know we can find unique such that

and , then

For the uniqueness, if , and , then . Furthermore, , since is the minimal polynomial of , then has to be .

5B.14

Suppose is finite-dimensional and has minimal polynomial . Find the minimal polynomial of .

Solution:

First note that

Then we have

Since is invertible, so is . Then we have

.

If we can find a polynomial with degree less than that can nullify , then we can use similar approach to find a polynomial with degree less than to nullify which contradicts the fact that minimal polynomial of has degree .

5B.15

Suppose is a finite-dimensional complex vector space with and . Define by

Prove that is not a continuous function.

Proof:

Let . Since is a finite-dimensional complex vector space, then from "5.19 existence of eigenvalues", we know has an eigenvalue, say .

From "5.12 operator cannot have more eigenvalues than dimension of vector space", we know can have at most distinct eigenvalues, so we can find a neighborhood of , , such that if and , then is not an eigenvalue.

For these , is invertible, so . On the other hand, since , and .

So is not continuous at .

5B.16

Suppose . Let be the operator on whose matrix (with respect to the standard basis) is

Here all entries of the matrix are except for all on the line under the diagonal and the entries in the last column (some of which might also be ). Show that the minimal polynomial of is the polynomial.

Proof:

Let

Consider . And note

So

i.e. .

Furthermore, notice for

i.e. . This means .

Also, since , so are independent, then it's not possible to find a polynomial with , such that . Otherwise , which is not possible.

So the minimal polynomial of is .

5B.17

Suppose is finite-dimensional, , and is the minimal polynomial of . Suppose . Show that the minimal polynomial of is the polynomial defined by .

Proof:

First

Now assume there is another monic polynomial with and

Then let , then is also a monic polynomial such that .

Also .

This is contradictary to the fact that is the minimal polynomial.

So is the minimal polynomial of .

5B.18

Suppose is finite-dimensional, , and is the minimal polynomial of . Suppose . Show that the minimal polynomial of is the polynomial defined by .

Proof:

let , and

Then

Also

So is monic.

Now assume satisfy and .

Then

Since , so , then ,

Let .

So we found a monic polynomial with and .

This is contradictary to the fact that is the minimal polynomial.

So the minimal polynomial of is the polynomial defined by .

5B.19

Suppose is finite-dimensional and . Let be the subspace of defined by

Prove that equals the degree of the minimal polynomial of .

Proof:

Let be the minimal polynomial of . And . Given any , using the "4.9 division algorithm for polynomials", we know we can find such that

with .

The use "5.17 multiplicative properties", we know

So

So .

Since , then can be represented by .

So . so . So

On the other hand, are linear independent. Otherwise, we can find such that they are not all 0 and

That means we find another polynomial with degree less than such that it's 0, which contradicts the assumption that is the minimal polynomial.

Since are linear independent, then .

In summary, .

5B.20

Suppose is such that the eigenvalues of 𝑇 are 3, 5, 8. Prove that .

Proof:

Let be the minimal polynomial of . From "5.22 existence, uniqueness, and degree of minimal polynomial", .

From "5.27 eigenvalues are the zeros of the minimal polynomial" we know .

From "4.6 each zero of a polynomial corresponds to a degree-one factor" we know .

Since , or .

Case 1: , then . Then is a multiple of .

Case 2: , then and .

Use 5.27 again, we know is an eigenvalue of , so . In any case, is a multiple of .

Then we can use 5.29 to conclude .

5B.21

Suppose is finite-dimensional and . Prove that the minimal polynomial of has degree at most .

If , then this exercise gives a better upper bound than 5.22 for the degree of the minimal polynomial of .

Proof:

Let . Let , then consider . Since is invariant under , so is well defined.

Let be the minimal polynomial of , then from 5.22, . Consider . We would like to show .

Given ,

case 1: , then .

case 2: , then , so . Also, since , then , so .

So in summary, .

Then from 5.29, is a multiple of minimal polynomial. Then the minimal polynomial of has degree at most .

5B.22

Suppose is finite-dimensional and . Prove that is invertible if and only if .

Proof:

Let

So has an inverse mapping: .

From 5.32 not invertible ⟺ constant term of minimal polynomial of is 0 we know if is the minimal polynomial, then

where , so

5B.23

Suppose is finite-dimensional and . Let . Prove that if , then is invariant under .

Proof:

Let .

We only need to prove .

Since are linear dependent, we can find

and are not all .

Let be the biggest integer such that . So we have

Apply on both sides we have

5B.24

Suppose is a finite-dimensional complex vector space. Suppose is such that and are eigenvalues of and that has no other eigenvalues. Prove that .

Proof:

Let be the minimal polynomial of . From 5.27 eigenvalues are the zeros of the minimal polynomial (b)

where is a list of all eigenvalues of , possibly with repetitions.

So . So .

If , then which is not possible, so . Similarly .

Then is a multiple of . So .

5B.25

Suppose is finite-dimensional, , and is a subspace of that is invariant under .

(a) Prove that the minimal polynomial of is a polynomial multiple of the minimal polynomial of the quotient operator .

Proof:

Assume the minimal polynomial of is , given any , we need to prove .

Since , then

Then is a zero operator on .

Then from 5.29 is a polynomial multiple of the minimal polynomial, we can conclude is a polynomial multiple of the minimal polynomial of the quotient operator .

(b) Prove that

(minimal polynomial of ) Γ— (minimal polynomial of )

is a polynomial multiple of the minimal polynomial of 𝑇.

Proof:

Assume minimal polynomial of is and minimal polynomial of is .

We need to prove, given any , .

First since the minimal polynomial of is . Then . On the other hand, . Thus it means .

Since the minimal polynomial of is , then .

Since is invariant under , then from exercise 5A.41 we know is also invariant under . Thus for any , . So .

Then again from 5.29 is a polynomial multiple of the minimal polynomial, we can conclude the statement.

5B.26

Suppose is finite-dimensional, , and is a subspace of that is invariant under . Prove that the set of eigenvalues of equals the union of the set of eigenvalues of and the set of eigenvalues of .

Proof:

Let the minimal polynomial of be , minimal polynomial of is and minimal polynomial of is .

Assume is a eigenvalue of . Then is a zero of . From the part (b) of exercise 5B.25, is a multiple of , then , so or .

Then from 5.27, is either an eigenvalue of or an eigenvalue of .

From exercise 5A.38, we know an eigenvalue of is an eigenvalue of .

Assume is an eigenvalue of , then we can find a and such that . Since , then .

So is an eigenvalue of .

5B.27

Suppose , is finite-dimensional, and . Prove that the minimal polynomial of equals the minimal polynomial of . The complexification was defined in Exercise 33 of Section 3B.

Proof:

Let be the minimal polynomial of and be the minimal polynomial of .

Note that , so

Then from the linearity of , we can see

So given any

So is a multiple of .

On the other hand

So is a multiple of .

Then

5B.28

Suppose is finite-dimensional and . Prove that the minimal polynomial of equals the minimal polynomial of .

Proof:

One way to think this problem is consider the matrix of and . They are transpose to each other.

But we will do another way. Note that given any linear functional , we have

And then use the distribution law of the composition of the linear mapping, we have

First assume is the minimal polynomial of . And assume is the minimal polynomial of .

Then given any linear functional and ,

So is a multiple of .

Now assume is a basis of and is the dual basis. And assume

On one hand

On the other hand

So , i.e. .

So is a multiple of .

Based on this, .

5B.29

Show that every operator on a finite-dimensional vector space of dimension at least two has an invariant subspace of dimension two.

Proof:

Consider is the operator, and is its minimal polynomial.

We distinguish the following cases:

case : If , then every vector is a eigenvector of . Since , then we can pick two linear independent vectors . Then is invariant with dimension .

case : , we can assume . This is because if , we can use "4.16 factorization of a polynomial over ". If , we can use "4.13 fundamental theorem of algebra, second version".

Consider . It cannot be because otherwise will be the minimal polynomial.

Then assume we can find , such that is not an eigenvector of , then are linearly independent. Furthermore, since , we have . So is invariant with dimension .

Now assume all are eigenvectors. If for all , , then will be the minimal polynomial, which is contradictary to our assumption that is the minimal polynomial.

So we can find which are 2 different eigenvalues and we can find 2 eigenvectors , such that .

From 5.11 linearly independent eigenvectors, we know are linear independent, then is invariant with dimension .

Section 5C Upper-Triangular Matrices

5C.1

Prove or give a counterexample: If and has an upper-triangular matrix with respect to some basis of , then has an upper-triangular matrix with respect to some basis of .

Solution:

Consider . And be the linear operator that rotates by degree counterclockwise.

Since does not have an eigenvalue, then does not have a 1-dimensional subspace that is invariant under w.r.t any basis of . Therefore, it's not possible that has an upper-triangular matrix w.r.t any basis of .

On the other hand, the matrix of w.r.t the standard basis is

which is an upper-triangular matrix.

5C.2

Suppose and are upper-triangular matrices of the same size, with on the diagonal of and on the diagonal of .

(a) Show that is an upper-triangular matrix with on the diagonal.

Proof:

Let , then the diagonal of on the th row and th column is

(b) Show that is an upper-triangular matrix with on the diagonal.

Proof

Let , then the diagonal of on the th row and th column is

Note that if , and if , so .

5C.3

Suppose is invertible and is a basis of with respect to which the matrix of is upper triangular, with on the diagonal. Show that the matrix of is also upper triangular with respect to the basis , with

on the diagonal.

Proof:

First, from "5.41 determination of eigenvalues from upper-triangular matrix", are the eigenvalues of . Since is invertible, then is not an eigenvalue of . So .

Then is well defined.

Next, we show if is invariant under and is invertible, then is invariant under .

Let , and consider . Since is invertible, then is injective, then is also injective. So is invertible. Then we can find such that . then we have .

So . Then is invariant under .

Now let . From "5.39 conditions for upper-triangular matrix", is invariant under , then is also invariant under , then again use 5.39, The matrix of with respect to is upper triangular.

Let on the diagonal. Note , so , thne .

For ,

Where , then

Since is invariant under , then . Then we must have , i.e. .

5C.4

Give an example of an operator whose matrix with respect to some basis contains only 's on the diagonal, but the operator is invertible. This exercise and the exercise below show that 5.41 fails without the hypothesis that an upper-triangular matrix is under consideration.

Proof:

Consider the vector space is , and the operator is rotation counterclockwise by 90 degree. And the basis is the standard basis, .

. So

It's invertible because its inverse is rotation clockwise by 90 degree.

5C.5

Give an example of an operator whose matrix with respect to some basis contains only nonzero numbers on the diagonal, but the operator is not invertible.

Proof:

Consider the vector space is , and the operator is defined as

Since it's not injective, it's not invertible.

Also the

5C.6

Suppose , is finite-dimensional, and . Prove that if , then has a -dimensional subspace invariant under .

Proof:

Use "5.47 if 𝐅 = 𝐂, then every operator on 𝑉 has an upper-triangular matrix", then for the operator , we can find a basis , such that is upper-triangular.

Then use "5.39 conditions for upper-triangular matrix", we know is invariant under and its dimension is .

5C.7

Suppose is finite-dimensional, , and .

(a) Prove that there exists a unique monic polynomial of smallest degree such that .

Proof:

Let and then the following vectors must be linear dependent

Then we can find the smallest , such that is the linear combination of and then we find the .

(b) Prove that the minimal polynomial of is a polynomial multiple of .

Proof:

Let be the minimal polynomial of .

Let . Then is invariant under . Then we can consider . Note that is the minimal polynomial of from part (a).

Then from "5.21 minimal polynomial of a restriction operator", we know is multiple of .

5C.8

Suppose is finite-dimensional, , and there exists a nonzero vector such that .

(a) Prove that if , then there does not exist a basis of with respect to which has an upper-triangular matrix.

Proof:

Let the minimal polynomial of and . Note that does not have a real zero, which means is not an eigenvector.

Otherwise, if , then , so . No real can satisfy this equation.

Then satisfy the 5C.7(a), so is a multiple of . Since cannot be written in the form of .

Then use "5.44 necessary and sufficient condition to have an upper-triangular matrix", we know there does not exist a basis of with respect to which has an upper-triangular matrix.

(b) Prove that if and is an upper-triangular matrix that equals the matrix of with respect to some basis of , then or appears on the diagonal of .

Proof:

Let and , then it's possible that

.

Since is a multiple of , then

either or or both are zeros of the . Then or or both are eigenvalues of .

From "5.41 determination of eigenvalues from upper-triangular matrix", we know or appears on the diagonal of .

5C.9

Suppose is a square matrix with complex entries. Prove that there exists an invertible square matrix with complex entries such that is an upper-triangular matrix.

Proof:

Let be an by matrix. Consider . is an operator in such that under the standard basis is , i.e. .

Use "5.47 if , then every operator on 𝑉 has an upper-triangular matrix", then we know we can find a basis such that is a upper-triangular matrix.

Then we can directly apply "3.84 change-of-basis formula" and let

Then we have .

5C.10

Suppose and is a basis of . Show that the following are equivalent.

(a) The matrix of with respect to is lower triangular.

(b) is invariant under for each .

(c) for each .

A square matrix is called lower triangular if all entries above the diagonal are .

Proof:

Fix any and .

Since The matrix of with respect to is lower triangular, then is the linear combination of , so .

So is invariant under .

is invariant under , then .

, then is a linear combination of . Then the coefficients of are all . This means the matrix of with respect to is lower triangular.

5C.11

Suppose and is finite-dimensional. Prove that if , then there exists a basis of with respect to which has a lower-triangular matrix.

Proof:

Use "5.47 if , then every operator on 𝑉 has an upper-triangular matrix", then we can find a basis such that is a upper-triangular matrix.

Now use "5.39 conditions for upper-triangular matrix", we know is invariant under for .

Now let . We can see

is invariant under .

Then apply exercise 5C.10 above, we get is a lower-triangular matrix under the basis .

5C.12

Suppose is finite-dimensional, has an upper-triangular matrix with respect to some basis of , and is a subspace of that is invariant under .

(a) Prove that has an upper-triangular matrix with respect to some basis of .

Proof:

Let be the minimal polynomial of , and be the minimal polynomial of .

From "5.44 necessary and sufficient condition to have an upper-triangular matrix", we know

Then from "5.31 minimal polynomial of a restriction operator", is a multiple of .

Then has to be in the form of

Then again apply 5.44, we know has an upper-triangular matrix with respect to some basis of .

(b) Prove that the quotient operator has an upper-triangular matrix with respect to some basis of .

Proof: The logic is very similar to part (a).

Let be the minimal polynomial of , and be the minimal polynomial of .

From exercise 5B.25 part (a), the minimal polynomial of is a polynomial multiple of the minimal polynomial of the quotient operator .

Then the other part is exactly the same as part (a).

5C.13

Suppose is finite-dimensional and . Suppose there exists a subspace of that is invariant under such that has an upper-triangular matrix with respect to some basis of and also has an upper-triangular matrix with respect to some basis of . Prove that has an upper-triangular matrix with respect to some basis of .

Proof:

Let be the minimal polynomial of , be that of and be that of .

From "5.44 necessary and sufficient condition to have an upper-triangular matrix",

we have

From the exercise 5B.25 (b) we know that (minimal polynomial of ) (minimal polynomial of ) is a polynomial multiple of the minimal polynomial of 𝑇.

Then due to unique factorization in we have

Then again use 5.44, we know has an upper-triangular matrix with respect to some basis of .

5C.14

Suppose is finite-dimensional and . Prove that has an upper- triangular matrix with respect to some basis of if and only if the dual operator has an upper-triangular matrix with respect to some basis of the dual space

Proof:

We use exercise 5B.28, which states that the minimal polynomial of equals the minimal polynomial of .

And then we can use "5.44 necessary and sufficient condition to have an upper-triangular matrix" again.

Section 5D Diagonalizable Operators

5D.1

Suppose is a finite-dimensional complex vector space and .

(a) Prove that if , then is diagonalizable.

Proof: Since then is a multiple of , which is the minimal polynomial of . Also note

From "4.13 fundamental theorem of algebra, second version", we know both and has a unique factorization. So the zeros of can only be distinct numbers. Then apply "5.62 necessary and sufficient condition for diagonalizability", we know is diagonalizable.

(b) Prove that if , then is diagonalizable.

Proof: Since then is a multiple of , which is the minimal polynomial of . Also note

From "4.13 fundamental theorem of algebra, second version", we know both and has a unique factorization. So the zeros of can only be distinct numbers. Then apply "5.62 necessary and sufficient condition for diagonalizability", we know is diagonalizable.

(c) Give an example of an operator such that and is not diagonalizable.

Solution:

Consider , then . Since , then the degree of the minimal polynomial of , i.e. . So .

Then apply "5.62 necessary and sufficient condition for diagonalizability", we know is not diagonalizable.

Furthermore .

5D.2

Suppose has a diagonal matrix with respect to some basis of . Prove that if , then appears on the diagonal of precisely times.

Proof:

Assume has a diagonal matrix w.r.t. the basis . And the elements on the diagonal matrix are .

Since , then they are eigenvectors.

If is not an eigenvalue of , then , so it does not appear on the diagonal. Also . So the conclusion holds.

Now if is an eigenvalue, and if it appears on the diagonal more than times. It means we can find at least linearly independent vectors and they are all eigenvectors w.r.t. to eigenvalue . So they all belong to . It means , which is impossible.

So appears on the diagonal at most times. This is true of all eigenvalues.

On the other hand, from "5.55 conditions equivalent to diagonalizability" we have

It means, cannot appear on the diagonal less than times. Otherwise the righ side of the above equation is less than the left side.

So the conclusion holds.

5D.3

Suppose is finite-dimensional and . Prove that if the operator is diagonalizable, then .

Proof:

If , then is invertible. So , So .

Now assume , then note .

Since is diagonalizable, then from "5.55 conditions equivalent to diagonalizability", we know

, where for .

Note , so we just need to prove .

Let , then since , we can pick sucht that

Then

Which means

On the other hand, if , then let , we have .

So .

In summary,

Then we have .

5D.4

Suppose is finite-dimensional and . Prove that the following are equivalent.

(a)

(b)

(c)

Proof:

Since , so .

From fundamental theorem of linear mapping, we know

From "2.43 dimension of a sum", we know

Then we have

From (c), we know is a direct sum.

Then from "2.43 dimension of a sum", fundamental theorem of linear mapping and (c), we know

So

5D.5

Suppose is a finite-dimensional complex vector space and . Prove that is diagonalizable if and only if

for every .

Proof:

We use the exercise 5D.3. If is diagonalizable, then using "5.55 conditions equivalent to diagonalizability"

we can find a basis which are all eigenvectors of .

In fact, for any , they are also eigenvectors of . To see this, note

So again use "5.55 conditions equivalent to diagonalizability", we know is also diagonalizable. Then use 5D.3, we have

Strategy:

Assume but , can we prove it's not possible to write

Of course we can do it, because .

Put it formally, let be the minimal polynomial of . Since is a complex vector space,

If are not all different, then we can write as

We can find such that , otherwise and its degree is less than which is contradictary to the assumption that is the minimal polynomial.

Then since

On other other hand , so .

So .

Then

Which is contradictary to our assumption.

Then are all distinct. Then we can use "5.62 necessary and sufficient condition for diagonalizability" To conclude is diagonalizable.

5D.6

Suppose and . Prove that or is invertible.

Proof: We prove by contradition.

Assume and are all non-invertible. Then and .

Then and .

So .

This is contradictary to "5.54 sum of eigenspaces is a direct sum".

So Either or .

So either or is invertible.

5D.7

Suppose is invertible. Prove that

for every with .

Proof:

Let . Since is invertible, then is injective. Furthermore, is invariant under , so is well defined and is also injective, so is invertible.

So we can find such that . So , i.e. .

So

So , then .

Then if we replace with , and replace with , and replace with , we can show

So

5D.8

Suppose is finite-dimensional and . Let denote the distinct nonzero eigenvalues of . Prove that

Proof:

if and , then , so .

Then it means . So we have

Then from "5.54 sum of eigenspaces is a direct sum", we can know

Then from "3.94 a sum is a direct sum if and only if dimensions add up", we know

So, we have

5D.9

Suppose each have as eigenvalues. Prove that there exists an invertible operator such that .

Proof:

Let , since and have 3 different eigenvalues. Then by "5.58 enough eigenvalues implies diagonalizability", we know both have diagonal matrices under some basis.

Assume has a basis and

Similarly, assume has a basis and

Then define as to be

is invertible since is injective. We can also see satisfy:

Then note

The same calculation can be applied to . Since is a basis of of , and when and are applied to them the results are the same. So .

5D.10

Find such that and each have as eigenvalues, and have no other eigenvalues, and there does not exist an invertible operator such that .

Solution:

If , then we use exercise 5A.40 which states:

Suppose and is invertible. Suppose is a polynomial. Then

This means the polynomial of and are actually the same.

So our goal is to find 2 operators sucht that they have as eigenvalues, but their minimal polynomials are not the same.

Let be an operator such that under standard basis, its matrix is

Then it's minimal polynomial is .

Let be an operator such that under standard basis, its matrix is

Then it's minimal polynomial is .

So . Then it's impossible to find an invertible operator such that .