Chapter 5 Eigenvalues and Eigenvectors
Section 5A Invariant Subspaces
5A.1
Suppose and is a subspace of .
(a) Prove that if , then is invariant under .
Proof:
Assume οΌ
(b) Prove that if , then is invariant under .
Proof:
If , then .
5A.2
Suppose that and are subspaces of invariant under . Prove that is invariant under .
Proof:
Assume , then we have
So
Since , then .
5A.3
Suppose . Prove that the intersection of every collection of subspaces of invariant under is invariant under .
Proof:
Let
where is invariant under .
If , then , then , so .
5A.4
Prove or give a counterexample: If is finite-dimensional and is a subspace of that is invariant under every operator on , then or .
Proof:
The statement is correct. We prove by contradition.
Assume is a subspace and and .
Let be a basis of and we can extends it to a basis of by adding .
Define such that . So is an operator.
Then is not an invariant under . We reach a contradition.
5A.5
Suppose is defined by . Find the eigenvalues of .
Solution:
So does not have any eigenvalues.
5A.6
Define by . Find all eigenvalues and eigenvectors of .
Solution:
Note can either be or .
If , then the eigenvectors are . If , then the eigenvectors are .
5A.7
Define by . Find all eigenvalues and eigenvectors of .
Proof:
Note can either be or .
If , then . Also we have , so , so the eigenvectors for will be for .
If , then , then . Since the eigenvectors cannot be , so , so . And the eigenvectors will be for .
5A.8
Suppose is such that . Prove that if is an eigenvalue of , then or .
Proof:
First we have the assumption that is a vector space over or .
If is a eigenvalue and is a an eigenvector, then
Since , then . Since is a real or complex number, then or .
5A.9
Define by . Find all eigenvalues and eigenvectors of .
Proof:
Assume
Then
If is an eigenvalue and is an eigenvector,
then
So we have
If , then , so the eigenvectors are .
If , then , so there is no eigenvectors.
5A.10
Define by for all . Find all eigenvalues and eigenvectors of .
Proof:
Assume
Then
If is an eigenvalue and is an eigenvector,
then
So we have
If , then , so the eigenvectors are .
If , then we can have to be any positive integer , and then eigenvectors will be for .
5A.11
Suppose is finite-dimensional, , and . Prove that there exists such that is invertible for all such that .
Proof:
Note is either or .
Since is finite-dimensional, then from "5.12 operator cannot have more eigenvalues than dimension of vector space", has at most eigenvalues.
Then we can find such that where is an eigenvalue.
So if , then is not an eigenvalue.
Then from "5.7 equivalent conditions to be an eigenvalue" we know is invertible.
5A.12
Suppose , where and are nonzero subspaces of . Define by for each and each . Find all eigenvalues and eigenvectors of .
Proof:
Assume is an eigenvalue, then
If and , then we must have , then is not an eigenvector, as a result, is not an eigenvalue.
If , then every nonzero vector in is an eigenvector. Indeed, given , then .
If , then every nonzero vector in is an eigenvector. Indeed, given , then .
5A.13
Suppose . Suppose is invertible.
(a) Prove that and have the same eigenvalues.
Proof:
If is an eigenvalue of , then we can find such that . Since is invertible, we can find such that . Since is invertible and , then .
On the other hand, if is an eigenvalue of , and assume such that
Then we have
Since and is invertible, then . So is an eigenvector of .
(b) What is the relationship between the eigenvectors of and the eigenvectors of ?
Proof:
From (a), if is an eigenvector of , then is an eigenvector of .
Conversely, if is an eigenvector of , then is an eigenvector of .
5A.14
Give an example of an operator on that has no (real) eigenvalues.
Solution:
Consider this operator (borrowed from 5.9(b))
Assume is an real eigenvalue, then
Then
If , then so means . Similarly , then , so is not an eigenvalue.
If , then , then , so is still not an eigenvalue.
5A.15
Suppose is finite-dimensional, , and . Show that is an eigenvalue of if and only if is an eigenvalue of the dual operator .
Proof
Given be a basis of and be its dual basis.
Let be the matrix of under basis and be the matrix of under basis .
From "3.132 matrix of is transpose of matrix of ", we know .
Let be the identity matrix, then the matrix for operator is . Similarly, the matrix for operator , is .
Note that .
Then from "5.7 equivalent conditions to be an eigenvalue" we have the following equivalent relation.
The following is my original thought, but it seems not working.
Assume is an eigenvalue of , and let be an eigenvector so .
Note , we can extend it to a basis of by adding
Then we can find a group of linear independent vectors such that .
Then we can find a basis of : .
Together forms a basis of .
Furthermore, we can extend to a basis of by adding vectors
Then consider the dual basis of .
Let
$$
$$
Then
5A.16
Suppose is a basis of and . Prove that if is an eigenvalue of , then
, where denotes the entry in row , column of the matrix of with respect to the basis .
Proof:
Let , and .
Assume is an eigenvector and .
Also assume
So we have
On the other hand
So we have
Compare the coefficients of on both sides, we have
Assume , then we must have . This is because as an eigenvector cannot be .
5A.17
Suppose , and . Prove that is an eigenvalue of π if and only if is an eigenvalue of the complexification .
The complexification is defined in Exercise 1B.8 See Exercise 33 in Section 3B for the definition of .
Proof:
Assume is an eigenvalue of and is an eigenvector, then .
Now consider
Since , then . Then is an eigenvector and is an eigenvalue.
Assume is an eigenvalue of and is an eigenvector. Then or .
So one of or is an eigenvector for sure. And is an eigenvalue.
5A.18
Suppose , and . Prove that is an eigenvalue of the complexification if and only if is an eigenvalue of .
Proof:
is an eigenvalue of the complexification , then there is a such that
So we have
Now consider
So is also an eigenvalue of .
The other direction is similar.
5A.19
Show that the forward shift operator defined by
has no eigenvalues.
Proof:
We use contradition.
Assume is an eigenvalue and is an eigenvector So we can find .
Also
If , then , so we have contradition.
If , then since , we have , similarly, , we reach a contradition.
So has no eigenvalues.
5A.20
Define the backward shift operator by
(a) Show that every element of is an eigenvalue of .
Proof:
Let .
If , then is an eigenvector.
If , then is an eigenvector.
(b) Find all eigenvectors of .
Solution:
From part (a), the eigenvectors are with and .
5A.21
Suppose is invertible.
(a) Suppose with . Prove that is an eigenvalue of if and only if is an eigenvalue of .
Proof:
Since , then an eigenvalue of .
The reverse side is similar.
(b) Prove that and have the same eigenvectors.
Proof:
The proof in (a) already showed if is an eigenvector of , it's also a eigenvector of and vice versa.
5A.22
Suppose and there exist nonzero vectors and in such that
Prove that 3 or β3 is an eigenvalue of .
Proof:
If , then , since , then is an eigenvalue.
If , then consider
Since , then . So is an eigenvalue.
5A.23
Suppose is finite-dimensional and . Prove that and have the same eigenvalues.
Proof:
If is an eigenvalue of and is an eigenvector such that .
Then we have .
If , then is an eigenvalue of .
If , then , then we need to show .
If is invertible, then we can find such that . Note can not be since . Then . So .
If is not invertible, then we can find , such that . Then , so .
In any case, . And is also an eigenvalue of .
The reverse side is similar.
5A.24
Suppose is an -by- matrix with entries in . Define by , where elements of are thought of as -by- column vectors.
(a) Suppose the sum of the entries in each row of equals . Prove that is an eigenvalue of .
Proof:
Consider the vector
So and is an eigenvalue of .
(b) Suppose the sum of the entries in each column of equals . Prove that is an eigenvalue of .
Proof:
Consider is the dual map of in . Then its matrix under dual basis is . Then the sum of the entries in each row of equals . Then we can apply part (a) and know is an eigenvalue of .
No we use the Exercise 5A.15 in this section which states is an eigenvalue of if and only if is an eigenvalue of the dual operator . And then we know is an eigenvalue of .
5A.25
Suppose and are eigenvectors of such that is also an eigenvector of . Prove that and are eigenvectors of corresponding to the same eigenvalue.
Proof:
Assume
Then
If , then and is independent, so .
Then , we have an contradition.
So .
5A.26
Suppose is such that every nonzero vector in is an eigenvector of . Prove that is a scalar multiple of the identity operator.
Proof:
Consider , and their eigenvalues are .
If , then , then . Then .
Since then , i.e. .
If , then is also an eigenvector of . From the last Exercise, we know .
So for any , . Then is a scalar multiple of the identity operator.
5A.27
Suppose that is finite-dimensional and . Suppose is such that every subspace of of dimension is invariant under . Prove that is a scalar multiple of the identity operator.
Proof:
Let . Consider , we can extend to a basis of by adding .
Assume
If , then let . is an invariant of .
So . Since can be represented by uniquely, we have .
Similarly we can show . So is an eigenvector.
That means every vector is an eigenvector of .
From last Exercise, we know is a scalar multiple of the identity operator.
5A.28
Suppose is finite-dimensional and . Prove that has at most distinct eigenvalues.
Proof:
We prove by contradition. Assume there are more than , then there are a least nonzero eigenvalues.
Let , we can find eigenvectors with different eigenvalues, i.e.
So we reached an contradition.
5A.29
Suppose and , , and are eigenvalues of . Prove that there exists such that .
Proof:
, , and are eigenvalues of , and from 5.12, we know operator cannot have more eigenvalues than dimension of vector space. Since , then cannot have other eigenvalues, so is not an eigenvalue of .
Since is not an eigenvalue of , then is invertible. Then we can find such that .
5A.30
Suppose and . Suppose π is an eigenvalue of . Prove that π = 2 or π = 3 or π = 4.
Proof:
We prove by contradition. Assume is an eigenvalue of , where . If is an eigenvector and , then
Since , then .
But this contradicts to the fact .
So or or .
5A.31
Give an example of such that .
Proof:
Consider the matrix of is
Then since then .
5A.32
Suppose has no eigenvalues and . Prove that .
Proof:
Since has no eigenvalues then are invertible. So is .
So for any , we can find , such that
So .
So , then .
5A.33
Suppose and is a positive integer.
(a) Prove that is injective if and only if is injective.
Proof:
Assume is injective and if , then , we have . Similarly , so , That means is injective.
Assume then , so , then is injective.
(b) Prove that is surjective if and only if is surjective.
Proof:
We prove by induction. First, is surjective. Assume is surjective, and given .
Since is surjective, we can find such that . Since is also surjective, we can find such that , then .
So is also surjective. Then we finish the induction.
is surjective, and given . We can find such that , then we have .
5A.34
Suppose is finite-dimensional and . Prove that the list is linearly independent if and only if there exists such that are eigenvectors of corresponding to distinct eigenvalues.
Proof:
It is an immediate results from "5.11 linearly independent eigenvectors".
Since is finite-dimensional, and is linearly independentοΌ we can extend it to a basis of by adding .
Let and , then is a linear map and are eigenvectors of corresponding to distinct eigenvalues
5A.35
Suppose that is a list of distinct real numbers. Prove that the list is linearly independent in the vector space of real-valued functions on π.
Hint: Let , and define an operator by . Find eigenvalues and eigenvectors of .
Proof:
Based on the hint, is a linear operator of . Also note from calculus, we know
Then are eigenvectors with different eigenvalues.
From "5.11 linearly independent eigenvectors", we know is linearly independent.
5A.36
Suppose that is a list of distinct positive numbers. Prove that the list is linearly independent in the vector space of real-valued functions on π.
Proof:
We know that is a linear operator of .
Also note from calculus, we know
Since are distinct positive numbers, so are also distinct.
From "5.11 linearly independent eigenvectors", we know is linearly independent.
5A.37
Suppose is finite-dimensional and . Define by for each . Prove that the set of eigenvalues of equals the set of eigenvalues of .
Proof:
Assume is an eigenvalue of . Then we can find , such that . We need to fine such that .
Let be a basis of , let , then .
So .
Now assume is an eigenvalue of , then we can find , such that .
Since , we can find such that . Let , then
So is an eigenvalue of .
5A.38
Suppose is finite-dimensional, , and is a subspace of invariant under . The quotient operator is defined by
for each .
(a) Show that the definition of makes sense (which requires using the condition that is invariant under π) and show that is an operator on .
Proof:
Assume , then from "3.101 two translates of a subspace are equal or disjoint", we know .
So is well defined.
Next, we will prove is linear map.
First
Second
(b) Show that each eigenvalue of is an eigenvalue of .
Proof:
Assume is an eigenvalue of . Then is not injective, so we can find such that , that means we can find such that .
Since is invariant under , so we can consider limited on , i.e. .
If is not invertible, we can find and , such that , since . Then . So is eigenvalue of .
If is invertible, we can find such that , then we also have .
Since , we have . And .
Therefore, is an eigenvalue of .
5A.39
Suppose is finite-dimensional and . Prove that has an eigenvalue if and only if there exists a subspace of of dimension that is invariant under .
Proof:
Let be a invariant space under and .
Then consider the quotient space and the operator on it defined in the last exercise.
Since , then has an eigenvalue. From the previous exercise part (b), each eigenvalue of is an eigenvalue of . So has an eigenvalue.
We will use induction. Let . First if , then is invariant and it's dimension is . The statement is true.
Now assume the statement holds for all , and we will prove when .
Assume is an eigenvalue, consider the linear mapping .
Consider . From "5.18 null space and range of are invariant under ", we know is invariant under .
Since is not surjective, then
If , then we are done.
If , then from fundamental theorem of linear maps (3.21), we know .
Then we can find which are linear independent.
Let
Now we can use exercise 5A.38 and consider the quotient space and its operator .
Note that is an eigenvalue of and is an eigenvector since
Since , then . And has an eigenvalue , so we can apply the induction and get an invariant subspace and .
Now assume is a basis of .
Then we can cosider the space .
Since is invariant under , then we have
And since , it means
Also . So is invariant under .
Now if
So are linear independent.
The , this completes the induction.
Here is the anwser from AI:
Let be an eigenvalue of and let . By 5.18, is invariant under . Since is not surjective ( is an eigenvalue, so is not injective, and is finite-dimensional), .
Case 1: . Then is the desired invariant subspace.
Case 2: .
Since is invariant under , the quotient operator is well-defined. For any :
So .
Let be the preimage of under the quotient map .
Then is invariant under , for ,
Then note and
So .
5A.40
Suppose and is invertible. Suppose is a polynomial. Prove that
Proof:
Note since is invertible, then .
So .
If
Then
5A.41
Suppose and is a subspace of invariant under . Prove that is invariant under for every polynomial .
Proof:
We use the induction to show is invariant under . Since is invariant under , assume is invariant under .
For any , since , then , so is invariant under .
Then given any , .
So is invariant under for every polynomial .
5A.42
Define by .
(a) Find all eigenvalues and eigenvectors of π.
Proof:
For any such that , is an eigenvalue, because let be the ith item of standard basis of .
Since , then can only have distinct eigenvalues. Then we found all eigenvalue.
If is an eigenvector with eigenvalue of , then
so with . That's all eigenvectors of .
(b) Find all subspaces of that are invariant under .
Solution:
Assume is invariant under and and , let
If , we want to show . If when , then , we are done.
Other we have some with .
Since is invariant subspace, then , so we have . We also have
So, for , but . For other , if then . If , then .
So the number of non zero coefficients is reduced by . By continuing this process, we can show .
That means , on the other hand . So .
That means all subspaces of that are invariant under are the form of .
5A.43
Suppose that is finite-dimensional, , and . Prove that .
Proof:
Assume .
One strategy is that: since , we should prove .
We will use the results from section about next section, i.e. section 5.3.
Assume is the minimal polynomial of . Then from 5.22 we know .
Given any , from 4.9 division algorithm for polynomials, we know we can find such that , where .
That means , since , then .
Since , then we have
Since , then .
Another strategy (not working so far) is we should find some such that or is not trivial invariant subspace.
We consider the . Since we know from exercise 5A.41, is invariant under , we want to find a operator such that is not invariant under .
Case 1: , then , then . Let be linear independent, then let , then .
Case 2: , we can find a basis of : . We can also extend it to a basis of by adding . Let , then is not invariant under .
Section 5B The Minimal Polynomial
5B.1
Suppose . Prove that is an eigenvalue of if and only if or is an eigenvalue of .
Proof:
Assume is an eigenvector and . Then we have .
If , then is an eigenvalue and is an eigenvector.
If , let . We have . Then is an eigenvalue and is an eigenvector.
If is an eigenvalue and is an eigenvector such that , then
So is an eigenvalue of and is an eigenvector. Similarly for the case when is an eigenvalue of .
5B.2
Suppose is a complex vector space and has no eigenvalues. Prove that every subspace of invariant under is either or infinite- dimensional.
Proof:
Assume is subspace that is invariant under . Then we can restrict under to get . Then is an operator on .
Assume is a finite-dimensional space.
Then from "5.19 existence of eigenvalues", it must have an eigenvalue and an eigenvector of such that .
But since , then we also have . This means has an eigenvalue and an eigenvector of .
Then we reached an contradition. So if , then is infinite-dimensional.
5B.3
Suppose is a positive integer and is defined by
anwser the following:
(a) Find all eigenvalues and eigenvectors of .
Solution:
Assume is an eigenvalue and is an eigenvector,
Then
Then we have
If , then any satisfy , is an eigenvector. So if , then , then is not an eigenvalue.
If , then and .
So in summary, there are 2 possible eigenvalues when :
- , and satisfy
- , and with .
if , then only case 2 is valid.
(b) Find the minimal polynomial of π.
Solution:
We first assume .
Let be the minimal polynomial of .
From "5.27 eigenvalues are the zeros of the minimal polynomial", we know
This means is a multiple of .
Now we consider applied on where is one of the standard basis.
Then for any . That means .
Then from "5.29 is a polynomial multiple of the minimal polynomial", we know is a multiple .
Since is a monic polynomial, and we must have .
Now we assume . In this case because . so . On the other hand is a zero of so . So .
5B.4
Suppose , and πΌ β π. Prove that πΌ is an eigenvalue of π(π) if and only if πΌ = π(π) for some eigenvalue π of π.
Proof:
Consider the polynomial . And consider . Since is an eigenvalue of , .
From "5.18 null space and range of are invariant under ", we know is invariant under . And then we can restrict on to get .
Let be the minimal polynomial of . Since is on , from "5.29 is a polynomial multiple of the minimal polynomial", we have
Since , from fundamental theorem of algebra, we can find one of its zero, say .
So . Since , then is not a multiple of , then is not on again from 5.29. We can find , such that . Let , then we have .
Since , then we have , so , i.e. . So is an eigenvalue of .
Since and is a zeor of , we have .
If , and , then
So is an eigenvalue of .
5B.5
Give an example of an operator on that shows the result in Exercise 4 does not hold if π is replaced with π.
Solution:
Consider is an operator, it rotates a vector by 90 degree counterclock-wise.
So .
So , then if we reuse the symbol in exercise 4, we have , then it's not possible to find a real number such that .
5B.6
Suppose is defined by . Find the minimal polynomial of .
Solution:
Consider
And
That means and .
So . so is a multiple of minimal polynomial.
On the other hand, if is , then
This is no possible, so .
So is the minimal polynomial.
5B.7
(a) Give an example of such that the minimal polynomial of does not equal the minimal polynomial of .
Solution:
Consider and .
Then so , then the minimal polynomial of is .
On the other hand,
, so , and , so the minimal polynomial of is .
(b) Suppose is finite-dimensional and . Prove that if at least one of is invertible, then the minimal polynomial of equals the minimal polynomial of .
Hint: Show that if π is invertible and π β π«(π ), then .
Proof:
Assume is invertible. is the minimal polynomial of . is the minimal polynomial of .
We will show and .
Just use exercise 5A.40,
Then use "5.29 is a polynomial multiple of the minimal polynomial", we know is an multiple of .
On the other hand,
So is a multiple of .
In summary, .
5B.8
Suppose is the operator of counterclockwise rotation by . Find the minimal polynomial of .
Because , the degree of the minimal polynomial of is at most . Thus the minimal polynomial of is not the tempting polynomial , even though .
Solution:
We write the standard basis in polar form
Then note
Similarly,
So .
On the other hand, since is a rotation, does not have eigenvalue, so the minimal polynomial cannot be degree 1.
Therefore, the minimal polynomial is .
5B.9
Suppose is such that with respect to some basis of , all entries of the matrix of are rational numbers. Explain why all coefficients of the minimal polynomial of are rational numbers.
Proof: unsolved.
5B.10
Suppose is finite-dimensional, , and . Prove that
for all integers .
Proof:
Let be the minimal polynomial of , from the polynomial division algorithm, we know given , we can find such that
with . So . Let .
So we have
So That means
On the other hand, since , we have
So we have
5B.11
Suppose is a two-dimensional vector space, , and the matrix of with respect to some basis of is
Prove that
(a) Show that .
Proof:
So .
(b) Show that the minimal polynomial of equals
Proof:
Assume the minimal polynomial of is .
If then assume .
So , .
If , then from part (2) we know , since minimal polynomial is unique, then is the minimal polynomial.
5B.12
Define by . Find the minimal polynomial of .
Proof:
Let be the minimal polynomial of .
Let be the standard basis of . Then note , then is an eigenvalue of .
So from "5.27 eigenvalues are the zeros of the minimal polynomial", part (b) has the form of . with .
On the other hand, , so .
5B.13
Suppose and . Prove that there exists a unique such that and is less than the degree of the minimal polynomial of .
Proof:
Let be the minimal polynomial of , from the division algorithm of polynomials, we know we can find unique such that
and , then
For the uniqueness, if , and , then . Furthermore, , since is the minimal polynomial of , then has to be .
5B.14
Suppose is finite-dimensional and has minimal polynomial . Find the minimal polynomial of .
Solution:
First note that
Then we have
Since is invertible, so is . Then we have
.
If we can find a polynomial with degree less than that can nullify , then we can use similar approach to find a polynomial with degree less than to nullify which contradicts the fact that minimal polynomial of has degree .
5B.15
Suppose is a finite-dimensional complex vector space with and . Define by
Prove that is not a continuous function.
Proof:
Let . Since is a finite-dimensional complex vector space, then from "5.19 existence of eigenvalues", we know has an eigenvalue, say .
From "5.12 operator cannot have more eigenvalues than dimension of vector space", we know can have at most distinct eigenvalues, so we can find a neighborhood of , , such that if and , then is not an eigenvalue.
For these , is invertible, so . On the other hand, since , and .
So is not continuous at .
5B.16
Suppose . Let be the operator on whose matrix (with respect to the standard basis) is
Here all entries of the matrix are except for all on the line under the diagonal and the entries in the last column (some of which might also be ). Show that the minimal polynomial of is the polynomial.
Proof:
Let
Consider . And note
So
i.e. .
Furthermore, notice for
i.e. . This means .
Also, since , so are independent, then it's not possible to find a polynomial with , such that . Otherwise , which is not possible.
So the minimal polynomial of is .
5B.17
Suppose is finite-dimensional, , and is the minimal polynomial of . Suppose . Show that the minimal polynomial of is the polynomial defined by .
Proof:
First
Now assume there is another monic polynomial with and
Then let , then is also a monic polynomial such that .
Also .
This is contradictary to the fact that is the minimal polynomial.
So is the minimal polynomial of .
5B.18
Suppose is finite-dimensional, , and is the minimal polynomial of . Suppose . Show that the minimal polynomial of is the polynomial defined by .
Proof:
let , and
Then
Also
So is monic.
Now assume satisfy and .
Then
Since , so , then ,
Let .
So we found a monic polynomial with and .
This is contradictary to the fact that is the minimal polynomial.
So the minimal polynomial of is the polynomial defined by .
5B.19
Suppose is finite-dimensional and . Let be the subspace of defined by
Prove that equals the degree of the minimal polynomial of .
Proof:
Let be the minimal polynomial of . And . Given any , using the "4.9 division algorithm for polynomials", we know we can find such that
with .
The use "5.17 multiplicative properties", we know
So
So .
Since , then can be represented by .
So . so . So
On the other hand, are linear independent. Otherwise, we can find such that they are not all 0 and
That means we find another polynomial with degree less than such that it's 0, which contradicts the assumption that is the minimal polynomial.
Since are linear independent, then .
In summary, .
5B.20
Suppose is such that the eigenvalues of π are 3, 5, 8. Prove that .
Proof:
Let be the minimal polynomial of . From "5.22 existence, uniqueness, and degree of minimal polynomial", .
From "5.27 eigenvalues are the zeros of the minimal polynomial" we know .
From "4.6 each zero of a polynomial corresponds to a degree-one factor" we know .
Since , or .
Case 1: , then . Then is a multiple of .
Case 2: , then and .
Use 5.27 again, we know is an eigenvalue of , so . In any case, is a multiple of .
Then we can use 5.29 to conclude .
5B.21
Suppose is finite-dimensional and . Prove that the minimal polynomial of has degree at most .
If , then this exercise gives a better upper bound than 5.22 for the degree of the minimal polynomial of .
Proof:
Let . Let , then consider . Since is invariant under , so is well defined.
Let be the minimal polynomial of , then from 5.22, . Consider . We would like to show .
Given ,
case 1: , then .
case 2: , then , so . Also, since , then , so .
So in summary, .
Then from 5.29, is a multiple of minimal polynomial. Then the minimal polynomial of has degree at most .
5B.22
Suppose is finite-dimensional and . Prove that is invertible if and only if .
Proof:
Let
So has an inverse mapping: .
From 5.32 not invertible βΊ constant term of minimal polynomial of is 0 we know if is the minimal polynomial, then
where , so
5B.23
Suppose is finite-dimensional and . Let . Prove that if , then is invariant under .
Proof:
Let .
We only need to prove .
Since are linear dependent, we can find
and are not all .
Let be the biggest integer such that . So we have
Apply on both sides we have
5B.24
Suppose is a finite-dimensional complex vector space. Suppose is such that and are eigenvalues of and that has no other eigenvalues. Prove that .
Proof:
Let be the minimal polynomial of . From 5.27 eigenvalues are the zeros of the minimal polynomial (b)
where is a list of all eigenvalues of , possibly with repetitions.
So . So .
If , then which is not possible, so . Similarly .
Then is a multiple of . So .
5B.25
Suppose is finite-dimensional, , and is a subspace of that is invariant under .
(a) Prove that the minimal polynomial of is a polynomial multiple of the minimal polynomial of the quotient operator .
Proof:
Assume the minimal polynomial of is , given any , we need to prove .
Since , then
Then is a zero operator on .
Then from 5.29 is a polynomial multiple of the minimal polynomial, we can conclude is a polynomial multiple of the minimal polynomial of the quotient operator .
(b) Prove that
(minimal polynomial of ) Γ (minimal polynomial of )
is a polynomial multiple of the minimal polynomial of π.
Proof:
Assume minimal polynomial of is and minimal polynomial of is .
We need to prove, given any , .
First since the minimal polynomial of is . Then . On the other hand, . Thus it means .
Since the minimal polynomial of is , then .
Since is invariant under , then from exercise 5A.41 we know is also invariant under . Thus for any , . So .
Then again from 5.29 is a polynomial multiple of the minimal polynomial, we can conclude the statement.
5B.26
Suppose is finite-dimensional, , and is a subspace of that is invariant under . Prove that the set of eigenvalues of equals the union of the set of eigenvalues of and the set of eigenvalues of .
Proof:
Let the minimal polynomial of be , minimal polynomial of is and minimal polynomial of is .
Assume is a eigenvalue of . Then is a zero of . From the part (b) of exercise 5B.25, is a multiple of , then , so or .
Then from 5.27, is either an eigenvalue of or an eigenvalue of .
From exercise 5A.38, we know an eigenvalue of is an eigenvalue of .
Assume is an eigenvalue of , then we can find a and such that . Since , then .
So is an eigenvalue of .
5B.27
Suppose , is finite-dimensional, and . Prove that the minimal polynomial of equals the minimal polynomial of . The complexification was defined in Exercise 33 of Section 3B.
Proof:
Let be the minimal polynomial of and be the minimal polynomial of .
Note that , so
Then from the linearity of , we can see
So given any
So is a multiple of .
On the other hand
So is a multiple of .
Then
5B.28
Suppose is finite-dimensional and . Prove that the minimal polynomial of equals the minimal polynomial of .
Proof:
One way to think this problem is consider the matrix of and . They are transpose to each other.
But we will do another way. Note that given any linear functional , we have
And then use the distribution law of the composition of the linear mapping, we have
First assume is the minimal polynomial of . And assume is the minimal polynomial of .
Then given any linear functional and ,
So is a multiple of .
Now assume is a basis of and is the dual basis. And assume
On one hand
On the other hand
So , i.e. .
So is a multiple of .
Based on this, .
5B.29
Show that every operator on a finite-dimensional vector space of dimension at least two has an invariant subspace of dimension two.
Proof:
Consider is the operator, and is its minimal polynomial.
We distinguish the following cases:
case : If , then every vector is a eigenvector of . Since , then we can pick two linear independent vectors . Then is invariant with dimension .
case : , we can assume . This is because if , we can use "4.16 factorization of a polynomial over ". If , we can use "4.13 fundamental theorem of algebra, second version".
Consider . It cannot be because otherwise will be the minimal polynomial.
Then assume we can find , such that is not an eigenvector of , then are linearly independent. Furthermore, since , we have . So is invariant with dimension .
Now assume all are eigenvectors. If for all , , then will be the minimal polynomial, which is contradictary to our assumption that is the minimal polynomial.
So we can find which are 2 different eigenvalues and we can find 2 eigenvectors , such that .
From 5.11 linearly independent eigenvectors, we know are linear independent, then is invariant with dimension .
Section 5C Upper-Triangular Matrices
5C.1
Prove or give a counterexample: If and has an upper-triangular matrix with respect to some basis of , then has an upper-triangular matrix with respect to some basis of .
Solution:
Consider . And be the linear operator that rotates by degree counterclockwise.
Since does not have an eigenvalue, then does not have a 1-dimensional subspace that is invariant under w.r.t any basis of . Therefore, it's not possible that has an upper-triangular matrix w.r.t any basis of .
On the other hand, the matrix of w.r.t the standard basis is
which is an upper-triangular matrix.
5C.2
Suppose and are upper-triangular matrices of the same size, with on the diagonal of and on the diagonal of .
(a) Show that is an upper-triangular matrix with on the diagonal.
Proof:
Let , then the diagonal of on the th row and th column is
(b) Show that is an upper-triangular matrix with on the diagonal.
Proof
Let , then the diagonal of on the th row and th column is
Note that if , and if , so .
5C.3
Suppose is invertible and is a basis of with respect to which the matrix of is upper triangular, with on the diagonal. Show that the matrix of is also upper triangular with respect to the basis , with
on the diagonal.
Proof:
First, from "5.41 determination of eigenvalues from upper-triangular matrix", are the eigenvalues of . Since is invertible, then is not an eigenvalue of . So .
Then is well defined.
Next, we show if is invariant under and is invertible, then is invariant under .
Let , and consider . Since is invertible, then is injective, then is also injective. So is invertible. Then we can find such that . then we have .
So . Then is invariant under .
Now let . From "5.39 conditions for upper-triangular matrix", is invariant under , then is also invariant under , then again use 5.39, The matrix of with respect to is upper triangular.
Let on the diagonal. Note , so , thne .
For ,
Where , then
Since is invariant under , then . Then we must have , i.e. .
5C.4
Give an example of an operator whose matrix with respect to some basis contains only 's on the diagonal, but the operator is invertible. This exercise and the exercise below show that 5.41 fails without the hypothesis that an upper-triangular matrix is under consideration.
Proof:
Consider the vector space is , and the operator is rotation counterclockwise by 90 degree. And the basis is the standard basis, .
. So
It's invertible because its inverse is rotation clockwise by 90 degree.
5C.5
Give an example of an operator whose matrix with respect to some basis contains only nonzero numbers on the diagonal, but the operator is not invertible.
Proof:
Consider the vector space is , and the operator is defined as
Since it's not injective, it's not invertible.
Also the
5C.6
Suppose , is finite-dimensional, and . Prove that if , then has a -dimensional subspace invariant under .
Proof:
Use "5.47 if π = π, then every operator on π has an upper-triangular matrix", then for the operator , we can find a basis , such that is upper-triangular.
Then use "5.39 conditions for upper-triangular matrix", we know is invariant under and its dimension is .
5C.7
Suppose is finite-dimensional, , and .
(a) Prove that there exists a unique monic polynomial of smallest degree such that .
Proof:
Let and then the following vectors must be linear dependent
Then we can find the smallest , such that is the linear combination of and then we find the .
(b) Prove that the minimal polynomial of is a polynomial multiple of .
Proof:
Let be the minimal polynomial of .
Let . Then is invariant under . Then we can consider . Note that is the minimal polynomial of from part (a).
Then from "5.21 minimal polynomial of a restriction operator", we know is multiple of .
5C.8
Suppose is finite-dimensional, , and there exists a nonzero vector such that .
(a) Prove that if , then there does not exist a basis of with respect to which has an upper-triangular matrix.
Proof:
Let the minimal polynomial of and . Note that does not have a real zero, which means is not an eigenvector.
Otherwise, if , then , so . No real can satisfy this equation.
Then satisfy the 5C.7(a), so is a multiple of . Since cannot be written in the form of .
Then use "5.44 necessary and sufficient condition to have an upper-triangular matrix", we know there does not exist a basis of with respect to which has an upper-triangular matrix.
(b) Prove that if and is an upper-triangular matrix that equals the matrix of with respect to some basis of , then or appears on the diagonal of .
Proof:
Let and , then it's possible that
.
Since is a multiple of , then
either or or both are zeros of the . Then or or both are eigenvalues of .
From "5.41 determination of eigenvalues from upper-triangular matrix", we know or appears on the diagonal of .
5C.9
Suppose is a square matrix with complex entries. Prove that there exists an invertible square matrix with complex entries such that is an upper-triangular matrix.
Proof:
Let be an by matrix. Consider . is an operator in such that under the standard basis is , i.e. .
Use "5.47 if , then every operator on π has an upper-triangular matrix", then we know we can find a basis such that is a upper-triangular matrix.
Then we can directly apply "3.84 change-of-basis formula" and let
Then we have .
5C.10
Suppose and is a basis of . Show that the following are equivalent.
(a) The matrix of with respect to is lower triangular.
(b) is invariant under for each .
(c) for each .
A square matrix is called lower triangular if all entries above the diagonal are .
Proof:
Fix any and .
Since The matrix of with respect to is lower triangular, then is the linear combination of , so .
So is invariant under .
is invariant under , then .
, then is a linear combination of . Then the coefficients of are all . This means the matrix of with respect to is lower triangular.
5C.11
Suppose and is finite-dimensional. Prove that if , then there exists a basis of with respect to which has a lower-triangular matrix.
Proof:
Use "5.47 if , then every operator on π has an upper-triangular matrix", then we can find a basis such that is a upper-triangular matrix.
Now use "5.39 conditions for upper-triangular matrix", we know is invariant under for .
Now let . We can see
is invariant under .
Then apply exercise 5C.10 above, we get is a lower-triangular matrix under the basis .
5C.12
Suppose is finite-dimensional, has an upper-triangular matrix with respect to some basis of , and is a subspace of that is invariant under .
(a) Prove that has an upper-triangular matrix with respect to some basis of .
Proof:
Let be the minimal polynomial of , and be the minimal polynomial of .
From "5.44 necessary and sufficient condition to have an upper-triangular matrix", we know
Then from "5.31 minimal polynomial of a restriction operator", is a multiple of .
Then has to be in the form of
Then again apply 5.44, we know has an upper-triangular matrix with respect to some basis of .
(b) Prove that the quotient operator has an upper-triangular matrix with respect to some basis of .
Proof: The logic is very similar to part (a).
Let be the minimal polynomial of , and be the minimal polynomial of .
From exercise 5B.25 part (a), the minimal polynomial of is a polynomial multiple of the minimal polynomial of the quotient operator .
Then the other part is exactly the same as part (a).
5C.13
Suppose is finite-dimensional and . Suppose there exists a subspace of that is invariant under such that has an upper-triangular matrix with respect to some basis of and also has an upper-triangular matrix with respect to some basis of . Prove that has an upper-triangular matrix with respect to some basis of .
Proof:
Let be the minimal polynomial of , be that of and be that of .
From "5.44 necessary and sufficient condition to have an upper-triangular matrix",
we have
From the exercise 5B.25 (b) we know that (minimal polynomial of ) (minimal polynomial of ) is a polynomial multiple of the minimal polynomial of π.
Then due to unique factorization in we have
Then again use 5.44, we know has an upper-triangular matrix with respect to some basis of .
5C.14
Suppose is finite-dimensional and . Prove that has an upper- triangular matrix with respect to some basis of if and only if the dual operator has an upper-triangular matrix with respect to some basis of the dual space
Proof:
We use exercise 5B.28, which states that the minimal polynomial of equals the minimal polynomial of .
And then we can use "5.44 necessary and sufficient condition to have an upper-triangular matrix" again.
Section 5D Diagonalizable Operators
5D.1
Suppose is a finite-dimensional complex vector space and .
(a) Prove that if , then is diagonalizable.
Proof: Since then is a multiple of , which is the minimal polynomial of . Also note
From "4.13 fundamental theorem of algebra, second version", we know both and has a unique factorization. So the zeros of can only be distinct numbers. Then apply "5.62 necessary and sufficient condition for diagonalizability", we know is diagonalizable.
(b) Prove that if , then is diagonalizable.
Proof: Since then is a multiple of , which is the minimal polynomial of . Also note
From "4.13 fundamental theorem of algebra, second version", we know both and has a unique factorization. So the zeros of can only be distinct numbers. Then apply "5.62 necessary and sufficient condition for diagonalizability", we know is diagonalizable.
(c) Give an example of an operator such that and is not diagonalizable.
Solution:
Consider , then . Since , then the degree of the minimal polynomial of , i.e. . So .
Then apply "5.62 necessary and sufficient condition for diagonalizability", we know is not diagonalizable.
Furthermore .
5D.2
Suppose has a diagonal matrix with respect to some basis of . Prove that if , then appears on the diagonal of precisely times.
Proof:
Assume has a diagonal matrix w.r.t. the basis . And the elements on the diagonal matrix are .
Since , then they are eigenvectors.
If is not an eigenvalue of , then , so it does not appear on the diagonal. Also . So the conclusion holds.
Now if is an eigenvalue, and if it appears on the diagonal more than times. It means we can find at least linearly independent vectors and they are all eigenvectors w.r.t. to eigenvalue . So they all belong to . It means , which is impossible.
So appears on the diagonal at most times. This is true of all eigenvalues.
On the other hand, from "5.55 conditions equivalent to diagonalizability" we have
It means, cannot appear on the diagonal less than times. Otherwise the righ side of the above equation is less than the left side.
So the conclusion holds.
5D.3
Suppose is finite-dimensional and . Prove that if the operator is diagonalizable, then .
Proof:
If , then is invertible. So , So .
Now assume , then note .
Since is diagonalizable, then from "5.55 conditions equivalent to diagonalizability", we know
, where for .
Note , so we just need to prove .
Let , then since , we can pick sucht that
Then
Which means
On the other hand, if , then let , we have .
So .
In summary,
Then we have .
5D.4
Suppose is finite-dimensional and . Prove that the following are equivalent.
(a)
(b)
(c)
Proof:
Since , so .
From fundamental theorem of linear mapping, we know
From "2.43 dimension of a sum", we know
Then we have
From (c), we know is a direct sum.
Then from "2.43 dimension of a sum", fundamental theorem of linear mapping and (c), we know
So
5D.5
Suppose is a finite-dimensional complex vector space and . Prove that is diagonalizable if and only if
for every .
Proof:
We use the exercise 5D.3. If is diagonalizable, then using "5.55 conditions equivalent to diagonalizability"
we can find a basis which are all eigenvectors of .
In fact, for any , they are also eigenvectors of . To see this, note
So again use "5.55 conditions equivalent to diagonalizability", we know is also diagonalizable. Then use 5D.3, we have
Strategy:
Assume but , can we prove it's not possible to write
Of course we can do it, because .
Put it formally, let be the minimal polynomial of . Since is a complex vector space,
If are not all different, then we can write as
We can find such that , otherwise and its degree is less than which is contradictary to the assumption that is the minimal polynomial.
Then since
On other other hand , so .
So .
Then
Which is contradictary to our assumption.
Then are all distinct. Then we can use "5.62 necessary and sufficient condition for diagonalizability" To conclude is diagonalizable.
5D.6
Suppose and . Prove that or is invertible.
Proof: We prove by contradition.
Assume and are all non-invertible. Then and .
Then and .
So .
This is contradictary to "5.54 sum of eigenspaces is a direct sum".
So Either or .
So either or is invertible.
5D.7
Suppose is invertible. Prove that
for every with .
Proof:
Let . Since is invertible, then is injective. Furthermore, is invariant under , so is well defined and is also injective, so is invertible.
So we can find such that . So , i.e. .
So
So , then .
Then if we replace with , and replace with , and replace with , we can show
So
5D.8
Suppose is finite-dimensional and . Let denote the distinct nonzero eigenvalues of . Prove that
Proof:
if and , then , so .
Then it means . So we have
Then from "5.54 sum of eigenspaces is a direct sum", we can know
Then from "3.94 a sum is a direct sum if and only if dimensions add up", we know
So, we have
5D.9
Suppose each have as eigenvalues. Prove that there exists an invertible operator such that .
Proof:
Let , since and have 3 different eigenvalues. Then by "5.58 enough eigenvalues implies diagonalizability", we know both have diagonal matrices under some basis.
Assume has a basis and
Similarly, assume has a basis and
Then define as to be
is invertible since is injective. We can also see satisfy:
Then note
The same calculation can be applied to . Since is a basis of of , and when and are applied to them the results are the same. So .
5D.10
Find such that and each have as eigenvalues, and have no other eigenvalues, and there does not exist an invertible operator such that .
Solution:
If , then we use exercise 5A.40 which states:
Suppose and is invertible. Suppose is a polynomial. Then
This means the polynomial of and are actually the same.
So our goal is to find 2 operators sucht that they have as eigenvalues, but their minimal polynomials are not the same.
Let be an operator such that under standard basis, its matrix is
Then it's minimal polynomial is .
Let be an operator such that under standard basis, its matrix is
Then it's minimal polynomial is .
So . Then it's impossible to find an invertible operator such that .