Chapter 08 Additional Topics
8.1 The Generalized Riemann Integral
Exercise 8.1.1
Let be an arbitrary tagged partition of that is -fine, and let .
(a) Explain why both the Riemann sum and fall between and .
Proof: Since is an upper bound of and a lower bound of , so fall between and .
Since , also fall between and .
(b) Explain why .
Proof:
Since , we have
8.1.2.
Explain why .
Proof: See previous exercise.
8.1.3.
(a) In terms of , what is the largest number of terms of the form that could appear in one of or but not the other?
Solution: Note that , and since has segments, so has at most points more than .
If these points fall into different segments of , then we can achive the largest number of terms of the form that appears in one of or but not the other, which is .
(b) Finish the proof in this direction by arguing that
Proof: Now we can bound
Combine the previous exercises, we have
So .
8.1.4.
(a) Show that if is continuous, then it is possible to pick tags so that .
Proof: Since is continuous, for each segment , because of extreme value theorem, it is possible to find such that . Pick those , we have .
(b) If is not continuous, it may not be possible to find tags for which . Show, however, that given an arbitrary , it is possible to pick tags for so that
The analogous statement holds for lower sums.
Proof: For each segment , is the supremum of for . So we can find such that .
Pick those , we have .
8.1.5.
Use the results of the previous exercise to finish the proof of Theorem 8.1.2.
Proof: Given , we can find partition , such that any -fine tagged partition . , such that . Similarly, .
Let , so
Gauges and δ(x)-fine Partitions
Definition 8.1.3.
A function is called a gauge on if for all .
Definition 8.1.4.
Given a particular gauge , a tagged partition is -fine if every subinterval satisfies .
In other words, each subinterval has width less than .
8.1.6.
Consider the interval [0,1].
(a) If , find a -fine tagged partition of . Does the choice of tags matter in this case?
Solution:
Let . The choice of tags does not matter.
(b) Let
Construct a -fine tagged partition of .
Solution:
Let .
Theorem 8.1.5.
Given a gauge on an interval , there exists a tagged partition that is -fine.
Proof. Let . It may be possible to find a tag such that the trivial partition works.
Specifically, if for some , then we can set equal to such an and notice that is -fine. If no such exists, then bisect into two equal halves.
Exercise 8.1.7.
Finish the proof of Theorem 8.1.5.
Proof: Assume otherwise, then this process continuous indefinitely, then we get a nested intervals. Because of NIP, we can find in all these intervals. That means for all . But So we have a contradiction.
Definition 8.1.6.
A function on has generalized Riemann integral if, for every , there exists a gauge on such that for each tagged partition that is -fine, it is true that
In this case, we write .
Theorem 8.1.7.
If a function has a generalized Riemann integral, then the value of the integral is unique.
Exercise 8.1.8.
Finish the argument.
Proof: Assume that a function has generalized Riemann integral and that it also has generalized Riemann integral . We must prove .
Since is generalized Riemann integrable, given , we can find , such that if a tagged partition is -fine, then .
Similarly, we can find , such that if a tagged partition is -fine, then .
Now we can define . From Theorem 8.1.5, we can find a tagged partition that is -fine.
If is -fine, it has to be -fine. This is because
So .
For the same reason, is -fine, it has to be -fine, and .
Since
And can be arbitrary, so .
Exercise 8.1.9
Explain why every function that is Riemann-integrable with must also have generalized Riemann integral .
Proof: If is Riemann-integrable, then for any , we can find , any tagged partition is -fine then .
Let this be the gauge, we can see is generalized Riemann integrable.
Theorem 8.1.8.
Dirichlet’s function is generalized Riemann-integrable on with .
Proof: Let ϵ > 0. By Definition 8.1.6, we must construct a gauge on [0,1] such that whenever is -fine tagged partition, it follows that
The gauge represents a restriction on the size of in the sense that .
The Riemann sum consists of products of the form . Thus, for irrational tags, there is nothing to worry about because in this case. Our task is to make sure that any time a tag is rational, it comes from a suitably thin subinterval.
Let be an enumeration of the countable set of rational numbers contained in . For each , set . For x irrational, set .
Exercise 8.1.10.
Show that if is a -fine tagged partition, then .
Proof:
If is irrational, then . Otherwise, . So .
Theorem 8.1.9.
Assume is differentiable at each point in , and set . Then, has the generalized Riemann integral
Proof. Let be a partition of . Both this proof and the proof of Theorem 7.5.1 make use of the following fact.
Exercise 8.1.11.
Show that
Proof: It is obvious.
If is a set of tags for , then we can estimate the difference between the Riemann sum and by
Let . To prove the theorem, we must construct a gauge such that
for all that are -fine. (Using the variable in the gauge function is more convenient than in this case.)
Exercise 8.1.12.
For each , explain why there exists a (a depending on ) such that
for all .
Proof:
Since is differential at , that means
i.e. given , for , we can find a , as long as ,
Exercise 8.1.13.
(a) For a particular of , show that
and
Proof: Since , then
i.e.
The other part is the same.
(b) Now, argue that
and use this fact to complete the proof of the theorem.
Proof:
Then we have
Then we proved Theorem 8.1.9.
If we consider the function
then it is not too difficult to show that is differentiable everywhere, including , with
What is notable here is that the derivative is unbounded near the origin. The theory of the ordinary Riemann integral begins with the assumption that we only consider bounded functions on closed intervals, but there is no such restriction for the generalized Riemann integral. Theorem 8.1.9 proves that has a generalized integral.
Now, improper Riemann integrals have been created to extend Riemann integration to some unbounded functions, but it is another interesting fact about the generalized Riemann integral that any function having an improper integral must already be integrable in the sense described in Definition 8.1.6.
Theorem 8.1.10 (Change-of-variable Formula).
Let be differentiable at each point of , and assume is differentiable on the set . If for all , then
Proof. The hypothesis of the theorem guarantees that the function is differentiable for all .
Exercise 8.1.14.
(a) Why are we sure that and have generalized Riemann integrals?
Proof: This is because is differentiable and . Since is also differentialble, then is differentialble. And is its derivative.
(b) Use Theorem 8.1.9 to finish the proof.
Proof:
On the left side
So
On the right side
8.3 Euler’s Sum
In Section 6.1 we saw Euler’s first and most famous derivation of the formula
At the crux of this argument are two representations for the function . The first is the standard Taylor series representation
and the second is an infinite product representation
Wallis’s Product
Exercise 8.3.1.
Supply the details to show that when the product formula in (2) is equivalent to
Proof:
We plug the into equation (2).
Exercise 8.3.2.
Assume and have continuous derivatives on and derive the familiar integration-by-parts formula
Proof: See exercise 7.5.6.
Exercise 8.3.3.
(a) Using the simple identity and the previous exercise, derive the recurrence relation
Proof:
So we have
So,
(b) Use this relation to generate the first three even terms and the first three odd terms of the sequence .
(c) Write a general expression for and
and
Exercise 8.3.4.
Show
and use this fact to finish the proof of Wallis’s product formula in (3).
Proof:
Because , so
So
Then it's easy to see product formula in (3) holds.
Exercise 8.3.5.
Derive the following alternative form of Wallis’s product formula:
Proof:
We know
So
So
Taylor Series
Exercise 8.3.6.
Show that has Taylor expansion , where and
for .
Solution:
Then
Exercise 8.3.7.
Show that but diverges.
Proof:
is a decreasing and bigger than , so converges. if , then
Now note
So we have
So diverges.
The divergence of makes sense when we consider the Taylor series for . We want to determine the values of for which
Exercise 8.3.8.
Using the expression for from Lagrange’s Remainder Theorem, show that equation (4) is valid for all . What goes wrong when we try to use this method to prove (4) for ?
Solution:
The Lagrange's Remainder is
Fix , then . So . . So .
So .
When , we cannot guarantee
Theorem 8.3.1 (Integral Remainder Theorem).
Let be differentiable times on and assume is continuous. Define for , and let
For all , the error function satisfies
Proof. The case is easy to check, so let’s take in and keep in mind that is a fixed constant in what follows. To avoid a few technical distractions, let’s just consider the case .
Exercise 8.3.9.
(a) Show
Proof: is differentiable, so it's continuous. So it's integrable. From theorem 7.5.1, then
(b) Now use a previous result from this section to show
Proof:
We use integration-by-parts, and let
So
(c) Continue in this fashion to complete the proof of the theorem.
Proof:
Let .
Consider
So we have
Exercise 8.3.10.
(a) Make a rough sketch of and over the interval , and compute for , and .
Solution:
So .
Here are the python code to plot and compute .
import numpy as np
import matplotlib.pyplot as plt
# Define the range of x values, avoiding the point where the function is undefined
x = np.linspace(-1, 0.99, 400) # 400 points between -1 and 0.99
# Compute the function values
y = 1 / np.sqrt(1 - x)
z = 1 + (1/2) * x + (3/8) * (x**2)
# Plot the function
plt.plot(x, y)
plt.plot(x, z)
plt.title('Plot of $1/\sqrt{1-x}$ and $1 + (1/2)x + (3/8)x^2$')
plt.xlabel('x')
plt.ylabel('1/sqrt(1-x)')
plt.grid(True)
plt.show()
x = np.array([1/2, 3/4, 8/9])
y = 1 / np.sqrt(1 - x)
z = 1 + (1/2) * x + (3/8) * (x**2)
e = y - z
print(e)
The for , and are
(b) For a general satisfying , show
Proof:
So we proved.
(c) Explain why the inequality
is valid, and use this to find an overestimate for that no longer involves an integral. Note that this estimate will necessarily depend on . Confirm that things are going well by checking that this overestimate is in fact larger than at the three computed values from part (a).
Proof:
Assume . Then , , so
If , then so , so , i.e.
In both cases, we proved it.
For , and are, the errors are
(d) Finally, show as for an arbitrary .
Proof:
We have
So
Since and , then .
The next step is to take the term-by-term anti-derivative of this series. Any time we start manipulating infinite series as though they were finite in nature we need to pause and make sure we are on solid footing.
Exercise 8.3.11.
Assuming that the derivative of is indeed supply the justification that allows us to conclude
Proof: Since converges for , and , then converges for .
Let
From theorem 6.5.7, is differentiable and . So . Since , then , for .
Exercise 8.3.12.
Our work thus far shows that the Taylor series in (5) is valid for all , but note that is continuous for all . Carefully explain why the series in (5) converges uniformly to on the closed interval .
Proof: Consider
Since
Then
when is large, .
So
So
converges. Since it's all positive, it converges absolutely. Then (5) also converges in .
Summing
Every proof of Euler’s sum contains a moment of genuine ingenuity at some point, and this is where our proof takes an unanticipated turn.
Let’s make the substitution in (5) where we restrict our attention to . The result is
which converges uniformly on .
Exercise 8.3.13.
(a) Show
being careful to justify each step in the argument. The term refers back to our earlier work on Wallis’s product.
Proof: let
So uniformly, then
(b) Deduce
and use this to finish the proof that .
Proof:
So
On the left side, .
So we proved the first part.
Let
Then
So .
8.4 Inventing the Factorial Function
Exercise 8.4.2.
Verify that the series converges absolutely for all , that is differentiable on , and .
Proof: Fix any , we can find . Let and
For , . So converges absolutely. Then we can apply Theorem 6.5.7 to know that is differentiable on , and .
Exercise 8.4.3.
(a) Use the results of Exercise 2.8.7 and the binomial formula to show that for all .
Proof: Fix and . Let
Then note
Use the results of Exercise 2.8.7, converges and it converges .
On the other hand, .
So .
(b) Show that , and for all .
Proof:
Also
So .
Also since if , then , then .
Exercise 8.4.4.
Define . Show and for all .
Proof:
We also have
So . So .
Definition 8.4.1.
Given , we say that if for all , there exists such that whenever it follows that
Exercise 8.4.5.
Show for all .
Proof:
Exercise 8.4.6.
(a) Explain why we know has an inverse function—let’s call it —defined on the strictly positive real numbers and satisfying
(i) for all and
(ii) , for all .
(b) Prove . (See Exercise 5.2.12.)
Proof:
Let
(c) Fix and differentiate with respect to . Conclude that
Proof: Also see exercise Exercise 7.5.8 (Natural Logarithm and Euler’s Constant).
Since , so
Since , we can plug and get .
(d) For and , has the usual interpretation as ( times). Show that
Proof:
From (c), we know
And from (a), we know
So (2) holds.
Definition 8.4.2.
Given , define the exponential function to be
Exercise 8.4.7.
(a) Show for all .
Proof:
Let , then , , i.e. , i.e. , i.e. .
So
(b) Show , for all and .
Proof: Note
So .
(c) Show is differentiable on and find the derivative.
Proof: Because , let
which is differentiable, and let which is also differentiable, then their composite function is also differentiable.
Exercise 8.4.8.
Inspired by the fact that and , let satisfy
(i) for all , and
(ii) for all .
(a) Find a formula for on , , and for arbitrary .
(b) (c) skipped
Improper Riemann Integrals
Definition 8.4.3.
Assume is defined on and integrable on every interval of the form . Then define to be
provided the limit exists. In this case we say the improper integral converges.
Exercise 8.4.9.
(a) Show that the improper integral converges if and only if, for all there exists such that whenever it follows that
(In one direction it will be useful to consider the sequence .
Proof:
Assume converges, and assume , then we can find , if , then
Consider ,
Consider then is Cauchy sequence and assume .
For , we can find , such that ,
We can also find , if , then . Then let .
If , and find such that then
So
(b) Show that if and converges then converges.
Proof: Since converges, then we can find , if then . Since , then
(c) Part (a) is a Cauchy criterion, and part (b) is a comparison test. State and prove an absolute convergence test for improper integrals.
Proof: The absolute convergence test for improper integrals is: if is integrable on any interval and converges, then converges.
Since is integrable on any interval , then from Theorem 7.4.2. (v), is also integrable on any interval . Since converges, we can find a such that , then
Again from Theorem 7.4.2. (v)
Then from part (a) converges.
Exercise 8.4.10.
(a) Use the properties of previously discussed to show
Proof: is continuous on , so it's integrable. Then we can use the first part of theorem 7.5.1, let
and , so
(b) Show
Proof:
is continuous on , so it's integrable.
Let
and .
Exercise 8.4.11.
(a) Evaluate using the integration-by-parts formula from Exercise 7.5.6. The result will be an expression in α and b.
Solution:
Let
Then
$$ \int_{0}^{b} t e^{-\alpha t} = \int_{0}^{b} k(t) h'(t) = h(b) k(b) - h(0) k(0) - \int_{0}^{b} k'(t) h(t) = \ - \frac{1}{\alpha } e^{-\alpha b} \cdot b -
\int_{0}^{b} -\frac{1}{\alpha } e^{-\alpha t} dt \
\frac{1}{\alpha } \int_{0}^{b} e^{-\alpha t} dt - \frac{b}{\alpha } e^{-\alpha b} \ = \frac{1}{\alpha } (\frac{1}{\alpha} - \frac{1}{\alpha } e^{-\alpha b}) - \frac{b}{\alpha } e^{-\alpha b} $$
(b) Now compute
and verify equation (4).
Solution:
Differentiating Under the Integral
- Our sense of distance between points and with the familiar Euclidean distance formula
Definition 8.4.4.
A function is continuous at if for all , there exists such that whenever , it follows that
Exercise 8.4.12.
Assume the function is continuous on the rectangle . Explain why the function
is properly defined for all .
Proof: Fix , is a continuous function defined on . So it is integrable. So
exists.
It should not be too surprising that Theorem 4.4.7 has an analogue in the setting. The set is compact in , and a continuous function on is uniformly continuous in the sense that the in Definition 8.4.4 can be chosen independently of the point .
Theorem 8.4.5.
If is continuous on , then is uniformly continuous on .
Exercise 8.4.13.
Prove Theorem 8.4.5.
Proof: We will prove is continuous first. Given in and , since is uniformly continuous on , we can find , as long as , for all .
So
Since is continuous then is uniformly continuous.
Taking inspiration from equations (3) and (4), let’s add the assumption that for each fixed value of in , the function is a differentiable function of ; that is,
exists for all . In addition, let’s assume that the derivative function is continuous.
Theorem 8.4.6.
If and are continuous on , then the function is differentiable and
Proof. Fix in and let be arbitrary. Our task is to find a such that
whenever .
Exercise 8.4.14.
Finish the proof of Theorem 8.4.6
Proof:
Because
Improper Integrals, Revisited
Theorem 8.4.6 is a formal justification for differentiating under the integral sign, but we need to extend this result to the case where the integral is improper. Looking back one more time to our motivating example in equation (3), we see that what we have is a function where the domain of the variable is the unbounded interval .
Let’s fix from some set . For such an , we define
provided the limit exists.
As we have seen on numerous occasions, the elixir required to ensure that good behavior in the finite setting extends to the infinite setting is uniformity.
Definition 8.4.7.
Given defined on , assume exists for all . We say the improper integral converges uniformly to on if for all , there exists such that
for all and all .
Exercise 8.4.15.
(a) Show that the improper integral converges uniformly to on the set .
Proof:
It does not depend on .
(b) Is the convergence uniform on ?
Solution: No. For any fixed , , but give any , let
Exercise 8.4.16.
Prove the following analogue of the Weierstrass M-Test for improper integrals: If satisfies for all and converges, then converges uniformly on .
Proof:
Given , since converges, we can find , if , we have .
Then
Then given any , we can find , such that
Then
An immediate consequence of Definition 8.4.7 is that if the improper integral converges uniformly then the sequence of functions defined by
converges uniformly to on . This observation gives us access to the host of useful results we developed in Chapter 6.
Theorem 8.4.8.
If is continuous on , then
is uniformly continuous on , provided the integral converges uniformly.
Proof:
Let
From theorem 8.4.5., then is continuous. Since the integral converges uniformly, then converges to uniformly. Then according to theorem 6.2.6, is continuous.
Theorem 8.4.9.
Assume the function is continuous on and exists for each . If the derivative function exists and is continuous, then
provided the integral in (7) converges uniformly.
Exercise 8.4.18.
Prove Theorem 8.4.9.
Proof:
Let .
Again, consider
And let .
Since and are continuous on , then from theorem 8.4.6, .
Since converges to and converges uniformly to , then from theorem 6.3.1, is differentiable and .
The Factorial Function
It’s time to return our attention to equation (3) from earlier in this section:
Exercise 8.4.19.
(a) Although we verified it directly, show how to use the theorems in this section to give a second justification for the formula
Proof: Consider , and .
is also continuous on .
$$ \int_{0}^{b} t e^{-x t} = \int_{0}^{b} k(t) h'(t) = h(b) k(b) - h(0) k(0) - \int_{0}^{b} k'(t) h(t) = \ - \frac{1}{x } e^{-x b} \cdot b -
\int_{0}^{b} -\frac{1}{x } e^{-x t} dt \
\frac{1}{x } \int_{0}^{b} e^{-x t} dt - \frac{b}{x } e^{-x b} \ = \frac{1}{x } (\frac{1}{x} - \frac{1}{x } e^{-x b}) - \frac{b}{x } e^{-x b} \ = \frac{1}{x^2} - \frac{1}{x^2} e^{-x b} - \frac{b}{x } e^{-x b} $$
So
converges uniformly. We can apply theorem 8.4.9:
So,
Then we can plug back.
(b) Now derive the formula
Proof:
First, we prove for any .
Since
So
The improper integral converges. So from exercise 8.4.16, converges uniformly.
We can use induction, assume the improper integral holds
Then is continuous, continuous and converges uniformly.
So we have
Definition 8.4.10.
For , define the factorial function
Exercise 8.4.20.
(a) Show that is an infinitely differentiable function on and produce a formula for the nth derivative. In particular show that .
Proof: Let . Given , since and are continuous functions on , so they are integrable.
Also, if , we can find , such that . then for ,
define as
So
Since the improper integral converges, then converges uniformly.
Now, let's consider the nth derivative of w.r.t :
Note that is not defined at . But we can use L’Hospital’s Rule: ∞/∞ case:
Thus we can define .
When , and
where is a constant independent of . So the improper integral converges uniformly.
So the nth derivative is
And the 2nd derivative is
For any , , so .
(b) Use the integration-by-parts formula employed earlier to show that satisfies the functional equation.
Proof:
So let then
When , we have
Theorem 8.4.11 (Bohr–Mollerup Theorem).
There is a unique positive function defined on satisfying
(i)
(ii) , and
(iii) is convex.
Because satisfies properties (i), (ii), and (iii), it follows that .
Proof: We need one more geometrically plausible fact about convex functions. If and are two intervals in the domain of a convex function , and and , then the slopes of the chords over these intervals satisfy
Because satisfies properties (i) and (ii) we know for all . Now fix and .
Exercise 8.4.21.
(a) Use the convexity of and the three intervals , , and to show
Proof:
This is the same as it asks.
(b) Show
Proof:
Since
Then with exercise 8.4.6 (c), so we proved.
(c) Now establish that
Proof:
We use (a) - and get
(d) Conclude that
Proof:
This is because
(e) Finally, show that the conclusion in (d) holds for all .
Proof:
Assume then , .
Then we can use induction for all .
Because we have arrived at an explicit formula for , the function must be unique. By virtue of the fact that satisfies conditions (i), (ii), and(iii) of the theorem, we can conclude that is this unique function; i.e., . Thus, not only have we proved the theorem, but we have also discovered analternate representation for the factorial function called the Gauss product formula:
For all .
Recall that when is extended to all of via the functional equation we get asymptotes at every negative integer. Thus, there is a compelling reason to consider the reciprocal function which we can take to be zero for .
Exercise 8.4.22.
(a) Where does equal zero? What other familiar function has the same set of roots?
Solution: for every integer. also has the same set of roots.
(b) The function provides the raw material for the all-important Gaussian bell curve from probability, where it is known that
Use this fact (and some standard integration techniques) to evaluate .
Solution:
Consider the integral
We apply 7.5.10 Change-of-variable Formula and let . So
Let , then
So
(c) Now use (a) and (b) to conjecture a striking relationship between the factorial function and a well-known function from trigonometry.
Solution:
So
So my conjecture is
Exercise 8.4.23.
As a parting shot, use the value for and the Gauss product formula in equation (9) to derive the famous product formula for discovered by John Wallis in the 1650s
Proof:
We plug , and take square on both side. Then we have