Chapter 4 The Derivative

4.2 New Environment: The Bachmann–Landau Notation

Definition 4.2.1 (-mapping, -mapping, -mapping).

Consider a mapping from some ball about the origin in one Euclidean space to a second Euclidean space,

where and are positive integers and is a positive real number. The mapping is smaller than order if

for every , for all small enough .

The mapping is of order if

for some , for all small enough .

The mapping is smaller than order if

for every , for all small enough .

A mapping smaller than order is denoted , a mapping of order is denoted , and a mapping smaller than order is denoted . Also can denote the collection of -mappings, and similarly for and .

Proposition 4.2.3 (Dominance principle for the Landau spaces).

Let be , and suppose that for all small enough . Then also is . And similarly for and for .

Proposition 4.2.4 (Vector space properties of the Landau spaces).

For every fixed domain-ball and codomain-space , the -mappings form a vector space, and forms a subspace, of which forms a subspace in turn. Symbolically,

Proof:

:

Assume are , for any given , we can find such that when , . Similarly, we can find such that when , .

Then let , when ,

For the scalor multiplication, given , we want to show is also . For any given , we can find , such that if , .

So

:

Assume are . We can find , if . We can find , if .

Let , when ,

For the scalor multiplication, given , we want to show is also .

Note , so is also .

:

Assume are , for any given , we can find such that when , . Similarly, we can find such that when , .

Then let , when ,

For the scalor multiplication, given , we want to show is also . For any given , we can find , such that if , .

So

Proposition 4.2.5.

Every linear mapping is . The only linear mapping is the zero mapping.

Proof:

Let , The unit sphere in is compact.

is linear, then we can find matrix , such that . Then , then . When is small, is also small. So each component is continuous. So is continuous.

Then the image of unit sphere is also compact. Since is also continuous, then we can find , such that for all .

Then for any , , then .

Assume is non-zero, . For any ,

Proposition 4.2.6 (Product property for Landau functions).

Consider two scalar-valued functions and their product function,

If is and is then is . Especially, the product of two linear functions is .

Proof:

Given .

Since is , we can find such that if .

For , since it's , we can find , if , .

Let , if , then .

Proposition 4.2.7 (Composition properties of the Landau spaces).

The composition of -mappings is again an -mapping. Also, the composition of -mappings is again an -mapping. Furthermore, the composition of an -mapping and an -mapping, in either order, is again an -mapping. Symbolically,

That is, and absorb themselves, and absorbs from either side.

Proof:

Assume are both .

Given .

Since is , we can find , such that if , .

Since is , we can find , such that if , .

Let , if , .

Then


Assume are both .

Since is , we can find and , such that if ,

Since is , we can find and , such that if ,

Let , if , .

Then

So we find .


Assume is and is .

Given .

Since is , we can find and , such that if ,

Since is , we can find , if , .

So let , so . Then


Assume is and is .

Given .

Since is , we can find and , such that if ,

Since is , we can find , if , .

So let , so .

4.3 One-Variable Revisionism: The Derivative Redefined

The one-variable derivative as recalled at the beginning of the chapter,

is a construction. To rethink the derivative, we should characterize it instead.

Consider

To reiterate, the idea that f has a tangent of slope t at has been normalized to the tidier idea that has slope at the origin:

To say that the graph of is horizontal at the origin is to say that for every positive real number , however small, the region between the lines of slope contains the graph of close enough to the origin.

that is

The intuitive condition for the graph of to be horizontal at the origin is precisely that is . The horizontal nature of the graph of at the origin connotes that the graph of has a tangent of slope at .

Definition 4.3.1 (Interior point).

Let be a subset of , and let a be a point of . Then is an interior point of if some -ball about is a subset of . That is, is an interior point of if for some .

Definition 4.3.2 (Derivative).

Let be a subset of , let be a mapping, and let be an interior point of . Then is differentiable at if there exists a linear mapping satisfying the condition

This is called the derivative of at , written or . When is differentiable at , the matrix of the linear mapping is written and is called the Jacobian matrix of at .

Proposition 4.3.3 (Uniqueness of the derivative).

Let (where ) be differentiable at . Then there is only one linear mapping satisfying the definition of .

Proof:

Assume we have ,

Since the only linear mapping is mapping, then .

Proposition 4.3.4.

If is differentiable at then is continuous at .

Proof:

4.4 Basic Results and the Chain Rule

Proposition 4.4.1 (Derivatives of constant and linear mappings).

(1) Let (where ) be the constant mapping for all , where is some fixed value in . Then the derivative of at every interior point of is the zero mapping.

Proof:

(2) The derivative of a linear mapping at every point is again .

Proof:

Proposition 4.4.2 (Linearity of the derivative).

Let (where ) and (where ) be mappings, and let a be a point of . Suppose that and are differentiable at a with derivatives and . Then:

(1) The sum is differentiable at with derivative .

Proof:

(2) For every , the scalar multiple is differentiable at with derivative .

Proof:

Theorem 4.4.3 (Chain rule).

Let (where ) be a mapping, let be a set containing , and let be a mapping. Thus the composition is defined. If is differentiable at the point , and is differentiable at the point , then the composition is differentiable at the point , and its derivative there is

In terms of Jacobian matrices, since the matrix of a composition is the product of the matrices, the chain rule is

Proof:

For simplicity, we first take and .

Then

Then for the general

Then

Lemma 4.4.4 (Derivatives of the product and reciprocal functions).

Define the product function,

and define the reciprocal function

Then

(1) The derivative of at every point exists and is

Proof:

Since , so .

(2) The derivative of at every nonzero real number a exists and is

Proof:

Since when , .

So it's .

Proposition 4.4.5 (Multivariable product and quotient rules).

Let (where ) and (where ) be functions, and let and differentiable at . Then:

(1) is differentiable at with derivative

Proof:

Consider

Then .

Note , so we have

(2) If then is differentiable at a with derivative

Proof:

Consider

So

Then .

Note , so we have

So

Another example

Consider for all

Let

Then

Let

Then note

Also note

Combine these together, we have

This results are confirmed by the textbook.

Now we can follow the approach in the text book.