Skip to content
Tutorials Center
My learning

Topics

Lesson 24 of 37 · Differentiation

Differentiation Rules and the Chain Rule

Prove the sum, product, quotient and chain rules from the limit definition, including Caratheodory's trick and the inverse function rule, with numeric checks.

Every derivative formula you used in calculus follows from the limit definition. In this lesson we prove the main rules, so you can see where each hypothesis is used. The chain rule is the subtle one: the naive proof divides by a quantity that may be zero. We repair it with a neat device due to Constantin Carathéodory.

Sum and constant multiple

If f and g are differentiable at a and c is a constant, then (f + g)'(a) = f'(a) + g'(a) and (cf)'(a) = c f'(a). Both follow from the limit laws applied to the difference quotient, since ((f+g)(a+h) - (f+g)(a))/h splits into two quotients.

Product rule

Theorem. If f, g are differentiable at a, then (fg)'(a) = f'(a) g(a) + f(a) g'(a).

Proof. Add and subtract f(a) g(a+h):

Text
f(a+h)g(a+h) - f(a)g(a)
  = [f(a+h) - f(a)] g(a+h) + f(a) [g(a+h) - g(a)].

Divide by h. The first term gives ((f(a+h)-f(a))/h) · g(a+h) → f'(a) g(a), because g is continuous at a (differentiable implies continuous), so g(a+h) → g(a). The second term tends to f(a) g'(a). ∎

Quotient rule

If also g(a) ≠ 0, then (f/g)'(a) = (f'(a) g(a) - f(a) g'(a)) / g(a)². One way to prove it: first show (1/g)'(a) = -g'(a)/g(a)² from

Text
1/g(a+h) - 1/g(a) = ( g(a) - g(a+h) ) / ( g(a) g(a+h) )

(continuity of g ensures g(a+h) ≠ 0 for small h), then apply the product rule to f · (1/g).

Python Numerical check of product and quotient rules

Press Run (or Ctrl + Enter) to see the result here.

Program input · what you'd type while the program runs

Type the answers before you press Run, one per line. Each time the program reads a line (with input()), it gets the next line from this box.

The chain rule and Carathéodory's trick

We want (g ∘ f)'(a) = g'(f(a)) · f'(a). The tempting proof writes

Text
(g(f(x)) - g(f(a))) / (x - a) = (g(f(x)) - g(f(a))) / (f(x) - f(a)) · (f(x) - f(a)) / (x - a),

but f(x) - f(a) can be 0 for x ≠ a arbitrarily close to a (for example f constant), so the division is illegal.

Carathéodory's characterization. f is differentiable at a if and only if there is a function φ, continuous at a, such that

Text
f(x) - f(a) = φ(x) (x - a)   for all x,

and then f'(a) = φ(a). (Take φ(x) = (f(x) - f(a))/(x - a) for x ≠ a and φ(a) = f'(a).) The equation has no division, so zero differences cause no trouble.

Proof of the chain rule. Suppose f is differentiable at a with φ, and g is differentiable at b = f(a) with ψ, so g(y) - g(b) = ψ(y)(y - b). Then

Text
g(f(x)) - g(f(a)) = ψ(f(x)) (f(x) - f(a)) = ψ(f(x)) φ(x) (x - a).

The function x ↦ ψ(f(x)) φ(x) is continuous at a (composition and product of continuous functions), with value ψ(b) φ(a) = g'(f(a)) f'(a) at a. By Carathéodory, g ∘ f is differentiable at a with that derivative. ∎

Python Carathéodory's function phi for x squared

Press Run (or Ctrl + Enter) to see the result here.

Program input · what you'd type while the program runs

Type the answers before you press Run, one per line. Each time the program reads a line (with input()), it gets the next line from this box.

The table makes the point: phi is defined everywhere, equals x + a away from a, and the identity holds even at x = a.

Inverse functions

Theorem. Suppose f is continuous and strictly increasing (or strictly decreasing) on an interval, differentiable at a, with f'(a) ≠ 0. Then f⁻¹ is differentiable at b = f(a) and (f⁻¹)'(b) = 1 / f'(a).

Sketch: with y = f(x), the quotient (f⁻¹(y) - f⁻¹(b))/(y - b) = (x - a)/(f(x) - f(a)), the reciprocal of the difference quotient of f. Continuity of f⁻¹ (a consequence of strict monotonicity on an interval) ensures x → a when y → b. Example: f(x) = sin x on (-π/2, π/2), f⁻¹ = arcsin, so arcsin'(y) = 1/cos x = 1/√(1 - y²).

Python Verify the inverse and chain rules symbolically

Press Run (or Ctrl + Enter) to see the result here.

Program input · what you'd type while the program runs

Type the answers before you press Run, one per line. Each time the program reads a line (with input()), it gets the next line from this box.

Check your understanding

Quick check · 4 questions

of 4 answered You scored / 4 · perfect!

  1. 1. In the proof of the product rule, why does g(a + h) tend to g(a)?

    Differentiability at a implies continuity at a.
  2. 2. What problem does Caratheodory's trick avoid in the chain rule?

    The identity f(x) - f(a) = phi(x)(x - a) has no division, so zero differences are harmless.
  3. 3. If f is strictly increasing and differentiable at a with f'(a) not 0, then the derivative of the inverse at f(a) is:

    The inverse's difference quotient is the reciprocal of f's difference quotient.
  4. 4. For the quotient rule we need which extra hypothesis?

    We divide by g, so g(a) must be nonzero.

Summary

  • Sum, product and quotient rules come from splitting and recombining difference quotients, using continuity of differentiable functions.
  • Carathéodory: f is differentiable at a iff f(x) - f(a) = φ(x)(x - a) with φ continuous at a; then f'(a) = φ(a).
  • The chain rule follows by multiplying the two φ functions.
  • The inverse of a strictly monotone differentiable function with f'(a) ≠ 0 has derivative 1/f'(a).

Next: The Mean Value Theorem