Skip to content
Tutorials Center
My learning

Topics

Lesson 14 of 37 ยท Sequences and Limits

Cauchy Sequences

Define Cauchy sequences, prove they converge in the real numbers, and see why this gives a limit test that needs no knowledge of the limit.

The definition of convergence mentions the limit L, so to use it you must already know (or guess) L. A Cauchy sequence removes that requirement: it only compares the terms with each other. The big theorem of this lesson says that in โ„, a sequence is Cauchy exactly when it converges. This is another face of completeness and it is the basis of how mathematicians construct limits in more general spaces.

The definition

A sequence (a_n) is Cauchy if

for every ฮต > 0 there exists N such that for all m, n โ‰ฅ N, |a_m โˆ’ a_n| < ฮต.

Intuition: far enough along, any two terms are within ฮต of each other, so the terms bunch together.

Fact 1. Every convergent sequence is Cauchy. If a_n โ†’ L, choose N with |a_n โˆ’ L| < ฮต/2 for n โ‰ฅ N. For m, n โ‰ฅ N, |a_m โˆ’ a_n| โ‰ค |a_m โˆ’ L| + |L โˆ’ a_n| < ฮต. โˆŽ

Fact 2. Every Cauchy sequence is bounded. (Take ฮต = 1: beyond N, all terms lie within 1 of a_N; only finitely many terms come before.)

Cauchy implies convergent in โ„

Theorem (Cauchy criterion). A sequence of real numbers converges if and only if it is Cauchy.

Proof of "Cauchy โ‡’ convergent". A Cauchy sequence is bounded, so by Bolzano-Weierstrass it has a subsequence a_{n_k} โ†’ L. We show the whole sequence converges to L. Let ฮต > 0. Choose N with |a_m โˆ’ a_n| < ฮต/2 for m, n โ‰ฅ N, and choose k with n_k โ‰ฅ N and |a_{n_k} โˆ’ L| < ฮต/2. For n โ‰ฅ N:

|a_n โˆ’ L| โ‰ค |a_n โˆ’ a_{n_k}| + |a_{n_k} โˆ’ L| < ฮต/2 + ฮต/2 = ฮต. โˆŽ

The subtlety is that this proof uses completeness (through Bolzano-Weierstrass). In โ„š the statement is false: the decimal approximations 1, 1.4, 1.41, 1.414, ... of โˆš2 form a Cauchy sequence of rationals with no limit in โ„š. A set where every Cauchy sequence converges is called complete.

Python A Cauchy sequence of rationals with no rational limit

Press Run (or Ctrl + Enter) to see the result here.

Program input ยท what you'd type while the program runs

Type the answers before you press Run, one per line. Each time the program reads a line (with input()), it gets the next line from this box.

The gaps between neighbors shrink (Cauchy), the squares approach 2, but no rational has square exactly 2.

Why use the Cauchy criterion?

  1. No limit needed. To show an iterative algorithm converges, show the successive differences are small.
  2. Contractive sequences. If |a_{n+2} โˆ’ a_{n+1}| โ‰ค c |a_{n+1} โˆ’ a_n| with 0 < c < 1, then (a_n) is Cauchy and hence converges. Proof: for m > n, by the triangle inequality and a geometric sum, |a_m โˆ’ a_n| โ‰ค |a_{n+1} โˆ’ a_n| (1 + c + cยฒ + ...) โ‰ค c^{nโˆ’1}|a_2 โˆ’ a_1|/(1 โˆ’ c), which is small for large n.
  3. Series. A series converges if and only if its partial sums are Cauchy (next chapter).

Example. a_1 = 1, a_{n+1} = 1/(2 + a_n). Then a_{n+2} โˆ’ a_{n+1} = (a_n โˆ’ a_{n+1})/((2 + a_{n+1})(2 + a_n)) and since all terms are positive the denominator exceeds 4, so c = 1/4 works. The sequence converges, to the positive solution of L = 1/(2 + L), namely L = โˆš2 โˆ’ 1.

Python A contractive recursion

Press Run (or Ctrl + Enter) to see the result here.

Program input ยท what you'd type while the program runs

Type the answers before you press Run, one per line. Each time the program reads a line (with input()), it gets the next line from this box.

The observed ratios of successive gaps are below 1/4, matching the proof, so the sequence is Cauchy.

It is not enough that |a_{n+1} โˆ’ a_n| โ†’ 0. The partial sums 1 + 1/2 + ... + 1/n have steps 1/(n+1) โ†’ 0 but diverge. A Cauchy sequence must have |a_m โˆ’ a_n| small for all pairs beyond N, not only neighbors.

Summary of three equivalent routes (in โ„)

Route Statement
Definition there is L with a_n โ†’ L
Monotone monotone and bounded
Cauchy terms eventually pairwise close

The first two require the order structure; the third works in any metric space, which is why it matters beyond this course.

Check your understanding

Quick check ยท 4 questions

of 4 answered You scored / 4 ยท perfect!

  1. 1. What does Cauchy mean for (a_n)?

    A Cauchy sequence compares terms with each other, not with a limit.
  2. 2. In โ„, a sequence converges if and only if it is

    That is the Cauchy criterion, a form of completeness.
  3. 3. Why is the Cauchy criterion false in โ„š?

    โ„š has a gap at โˆš2.
  4. 4. Is 1 + 1/2 + ... + 1/n a Cauchy sequence?

    Steps tending to 0 do not suffice. The harmonic partial sums are unbounded, so they cannot be Cauchy.

Summary

  • Cauchy: terms eventually pairwise within ฮต; no limit is mentioned.
  • Convergent sequences are Cauchy; Cauchy sequences are bounded.
  • In โ„, Cauchy implies convergent (via Bolzano-Weierstrass); in โ„š it fails.
  • Contractive recursions are Cauchy, so they converge.
  • Small consecutive steps alone do not imply Cauchy.

Next: Infinite Series: Basics