1. Convergence criteria for series with positive terms
In this section by a series with positive terms we shall understand (by an abuse of language) a series (un) of real terms such that un≥0starting from some particular value of n. Everything we shall say about such series will extend immediately by a change of sign to series all of whose terms are ≤0 starting from some particular value of n. We have seen (II, p. 64, Example 3) that to every sequence (un)n≥1 of points in a normed space E one can associate a step function u defined on [1,+∞[ by the conditions u(x)=un for n≤x<n+1: then the series (un) converges if and only if the integral ∫1+∞u(t)dt converges.
Let (un) and (vn) be two series with positive terms, and u and v the associated step functions: the relation un≤vn for n≥n0 is equivalent to u(x)≤v(x) for x≥n0. Thus each of the relations un≼vn,un≪vn,un∼vn is equivalent to u(x)≼v(x),u(x)≪v(x) and u(x)∼v(x) respectively; this remark allows us to translate propositions 1 (V, p. 228) and 6 (V, p. 230) as follows:
Proposition 1
Let* (un)and(vn)be two series with positive terms. Ifun≼vnand if the series(vn)converges, then(un)converges; ifun≻vnand if∑n=1∞vn=+∞, then∑n=1∞un=+∞.
Proposition 2
Let* (un)and(vn)be two series with positive terms: 1. If the series(vn)converges then the relationun≪vn(resp.un∼vn) implies∑p=n∞up≪∑p=n∞vp(resp.∑p=n∞up∼∑p=n∞vp). 2. If∑n=1∞vn=+∞then the relationun≪vn(resp.un∼vn) implies∑p=1nup≪∑p=1nvp(resp.∑p=1nup∼∑p=1nvp).
One obtains convenient convergence criteria by taking for the comparison series (vn) in prop. 1 a series whose terms are of the form vn=f(n), where f is a function ≥0 defined for every real number x>x0 and decreasing on the interval [x0,+∞[; indeed:
Proposition 3 (Cauchy-Maclaurin criterion)
If* fis a function≥0and decreasing on[x0,+∞[, then the series with general termvn=f(n)converges if and only if the integral∫x0+∞f(t)dtconverges.
To prove this it is sufficient to note that if v is the step function associated with the series (vn) then v(x+1)≤f(x)≤v(x) for every x≥x0 since f is decreasing; the proposition is thus a consequence of the comparison principle (II, p. 66, prop. 3).
Since the functions which feature in the logarithmic convergence criteria for integrals (V, p. 229, prop. 2, 3 and 4) are decreasing on an interval [x0,+∞[, applying prop. 1 and 3 of V, p. 237, gives the following criteria:
Proposition 4 ("logarithmic criterion of order 0")
Let (un) be a series with positive terms; if un≼nμ for some μ<−1 then the series (un) converges; if un≽nμ for some μ≥−1 then the series (un) has an infinite sum.
Proposition 5 ("logarithmic criterion of order p")
Let (un) be a series with positive terms. If un≼nl1(n)l2(n)…lp−1(n)(lp(n))μ1 for some μ>1 then the series (un) converges; if un≽nl1(n)l2(n)…lp−1(n)(lp(n))μ1 for some μ≤1 then the series (un) has an infinite sum.
If 0≤q<1 one has qn≼n−μ for any μ>0; applying the logarithmic criterion of order 0 again proves the convergence of the geometric series ∑n=0∞qn for ∣q∣<1 (Gen. Top., IV, p. 364). If one applies prop. 1 with vn=qn one obtains a criterion which may be put in the following form ("Cauchy's criterion"): Let (un) be a series with positive terms; if limsupn→∞(un)1/n<1 then the series (un) converges; if limsupn→∞(un)1/n>1 then the series (un) has infinite sum. Indeed, if limsupn→∞(un)1/n=a<1 then un≼qn for every q such that a<q<1. If, on the other hand, limsupn→∞(un)1/n=a>1 then un≽qn>1 for infinitely many values of n, for any q such that 1<q<a; since un does not tend to 0 one has ∑n=1∞un=+∞.
This criterion is very useful in the theory of entire series, which we shall study later; but it even so it does not permit one to decide the convergence of the series (1/nα), in other words, its field of application is much more restricted than that of the logarithmic criteria.
2. Asymptotic expansion of the partial sums of a series
For x real tending to +∞ let E be a comparison scale formed by functions each of which is defined on a whole interval[x0,+∞[ (depending on the function) and is ≥0 on this interval. Let (un) be a series whose terms belong to a complete normed space E, such that un admits an asymptotic expansion to precision gα with respect to the scale E′ of restrictions to N of the functions in E:
un=λ≤α∑aλgλ(n)+rα(n).
Suppose that every partial sum ∑m=1ng(m), where g∈E, admits an asymptotic expansion relative to E′. One can then obtain an asymptotic expansion of the sn=∑m=1num with respect to E′; again we distinguish two cases:
1° ∑n=1∞gα(n)=+∞. Then (V, p. 237, prop. 2) one has ∑m=1nrα(m)≪∑m=1ngα(m): by hypothesis one can obtain an asymptotic expansion of
λ≤α∑aλ(m=1∑ng(m))
(V, p. 222) to a certain precision gσ; if cgσ(n) is the principal part of ∑m=1ngα(m), one will have an asymptotic expansion of sn to precision gmin(ρ,σ).
2° ∑n=1∞gα(n) converges; then let β be the smallest of the indices λ≤α such that aλ=0 and such that ∑n=1∞gλ(n) converges; the series
to precision gρ one thus obtains an asymptotic expansion of sn to precision gmin(ρ,σ).
One is thus led to the particular case of series (g(n)) where g∈E. We shall see how, subject to certain conditions, one can straight away obtain a principal part of sn=∑m=1ng(m) (when ∑n=1∞g(n)=+∞) or of rn=∑m=n+1∞g(m) (when ∑n=1ng(n)<+∞).
Proposition 6
Let g be a real function, > 0 and monotone, defined on an interval [x_0, +\infty[ (where x_0 \leq 1 ), and such that log g and x are comparable to order 1.
1° If g is of infinite order relative to e, one has
sn=m=1∑ng(m)∼g(n)ifn=1∑∞g(n)=+∞;(1)
rn=m=n+1∑∞g(m)∼g(n+1)ifn=1∑∞g(n)<+∞.(2)
2° If g is of finite order μ with respect to ex one has
(the number 1−e−μμ is to be replaced by 1 in (3) and (4) when μ=0).
1° If g is of order +∞ relative to ex one has logg≫x whence g′/g≫1, or g′≫g, by the hypothesis; g is therefore increasing and tends to +∞ with x, whence ∑n=1∞g(n)=+∞. If u is the step function associated with the series (g(n)) (V, p. 237), one has u(x)≤g(x) starting from a certain value of x, so u≪g and consequently
sn−1=∫1nu(t)dt≪∫1ng(t)dt≪∫1ng′(t)dt∼g(n);
since sn=sn−1+g(n) one has sn∼g(n). The proof is similar when g is of order −∞ relative to ex; we thus obtain formula (2).
2° If g is of finite order μ relative to ex one can write g(x)=eμxh(x) where h is of order 0 relative to ex; further, by hypothesis, logg∼μx for μ=0 (logg≪x for μ=0) implies h′≪h. Suppose first that ∑n=1∞g(n)=+∞ (which implies that μ≥0; the converse always holds if μ>0, since then g(x) tends to +∞ with x); let us evaluate the principal part of ∫n−1ng(t)dt. One can write
∫n−1ng(t)dt=∫n−1neμth(t)dt
=h(n)∫n−1neμtdt+∫n−1neμt(h(t)−h(n))dt
=μ1−e−μg(n)+∫n−1neμt(h(t)−h(n))dt.
Now, the relation h′≪h implies that for every ε>0 there is an n0 such that the relation x≥n0 implies that ∣h′(x)/h(x)∣≤ε; one deduces from the mean value theorem that −ε≤log∣h(t)/h(n)∣≤ε, for n−1≤t≤n, if n≥n0, whence
∣h(t)−h(n)∣≤(eε−1)h(n)
and consequently
∫n−1neμt(h(t)−h(n))dt≤(eε−1)eμnh(n)=(eε−1)g(n)
since eμt is increasing. Since eε−1 becomes arbitrarily small with ε one sees that one can write
∫n−1ng(t)dt=μ1−e−μg(n)+o(g(n))
(μ1−e−μ being replaced by 1 when μ=0). The proposition is then a consequence of prop. 2 of V, p. 237. One argues similarly when ∑n=1∞g(n) is finite.
By applying prop. 6 of V, p. 239, repeatedly one can then sometimes obtain an asymptotic expansion for sn=∑m=1ng(m). First suppose that g is of order +∞ relative to eλ; for every fixed value of p one can write, by prop. 6,
sn=g(n)+g(n−1)+⋯+g(n−p)+o(g(n−p))
and it suffices to expand (relative to E′) each of the functions g(n−k) (0≤k≤p), limiting the precision of the expansions to the principal part of g(n−p), to obtain an expansion for the sn.
Example
Let g(x)=xλ=exp(λlogx), of order +∞ relative to eλ. Taking p=2 one has
(n−1)log(n−1)=(n−1)logn−1+2n1+o(n1)
whence (V, p. 225)
(n−1)n−1=e1nn−1+2e1nn−2+o1(nn−2)
and similarly
(n−2)n−2=e21nn−2+o2(nn−2);
consequently
sn=nn+e1nn−1+(2e1+e21)nn−2+o3(nn−2).
One proceeds similarly (for rn) when g is of order −∞ relative to eλ.
Now if g is of finite order μ relative to ex, and if, for example, ∑n=1∞g(n)=+∞, one can write
sn=1−e−μμ∫1ng(t)dt+m=1∑nf1(m)
where f1(n)=g(n)−1−e−μμ∫1ng(t)dt≪g(n) by prop. 6 of V, p. 239. If one has a principal part cg1(n) of f1(n) relative to E′, and if one can again apply prop. 6 to the function g1 one will obtain a primitive equivalent to ∑m=1nf1(m) if ∑n=1∞g1(n)=+∞, and equivalent to ∑m=n+1∞f1(m) in the opposite case (in the latter case one writes ∑m=1nf1(m)=C−∑m=n+1∞f1(m), with C=∑n=1∞f1(n)).
Step by step one can thus eventually obtain an expression for sn as the sum of a certain number of primitives each of which is negligible with respect to the previous, of a term remaining negligible relative to the last primitive written, and finally a constant (the case where the remainder term tends to 0). It then remains to expand each of the primitives obtained with respect to E′ (cf. V, p. 235).
Example
Let g(n)=n1; then
sn=m=1∑nm1∼∫1ntdt=logn
then
n1−(logn−log(n−1))∼−2n21
whence
sn=logn+γ+2n1+o(n1).
The constant γ which appears in this formula plays an important rôle in Analysis (cf. chap. VI and VII); it is known as Euler's constant; one has
γ=0.577215664…
to within 1/109.
We shall see in VI, p. 288, how the Euler-Maclaurin summation formula gives an asymptotic expansion of arbitrary order for sn (or for rn) in the most important cases.
3. Asymptotic expansion of the partial products of an infinite product
One knows (Gen. Top., V. p. 22 and 23) that for the infinite product with general factor 1+un (un>−1) to be convergent (resp. commutatively convergent) it is necessary and sufficient that the series with general term log(1+un) should be convergent (resp. commutatively convergent), and that one then has the relation
logn=1∏∞(1+un)=n=1∑∞log(1+un).
When the infinite product converges one knows that un tends to 0; thus log(1+un)∼un; now one knows that for a series of real numbers to be commutatively convergent it is necessary and sufficient that it should be absolutely convergent (Gen. Top., IV, p. 372, prop. 5); by prop. 1 one thus recovers the fact that the product with general factor 1+un is commutatively convergent if and only if the series with general term un is absolutely convergent (Gen. Top., IV, p. 368, th. 4).
A similar argument applies to an infinite product whose general factor is a complex number 1+un (un=−1). Indeed, for such a product to be commutatively convergent it is necessary and sufficient (Gen. Top., VIII, p. 115, prop. 2) that the infinite product with general factor ∣1+un∣ should be so, and further, if θn is the amplitude of 1+un (taken between −π and +π), that the series of the θn should be commutatively convergent. Since un tends to 0, log(1+un) is defined starting from some particular value of n (III, p. 100) and one has
log(1+un)=log∣1+un∣+iθn;
thus, for the product with general factor 1+un to be commutatively convergent it is necessary and sufficient that the series with general term ∣log(1+un)∣ be absolutely convergent (Gen Top., VII, p. 84, th. 1); now log(1+un)∼un (I, p. 18, prop. 5), so one again obtains the condition that the series with general term un should be absolutely convergent (Gen. Top., VIII, p. 116, th. 1).
The relation between infinite products and series of real numbers sometimes allows one to obtain an asymptotic expansion for the partial product pn=∏k=1n(1+uk); it suffices to have an asymptotic expansion for the partial sum sn=∑k=1nlog(1+uk), then to expand pn=exp(sn); one is thus brought back to the two problems examined earlier (V, p. 238 and p. 226).
Example: Stirling’s formula. Let us seek an asymptotic expansion for n!; this leads us to expand sn=∑p=1nlogp, and then exp(sn). The method of n 2 gives successively
We shall show in VII, p. 322, that ek=2π. The formula (5) (with this value of k) is called Stirling's formula. In the same way, for every real number a not an integer >0, one shows that
(a+1)(a+2)…(a+n)∼K(a)nn+a+21e−n.(6)
We shall determine the function K(a) too (VII, p. 18). From formulae (5) and (6) one derives in particular that
(na)∼(−1)nφ(a)n−a−1(7)
for every real number a not an integer >0, where φ(a) is a function of a which will be specified in VII, p. 322.
4. Application: convergence criteria of the second kind for series with positive terms
Quite often one meets series (un) for which un>0 from a certain point on, and un+1/un has an asymptotic expansion which is easy to determine. It is convenient, for such series, to have criteria (called criteria of the second kind) allowing one to determine whether the series is convergent from the form of un+1/un alone. The following is such a criterion:
Proposition 7 ("Raabe's test")
Let (un) be a series with terms >0 from some point on. If, from a certain stage, un+1/un⩽1−nα for some α>1, then the series (un) converges; if, from a certain point on, un+1/un⩾1−n1, then the series (un) has infinite sum.
Indeed, if un+1/un⩽1−nα with α>1, for all n⩾n0, then one has un≼pn=∏k=n0n(1−kα). Now, log(1−nα)=−nα−2n2α2+o(n21), whence logpn=−αlogn+k+o(1/n) (k constant), and pn∼eknα1; since α>1 the logarithmic criterion of order 0 allows one to finish.
If, on the other hand, un+1/un≥1−n1 from a certain point, then the same calculation proves that un≥n1, whence the proposition.
One can prove in the same way, using the logarithmic criteria of order >0, the following criterion of the second kind:
Proposition 8
Let (un) be a series with terms >0 from a certain point on. If, from a certain point, one has
Raabe's test shows that the series converges for α+β<γ, and has infinite sum for α+β>γ; when α+β=γ the series also has an infinite sum, as is shown by prop. 8.
Remark 1
As a particular instance of Raabe's test one sees that if limsupn→∞un+1/un<1 the series (un) converges; if, on the other hand, liminfn→∞un+1/un>1, the series (un) has an infinite sum (d'Alembert's test).
Remark 2
The criteria of the second kind can be applied only to series whose general term behaves in a very regular way as n tends to +∞; in other words, their scope is much more restricted than those of the logarithmic criteria, and it would be a blunder to try to use them beyond the special cases to which they are particularly suited. For example, for the series (un) defined by u2m=2−m, u2m+1=3−m one has u2m+1/u2m=(32)m, u2m+2/u2m+1=21(23)m; the first of these ratios tends to 0 and the second to +∞ as m increases indefinitely, so no criterion of the second kind is applicable; nevertheless, since un≼2−n/2, it is immediate that the series converges.
Even when un+1/un has a simple expression, a direct evaluation of a principal part for un often leads to a result as quickly as the criteria of the second kind. For example, for the hypergeometric series, Stirling’s formula shows immediately that un∼anα+β−γ−1, where a is a constant =0, and the logarithmic criterion of order 0 is then applicable.