Many mathematical constant are calculated as limit of series. In this
chapter, we recall some definitions and results related to series and
acceleration of their convergence. For any series åan, we denote by
sn its partial sums, that is
s0
=
a0,
s1
=
a0+a1,
sn
=
a0+a1+...+an =
n å
k = 0
ak.
We are interested in the behavior of sn as n tends to infinite
(infinite series). The series whose terms have alternative signs are said to
be alternating series, we write them as
sn = a0-a1+...+(-1)nan =
n å
k = 0
(-1)kak,
where the (ak) are positive numbers.
Definition 1
An infinite series åan is said to be convergent if its partial sums
(sn) tends to a limit S (called the sum of the series) as n
tends to infinite. Otherwise the series is said to be divergent.
Example 1
For the geometric series is defined by ak = xk, the partial
sum sn is then given by
sn = 1+x+x2+...+xn =
1-xn+11-x
,
hence it converges for | x| < 1 to S = 1/(1-x) and diverges
otherwise.
Example 2
The harmonic series is defined for k > 0 by ak = 1/k, and the
partial sum sn (sometimes denoted Hn and called Harmonic
number) is
sn = 1+
12
+...+
1n
.
We have for n = 2p
sn
=
æ ç
è
1+
12
ö ÷
ø
+
æ ç
è
13
+
14
ö ÷
ø
+
æ ç
è
15
+..+
18
ö ÷
ø
+...+
æ ç
è
12p-1+1
+...+
12p
ö ÷
ø
sn
>
1.
12
+2.
14
+4.
18
+...+2p-1.
12p
=
p2
,
therefore the partial sums are unbounded and the harmonic series is
divergent (this important result was known to Jakob Bernoulli (1654-1705) ).
Ernst Kummer's (1810-1893) method is elementary and may be used to
accelerate the convergence of many series. The idea is to subtract from a
given convergent series åan another equivalent series åbn whose sum ån ³ 0bn is well known. More precisely
suppose that
lim
n® ¥
anbn
= r ¹ 0,
then the transformation is given by
¥ å
n = 0
an = r
¥ å
n = 0
bn +
¥ å
n = 0
æ ç
è
1-r
bnan
ö ÷
ø
an.
The convergence of the latest series is faster because 1-rbn/an
tends to 0 as k tends to infinity.
Example 3
Consider
S
=
¥ å
k = 1
1k2
C
=
¥ å
k = 1
1k(k+1)
=
¥ å
k = 1
æ ç
è
1k
-
1k+1
ö ÷
ø
= 1,
we have r = C = 1 and Kummer's transformation becomes
S = 1+
¥ å
k = 1
æ ç
è
1-
k2k(k+1)
ö ÷
ø
1k2
= 1+
¥ å
k = 1
1k2(k+1)
.
The process can be repeated with this time
S*
=
¥ å
k = 1
1k2(k+1)
C
=
¥ å
k = 1
1k(k+1)(k+2)
=
14
,
giving
S =
54
+2
¥ å
k = 1
1k2(k+1)(k+2)
.
After N applications of the transformation
S =
N å
k = 1
1k2
+N!
¥ å
k = 1
1k2(k+1)(k+2)...(k+N)
,
whose convergence may be rapid enough for suitable values of N (this
example is due to Knopp [7]).
Note, that we have used the following family of series to improve the
convergence
In 1926, Alexander Aitken found a new procedure to accelerate the rate of
convergence of a series, the Aitken d2-process
[2]. It consists in constructing a new series S*, whose
partial sums sn* are given by
sn* = sn+1-
(sn+1-sn)2sn+1-2sn+sn-1
,
where (sn-1,sn,sn+1) are three successive partial sums of the
original series. Of course, it's possible to repeat the process on the new
series S* ... For example for the converging geometric series with 0 < x < 1:
sn
=
1+x+x2+...+xn =
1-xn+11-x
and the limit is
S
=
lim
n® ¥
sn =
11-x
,
hence
sn = (1-xn+1)S = S-xn+1S,
and if we replace (sn-1,sn,sn+1) by this expression we have sn* = S ..., the exact limit is given just by three evaluations of the
original series. This indicates that for a series almost geometric, Aitken's
process may be efficient.
Example 4
If we consider the extremely slow (logarithmic rate) converging series
Very efficient methods exist to accelerate the convergence of an alternating
series
S =
¥ å
k = 0
(-1)kak,
one of the first is due to Euler. Usually the transformed series converges
geometrically with a rate of convergence depending on the method.
Because the speed of converge may be dramatically improved, there is a trick
due to Van Wijngaarden which permits to transform any series åbk with
positive terms bk into an alternating series. It may be written
¥ å
k = 0
bk =
¥ å
k = 0
(-1)kak
with
ak =
¥ å
j = 0
2j b2j(k+1)-1 = bk+2b2k+1+4b4k+3+8b8k+7+...
and because 2j(k+1)-1 increases very rapidly with j, only a few terms
of this sum are required. Sometimes a closed form exists for the ak,
for example if
In 1755, Euler gave a first version of what is now called Euler's
transformation. To establish it, observe that the sum of the alternating
series may be written as
2S = a0+(a0-a1)-(a1-a2)+(a2-a3)-... = a0+S1,
with
S1 = D1a0-D1a1+D1a2-...+(-1)kD1ak+...,
and the first difference operator is denoted by
D1ak = ak-ak+1.
The new series S1is also alternating and the process may be
applied again
In 1991, a generalization of Euler's method was given in [4] (this
work in fact generalizes a technique that was used to obtain irrationality
measures of some classical constants like log(2) for example). This
algorithm is very general, powerful and easy to understand. For an
alternating series å(-1)k ak, we assume that there exist a positive function w(x) such that
ak =
ó õ
1
0
xkw(x)dx.
This relation permits to write the sum of the series as
¥ å
k = 0
(-1)kak =
ó õ
1
0
æ è
¥ å
k = 0
(-1)kxk w(x)dx
ö ø
=
ó õ
1
0
w(x)1+x
dx.
Now, for any sequence of polynomials Pn(x) of degree n with Pn(-1) ¹ 0, we denote by Sn the number
Sn =
1Pn(-1)
ó õ
1
0
Pn(-1)-Pn(x)1+x
w(x)dx.
Notice that Sn is a linear combination of the number (ak)0 £ k < n
since if we write Pn(x) = åk = 0n pk (-x)k, we have easily
Sn =
1Pn(-1)
n-1 å
k = 0
ck (-1)k ak with ck =
n å
j = k+1
pj
(1)
The number Sn satisfies
Sn =
ó õ
1
0
w(x)1+x
dx -
ó õ
1
0
Pn(x)w(x)Pn(-1)(1+x)
dx = S-
ó õ
1
0
Pn(x)w(x)Pn(-1)(1+x)
dx.
Therefore we deduce
| Sn-S| £
1| Pn(-1)|
ó õ
1
0
| Pn(x)| w(x)(1+x)
dx £
Mn| Pn(-1)|
| S|, Mn =
sup
x Î [0,1]
|pn(x)|
This inequality suggests to choose polynomials with small value of Mn/|Pn(-1)|.
This choice corresponds in fact to Euler's method.
Another choice is
Pn(x) = (1-2x)n =
n å
k = 0
2k
æ ç
è
n
k
ö ÷
ø
(-x)k, for which Pn(-1) = 3n,Mn = 1.
It leads to the acceleration
| Sn-S| £
| S|3n
where
Sn =
13n
n-1 å
k = 0
(-1)kckak, ck =
n å
j = k+1
2j
æ ç
è
n
j
ö ÷
ø
.
Chebyshev's polynomials (see [1]) shifted to [0,1]
provide a more efficient acceleration. They satisfy the relation
Pn(sin2t) = cos(2nt)
(2)
and explicitly writes in the form
Pn(x) =
n å
j = 0
nn+j
æ ç
è
n+j
2j
ö ÷
ø
4j(-x)j.
The relation (2) show that Mn = 1 and |Pn(-1)| ³ 1/2(3+Ö8)n > 5.828n/2. This family
leads to the following acceleration process :
| Sn-S| £
2| S|5.828n
where
Sn =
1Pn(-1)
n-1 å
k = 0
(-1)kckak, ck =
n å
j = k+1
nn+j
æ ç
è
n+j
2j
ö ÷
ø
4j.
Other families of orthogonal polynomials such as Legendre's
polynomials, Niven's polynomial may give interesting accelerations. More
details and results may be found in the very interesting paper [4].
Once the choice of a sequence of polynomials is made, it can be applied to
compute the value of many alternating series such as
log(2) =
¥ å
k = 0
(-1)kk+1
ak =
1k+1
=
ó õ
1
0
xk dx
p4
=
¥ å
k = 0
(-1)k2k+1
ak =
12k+1
=
ó õ
1
0
xk
x-1/22
dx
(1-2-s)z(s) =
¥ å
k = 0
(-1)k(k+1)s
,
ak =
1(k+1)s
=
1G(s)
ó õ
1
0
xk | log(x)| s-1dx.
Notice that this latest method is very efficient and may be used to compute
the value of the zeta function at values of s with Â(s) > 0 (see ). Another beautiful alternating series whose convergence can be
accelerated in this way is
If you know how to evaluate the Zeta function at integers values, there is
an easy way to transform your original series in a geometric converging one
(based on [5]). Suppose that you want to estimate a series which
has the form
S = A+
¥ å
k = 2
f
æ ç
è
1k
ö ÷
ø
where A is a constant and where the analytic function f may be written
f(z) =
¥ å
n = 2
anzn
then
S = A+
¥ å
k = 2
æ ç
è
¥ å
n = 2
ankn
ö ÷
ø
= A+
¥ å
n = 2
an
æ ç
è
¥ å
k = 2
1kn
ö ÷
ø
hence
S = A+
¥ å
n = 2
an( z(n)-1) .
Observe that
z(n)-1 ~
12n
,
therefore the transformed series has a geometric rate of convergence. This
rate may be improved if a few terms of the original series are computed,
this time the limit is given by
S = A+
M å
k = 2
f
æ ç
è
1k
ö ÷
ø
+
¥ å
k = M+1
f
æ ç
è
1k
ö ÷
ø
= A+
M å
k = 2
f
æ ç
è
1k
ö ÷
ø
+
¥ å
n = 2
an
æ ç
è
¥ å
k = M+1
1kn
ö ÷
ø
and again
S = A+f
æ ç
è
12
ö ÷
ø
+...+f
æ ç
è
1M
ö ÷
ø
+
¥ å
n = 2
an
æ ç
è
z(n)-1-
12n
-...-
1Mn
ö ÷
ø
but this time
z(n)-1-
12n
-...-
1Mn
= z(n,M+1) ~
1(M+1)n
and z(s,a) is the Hurwitz Zeta Function. The rate of
convergence remains geometric but this rate may be taken as large as desired
by taking a large enough value for M.