4. Approximation of continuous real-valued functions
1. Approximation of continuous functions by functions belonging to a lattice
In this section we shall study the set of continuous real-valued functions (*) defined on a compact space , and we shall always suppose that is endowed with the topology of uniform convergence. From § 3, no. 2 we know that this topology is defined by the norm
and that this norm is compatible with the -algebra structure of . With this norm and this algebra structure, is a complete normed algebra over (, no. 6, Theorem 2, Corollary 1).
(*) The real-valued functions under consideration in this section are assumed always to be finite.
If is a subset of , we shall say that a continuous real-valued function on can be uniformly approximated by functions of if lies in the closure of in the space , i.e. if, for each , there exists a function such that for all . To say that every continuous real-valued function on can be uniformly approximated by functions of therefore means that is dense in .
On the set , the relation [which means that for all ] is an order relation, with respect to which is a lattice. Clearly we have , and therefore is a uniformly continuous mapping of into itself. It follows that
and
are uniformly continuous on .
PROPOSITION I. Let be a compact space and let be a set of continuous real-valued functions defined on . Let be a continuous real-valued function on such that for each there exists a function such that [resp. ]. Then there exists a finite number of functions () such that, if [resp. ], we have [resp. ] for all .
For each , let be the open set consisting of all such that [resp. ]. Since by hypothesis, is the union of the sets as runs through . Since is compact there exists a finite number of points () such that the cover , and it is clear that the functions satisfy the conditions of the proposition.
THEOREM I (Dini). Let be a compact space, and let be a set of continuous real-valued functions on which is directed with respect to the relation (resp. ). If the upper (resp. lower) envelope of is finite and continuous on , then can be uniformly approximated by functions belonging to (or, equivalently, the section filter of converges uniformly to in ).
Given any , for each there exists a function such that . By Proposition I and the fact that is directed with respect to the relation , there exists such that for all ; on the other hand, we have by definition, and therefore the theorem is proved.
Corollary
Let be an increasing (resp. decreasing) sequence of continuous real-valued functions on . If the upper (resp. lower) envelope of the sequence is finite and continuous on , then the sequence converges uniformly to in .
It is clear that the conclusion of Theorem 1 is no longer necessarily valid if is no longer assumed to be compact, as is shown by the example of the decreasing sequence of functions in .
Proposition 2
Let be a compact space, and let be a set of continuous real-valued functions on such that, given any two functions , the functions and are in . Then a continuous real-valued function on can be uniformly approximated by functions belonging to if and only if, for each real number and each pair of points of , there is a function such that and .
The condition is clearly necessary; let us show that it is sufficient. For each , we shall show that there is a function such that for all . Let be any point of , and let be the set of all functions such that . By hypothesis, for each , the function belongs to and we have . Hence, by Proposition 1, there is a finite number of functions of whose upper envelope is such that for all ; on the other hand, we have by the definition of ; finally, by hypothesis. Proposition 1 therefore shows that there exists a finite number of functions whose lower envelope is such that for all ; but since we have for all and for every index , we have also for all . Since by hypothesis, the proof is complete.
Remark
When the set satisfies the conditions of Proposition 2, it is a lattice with respect to the ordering . But it should be remarked that a subset of can be a lattice with respect to this ordering without it being necessarily the case that the least upper bound (resp. greatest lower bound) in of two functions of is the same as their least upper bound (resp. greatest lower bound) in . \* An example is provided by the convex mappings of a compact interval of into . \
Corollary
Suppose that is such that, whenever and , we have and ; and is such that, given any two distinct points of and any two real numbers , there is a function such that and . Then every continuous real-valued function on can be uniformly approximated by functions belonging to .
Definition 1
If X is any set, a set H of mappings of X into a set Y is said to separate the elements of a subset A of X (or to be a separating set for the elements of A) if, given any two distinct elements x, y of A, there is a function f ∈ H such that f(x) ≠ f(y).
For example, if X is a completely regular space (Chapter IX, § 1, no. 5) then the set of all continuous mappings of X into [0, 1] separates the points of X.
Theorem 2 (Stone)
Let X be a compact space, and let H be a vector subspace of such that 1) the constant functions belong to H; 2) if , then ; 3) H separates the points of X. Then every continuous real-valued function on X can be uniformly approximated by functions of H.
It is enough to show that H satisfies the conditions of the Corollary to Proposition 2. By hypothesis, if and , we have
On the other hand, let x and y be any two distinct points of X, and let α, β be any two real numbers. By hypothesis, there is a function such that : say and . Since the constants belong to H, the function
2. Approximation of continuous functions by polynomials
Given a set H of real-valued functions defined on a set X, we say that a real-valued function defined on X is a polynomial (resp. a polynomial with no constant term) with real coefficients, in the functions of H, if it is of the form where g is a polynomial (resp. a polynomial with no constant term) in n indeterminates (n arbitrary) with real coefficients, and the () belong to H.
Theorem 3 (Weierstrass-Stone)
Let X be a compact space and let H be a set of continuous real-valued functions on X which separates the points of X. Then every continuous real-valued function on X can be uniformly approximated by polynomials (with real coefficients) in the functions of H.
An equivalent statement of the theorem is that any subalgebra of which contains the constant functions and separates the points of X is dense in .
Let be the set of all polynomials in the functions of H, and let be the closure of in . If g is any polynomial in n variables with real coefficients, then is a continuous mapping of into , which maps into , and therefore maps into (Chapter I, § 2, no. 1, Theorem 1). In particular, is a vector subspace of and evidently satisfies the first and third conditions of Theorem 2; we shall show that it also satisfies the second condition, and this will prove that .
Since every function is bounded in , it is enough to prove the following lemma:
Lemma 1
For each real number and each compact interval there exists a polynomial with no constant term such that for all .
It is enough to prove the lemma for an interval of the form and hence, replacing by , for the interval . Since , Lemma 1 is a consequence of the following result:
Lemma 2
Let be the sequence of polynomials without constant terms defined by*
To prove Lemma 2 it is enough to show that, for all , we have
We prove (2) by induction on . It is true for . If it follows from the inductive hypothesis (2) that , hence , and therefore from (1) we have
If is not compact, the conclusion of Theorem 3 is not necessarily valid. For example, a continuous real-valued function on which is bounded and not constant cannot be uniformly approximated in by polynomials (cf. Exercise 6).
Proposition 3
Let* be a family of compact intervals of , their product, and let be a compact subspace of . Then every continuous real-valued function on can be uniformly approximated by polynomials in the coordinates .
For if and are two distinct points of , there is at least one index such that ; hence the family of continuous functions satisfies the conditions of Theorem 3.
Proposition 4
Let* be a compact space, let be a closed subspace of , and let be a set of continuous real-valued functions on which separates the points of and is such that is the intersection of the sets as runs through . Then every continuous real-valued function on which is zero on can be uniformly approximated by polynomials without constant terms in the functions of .
Consider first the particular case in which consists of a single point . The hypotheses then imply that separates the points of ; for, if , then by hypothesis there is a function such that . Hence, for each and each continuous real-valued function on such that , there exists (Theorem 3) a polynomial in the functions of such that for all . In particular , so that
for all ; and since is a polynomial in the functions of with no constant term, the result is established in this case.
In the general case, consider the equivalence relation on whose classes are the set and the sets for . The quotient space is Hausdorff (Chapter I, § 8, no. 6, Proposition 15) and therefore compact. Let be the canonical mapping. Every continuous real-valued function on which vanishes on can be written in the form , where is a continuous real-valued function on which vanishes at the point . Applying the result already proved to the space and the point , we obtain the final result.
3. Application : approximation of continuous real-valued functions defined on a product of compact spaces
Theorem 4
Let be a family of compact spaces, and let
Consider the set of "functions of one variable" (any ) which are continuous on . This set separates the points of , for if and are any two distinct points of , there exists such that and there exists a continuous real-valued function on such that . The function then belongs to and takes distinct values at and . Since every polynomial in the functions of is of the form stated in the theorem, the result follows from Theorem 3.
If not all the are compact, the conclusion of Theorem 4 is not necessarily valid (cf. Exercise 9).
4. Approximation of continuous mappings of a compact space into a normed space
Let be a compact space and let be a normed vector space over the field (Chapter IX, § 3); the space will always be assumed to carry the topology of uniform convergence defined by the norm (, no. 2).
Given a set of continuous real-valued functions defined on , a finite family of functions belonging to , and a finite family of points of : the mapping of into is then continuous; we denote it by , and we say that it is a linear combination of functions of with coefficients in . We say that a continuous mapping can be uniformly approximated by linear combinations of functions of (with coefficients in ), if lies in the closure of the vector subspace of formed by these linear combinations.
Proposition 5
Let be a compact space, a normed space over and a subset of . If every continuous real-valued function on can be uniformly approximated by functions of , then every continuous mapping of into can be uniformly approximated by linear combinations of functions of with coefficients in .
Given any real number , for each there exists an open neighbourhood of in which the oscillation of is . Hence there is a finite open covering of such that the oscillation of in each is . Let be a value of in (), and let be a continuous partition of unity subordinate to the covering (Chapter IX, § 4, no. 4, Corollary to Proposition 4). Let be any point of . For each index such that , we have , and for each index such that we have ; it follows that
On the other hand, by hypothesis there is a function such that
for all (); hence we have
and the proof is complete.
From Proposition 5 it follows that, to each of the propositions in which we have proved that a certain subset of is dense, there corresponds an analogous proposition for continuous mappings of into an arbitrary normed space . We shall write down explicitly only the proposition which corresponds in this way to Theorem 3. Given a set of real-valued functions on , a polynomial in the functions of , with coefficients in , is defined to be any linear combination, with coefficients in , of products of a finite (possibly empty) family of functions belonging to . Then:
Proposition 6
Let be a compact space and let be a set of continuous real-valued functions on which separates the points of . Then every continuous mapping of into a normed space over can be uniformly approximated by polynomials in the functions of with coefficients in .
From this we deduce:
Proposition 7
Let be a compact space and let be a set of continuous complex-valued functions on which separates the points of . Then every continuous mapping of into a normed space over can be uniformly approximated by polynomials in the functions and their conjugates with coefficients in .
We have only to note that is also a normed space over and to apply Proposition 6 to the set of real parts and imaginary parts of the functions , using the formulas
Corollary 1
If is a compact subset of the space , then every continuous mapping of into a normed space over the field can be uniformly approximated by polynomials in the and with coefficients in .
We shall see later that in general it is not possible to approximate uniformly by polynomials (with coefficients in ) in the variables alone, even if .
Corollary 2
Let be a locally compact space and let be the normed -algebra of continuous mappings of into which tend to 0 at infinity. Let be a subalgebra of which separates the points of and is such that (i) whenever , (ii) for each , there is an such that . Then is dense in .
If is the compact space obtained by adjoining a point at infinity to , then can be identified with the subspace of consisting of continuous mappings which vanish at , the norm on being defined by
By virtue of Proposition 7, every can be uniformly approximated by polynomials with complex coefficients in the functions belonging to ; moreover, since , the argument of no. 2, Proposition 4 shows that we may suppose these polynomials to have no constant term, and then they belong to .
Another application of Proposition 7 is the following:
Proposition 8
Let P be the set of all periodic continuous mappings of into whose group of periods contains . Then every function belonging to P can be uniformly approximated in by linear combinations, with complex coefficients, of functions of the form
where the are rational integers (such linear combinations are called trigonometric polynomials in m variables).
We have only to observe that P (endowed with the topology of uniform convergence) is canonically isomorphic to the space of all continuous mappings of the compact space into (Chapter VII, § 1, no. 6), and apply Proposition 7 to the set of mappings of into which correspond to the m mappings of into .
Exercises
See the exercises for § 4.