§ 2. Orthogonal families in a hilbertian space
1. External hilbertian sum of hilbertian spaces
Proposition 1
Let be a family of hilbertian spaces, P the product vector space and E the subset of P consisting of all families such that is finite.
a) E is a vector subspace of P.
b) For every and in E, the family is summable. If we put , we define a positive separating hermitian form on E.
c) For the scalar product so defined, E is a hilbertian space; the direct sum S of the is dense in E.
For and in E, we have
By the Cauchy-Schwarz inequality, we have
We recall that S is the subspace of P consisting of all families such that the set of all for which is finite. It follows immediately that S is dense in E; hence it remains to prove that E is complete for the topology obtained by the norm . Let be the topology induced on E by the product topology on . For every , let be the set of all such that . This relation implies that we have for every finite subset J of I, and so is a closed subset of , hence also complete. The fact that E is complete for now follows from GT, III, § 3, No. 5, cor. 2 to prop. 10.
Definition 1
Let* be a family of hilbertian spaces. The hilbertian space E defined in prop. 1 is called the external hilbertian sum of the family and written as or ^1.
Let be the mapping from into E which transforms into an element such that for all and ; it is clear that is an isomorphism from the hilbertian space onto a closed vector subspace of E. We say that is the canonical mapping from into E and we shall generally identify with its image in E by this isomorphism. With this convention, and are orthogonal in E for , and E is the closed vector subspace generated by the union of the subspaces .
When I is finite, E is the direct sum of the ; since the canonical projector from E onto is continuous for all , E is also the topological direct sum of the (GT, III, § 6, No. 2, prop. 2). If , we also write instead of .
Example
— Let E be a hilbertian space and I a set of indices. Let denote the external hilbertian sum of the family where for all . In other words, is the space of all families of elements of E such that , endowed with the scalar product (space of square summable families of elements of E indexed by I). We put .
2. Hilbertian sum of orthogonal subspaces of a hilbertian space
Definition 2
A hilbertian space E is said to be a hilbertian sum of a family* of closed vector subspaces of E when :
1) for two distinct indices in I, the subspaces and are orthogonal in E; 2) the closed vector subspace generated by the union of the is E.
1 Care must be taken not to confuse this notation with that of the « algebraic » direct sum of the spaces (A, II, § 1, No. 6).
Theorem 1
— Let E be a hilbertian space which is a hilbertian sum of a family of closed vector subspaces of E. There exists an isomorphism and only one, from E onto the external hilbertian sum of the family such that, for all , the restriction of to E is the canonical mapping from into F.
Let be the « algebraic » direct sum of the , and let be the linear mapping from S into E. We shall show that is an isomorphism from the prehilbertian space S onto the (prehilbertian) subspace of E, generated by the union of the : for, for two elements , , we have
But if , by hypothesis, hence
this proves our assertion. Since S is dense in F and dense in E, the isomorphism extends to an isomorphism from F onto E (V, p. 8, cor.). It is clear that the inverse isomorphism of is the required mapping; its uniqueness follows from the fact that the closed subspace of E generated by the union of the is E itself.
When E is the hilbertian sum of a family of subspaces, we shall often identify E with the external hilbertian sum F of the by means of the isomorphism . If the set I is finite, saying that E is the hilbertian sum of the family means that the are two by two orthogonal and that the vector space E is the direct sum of the family of subspaces.
Corollary 1
— Let E be a hilbertian space, which is a hilbertian sum of a family of closed vector subspaces of E; for all , let be the orthoprojector (V, p. 13) from E onto .
a) For all , the family is summable in , the family is summable in E, and we have
b) Conversely, if is a family of elements of E such that for all and , this family is summable, and the sum is the only point of E for which for all .
c) For every pair of points of E, we have
These properties are in fact obvious for the external hilbertian sum of the , and can be transferred to E by isomorphism.
Corollary 2
— Let E be a Hausdorff prehilbertian space, a family of complete vector subspaces of E such that, for every pair of distinct indices in I, the subspaces and are orthogonal. Let V be the closed vector subspace of E generated by the union of the . For every , let be the orthoprojector from E onto . Let .
1) We have .
2) The following conditions are equivalent : a) ; b) ; c) the family is summable in E, and we have .
3) Suppose V is complete. Then the family is summable in E, and
Let be the hilbertian space completion of E; we identify E with a dense subspace of ; the , being complete, are closed subspaces of . The closure of V in is the closed vector subspace of generated by the union of the , and . The space is the hilbertian sum of the and of the subspace W, the orthogonal complement of in ; put and for all . By cor. 1, we have , and in . This implies assertion 1), and the fact that conditions b) and c) of 2) are equivalent to the condition , hence to the condition . Finally, if V is complete, and if we put , we have , hence is orthogonal to , and so for all ; it is now enough to apply property 2) to the vector .
Remark
Let E be a Hausdorff prehilbertian space, a family of vector subspaces of E such that for every pair of distinct indices , the subspaces and are orthogonal. Then, for every , the intersection of and of the closed vector subspace generated by the union of the for all reduces to 0 for, if belongs to and also to , then it is orthogonal to all the for , hence to . In particular, is orthogonal to itself, hence is zero.
Proposition 2
— Let E be a hilbertian space and a family of closed vector subspaces of E; for every , let be a family of closed vector subspaces of such that is the closed vector subspace generated by the union of this family. In order that E is the hilbertian sum of the family , it is necessary and sufficient that E is the hilbertian sum of the family and that, for each , is the hilbertian sum of the family ("associativity of the hilbertian sum").
To show that the condition is necessary, it is enough to see that and are orthogonal if . But, every element of () is orthogonal to all the (), hence to the closed vector subspace which they generate; the same argument then shows that every element of is orthogonal to , being orthogonal to all the ().
To show that the condition is sufficient, it is enough to verify that, if it is satisfied, E is equal to the closed vector subspace F generated by the union of the (, μ ∈ M_λ); but, for each λ ∈ L, F contains the closed vector subspace generated by the union of the W_{λμ} such that μ ∈ M_λ, that is, F contains V_λ; hence F is the closed vector subspace generated by the union of the V_λ, which is E by hypothesis.
3. Orthonormal families
Definition 3
In a prehilbertian space, a family (e_i)_{i∈I} of vectors is said to be orthogonal if e_i and e_k are orthogonals for all i ≠ k, and is said to be orthonormal, if in addition for all .
A subset S of E such that the family defined by the identity mapping from S onto itself is orthonormal is said to be an orthonormal set. If (e_i)_{i∈I} is an orthonormal family, the mapping is injective; we can then talk indifferently of an orthonormal family or an orthonormal set.
If (e_i)_{i∈I} is an orthonormal family, the complete one dimensional vector subspaces D_i = Ke_i are two by two orthogonal. For every x ∈ E, the orthogonal projection of x on D_i is with , which gives . The results of No. 2 applied to the subspaces D_i imply the following propositions:
Proposition 3
In a Hausdorff prehilbertian space E, every orthonormal family is topologically independent.
We note that this property immediately follows from the characterization of topologically independent families (IV, p. 1 and II, p. 43, cor. 2), on account of the identification of the dual of E with the completion of E or with the space conjugate to E according as K is equal to R or C (V, p. 17, Remark).
Proposition 4
Let E be a Hausdorff prehilbertian space, (e_i)_{i∈I} an orthonormal family in E, V the closed vector subspace of E generated by the e_i.
1) For every x ∈ E, we have
(Bessel’s inequality); here the set of all such that is countable. Moreover, the following conditions are equivalent : a) ; b) ; c) the family is summable in E, and .
2) If V is complete, then the family of all is summable in E for all , and .
3) Suppose V is complete. For every family of scalars such that , there exists a unique point such that for all . If is a second family of scalars such that , and if is such that for all , then .
Proposition 5
— Let be an orthonormal family in a Hausdorff prehilbertian space E. The following properties are equivalent : a) the family is total ; b) for every , the family is summable in E, and we have ; c) for every ,
(Parseval’s relation).
When E is hilbertian these conditions are also equivalent to : d) the relations for all imply that .
The equivalence of conditions a), b), c) follows immediately from prop. 4. When E is hilbertian, the equivalence of conditions a) and d) follows from cor. 1 of V, p. 16.
Definition 4
— An orthonormal and total family in a Hausdorff prehilbertian space E is called an orthonormal basis of E.
An orthonormal basis of a Hausdorff prehilbertian space E is also an orthonormal basis of the completion of E.
Let be an orthonormal basis of E; for every , the numbers are called, by abuse of language, the coordinates of with respect to the basis . For every and in E, we have
An orthonormal basis of E is not, in general, a basis of E over the field K in the sense defined in A, II, p. 25; to avoid any confusion we shall always say that a basis of a prehilbertian space E in the sense of loc. cit. is an algebraic basis of E over K.
Let E and F be two Hausdorff prehilbertian spaces and a continuous linear mapping from E into F. Let (resp. ) be an orthonormal basis of E (resp. F). Put
for . The family is called the matrix of with respect to the orthonormal bases and . Let and ; if we write and for the coordinates of and respectively, we get for all . When is an algebraic basis of E and an algebraic basis of F, our definition is consistent with that of A, II, § 10, No. 4.
Example
Let E be the space of all complex valued continuous functions on , such that for and . We assign to E the scalar product defined by
Then E is a Hausdorff prehilbertian space, but is not complete. For every integer , let . It is immediate that the family is orthonormal in E. Moreover, the topology of uniform convergence on E is finer than the topology deduced from the norm . The family is total in E for the uniform convergence (GT, X, § 4, No. 4), and a fortiori in the prehilbertian space E. Hence is an orthonormal basis of E.
4. Orthonormalisation
Theorem 2
For every orthonormal set L in a hilbertian space E, there exists an orthonormal basis B of E containing L.
In fact, let be the family of all orthonormal subsets of E, linearly ordered by inclusion; it is immediate that this family has finite character (S, III, § 4, No. 5). Hence there exists a maximal family B in containing L, by th. 1 of S, III, § 4, No. 5. It remains to prove that B is a total set. If not, there will exist a vector which is orthogonal to all the vectors of B (V, p. 22, prop. 5), and multiplying y by a suitable scalar, we can assume that ; then, will be an orthonormal set distinct from B and containing B; this contradicts the definition of B; hence the theorem.
Corollary 1
In every hilbertian space, there exists an orthonormal basis.
It is enough to apply th. 2 to the case .
Corollary 2
Every hilbertian space is isomorphic to a space .
More precisely, let be an orthonormal basis of a hilbertian space E. By props. 4 (V, p. 21) and 5 (V, p. 22), the mapping defined by
Proposition 6
Let E be a Hausdorff prehilbertian space, and let (I an interval of with origin 1) be a countable (finite or not) independent family of vectors of E. There exists an orthonormal family , and only one, in E, with the following properties:
1) for every integer , the vector subspace of E generated by is identical with the vector subspace of E generated by ; 2) for every integer , the number is real and .
In fact, let be the subspace (of dimension n) generated by . If and (where is the orthoprojector onto the complete subspace ), the line is the orthogonal of in . If the satisfy condition 1) of the proposition, we must have ; the condition then implies and the condition implies ; this completely determines , and we have proved that we can determine, by induction, an orthonormal family , and only one, so as to satisfy conditions 1) and 2) of the proposition.
The sequence is said to be obtained by orthonormalisation from the independent family . It is clear that the vector subspace generated by the family is identical with the vector subspace generated by the family . In particular, if is a total sequence, so is , which is then an orthonormal basis of E; hence we get:
Corollary
In every Hausdorff prehilbertian space E satisfying the first axiom of countability, there exists a countable orthonormal basis.
If E satisfies the first axiom of countability, then there exists a total sequence in E, and we can always extract an independent total family from such a sequence (A, II, § 7, No. 1, th. 2).
We can give examples of Hausdorff prehilbertian spaces not having any orthonormal basis (V, p. 70, exerc. 2). Example. — Let I be the interval of and E the vector space of real valued continuous functions on I. Let denote the canonical injection from I into , considered as an element of E. By the Stone-Weierstrass theorem the sequence is total in E for the topology of uniform convergence GT, X, § 4, No. 2). Consider E as a real Hausdorff prehilbertian space in which the scalar product is given by
Proposition 7
In a hilbertian space E, two orthonormal bases are equipotent.
Let B and C be two orthonormal bases of E. The case when one of the two sets B, C is finite is trivial, since a finite orthonormal basis is an algebraic basis of the space. Suppose therefore that B and C are infinite. For every , let be the subset of C consisting of all such that . The set is countable (V, p. 21, prop. 4). For every , there exists such that , since B is an orthonormal basis and ; in other words C is the union of the countable sets as ranges over B. The cardinality of C is hence less than that of , hence less than that of B (S, III, § 6, No. 3, cor. 4); similarly, the cardinality of B is less than that of C; this completes the proof.
The cardinality of an arbitrary orthonormal basis of a hilbertian space E is called the hilbertian dimension of E.
Corollary 1
Given two orthonormal bases in a hilbertian space E, there exists an automorphism of E transforming the first basis into the second.
Corollary 2
— In order that the hilbertian spaces and be isomorphic, it is necessary and sufficient that I and J are equipotent.
Exercises
See the exercises for § 2.