§ 1. Prehilbertian spaces and hilbertian spaces
1. Hermitian forms
We recall the following definition given in Algebra (A, IX, § 3, No. 1):
Definition 1
Let E be a vector space over the field K. A hermitian form (on the left) on E is a map f from E × E into K satisfying the following conditions (for in E and in K):
(1)
(2)
(3)
When the field K is R, the notion of hermitian form on E reduces to that of symmetric bilinear form on E × E (A, III, § 6, No. 3).
We note that the second condition (1) and the second condition (2) follow from the other three.
¹ For the reader specially interested in hilbertian spaces, we point out that only No. 7 of § 1 and No. 8 of § 4 depend on results of chapters III and IV. For this the reader can consult « Summary of some important properties of Banach spaces » which appears at the end of this volume. The only references to chapters I and II concern the definition of a convex set and of a semi-norm (II, p. 1 and p. 7), that of a topological direct sum (I, p. 4), of a total family and a topologically independent family (I, p. 12).
From (1) and (2) we deduce immediately that
In particular, if E is finite dimensional, and if is a basis of E, then for and , we have,
with the notation ; moreover, relation (3) amounts to for every pair of indices ; this implies in particular that the numbers are real.
From (3), the number is real for all . Moreover, we immediately establish the following formulas, known as polarization formulas
(5)
Remark
— We observe that formula (6) is valid for every sesquilinear form on (that is to say, for every function satisfying (1) and (2), but not necessarily (3)). This remark shows that, when , a sesquilinear form such that is real for all is necessarily hermitian: relation (6) then gives since we have and whenever .
From the polarisation formulas, we have in particular,
Proposition 1
If is a hermitian form on , and a vector subspace of such that for all , then we also have for every pair of points in .
Let be a hermitian form on ; the set of all such that for all is a vector subspace of . It follows from (3) that, if (mod. ) and (mod. ), we have ; hence, on the quotient space we define a sesquilinear form by putting for all and all ; it is clear that is hermitian and that the relation « for all » implies in , in other words (A, IX) is separating. We say that is the separating hermitian form associated with .
2. Positive hermitian forms
Definition 2
Let be a vector space over the field . A hermitian form on is said to be positive if for all .
It is clear that hermitian forms on a vector space form a vector space over the field (but not over the field , when is ) : in this space the positive hermitian forms constitute a pointed convex proper cone (II, p. 10) as a result of def. 2 and prop. 1.
Proposition 2
— *If f is a positive hermitian form, we have
for every x and y in E (Cauchy-Schwarz inequality).
First assume that we have . For every , we have
which can be written as
Replacing by in this inequality, we get (7). If , we argue similarly.
Finally, if , we have for all , which can be written as
Replacing by in this inequality, we get , and therefore ; we again get (7) in this case.
Corollary 1
— *If f is a positive hermitian form, the set N of all x \in E such that f(x, x) = 0 coincides with the vector subspace of all x \in E such that f(x, y) = 0 for all y \in E.
Corollary 2
— *For a positive hermitian form to be separating, it is necessary and sufficient that the relation x \neq 0 implies f(x, x) > 0.
This follows immediately from cor. 1.
For every positive hermitian form f on E, the separating hermitian form associated with f (V, p. 2) is evidently a positive hermitian form on E/N.
Proposition 3
— *Let f be a positive hermitian form on E. Put
for all x \in E. Then p is a semi-norm on E, and is a norm if and only if f is separating.
It is enough to prove the inequality . But we have
and, by Cauchy-Schwarz inequality
Remark
— 1) Suppose f is positive and separating, and let x, y be two vectors . The proof of Cauchy-Schwarz inequality shows that, if the two members of (7) are equal, then there exists a scalar such that , hence , in other words, and are linearly dependent; the converse is immediate. The proof of inequality (8) shows that the equality is possible only if and are linearly dependent; if , the preceding equality can be written as , and implies that is real and positive.
2) Let be a positive hermitian form on , and let be assigned the semi-norm ; if is the positive, separating hermitian form defined on associated with , then the normed space obtained by assigning the norm to is the normed space associated with (II, p. 5).
Definition 3
Let be a vector space over the field . A semi-norm on is said to be prehilbertian if there exists a positive hermitian form on such that for all *.
Observe that for a semi-norm on , there exists at most one positive hermitian form such that for all ; this follows from the polarization formulas (V, p. 2).
3. Prehilbertian spaces
Definition 4
A prehilbertian space is a set with the structure of a vector space over and with a positive hermitian form. We say that is a real (resp. complex) prehilbertian space when is (resp. is ).
Example 1
The form defines a prehilbertian structure on , said to be canonical. When is considered as a prehilbertian space, we shall always mean, unless otherwise mentioned that it has this structure.
Example 2
Let be an interval (bounded or not) in , and let be the set of regulated functions (FVR, II, p. 4) defined on with values in , having compact support. It is clear that is a vector space over ; let be the sesquilinear form ; it is immediate that is a positive hermitian form on , and hence defines a prehilbertian structure on this space.
Example 3
Let be an integer. We define a prehilbertian space structure on the space , by means of the hermitian form
(for and ). When is , we see that this is just the scalar product of two vectors of (GT, VI, § 2, No. 2).
Example 4
Let (or ) be the set of sequences of elements of such that is finite. One can show that is a vector subspace of and define a prehilbertian space structure on by means of the hermitian form (cf. V, p. 18).
Example 5
Let be a real prehilbertian space, the corresponding symmetric bilinear form on . Let be the vector space complexification of ; we identify with a subset of by the map , in such a way that every element of can be written uniquely as with in . The map extends uniquely to a hermitian form on ; we have,
In particular, we have
Whenever only one prehilbertian space structure on a vector space is under consideration, the value, for a pair of points of , of the hermitian form which defines the said structure is denoted by or simply , if no confusion is likely to arise. This number is called the scalar product of and (scalar square of if ). Two vectors are said to be orthogonal if . The function is a semi-norm on the vector space (V, p. 3); a prehilbertian space is always considered with this semi-norm assigned to it (and consequently also with the corresponding topology and uniform structure).
With these notations, in a prehilbertian space , the Cauchy-Schwarz inequality can be written as
Consequently, the scalar product is a continuous sesquilinear form on (II, p. 5, prop. 4).
In order that be Hausdorff, it is necessary and sufficient that is a norm on ; in other words, that the hermitian form is positive and separating; this is equivalent to saying that is the only vector of , which is orthogonal to itself.
According to general definitions (S, IV, § 1, No. 5), an isomorphism from a prehilbertian space onto a prehilbertian space is a bijective linear mapping from onto such that
Let be a complex prehilbertian space, and the scalar product in . On the set , we can define a second vector space structure with respect to , taking the same law of the additive group and for the law of external composition (A, II, § 1, No. 13) for this vector space structure, is a *positive hermitian
1 It may happen sometimes that we write for . Observe that the formula (4) of V, p. 2, takes the following equivalent forms:
form. The prehilbertian space obtained by assigning this new vector space structure and the new hermitian form to E, is said to be conjugate to E. An isomorphism from E onto is a semi-linear mapping from E onto itself (with respect to the automorphism of ) such that or (for in E); such a mapping is said to be a semi-automorphism of the prehilbertian space E.
If E is a prehilbertian space, M a vector subspace of E, the restriction of the scalar product to is a positive hermitian form on M, which then defines a prehilbertian space structure on M; we say that this structure is induced by the structure of E, or that M is a prehilbertian subspace of E.
4. Hilbertian spaces
Definition 5
A hilbertian space* (or Hilbert space) is a prehilbertian space which is Hausdorff and complete. We say that a norm on a vector space E (over K) is hilbertian if it is prehilbertian, and if the normed space E is complete.
If E is a hilbertian space and M a closed vector subspace of E, the prehilbertian space structure induced on M is in fact a hilbertian space structure. In this case we say that M, with the induced structure is a hilbertian subspace of E.
Example 1
The prehilbertian spaces defined in examples 1, 3, 4 of V, p. 4, are hilbertian spaces. On the other hand, the prehilbertian space defined in example 2 is neither Hausdorff, nor complete. The complexification of a hilbertian space is a hilbertian space.
Example 2
\* Let X be a Hausdorff topological space and let be a positive measure on X. Let be the space consisting of equivalence classes, for , of all square -integrable functions on X with values in . This is a complex hilbertian space, whose scalar product is given by
Example 3
\* Let be an integer and let U be an open set in . Let be the measure on U induced by the Lebesgue measure on , and put . Let denote the space of all functions with the following property; for , there exists a function such that
for every function of class with compact support in U. The function is defined uniquely up to equivalence with respect to , and is denoted by or (ith partial derivative). By induction on the integer , we define as the set of all functions such that for . We define a scalar product on by the formula
Then is a complex hilbertian space, called Sobolev space of index s.
Example 4
\* Let X be a differential variety of class (with ) pure of finite dimension .
In the vector fibre space , let L be the complement of the zero section. For every real number , the mapping from into itself leaves L stable.
Let be a complex number. A complex valued function on L such that for and any non-zero real number is called a density of order on X. We say that a density of order 1 is locally integrable if there exists an open cover of X, and for every a system of coordinates on and a complex valued function on satisfying the following conditions:
a) The function is locally integrable on the open set of with respect to the Lebesgue measure ;
b) Let ; if is the basis of associated to the system of coordinates in we have
Then, there exists one and only one measure on X such that for every , the image under of the restriction of to is equal to the measure (cf. VAR, R, 10.4.3).
Let (resp. ) be the vector space of measurable densities of order 1/2 such that the measure associated with the density of order 1 is bounded (resp. null). Let and be in ; then is a density of order 1, and the measure associated with is bounded; the number depends only on the classes and of and modulo and is denoted by or . Then the mapping assigns a complex hilbertian space structure to the vector space .
Example 5
\* Let D be the open disc with centre 0 and radius 1 in . The Hardy space consists of all holomorphic functions for which
For a function to belong to , it is necessary and sufficient that there exists a sequence of complex numbers such that and that
Every Hausdorff prehilbertian space is isomorphic to an everywhere dense subspace of a hilbertian space determined up to an isomorphism. Precisely :
Proposition 4
— Let E be a Hausdorff prehilbertian space, the normed space completion of E(GT, IX, § 3, No. 3). The scalar product* extends by continuity to a positive and separating hermitian form on* , and defines a hilbertian space structure on .
The existence of the extension of to follows from the continuity of this sesquilinear form an (GT, III, § 6, No. 5, th. 1). Moreover, this extension, which will also be denoted by is a hermitian form and satisfies the relation , by virtue of the principle of extension of identities ( being the norm on obtained by extending the norm on E by continuity) ; this proves that the relation implies in , hence that the form is positive and separating, and consequently defines a hilbertian space structure on . Q.E.D.
This hilbertian space is said to be the completion of the Hausdorff prehilbertian space E.
\* Example 6. — Let U be an open subset of (). Let be the vector space of all functions of class with compact support in U. We define a Hausdorff prehilbertian space structure on whose scalar product is given by
This prehilbertian space is not complete. Its completion is called the Dirichlet space associated with U. \*
Corollary
— Let V be a vector space over K and f a positive hermitian form on V. a) There exists a Hilbert space E and a linear mapping such that for x, y in V, and such that u(V) is dense in E. b) If two pairs satisfy the conditions analogous to a), then there exists a unique isomorphism from the Hilbert space onto the Hilbert space such that .
Let N be the set of all such that . We define a positive and separating hermitian form on the space V/N by for and . Let E be the hilbertian space completion of V/N and the mapping from V into E. Then the conditions of a) are satisfied.
Under the hypotheses of b), N is equal to the kernel of and to that of . Hence there exists a bijective linear mapping from onto such that for all . We verify immediately that is an isomorphism of prehilbertian spaces, hence an isometry. Since is dense in for , extends uniquely to an isometry from onto , and b) follows.
We say that the hilbertian space E is the separated completion of V (for the form f).
Example 7. — Let G be a group (with unit element 1) and a homomorphism from G into the group of automorphisms of a complex hilbertian space E ; we say that is a unitary representation of G in E. Let ; we put
for all . Then is positive definite, in other words satisfies the relation :
(PD) For every in and in , we have
In fact, the first member of (11) is precisely .
Conversely, let be a positive definite function on . Let be the vector space of all functions with finite support on . We define a hermitian form on by
and the relation (PD) expresses the fact that is positive. By the corollary of prop. 4, there exists a hilbertian space and a linear mapping , with a dense image, such that
For every , let be the left translation by in defined by for and . We have . Now apply assertion b) of the corollary of prop. 4 to and : there exists a unique automorphism of the hilbertian space such that . We see immediately that is a homomorphism from into the group of automorphisms of .
Let be the element of defined by for in . We have for all , and so by putting .
Formulas (12) and (13) imply that for all . We remark that the set of vectors for all , is total in .
5. Convex subsets of a prehilbertian space
If we calculate and for any two points of a prehilbertian space , we immediately get the « identity of the median »
From this identity we deduce the following proposition :
!Diagram showing sets B', B, and A, with x and y marked within A
Fig. 1.
Proposition 5
— Let be a prehilbertian space. Let be a real number , a real number such that . Let and be subsets of defined by ,
Theorem 1
Let E be a prehilbertian space, and H a non-empty convex subset of E such that H is a Hausdorff and complete uniform subspace of E. For every , there exists a unique point in H such that . The element of H is also the unique element a of H satisfying the relation*
!Diagram showing a point x, a point y, and a line segment labeled a + λ(y − a)
Fig. 2.
Put , and for every integer , let be the set of points of H such that . The set is closed in H, is convex and non-empty, and its diameter is bounded by for all large enough , by prop. 5. The sequence being decreasing, and the set H being Hausdorff and complete it follows that the base of the Cauchy filter converges to a point of H; we have , hence is the unique point of H such that .
1 We recall (GT, VIII, § 1, No. 1) that denotes the real part of the complex number z; we have if z is real.
Let ; since is convex, the point of E belongs to for every real number such that . Hence we have
In what follows the mapping of E in will be called the projection from E onto . We remark that for all .
The first part of th. 1 is valid under more general hypotheses on the space E (V, p. 67, exerc. 31).
The proof of th. 1 establishes, among others, the following property :
Corollary 1
Let I be a set directed by a filter and let be a family of points of . Let . Suppose that we have*
Corollary 2
For every in , we have*
Let be two points of . Put . By formula (15) (V, p. 10) we have and . We also have , which gives,
Proposition 6
Let be a prehilbertian space and let be a non-empty, directed decreasing set of non-empty Hausdorff and complete convex subsets of . For every and every subset of , put . In order that the intersection M of the sets H belonging to be non-empty, it is necessary and sufficient that there exists in E such that is finite. For every we then have
If M is non-empty, for all and all .
Conversely, suppose that there exists a point in E and a real number such that for all . Let ; then
Proposition 7
Let E be a Hausdorff prehilbertian space and let be a non-empty directed increasing set of non-empty, convex, complete subsets of E. Put and suppose that the closure N of A is complete. Then N is convex and we have*
It is clear that A is convex, hence its closure N is convex (II, p. 13). With the notations of prop. 6, , and consequently is the limit of with respect to the section filter of . Since and
6. Vector subspaces and orthoprojectors
Let E be a prehilbertian space. Recall that two vectors and of E are said to be orthogonal if ; then
Let A be a subset of E. We say that a vector x in E is orthogonal to A if it is orthogonal to every vector of A. The set of all vectors orthogonal to A is a closed vector subspace of A, denoted by and called (by abuse of language) the orthogonal of A.
Let A and B be two subsets of E. We say that A and B are orthogonal if every vector of A is orthogonal to every vector of B. This is equivalent to saying that , or that . If E is Hausdorff and if A and B are orthogonal then is empty or reduces to 0 since 0 is the only vector of E orthogonal to itself.
Theorem 2
Let E be a prehilbertian space and M a vector subspace of E, which is Hausdorff and complete. Then E is the topological direct sum of M and of the subspace orthogonal to M. The projector from E onto M associated with the decomposition is the projection from E onto M defined in th. 1 (V, p. 10).
We first show that belongs to for all . Let . For every scalar , the vector belongs to M; hence by formula 15 (V, p. 10) we have,
for all . If, in particular we take we conclude that , hence our assertion.
Since M is Hausdorff, 0 is the only vector of M, orthogonal to itself, hence . For every , we have and . Consequently, E is the direct sum of M and , and is the projector from E onto M with kernel . Since is a continuous mapping from E into M (V, p. 11, cor. 2), if follows from GT, III, § 6, No. 2 that E is the topological direct sum of M and .
Corollary
Let E be a Hausdorff prehilbertian space and M a finite dimensional vector subspace of E. Then E is the direct sum of M and .
Since E is Hausdorff, so is M; since M is finite dimensional, it is complete (I, p. 13). It is therefore enough to apply th. 2.
With the notations of th. 2, we say that is the orthogonal complement of M and that is the orthoprojector (or the orthogonal projector, or by abuse of language, the projector) from E onto M; if x is a vector of E, the vector of M is also called the orthogonal projection of x on M. Note that is a continuous linear mapping from E onto M and that we have by cor. 2 of V, p. 11, except in the case when in which case .
It follows immediately from Pythagoras theorem that the canonical mapping from onto deduced from the direct sum decomposition is isometric if is assigned the quotient semi-norm from that of E (II, p. 4). We shall always assign that prehilbertian structure to for which is an isomorphism of prehilbertian spaces; the quotient semi-norm on is then deduced from this prehilbertian structure.
We shall often use the preceding results when E is a hilbertian space and M a closed vector subspace of E. In this case, is a closed vector subspace of E, and , and .
Proposition 8
— Let E be a hilbertian space, M a closed vector subspace of E, I a non-empty ordered directed set and a family of closed vector subspaces of E. We assume that either the mapping is increasing and that M is the closure of or that the mapping is decreasing and that . Then for all .
Prop. 8 follows immediately from props. 6 (V, p. 11) and 7 (V, p. 12).
Proposition 9
— Let E be a hilbertian space and M, N two closed vector subspaces of E.
a) The following conditions are equivalent : (i) ; (ii) if is orthogonal to and if is orthogonal to , then x and y are orthogonal; (iii) every vector of M orthogonal to is orthogonal to N; (iv) .
b) If the equivalent conditions of a) are satisfied, we have , the vector subspace of E is closed and we have .
c) We have if and only if M is orthogonal to N. If this is so, then the vector subspace of E is closed, and .
Put , and . Condition (ii) implies that and are orthogonal, and (iii) implies that and N are orthogonal. Since we have and is orthogonal to L, we have proved the equivalence of (ii) and (iii). If condition (iii) is satisfied, we have and since , condition (iv) is satisfied. Conversely, from (iv) we conclude that since the subspaces and of M are orthogonal, and so , that is, the relation (iii).
Assume that condition (iv) is satisfied. It is immediate that for all and hence for all . But, for every , the vector belongs to L, and the vector
Conversely, suppose condition (i) is satisfied. Let ; we have
We have proved a) and the first part of b). Assume now that and commute and put ; since and are idempotents in the algebra , so is q; hence (GT, III, § 6, No. 2) the image of q is a closed vector subspace of E.
It is clear that the image of is contained in ; however, we have , hence for all ; since we also have , we get for all . We conclude that the image of is equal to . The orthogonal of is equal to , and the kernel of obviously contains , hence . This proves b).
We have if and only if the image of is contained in the kernel of , that is, if and only if is orthogonal to . The rest of the assertion c) is then a particular case of b).
Remark
— Let be a hilbertian space and two closed vector subspaces of . The relation is equivalent to the orthogonality of and , that is to say, to the relation by prop. 9, c). Since we have , we conclude that the relations and are equivalent (« the three perpendicular theorem », cf. fig. 3).
!Diagram showing subspaces M, N, and projections p_M(x), p_N(x)
Fig. 3.
7. Dual of a hilbertian space
Theorem 3
Let be a hilbertian space. For every , let be the continuous linear form on ; the mapping is a bijective, semi-linear (for the automorphism ) mapping from onto its dual , and an isometry from the normed space onto the normed space .
The mapping is semi-linear by (2) (V, p. 1) and by virtue of the Cauchy-Schwarz inequality, we have , hence is an isometry from into , and in particular, is injective. To complete the proof, we need to prove that for all in , there exists such that . But the hyperplane is closed in ; its orthogonal is a line . Let be a non-zero element of ; the kernel of the linear form is equal to and hence there exists a scalar such that . Q.E.D.
The mapping from onto its dual is said to be canonical. The inverse mapping from onto is also called canonical and is denoted by . We have
for in and in . Also for .
When K is , the mapping is linear. We shall transfer the scalar product of E to E' by this mapping. When , we can consider the mapping as an isomorphism from the vector space , the conjugate of E onto E' (V, p. 6). We shall transfer the scalar product of to E' by this mapping.
In the two cases considered, E' is a hilbertian space and we have the formulae
for in E and in E'.
To say that the vector is orthogonal to a vector is equivalent to saying that the linear form is orthogonal to in the sense defined in II, p. 41 (this justifies the use of the word « orthogonal » in the two cases). If M is a closed vector subspace of E, the subspace orthogonal to M in E' (II, p. 44) is the image under of the orthogonal of M in E, defined in V, p. 13 (this justifies the use of the notation in the two cases).
Corollary 1
In order that the family of points of a hilbertian space E be total, it is necessary and sufficient that the relations for and for all indices imply that .
In fact, this says that 0 is the only vector of E' which is orthogonal to all the (II, p. 43 and IV, p. 1).
Corollary 2
Let E and F be two hilbertian spaces. For , and , put
The mapping is an isomorphism from the Banach space onto the space of all continuous sesquilinear forms on , endowed with the norm
It is clear that is sesquilinear and continuous for all . Conversely, let be a continuous sesquilinear form on . For every , the mapping is a continuous linear form on the hilbertian space F. By th. 3, for every , there exists a unique element in F such that for all . The mapping from E into F is linear and we have
hence belongs to , and . This proves cor. 2.
Recall (A, IX, § 1, No. 5) that a sesquilinear form (on the left) on is a mapping from into K which satisfies relations (1) and (2) of V, p. 1.
The canonical mapping from E into its bidual E'' (IV, p. 14) maps E onto E'', in other words (IV, p. 16), E is a reflexive Banach space. In fact, if E is a real (resp. complex) hilbertian space, the canonical mapping φ from E' onto E is an isomorphism from the normed space E' onto E (resp. onto the conjugate space of E); applying th. 3 to E (resp. E), we see that every continuous linear form on the normed space E' is of the form with , hence our assertion follows.
As a consequence (IV, p. 17, prop. 6):
Theorem 4
In a hilbertian space E, the unit ball is weakly compact.
Proposition 10
If, in a hilbertian space E, a filter converges weakly to , and if moreover , then converges to for the initial topology of E.
In fact, . Since tends to with respect to by hypothesis, and tends to with respect to , tends to 0 with respect to , hence the proposition.
Remark
— If E is a Hausdorff prehilbertian space and the hilbertian space completion of E, we know (III, p. 16) that the dual E' of E can be identified with the dual of ; it then follows from th. 3 (V, p. 15) that every continuous linear form on E can be written in a unique way as , where .
Exercises
See the exercises for § 1.