§ 5. Separation of convex sets
1. The Hahn-Banach theorem (geometric form)
Theorem 1 (Hahn-Banach)
— *Let A be an open convex non empty set of the topological vector space E and let M be a non-empty linear variety which does not meet A. Then there exists a closed hyperplane H which contains M and does not meet A.
By translation the problem can be reduced to the case , so that is absorbent. Let be the gauge of (II, p. 20) so that is the set of points such that . On the other hand, let be the vector subspace of generated by ; thus is a hyperplane in that does not contain , and hence there is a unique linear form on such that is the set of points for which . The hypothesis implies therefore that for all for which , we have ; as and are positively homogeneous we have for all such that ; finally as for all , we see that for all . By the analytical form of the Hahn-Banach theorem (II, p. 22, th. 1) there exists a linear form on which extends and is such that, for all , . Let be the hyperplane in with the equation . Clearly and . On the other hand the complement of in contains the open non-empty set , therefore is closed in (I, p. 11, corollary).
Q.E.D.
Remark 1
When , th. 1 can be stated as follows : there exists a continuous linear form in E, such that in and in (II, p. 8, prop. 4).
Remark 2
If we apply theorem 1 to the case where carries the finest locally convex topology (II, p. 25, Example 2), and if, for the sake of simplicity, we suppose that , then we get the following result (that superficially does not involve topology) : if is an absorbent convex set in the real vector space and if is a non-empty linear variety that does not meet , then there exists a hyperplane containing and such that lies on one side of . This result is not valid for every convex set (II, p. 65, exerc. 5).
2. Separation of convex sets in a topological vector space
Definition 1
— Two non-empty sets of a real topological vector space are said to be separated by a closed hyperplane if is contained in one of the closed half-spaces determined by and is contained in the other closed half-space.
Definition 2
— Two non-empty sets of a real topological vector space are said to be strictly separated by the closed hyperplane if is contained in one of the open half-spaces determined by , and is contained in the other open half-space.
Proposition 1
— Let be an open non-empty convex set and let be a non-empty convex set in a real topological vector space ; if does not meet then there exists a closed hyperplane that separates from .
For the set is open, convex (II, p. 9, prop. 7) and non-empty, also . By theorem 1 of II, p. 36, there exists a continuous linear form on such that in . Then, for all , and , we have . Write ; is finite and we have for all and for all ; the closed hyperplane with the equation separates from .
Remark
— 1) The hyperplane does not meet (II, p. 15, prop. 1; if and are two convex non-empty open sets that do not meet then there exists a closed hyperplane that separates strictly from . 2) However, when is not open, it is not necessarily the case that there exists a closed hyperplane that separates strictly from , even if is of finite dimension, and even if does not meet (II, p. 78, exerc. 12).
Definition 3
— For a subset of a vector space , a hyperplane is called a support-hyperplane of , if contains at least one point of and all the points of lie on the same side of .
Let be a linear form on that is not identically zero; to say that the hyperplane of the equation is a support hyperplane of means that is either the smallest or the largest member of the set . In other words, there exists a support hyperplane of parallel to the hyperplane of equation , if, and only if, one of the bounds of the set is finite and belongs to .
Proposition 2
— Let be a non-empty compact subset of a topological vector space . For every closed hyperplane in , there exists a support hyperplane of parallel to .
For, if is an equation of , where is a continuous linear form in , the restriction of to is continuous, therefore bounded and attains its bounds in (GT, IV, § 6.1, th. 1).
This demonstrates that there exist one or two support hyperplanes of parallel to ; the first case can only arise when is completely contained in a hyperplane parallel to .
Proposition 3
— In a topological vector space , let be a closed convex set with a non-empty interior. Then every support hyperplane of is closed and every frontier point of belongs to at least one support hyperplane of .
Every support hyperplane of is closed, since all the points of are on the same side of the hyperplane (II, p. 15, prop. 17). Also if is a frontier point of , then does not belong to the open non-empty convex set ; after th. 1 of II, p. 36 there exists a hyperplane that contains and does not meet . As is the closure of (II, p. 14, cor. 1 to prop. 16), it follows from prop. 17 of II, p. 15 that is a support hyperplane of .
3. Separation of convex sets in a locally convex space
Proposition 4
— Let be a closed non-empty convex set in a locally convex space and let be a compact non-empty convex set in , that does not meet . Then there exists a closed hyperplane that strictly separates from .
For there exists an open convex neighbourhood of 0 in such that and do not meet (GT, II, § 4.3, prop. 4). As and are convex and open in , prop. 1 of II, p. 37 shows that there exists a closed hyperplane that strictly separates from , and fortiori from .
Remark
In a Hausdorff locally convex space , let and be two closed non-empty convex sets that are disjoint, if is finite dimensional then there exists a closed hyperplane that separates from (II, p. 78, exerc. 13); but this conclusion is not necessarily true when is of infinite dimension (II, p. 78, exerc. 10 and 11).
Corollary 1
— In a locally convex space, every closed convex set is the intersection of the closed half-spaces which contain it.
In fact, for every point , there exists a closed hyperplane that separates strictly from (using prop. 4).
Corollary 2
— In a Hausdorff locally convex space, every compact convex set is the intersection of the closed half-spaces which contain it and which are determined by support hyperplanes of .
For, let ; is closed, therefore there exists a closed hyperplane which separates strictly from (prop. 4); let be an equation of ( a continuous linear form) and suppose that for all . If we put , the half-space defined by contains , is determined by the support hyperplane of equation , and does not contain ; whence the corollary.
It is possible that a closed convex set that is not compact and has no interior point, in a locally convex space, does not have any closed support hyperplane (II, p. 86, exerc. 18 : cf. also V, p. 71, exerc. 11).
Corollary 3
— In a locally convex space, the closure of each linear variety is the intersection of the closed hyperplanes that contain .
For all , let be a closed hyperplane that separates strictly from ;
thus is parallel to ; the closed hyperplane , containing and parallel to does not contain . The corollary follows.
Corollary 4
Let be a closed convex set in a locally convex space . A subset of is contained in , if, and only if, for every real valued continuous affine function in such that for all in , we have for all in .
The condition is obviously necessary. Conversely we show that it is sufficient; if a point is not contained in , there exists a closed hyperplane of equation separating strictly from ; if we suppose for example that , then the continuous affine function contradicts the hypotheses.
Corollary 5
In a locally convex space , the closure of each convex cone of vertex is the intersection of closed half-spaces containing determined by closed hyperplanes that pass through .
For is a convex cone of vertex (II, p. 13, prop. 14). For , there exists a closed hyperplane that separates strictly from (prop. 4). It is now just necessary to apply the following lemma :
Lemma 1
— *If a cone , with vertex , is contained in an open half-space determined by a hyperplane , then it is contained in a closed half-space determined by a hyperplane , that is parallel to and passes through .
Let with be an equation of , so that is the equation of . If there exists such that , then there would exist , such that , and as , this would contradict the hypothesis.
4. Approximation to convex functions
Proposition 5
Let be a closed convex set in a locally convex space . Then every lower semi-continuous convex function defined in is the upper envelope of a family of functions that are the restrictions to of continuous affine linear functions in .
For, the set of points such that and is convex (II, p. 17, prop. 19) and closed, since the function is lower semi-continuous. Then let be any point of and let be such that . By cor. 1 of II, p. 38, there exists a closed hyperplane in , that contains and does not meet . Every linear continuous form on being of the form
where and is a continuous linear form on , it follows that has an equation of the form , and as contains we have . Now the point does not belong to and therefore . Dividing by , if necessary, we can write the equation of as . As , we have, therefore, for all and this proves the proposition.
Remark 1
It follows from prop. 5 that is the upper envelope of a directed increasing family of functions that are the restrictions to of functions which are continuous and convex in .
Remark 2
Suppose further that is a closed convex cone with vertex 0 and that is positively homogeneous. Then is the upper envelope of a family of functions which are the restrictions to of continuous linear forms in . For, let be a family of continuous affine linear functions in of which the restrictions to have as their upper envelope. Put , where , and where is a continuous linear form in . We have . On the other hand, if , we have for every ,
Remark 3
The restriction to of a continuous affine function in is a function that is affine in (i.e. both concave and convex II, p. 17); but it may be the case that there exist continuous affine functions in a compact convex set , that are not the restrictions to of continuous affine functions in (II, p. 78, exerc. II, c)). However :
Proposition 6
Let be an upper semi-continuous affine function in a compact convex set , of the Hausdorff locally convex space . Let be the set of restrictions to of continuous affine functions in ; the set of the such that for all , is then decreasing directed and its lower envelope is equal to .
We may suppose that is non-empty. Let be two elements of , such that and for all , and let be a constant that is an upper bound of and . Let (resp. ) be the compact convex set of points of such that (resp. ), and let be the set of such that ; is convex and closed in . The convex envelope of does not meet , since is contained in the set of such that , a set which is convex and does not meet . As is compact (II, p. 14, prop. 15), we can separate strictly from by a closed hyperplane in . For every , the hyperplane separates strictly from , and therefore meets the line in a single point ; thus is the graph of a continuous affine function whose restriction to is a member of , that is a lower bound for and and that satisfies the inequality for all . This proves that the set is decreasing directed. Prop. 5 of II, p. 39, applied to shows that is the lower envelope of .
Corollary
Let be a continuous affine function in ; then there exists a sequence of elements of which converges uniformly to in .
For, prop. 6 and Dini’s theorem (GT, X, § 4.1, th. 1) show that for all there exists such that .
Exercises
See the exercises for § 5.