§ 2. Convex sets
1. Definition of a convex set
For any two points of an affine space , the set of points where is called the closed segment with end points and ; it reduces to a point when . The complement of in this segment is called the segment with end points which is open at and closed at ; it is empty if . Finally the complement of in the closed segment with end points is called the open segment with end points ; it is empty when .
Definition 1
— A subset of an affine space is convex if, for every two points of , the closed segment with end points is contained in .
As , this definition is equivalent to the following: the set is convex if, for every point , the transform of by a homothety of centre and ratio where , is contained in (in other words, is stable for these homotheties).
Example 1
Every linear affine variety of (and in particular the empty set) is convex.
Example 2
The only non-empty convex sets in are the intervals (GT, IV, § 2.4, prop. 1).
Example 3
Let be a vector space and a norm on ; the unit ball , formed by the points
such that , is convex since the relations , imply for that
Remark
— Let be a convex subset of a vector space ; for any scalars and we have . In other words, for any , there exists such that ; in fact this relation can be written and we have and , from which the assertion follows, on using def. 1.
Proposition 1
Let be a family of points of a convex subset ; every barycentre of the formed using positive masses (such that and except for finitely many of the indices, cf. A, II, § 9.3) belongs to .
Clearly we need only consider the case when the indices are and for each ; the proposition is trivial if ; we prove the result by induction on . Put , and ; the induction hypothesis implies that . Now as and , its follows from def. 1 that belongs to .
Proposition 2
Let and be two affine spaces and be an affine linear mapping of in ; then the image of a convex subset of under , and the inverse image of a convex subset of under are both convex.
The image under of the closed segment with end points is the closed segment with end points , hence the first statement. We deduce that the inverse image of a closed segment of under contains each closed segment whose end points belong to it; the second statement of prop. 2 follows.
In particular the image of a convex set under a homothety or a translation is a convex set.
Proposition 3
In the affine space , let be a hyperplane defined by the relation , where is a non-constant affine function on . Then the half-spaces defined by the relations are convex.
For these are the inverse images under of intervals of and thus are convex.
With the notations of prop. 3 the points of a subset of an affine space are on the same side (resp. strictly on the same side) of the hyperplane if is contained in one of the half-spaces defined by (resp. or ).
Proposition 4
The points of , a convex subset of an affine space are strictly on the same side of a hyperplane if, and only if, does not meet .
Clearly the condition is necessary. Conversely suppose that it is satisfied and let , be an equation defining H ( is an affine linear mapping of E in ). The set is convex in , therefore it is an interval, and . Hence is of fixed sign for all .
2. Intersections of convex sets. Products of convex sets
Proposition 5
— The intersection of any family of convex subsets of an affine space E is convex.
The proposition follows immediately from def. 1 of II, p. 7.
Proposition 6
— Let be a family of vector spaces, and for each , let be a non-empty subset of . Then the set is convex in , if, and only if, for all , the set is convex in .
In fact, each projection is a linear mapping and we have and ; the proposition follows from props. 2 and 5 above.
Corollary
— In the space every parallelootope (GT, VI, § 1.3) is a convex subset.
For it is the image under an affine linear mapping of a rectangular parallelepiped, and this last is convex by prop. 6.
Proposition 7
— Let A and B be two convex subsets of the vector space E. For any real numbers the set (set of points of the form , where varies in A, and in B*) is convex*.
For is the image of the convex subset of under the linear mapping of in .
3. Convex envelope of a set
Definition 2
— Given a subset A of an affine space E, we call the intersection of all convex sets containing A, the convex envelope of A, that is to say (II, p. 9, prop. 5) it is the smallest convex set containing A.
Proposition 8
— For any family of convex subsets of an affine space E, the convex envelope of is precisely the set of linear combinations , where for all ( except for finitely many indices) and .
Denote the set of these linear combinations by C, clearly C is contained in every convex set which contains all the (II, p. 8, prop. 1); on the other hand for every . All that remains to be proved is that C is convex. Let , be two points of C and be a number such that , write γ_i = αλ_i + (1 - α) μ_i for every i ∈ I, and let J be the set (finite) of the indices of I for which γ_i ≠ 0. We can write αx + (1 - α)y = ∑_{i∈J} γ_i z_i, where
belongs to A_i for all i ∈ J; but , and we see that . The proposition is proved.
Corollary 1
The convex envelope of a subset A of E is identical with the set of linear combinations , where is any finite family of points of A, the numbers and .
The dimension of the affine linear variety (A, II, § 9.3) generated by the convex set A is called the dimension of A.
Let E be a vector space. The convex envelope C, of the balanced envelope of a set A in E is called the balanced convex envelope (or the symmetric convex envelope) of A; clearly it is the smallest symmetric convex set that contains A; it is also the convex envelope of , since every point of the balanced envelope of A belongs to a segment with extremities a and −a where . The set C coincides with the set of linear combinations where and ; for it is clear that this set of points is convex and contains A and −A; it is sufficient to prove that it is contained in C, and for this we need consider only those linear combinations for which ; we can then write with and , if ; and ; if ; clearly , and our assertion is proved.
Corollary 2
Let f be an affine linear mapping of the affine space E in the affine space F; for each subset A of E, the convex envelope of f(A) is the image under f of the convex envelope of A.
There is a similar statement for linear mappings and balanced convex envelopes.
4. Convex cones
Definition 3
A subset C of an affine space E is a cone with vertex x_0 if C is invariant for all homotheties of centre x_0 and ratio > 0.
We shall suppose in this No. and in the one following, that we have chosen the vertex of the cone being considered, as origin in E; i.e. we suppose that E is a vector space, and when we speak of a cone, it is to be understood that this cone has vertex 0. The set of points of the form for (resp. ), where is a non-null vector, is called an open half line (resp. closed half-line) originating at 0.
A cone C of vertex 0 is said to be pointed if , and non-pointed otherwise. A pointed cone is either the single point or is the union of a set of closed half-lines originating at 0. A non-pointed cone is the union (possibly empty) of open half lines originating at 0. If C is a non-pointed cone, then is a pointed cone. If C is a pointed cone, then is a non-pointed cone.
If C is a non-pointed convex cone, then is a pointed convex cone. However, if C is a pointed convex cone, is not necessarily convex. We say that a pointed convex cone is proper if it does not contain any line passing through 0. Then
Proposition 9
A pointed convex cone C is proper if and only if the non-pointed cone , which is the complement of 0 in C, is convex.
If C contains a line through 0 then clearly is not convex. Suppose now that C is proper and let x, y be two points of . The closed segment with end points x, y is contained in C; if it contains 0 then for some with , therefore with . Thus C contains the line through 0 and x, contrary to hypothesis.
Proposition 10
A subset C of E is a convex cone if and only if and for all .
For the condition for all characterises the cones. If C is convex we have (II, p. 8, Remark). Conversely, if the cone C is such that , then for , we have , which shows that C is convex.
Corollary 1
If C is a non-empty convex cone, the vector space generated by C is the set (the set of points where x, y vary in C).
For, if , then V is non empty, we have for all , and , which shows that V is a vector subspace. Finally every vector subspace that contains C also contains V.
Corollary 2
If C is a pointed convex cone, the largest vector subspace contained in C is the set .
For, if , then W is non-empty and for all , also
Obviously, if is a linear mapping of E in a vector space F, then , the image of a convex cone C in E, is a convex cone in F. Every intersection of convex cones (with vertex 0) in E is a convex cone. For every subset A of E the intersection of convex cones containing A (these exist, E itself is one such cone) is the smallest convex cone that contains A; it is called the convex cone generated by A.
Proposition 11
Let be a family of convex cones in E; the convex cone generated by the union of the is identical with the set of points , where J is any finite subset of I and for all .
In fact, it is obvious that C, the set of such points, is a convex cone containing the union of the , and that it is contained in any convex cone which contains this union.
Corollary
— For any subset A of E, the convex cone generated by A, is identical with the set of linear combinations , where is any finite non-empty family of points of A, and where for all .
It is sufficient to see that, if a convex cone contains a point of A then it also contains the half-line of the points where varies in the set of positive numbers and that is a convex cone.
Proposition 12
— If A is a convex set in E, then the convex cone generated by A is identical with .
The set C is clearly a cone; it is sufficient to show that C is convex. Let be two points of C (). Let be two numbers such that . Then , with , and ; hence .
Remark
— 1) With the hypotheses of prop. 12, if , then the cone C is non-pointed, thus is proper.
2) Let A be any convex set in E; consider the convex set in the space and the convex cone C with vertex 0 that is generated by . Prop. 12 shows that is the intersection of C and of the hyperplane in F. Every convex set in E can, therefore, be considered as the projection on E of the intersection of a convex cone with vertex 0 in F and the hyperplane .
5. Ordered vector spaces
A preorder structure, on a vector space E, denoted by or , is compatible with the vector space structure of E if it satisfies the following two axioms;
(EO) If then for all .
(EO) If then for every scalar .
The vector space E, carrying these two structures, is called a preordered vector space (resp. an ordered vector space when the relation of preorder on E is an order).
Note that axiom (EO) means that the preorder structure and the additive group structure of E are compatible, that is to say, E carrying these two structures, is a preordered group (A, VI, p. 3).
Example
— On the space of all finite real-valued functions defined over A, the relation of order given by « for all , » is compatible with the vector space structure of E.
Proposition 13
— (i) The set P, of elements , of a preordered vector space E, is a pointed convex cone.
(ii) Conversely, if P is a pointed convex cone in E, then the relation is a preorder relation on E, and the preorder structure that it defines is the only one that is compatible with the vector space structure of E and for which P is the set of elements .
(iii) The relation , with P a pointed convex cone, is an order relation on E if and only if P is a proper cone.
(i) Axioms (EO_I) and (EO_{II}) imply and for all . As , it follows that P is a pointed convex cone (II, p. 11, prop. 10).
(ii) Conversely, if P is a pointed convex cone, the relation implies that the relation is a preorder compatible with the additive group structure of E (A, VI, p. 3, prop. 3); clearly writing it , the set P is identical with the set of ; further the relation for all shows that axiom (EO_{II}) is satisfied.
(iii) To say that P is proper means that (II, p. 11, cor. 2), hence that is an order relation.
Example
\* Let H be a real Hilbert space; in the vector space of continuous endomorphisms of H, the positive hermitian endomorphisms form a proper pointed convex cone; this cone, therefore, defines an order structure compatible with the vector space structure of and for which the relation means that is a positive hermitian endomorphism. \
For any pointed convex cone P in the vector space E, the set is a vector subspace, H, of E (II, p. 11, cor. 2). The canonical image of P in is a convex cone and the inverse image of in E is P. Thus , and defines an order structure on that is compatible with its vector space structure.
A linear form on a preordered vector space E is said to be positive if in E implies . Or, alternatively, if the convex cone P of elements in E is contained in the half space of those for which . Clearly, in the dual to E, the set of positive linear forms is a pointed convex cone.
6. Convex cones in topological vector spaces
Proposition 14
In a topological vector space E, the closure of a convex set (resp. of a convex cone) is a convex set (resp. a convex cone with the same vertex).
For, let A be a convex set; the mapping , where , is continuous in and maps in A; thus (GT, I, § 2.1, th. 1) it maps in , which shows that is convex. Similarly, if C is a convex cone with vertex 0 then and for all .
Definition 4
For any set A of a topological vector space E, the intersection of all the closed convex sets containing A is called the convex closed envelope of A; it is the smallest convex closed set containing A.
From prop. 14, the convex closed envelope of A is the closure of the convex envelope of A; it is clearly the same as the convex closed envelope of .
Similarly we call the smallest symmetric, convex, closed set that contains A, the symmetric convex closed envelope (or the balanced convex closed envelope) of A; it is the closure of the symmetric convex envelope of A (II, p. 10); it is also the symmetric convex closed envelope of .
Proposition 15
— Let () be a finite number of compact convex sets in a Hausdorff topological vector space E. Then the convex envelope of the union of the is compact (and is, therefore, the same as the convex closed envelope of this union).
Let B be the compact set in defined by the points where (), and . Define a continuous mapping of in E by the formula . The convex envelope C of is the image of under this mapping; as is compact and E is Hausdorff, it follows that C is compact.
Corollary 1
— In a Hausdorff topological vector space the convex envelope of a finite set is compact.
Corollary 2
— In a topological vector space E, the convex envelope of a finite set is precompact.
In fact, let j be the canonical mapping of E in its Hausdorff completion ; if C is the convex envelope of A, then is the convex envelope of the finite set in , hence is compact (cor. 1) and therefore C is precompact (GT, II, § 4.2).
Proposition 16
— Let A be a convex subset, with at least one interior point , of a topological vector space E. For any point , every point of the open segment with end points lies in the interior of A.
For any point y of this segment, let f be the homothety of centre y and ratio , which transforms into x. If V is an open neighbourhood of contained in A, then is a neighbourhood of x and therefore contains a point ; now
hence , so that y is transformed into z by the homothety g, of centre and ratio ; since , g transforms V into a neighbourhood of 0 contained in A. The proposition is proved.
Corollary 1
— The interior of a convex set , is itself a convex set; if is not empty, then it coincides with the interior of , and is a convex set that coincides with the closure of .
It follows from prop. 16, that if is not empty, then it is a convex set and every point of is a cluster point of . Next we show that every interior point of belongs to . Let x be an interior point of and suppose, for definiteness that . Let V be a symmetric neighbourhood of 0 that is contained in and let ; now , and therefore, by prop. 16, we see that , if ; this is obviously true if .
Corollary 2
— The interior of a convex cone C, is itself a convex cone; if is not empty then it coincides with the interior of , and is a pointed convex cone that coincides with the closure of .
Since homotheties of ratio and centre 0 transform C into itself, they do the same for , thus is a cone; the remainder of the corollary follows from cor. 1 and the obvious remark that if C is not empty then contains the vertex of C.
Let H be a closed hyperplane in the topological vector space E over ; it has an equation of the form , where is a continuous linear form that is not identically zero in E (I, p. 13, th. 1). The closed half spaces defined respectively by and are therefore closed convex sets; their complements defined respectively by and , are open convex sets. We say that these half-spaces are the closed (resp. open) half spaces determined by H.
Proposition 17
— In a topological vector space E, let A be a set with at least one interior point, and such that all its points lie on the same side of an hyperplane H. Then H is closed, the interior points of A lie strictly on the same side of H, and the cluster points of A lie on the same side of H. In particular open (resp. closed) half spaces are determined by closed hyperplanes.
In fact suppose that H contains the origin and that is an equation of H; suppose, for definiteness, that for all . The half space formed by the points y such that contains at least one interior point, and, by translation, the same is true of the half space of points y such that ; this shows that H is closed (I, p. 11, corollary). Then we know that is a strict morphism of E on (I, p. 13, corollary), therefore is an open set in . This set cannot contain 0 or it would contain numbers contrary to hypothesis; it is thus contained in the open interval . On the other hand, the half space of those y for which is closed and contains A, therefore it contains .
Corollary
— Let P be a pointed convex cone, with at least one interior point, of the topological vector space E. Then each linear form f that is not identically zero on E, and is positive for the preorder structure defined by P (II, p. 13), is necessarily continuous. Further, if x is interior to P then and if x is a cluster point of P then .
Apply prop. 17 to the case where H is the hyperplane with the equation .
Remark
In a topological vector space E, every convex set C is connected. In fact, if , then C is a union of segments with end point a and closed at a; these are connected and the result follows from GT, I, § 11.1, prop. 2.
7. Topologies on ordered vector spaces
Let E be an ordered vector space. A topology on E is compatible with the ordered vector space structure of E if it is both compatible with the vector space structure of E and subject to the following axiom :
(TO) The convex cone of the x with , is closed in E.
An ordered vector space E with a compatible topology is called an ordered topological vector space.
Example
The space with its usual topology and the order structure that is the product of the order structure of its factors is an ordered topological vector space. On the other hand, for , when carries the lexicographical order (S, III, § 2.6), the usual topology is not compatible with the ordered vector space structure of .
Let A be a set; the vector space of real valued bounded functions defined on A, with the topology defined by the norm and the order structure induced by the product order structure of , is an ordered topological vector space.
In an ordered topological vector space E, the set of elements is closed; since translations are homeomorphisms, we deduce that, for all , the set of elements (resp. ) is closed. Since is the intersection of the sets and , it follows that is closed and that E is Hausdorff.
Proposition 18
In an ordered topological vector space E, let H be a set directed by the relation . If the section filter of H has a limit in E, then this limit is the upper bound of H.
For, let ; for every , the set of such that is a set of the section filter of H, therefore b is a cluster point of this set; but as the set is closed in E, we have , thus b is an upper bound of H. On the other hand, if a is an upper bound of H, then H is contained in the closed set ; as b is a cluster point of H, we have , which completes the proof (II, p. 72, exerc. 42).
8. Convex functions
Definition 5
Let X be a convex subset of the affine space E. A real-valued finite function, defined over X is convex (resp. strictly convex) if for any two distinct points x, y of X and any real number , we have:
(1)
(2)
When , this definition of convex function is the same as that in FVR, I, p. 32. Further, f is convex (resp. strictly convex) in X if, and only if, for every affine line , the restriction of f to is convex (resp. strictly convex) in .
Example
If f is an affine linear function on E, then f and are convex functions on E; this is obvious for f since
for ; further, the restriction of to an affine line is strictly convex if is not a constant.
A real-valued function , defined over , is concave (resp. strictly concave) if — is convex (resp. strictly convex). That is to say, for every two distinct points of and every number , such that , we have
(resp.
A mapping of in is affine if it is both convex and concave (cf. II, p. 78, exerc. 11).
Proposition 19
Let be a convex set of the affine space ; and let be a real-valued function defined over . Denote the set of points for which and (resp. and ) by (resp. ). Then the following conditions are equivalent*:
a) The function is convex. b) The set in the affine space is convex. c) The set in the affine space is convex.
We show that . Let and be two points of and , then and if is convex
which shows that the point of belongs to . Thus is convex.
Next we show that . If are two points of then for every , and belong to and, if , the same is true of ; by the definition of this implies that belongs to .
Finally , for (with the above notation), if belongs to then
provided and ; hence (1) follows and is convex.
Corollary
If is convex in , then for all , the set of such that (resp. ) is convex*.
In fact, it is the projection on of the intersection of (resp. ) and the hyperplane in .
Proposition 20
Let be a convex function, defined over a convex set of the affine* space E. Then for every family of points of X and every family of real numbers, all , such that , we have:
(3)
If is strictly convex and if for all , then
(4)
The inequality (3) follows from II, prop. 19 above and II, p. 8, prop. 1. Suppose that the are not all equal (which implies ) and that the are all ; then the point differs from at least one . Suppose for definiteness that , write where . Then and, as , we have, by hypothesis,
9. Operations on convex functions
Let X be a convex set of an affine space E. If are finitely many convex functions defined over X and are numbers then the function is convex over X.
If is any family of convex functions defined over X and if , the upper envelope of the family in X, is finite then is convex.
Finally if H is a set of convex functions defined over X, and is a filter on H that converges simply in X to the finite real valued function , then is convex over X.
10. Convex functions over an open convex set
Proposition 21
Let be a convex function, defined over the non-empty open convex set X in the topological vector space E. Then is continuous if, and only if, it is bounded above when restricted to some non-empty open subset U of X.
The condition is obviously necessary, we prove that it is sufficient. Let be a point such that is bounded above in a neighbourhood V of ; we show firstly that is continuous at . By translation, we can restrict ourselves to the case when and ; moreover we can suppose that the neighbourhood V is balanced (I, p. 7, prop. 4). Suppose that in V; for every , we observe that if , then and . Applying inequality (1) of II, p. 16 to the points and 0 and to the number , we see that ; applying it to points and and the number , gives . Thus is arbitrarily small in , if is sufficiently small, and is continuous at .
Now let be some point of X; since X is open, there is a number such that belongs to X. Let be the homothety of centre and ratio , which transforms 0 into ; for every point , we have from (1)
Thus is bounded above in a neighbourhood of and hence, by the first part, is continuous at . The proposition is proved.
Corollary
Every convex function f defined over an open convex set X in is continuous in X.
We can suppose that X is not empty. Then there exist, in X, affinely independent points () and the convex envelope of these points, S, contains the open non-empty set formed of the points with for all and . By II, p. 17, prop. 20, is bounded above in S and therefore is continuous.
In a topological vector space of infinite dimensions there exist, in general, linear non-continuous forms (II, p. 80, exerc. 25) and thus convex functions that are not continuous at any point.
11. Semi-norms and convex sets
Let E be a vector space over ; a mapping of E in is positively homogeneous if, for every and all we have
A positively homogeneous function on E is convex if, and only if, it satisfies axiom (SN) of II, p. 1 for all of E;
In fact, if is convex, then for in E,
and, by (5), this relation is equivalent to (6). Conversely, if (6) holds, then we also have for all such that ,
using (5).
A convex positively homogeneous function on E is called sub-linear.
If is a sub-linear function defined on E; then, by II, § 2.8, corollary, for all , the set (resp. ) of points for which (resp. ) is convex; further this set is absorbent, since for all , there exists such that .
There is a partial converse of this result:
Proposition 22
Let A be a convex set, containing 0, in the vector space E. For all , put
Since the relations and are equivalent when , we have for . Let be two points of E. If (resp. ) is not absorbed by A then (resp. ) and the inequality is obviously true. Suppose there exist such that , and ; then (II, p. 8, Remark); and thus . The inclusion is clearly true. The inclusion follows because A is convex and contains 0. Finally if A is absorbent then is obviously finite.
The function defined by (7) is called the gauge of the convex set A. If A is absorbent and symmetric, then is a semi-norm.
Proposition 23
Let E be a topological vector space. If A is an open convex set which contains 0, then is finite and continuous, and . If A is a closed convex set containing 0, then is lower semi-continuous and .
If A is open and contains 0, then it is absorbent. For , there exists such that , and thus ; this, combined with (9) gives . Since the convex function is bounded above in the open set A, it is continuous in E (II, p. 18, prop. 21).
Suppose A is closed and contains 0. For every with , we have for all , therefore since A is closed; remembering (9), this shows that . For all , is therefore the set of such that ; as in E, this shows that is lower semi-continuous in E (GT, IV, § 6.2).
A positive sublinear function over E is the gauge of each convex set A where .
Exercises
See the exercises for § 2.