Bourbaki

§ 9. Compact Lie groups operating on manifolds

In this paragraph, X denotes a separated, locally finite dimensional, real manifold of class Cr(1≤r≤ω)C^r(1\leq r\leq \omega ).

1. Embedding of a manifold in the neighbourhood of a compact set

Lemma 1 01HE

Let T and T′T' be two topological spaces, A and A′A' compact subsets of T and T′T', respectively, W a neighbourhood of A×A′A\times A' in T×T′T\times T'. There exists an open neighbourhood U of A in T and an open neighbourhood U′U' of A′A' in T′T' such that U×U′⊂WU\times U'\subset W.

Let x∈Ax\in A; there exist open subsets UxU_x of T and Ux′U'_x of T′T' such that {x}×A′⊂Ux×Ux′⊂W:\{x\} \times A'\subset U_x\times U'_x\subset W: indeed, the compact subset {x}×A′\{x\} \times A' of T×T′T\times T' can be covered by a finite number of open sets contained in W, of the form Ui×Ui′U_i\times U'_i, with x∈Uix\in U_i; it suffices to take Ux=⋂iUiU_x=\bigcap_iU_i and Ux′=⋃iUi′U'_x=\bigcup_iU'_i.

Since A is compact, there exist points x1,...,xmx_1, . . . , x_m of A such that A⊂⋃iUxiA\subset \bigcup_iU_{x_i}; put U=⋃iUxiU =\bigcup_iU_{x_i} and U′=⋂iUxi′U'=\bigcap_iU'_{x_i}. Then A×A′⊂U×U′⊂WA\times A'\subset U\times U'\subset W, hence the lemma.

In the remainder of this number, Y denotes a separated manifold of class CrC^r.

Proposition 1 01HF

Let φ:X→Y\varphi : X\rightarrow Y be a morphism of class CrC^r, A a compact subset of X. The following conditions are equivalent:

(i) The restriction of φ\varphi to A is injective, and φ\varphi is an immersion at every point of A;

(ii) there exists an open neighbourhood U of A such that φ\varphi induces an embedding of U into Y.

When these conditions are satisfied, φ\varphi is said to be an embedding in the neighbourhood of A.

We prove that (i) implies (ii), the other implication being clear. Assuming (i), there exists an open neighbourhood V of X containing A such that the restriction of φ\varphi to V is an immersion (Differentiable and Analytic Manifolds, Results, 5.7.1). Denote by Γ\Gamma the set of points (x,y)(x, y) in V×VV\times V such that φ(x)=φ(y)\varphi (x) =\varphi (y), and by Δ\Delta the diagonal in V×VV\times V. Then Δ\Delta is an open subset of Γ:\Gamma : indeed, for all x∈Vx\in V, there exists an open neighbourhood UxU_x of xx such that the restriction of φ\varphi to UxU_x is injective, that is, such that Γ∩(Ux×Ux)=\Gamma \cap (U_x\times U_x) = Δ∩(Ux×Ux)\Delta \cap (U_x\times U_x).

Since Y is separated, Γ\Gamma is closed in V×VV\times V; consequently the complement W of Γ\Gamma -- Δ\Delta in V×VV\times V is open. By assumption, W contains A×AA\times A; Lemma 1 implies that there exists an open subset U′U' of V containing A such that U′×U′⊂WU'\times U'\subset W, that is, such that the restriction of φ\varphi to U′U' is injective. Moreover, there exists an open neighbourhood U of A whose closure is compact and contained in U′(U'(General Topology, Chap. I, §9, no. 7, Prop. 10). Then φ\varphi induces a homeomorphism from U to φ\varphi(U), and consequently from U to φ(U)\varphi (U); it follows that the restriction of φ\varphi to U is an embedding (Differentiable and Analytic Manifolds, Results, 5.8.3).

Proposition 2 01HG

Assume that the manifold Y is paracompact; let A be a subset of X, and let φ:X→Y\varphi :X\rightarrow Y be a morphism of class CrC^r that induces a homeomorphism from A to φ(A)\varphi (A), and that is étale at every point of A. Then there exists an open neighbourhood U of A such that φ\varphi induces an isomorphism from U to an open submanifold of Y.

Restricting X and Y if necessary, we can assume that φ\varphi is étale and surjective. Denote by σ:φ(A)→A\sigma :\varphi (A)\rightarrow A the inverse homeomorphism of φ∣A\varphi |A. Since Y is metrizable (Differentiable and Analytic Manifolds, Results, 5.1.6), φ(A)\varphi (A) admits a fundamental system of paracompact neighbourhoods; hence, by General Topology, Chap. XI, there exist an open neighbourhood V of φ(A)\varphi (A) in Y and a continuous map s:V→Xs: V\rightarrow X, that coincides with σ\sigma on φ(A)\varphi (A) and is such that φ(s(y))=y\varphi (s(y)) =y for all y∈Vy\in V. Moreover, ss is topologically étale, so s(V)s(V) is an open set U containing A. Then φ\varphi induces a homeomorphism φ′\varphi ' from U to V; by Differentiable and Analytic Manifolds, Results,5.7.8,φ′, 5.7.8,\varphi ' is an isomorphism.

In the remainder of this number, we assume that r≠ωr\not=\omega.

Proposition 3 01HH

Let A be a compact subset of X. The set P\mathscr{P} of morphisms φ∈Cr(X;Y)\varphi \in \mathscr{C}^r(X;Y) that are embeddings in the neighbourhood of A is open in Cr(X;Y)\mathscr{C}^r(X;Y) in the topology of compact CrC^r-convergence (§ 6, no. 4).

Clearly, it suffices to prove the proposition for r=1r= 1.

a) We show first that the subset J of C1(X;Y)\mathscr{C}^1(X;Y) consisting of the morphisms that are immersions at every point of A is open. Consider the map jA:C1(X;Y)×A→J1(X;Y)j_A:\mathscr{C}^1(X;Y)\times A\rightarrow J^1(X;Y) such that jA(φ,x)=jx1(φ)(j_A(\varphi , x) =j_x^1(\varphi ) (Differentiable and Analytic Manifolds, Results, 12.1).

By definition of the topology on C1\mathscr{C}^1(X;Y), the map j~A:φ→jA(φ,.)\widetilde{j}_A:\varphi \rightarrow j_A(\varphi , .) from C1(X;Y)\mathscr{C}^1(X;Y) to C(A;J1(X;Y))\mathscr{C}(A;J^1(X;Y)) is continuous; it now follows from General Topology, Chap. X, §3, no. 4, Th. 3, that jAj_A is continuous.

On the other hand, let M be the set of jets jj in J1(X;Y)J^1(X;Y) whose tangent map T(j):Ts(j)(X)→Tb(j)(Y)(T(j) : T_{\mathbf{s}(j)}(X)\rightarrow T_{\mathbf{b}(j)}(Y) (Differentiable and Analytic Manifolds, Results, 12.3.4) is injective. The set M is open in J1(X;Y)J^1(X;Y); indeed, it suffices to verify this assertion when X is an open subset of a finite dimensional vector space E, and Y is an open subset of a Banach space F; we are then reduced (Differentiable and Analytic Manifolds, Results, 12.3.1) to proving that the set of injective continuous linear maps is open in L\mathscr{L}(E;F), which follows from Spectral Theory, Chap. III, §2, no. 7, Prop. 16.

We conclude from the preceding that the set jA−1(M)j_A^{-1}(M) is open in C1(X;Y)×A\mathscr{C}^1(X;Y)\times A, hence that its complement F\mathscr{F} is closed. Since A is compact, the projection pr1:C1(X;Y)×A→C1(X;Y)_1:\mathscr{C}^1(X;Y)\times A\rightarrow \mathscr{C}^1(X;Y) is a proper morphism, hence closed; consequently, the set J, which is equal to C1(X;Y)\mathscr{C}^1(X;Y) -- pr1(F)_1(\mathscr{F}), is open in C1(X;Y)\mathscr{C}^1(X;Y).

b) Let H be the subset of J×A×AJ\times A\times A consisting of the elements (f,x,y)(f, x, y) such that f(x)=f(y)f(x) =f(y). It is clear that H contains J×ΔJ\times \Delta, where Δ\Delta denotes the diagonal in the product A×AA\times A; we show that H′=HH'= H -- (J×Δ)(J\times \Delta ) is closed in J×A×AJ\times A\times A. Since P\mathscr{P} is the complement in J of the image of H′H' under the proper projection pr1:J×A×A→J_1: J\times A\times A\rightarrow J, this will imply the proposition.

The topology of C1(X;Y)\mathscr{C}^1(X;Y) being finer than the topology of compact convergence, the map (φ,x)→φ(x)(\varphi , x) \rightarrow \varphi (x) from C1(X;Y)×A\mathscr{C}^1(X;Y)\times A to Y is continuous (General Topology, Chap. X, §3, no. 4, Cor. 1 of Th. 3); it follows that H is closed in J×A×AJ\times A\times A. Hence, it suffices to show that J×ΔJ\times \Delta is open in H, in other words, that for all φ∈J\varphi \in J and all x∈Ax\in A there exists a neighbourhood Ω\Omega of φ\varphi in J and a neighbourhood B of xx in X such that, for any morphism ψ\psi in Ω\Omega, the restriction of ψ\psi to A∩BA\cap B is injective.

Thus, the proposition follows from the following lemma:

Lemma 2 01HI

Let xx be a point of X,φ:X→Y,\varphi : X\rightarrow Y a morphism of class C1C^1 that is an immersion at xx. There exists a neighbourhood Ω\Omega of φ\varphi in C1(X;Y)\mathscr{C}^1(X;Y) and a neighbourhood B of xx in X such that, for all ψ∈Ω\psi \in \Omega, the restriction of ψ\psi to B is injective.

Let U be a relatively compact open neighbourhood of xx isomorphic to a finite dimensional vector space, and such that φ(U)\varphi (U) is contained in the domain V of a chart. The set Ω0\Omega_0 of ψ∈C1(X;Y)\psi \in \mathscr{C}^1(X;Y) such that ψ(U)⊂V\psi (U)\subset V is open in C1\mathscr{C}^1(X;Y), and the restriction map Ω0→C1(U;V)\Omega_0\rightarrow \mathscr{C}^1(U;V) is continuous; we are thus reduced to proving the lemma when X = U and Y = V, in other words, we can assume that X is a finite dimensional vector space and Y is a Banach space. Choose norms on X and Y.

The linear map Dφ(x):X→D\varphi (x) : X\rightarrow Y is injective; denote its conorm by q(q(Spectral Theory, Chap. III, §2, no. 6), so that, by definition, we have ∥Dφ(x).t∥≥q∥t∥\|D\varphi (x).t\| \geq q\|t\| for all t∈Xt\in X. Let ε∈R\varepsilon \in \mathbf{R} be such that 0<ε<q/20< \varepsilon < q/2, and let B be a closed ball with centre xx such that ∥Dφ(u)−Dφ(x)∥≤ε\|D\varphi (u)-D\varphi (x)\| \leq \varepsilon for all u∈Bu\in B. Denote by Ω\Omega the subset of C1(X;Y)\mathscr{C}^1(X;Y) consisting of the morphisms ψ\psi such that ∥Dψ(u)−Dφ(u)∥≤ε\|D\psi (u)-D\varphi (u)\| \leq \varepsilon for all u∈Bu\in B; it is open by definition of the topology of C1(X;Y)\mathscr{C}^1(X;Y). For ψ∈Ω\psi \in \Omega, put ψ0=ψ−Dφ(x)\psi_0=\psi -D\varphi (x). We have ∥Dψ0(u)∥≤2ε\|D\psi_0(u)\| \leq 2\varepsilon for all u∈Bu\in B, and consequently ∥ψ0(u)−ψ0(v)∥≤2ε∥u−v∥\|\psi_0(u)-\psi_0(v)\| \leq 2\varepsilon \|u-v\| for all uu and vv in B (Differentiable and Analytic Manifolds, Results, 2.2.3). It follows that

∥ψ(u)−ψ(v)∥≥∥Dφ(x).(u−v)∥−∥ψ0(u)−ψ0(v)∥≥(q−2ε)∥u−v∥ \|\psi (u)-\psi (v)\| \geq \|D\varphi (x).(u-v)\| - \|\psi_0(u)-\psi_0(v)\| \geq (q-2\varepsilon )\|u-v\|

Consequently, the restriction of ψ\psi to B is injective, hence the lemma.

Proposition 4 01HJ

Let A be a compact subset of X. There exist a finite dimensional vector space E and a morphism φ∈Cr(X;E)(r≠ω)\varphi \in \mathscr{C}^r(X;E) (r\not=\omega ) that is an embedding in the neighbourhood of A.

Let (Ui,φi,Ei)i∈I(U_i, \varphi_i,E_i)_{i\in I} be a finite family of charts of X whose domains cover A. We extend φi\varphi_i to a map from X to EiE_i (also denoted by φi\varphi_i) by putting φi(x)=0\varphi_i(x) = 0 for x∉Uix \notin U_i. Let (Vi)i∈I(V_i)_{i\in I} be a covering of A by open subsets of X such that V‾i⊂Ui\overline{V}_i\subset U_i for all i∈Ii\in I (the existence of such a covering follows from General Topology, Chap. IX, §4, no. 3, Cor. 1 of Th. 3, applied to the compact space X′X' obtained by adjoining to X a point at infinity and the covering of X′X' consisting of the open sets Ui(i∈I)U_i(i\in I) and X′X' -- A). For all i∈Ii\in I, let αi\alpha_i be a numerical function of class CrC^r on X, equal to 1 at every point of ViV_i, and with support contained in Ui(U_i(Differentiable and Analytic Manifolds, Results, 5.3.6).

Consider the map φ:X→⨁i∈I(Ei⊕R)\varphi : X\rightarrow \bigoplus_{i\in I}(E_i\oplus \mathbf{R}) defined by

φ(x)=(αi(x)φi(x),αi(x))i∈I \varphi (x) = (\alpha_i(x)\varphi_i(x), \alpha_i(x))_{i\in I}

For all i∈Ii\in I, the map αiφi\alpha_i\varphi_i is of class CrC^r (since its restrictions to UiU_i and to the complement of the support of αi\alpha_i are), and its restriction to ViV_i is an embedding; it follows that φ\varphi is a morphism of class CrC^r and is an immersion at every point of A. We show that the restriction of φ\varphi to A is injective. Let x,yx, y be two points of A such that φ(x)=φ(y)\varphi (x) =\varphi (y), and let i∈Ii\in I be such that x∈Vix\in V_i. Then αi(x)=1\alpha_i(x) = 1, so αi(y)=1\alpha_i(y) = 1, which implies that y∈Uiy\in U_i; but we also have φi(x)=φi(y)\varphi_i(x) =\varphi_i(y), so x=yx=y since φi\varphi_i induces an embedding of UiU_i into EiE_i.

It can be shown9^9 that every separated manifold, countable at infinity and of

pure dimension nn, embeds in R2n\mathbf{R}^{2n}; for a weaker result, cf. Exercise 2.

9^9 See H. WHITNEY, The self-intersections of a smooth nn-manifold in 2n2n-space,

Ann. of Math., 45 (1944), pp. 220-246.

2. Equivariant embedding theorem

In this number, we assume that r≠ωr\not=\omega.

Lemma 3 01HK

Let G be a compact topological group operating continuously on a topological space X; let A be a subset of X, stable under G, and W a neighbourhood of A. Then, there exists an open neighbourhood V of A stable under G and contained in∘W_{\circ}W.

Put F = X -- W and V = X-- GF. Then V is open (General Topology, Chap. III, §4, no. 1, Cor. 1 of Prop. 1), stable under G, and A⊂V⊂WA\subset V\subset W.

Theorem 1 01HL

Let G be a compact Lie group, (g,x)→gx(g, x) \rightarrow gx a law of left operation of class CrC^r of G on X, and A a compact subset of X. There exists an analytic linear representation ρ\rho of G on a finite dimensional vector space E, a morphism φ:X→E\varphi : X\rightarrow E of class CrC^r, compatible with the operations of G, and an open neighbourhood U of A, stable under G, such that the restriction of φ\varphi to U is an embedding.

Replacing A by the compact set GA, we are reduced to the case in which A is stable under G.

Let E0E_0 be a finite dimensional vector space such that there exists an element of Cr(X;E0)\mathscr{C}^r(X;E_0) that is an embedding in the neighbourhood of A (no. 1, Prop. 4); the set P\mathscr{P} of morphisms having this property is a non-empty open subset of Cr(X;E0)\mathscr{C}^r(X;E_0) (no. 1, Prop. 3). Consider the continuous linear representation of the compact group G on the space Cr(X;E0)(\mathscr{C}^r(X;E_0) (§6, no. 4, Lemma 4). By the Peter-Weyl theorem (Spectral Theory, in preparation), the union of the finite dimensional subspaces stable under G is dense in Cr(X;E0)\mathscr{C}^r(X;E_0); hence, there exists an element φ0\varphi_0 of P\mathscr{P} such that the maps x→φ0(gx)x \rightarrow \varphi_0(gx), for g∈Gg\in G, generate a finite dimensional vector subspace E1E_1 of Cr(X;E0)\mathscr{C}^r(X;E_0), which is clearly stable under the operation of G.

Take E to be the space HomR(E1,E0),ρ_{\mathbf{R}}(E_1,E_0),\rho to be the representation of G on E induced by the action on E1E_1, and φ:X→E\varphi : X\rightarrow E to be the map that associates to x∈Xx\in X the linear map ψ→ψ(x)\psi \rightarrow \psi (x) from E1E_1 to E0E_0. This is a morphism of class CrC^r; for x∈X,g∈G,ψ∈E1x\in X,g\in G,\psi \in E_1, we have (denoting by τ(g)\tau (g) the automorphism x→gxx \rightarrow gx of X):

φ(gx)(ψ)−ψ(gx)=φ(x)(ψ∘τ(g))=(ρ(g)φ(x))(ψ) \varphi (gx)(\psi )-\psi (gx) =\varphi (x)(\psi \circ \tau (g)) = (\rho (g)\varphi (x))(\psi )

Let α:\alpha : HomR(E1,E0)→E0_{\mathbf{R}}(E_1,E_0)\rightarrow E_0 be the linear map u→u(φ0)u \rightarrow u(\varphi_0); we have α∘φ=φ0\alpha \circ \varphi =\varphi_0, so φ\varphi is an embedding in the neighbourhood of A because φ0\varphi_0 is one. Hence, there exists an open neighbourhood U of A such that the restriction of φ\varphi to U is an embedding; we can choose U stable under G by Lemma 3, hence the theorem.

Corollary 1 01HM

Assume that X is compact. There exists an analytic linear representation ρ\rho of G on a finite dimensional vector space E and an embedding φ:X→E\varphi : X\rightarrow E such that φ(gx)=ρ(g)φ(x)\varphi (gx) =\rho (g)\varphi (x) for g∈G,x∈Xg\in G, x\in X.

Corollary 2 01HN

Let H be a closed subgroup of G. There exists an analytic linear representation of G on a finite dimensional vector space E and a point v∈Ev\in E with fixer H.

Apply Cor. 1 to the canonical operation of G on the compact manifold G/HG/H. This gives an analytic linear representation ρ:G→GL(E)\rho : G\rightarrow \mathbf{G}\mathbf{L}(E) and an embedding φ:G/H→E\varphi : G/H\rightarrow E such that φ(gx)=ρ(g)φ(x),g∈G,x∈G/H\varphi (gx) =\rho (g)\varphi (x),g\in G, x\in G/H. Let e‾∈G/H\overline{e}\in G/H be the class of e∈Ge\in G, and v=φ(e‾)v=\varphi (\overline{e}) its image. For all g∈Gg\in G, we have ρ(g)v=v⇐⇒φ(ge‾)=φ(e‾)⇐⇒ge‾=e‾⇐⇒g∈H\rho (g)v=v\Leftarrow \Rightarrow \varphi (g\overline{e}) =\varphi (\overline{e})\Leftarrow \Rightarrow g\overline{e}= \overline{e}\Leftarrow \Rightarrow g\in H.

Corollary 3 01HO

Assume that X is paracompact. There exists a real Hilbert space E, a continuous unitary representation 10ρ^{10}\rho of G on E and an embedding φ:X→E\varphi : X\rightarrow E of class CrC^r such that φ(gx)=ρ(g)φ(x)\varphi (gx) =\rho (g)\varphi (x) for all g∈Gg\in G and all x∈Xx\in X.

The space X/GX/G is locally compact (General Topology, Chap. III, §4, no. 5, Prop. 11). Its connected components are the images of the connected components of X, which are countable at infinity (General Topology, Chap. I, §9, no. 10, Th. 5); thus, they are themselves countable at infinity, which implies that X/GX/G is paracompact (loc. cit.). Hence, there exists a locally finite covering (Uα′)α∈I(U'_{\alpha})_{\alpha\in I} of X/GX/G by relatively compact open sets, and a covering (Vα′)α∈I(V'_{\alpha})_{\alpha\in I} such that V‾α′⊂Uα′\overline{V}'_{\alpha}\subset U'_{\alpha} for all α∈I(\alpha \in I (General Topology, Chap. IX, §4, no. 3, Cor. 1 of Th. 3); taking the inverse image, we obtain two locally finite coverings (Uα)α∈I(U_{\alpha})_{\alpha\in I} and (Vα)α∈I(V_{\alpha})_{\alpha\in I} of X by relatively compact open sets stable under G, such that V‾α⊂Uα\overline{V}_{\alpha}\subset U_{\alpha} for all α∈I\alpha \in I.

For all α∈I\alpha \in I, there exists a representation ρα\rho_{\alpha} of G on a finite dimensional real vector space EαE_{\alpha} and a morphism φα∈Cr(X;Eα)\varphi_{\alpha}\in \mathscr{C}^r(X;E_{\alpha}), compatible with the operations of G, whose restriction to UαU_{\alpha} is an embedding (Th. 1). For α∈I\alpha \in I, let aαa_{\alpha} be a numerical function of class CrC^r on X, equal to 1 on VαV_{\alpha} and to 0 outside Uα(U_{\alpha}(Differentiable and Analytic Manifolds, Results, 5.3.6). Put bα(x)=∫Gaα(gx)dgb_{\alpha}(x) =\int_Ga_{\alpha}(gx)dg for x∈Xx\in X. The function bαb_{\alpha} is of class CrC^r, invariant under G (§6, no. 4, Cor. 2), equal to 1 on VαV_{\alpha} and to 0 outside UαU_{\alpha}. Give each EαE_{\alpha} a Hilbert scalar product invariant under G (§1, no. 1), and R\mathbf{R} its canonical Hilbert structure; let E be the Hilbert sum of the family (Eα⊕R)α∈I(E_{\alpha}\oplus \mathbf{R})_{\alpha\in I}, and let ρ\rho be the representation of G on E induced by the ρα\rho_{\alpha} and the trivial action of G on R\mathbf{R}. For x∈Xx\in X, put φ(x)=(bα(x)φα(x),bα(x))α∈I\varphi (x) = (b_{\alpha}(x)\varphi_{\alpha}(x), b_{\alpha}(x))_{\alpha\in I}. Then φ\varphi is a morphism of class CrC^r from X to E, compatible with the operations of G; we verify as in the proof of Prop. 4 (no. 1) that φ\varphi is an embedding, which implies the corollary.

10^{10}That is (Spectral Theory, in preparation) a continuous linear representation (Integration, Chap. VIII, §2, no. 1) such that the operator ρ(g)\rho (g) is unitary for all

g∈G g\in G

3. Tubes and transversals

Lemma 4 01HP

Let H be a compact Lie group, ρ:H→GL(V)\rho : H\rightarrow \mathbf{G}\mathbf{L}(V) a continuous (hence analytic) representation of H on a finite dimensional real vector space, and W a neighbourhood of the origin in V. There exists an open neighbourhood B of the origin, contained in W and stable under H, and an analytic isomorphism u:V→Bu: V\rightarrow B, compatible with the operations of H, such that u(0)=0u(0) = 0 and Du(0)=Du(0) = IdV_V.

Choose a scalar product on V invariant under H (§1, no. 1). There exists a real number r>0r >0 such that the open ball B of radius rr is contained in W; it is clearly stable under H. Put u(v)=r(r2+∥v∥2)−1/2vu(v) =r(r^2+\|v\|^2)^{-1/2}v for all v∈Vv\in V; then uu is a bijective analytic map from V to B, compatible with the operations of H, and its inverse map w→r(r2−∥w∥2)−1/2ww \rightarrow r(r^2- \|w\|^2)^{-1/2}w is analytic. Moreover, u(0)=0u(0) = 0 and Du(0)=Du(0) = IdV_V.

Proposition 5 01HQ

Let H be a compact Lie group, (h,x)→hx(h, x) \rightarrow hx a law of left operation of class CrC^r of H on X, and xx a point of X fixed under the operation of H. Then the group H operates linearly on the vector space T=Tx(X)T = T_x(X); there exists an open embedding φ:T→X\varphi : T\rightarrow X of class CrC^r, compatible with the operations of H, such that φ(0)=x\varphi (0) =x and T0(φ)T_0(\varphi ) is the identity map of T.

Let (U,ψ,E)(U, \psi ,E) be a chart of X at xx, such that U is stable under H (no. 2, Lemma 3) and such that ψ(x)=0\psi (x) = 0. Identify E with T by means of Tx(ψ)T_x(\psi ), and put

ψ♯(y)=∫Hh.ψ(h−1y)dh\psi^{\sharp}(y) =\int_Hh.\psi (h^{-1}y)dh for y∈Uy\in U,

where dhdh is the Haar measure on H of total mass 1.

Then (§6, no. 4, Cor. 11)ψ♯\psi^{\sharp} is a morphism of class CrC^r from U to T, compatible with the operations of H, such that ψ♯(x)=0\psi^{\sharp}(x) = 0 and dxψ♯=d_x\psi^{\sharp}= IdT_T. Hence, there exists an open set U′⊂UU'\subset U containing xx, and an open neighbourhood V of 0 in T, such that ψ♯\psi^{\sharp} induces an isomorphism θ:U′→V\theta : U'\rightarrow V. Restricting U′U' and V if necessary, we can assume that they are stable under H and that there exists an isomorphism u:T→Vu: T\rightarrow V compatible with the operations of H (Lemma 4). It now suffices to take φ=θ−1∘u\varphi =\theta^{-1}\circ u.

Recall (Differentiable and Analytic Manifolds, Results, 6.5.1) that if G is a Lie group, H a Lie subgroup of G and Y a manifold on which H operates on the left, we denote by G×HYG\times^HY the quotient of the product manifold G×YG\times Y by the right operation ((g,y),h)→(gh,h−1y)((g, y), h) \rightarrow (gh, h^{-1}y) of H; this is a manifold on which the Lie group G operates naturally on the left; the projection G×HY→G/HG\times^HY\rightarrow G/H is a bundle with fibre Y. Further, if Y is a finite dimensional vector space on which H operates linearly, G×HYG\times^HY has a natural structure of vector G-bundle with base G/H(G/H (Differentiable and Analytic Manifolds, Results, 7.10.2).

Let G be a Lie group operating properly on the manifold X (General Topology, Chap. III, §4, no. 1, Def. 1) such that the law of operation (g,x)→gx(g, x) \rightarrow gx is of class CrC^r. Then, for every point xx of X, the orbit GxGx of xx is a closed submanifold of X, isomorphic to the Lie homogeneous space G/GxG/G_x, where GxG_x is the fixer of xx in G (cf. Chap. III, §1, no. 7, Prop. 14 (ii), and General Topology, Chap. III, §4, no. 2, Prop. 4); this is a compact Lie group (loc. cit.).

Proposition 6 01HR

Assume that the manifold X is paracompact; let xx be a point of X, GxG_x its fixer. There exists a finite dimensional analytic linear representation τ:Gx→GL(W)\tau : G_x\rightarrow \mathbf{G}\mathbf{L}(W), and an open embedding α:G×GxW→X\alpha : G\times^{G_x}W\rightarrow X of class CrC^r, compatible with the operations of G, that maps the class of (e,0)∈G×W(e,0)\in G\times W to xx.

Put T=Tx(X)T = T_x(X). Let W be a complementary subspace of Tx(Gx)T_x(Gx) in T, stable under GxG_x (for example, the orthogonal complement of Tx(Gx)T_x(Gx) with respect to a scalar product on T invariant under GxG_x). On the other hand, let φ:T→X\varphi : T\rightarrow X be a morphism with the properties stated in Prop. 5 (relative to H=GxH = G_x). Consider the morphism λ:G×W→X\lambda : G\times W\rightarrow X defined by λ(g,w)=gφ(w)\lambda (g, w) =g\varphi (w). It induces by passage to the quotient a morphism μ:G×GxW→X\mu: G\times^{G_x}W\rightarrow X of class CrC^r, compatible with the operations of G, that maps the class zz of (e,0)(e,0) to xx.

We show that μ\mu is étale at the point zz. We have

dim(G ×GxW\times^{G_x}W) == dim(G) + dim(W) −- dim(Gx_x)

= dim(Gxx) ++ dim(W) = dim(T),

so it suffices to show that μ\mu is submersive at zz, or equivalently that λ\lambda is submersive at (e,0)(e,0). But, the tangent map T(e,0)(λ):Te(G)⊕W→TT_{(e,0)}(\lambda ) : T_e(G)\oplus W\rightarrow T is equal to Te(ρ(x))+iT_e(\rho (x)) +i, where ρ(x)\rho (x) is the orbital map g→gxg \rightarrow gx and ii the canonical injection from W to T; since Im Te(ρ(x))=Tx(Gx)T_e(\rho (x)) = T_x(Gx), the map T(e,0)(λ)T_{(e,0)}(\lambda ) is surjective, and μ\mu is étale at zz.

We are going to show that there exists an open neighbourhood Ω\Omega of GzGz in G×GxWG\times^{G_x}W, stable under G, such that μ\mu induces an isomorphism from Ω\Omega onto an open subset of X. This will imply the proposition: indeed, the inverse image of Ω\Omega in G×WG\times W is stable under G, and hence is of the form G×BG\times B, where B is an open subset of W containing the origin and stable under GxG_x; restricting Ω\Omega if necessary, we can assume that there exists an isomorphism u:W→Bu: W\rightarrow B, compatible with the operations of GxG_x (Lemma 4). It is clear that the composite morphism α:G×GxW⟶(Id,u)G×GxB⟶μ\alpha : G\times^{G_x}W\overset{(Id,u)}{\longrightarrow}G\times^{G_x}B\longrightarrow^\mu X satisfies the conditions in the statement of the proposition.

Thus, the proposition is a consequence of the following lemma:

Lemma 5 01HS

Let Z be a separated manifold of class CrC^r, equipped with a law of left operation m:G×Z→Zm: G\times Z\rightarrow Z of class CrC^r, and μ:Z→X\mu: Z\rightarrow X a morphism (of class CrC^r) compatible with the operations of G. Let zz be a point of Z, and x=μ(z)x=\mu(z). Assume that μ\mu is étale at zz, and that the fixer of zz in G is equal to the fixer GxG_x of xx. Then, there exists an open neighbourhood Ω\Omega of the orbit GzGz, stable under G, such that μ\mu induces an isomorphism from Ω\Omega onto an open subset of X.

Since μ\mu is compatible with the operations of G, it is étale at every point of GzGz; since the canonical map G/Gx→GxG/G_x\rightarrow Gx is a homeomorphism, so is the map from GzGz to GxGx induced by μ\mu. Hence, it follows from Prop. 2 of no. 1 that there exists an open neighbourhood U of GzGz in Z such that μ\mu induces an open embedding of U into X.

Since G operates properly on X, there exists an open neighbourhood V of xx and a compact subset K of G such that gV∩V=∅gV\cap V =\emptyset for g∉K(g \notin K (General Topology, Chap. III, §4, no. 4, Prop. 7); in particular, e∈Ke\in K. The set W1W_1 of points y∈Zy\in Z such that Ky⊂UKy\subset U is open in Z: indeed, Z-- W1W_1 is the image of the closed set (K×Z)(K\times Z) -- m−1(U)m^{-1}(U) under the proper projection pr2:K×Z→Z_2: K\times Z\rightarrow Z. Put W=W1∩μ−1(V)W = W_1\cap \mu^{-1}(V); this is an open subset of Z, containing zz, and satisfying the following conditions:

(i) KW ⊂U\subset U, and in particular W⊂UW\subset U;

(ii) μ(W)⊂V\mu(W)\subset V.

Put Ω=\Omega = GW and consider the restriction of μ\mu to Ω\Omega. This is an étale morphism, since every point of Ω\Omega is conjugate under G to a point of U. We show that it is injective: let g,hg, h in G and u,vu, v in W be such that μ(gu)=\mu(gu) = μ(hv)\mu(hv). Put k=g−1hk=g^{-1}h; then μ(u)=kμ(v)\mu(u) =k\mu(v), so k∈Kk\in K by (ii). But kvkv and uu belong to U by (i); thus, u=kvu=kv because the restriction of μ\mu to V is injective, so gu=hvgu=hv. Hence, the restriction of μ\mu to Ω\Omega is injective, and consequently (Differentiable and Analytic Manifolds, Results, 5.7.8) is an isomorphism onto an open submanifold of X, which completes the proof.

Under the conditions of Prop. 6, the image of α\alpha is an open neighbourhood T of the orbit A of xx, equipped with the structure of vector bundle with base A, for which the zero section is the orbit A itself. Such a neighbourhood is called a linear tube (around the orbit in question). For each point a∈Aa\in A, the fibre YaY_a of this vector bundle is a submanifold of X, stable under the fixer GaG_a of aa, and such that the morphism from G×GaYaG\times^{G_a}Y_a to X that maps the class of (g,y)∈G×Ya(g, y)\in G\times Y_a to gy∈Xgy\in X induces a morphism of class CrC^r from G×GaYaG\times^{G_a}Y_a to T. Then YaY_a is said to be the transversal at aa of the tube T. We remark that the tangent space at aa of YaY_a is canonically isomorphic to YaY_a and that it is a complement of Ta(A)T_a(A) in Ta(X)T_a(X); thus, the vector bundle T with base A is canonically isomorphic to the normal bundle of A in X (Differentiable and Analytic Manifolds, Results, 8.1.3).

4. Orbit types

Let G be a topological group operating continuously on a separated topological space E. For every point xx of E, denote by GxG_x the fixer of xx in G, and assume that the canonical map G/Gx→GxG/G_x\rightarrow Gx is a homeomorphism; this is notably the case in the following two situations:

a) the topologies of G and E are discrete;

b)Gb) G operates properly on E (General Topology, Chap. III, §4, no. 2, Prop. 4), for example, G is compact (General Topology, Chap. III, §4, no. 1, Prop. 2).

Denote by T\mathscr{T} the set of conjugacy classes of closed subgroups of G. For every x∈Ex\in E, we call the orbit type of xx, or sometimes the type of xx, the class of GxG_x in T\mathscr{T}; two points of the same orbit are of the same orbit type (Algebra, Chap. I, §5, no. 2, Prop. 2); two orbits are of the same type if and only if they are isomorphic as G-sets (Algebra, Chap. I, §5, no. 5, Th. 1). For every t∈Tt\in \mathscr{T}, denote by E(t)E_{(t)} the set of points of E of type tt, that is, the union of the orbits of type tt; this is a stable subset of E. For H∈tH\in t, we also write E(H)E_{(H)} for E(t)E_{(t)}; for example, E(G)E_{(G)} is the closed subspace of E consisting of the points fixed by G.

Give T\mathscr{T} the following preorder relation:

t≤t′⇐⇒t\leq t'\Leftarrow \Rightarrow there exists H∈tH\in t and H′∈t′H'\in t' such that H⊃H′H\supset H'.

Let Ω\Omega and Ω′\Omega ' be two orbits of G on E,tE,t and t′t' their types; then t≤t′t\leq t' if and only if there exists a G-morphism (necessarily surjective and continuous) from Ω′\Omega ' to Ω\Omega.

Let x,x′x, x' be in E, and t,t′t, t' their types; then t≤t′t\leq t' if and only if there exists a∈Ga\in G such that aGx′a−1⊂GxaG_{x'}a^{-1}\subset G_x.

Lemma 6 01HT

Let G be a Lie group.

a) Every decreasing sequence of compact subgroups of G is stationary.

b) Let H and H′H' be two compact subgroups of G such that H⊂H′H\subset H' and such that there exists an isomorphism (of topological groups) from H′H' to H. Then H=H′H = H'.

c) With the relation t≤t′t\leq t', the set T\mathscr{T} is a noetherian ordered set (Theory of Sets, Chap. III, §6, no. 5, text preceding Prop. 7).

a) Let (Hi)i≥1(H_i)_{i\geq 1} be a decreasing sequence of compact subgroups of G; these are Lie subgroups of G (Chap. III, §8, no. 2, Th. 2). The sequence of integers (dim HiH_i)i≥1_{i\geq 1} is decreasing, hence stationary, so there exists an integer N such that the subgroups HiH_i have the same identity component for i≥Ni\geq N. Then the decreasing sequence of positive integers (Hi:(Hi)0)i≥N(H_i: (H_i)_0)_{i\geq N} is stationary, so Hi=Hi+1H_i= H_{i+1} for ii sufficiently large.

b) Let ff be an isomorphism from H′H' to H. The sequence (fn(H))n≥0(f^n(H))_{n\geq 0} is a decreasing sequence of compact subgroups of G, so fn(H)=fn+1(H)f^n(H) =f^{n+1}(H) for nn sufficiently large, by a). Since ff is an isomorphism, this implies that f(H)=H=f(H′)f(H) = H =f(H'), so H=H′H = H'.

c) Let t,t′∈Tt, t'\in \mathscr{T} be such that t≤t′t\leq t' and t′≤tt'\leq t. Then, there exist H,H1∈tH,H_1\in t and H′,H1′∈t′H',H'_1\in t' such that H⊃H′H\supset H' and H1⊂H1′H_1\subset H'_1. Let gg and g′g' be two elements of G such that H1=gHg−1H_1=gHg^{-1} and H1′=g′H′g′−1H'_1=g'H'g^{'-1}; put u=g′−1gu=g^{'-1}g. Then

uHu−1⊂H′⊂H uHu^{-1}\subset H'\subset H

by b), this implies that uHu−1=HuHu^{-1}= H, so H′=HH'= H and t′=tt'=t. Thus, the set T\mathscr{T} is ordered, and it is noetherian by a).

Theorem 2 01HU

Let G be a Lie group operating properly on X, such that the law of operation (g,x)→gx(g, x) \rightarrow gx is of class CrC^r. Assume that X is paracompact.

a) The map which associates to any point of X its orbit type has the following semi-continuity property: let x∈Xx\in X and let t∈Tt\in \mathscr{T} be its orbit type; there exists a stable open neighbourhood U of xx such that, for any u∈Uu\in U, the type of uu is ≥t\geq t.

b) For all t∈T,X(t)t\in \mathscr{T},X_{(t)} is a submanifold of X, the equivalence relation on X(t)X_{(t)} induced by the operation of G is regular (Differentiable and Analytic Manifolds, Results, 5.9.5), and the morphism X(t)→X(t)/GX_{(t)}\rightarrow X_{(t)}/G is a bundle.

c) Assume that X/GX/G is connected. Then the set of orbit types of elements of X has a largest element τ\tau; moreover, X(τ)X_{(\tau)} is a dense open subset of X and X(τ)/GX_{(\tau)}/G is connected.

Let xx be a point of X and t∈Tt\in \mathscr{T} its type. To prove a) and b), we can replace X by a stable open set containing xx, and hence (Prop. 6) can assume that X is of the form G×HWG\times^HW, where W is the space of a finite dimensional analytic linear representation of a compact subgroup H of G, the point xx being the image p(e,0)p(e,0) of (e,0)∈G×W(e,0)\in G\times W under the canonical projection p:G×W→G×HWp: G\times W\rightarrow G\times^HW. If u=p(g,y)∈G×HWu=p(g, y)\in G\times^HW and a∈Ga\in G, then au=uau=u if and only if there exists h∈Hh\in H with (ag,y)=(gh−1,hy)(ag, y) = (gh^{-1}, hy), that is, if a∈gHyg−1a\in gH_yg^{-1}. Thus, Gu=gHyg−1G_u=gH_yg^{-1}; in particular, Gx=HG_x= H, so GuG_u is conjugate to a subgroup of GxG_x, which proves that the type of uu is ≥t\geq t, hence a).

Moreover, uu is of type tt if and only if GuG_u is conjugate to H in G, or equivalently that HyH_y is conjugate to H in G; by Lemma 6b)6b), this means that Hy=HH_y= H, and hence that yy is fixed by H. If W′W' is the vector subspace of W consisting of the elements fixed by H, it follows that X(t)X_{(t)} can be identified with G×HW′G\times^HW', and hence also with G/H×W′G/H\times W', hence b).

To prove c), observe that the assumption that X/GX/G is connected implies that X is pure of finite dimension: indeed, for all k≥0k\geq 0, denote by XkX_k the set of points x∈Xx\in X such that dimxX=k_xX =k; then XkX_k is open and closed in X, and stable under G, so X is equal to one of the XkX_k.

We now prove c) by induction on the dimension of X, the assertion being clear for dim X = 0. Let τ\tau be a maximal element among the orbit types of the points of X (such an element exists by Lemma 6c6c))). We shall prove the following:

c′)c') For every subset A of X(t)X_{(t)}, open and closed in X(τ)X_{(\tau)} and stable under G, the closure A‾\overline{A} of A in X is open.

This assertion implies c). Indeed, note first that X(τ)X_{(\tau)} is open in X, by a); assertion c′)c') implies that X‾(τ)\overline{X}_{(\tau)} is open and closed in X, hence equal to X since it is stable under G and X/GX/G is connected. Let A be a non-empty open and closed subset of X(τ)X_{(\tau)} stable under G; by c′),A‾c'),\overline{A} is open and closed in X and stable under G, hence equal to X; this implies that A is dense in X(τ)X_{(\tau)}, hence equal to X(τ)X_{(\tau)}. Consequently, every non-empty open and closed subset of X(τ)/GX_{(\tau)}/G is equal to X(τ)/GX_{(\tau)}/G, which proves that X(τ)/GX_{(\tau)}/G is connected. Finally, since X(τ)X_{(\tau)} is dense in X, it follows from a) that every point of X is of type ≤τ\leq \tau; in other words, τ\tau is the largest element among the orbit types of the points of X.

We now prove c′)c'). We can assume that A is non-empty; let x∈Ax\in A. It suffices to prove that A is a neighbourhood of xx. For this we can, as above, assume that X=G×HWX = G\times^HW with H compact, xx being the canonical image of (e,0)(e,0). Assume first that H operates trivially on W: then X can be identified with (G/H)×W(G/H)\times W, and X(τ)/G=X/GX_{(\tau)}/G = X/G is homeomorphic to W, hence connected; thus, A/G=X/GA/G = X/G, so A = X. Assume from now on that H does not operate trivially on W. Choose a scalar product on W invariant under the compact group H; let S be the unit sphere in W (the set of vectors of norm 1). Note that S/HS/H is connected: indeed, if dim(W) ≥2,S\geq 2, S is connected, and if dim(W) = 1, S is a space of two points on which H operates non-trivially. Put Y=G×HSY = G\times^HS; this is a closed submanifold of X, stable under G, of codimension 1, and Y/GY/G, which is homeomorphic to S/HS/H, is connected. Thus, by the induction hypothesis, there exists a maximal orbit type θ\theta for Y, the set Y(θ)Y_{(\theta)} is open and dense in Y, and Y(θ)/GY_{(\theta)}/G is connected.

Consider the operation of R+∗\mathbf{R}^*_+ on X induced by passage to the quotient by the law of operation (λ,(g,w))→(g,λw)(\lambda ,(g, w)) \rightarrow (g, \lambda w) of R+∗\mathbf{R}^*_+ on G×WG\times W. Two points of X conjugate under this operation are of the same orbit type; consequently, X(θ)X_{(\theta)} contains R+∗Y(θ)\mathbf{R}^*_+Y_{(\theta)}, which is a dense open subset of X. But X(τ)X_{(\tau)} is open by a), and hence meets X(θ)X_{(\theta)}, so θ=τ\theta =\tau.

On the other hand, the homeomorphism (λ,w)→λw(\lambda , w) \rightarrow \lambda w from R+∗×S\mathbf{R}^*_+\times S to W -- {0}(\{0\}(General Topology, Chap. VI, §2, no. 3, Prop. 3) induces a homeomorphism from R+∗×(S/H)\mathbf{R}^*_+\times (S/H) to (R+∗S)/H(\mathbf{R}^*_+S)/H, hence also from R+∗×(Y/G)\mathbf{R}^*_+\times (Y/G) to (R+∗Y)/G(\mathbf{R}^*_+Y)/G, and from R+∗×(Y(θ)/G)\mathbf{R}^*_+\times (Y_{(\theta)}/G) to (R+∗Y(θ))/G(\mathbf{R}^*_+Y_{(\theta)})/G. Thus, (R+∗Y(θ))/G(\mathbf{R}^*_+Y_{(\theta)})/G is connected, and X(τ)/GX_{(\tau)}/G, which contains a connected dense subset, is itself connected (General Topology, Chap. I, §11, no. 1, Prop. 1). Consequently, A is equal to X(τ)X_{(\tau)}, hence is dense in X, and A is a neighbourhood of xx. This completes the proof of the theorem.

With the notations in Th. 2c)2c), the points of X(τ)X_{(\tau)} are said to be principal and their orbits are called principal orbits. If xx is a point of X, and if G×GxWG\times^{G_x}W is a linear tube in X around the orbit of xx, the point xx is principal if and only if GxG_x operates trivially on W, that is, if the tube is of the form (G/Gx)×W(G/G_x)\times W.

Example 1 01HV

Let G be a connected compact Lie group, operating on itself by inner automorphisms. The fixer of an element xx of G is simply the centralizer Z(x)Z(x) of xx in G; it contains every maximal torus containing xx. It follows that the largest orbit type τ\tau is the conjugacy class of the maximal tori of G. The open set G(τ)G_{(\tau)} is the set of very regular elements of G (§5, no. 1, Remark). Assume that G is simply-connected. Then G(τ)G_{(\tau)} is equal to the set GrG_r of regular elements of G (§5, no. 2, Remark 2); if A is an alcove of a Cartan subalgebra t\mathfrak{t} of g=L(G)\mathfrak{g}= L(G), the composite map π:A⟶expGr⟶Gr/\pi : A\longrightarrow^{exp}G_r\longrightarrow G_r/Int(G) is an isomorphism of analytic manifolds. Indeed, this is a homeomorphism (§5, no. 2, Cor. of Prop. 2); let a∈Aa\in A, put t=t= exp aa and identify Tt(G)T_t(G) with g\mathfrak{g} by means of the translation γ(t)\gamma (t). The tangent map Ta(π)T_a(\pi ) can then be identified with the composite of the canonical injection t→g\mathfrak{t}\rightarrow \mathfrak{g} and the quotient map g→g/\mathfrak{g}\rightarrow \mathfrak{g}/Im(Ad t−1−1t^{-1}-1). Since tt is regular, Ta(π)T_a(\pi ) is an isomorphism, hence the stated result (Differentiable and Analytic Manifolds, Results, 5.7.8).

Example 2 01HW

Let E be a real euclidean affine space, H\mathfrak{H} a set of hyperplanes of E, W the group of displacements of E generated by the orthogonal reflections with respect to the hyperplanes of H\mathfrak{H}. Assume that H\mathfrak{H} is stable under W and that the group W, with the discrete topology, operates properly on E.

The preceding can be applied to the operation of W on E. The fixer of a point xx of E is the subgroup of W generated by the reflections with respect to the hyperplanes of H\mathfrak{H} containing xx (Chap. V, §3, no. 3, Prop. 2). Consequently, the largest orbit type τ\tau is the class of the subgroup {\{IdE}_E\}, and E(τ)E_{(\tau)} is the union of the chambers of E. Note that in this case the covering E(τ)→E(τ)/WE_{(\tau)}\rightarrow E_{(\tau)}/W is trivial, and in particular E(τ)E_{(\tau)} is not connected if H\mathfrak{H} is non-empty.

Exercises

See the exercises for § 9.

Transcribed from the printed volume. Not translated.