Bourbaki

§ 4. Geometric representation of a Coxeter group

In this paragraph, all the vector spaces considered are real vector spaces.

1. Form associated to a Coxeter group

Let S be a set and let M = (m(s,s′)s,s′∈S)(m(s, s')_{s, s' \in S}) be a Coxeter matrix (Chap. IV, § 1, no. 9) of type S. Recall that this means:

(1) The elements of M are integers or +∞+\infty. (2) M is symmetric. (3) m(s,s)=1m(s, s) = 1 for all s. (4) m(s,s′)≥2m(s, s') \geq 2 for s≠s′s \neq s'.

Let E=R(S)E = \mathbf{R}^{(S)}, let (es)s∈S(e_s)_{s \in S} be the canonical basis of E, and let BMB_M be the bilinear form on E such that

BM(es,es′)=−cos⁡πm(s,s′). B_M(e_s, e_{s'}) = -\cos \frac{\pi}{m(s, s')}.

The form BMB_M is symmetric. It is called the associated form of the matrix M. We have

BM(es,es)=1andBM(es,es′)≤0ifs≠s′. B_M(e_s, e_s) = 1 \quad \text{and} \quad B_M(e_s, e_{s'}) \leq 0 \quad \text{if} \quad s \neq s'.

Let s∈Ss \in S and let fsf_s be the linear form x↦2BM(es,x)x \mapsto 2B_M(e_s, x). We denote by σs\sigma_s the pseudo-reflection defined by the pair (es,fs)(e_s, f_s) (cf. § 2, no. 1); since ⟨es,fs⟩=2\langle e_s, f_s \rangle = 2, it is a reflection (§2§ 2, no. 2). We have

σs(x)=x−2BM(es,x).es \sigma_s(x) = x - 2B_M(e_s, x).e_s

and in particular

σs(es′)=es′+2cos⁡πm(s,s′).es. \sigma_s(e_{s'}) = e_{s'} + 2 \cos \frac{\pi}{m(s, s')}.e_s.

Since ese_s is not isotropic for BMB_M, the space E is the direct sum of the line Res\mathbf{R}e_s and the hyperplane HsH_s orthogonal to ese_s. Since σs\sigma_s is equal to −1-1 on Res\mathbf{R}e_s and to 1 on HsH_s, it follows that σs\sigma_s preserves the form BMB_M. When S is finite and BMB_M is non-degenerate (a case to which we shall return in no. 8), it follows that σs\sigma_s is an orthogonal reflection (§2§ 2, no. 3).

2. The plane Es,s′E_{s,s'} and the group generated by σs\sigma_s and σs′\sigma_{s'}

In this number, we denote by ss and s′s' two elements of SS with s≠s′s \neq s'. Put m=m(s,s′)m = m(s, s') and denote by Es,s′E_{s,s'} the plane Res⊕Res′\mathbf{R}e_s \oplus \mathbf{R}e_{s'}.

Proposition 1

The restriction of BMB_M to Es,s′E_{s,s'} is positive, and it is non-degenerate if and only if mm is finite.

Let z=xes+yes′z = x e_s + y e_{s'}, with x,y∈Rx, y \in \mathbf{R}, be an element of Es,s′E_{s,s'}. We have

BM(z,z)=x2−2xycos⁡πm+y2=(x−y⋅cos⁡πm)2+y2sin⁡2πm, B_M(z, z) = x^2 - 2xy \cos \frac{\pi}{m} + y^2 \\ = \left( x - y \cdot \cos \frac{\pi}{m} \right)^2 + y^2 \sin^2 \frac{\pi}{m},
which shows that BMB_M is positive on Es,s′E_{s,s'}, and that it is non-degenerate there if and only if sin⁡πm≠0\sin \frac{\pi}{m} \neq 0. The proposition follows.

The reflections σs\sigma_s and σs′\sigma_{s'} leave Es,s′E_{s,s'} stable. We are going to determine the order of the restriction of σsσs′\sigma_s \sigma_{s'} to Es,s′E_{s,s'}. We distinguish two cases:

a) m=+∞a) \ m = +\infty.

Let u=es+es′u = e_s + e_{s'}. We have BM(u,es)=BM(u,es′)=0B_M(u, e_s) = B_M(u, e_{s'}) = 0, so uu is invariant under σs\sigma_s and σs′\sigma_{s'}. Moreover,

σs(σs′(es))=σs(es+2es′)=3es+2es′=2u+es; \sigma_s(\sigma_{s'}(e_s)) = \sigma_s(e_s + 2e_{s'}) = 3e_s + 2e_{s'} = 2u + e_s;
hence
(σsσs′)n(es)=2nu+esfor all n∈Z. (\sigma_s \sigma_{s'})^n(e_s) = 2nu + e_s \quad \text{for all } n \in \mathbf{Z}.
It follows that the restriction of σsσs′\sigma_s \sigma_{s'} to Es,s′E_{s,s'} is of infinite order.

b) mb) \ m is finite.

The form BHB_H provides Es,s′E_{s,s'} with the structure of a euclidean plane. Since the scalar product of ese_s and es′e_{s'} is equal to −cos⁡πm=cos⁡(π−πm)-\cos \frac{\pi}{m} = \cos (\pi - \frac{\pi}{m}), we can orient Es,s′E_{s,s'} so that the angle between the half-lines R+es\mathbf{R}_+ e_s and R+es′\mathbf{R}_+ e_{s'} is equal to π−πm\pi - \frac{\pi}{m}. If D and D' denote the lines orthogonal to ese_s and es′e_{s'},

(D′^,D^)=π−(D^,D′^)=πm. (\widehat{D'}, \widehat{D}) = \pi - (\widehat{D}, \widehat{D'}) = \frac{\pi}{m}.
Now, the restrictions σ‾s\overline{\sigma}_s and σ‾s′\overline{\sigma}_{s'} of σs\sigma_s and σs′\sigma_{s'} to Es,s′E_{s,s'} are the orthogonal symmetries with respect to D and D'. By the Cor. to Prop. 6 of § 2, no. 5, it follows that σ‾sσ‾s′\overline{\sigma}_s \overline{\sigma}_{s'} is the rotation with angle 2πm\frac{2\pi}{m}. In particular, its order is mm.

We now return to E:

Proposition 2

The subgroup of GL(E)\mathbf{GL}(E) generated by σs\sigma_s and σs′\sigma_{s'} is a dihedral group of order 2m(s,s′)2m(s, s')*.

Since σs\sigma_s and σs′\sigma_{s'} are of order 2, and are distinct, it is enough to show that their product σsσs′\sigma_s \sigma_{s'} is of order m(s,s′)m(s, s'). When m(s,s′)m(s, s') is infinite, this follows from aa above. When m(s,s′)m(s, s') is finite, it follows from Prop. 1 that E is the direct sum of Es,s′E_{s,s'} and its orthogonal complement Vs,s′V_{s,s'}; since σs\sigma_s and σs′\sigma_{s'} are the identity on Vs,s′V_{s,s'}, and since the restriction of σsσs′\sigma_s \sigma_{s'} to Es,s′E_{s,s'} is of order m(s,s′)m(s, s') by bb, the order of σsσs′\sigma_s \sigma_{s'} is indeed equal to m(s,s′)m(s, s').

3. Group and representation associated to a Coxeter matrix

We retain the notation of the preceding numbers. Let W−=W(M)W^- = W(M) be the group defined by the family of generators (gs)s∈S(g_s)_{s \in S} and the relations¹

(gsgs′)m(s,s′)=1,for s,s′∈S, m(s,s′)≠+∞.(g_s g_{s'})^{m(s, s')} = 1,\quad \text{for } s, s' \in S,\ m(s, s') \neq +\infty.

Proposition 3

There exists a unique homomorphism

σ:W→GL(E)\sigma : W \to \mathbf{GL}(E)

such that σ(gs)=σs\sigma(g_s) = \sigma_s for all s∈Ss \in S. The elements of σ(W)\sigma(W) preserve the bilinear form BMB_M.

To prove the existence and uniqueness of σ\sigma, it is enough to show that (σsσs′)m(s,s′)=1(\sigma_s \sigma_{s'})^{m(s, s')} = 1 if m(s,s′)≠+∞m(s, s') \neq +\infty. Now, if s=s′s = s', this follows from the fact that σs\sigma_s is of order 2; if s≠s′s \neq s', it follows from what we proved in no. 2. Finally, since the reflections σs\sigma_s preserve BMB_M, so do the elements of σ(W)\sigma(W).

Remark 1

We shall see in no. 4 that σ\sigma is injective; the group W can thus be identified with the subgroup of GL(E)\mathbf{GL}(E) generated by the σs\sigma_s.

Proposition 4

a)* The map s↦gss \mapsto g_s from SS to WW is injective.

b) Each of the gsg_s is of order 2.

c) If s,s′∈Ss, s' \in S, gsgs′g_s g_{s'} is of order m(s,s′)m(s, s').

Assertion a) follows from the fact that the composite map

s↦gs↦σss \mapsto g_s \mapsto \sigma_s

from SS to GL(E)\mathbf{GL}(E) is injective.

For b) (resp. c)), we remark that the order of gsg_s (resp. the order of gsgs′g_s g_{s'}) is at most 2 (resp. at most m(s,s′)m(s, s')). Since we have seen in no. 2 that the order of σs\sigma_s (resp. of σsσs′\sigma_s \sigma_{s'}) is 2 (resp. m(s,s′)m(s, s')), we must have equality.

In view of a), SS can be identified with a subset of WW by means of the map s↦gss \mapsto g_s.

¹ This means that, if LSL_S denotes the free group on SS, WW is the quotient of LSL_S by the smallest normal subgroup of LSL_S containing the elements (ss′)m(s,s′)(ss')^{m(s, s')}, for m(s,s′)≠+∞m(s, s') \neq +\infty.

Corollary

The pair* (W, S) is a Coxeter system with matrix M.

This is simply the content of properties b) and c), together with the definition of W.

Remark 2

We have thus shown that every Coxeter matrix corresponds to a Coxeter group.

4. Contragredient representation

Let E* be the dual of E. Since W acts on E via σ, it also acts, by transport of structure, on E*. The corresponding representation

σ∗:W→GL(E∗) \sigma^*: W \to \mathbf{GL}(E^*)

is called the contragredient representation of σ. We have

σ∗(w)=tσ(w−1)for all w∈W. \sigma^*(w) = {}^t\sigma(w^{-1}) \quad \text{for all } w \in W.

If x* ∈ E* and w ∈ W, we denote by w(x*) the transform of x* by σ*(w).

If s ∈ S, denote by A_s the set of x* ∈ E* such that x*(e_s) > 0. Let C be the intersection of the A_s, s ∈ S. When S is finite, C is an open simplicial cone in E* (§ 1, no. 6).

Theorem 1 (Tits)

If w ∈ W and C ∩ w(C) ≠ ∅, then w = 1*.

We indicate immediately several consequences of this theorem:

Corollary 1

The group* W acts simply-transitively on the set of w(C) for w ∈ W.

This is clear.

Corollary 2

The representations* σ and σ* are injective.

Indeed, if σ*(w) = 1, then w(C) = C, so w = 1 by the theorem. The injectivity of σ follows from that of σ*.

Corollary 3

If S is finite, σ(W) is a discrete subgroup of* \mathbf{GL}(E) provided with its canonical Lie group structure; similarly, σ(W) is a discrete subgroup of* \mathbf{GL}(E^*) *.

Let x* ∈ C. The set U of g ∈ \mathbf{GL}(E^*) such that g(x*) ∈ C is a neighbourhood of the identity element in \mathbf{GL}(E^*); by the theorem,

σ∗(W)∩U={1}; \sigma^*(W) \cap U = \{1\};

thus, σ*(W) is a discrete subgroup of \mathbf{GL}(E^*). By transport of structure, it follows that σ(W) is discrete in \mathbf{GL}(E).

Proof of Theorem 1.

If w∈Ww \in W, denote by l(w)l(w) the length of ww with respect to SS (Chap. IV, § 1, no. 1).

We are going to prove the following assertions, where nn denotes an integer ⩾0\geqslant 0:

(P_n) Let w∈Ww \in W, with l(w)=nl(w) = n, and s∈Ss \in S. Then: either w(C)⊂Asw(C) \subset A_s; or w(C)⊂s(As)w(C) \subset s(A_s) and l(sw)=l(w)−1l(sw) = l(w) - 1.

(Q_n) Let w∈Ww \in W, with l(w)=nl(w) = n, and s,s′∈S,s≠s′s, s' \in S, s \neq s'. Let Ws,s′W_{s,s'} be the subgroup of WW generated by ss and s′s'. There exists u∈Ws,s′u \in W_{s,s'} such that

w(C)⊂u(As∩As′)andl(w)=l(u)+l(u−1w). w(C) \subset u(A_s \cap A_{s'}) \quad \text{and} \quad l(w) = l(u) + l(u^{-1}w).

These assertions are trivial for n=0n = 0. We prove them by induction on nn, according to the scheme

((Pn) and (Qn))⟹(Pn+1)and((Pn+1) and (Qn))⟹(Qn+1). ((P_n) \text{ and } (Q_n)) \Longrightarrow (P_{n+1}) \quad \text{and} \quad ((P_{n+1}) \text{ and } (Q_n)) \Longrightarrow (Q_{n+1}).

Proof that ((Pn) and (Qn))⟹(Pn+1)((P_n) \text{ and } (Q_n)) \Longrightarrow (P_{n+1}).

Let w∈Ww \in W, with l(w)=n+1l(w) = n + 1, and s∈Ss \in S. We can write ww in the form w=s′w′w = s'w' with s′∈Ss' \in S and l(w′)=nl(w') = n. If s′=ss' = s, (Pn)(P_n) applied to w′w' shows that w′(C)⊂Asw'(C) \subset A_s, hence w(C)⊂s(As)w(C) \subset s(A_s) and l(sw)=l(w′)=l(w)−1l(sw) = l(w') = l(w) - 1. If s′≠ss' \neq s, (Qn)(Q_n) applied to w′w' shows that there exists u∈Ws,s′u \in W_{s,s'} such that

w′(C)⊂u(As∩As′)andl(w′)=l(u)+l(u−1w′). w'(C) \subset u(A_s \cap A_{s'}) \quad \text{and} \quad l(w') = l(u) + l(u^{-1}w').
We have w(C)=s′w′(C)⊂s′u(As∩As′)w(C) = s'w'(C) \subset s'u(A_s \cap A_{s'}).

Lemma 1

Let s,s′∈Ss, s' \in S, with s≠s′s \neq s', and let v∈Ws,s′v \in W_{s,s'}. Then v(As∩As′)v(A_s \cap A_{s'}) is contained in either AsA_s or in s(As)s(A_s), and in the second case l(sv)=l(v)−1l(sv) = l(v) - 1.

The proof will be given in no. 5.

We apply the lemma to the element v=s′uv = s'u. There are two possibilities: either

s′u(As∩As′)⊂Asandafortioriw(C)⊂As, s'u(A_s \cap A_{s'}) \subset A_s \quad \text{and} \quad a fortiori \quad w(C) \subset A_s,
or
s′u(As∩As′)⊂s(As)andafortioriw(C)⊂s(As). s'u(A_s \cap A_{s'}) \subset s(A_s) \quad \text{and} \quad a fortiori \quad w(C) \subset s(A_s).
Moreover, in the second case, l(ss′u)=l(s′u)−1l(ss'u) = l(s'u) - 1. Hence
l(sw)=l(ss′w′)=l(ss′u.u−1w′)≤l(ss′u)+l(u−1w′)=l(s′u)+l(u−1w′)−1≤l(w)−1, l(sw) = l(ss'w') = l(ss'u.u^{-1}w') \leq l(ss'u) + l(u^{-1}w') = l(s'u) + l(u^{-1}w') - 1 \leq l(w) - 1,
and we know that this implies that l(sw)=l(w)−1l(sw) = l(w) - 1.

Proof that ((P_{n+1}) and (Q_n)) \Longrightarrow (Q_{n+1}).

Let w \in W, with l(w) = n + 1, and s, s' \in S, s \neq s'. If w(C) is contained in A_s \cap A_{s'}, condition (Q_{n+1}) is satisfied with u = 1. For if not, suppose for example that w(C) is not contained in A_s. By (P_{n+1}), w(C) \subset s(A_s) and l(sw) = n. By (Q_n), applied to sw, there exists v \in W_{s,s'} such that

sw(C) \subset v(A_s \cap A_{s'}) \quad \text{and} \quad l(sw) = l(v) + l(v^{-1}sw).

Then

w(C) \subset sv(A_s \cap A_{s'})

and

l(w) = 1 + l(sw) = 1 + l(v) + l(v^{-1}sw) \geq l(sv) + l((sv)^{-1}w) \geq l(w),

so the inequalities above must be equalities. It follows that (Q_{n+1}) is satisfied with u = sv.

Proof of the theorem.

Let w \in W, with w \neq 1. We can write w in the form sw' with s \in S and l(w') = l(w) - 1. By (P_n), applied to w' and n = l(w'), we have w'(C) \subset A_s, since the case w'(C) \subset s(A_s) is excluded because l(sw') = l(w) = l(w') + 1. So w(C) = sw'(C) \subset s(A_s), and since A_s and s(A_s) are disjoint, we have C \cap w(C) = \varnothing. Q.E.D.

5. Proof of lemma 1

Let E_{s,s'}^* be the dual of the plane E_{s,s'} = \mathbf{R}e_s \oplus \mathbf{R}e_{s'} (no. 2). The transpose of the injection E_{s,s'} \to E is a surjection

p:E∗→Es,s′∗ p : E^* \to E_{s,s'}^*

that commutes with the action of the group W_{s,s'}. It is clear that A_s, A_{s'} and A_s \cap A_{s'} are the inverse images under p of corresponding subsets of E_{s,s'}^* (considered as the space of the contragredient representation of the Coxeter group W_{s,s'}). Moreover, since the length of an element of W_{s,s'} is the same with respect to \{s, s'\} and with respect to S (Chap. IV, § 1, no. 8), we are reduced finally to the case where S = \{s, s'\}; if m = m(s, s'), the group W is then a dihedral group of order 2m.

We now distinguish two cases: a) m = +\infty. Let (\varepsilon, \varepsilon') be the dual basis of (e_s, e_{s'}). Then

s.ε=−ε+2ε′,s′.ε=ε,s.ε′=ε′,s′.ε′=2ε−ε′. s.\varepsilon = -\varepsilon + 2\varepsilon', \quad s'.\varepsilon = \varepsilon, s.\varepsilon' = \varepsilon', \quad s'.\varepsilon' = 2\varepsilon - \varepsilon'.

Let D be the affine line of E∗E^* containing ε\varepsilon and ε′\varepsilon'; the formulas above show that D is stable under s and s′s' and that the restriction of s (resp. s′s') to D is the reflection with respect to the point ε′\varepsilon' (resp. ε\varepsilon). Let

θ:R→D \theta : \mathbf{R} \to D

be the affine bijection t↦θ(t)=tε+(1−t)ε′t \mapsto \theta(t) = t\varepsilon + (1-t)\varepsilon'. Let InI_n be the image under θ\theta of the open interval ]n,n+1[]n, n+1[, and let CnC_n be the union of the λIn\lambda I_n for λ>0\lambda > 0. Then C0=CC_0 = C; moreover, by the Remark of § 2, no. 4, applied to the affine space D, the InI_n are permuted simply-transitively by W; hence so are the CnC_n. If v∈Wv \in W, v(C)v(C) is equal to one of the CnC_n, hence is contained in AsA_s if n≥0n \geq 0 and in s(As)s(A_s) if n<0n < 0. In the second case, I0I_0 and InI_n are on opposite sides of the point ε′\varepsilon'; hence l(sv)=l(v)−1l(sv) = l(v) - 1 (loc. cit.).

b) mm is finite.

The form BMB_M is then non-degenerate (no. 2) so we can identify E∗E^* with E. We have seen that E can be oriented so that the angle between the half-lines R+es\mathbf{R}_+ e_s and R+es′\mathbf{R}_+ e_{s'} is equal to π−πm\pi - \frac{\pi}{m}. Let D (resp. D′D') be the half-line obtained from R+es\mathbf{R}_+ e_s (resp. R+es′\mathbf{R}_+ e_{s'}) by a rotation of π/2\pi/2 (resp. −π/2-\pi/2), cf. Fig. 2. The chamber C is the set of x∈Ex \in E whose scalar product with ese_s and es′e_{s'} is >0> 0; this is the open angular sector with origin D′D' and extremity D. By the Remark of § 2, no 5, every element vv of W transforms C into an angular sector that is on the same side of D as C (i.e. is contained in AsA_s) or on the opposite side (i.e. contained in s(As)s(A_s)), and in the latter case

l(sv)=l(v)−1, l(sv) = l(v) - 1,

which completes the proof of the lemma.

![Diagram showing two half-lines es and es', an angle labeled π/m, and shaded regions labeled D and D', with a point O at the origin](Fig. 2)

Fig. 2

6. Fundamental domain of w in the union of the chambers

We retain the notation of no. 4. For s∈Ss \in S, denote by HsH_s the hyperplane of E∗E^* orthogonal to ese_s, by A‾s\overline{A}_s the set of x∗∈E∗x^* \in E^* such that ⟨x∗,es⟩⩾0\langle x^*, e_s \rangle \geqslant 0 and by C‾\overline{C} the intersection of the A‾s\overline{A}_s for s∈Ss \in S. For the weak topology σ(E∗,E)\sigma(E^*, E) defined by the duality between E∗E^* and EE (Topological Vector Spaces, Chap. II, §6, no. 2), the A‾s\overline{A}_s are closed half-spaces and C‾\overline{C} is a closed convex cone. Moreover, C‾\overline{C} is the closure of CC; indeed, if x∗∈C‾x^* \in \overline{C} and y∗∈Cy^* \in C, then x∗+ty∗∈Cx^* + t y^* \in C for every real number t>0t > 0 and x∗=lim⁡t→0(x∗+ty∗)x^* = \lim_{t \to 0} (x^* + t y^*).

For X⊂SX \subset S, put

CX=(⋂s∈XHs)∩(⋂s∈S−XAs). C_X = \left( \bigcap_{s \in X} H_s \right) \cap \left( \bigcap_{s \in S - X} A_s \right).

We have CX⊂C‾C_X \subset \overline{C}, C∅=CC_\varnothing = C and CS={0}C_S = \{0\}. The sets CXC_X, for X∈B(S)X \in B(S), form a partition of C‾\overline{C}.

On the other hand, recall (Chap. IV, §1, no. 8) that WXW_X denotes the subgroup of WW generated by XX. Clearly w(x∗)=x∗w(x^*) = x^* for w∈WXw \in W_X and x∗∈CXx^* \in C_X.

Proposition 5

Let X,X′⊂SX, X' \subset S and w,w′∈Ww, w' \in W. If w(CX)∩w′(CX′)≠∅w(C_X) \cap w'(C_{X'}) \neq \varnothing, then X=X′X = X', wWX=w′WX′wW_X = w'W_{X'} and w(CX)=w′(CX′)w(C_X) = w'(C_{X'}).

We are reduced immediately to the case w′=1w' = 1. The proof is by induction on the length nn of ww. If n=0n = 0, the assertion is clear. If l(w)>0l(w) > 0, there exists s∈Ss \in S such that l(sw)=l(w)−1l(sw) = l(w) - 1 and then (cf. the end of no. 4) w(C)⊂s(As)w(C) \subset s(A_s), hence w(C‾)⊂s(A‾s)w(\overline{C}) \subset s(\overline{A}_s). Since C‾⊂A‾s\overline{C} \subset \overline{A}_s, it follows that

C‾∩w(C‾)⊂Hs. \overline{C} \cap w(\overline{C}) \subset H_s.

Then s(x∗)=x∗s(x^*) = x^* for all x∗∈C‾∩w(C‾)x^* \in \overline{C} \cap w(\overline{C}), and a fortiori for all

x∗∈CX′∩w(CX). x^* \in C_{X'} \cap w(C_X).

Consequently, the relation CX′∩w(CX)≠∅C_{X'} \cap w(C_X) \neq \varnothing implies on the one hand that CX′∩Hs≠∅C_{X'} \cap H_s \neq \varnothing, and hence that s∈X′s \in X', and on the other hand that CX′∩sw(CX)≠∅C_{X'} \cap sw(C_X) \neq \varnothing. The induction hypothesis then implies that X=X′X = X' and swWX=WX′=WXswW_X = W_{X'} = W_X, so sw∈WXsw \in W_X and w∈WXw \in W_X since s∈WXs \in W_X. It follows that wWX=WX′wW_X = W_{X'} and that w(CX)=CX=CX′w(C_X) = C_X = C_{X'}.

Corollary

Let XX be a subset of SS and x∗x^* an element of CXC_X. The stabiliser of x∗x^* in WW is WXW_X.

Now let UU be the union of the w(C‾)w(\overline{C}) for w∈Ww \in W, and let F\mathscr{F} be the set of subsets of UU of the form w(CX)w(C_X), with X⊂SX \subset S and w∈Ww \in W. By the above, F\mathscr{F} is a partition of UU.

Proposition 6

(i) The cone U is convex.

(ii) Every closed segment contained in U meets only finitely many elements of F\mathfrak{F}.

(iii) The cone C‾\overline{C} is a fundamental domain for the action of W on U.

To prove (iii), it is enough to show that, if x∗,y∗∈C‾x^*, y^* \in \overline{C} and w∈Ww \in W are such that w(x∗)=y∗w(x^*) = y^*, then x∗=y∗x^* = y^*. Now there exist two subsets X and Y of S such that x∗∈CXx^* \in C_X and y∗∈CYy^* \in C_Y; we have w(CX)∩CY≠∅w(C_X) \cap C_Y \neq \varnothing, and Prop. 5 shows that X=YX = Y and w∈WXw \in W_X, which implies that x∗=y∗x^* = y^*.

Now let x∗,y∗∈Ux^*, y^* \in U; we shall show that the segment [x∗y∗][x^*y^*] is covered by finitely many elements of F\mathfrak{F}, which will establish both (i) and (ii). By transforming x∗x^* and y∗y^* by the same element of W, we can assume that x∗∈C‾x^* \in \overline{C}. Let w∈Ww \in W be such that y∗∈w(C‾)y^* \in w(\overline{C}). We argue by induction on the length of ww. For s∈Ss \in S, the relation w(C‾)⊄As‾w(\overline{C}) \not\subset \overline{A_s} is equivalent to w(C)⊄Asw(C) \not\subset A_s and hence to l(sw)<l(w)l(sw) < l(w) (cf. no. 4). Prop. 7 of no. 8 of Chap. IV, §1 now implies that there exist only finitely many s∈Ss \in S such that w(C‾)⊄As‾w(\overline{C}) \not\subset \overline{A_s}. The set T of s∈Ss \in S such that ⟨y∗,es⟩<0\langle y^*, e_s \rangle < 0 is thus finite. On the other hand, the intersection C‾∩[x∗y∗]\overline{C} \cap [x^*y^*] is a closed segment [x∗z∗][x^*z^*]. If z∗=y∗z^* = y^*, that is if y∗∈C‾y^* \in \overline{C}, there exist subsets X and Y of S such that x∗∈CXx^* \in C_X and y∗∈CYy^* \in C_Y. The open segment ]x∗y∗[]x^*y^*[ is then contained in CX∩YC_{X \cap Y}, so [x∗y∗]⊂CX∪CY∪CX∩Y[x^*y^*] \subset C_X \cup C_Y \cup C_{X \cap Y}. If z∗≠y∗z^* \neq y^*, there exists an s∈Ts \in T such that z∗∈Hsz^* \in H_s. Then w(C)⊄Asw(C) \not\subset A_s and l(sw)<l(w)l(sw) < l(w). The induction hypothesis thus implies that the segment [z∗y∗]=s([z∗(s(y∗))])[z^*y^*] = s([z^*(s(y^*))]) is covered by a finite number of elements of F\mathfrak{F}, and hence so is

[x∗y∗]=[x∗z∗]∪[z∗y∗] [x^*y^*] = [x^*z^*] \cup [z^*y^*]

since [x∗z∗]⊂C‾[x^*z^*] \subset \overline{C}.

7. Irreducibility of the geometric representation of a Coxeter group

We retain the notation of the preceding nos., and assume that S is finite.

Proposition 7

Assume that* (W,S)(W, S) is irreducible (Chap. IV, §1, no. 9). Let E0E^0 be the subspace of E orthogonal to E with respect to BMB_M. The group W acts trivially on E0E^0, and every subspace of E distinct from E and stable under W is contained in E0E^0.

If x∈E0x \in E^0, then σs(x)=x−2BM(es,x)es=x\sigma_s(x) = x - 2B_M(e_s, x)e_s = x for all s∈Ss \in S. Since W is generated by S, it follows that W acts trivially on E0E^0.

Let E′E' be a subspace of E stable under W. Let s,s′∈Ss, s' \in S be two elements that are linked in the graph Γ\Gamma of (W,S)(W, S) (Chap. IV, §1, no. 9); recall that this means that m(s,s′)≥3m(s, s') \geq 3. Suppose that es∈E′e_s \in E'. Then σs′(es)∈E′\sigma_{s'}(e_s) \in E' and since the coefficient of es′e_{s'} in σs′(es)\sigma_{s'}(e_s) is non-zero, we have es′∈E′e_{s'} \in E'. Since Γ\Gamma is connected, it follows that, if E′E' contains one of the ese_s it contains them all and coincides with E. Except in this case, it follows from Prop. 3 of §2, no. 2 that, for all s∈Ss \in S, E′E' is contained in the hyperplane HsH_s orthogonal to ese_s. Since the intersection of the HsH_s is equal to E0E^0, this proves the proposition.

Corollary

Assume that* (W,S)(W, S) is irreducible. Then: a) If BMB_M is non-degenerate, the W-module EE is absolutely simple. b) If BMB_M is degenerate, the W-module EE is not semi-simple.

In case a), Prop. 7 shows that EE is simple, hence also absolutely simple (§2§ 2, no. 1, Prop. 1).

In case b), E0≠0E^0 \neq 0, E≠E0E \neq E^0 (since BM≠0B_M \neq 0), and Prop. 7 shows that E0E^0 has no complement stable under WW; thus, the W-module EE is not semi-simple.

8. Finiteness criterion

We retain the notation of the preceding nos., and assume that SS is finite.

Theorem 2

The following properties are equivalent*: (1) WW is finite. (2) The form BMB_M is positive and non-degenerate.

(1) ⟹\Longrightarrow (2). Let S=⋃iSiS = \bigcup_i S_i be the decomposition of SS into connected components (Chap. IV, §1§ 1, no. 9), and let W=∏iWiW = \prod_i W_i be the corresponding decomposition of WW. The space EE can be identified with the direct sum of the spaces Ei=RSiE_i = \mathbf{R}^{S_i}, and BMB_M can be identified with the direct sum of the corresponding forms BMiB_{M_i}. We are thus reduced to the case when (W,S)(W, S) is irreducible. Since WW is assumed to be finite, EE is a semi-simple W-module (Appendix, Prop. 2). By the Cor. to Prop. 5, it follows that EE is absolutely simple. Let B′B' be a positive non-degenerate form on EE, and let B′′B'' be the sum of its transforms under WW. Since B′′B'' is invariant under WW, it is proportional to BMB_M (§2§ 2, no. 1, Prop. 1); since BM(es,cs)=1B_M(e_s, c_s) = 1 for all s∈Ss \in S, the coefficient of proportionality is >0> 0, and since B′′B'' is positive so is BMB_M, which proves (2).

(2) ⟹\Longrightarrow (1). If BMB_M is positive non-degenerate, the orthogonal group O(BM)O(B_M) is compact (Integration, Chap. VII, §3§ 3, no. 1). Since σ(W)\sigma(W) is a discrete subgroup of O(BM)O(B_M) (Cor. 3 of Th. 1), it follows that σ(W)\sigma(W) is finite, hence so is WW. Q.E.D.

The following result has been established in the course of the proof:

Corollary

If* (W,S)(W, S) is irreducible and finite, E is an absolutely simple W-module.

The finiteness criterion provided by Th. 2 permits the classification of all finite Coxeter groups (cf. Chap. VI, §4§ 4). We restrict ourselves here to the following preliminary result:

Proposition 8

If* WW is finite, the graph of (W,S)(W, S) is a forest (Chap. IV, Appendix).

If not, this graph would contain a circuit (s1,…,sn)(s_1, \ldots, s_n), n≥3n \geq 3. Putting mi=m(s1,si+1)m_i = m(s_1, s_{i+1}), 1≤i<n1 \leq i < n, and mn=m(sn,s1)m_n = m(s_n, s_1), this means that mi≥3m_i \geq 3 for all ii. Let

x=es1+⋯+esn. x = e_{s_1} + \cdots + e_{s_n}.
Then BM(x,x)=n+2∑i<jBM(esi,esj)B_M(x, x) = n + 2 \sum_{i<j} B_M(e_{s_i}, e_{s_j}). Now2^2
BM(esi,esi+1)=−cos⁡πmi≤−cos⁡π3≤−12, B_M(e_{s_i}, e_{s_{i+1}}) = -\cos \frac{\pi}{m_i} \leq -\cos \frac{\pi}{3} \leq -\frac{1}{2},
and similarly for BM(esn,es1)B_M(e_{s_n}, e_{s_1}). Since the other terms in the sum are ≤0\leq 0, we obtain
BM(x,x)≤n−n=0, B_M(x, x) \leq n - n = 0,
contrary to the fact that BMB_M is positive non-degenerate.

Corollary

If* (W,S)(W, S) is irreducible and finite, its graph is a tree.

Indeed, a connected forest is a tree.

Comparison with the results of § 3.

First of all let (W,S)(W, S) be a finite Coxeter group. Denote by (x∣y)(x|y) the form BM(x,y)B_M(x, y); by Th. 2, this is a scalar product on EE. For all s∈Ss \in S, let HsH_s be the hyperplane associated to the orthogonal reflection σs\sigma_s, and let H\mathfrak{H} be the family of hyperplanes w(Hs)w(H_s), for s∈Ss \in S, w∈Ww \in W. Let C0C_0 be the set of x∈Ex \in E such that (x∣es)>0(x|e_s) > 0 for all s∈Ss \in S. Finally, identify WW (by means of σ\sigma) with a subgroup of the orthogonal group O(E)\mathbf{O}(E) of the space EE.

Proposition 9

With the preceding notations*, WW is the subgroup of O(E)\mathbf{O}(E) generated by the reflections with respect to the hyperplanes of H\mathfrak{H}. It is an essential group (§3§ 3, no. 7) and C0C_0 is a chamber of EE relative to H\mathfrak{H}.

The first assertion is trivial. On the other hand, if x∈Ex \in E is invariant under WW, it is orthogonal to all the ese_s, and hence is zero; this shows that WW is essential. Finally, the isomorphism E→E∗E \to E^* defined by BMB_M transforms C0C_0 to the set CC of no. 4; the property (Pn)(P_n) proved there shows that, for all

2^2 The roots of the equation z3−1=0z^3 - 1 = 0 are 1 and −1±i32\frac{-1 \pm i \sqrt{3}}{2}. Thus cos⁡2π3=−12\cos \frac{2\pi}{3} = -\frac{1}{2} and consequently cos⁡π3=12\cos \frac{\pi}{3} = \frac{1}{2}. Note also that sin⁡2π3=32\sin \frac{2\pi}{3} = \frac{\sqrt{3}}{2}, hence

sin⁡π3=32,cos⁡π6=−cos⁡5π6=32,sin⁡π6=sin⁡5π6=12. \sin \frac{\pi}{3} = \frac{\sqrt{3}}{2}, \quad \cos \frac{\pi}{6} = -\cos \frac{5\pi}{6} = \frac{\sqrt{3}}{2}, \quad \sin \frac{\pi}{6} = \sin \frac{5\pi}{6} = \frac{1}{2}.
Similarly, the roots of the equation z2−i=0z^2 - i = 0 are ±1+i2\pm \frac{1+i}{\sqrt{2}}, so
cos⁡π4=sin⁡π4=22and consequentlysin⁡3π4=−cos⁡3π4=22. \cos \frac{\pi}{4} = \sin \frac{\pi}{4} = \frac{\sqrt{2}}{2} \quad \text{and consequently} \quad \sin \frac{3\pi}{4} = -\cos \frac{3\pi}{4} = \frac{\sqrt{2}}{2}.

w∈Ww \in W and all s∈Ss \in S, w(C0)w(C_0) does not meet HsH_s. It follows that C0C_0 is contained in the complement UU of the union of the hyperplanes of H\mathfrak{H}, and since C0C_0 is connected, open and closed in UU, it is a chamber of EE relative to H\mathfrak{H}. Q.E.D.

We can apply to WW and C0C_0 all the properties proved in § 3. In particular, C0‾\overline{C_0} is a fundamental domain for the action of WW on EE (in other words, the cone UU defined in no. 6 is equal to the whole of EE).

Conversely, let EE be a finite dimensional real vector space, provided with a scalar product (x∣y)(x|y) and let WW be an essential finite group of displacements of EE leaving 0 fixed; assume that WW is generated by reflections. Let C0C_0 be a chamber of EE with respect to WW (cf. § 3), and let SS be the set of orthogonal reflections relative to the walls of C0C_0. Then (W,S)(W, S) is a finite Coxeter system (§3§ 3, no. 2, Th. 1). Moreover, if s∈Ss \in S, denote by HsH_s the wall of C0C_0 corresponding to ss, and denote by ese_s the unit vector orthogonal to HsH_s and on the same side of HsH_s as C0C_0. If (m(s,s′))(m(s, s')) denotes the Coxeter matrix of (W,S)(W, S), Props. 3 and 7 of §3§ 3 show that

(es∣es′)=−cos⁡(π/m(s,s′)) (e_s|e_{s'}) = -\cos(\pi/m(s, s'))

and that the ese_s form a basis of EE. *The natural representation of WW on EE can thus be identified with the representation σ\sigma of no. 3.

9. Case in which BMB_M is positive and degenerate

In this number, we assume that SS is finite, that (W,S)(W, S) is irreducible, and that the form BMB_M is positive and degenerate.

Lemma 2

The orthogonal complement E0E^0 of EE for BMB_M is of dimension 1; it is generated by an element v=∑s∈Svsesv = \sum_{s \in S} v_s e_s with vs>0v_s > 0 for all ss.

This follows from Lemma 4 of §3§ 3, no. 5, applied to the matrix with entries BM(es,es′)B_M(e_s, e_{s'}).

Let v=∑svsesv = \sum_s v_s e_s be the vector satisfying the conditions of Lemma 2 and such that ∑svs=1\sum_s v_s = 1, and let AA be the affine hyperplane of E∗E^* consisting of the y∗∈E∗y^* \in E^* such that ⟨v,y∗⟩=1\langle v, y^* \rangle = 1. If TT denotes the orthogonal complement of vv in E∗E^*, AA has a natural structure of an affine space with space of translations TT. Moreover, the form BMB_M defines by passage to the quotient a non-degenerate scalar product on E/E0E/E^0, hence also on its dual TT; this gives a euclidean structure on the affine space AA (Algebra, Chap. IX, § 6, no. 6).

Let GG be the subgroup of GL(E)\mathbf{GL}(E) consisting of the automorphisms leaving vv and BMB_M invariant; if g∈Gg \in G, the contragredient map tg−1{}^t g^{-1} leaves AA and TT stable, and defines by restriction to AA a displacement i(g)i(g) of AA (cf. § 3). It is immediate that this gives an isomorphism from GG to the group of displacements of AA. Moreover, the stabiliser GaG_a of a point aa of AA can be identified with the orthogonal group of the Hilbert space T and is thus compact. On the other hand, G is a locally compact group countable at infinity and A is a Baire space: it follows (Integration, Chap. VII, Appendix, Lemma 2) that the map ψ:g↦g(a)\psi : g \mapsto g(a) defines a homeomorphism from G/GaG/G_a to A. Thus G acts properly on A (General Topology, Chap. III, § 4, no. 2, Prop. 5). Since W is a subgroup of G, it can be identified with a group of displacements of A. We are going to show that this group satisfies the assumptions of § 3. More precisely:

Proposition 10

The group W provided with the discrete topology acts properly on A; it is generated by orthogonal reflections; it is infinite, irreducible and essential* (§ 3, no. 7). The intersection C ∩ A is a chamber of A for W. If Ls denotes the hyperplane of A formed by the intersection of A with the hyperplane of E* orthogonal to e_s, the L_s for s ∈ S are the walls of C ∩ A. If εs\varepsilon_s is the unit vector of T orthogonal to L_s on the same side of L_s as C ∩ A, then (εs∣εt)=−cos⁡(π/m(s,t))(\varepsilon_s|\varepsilon_t) = -\cos(\pi/m(s,t)) (for s, t ∈ S) and the Coxeter matrix of W (§ 3, no. 4) is identified with M.

By Cor. 3 of Th. 1, W is discrete in GL(E)\mathbf{GL}(E), and hence in G, and acts properly on A. Let s∈Ss \in S. Since Card S ≥ 2, the hyperplane of E* orthogonal to ese_s is not orthogonal to v and its intersection L_s with A is indeed a hyperplane. The displacement corresponding to s is thus a displacement of order 2 leaving fixed all the points of L_s: it is necessarily the orthogonal reflection associated to L_s. It follows that W is generated by orthogonal reflections. Th. 2 now shows that it is infinite and Prop. 7 that it is essential and irreducible.

Since C is an open simplicial cone, whose walls are the hyperplanes with equations ⟨x∗,es⟩=0\langle x^*, e_s \rangle = 0 (for s∈Ss \in S), the intersection C ∩ A is a convex, hence connected, open and closed subset of the complement of the union of the L_s in A. Moreover, C ∩ A is non-empty, for if x∗∈Cx^* \in C we have ⟨x∗,v⟩=∑svs⟨x∗,es⟩>0\langle x^*, v \rangle = \sum_s v_s \langle x^*, e_s \rangle > 0 and ⟨x∗,v⟩−1x∗∈C∩A\langle x^*, v \rangle^{-1} x^* \in C \cap A. It follows that C ∩ A is a chamber of A relative to the system of the L_s. Moreover, w(C∩A)∩Ls=∅w(C \cap A) \cap L_s = \varnothing for all w∈Ww \in W (cf. no. 4, property (P_n)) and it follows that C ∩ A is a chamber of A relative to the system consisting of the transforms of the L_s by the elements of W; by the Cor. of Th. 1 of § 3, no. 2, it follows that C ∩ A is a chamber of A relative to W.

Let as∗a_s^* be the vertex of the simplex C ∩ A not in L_s. We have

⟨as∗,et⟩=0 \langle a_s^*, e_t \rangle = 0

for s,t∈Ss, t \in S and s≠ts \neq t, and

⟨as∗,es⟩=vs−1⟨as∗,v⟩=vs−1. \langle a_s^*, e_s \rangle = v_s^{-1} \langle a_s^*, v \rangle = v_s^{-1}.

Let εs\varepsilon_s be the vector in T defined by the relations:

(εs∣as∗−at∗)=vs−1for t∈S, t≠s. (\varepsilon_s|a_s^* - a_t^*) = v_s^{-1} \quad \text{for } t \in S, \ t \neq s.

The vector εs\varepsilon_s is orthogonal to LsL_s and is on the same side of the hyperplane LsL_s as C∩AC \cap A. Moreover

(εs∣as∗−at∗)=⟨es,as∗−at∗⟩for all s,t∈S (\varepsilon_s | a_s^* - a_t^*) = \langle e_s, a_s^* - a_t^* \rangle \quad \text{for all } s, t \in S

which shows that εs\varepsilon_s is the image of the class of ese_s under the isomorphism from E/E0E/E^0 to TT given by the quadratic form BMB_M. It follows that

(εs∣εt)=BM(es,et). (\varepsilon_s | \varepsilon_t) = B_M(e_s, e_t).

Consequently εs\varepsilon_s is a unit vector and the last assertion of Prop. 10 is proved.

The euclidean affine space AA provided with the group WW is called the space associated to the Coxeter matrix MM and we denote it by AMA_M.

Proposition 10 admits a converse:

Proposition 11

Let WW be a group of displacements of a euclidean affine space AA, satisfying the assumptions of § 3. Assume that WW is infinite, essential and irreducible. Then the form BMB_M attached to the Coxeter matrix MM of WW is positive degenerate and there exists a unique isomorphism from the affine space AMA_M associated to MM to AA, commuting with the action of WW. This isomorphism transforms the scalar product of AMA_M into a multiple of the scalar product of AA.

Let C0C_0 be a chamber of AA and let SS be the set of orthogonal reflections with respect to the walls of C0C_0. If ηs\eta_s denotes the unit vector orthogonal to the hyperplane NsN_s associated to the reflection ss and on the same side of NsN_s as C0C_0 (§ 3, Prop. 3), the form BMB_M is such that BM(es,et)=(ηs∣ηt)B_M(e_s, e_t) = (\eta_s | \eta_t) for s,t∈Ss, t \in S. It is thus positive. Since the ηs\eta_s are linearly dependent (§ 3, no. 9, Prop. 8), it is degenerate.

We can thus apply the preceding constructions to MM. With the same notation as above, (εs∣εt)=(ηs∣ηt)(\varepsilon_s | \varepsilon_t) = (\eta_s | \eta_t) and there exists a unique isomorphism φ\varphi of Hilbert spaces from TT to the space of translations of AA such that φ(εs)=ηs\varphi(\varepsilon_s) = \eta_s. Let aa and bb be two distinct vertices of C0C_0 and s0s_0 the reflection in SS such that a∉Ns0a \notin N_{s_0}. Put λ=(ηs∣a−b)\lambda = (\eta_s | a - b) and let ψ\psi be the affine bijection from AMA_M to AA defined by

ψ(as0+x)=a+vs0λφ(x)for x∈T. \psi(a_{s_0} + x) = a + v_{s_0} \lambda \varphi(x) \quad \text{for } x \in T.

It is then immediate that ψ(Ls)=Ns\psi(L_s) = N_s for all s∈Ss \in S and that ψ\psi transforms the scalar product of AMA_M into a multiple of that on AA. It follows at once that ψ\psi commutes with the action of WW. Finally, the uniqueness of ψ\psi is evident, for asa_s for example is the unique point of AMA_M invariant under the reflections t∈S,t≠st \in S, t \neq s.

Exercises

In the exercises below, (W,S)(W, S) denotes a Coxeter system. We assume that SS is finite; its cardinal is called the rank of (W,S)(W, S). We identify WW with a subgroup of GL(E)\mathbf{GL}(E) by means of σ\sigma (cf. nos. 3 and 4).

See the exercises for § 4.

Transcribed from the printed volume. Not translated.