Bourbaki

§ 2. Representations of locally compact groups

In this paragraph, the vector spaces are over the field K=RK =\mathbf{R} or C\mathbf{C}. We denote by G a locally compact group endowed with a left Haar measure μ\mu. We shall write Lp(G)=LCp(G,μ)\mathscr{L}^p(G) =\mathscr{L}_{\mathbf{C}}^p(G, \mu) and Lp(G)=LCp(G,μ)L^p(G) = L^p_{\mathbf{C}}(G, \mu) for every p∈[1,+∞]p\in [1,+\infty ].

1. Continuity of certain representations

Proposition 1 03A4

Let H be a locally compact group. Let ϱ1\varrho_1 (resp. ϱ2\varrho_2) be a continuous representation of G (resp. of H) in a separated locally convex K-vector space E1E_1 (resp. E2E_2). Let F denote the space L(E1;E2)\mathscr{L}(E_1; E_2) endowed with the topology of compact convergence. The representation ϱ\varrho of G×HG\times H in F defined by ϱ(g,h)u=ϱ2(h)∘u∘ϱ1(g−1)\varrho (g, h)u=\varrho_2(h)\circ u\circ \varrho_1(g^{-1}) for (g,h)∈G×H(g, h)\in G\times H is continuous.

Let Lc(E1;E2)\mathscr{L}_c(E_1; E_2) denote the space L(E1;E2)\mathscr{L}(E_1; E_2) endowed with the topology of compact convergence. Let F1\mathfrak{F}_1 (resp. F2,F3\mathfrak{F}_2,\mathfrak{F}_3) be a filter in G converging to ee (resp. a filter in Lc(E1;E2)\mathscr{L}_c(E_1; E_2) converging to 0, a filter in H converging to ee). Since G and H are locally compact, there exist elements C∈F1C\in \mathfrak{F}_1 and D∈F3D\in \mathfrak{F}_3 which are relatively compact. The set ϱ1(C−1)\varrho_1(C^{-1}) is equicontinuous in L(E1)(\mathscr{L}(E_1) (cf. INT, VIII, p. 129, § 2, no1^o1, rem. 2, a′))')). By prop. 9 of EVT, III, p. 33 and prop. 4 of EVT, III, p. 31, the mapping defined by (u,v)↦u∘v(u, v)\mapsto u\circ v of Lc(E1;E2)×ϱ1(C−1)\mathscr{L}_c(E_1; E_2)\times \varrho_1(C^{-1}) into Lc(E1;E2)\mathscr{L}_c(E_1; E_2) is continuous. The filter base F2∘ϱ1(F1−1)\mathfrak{F}_2\circ \varrho_1(\mathfrak{F}^{-1}_1) therefore converges to 0 in Lc(E1;E2)\mathscr{L}_c(E_1; E_2). The set ϱ2(D)\varrho_2(D) is equicontinuous in L(E2)(\mathscr{L}(E_2) (cf. INT, VIII, p. 129, § 2, no1^o1, rem. 2), and for every x∈E2x\in E_2, the set ϱ2(D)x⊂E2\varrho_2(D)x\subset E_2 is relatively compact. Consequently, ϱ2(D)\varrho_2(D) is relatively compact in L(E2)\mathscr{L}(E_2) endowed with the topology of compact convergence (TG, X, p. 18, cor. 1). The mapping defined by (u,v)↦u∘v(u, v)\mapsto u\circ v of ϱ2(D)‾×Lc(E1;E2)\overline{\varrho_2(D)}\times \mathscr{L}_c(E_1; E_2) into Lc(E1;E2)\mathscr{L}_c(E_1; E_2) is continuous by prop. 9 of EVT, III, p. 33 and prop. 4 of EVT, III, p. 31. Hence the filter base ϱ(F1×F3)(F2)\varrho (\mathfrak{F}_1\times \mathfrak{F}_3)(\mathfrak{F}_2) converges to 0 in Lc(E1;E2)\mathscr{L}_c(E_1; E_2). This implies the assertion.

Corollary 03A5

Let ϱ\varrho be a continuous representation of G in a separated locally convex K-vector space E. The contragredient representation ϱ˘\breve{\varrho} is continuous when E′E' is endowed with the topology of compact convergence.

This results from the proposition by taking H={e},ϱ1=ϱH =\{e\},\varrho_1=\varrho and ϱ2\varrho_2 the trivial representation on K.

Remark 03A6

The contragredient representation is not necessarily continuous when E′E' is endowed with the strong topology (cf. INT, VIII, p. 191, § 2, exercise 3, d)). One can show that it is so if the space E is semi-reflexive (loc. cit., c)).

2. Extension of representations to spaces of measures

In this number, it is assumed that K=CK =\mathbf{C}.

Let ϱ\varrho be a continuous linear representation of G in a separated quasi-complete locally convex space E. Let Mc(G)\mathscr{M}_c(G) denote the space of measures with compact support on G endowed with the topology of compact convergence; this is the dual of the space C(G)\mathscr{C}(G). For every measure ν∈Mc\nu \in \mathscr{M}_c(G), put

ϱ(ν)=∫Gϱ(g)dν(g) \varrho (\nu ) =\int_G\varrho (g)d\nu (g)

This is an element of L(E)\mathscr{L}(E). In particular, one has ϱ(εg)=ϱ(g)\varrho (\varepsilon_g) =\varrho (g) for every g∈Gg\in G.

According to INT, VIII, p. 136, § 2, no6^o6, the mapping ν↦ϱ(ν)\nu \mapsto \varrho (\nu ) is a continuous linear mapping from Mc(G)\mathscr{M}_c(G) into the space L(E)\mathscr{L}(E) endowed with the topology of compact convergence. According to INT, VIII, p. 145, § 3, no3^o3, prop. 11, it is a morphism of unital algebras.

Let x∈Ex\in E. The mapping from Mc(G)\mathscr{M}_c(G) into E defined by ν↦ϱ(ν)x\nu \mapsto \varrho (\nu )x is continuous when Mc(G)\mathscr{M}_c(G) is endowed with the topology of compact convergence (INT, VI, p. 27, § 1, no^o 7, prop. 16 and EVT, III, p. 31, prop. 4).

For f∈L1(G)f\in \mathscr{L}^1(G) null outside a compact subset of G, the measure f⋅μf\cdot \mu has compact support and we shall denote by ϱμ(f)\varrho^\mu(f), or by ϱ(f)\varrho (f) when no ambiguity is possible, the endomorphism ϱ(f⋅μ)\varrho (f\cdot \mu) of E. This endomorphism depends only on the class f~\widetilde{f} of ff in L1L^1(G), and it will also be denoted by ϱμ(f~)\varrho^\mu(\widetilde{f}) or ϱ(f~)\varrho (\widetilde{f}).

Analogously, let ϱ\varrho be a continuous and bounded linear representation of G in a Banach space E. For every bounded measure ν∈M1\nu \in \mathscr{M}^1(G), put

ϱ(ν)=∫Gϱ(g)dν(g) \varrho (\nu ) =\int_G\varrho (g)d\nu (g)

According to INT, VIII, loc. cit., the mapping ν↦ϱ(ν)\nu \mapsto \varrho (\nu ) is a continuous unital morphism of Banach algebras from the algebra M1(G)\mathscr{M}^1(G) of bounded complex measures on G into the Banach algebra L(E)\mathscr{L}(E).

Let ρ\rho be the function g↦∥ϱ(g)∥g\mapsto \|\varrho (g)\| on G; the algebra denoted Mρ\mathscr{M}^{\rho} in INT, VIII, p. 145, prop. 11 (whose elements are the measures ν\nu such that ρ∈L1(ν)\rho \in \mathscr{L}^1(\nu )) coincides with the Banach algebra M1(G)\mathscr{M}^1(G). Indeed, put M = sup ρ\rho. We have M>0M>0 since ρ(e)=1\rho (e) = 1, and M−1⩽ρ⩽MM^{-1}\leqslant \rho \leqslant M since ∥ϱ(e)∥⩽∥ϱ(g)∥∥ϱ(g−1)∥\|\varrho (e)\|\leqslant \|\varrho (g)\| \|\varrho (g^{-1})\| for every g∈Gg\in G; thus ρ∈L1(ν)\rho \in \mathscr{L}^1(\nu ) if and only if ν\nu is a bounded measure.

If f∈L1f\in \mathscr{L}^1(G), we shall also denote by ϱμ(f)\varrho^\mu(f) or simply ϱ(f)\varrho (f) the endomorphism ϱ(f⋅μ)\varrho (f\cdot \mu), and analogously for the class f~\widetilde{f} of ff in L1(G)L^1(G).

Lemma 1 03A7

Let ϱ\varrho be a unitary representation of G in a Hilbert space E. The mapping ν↦ϱ(ν)\nu \mapsto \varrho (\nu ) from M1(G)\mathscr{M}^1(G) into L(E)\mathscr{L}(E) is a unital morphism of involutive Banach algebras.

From what precedes, it suffices to prove that the morphism ν↦ϱ(ν)\nu \mapsto \varrho (\nu ) is involutive. Let ν∈M1(G)\nu \in \mathscr{M}^1(G). The measure ν∗\nu^* is the conjugate measure of the measure νˇ(\check{\nu}(I, p. 99, example 4). According to the definition of the conjugate measure (INT, III, p. 52, § 1, no5^o5), one calculates

⟨x∣ϱ(ν)y⟩=∫⟨x∣ϱ(g)y⟩dν(g) \langle x|\varrho (\nu )y\rangle =\int\langle x|\varrho (g)y\rangle d\nu (g)
=∫GG⟨ϱ(g−1)x∣y⟩dν(g)=∫G⟨ϱ(g)x∣y⟩dνˇ(g) =\int^G_G\langle \varrho (g^{-1})x|y\rangle d\nu (g) =\int_G\langle \varrho (g)x|y\rangle d\check{\nu}(g)
=∫G⟨y∣ϱ(g)x⟩dν∗(g)=⟨ϱ(ν∗)x∣y⟩ =\int_G\langle y|\varrho (g)x\rangle d\nu^*(g) =\langle \varrho (\nu^*)x|y\rangle

for all xx and yy in E, whence ϱ(ν)∗=ϱ(ν∗)\varrho (\nu )^*=\varrho (\nu^*).

Let ϱ\varrho be a continuous linear representation (resp. continuous and bounded) of G in a quasi-complete locally convex space E (resp. a Banach space E). If F is a closed subspace of E defining a subrepresentation ϱF\varrho_F of ϱ\varrho, then for every measure ν∈Mc(G)\nu \in \mathscr{M}_c(G) (resp. ν∈M1(G)\nu \in \mathscr{M}^1(G)) the linear mapping ϱ(ν)\varrho (\nu ) leaves the subspace F stable and coincides with ϱF(ν)\varrho_F(\nu ) on F.

Conversely, let F⊂EF\subset E be a closed subspace, stable under the linear mappings ϱ(f)\varrho (f) for every function f∈K(G)f\in \mathscr{K}(G). Then F defines a subrepresentation of ϱ\varrho (INT, VIII, p. 139, § 2, no7^o7, prop. 10).

Recall (A, VIII, p. 388) that a function f:G→Cf: G\rightarrow \mathbf{C} is said to be central if, for all gg and hh in G, one has f(gh)=f(hg)f(gh) =f(hg). This amounts to saying that ff is invariant under conjugation.

Definition 1 03A8

A bounded measure ν∈M1(G)\nu \in \mathscr{M}^1(G) is said to be central if one has εg∗ν=ν∗εg\varepsilon_g*\nu =\nu *\varepsilon_g for every g∈Gg\in G.

If G is unimodular and f∈C(G)f\in \mathscr{C}(G) is μ\mu-integrable, the measure f⋅μf\cdot \mu is central if and only if ff is central.

Let ϱ\varrho be a bounded continuous representation of G in a Banach space E (resp. a continuous representation of G in a separated quasi-complete locally convex space E). For every bounded central measure ν\nu on G (resp. every central measure with compact support ν\nu on G), the linear mapping ϱ(ν)\varrho (\nu ) is a G-morphism from ϱ\varrho into ϱ\varrho. In fact, for every g∈Gg\in G, one has

ϱ(ν)ϱ(g)=ϱ(ν∗εg)=ϱ(εg∗ν)=ϱ(g)ϱ(ν) \varrho (\nu )\varrho (g) =\varrho (\nu *\varepsilon_g) =\varrho (\varepsilon_g*\nu ) =\varrho (g)\varrho (\nu )

3. Criterion for Semisimplicity

Proposition 2 03A9

Let ϱ\varrho be a unitary representation of G in a complex Hilbert space E. Let F\mathfrak{F} be a basis of filter on Mc(G)\mathscr{M}_c(G) converging to the measure εe\varepsilon_e for the topology of compact convergence. Suppose that there exists M∈FM\in \mathfrak{F} such that ϱ(ν)\varrho (\nu ) is a compact endomorphism of E for every ν∈M\nu \in M.

Then the unitary representation ϱ\varrho is semisimple and every irreducible unitary representation of G has finite multiplicity in ϱ\varrho.

Let us first prove a lemma.

Lemma 2 03AA

Let ϱ1\varrho_1 be a nonzero unitary representation of G isomorphic to a subrepresentation of ϱ\varrho. There exists a measure ν∈M\nu \in M such that ϱ1(νˇ∗ν)\varrho_1(\check{\nu}*\nu ) is a nonzero hermitian compact endomorphism of the space of ϱ1\varrho_1. In particular, there exists a nonzero real number λ\lambda such that the eigensubspace of ϱ1(νˇ∗ν)\varrho_1(\check{\nu}*\nu ) corresponding to λ\lambda is nonzero.

One may suppose that ϱ1\varrho_1 is a subrepresentation of ϱ\varrho. Let E1E_1 be its space. For every measure ν∈M\nu \in M, the endomorphism ϱ1(ν)\varrho_1(\nu ) is deduced from ϱ(ν)\varrho (\nu ) by passing to subspaces. The hypothesis and prop. 3 of III, p. 5 therefore imply that ϱ1(ν)\varrho_1(\nu ) is compact.

Since F\mathfrak{F} converges to the measure εe\varepsilon_e in Mc(G)\mathscr{M}_c(G) endowed with the topology of compact convergence and since the space E1E_1 is nonzero, there exists ν∈M\nu \in M such that v=ϱ1(ν)v=\varrho_1(\nu ) is a nonzero endomorphism of E1E_1 (cf. No.o2^o2 of V, p. 400). The endomorphism u=ϱ1(νˇ∗ν)u=\varrho_1(\check{\nu}*\nu ) is equal to v∗∘vv^*\circ v (lemma 1 of V, p. 401); it is therefore nonzero (EVT, V, p. 39, prop. 2), hermitian and compact, since vv is compact.

Since uu is hermitian and nonzero, its spectrum is not reduced to zero (example 1 of I, p. 110). Finally, since uu is compact, every λ∈\lambda \in Sp(uu)−{0}-\{0\} is an eigenvalue of uu (prop. 2 of III, p. 83).

Let us now prove the proposition.

We shall use prop. 7 of V, p. 391 to establish that ϱ\varrho is semisimple. Let ϱ1\varrho_1 be a nonzero subrepresentation of ϱ\varrho, and E1⊂EE_1\subset E its space; we must prove that ϱ1\varrho_1 contains an irreducible subrepresentation.

Let ν∈M\nu \in M be such that u=ϱ1(νˇ∗ν)u=\varrho_1(\check{\nu}*\nu ) is a nonzero compact hermitian endomorphism of the space of ϱ1\varrho_1, and let λ\lambda be nonzero such that the eigensubspace F of uu relative to λ\lambda is nonzero (lemma 2). The space F is of finite dimension (prop. 5 of III, p. 90). There exists a subrepresentation ϱ2\varrho_2 of ϱ1\varrho_1 on a subspace E2E_2 of E1E_1 such that E2∩FE_2\cap F is nonzero and of minimal dimension. Let xx be a nonzero element of E2∩FE_2\cap F, and let E3E_3 be the subrepresentation of ϱ1\varrho_1 generated by xx. Then E3⊂E2E_3\subset E_2, whence E3∩F=E2∩FE_3\cap F = E_2\cap F by minimality of the dimension of E2∩FE_2\cap F.

Let us prove that the representation E3E_3 is irreducible. Let E4⊂E3E_4\subset E_3 be a closed subspace stable under G. We have E2∩F=(E4∩F)⊕(E4∘∩F)E_2\cap F = (E_4\cap F)\oplus (E^{\circ}_4\cap F), where E4∘E^{\circ}_4 denotes the orthogonal of E4E_4 in E3E_3 (in fact, if y∈E2∩Fy\in E_2\cap F, let y4∈E4y_4\in E_4 be its orthogonal projection on E4E_4; since E4E_4 and E4∘E^{\circ}_4 are stable under uu, the vector u(y4)u(y_4) is the orthogonal projection of u(y)=λyu(y) =\lambda y on E4E_4, whence u(y4)=λy4u(y_4) =\lambda y_4, which means that y4∈E4∩Fy_4\in E_4\cap F, and the assertion follows). The minimality of the dimension of E2∩FE_2\cap F then implies that either E4∩F=E2∩FE_4\cap F = E_2\cap F, or E4∘∩F=E2∩FE^{\circ}_4\cap F = E_2\cap F. In the first case, we have x∈E4x\in E_4, whence E4=E3E_4= E_3, and in the second, we have x∈E4∘x\in E^{\circ}_4, whence E4∘=E3E^{\circ}_4= E_3 and E4={0}E_4=\{0\}. The representation E3E_3 is therefore irreducible.

It follows from Prop. 7 of V, p. 391 that the representation ϱ\varrho is semisimple.

Let π\pi be an irreducible unitary representation of G whose multiplicity in ϱ\varrho is nonzero; let EπE_{\pi} be its space. There exist a measure ν∈M\nu \in M and a nonzero real number λ\lambda such that u=π(νˇ∗ν)u=\pi (\check{\nu}*\nu ) is a nonzero compact hermitian endomorphism of EπE_{\pi} and that the proper subspace of uu corresponding to λ\lambda is nonzero (Lemma 2). Let F be the proper subspace of v=ϱ(νˇ∗ν)v=\varrho (\check{\nu}*\nu ) corresponding to λ\lambda. For every subrepresentation E1E_1 of E isomorphic to π\pi, the endomorphism of E1E_1 deduced from vv by passing to the subspaces is identified with uu, hence the intersection of E1E_1 and F is nonzero. Thus, the multiplicity of π\pi in ϱ\varrho is less than the dimension of the space F, which is finite (Prop. 5 of III, p. 90).

Example 03AB

Suppose that G is unimodular, for example that G is a real semisimple Lie group. Let Γ⊂G\Gamma \subset G be a discrete subgroup such that the quotient X=Γ\GX = \Gamma \backslash G is compact. The group G acts on the right by multiplication on X. Let β\beta denote the counting measure on Γ and put μ~=μ/β\widetilde{\mu}=\mu/\beta (INT, VII, p. 44, § 2, No.o2^o2, Def. 1); it is a bounded G-invariant measure on X.

For every f∈L2(X,μ~)f\in \mathscr{L}^2(X,\widetilde{\mu}) and every g∈g\in G, one defines the function ϱ(g)f∈L2(X,μ~)\varrho (g)f\in \mathscr{L}^2(X,\widetilde{\mu}) by ϱ(g)f(x)=f(x⋅g)\varrho (g)f(x) =f(x\cdot g). The mapping ϱ(g)\varrho (g) is a continuous linear mapping, which induces by passing to quotients a unitary mapping on L2(X,μ~)L^2(X,\widetilde{\mu}), again denoted by ϱ(g)\varrho (g). The mapping ϱ\varrho is a unitary representation of G in L2(X,μ~)L^2(X,\widetilde{\mu}) (INT, VII, p. 135, § 2, No.o5^o5, Prop. 8).

Let φ∈K(G)\varphi \in \mathscr{K}(G). For all compact subsets L1L_1 and L2L_2 of G, the intersection T of Γ and the compact set L1L_1Supp(φ\varphi )L2−1L^{-1}_2 is finite. For every (g,h)∈L1×L2(g, h)\in L_1\times L_2, the series ∑γ∈Γφ(g−1γh)\sum_{\gamma\in\Gamma}\varphi (g^{-1}\gamma h) coincides with the sum

finite ∑γ∈Tφ(g−1γh)\sum_{\gamma\in T}\varphi (g^{-1}\gamma h). Since G is locally compact, the sum of

this series, denoted by kφ(g,h)k_{\varphi}(g, h), is a continuous function on G×GG\times G.

Let g∈Gg\in G and let (γ,η)∈Γ×Γ(\gamma , \eta )\in \Gamma \times \Gamma. One has kφ(γg,ηh)=kφ(g,h)k_{\varphi}(\gamma g, \eta h) =k_{\varphi}(g, h), hence kφk_{\varphi} defines by passing to the quotient a continuous function on X×XX\times X, which is denoted by k~φ\widetilde{k}_{\varphi}. One has moreover k~φ∈L2(X×X,μ~⊗μ~)\widetilde{k}_{\varphi}\in \mathscr{L}^2(X\times X,\widetilde{\mu}\otimes \widetilde{\mu}), since the space X is assumed compact.

One denotes by x˙\dot{x} the image in X of an element xx of G under the canonical projection. Let φ∈K(G)\varphi \in \mathscr{K}(G). For f∈L2(X,μ~)f\in \mathscr{L}^2(X,\widetilde{\mu}) and x∈Gx\in G, one has

ϱ(φ)f(x˙)=∫Gφ(g)(ϱ(g)f)(x˙)dμ(g)=∫Gφ(g)f(x˙⋅g)dμ(g) \varrho (\varphi )f( \dot{x}) =\int_G\varphi (g) (\varrho (g)f)( \dot{x})d\mu(g) =\int_G\varphi (g)f( \dot{x}\cdot g)d\mu(g)
=∫Gφ(x−1y)f(y˙)dμ(y)=∫Γ\G((∑γ∈Γφ(x−1γy))f(y˙)dμ~(y˙) =\int_G\varphi (x^{-1}y)f( \dot{y})d\mu(y) =\int_{\Gamma\backslash G}((\sum_{\gamma\in\Gamma}\varphi (x^{-1}\gamma y))f( \dot{y})d\widetilde{\mu}( \dot{y})

(INT, VII, p. 46, § 2, No.o3^o3, Prop. 5). Since k~φ\widetilde{k}_{\varphi} belongs to the space L2(X×X,μ~⊗μ~)\mathscr{L}^2(X\times X,\widetilde{\mu}\otimes \widetilde{\mu}), it follows that the endomorphism ϱ(φ)\varrho (\varphi ) of L2(X,μ~)L^2(X,\widetilde{\mu}) coincides with the Hilbert-Schmidt endomorphism of kernel k~φ\widetilde{k}_{\varphi}; this endomorphism is therefore compact (Cor. 1 of III, p. 33)

There exists a sequence (φn)n∈N(\varphi_n)_{n\in\mathbf{N}} of functions in K+(G)\mathscr{K}_+(G) of integral 1 such that φn⋅μ\varphi_n\cdot \mu converges to εe\varepsilon_e in Mc(G)\mathscr{M}_c(G) endowed with the topology of compact convergence (INT, VIII, p. 139, § 2, No.o7^o7, Cor. 2). Prop. 2 therefore implies that the representation ϱ\varrho is semisimple and that the multiplicities of the irreducible unitary representations of G in ϱ\varrho are finite.

The irreducible unitary representations of G whose multiplicity in ϱ\varrho is not zero are called Γ-automorphic representations of the group G.

4. Regular Representations

Let pp be a real number ⩾1\geqslant 1 and μ′\mu' a right Haar measure on G.

For every g∈Gg\in G and every function f∈Lp(G,μ)f\in \mathscr{L}^p(G, \mu), we denote by γG(p)(g)f\boldsymbol{\gamma }^{(p)}_G(g)f the function x↦f(g−1x)x\mapsto f(g^{-1}x) on G. The mapping g↦γG(p)(g)g\mapsto \boldsymbol{\gamma }^{(p)}_G(g) is a continuous linear representation of G in Lp(G)\mathscr{L}^p(G). By passing to quotients, it induces a continuous isometric linear representation of G in Lp(G)L^p(G) (INT, VIII, p. 135, § 2, no5^o5, Prop. 8), denoted by γG(p)\boldsymbol{\gamma }^{(p)}_G.

Analogously, for every g∈Gg\in G and every function f∈Lp(G,μ′)f\in \mathscr{L}^p(G, \mu'), we denote by δG(p)(g)f\boldsymbol{\delta }^{(p)}_G(g)f the function x↦f(xg)x\mapsto f(xg) on G. The mapping g↦δG(p)(g)g\mapsto \boldsymbol{\delta }^{(p)}_G(g) is a continuous linear representation of G in Lp(G,μ′)\mathscr{L}^p(G, \mu'). By passing to quotients, it induces a continuous isometric linear representation of G in Lp(G,μ′)(L^p(G, \mu') (cf. INT, VIII, p. 136, § 2, no5)^o5).

We say that γG(p)\boldsymbol{\gamma }_G^{(p)} is the left regular representation of G in Lp(G)\mathscr{L}^p(G) or Lp(G)L^p(G) and that δG(p)\boldsymbol{\delta }^{(p)}_G is the right regular representation of G in Lp(G,μ′)\mathscr{L}^p(G, \mu') or Lp(G,μ′)L^p(G, \mu').

Lemma 3 03AC

Let pp be a real number ⩾1\geqslant 1. The left (resp. right) regular representation of G in Lp(G,μ)(L^p(G, \mu) (resp. in Lp(G,μ′))L^p(G, \mu')) is faithful.

More precisely, let qq be the conjugate exponent of pp and let gg be an element of G such that g≠eg\not =e.

a) There exists a function φ∈K(G)\varphi \in \mathscr{K}(G), positive and nonzero in Lq(G,μ)L^q(G, \mu), such that ⟨φ,γG(p)(g)φ⟩=0\langle \varphi ,\boldsymbol{\gamma }^{(p)}_G(g)\varphi \rangle = 0;

b) There exists a function φ∈K(G)\varphi \in \mathscr{K}(G), positive and nonzero in Lq(G,μ′)L^q(G, \mu'), such that ⟨φ,δG(p)(g)φ⟩=0\langle \varphi ,\boldsymbol{\delta }^{(p)}_G(g)\varphi \rangle = 0.

Let us consider the case of the left regular representation γG(p)\boldsymbol{\gamma }^{(p)}_G, that of the right regular representation being similar. Assertion a) implies that γG(p)\boldsymbol{\gamma }^{(p)}_G is faithful, for if g≠eg\not =e is an element of G, and if φ\varphi is as in a), one has φ≠γG(p)(g)φ\varphi \not =\boldsymbol{\gamma }^{(p)}_G(g)\varphi since ⟨φ,φ⟩=∫Gφ2>0\langle \varphi , \varphi \rangle =\int_G\varphi^2>0.

Let us therefore prove a). Let g≠eg\not =e in G. Let C be a symmetric compact neighbourhood of ee such that g∉C2g \notin C^2 and let φ∈K(G)\varphi \in \mathscr{K}(G) be a positive continuous function of integral 1 with support contained in C; the function φ\varphi is nonzero in Lp(G,μ)L^p(G, \mu). Since C∩g−1C=∅C\cap g^{-1}C =\emptyset, one has

⟨φ,γG(p)(g)φ⟩=∫Gφ(x)φ(g−1x)dμ(x)=0 \langle \varphi ,\boldsymbol{\gamma }^{(p)}_G(g)\varphi \rangle =\int_G\varphi (x)\varphi (g^{-1}x)d\mu(x) = 0

Let ϱ\varrho be a continuous bounded representation of G in a Banach space E. For every f∈L1(G)f\in L^1(G) (resp. f′∈L1(G,μ′)f'\in L^1(G, \mu')) and every g∈Gg\in G, one has

(1) ϱ(g)ϱ(f⋅μ)=ϱ(εg∗(f⋅μ))=ϱ(γG(1)(g)f⋅μ)\varrho (g)\varrho (f\cdot \mu) =\varrho (\varepsilon_g*(f\cdot \mu)) =\varrho (\boldsymbol{\gamma }^{(1)}_G(g)f\cdot \mu),

(2) ϱ(f′⋅μ′)ϱ(g)=ϱ((f′⋅μ′)∗εg)=ϱ(δG(1)(g−1)f′⋅μ′)\varrho (f'\cdot \mu')\varrho (g) =\varrho ((f'\cdot \mu')*\varepsilon_g) =\varrho (\boldsymbol{\delta }^{(1)}_G(g^{-1})f'\cdot \mu')

(INT, VIII, p. 144, § 3, no2^o2, formula (5)).

Suppose G unimodular, and put μ′=μ\mu'=\mu. The biregular representation of G in Lp(G)\mathscr{L}^p(G) (resp. in Lp(G)L^p(G)) is the representation ϱG(p)\boldsymbol{\varrho }^{(p)}_G of G×GG\times G in Lp(G)\mathscr{L}^p(G) (resp. in Lp(G)L^p(G)) such that

ϱG(p)(g1,g2)=γG(p)(g1)δG(p)(g2)=δG(p)(g2)γG(p)(g1) \boldsymbol{\varrho }_G^{(p)}(g_1, g_2) =\boldsymbol{\gamma }_G^{(p)}(g_1)\boldsymbol{\delta }_G^{(p)}(g_2) =\boldsymbol{\delta }_G^{(p)}(g_2)\boldsymbol{\gamma }_G^{(p)}(g_1)

It is a continuous linear representation (Lemma 1 of V, p. 377). It satisfies

(ϱG(p)(g1,g2)f)(x)=f(g1−1xg2) (\boldsymbol{\varrho }_G^{(p)}(g_1, g_2)f)(x) =f(g_1^{-1}xg_2)

for every f∈Lpf\in \mathscr{L}^p(G), every (g1,g2)∈G×G(g_1, g_2)\in G\times G and every x∈Gx\in G.

Remark 03AD

The biregular representation of G in Lp(G,μ)L^p(G, \mu) is not necessarily faithful; its kernel is the image of the center of G under the mapping g↦(g,g)g\mapsto (g, g) (exercise 4 of V, p. 487).

When p=2p= 2, the left regular representation γG(2)\boldsymbol{\gamma }^{(2)}_G of G in the complex Hilbert space L2(G,μ)L^2(G, \mu) is unitary, since it is isometric. Analogously, the right regular representation δG(2)\boldsymbol{\delta }^{(2)}_G in L2(G,μ′)L^2(G, \mu') is unitary.

We shall write simply γG=γG(2)\boldsymbol{\gamma }_G=\boldsymbol{\gamma }^{(2)}_G and δG=δG(2)\boldsymbol{\delta }_G=\boldsymbol{\delta }^{(2)}_G, and we shall call these representations the left and right regular representations of G.

If G is unimodular, the biregular representation ϱG(2)\boldsymbol{\varrho }^{(2)}_G of G×GG\times G in L2(G,μ)L^2(G, \mu) is unitary. We shall write it simply ϱG\boldsymbol{\varrho }_G.

Lemma 4 03AE

Let pp be a real number ⩾1\geqslant 1. For f∈L1(G)f\in \mathscr{L}^1(G), the linear mapping γG(p)(f)\boldsymbol{\gamma }^{(p)}_G(f) coincides with the endomorphism of Lp(G)L^p(G) defined by φ↦f∗μφ\varphi \mapsto f*^\mu\varphi.

This follows from INT, VIII, p. 157, § 4, No.o2^o2, Prop. 6, taking account of formula (14) of INT, VIII, p. 165.

Remark 03AF

Recall that, for every function ff on G, one defines the function fˇ\check{f} on G by fˇ(g)=f(g−1)\check{f}(g) =f(g^{-1}) for every g∈Gg\in G (INT, VII, p. 12, § 1, No.o1^o1, formula (12)).

One verifies that if f∈L1f\in \mathscr{L}^1(G), the linear mapping u=δG(p)(f)u=\boldsymbol{\delta }^{(p)}_G(f) satisfies the relation

u(φˇ)=f∗φˇ u(\widecheck{\varphi}) =f*\check{\varphi}

for every φ∈Lp(G,μ′)\varphi \in L^p(G, \mu').

5. Equivariant functions

In this number, a closed subgroup H of G is fixed. One denotes by ϖ\varpi the canonical projection of G onto G/HG/H.

In addition to the Haar measure μ\mu on G, a left Haar measure β\beta on H is fixed.

According to INT, VII, p. 56, § 2, no5^o5, th. 2, there exists a continuous function κ:G→R+∗\kappa : G\rightarrow \mathbf{R}_+^* such that κ(xh)=ΔH(h)ΔG(h)−1κ(x)\kappa (xh) = \Delta_H(h)\Delta_G(h)^{-1}\kappa (x) for every (x,h)∈G×H(x, h)\in G\times H. We fix such a function κ\kappa. We denote by ν\nu the measure (κ⋅μ)/β(\kappa \cdot \mu)/\beta on G/HG/H; according to loc. cit., this is a non-zero positive measure quasi-invariant by G. Its support is equal to G/HG/H (INT, VII, p. 10, § 1, no1^o1). According to INT, VII, p. 43, § 2, no2^o2, prop. 4, the measure ν\nu is the unique measure on G/HG/H such that the measure ν♯\nu^{\sharp} on G is equal to κ⋅μ\kappa \cdot \mu. We endow the space G/HG/H with the measure ν\nu (so that we write, for example, Lp(G/H)=Lp(G/H,ν)\mathscr{L}^p(G/H) =\mathscr{L}^p(G/H, \nu )).

We shall say that a set S⊂GS\subset G is negligible modulo H if ϖ(S)\varpi (S) is ν\nu-negligible. This condition does not depend on the choice of the Haar measures on G and on H. It implies that S is locally μ\mu-negligible (INT, VII, p. 47, § 2, no3^o3, prop. 6, a)). We shall say that a property of an element of G is true almost everywhere modulo H if the set of elements of G for which this property does not hold is negligible modulo H.

Let π\pi be a unitary representation of H in a Hilbert space E. We denote by Fπ(G)\mathscr{F}_{\pi}(G) the vector space of functions ff on G with values in E such that f(xh)=π(h)f(x)f(xh) =\pi (h)f(x) for all (x,h)∈G×H(x, h)\in G\times H. The elements of Fπ(G)\mathscr{F}_{\pi}(G) are said to be the π\pi-equivariant functions on G.

The space F1(G)\mathscr{F}_1(G) associated with the trivial representation of G on C\mathbf{C} is identified with the space F(G/H)\mathscr{F}(G/H) of complex-valued functions on G/HG/H by the mapping f↦f∘ϖf\mapsto f\circ \varpi of F(G/H)\mathscr{F}(G/H) into F1(G)\mathscr{F}_1(G).

For every function ff in Fπ\mathscr{F}_{\pi}(G), the function ∥f∥\|f\| belongs to F1(G)\mathscr{F}_1(G) since π\pi is unitary. This makes it possible to identify ∥f∥\|f\| with a function on G/HG/H, and we shall write for example ∥f(xH)∥\|f(xH)\| for the value of this function at an element xHxH of G/HG/H.

A function ff of Fπ(G)\mathscr{F}_{\pi}(G) will be said to be zero outside a compact set modulo H if ∥f∥\|f\| is zero outside a compact subset of G/HG/H. It amounts to the same to say that there exists a compact subset K of G such that ff is zero outside K⋅HK\cdot H (TG, III, p. 33, prop. 10).

We denote by Kπ(G)\mathscr{K}_{\pi}(G) the space of continuous functions on G belonging to Fπ(G)\mathscr{F}_{\pi}(G) which have compact support modulo H.

A space analogous to Kπ(G)\mathscr{K}_{\pi}(G) was defined in INT, VII, p. 39, §2, no1^o1, when π\pi is a continuous homomorphism of H into R+∗\mathbf{R}^*_+.

Let p∈[1,+∞[p\in [1,+\infty [. For every f∈Fπf\in \mathscr{F}_{\pi}(G), one sets

Np(f)=(∫G/H∗∥f∥pdν)1/p N_p(f) =(\int_{G/H}^*\|f\|^pd\nu )^{1/p}

This is a real number or +∞+\infty. One denotes by Fπp(G,ν)\mathscr{F}_{\pi}^p(G, \nu ), or simply Fπp\mathscr{F}_{\pi}^p(G), the subspace of the functions f∈Fπ(G)f\in \mathscr{F}_{\pi}(G) such that Np(f)N_p(f) is finite. The space Fπp(G)\mathscr{F}_{\pi}^p(G) endowed with the mapping NpN_p is a semi-normed space.

The space Kπ(G)\mathscr{K}_{\pi}(G) is contained in Fπp(G)\mathscr{F}_{\pi}^p(G). Its closure in Fπp(G)\mathscr{F}_{\pi}^p(G) is denoted by Lπp(G,ν)\mathscr{L}_{\pi}^p(G, \nu ), or simply Lπp(G)\mathscr{L}_{\pi}^p(G); one says that this is the space of π\pi-equivariant functions on G whose pep^e power is integrable modulo H.

The assertions of the following proposition are, when π\pi is the trivial representation of dimension 1, consequences of INT, IV, p. 128, § 3, no3^o3, prop. 6 and p. 131, §3, no4^o4, th. 3.

Proposition 3 03AG

a) Let (fn)n∈N(f_n)_{n\in\mathbf{N}} be a sequence in Fπp(G)\mathscr{F}_{\pi}^p(G) such that the series

∑n=0+∞Np(fn) \sum_{n=0}^{+\infty}N_p(f_n)

converges. Then the series with general term fn(g)f_n(g) is absolutely convergent for gg outside a set T which is negligible modulo H. Let ff be the function on G with values in E which is equal to the sum of this series on G - T and equal to 0 on T. Then one has f∈Fπp(G)f\in \mathscr{F}_{\pi}^p(G) and the series with general term fnf_n converges to ff in the space Fπp(G)\mathscr{F}_{\pi}^p(G);

b) Let (fn)(f_n) be a sequence converging in Lπp(G)\mathscr{L}_{\pi}^p(G) to a function ff. There exists a subsequence (fnk)(f_{n_k}) extracted from (fn)(f_n) such that fnk(g)f_{n_k}(g) converges to f(g)f(g) for every gg outside a set negligible modulo H;

c) The semi-normed spaces Fπp(G)\mathscr{F}_{\pi}^p(G) and Lπp(G)\mathscr{L}_{\pi}^p(G) are complete.

In assertion a), to say that the series with general term fnf_n converges to ff in the space Fπp(G)\mathscr{F}_{\pi}^p(G) means that the sequence of partial sums f0+⋯+fnf_0+\cdots +f_n converges to ff in Fπp(G)\mathscr{F}_{\pi}^p(G). One then also says that ff is a sum of this series.

Let us prove a). By prop. 6 of INT, IV, p. 128, § 3, no3^o3, there exists a ν\nu-negligible set S⊂G/HS\subset G/H such that the series with general term ∥fn(gH)∥\|f_n(gH)\| converges absolutely for gH∉SgH\notin S. Moreover, the function hh which is equal to the sum of this series for gH∉SgH\notin S and which is zero for gH∈SgH\in S satisfies Np(h)<+∞N_p(h)<+\infty.

The set T=ϖ−1(S)T =\overset{-1}{\varpi}(S) is negligible modulo H. For every g∉Tg \notin T, the series with general term fn(g)f_n(g) is absolutely convergent in E. Define f(g)=∑fn(g)f(g) =\sum f_n(g) for g∉Tg \notin T and f(g)=0f(g) = 0 otherwise. We have f∈f\in Fπ(G)\mathscr{F}_{\pi}(G). Note that ∥f(gH)∥⩽h(gH)\|f(gH)\|\leqslant h(gH) for every g∈Gg\in G, whence Np(f)⩽N_p(f)\leqslant Np(h)<+∞N_p(h)<+\infty. Thus f∈Fπp(G)f\in \mathscr{F}_{\pi}^p(G). Similarly, we obtain

Np(f−∑n=0kfn)⩽∑n=k+1+∞Np(fn) N_p(f-\sum_{n=0}^kf_n)\leqslant \sum_{n=k+1}^{+\infty}N_p(f_n)

for every k∈Nk\in \mathbf{N}, hence the series ∑fn\sum f_n converges to ff in Fπp(G)\mathscr{F}_{\pi}^p(G). Assertion a) is proved.

Let us prove b). The sequence (∥fn−f∥)n∈N(\|f_n-f\|)_{n\in\mathbf{N}} converges to 0 in the space Lp(G/H)\mathscr{L}^p(G/H). By INT, IV, p. 131, § 4, no3^o3, th. 3, there exists a subsequence (∥fnk−f∥)k∈N(\|f_{n_k}-f\|)_{k\in\mathbf{N}} which converges ν\nu-almost everywhere to 0. The sequence (fnk(g))k∈N(f_{n_k}(g))_{k\in\mathbf{N}} then converges to f(g)f(g) for every gg outside a set negligible modulo H.

Finally, let us prove c). Let (fn)n∈N(f_n)_{n\in\mathbf{N}} be a Cauchy sequence in Fπp(G)\mathscr{F}_{\pi}^p(G). There exists a strictly increasing sequence of integers (nk)k∈N(n_k)_{k\in\mathbf{N}} such that Np(fnk+1−fnk)⩽2−kN_p(f_{n_{k+1}}-f_{n_k})\leqslant 2^{-k} for every k∈Nk\in \mathbf{N}. For every k∈Nk\in \mathbf{N}, put hkh_k = fnk+1−fnk∈Fπp(G)f_{n_{k+1}}-f_{n_k}\in \mathscr{F}_{\pi}^p(G). By a), the series with general term hkh_k converges in Fπp(G)\mathscr{F}_{\pi}^p(G); let hh denote its sum. For every ℓ∈N\ell \in \mathbf{N}, we obtain

fn0+∑k=0ℓhk=fnℓ+1 f_{n_0}+\sum_{k=0}^{\ell}h_k=f_{n_{\ell+1}}

hence fn0+hf_{n_0}+h is a cluster value of the sequence (fn)(f_n). It therefore converges (TG, II, p. 14, cor. 2 of prop. 5). Thus the space Fπp(G)\mathscr{F}_{\pi}^p(G) is complete; since the space Lπp(G)\mathscr{L}_{\pi}^p(G) is closed in Fπp\mathscr{F}_{\pi}^p(G), it is likewise complete.

Corollary 03AH

Let (fn)n∈N(f_n)_{n\in\mathbf{N}} be a Cauchy sequence in Lπp(G)\mathscr{L}_{\pi}^p(G) and let f∈Fπ(G)f\in \mathscr{F}_{\pi}(G) be such that fn(g)f_n(g) converges to f(g)f(g) almost everywhere modulo H. Then f∈Lπp(G)f\in \mathscr{L}_{\pi}^p(G) and (fn)n∈N(f_n)_{n\in\mathbf{N}} converges to ff in Lπp(G)\mathscr{L}_{\pi}^p(G).

In fact, the function ff coincides almost everywhere modulo H with the limit of the sequence (fn)(f_n) in Lπp(G)\mathscr{L}_{\pi}^p(G).

We denote by Lπp(G)L^p_{\pi}(G) the associated separated normed topological vector space of the semi-normed space Lπp(G)\mathscr{L}_{\pi}^p(G); it is a Banach space.

Let ff be a function on G with values in E. Denote by SfS_f the set of x∈Gx\in G such that the function h↦f(xh)h\mapsto f(xh) on H does not belong to LE1(H)\mathscr{L}_E^1(H). One has Sf⋅h=SfS_f\cdot h= S_f for every h∈Hh\in H.

Let x∈x\in G - SfS_f. Since π\pi is a unitary representation, the function h↦π(h)∗f(xh)h\mapsto \pi (h)^*f(xh) is measurable (as the composition of the mapping h↦(h,f(xh))h\mapsto (h, f(xh)) of H into H×EH\times E, which is then measurable, and of the continuous mapping (g,x)↦π(g)∗x(g, x)\mapsto \pi (g)^*x of H×EH\times E into E, cf. INT, IV, p. 174, § 5, no3^o3, Th. 1), and it is integrable on H.

One defines a function fπf^{\pi} on G by putting

fπ(x)=∫Hπ(h)∗f(xh)dβ(h)(3) f^{\pi}(x) =\int_H\pi (h)^*f(xh)d\beta (h) \tag{3}

for x∈Gx\in G - SfS_f and fπ(x)=0f^{\pi}(x) = 0 if x∈Sfx\in S_f.

Proposition 4 03AI

Let f∈LE1(G)f\in \mathscr{L}_E^1(G).

a) The set SfS_f is negligible modulo H and fπ∈Fπ(G)f^{\pi}\in \mathscr{F}_{\pi}(G);

b) Let C be a compact subset of G. If ff is continuous and has support contained in C, then SfS_f is empty, the function fπf^{\pi} belongs to Kπ(G)\mathscr{K}_{\pi}(G) and its support is contained in C⋅HC\cdot H.

The first part of a) follows from INT, VII, p. 57, § 2, no5^o5, c). Let w∈Hw\in H. If x∈Gx\in G - SfS_f, then xw∈Gxw\in G - SfS_f and

fπ(xw)=∫Hπ(h)∗f(xwh)dβ(h) f^{\pi}(xw) =\int_H\pi (h)^*f(xwh)d\beta (h)
=∫Hπ(w−1y)∗f(xy)dβ(y)=π(w)fπ(x) =\int_H\pi (w^{-1}y)^*f(xy)d\beta (y) =\pi (w)f^{\pi}(x)

whereas if x∈Sfx\in S_f, then fπ(xw)=0=π(w)∗fπ(x)f^{\pi}(xw) = 0 =\pi (w)^*f^{\pi}(x). The function fπf^{\pi} therefore belongs to Fπ(G)\mathscr{F}_{\pi}(G).

Suppose now that ff is continuous and has support contained in C. For every x∈Gx\in G, the mapping h↦f(xh)h\mapsto f(xh) then belongs to K\mathscr{K} (H), hence is integrable, which proves that Sf=∅S_f=\emptyset.

Let us prove that fπf^{\pi} is continuous. Let x∈Gx\in G. Let U be a relatively compact open neighbourhood of xx in G.

For every y∈Uy\in U, one has

∥fπ(y)−fπ(x)∥⩽∫H∥f(yh)−f(xh)∥dβ(h) \|f^{\pi}(y)-f^{\pi}(x)\|\leqslant \int_H\|f(yh)-f(xh)\|d\beta (h)
=∫∥f(yh)−f(xh)∥dβ(h) =\int\|f(yh)-f(xh)\|d\beta (h)
H∩(y−1C∪x−1C)H\cap (y^{-1}C\cup x^{-1}C)

⩽β(H∩U−1C)\leqslant \beta (H\cap U^{-1}C) suph∈U−1C∥f(yh)−f(xh)∥_{h\in U^{-1}C}\|f(yh)-f(xh)\|,

and the continuity of fπf^{\pi} then follows from the uniform continuity of ff on G.

Finally, if x∈Gx\in G satisfies fπ(x)≠0f^{\pi}(x)\not = 0, there exists h∈Hh\in H such that f(xh)≠0f(xh)\not = 0; thus xhxh belong to C and xx belong to C⋅HC\cdot H. Since C⋅HC\cdot H is closed in G, one concludes that the support of fπf^{\pi} is contained in C⋅HC\cdot H.

Let C be a compact subset of G. Let u∈K+(G)u\in \mathscr{K}_+(G) be a function such that u(x)>0u(x)>0 for every x∈Cx\in C. Let vv be the function on G defined by

v(x)=∫Hu(xh)dβ(h)(4) v(x) =\int_Hu(xh)d\beta (h) \tag{4}

for every x∈Gx\in G; with the preceding notation, one has v=u1v=u^1, corresponding to the trivial representation of dimension 1 of H. The function vv is continuous and positive; it belong to F1\mathscr{F}_1(G), its support is contained in Supp(uu)⋅H\cdot H and one has

(5) xxinfC⋅H∈v(x)>0^{\in}_{C\cdot H}v(x)>0

(INT, VII, p. 39–40, § 2, no1^o1, prop. 1 and lemma 1, a)).

Lemma 5 03AJ

Let f∈Fπ(G)f\in \mathscr{F}_{\pi}(G) be a μ\mu-measurable function equal to zero outside C⋅HC\cdot H such that the function ∥f∥\|f\| is ν\nu-integrable on G/HG/H. Let ss be the E-valued function on G such that

v(x)−1f(x)v(x)^{-1}f(x) if x∈C⋅Hx\in C\cdot H

s(x)= s(x) =

0 if x∈Gx\in G - C⋅HC\cdot H.

a) The function ss is μ\mu-measurable; it belong to Fπ(G)\mathscr{F}_{\pi}(G) and is equal to zero outside C⋅HC\cdot H;

b) The function usus belong to L1(G)\mathscr{L}^1(G) and (us)π=f(us)^{\pi}=f almost everywhere modulo H.

The function ss is equal to zero outside C⋅HC\cdot H by definition; it is μ\mu-measurable since the function ff is μ\mu-measurable and v(x)>0v(x)>0 for every x∈C⋅Hx\in C\cdot H (INT, IV, p. 193, § 5, no10^o10, prop. 16). One has s∈Fπ(G)s\in \mathscr{F}_{\pi}(G) because v∈F1(G)v\in \mathscr{F}_1(G).

The function ff is locally μ\mu-integrable, since ∥f∥\|f\| is a ν\nu-integrable function (INT, VII, p. 47, § 2, No.o3^o3, prop. 6, c), noting that the measure ν♯=κ⋅μ\nu^{\sharp}=\kappa \cdot \mu is equivalent to μ)\mu), hence the function ss is also so by formula (5). The function usus is measurable and zero outside a compact subset of G; since uu is bounded, it follows that usus is μ\mu-integrable.

For all x∈Gx\in G - SusS_{us}, we have

(us)π(x)=∫Hπ(h)∗(u(xh)s(xh))dβ(h) (us)^{\pi}(x) =\int_H\pi (h)^*(u(xh)s(xh))d\beta (h)
=∫Hu(xh)s(x)dβ(h)=v(x)s(x) =\int_Hu(xh)s(x)d\beta (h) =v(x)s(x)

since s(xh)=π(h)s(x)s(xh) =\pi (h)s(x); the last assertion follows from prop. 4, a).

When H={e}H =\{e\} and π\pi is of dimension 1, the following proposition is none other than INT, IV, p. 184, § 5, No.o6^o6, th. 5.

Proposition 5 03AK

Let p∈[1,+∞[p\in [1,+\infty [. The space Lπp(G)\mathscr{L}_{\pi}^p(G) is the space of functions f∈Fπ(G)f\in \mathscr{F}_{\pi}(G) such that ff is μ\mu-measurable and the function ∥f∥\|f\| belong to Lp(G/H)\mathscr{L}^p(G/H).

Let f∈Lπp(G)f\in \mathscr{L}_{\pi}^p(G). It is the limit in Lπp(G)\mathscr{L}_{\pi}^p(G) of a sequence of elements of Kπ(G)\mathscr{K}_{\pi}(G). By prop. 3, b) and Egoroff's theorem (INT, IV, p. 175, § 5, No.o4^o4, th. 2), the function ff is therefore μ\mu-measurable; consequently, the function ∥f∥\|f\| on G/HG/H is ν\nu-measurable (INT, VII, p. 47, § 2, No.o3^o3, prop. 6, b)). Since Np(f)N_p(f) is finite, the function ∥f∥\|f\| belong to Lp(G/H)\mathscr{L}^p(G/H) (INT, IV, p. 184, § 5, No.o6^o6, th. 5).

Let us prove the converse assertion. Let ff be a μ\mu-measurable function belonging to Fπ(G)\mathscr{F}_{\pi}(G) such that ∥f∥∈Lp(G/H)\|f\| \in \mathscr{L}^p(G/H). Let ε>0\varepsilon >0. Let us prove that there exists f~∈Kπ(G)\widetilde{f}\in \mathscr{K}_{\pi}(G) such that

Np(f−f~)p=∫G/H∗∥f−f~∥pdν⩽ε N_p(f-\widetilde{f})^p=\int_{G/H}^*\|f-\widetilde{f}\|^pd\nu \leqslant \varepsilon

which will conclude the proof.

Suppose first that there exists a compact subset C of G such that ff is zero outside C⋅HC\cdot H. Let u∈K+(G)u\in \mathscr{K}_+(G) be a function such that u(x)>0u(x)>0 for all x∈Cx\in C and define v=u1v=u^1 as above. Let us denote by φ\varphi the characteristic function of the support of uu.

Let qq be the conjugate exponent of pp. If p=1p= 1, let ww be the constant function on G equal to supx∈Gu(x)_{x\in G}u(x). If p>1p >1, define

w(x)=(∫Hu(xh)q dβ(h))1/q w(x)=\left(\int_Hu(xh)^q\,d\beta(h)\right)^{1/q}

for every x∈Gx\in G. In both cases, the function ww is continuous and positive; it belongs to K1(G)\mathscr{K}_1(G) (Prop. 4 applied to the trivial representation of dimension 1 and to the function uqu^q), hence it is bounded on G. Put W = supx∈Gw(x)_{x\in G}w(x).

Let ss be the function on G with values in E defined by Lemma 5 applied to ff. Put g=φsg=\varphi s. The function gg is μ\mu-measurable, and satisfies ∥g∥⩽∥f∥/\|g\|\leqslant \|f\|/ infx∈C⋅Hv(x)_{x\in C\cdot H}v(x). Since gg vanishes outside the support of uu and κ\kappa is continuous, we have g∈LEp(G,κ⋅μ)g\in \mathscr{L}_E^p(G, \kappa \cdot \mu). Let g~\widetilde{g} be a function in KE(G)\mathscr{K}_E(G) such that

∫∗∥g−g~∥pκdμ⩽εp \int^*\|g-\widetilde{g}\|^p\kappa d\mu\leqslant \varepsilon_p

G_G W

We have us=ugus=ug, hence f=(us)π=(ug)πf= (us)^{\pi}= (ug)^{\pi} almost everywhere modulo H (Lemma 5, b)). Let f~=(ug~)π\widetilde{f}= (u\widetilde{g})^{\pi}; we have f~∈Kπ(G)\widetilde{f}\in \mathscr{K}_{\pi}(G) (Prop. 4, b)). For every x∈Gx\in G - SugS_{ug}, we obtain

∥(ug)π(x)−(ug~)π(x)∥⩽∫H∗u(xh)∥g(xh)−g~(xh)∥dβ(h) \|(ug)^{\pi}(x)-(u\widetilde{g})^{\pi}(x)\|\leqslant \int_H^*u(xh)\|g(xh)-\widetilde{g}(xh)\|d\beta (h)

whence

∥(ug)π(x)−(ug~)π(x)∥p⩽w(x)p∫H∗∥g(xh)−g~(xh)∥pdβ(h) \|(ug)^{\pi}(x)-(u\widetilde{g})^{\pi}(x)\|^p\leqslant w(x)^p\int_H^*\|g(xh)-\widetilde{g}(xh)\|^pd\beta (h)

by Hölder's inequality in the case p>1p >1. Since SugS_{ug} is negligible modulo H, it follows that

∫G/H∗∥f−f~∥pdν⩽Wp∫G/H∗(∫H∗∥g(xh)−g~(xh)∥dβ(h))pdν(xH) \int_{G/H}^*\|f-\widetilde{f}\|^pd\nu \leqslant W^p\int_{G/H}^*(\int_H^*\|g(xh)-\widetilde{g}(xh)\|d\beta (h))^pd\nu (xH)
=Wp∫G∗∥g−g~∥pκdμ⩽ε = W^p\int_G^*\|g-\widetilde{g}\|^p\kappa d\mu\leqslant \varepsilon

by INT, VII, p. 46, § 2, no3^o3, Prop. 5, b), which is applicable since g−g~g-\widetilde{g} vanishes outside a compact subset of G. This implies the required property when ff vanishes outside a compact subset modulo H.

Consider now the general case. Since ∥f∥∈Lp(G/H)\|f\| \in \mathscr{L}^p(G/H) by hypothesis, there exists a compact subset L of G/HG/H such that

∫∗pε \int^*p\varepsilon
∥f∥dν⩽ \|f\|d\nu \leqslant

(G/H)−L(G/H)-L 2

(cf. INT, IV, p. 152, § 4, no6^o6, th. 4). Let φL\varphi_L be the characteristic function of L and put fL=(φL∘ϖ)ff_L= (\varphi_L\circ \varpi )f. We have

∫∗p∫∗pε \int^*p\int^*p\varepsilon
∥f−fL∥dν=∥f∥dν⩽ \|f-f_L\|d\nu =\|f\|d\nu \leqslant

G/H(G/H)−LG/H(G/H)-L 2

The function fLf_L is μ\mu-measurable and vanishes outside a compact set modulo H. It belongs to Lπp\mathscr{L}_{\pi}^p(G), hence by the preceding case, there exists f~∈Kπ(G)\widetilde{f}\in \mathscr{K}_{\pi}(G) such that Np(fL−f~)⩽(ε2)1/pN_p(f_L-\widetilde{f})\leqslant (\frac{\varepsilon}{2})^{1/p}, whence

∫G/H∗∥f−f~∥pdν⩽ε \int_{G/H}^*\|f-\widetilde{f}\|^pd\nu \leqslant \varepsilon

as desired.

Let us consider the case p=2p= 2. For f1f_1 and f2f_2 in Fπ\mathscr{F}_{\pi}(G), the function x↦⟨f1(x)∣f2(x)⟩x\mapsto \langle f_1(x)|f_2(x)\rangle belongs to F1(G)\mathscr{F}_1(G) since the representation π\pi is unitary, and therefore defines by passing to the quotient a function on G/HG/H, which is identified as above with ⟨f1∣f2⟩\langle f_1|f_2\rangle. One has the majorization ∣⟨f1∣f2⟩∣⩽∥f1∥∥f2∥|\langle f_1|f_2\rangle |\leqslant \|f_1\|\|f_2\| in F(G/H)\mathscr{F}(G/H).

If f1f_1 and f2f_2 belong to Lπ2\mathscr{L}_{\pi}^2(G), then the function ⟨f1∣f2⟩\langle f_1|f_2\rangle belongs to L11(G)\mathscr{L}_1^1(G). In particular, it is integrable on G/HG/H. The mapping

(f1,f2)↦∫G/H⟨f1∣f2⟩dν (f_1, f_2)\mapsto \int_{G/H}\langle f_1|f_2\rangle d\nu

is a positive Hermitian form on Lπ2(G)\mathscr{L}_{\pi}^2(G); the associated seminorm is the seminorm N2N_2. In particular, the space Lπ2(G)\mathscr{L}_{\pi}^2(G) is a prehilbertian space and Lπ2(G)L^2_{\pi}(G) is the Hilbert space associated with Lπ2(G)\mathscr{L}_{\pi}^2(G).

6. Induced representations

We retain the notations and conventions of the preceding number concerning the measures β\beta on H and ν\nu on G/HG/H, as well as the function κ:G→R+∗\kappa : G\rightarrow \mathbf{R}^*_+.

There exists a continuous function η\eta of G×G/HG\times G/H into R+∗\mathbf{R}_+^* such that

η(x,yH)=κ(xy)κ(x) \eta (x, yH) =\frac{\kappa(xy)}{\kappa(x)}

for every (x,y)∈G×G(x, y)\in G\times G, and γG/H(x)ν=(y↦η(x−1,y))⋅ν\boldsymbol{\gamma }_{G/H}(x)\nu = (y\mapsto \eta (x^{-1}, y))\cdot \nu for x∈Gx\in G (INT, VII, p. 56, § 2, no5^o5, th. 2, c)).

Let p∈[1,+∞[p\in [1,+\infty [ and let π\pi be a unitary representation of H in a complex Hilbert space E.

Lemma 6 03AL

Let f∈Kπ‾(G)f\in \mathscr{K}_{\overline{\pi}}(G). For every g∈Gg\in G, the function

f~:x↦η(g−1,xH)1/pf(g−1x) \widetilde{f}:x\mapsto \eta (g^{-1}, xH)^{1/p}f(g^{-1}x)

of G into E belongs to Kπ‾(G)\mathscr{K}_{\overline{\pi}}(G) and satisfies Np(f~)=Np(f)N_p(\widetilde{f}) = N_p(f).

It is verified without difficulty that f~∈Kπ‾(G)\widetilde{f}\in \mathscr{K}_{\overline{\pi}}(G). Since

Np(f~)p=∫G/H∗∥f~∥pdν=∫G/H∗γG/H(g)(∥f∥p)(y)η(g−1,y)dν(y) N_p(\widetilde{f})^p=\int_{G/H}^*\|\widetilde{f}\|^pd\nu =\int_{G/H}^*\gamma_{G/H}(g)(\|f\|^p)(y)\eta (g^{-1}, y)d\nu (y)

and since (y↦η(g−1,y))⋅ν=γG/H(g)ν(y\mapsto \eta (g^{-1}, y))\cdot \nu =\boldsymbol{\gamma }_{G/H}(g)\nu, one obtains Np(f~)=Np(f)N_p(\widetilde{f}) = N_p(f).

It follows from this lemma that there exists a continuous isometric representation π~\widetilde{\pi} of G in Lπ‾p(G)L^p_{\overline{\pi}}(G) such that for f∈Kπ(G)f\in \mathscr{K}_{\pi}(G) and g∈Gg\in G, the element π~(g)f\widetilde{\pi}(g)f is the class of the function f~\widetilde{f} defined above. If p=2p= 2, then this representation is unitary.

Definition 2 03AM

One says that the unitary representation of G in the space Lπ‾2(G)L^2_{\overline{\pi}}(G) thus defined is the unitary representation of G induced by the representation π\pi of H relative to κ\kappa. It is denoted by IndHG(π,κ)^G_H(\pi , \kappa ), or simply IndHG(π)^G_H(\pi ).

Remark 1 03AN

Let ϱ\varrho be a unitary representation of H in a complex Hilbert space F and let u:π→ϱu:\pi \rightarrow \varrho be an H-morphism. For every function f∈Kπ‾f\in \mathscr{K}_{\overline{\pi}}(G), let v(f)v(f) denote the function g↦u(f(g))g\mapsto u(f(g)) from G into F; it belongs to Kϱ‾(G)\mathscr{K}_{\overline{\varrho}}(G) and satisfies Np(v(f))⩽∥u∥Np(f)N_p(v(f))\leqslant \|u\|N_p(f). The linear mapping from Kπ‾(G)\mathscr{K}_{\overline{\pi}}(G) into Kϱ‾(G)\mathscr{K}_{\overline{\varrho}}(G) which associates v(f)v(f) with ff therefore extends to a continuous H-morphism from IndHG(π)^G_H(\pi ) into IndHG(ϱ)^G_H(\varrho ) which is denoted by IndHG(u)^G_H(u). We have IndHG(1π)=1IndHG(π)^G_H(1_{\pi}) = 1_{Ind^G_H(\pi)}. Let σ\sigma be a unitary representation of H and let v:ϱ→σv:\varrho \rightarrow \sigma be an H-morphism; we have IndHG(v∘u)=^G_H(v\circ u) = IndHG(v)∘^G_H(v)\circ IndHG(u)^G_H(u).

In other words, the construction which associates IndHG(π)^G_H(\pi ) with π\pi and IndHG(u)^G_H(u) with uu is a functor from the category of unitary representations of H into that of unitary representations of G (cf. CAT, I, § 2, in preparation).

Remark 2 03AO

Let κ′:G→R+∗\kappa ': G\rightarrow \mathbf{R}_+^* be such that

κ′(xh)κ′(x)=ΔH(h)ΔG(h)=κ(xh)κ(x) \frac{\kappa'(xh)}{\kappa'(x)}=\frac{\Delta_H(h)}{\Delta_G(h)}=\frac{\kappa(xh)}{\kappa(x)}

for every (x,h)∈G×H(x, h)\in G\times H. Let ν′\nu ' be the quasi-invariant measure (κ′⋅μ)/β(\kappa '\cdot \mu)/\beta on G/HG/H. The function κ′κ−1\kappa '\kappa^{-1} defines, by passing to quotients, a continuous function ξ:G/H→R+∗\xi : G/H\rightarrow \mathbf{R}_+^* such that ν′=ξ⋅ν\nu '=\xi \cdot \nu. The endomorphism α\alpha of Kπ(G)\mathscr{K}_{\pi}(G) defined by f↦(κ′κ−1)1/pff\mapsto (\kappa '\kappa^{-1})^{1/p}f satisfies

∫G/H∗∥f∥pdν′=∫G/H∗∥α(f)∥pdν \int_{G/H}^*\|f\|^pd\nu '=\int_{G/H}^*\|\alpha (f)\|^pd\nu

and makes it possible to identify the spaces Lπp(G,ν′)\mathscr{L}_{\pi}^p(G, \nu ') and Lπp(G,ν)\mathscr{L}_{\pi}^p(G, \nu ), as well as the spaces Lπp(G,ν′)L^p_{\pi}(G, \nu ') and Lπp(G,ν)L^p_{\pi}(G, \nu ). Moreover, α\alpha induces an isometric isomorphism of the representations IndHG(π,κ′)^G_H(\pi , \kappa ') and IndHG(π,κ)^G_H(\pi , \kappa ).

7. Case of a central closed subgroup

In this No., it is assumed that the group G is unimodular.

Consider a closed subgroup Z of the center of G, and let dzdz denote a Haar measure on Z. The quotient group G/ZG/Z is endowed with the Haar measure ν=μ/dz\nu =\mu/dz. Let χ\chi be a unitary character of Z. The quotient group G/ZG/Z is unimodular by INT, VII, p. 61, § 2, no7^o7, cor. of prop. 11.

Lemma 7 03AP

We have

N1(fˇ)=N1(f),⟨f1∣f2⟩=⟨fˇ1∣fˇ2⟩(6) N_1(\check{f}) = N_1(f),\langle f_1|f_2\rangle =\langle \check{f}_1|\check{f}_2\rangle \tag{6}

for every f∈Fχ(G)f\in \mathscr{F}_{\chi}(G) and all f1f_1 and f2f_2 in Lχ2(G)\mathscr{L}_{\chi}^2(G).

These formulas are consequences of the definitions.

For every g∈Gg\in G and every f∈Fχf\in \mathscr{F}_{\chi}(G), the functions x↦f(g−1x)x\mapsto f(g^{-1}x) and x↦f(xg)x\mapsto f(xg) belong to Fχ(G)\mathscr{F}_{\chi}(G). They are denoted respectively by γG,χ(g)f\boldsymbol{\gamma }_{G,\chi}(g)f and δG,χ(g)f\boldsymbol{\delta }_{G,\chi}(g)f. The mappings γG,χ\boldsymbol{\gamma }_{G,\chi} and δG,χ\boldsymbol{\delta }_{G,\chi} are linear representations of G in Fχ(G)\mathscr{F}_{\chi}(G). For every z∈Zz\in Z, one has

γG,χ(gz)=χ(z)‾γG,χ(g),δG,χ(gz)=χ(z)δG,χ(g)(7) \boldsymbol{\gamma }_{G,\chi}(gz) =\overline{\chi(z)}\boldsymbol{\gamma }_{G,\chi}(g),\boldsymbol{\delta }_{G,\chi}(gz) =\chi (z)\boldsymbol{\delta }_{G,\chi}(g) \tag{7}

Let f∈Fχ(G)f\in \mathscr{F}_{\chi}(G) and g∈Gg\in G; one has

∣γG,χ(g)f∣=γG/Z(gZ)∣f∣,∣δG,χ(g)f∣=δG/Z(gZ)∣f∣(8) |\boldsymbol{\gamma }_{G,\chi}(g)f|=\boldsymbol{\gamma }_{G/Z}(gZ)|f|,|\boldsymbol{\delta }_{G,\chi}(g)f|=\boldsymbol{\delta }_{G/Z}(gZ)|f| \tag{8}

where all the functions occurring in these equalities are identified with functions on G/ZG/Z.

The subspace Kχ(G)\mathscr{K}_{\chi}(G) of Fχ(G)\mathscr{F}_{\chi}(G) is stable under γG,χ\boldsymbol{\gamma }_{G,\chi} and δG,χ\boldsymbol{\delta }_{G,\chi}. Let pp be a real number ⩾1\geqslant 1. Formulae (8) imply that the representations γG,χ\boldsymbol{\gamma }_{G,\chi} and δG,χ\boldsymbol{\delta }_{G,\chi}, restricted to Kχ\mathscr{K}_{\chi}(G), extend to continuous isometric linear representations of G in Lχp\mathscr{L}_{\chi}^p(G), which will be denoted by γG,χ(p)\boldsymbol{\gamma }^{(p)}_{G,\chi} and δG,χ(p)\boldsymbol{\delta }^{(p)}_{G,\chi}. By passing to quotients, these representations also define isometric representations of G in LχpL^p_{\chi}(G), denoted in the same way.

The representations γG,χ(2)\boldsymbol{\gamma }^{(2)}_{G,\chi} and δG,χ(2)\boldsymbol{\delta }^{(2)}_{G,\chi} in Lχ2(G)L_{\chi}^2(G) are unitary, and will be denoted simply by γG,χ\boldsymbol{\gamma }_{G,\chi} and δG,χ\boldsymbol{\delta }_{G,\chi}, respectively, whenever no confusion with the representations in Fχ(G)\mathscr{F}_{\chi}(G) is possible. One also denotes by ϱG,χ\boldsymbol{\varrho }_{G,\chi} the continuous representation of G×GG\times G in Lχ2(G)\mathscr{L}_{\chi}^2(G) or Lχ2(G)L^2_{\chi}(G) defined by

ϱG,χ(g,h)=γG,χ(g)∘δG,χ(h)=δG,χ(h)∘γG,χ(g) \boldsymbol{\varrho }_{G,\chi}(g, h) =\boldsymbol{\gamma }_{G,\chi}(g)\circ \boldsymbol{\delta }_{G,\chi}(h) =\boldsymbol{\delta }_{G,\chi}(h)\circ \boldsymbol{\gamma }_{G,\chi}(g)

for every (g,h)∈G×G((g, h)\in G\times G (cf. Lemma 1 of V, p. 377).

The representation γG,χ\boldsymbol{\gamma }_{G,\chi} on Lχ2(G)L^2_{\chi}(G) is none other than the induced representation IndZG(χ‾)^G_Z(\overline{\chi}).

When Z={e}Z =\{e\}, the following lemma results from INT, VIII, p. 166, § 4, no5^o5, Prop. 12, since G is unimodular.

Lemma 8 03AQ

Let f1∈Kχ(G)f_1\in \mathscr{K}_{\chi}(G) and f2∈Lχ2(G)f_2\in \mathscr{L}_{\chi}^2(G).

a) The function ff on G defined by f(g)=⟨f1∣γG,χ(g)f2⟩f(g) =\langle f_1|\boldsymbol{\gamma }_{G,\chi}(g)f_2\rangle for every g∈Gg\in G belong to Lχ‾2(G)\mathscr{L}_{\overline{\chi}}^2(G) and satisfies N2(f)⩽N1(f1)N2(f2)N_2(f)\leqslant N_1(f_1)N_2(f_2);

b) The function ff on G defined by f(g)=⟨f1∣δG,χ(g)f2⟩f(g) =\langle f_1|\boldsymbol{\delta }_{G,\chi}(g)f_2\rangle for every g∈Gg\in G belong to Lχ2(G)\mathscr{L}_{\chi}^2(G) and satisfies N2(f)⩽N1(f1)N2(f2)N_2(f)\leqslant N_1(f_1)N_2(f_2).

Let us prove a), the proof of assertion b) being similar. The function ff is continuous, hence μ\mu-measurable. For every z∈Zz\in Z and every g∈Gg\in G, we have

f(gz)=⟨f1∣γG,χ(gz)f2⟩=χ(z)‾⟨f1∣γG,χ(g)f2⟩ f(gz) =\langle f_1|\boldsymbol{\gamma }_{G,\chi}(gz)f_2\rangle =\overline{\chi(z)}\langle f_1|\boldsymbol{\gamma }_{G,\chi}(g)f_2\rangle

(formula (7), p. 417), hence f∈Fχ‾(G)f\in \mathscr{F}_{\overline{\chi}}(G). Prop. 5 of V, p. 413 implies that it now suffices to prove that N2(f)⩽N1(f1)N2(f2)N_2(f)\leqslant N_1(f_1)N_2(f_2).

Suppose first that f2f_2 belongs to Kχ(G)\mathscr{K}_{\chi}(G). For every g∈Gg\in G, by definition we have

f(g)=∫G/Zf1‾γG,χ(g)f2dν f(g) =\int_{G/Z}\overline{f_1}\boldsymbol{\gamma }_{G,\chi}(g)f_2d\nu

where the function f1‾γG,χ(g)f2\overline{f_1}\boldsymbol{\gamma }_{G,\chi}(g)f_2 is identified with a function on G/ZG/Z.

Define a function f3f_3 on G by putting f3(g)=0f_3(g) = 0 if f1(g)=0f_1(g) = 0 and f3(g)=f1(g)∣f1(g)∣−1/2f_3(g) =f_1(g)|f_1(g)|^{-1/2} otherwise. The function f3f_3 belongs to Fχ(G)\mathscr{F}_{\chi}(G) and satisfies f1=∣f1∣1/2f3f_1=|f_1|^{1/2}f_3; it is μ\mu-measurable and zero outside a compact modulo Z, since f1f_1 is. Since ∣f1∣1/2∈K1|f_1|^{1/2}\in \mathscr{K}_1(G), it follows that

f1‾γG,χ(g)f2=∣f1∣1/2f3‾γG,χ(g)f2 \overline{f_1}\boldsymbol{\gamma }_{G,\chi}(g)f_2=|f_1|^{1/2}\overline{f_3}\boldsymbol{\gamma }_{G,\chi}(g)f_2
∣f3‾γG,χ(g)f2∣=∣f3∣∣γG,χ(g)f2∣ |\overline{f_3}\boldsymbol{\gamma }_{G,\chi}(g)f_2|=|f_3| |\boldsymbol{\gamma }_{G,\chi}(g)f_2|

for every g∈Gg\in G.

Let g∈Gg\in G. By the Cauchy-Schwarz inequality, we have

∣f(g)∣2⩽(∫G/Z∣f1∣1/2∣f3∣∣γG,χ(g)f2∣dν)2 |f(g)|^2\leqslant (\int_{G/Z}|f_1|^{1/2}|f_3| |\boldsymbol{\gamma }_{G,\chi}(g)f_2|d\nu )^2
⩽(∫G/Z∣f1∣dν)(∫G/Z∣f3∣2∣γG,χ(g)f2∣2dν) \leqslant (\int_{G/Z}|f_1|d\nu )(\int_{G/Z}|f_3|^2|\boldsymbol{\gamma }_{G,\chi}(g)f_2|^2d\nu )

Since we have ∣f3∣2=∣f1∣|f_3|^2=|f_1| in K(G/Z)\mathscr{K}(G/Z), it follows, on integrating over G/ZG/Z, that

∫G/Z∣f(g)∣2dν(g)⩽N1(f1)∫G/Z(∫G/Z∣f1(x)∣∣f2(g−1x)∣2dν(x))dν(g) \int_{G/Z}|f(g)|^2d\nu (g)\leqslant N_1(f_1)\int_{G/Z}(\int_{G/Z}|f_1(x)| |f_2(g^{-1}x)|^2d\nu (x))d\nu (g)

The function on G/Z×G/ZG/Z\times G/Z deduced from the function

(g,x)↦∣f1(x)∣∣f2(g−1x)∣2 (g, x)\mapsto |f_1(x)| |f_2(g^{-1}x)|^2

by passing to quotients is (ν⊗ν(\nu \otimes \nu)-measurable and has compact support, hence it is (ν⊗ν(\nu \otimes \nu)-moderate (INT, V, p. 4, § 5, No.o2^o2, Def. 2). By Prop. 7 of INT, V, p. 93, § 8, No.o3^o3, it follows that

∫G/Z(∫G/Z∣f1(x)∣∣f2(g−1x)∣2dν(x))dν(g) \int_{G/Z}(\int_{G/Z}|f_1(x)| |f_2(g^{-1}x)|^2d\nu (x))d\nu (g)
=∫G/Z∣f1(x)∣(∫G/Z∣f2(g−1x)∣2dν(g))dν(x)=N1(f1)N2(f2)2 =\int_{G/Z}|f_1(x)|(\int_{G/Z}|f_2(g^{-1}x)|^2d\nu (g))d\nu (x) = N_1(f_1)N_2(f_2)^2

Consequently, we have N2(f)2⩽N1(f1)2N2(f2)2N_2(f)^2\leqslant N_1(f_1)^2N_2(f_2)^2, which establishes the required property in this case.

Let us consider the general case. Let uu denote the linear mapping of Kχ(G)\mathscr{K}_{\chi}(G) into Lχ‾2(G)\mathscr{L}_{\overline{\chi}}^2(G) which associates ff to f2f_2. Let f2∈Lχ2(G)f_2\in \mathscr{L}_{\chi}^2(G) and let (f2,n)n∈N(f_{2,n})_{n\in\mathbf{N}} be a sequence in Kχ(G)\mathscr{K}_{\chi}(G) converging to f2f_2 in Lχ2(G)\mathscr{L}_{\chi}^2(G). Let fn=u(f2,n)f_n=u(f_{2,n}); the sequence (fn)n∈N(f_n)_{n\in\mathbf{N}} is a Cauchy sequence in Lχ‾2(G)\mathscr{L}_{\overline{\chi}}^2(G) since the preceding case implies that N2(fn−fm)⩽N1(f1)N2(f2,n−f2,m)N_2(f_n-f_m)\leqslant N_1(f_1)N_2(f_{2,n}-f_{2,m}) for all nn and mm in N\mathbf{N}. Let f∈Lχ‾2(G)f\in \mathscr{L}_{\overline{\chi}}^2(G) be such that (fn)(f_n) converges to ff (Prop. 3, c) of V, p. 409). Since N2(fn)⩽N1(f1)N2(f2,n)N_2(f_n)\leqslant N_1(f_1)N_2(f_{2,n}) for every n∈Nn\in \mathbf{N}, it follows that N2(f)⩽N1(f1)N2(f2)N_2(f)\leqslant N_1(f_1)N_2(f_2).

There exists a subsequence (fnk)k∈N(f_{n_k})_{k\in\mathbf{N}} such that fnk(g)f_{n_k}(g) converges to f(g)f(g) for every g∈Gg\in G outside a subset of G negligible modulo Z (loc. cit., b)). But on the other hand, for every g∈Gg\in G, one has

fnk(g)=⟨f1∣γG,χ(g)f2,nk⟩→⟨f1∣γG,χ(g)f2⟩ f_{n_k}(g) =\langle f_1|\boldsymbol{\gamma }_{G,\chi}(g)f_{2,n_k}\rangle \rightarrow \langle f_1|\boldsymbol{\gamma }_{G,\chi}(g)f_2\rangle

Consequently, one has f(g)=⟨f1∣γG,χ(g)f2⟩f(g) =\langle f_1|\boldsymbol{\gamma }_{G,\chi}(g)f_2\rangle for every gg outside a subset of G negligible modulo Z. Since f∈Lχ‾2(G)f\in \mathscr{L}_{\overline{\chi}}^2(G) and N2(f)⩽N1(f1)N2(f2)N_2(f)\leqslant N_1(f_1)N_2(f_2), the lemma is proved.

8. Square-integrable representations

In this No., the Hilbert spaces considered are complex. It is assumed that G is unimodular, and C denotes its center. For every closed subgroup Z of C, let βZ\beta_Z denote a Haar measure on Z, and endow G/ZG/Z with the Haar measure νZ=μ/βZ\nu_Z=\mu/\beta_Z (INT, VII, p. 44, § 2, no2^o2, Def. 1).

Let π\pi be an irreducible unitary representation of G in a Hilbert space E, and let χ∈C^\chi \in \widehat{C} be its central character (Def. 6 of V, p. 390). For all xx and yy in E, let fx,yf_{x,y} denote the matrix coefficient g↦⟨x∣π(g)y⟩g\mapsto \langle x|\pi (g)y\rangle; this is a continuous complex-valued function on G.

Let xx and yy be in E. For z∈Cz\in C and g∈Gg\in G, one has

fx,y(zg)=⟨x∣π(zg)y⟩=⟨x∣χ(z)π(g)y⟩=χ(z)fx,y(g)(9) f_{x,y}(zg) =\langle x|\pi (zg)y\rangle =\langle x|\chi (z)\pi (g)y\rangle =\chi (z)f_{x,y}(g) \tag{9}

therefore fx,yf_{x,y} belong to the space Fχ(G)(\mathscr{F}_{\chi}(G) (V, p. 408). Moreover, for every (g1,h1)∈G×G(g_1, h_1)\in G\times G and every g∈Gg\in G, one has

fπ(g1)x,π(h1)y(g)=⟨π(g1)x∣π(g)π(h1)y⟩=fx,y(g1−1gh1)(10) f_{\pi(g_1)x,\pi(h_1)y}(g) =\langle \pi (g_1)x|\pi (g)\pi (h_1)y\rangle =f_{x,y}(g_1^{-1}gh_1) \tag{10}

Relation (9) justifies the following definition.

Definition 3 03AR

Let π\pi be an irreducible unitary representation of G in a Hilbert space E. One says that π\pi is square-integrable modulo the center if the function on G/CG/C deduced from the function ∣fx,y∣|f_{x,y}| by passing to the quotient belong to L2(G/C)\mathscr{L}^2(G/C) for every (x,y)∈E×E(x, y)\in E\times E.

This condition does not depend on the choice of a Haar measure on G/CG/C.

If the matrix coefficients of π\pi belong to L2\mathscr{L}^2(G), one says that π\pi is square-integrable; the existence of an irreducible unitary square-integrable representation of G implies that the center of G is compact (exercise 5 of V, p. 487).

There exist groups G which admit no square-integrable representation, even modulo the center (cf. exercise 32 of V, p. 516).

Proposition 6 03AS

Let π\pi be an irreducible unitary representation of G in a Hilbert space E. Let χ\chi be the central character of π\pi. Then π\pi is square-integrable modulo the center if and only if there exist non-zero elements x0x_0 and y0y_0 of E such that the function on G/CG/C deduced from ∣fx0,y0∣|f_{x_0,y_0}| by passing to the quotient belongs to L2(G/C)\mathscr{L}^2(G/C).

Suppose that there exist non-zero elements x0x_0 and y0y_0 of E such that ∣fx0,y0∣∈L2(G/C)|f_{x_0,y_0}| \in \mathscr{L}^2(G/C). It is enough to prove that π\pi is then square-integrable modulo the center.

Let F be the set of elements x∈Ex\in E such that ∣fx,y0∣|f_{x,y_0}| belongs to L2(G/C)\mathscr{L}^2(G/C). It is a vector subspace of E; it contains x0x_0, hence is non-zero. Relation (10) above implies that F is stable under π\pi; since the representation π\pi is irreducible, the space F is therefore dense in E.

Let x∈Fx\in F. Since fx,y0f_{x,y_0} belongs to Fχ(G)\mathscr{F}_{\chi}(G) and is μ\mu-measurable, and since ∣fx,y0∣∈L2(G/C)|f_{x,y_0}| \in \mathscr{L}^2(G/C), one has fx,y0∈Lχ2(G)f_{x,y_0}\in \mathscr{L}_{\chi}^2(G) (Prop. 5 of V, p. 413 applied to Z = C). Let uu denote the partial operator from E into Lχ2(G)L^2_{\chi}(G) whose domain is F and which associates to x∈Fx\in F the class of fx,y0f_{x,y_0} in Lχ2(G)L^2_{\chi}(G).

Let us prove that the partial operator uu is closed. Let (xn,u(xn))n∈N(x_n, u(x_n))_{n\in\mathbf{N}} be a sequence of elements of the graph of uu which converges in E×Lχ2(G)E\times L^2_{\chi}(G). Let xx be the limit of (xn)(x_n) and let f∈Lχ2(G)f\in \mathscr{L}_{\chi}^2(G) be a function whose class is the limit of the sequence (u(xn))(u(x_n)).

The function u(xn)u(x_n) is the class of the matrix coefficient fxn,y0f_{x_n,y_0}. For every g∈Gg\in G, one has

fxn,y0(g)=⟨xn∣π(g)y0⟩→⟨x∣π(g)y0⟩=fx,y0(g) f_{x_n,y_0}(g) =\langle x_n|\pi (g)y_0\rangle \rightarrow \langle x|\pi (g)y_0\rangle =f_{x,y_0}(g)

when n→+∞n\rightarrow +\infty. Hence fx,y0∈Lχ2(G)f_{x,y_0}\in \mathscr{L}_{\chi}^2(G) and f=fx0,yf=f_{x_0,y} almost everywhere modulo C (cor. of Prop. 3 of V, p. 409); this means that u(x)u(x) is the class of ff in Lχ2(G)L^2_{\chi}(G). Thus we have proved that uu is closed.

The domain F of uu is stable under π\pi, and relation (10) proves that uu satisfies u∘π(g)=γG,χ(g)∘uu\circ \pi (g) =\boldsymbol{\gamma }_{G,\chi}(g)\circ u for all g∈Gg\in G. Consequently one also has the equality u∗∘γG,χ(g)=π(g)∘u∗u^*\circ \boldsymbol{\gamma }_{G,\chi}(g) =\pi (g)\circ u^* for all g∈Gg\in G (lemma 6 of V, p. 381), whence (u∗∘u)∘π(g)=π(g)∘(u∗∘u)(u^*\circ u)\circ \pi (g) =\pi (g)\circ (u^*\circ u). Now the partial operator u∗∘uu^*\circ u is self-adjoint (prop. 12 of IV, p. 241), and in particular closed (prop. 7 of IV, p. 236), hence cor. 1 of V, p. 387 implies that the domain of u∗∘uu^*\circ u is equal to E. A fortiori, one has F = E, that is to say that the function ∣fx,y0∣|f_{x,y_0}| belongs to L2(G/C)\mathscr{L}^2(G/C) for all x∈Ex\in E.

Let (x,y)∈E×E(x, y)\in E\times E. One has fx,y0∈Lχ2(G)f_{x,y_0}\in \mathscr{L}_{\chi}^2(G). One proves mutatis mutandis, using the representation δG,χ\boldsymbol{\delta }_{G,\chi} instead of γG,χ\boldsymbol{\gamma }_{G,\chi}, that the set of y∈Ey\in E such that the function ∣fx,y∣|f_{x,y}| belongs to L2(G/C)\mathscr{L}^2(G/C) is equal to E. The proposition follows.

In the remainder of this No., we fix a closed subgroup Z of C such that C/ZC/Z is compact.

Lemma 9 03AT

Let π\pi be an irreducible unitary representation of G in a Hilbert space E which is square-integrable modulo the center. Let χ\chi be the restriction to Z of the central character of π\pi. For all xx and yy in E, one has fx,y∈Lχ2(G)f_{x,y}\in \mathscr{L}_{\chi}^2(G).

The function fx,yf_{x,y} is continuous, hence μ\mu-measurable. One has fx,y∈Fχ(G)f_{x,y}\in \mathscr{F}_{\chi}(G) by formula (9), p. 420. Moreover, by INT, VII, p. 64, § 2, No.o8^o8, cor. 1, c), one has N2(fx,y)<+∞N_2(f_{x,y})<+\infty since C/ZC/Z is compact and ∣fx,y∣∈L2(G/C)|f_{x,y}| \in \mathscr{L}^2(G/C). The assertion therefore follows from proposition 5 of V, p. 413.

Proposition 7 03AU

Let π\pi be an irreducible unitary representation of G in a Hilbert space E which is square-integrable modulo the center. Let χ\chi be the restriction to Z of the central character of π\pi.

There exist a real number c>0c >0 and a unique isometric (G×G)(G\times G)-morphism ww of the unitary representation π‾⊠π\overline{\pi}\boxtimes \pi into Lχ2(G)L^2_{\chi}(G) such that, for all (x,y)∈E‾×E(x, y)\in \overline{E}\times E, the element w(x⊗y)w(x\otimes y) is the class in Lχ2(G)L^2_{\chi}(G) of the function c1/2fx,yc^{1/2}f_{x,y}.

For all (x,y)∈E×E(x, y)\in E\times E, one has fx,y∈Lχ2(G)f_{x,y}\in \mathscr{L}_{\chi}^2(G) (lemma 9). Let vv denote the unique linear mapping of E‾⊗E\overline{E}\otimes E into Lχ2(G)L^2_{\chi}(G) such that v(x⊗y)v(x\otimes y) is the class of fx,yf_{x,y} for all (x,y)∈E×E(x, y)\in E\times E.

We shall prove below the following lemma.

Lemma 10 03AV

There exists a real number c>0c >0 such that the linear mapping w=c1/2vw=c^{1/2}v is isometric.

This lemma being assumed valid, let us remark that formula (10), p. 420, may be written

v(π‾(g1)x⊗π(h1)y)=ϱG,χ(g1,h1)v(x⊗y)(11) v(\overline{\pi}(g_1)x\otimes \pi (h_1)y) =\boldsymbol{\varrho }_{G,\chi}(g_1, h_1)v(x\otimes y) \tag{11}

for all (g1,h1)∈G×G(g_1, h_1)\in G\times G and all (x,y)∈E‾×E(x, y)\in \overline{E}\times E. The isometric linear mapping ww of E‾⊗E\overline{E}\otimes E into Lχ2(G)L^2_{\chi}(G) admits a continuous extension, still denoted by ww, to E⊗^2EE\widehat{\otimes}_2E. By continuity and linearity, formula (11) implies that ww is a (G×(G\times G)-morphism of π‾⊠π\overline{\pi}\boxtimes \pi into Lχ2L^2_{\chi}(G), which concludes the proof of the proposition.

Let us prove the lemma. For every x∈Ex\in E, let uxu_x denote the linear mapping y↦v(x⊗y)=fx,yy\mapsto v(x\otimes y) =f_{x,y} of E into Lχ2(G)L^2_{\chi}(G). We have ux∈u_x\in HomG(π,γG,χ)_G(\pi ,\boldsymbol{\gamma }_{G,\chi}) (formula (10)). By cor. 5 of V, p. 388, there exists a real number λx⩾0\lambda_x\geqslant 0 such that λxux\lambda_xu_x is isometric.

Let xx and yy be in E. We have

∥fx,y∥2=∫G/Zf‾x,yfx,ydνZ=∫G/Zfˇ‾x,yfˇx,ydνZ \|f_{x,y}\|^2=\int_{G/Z}\overline{f}_{x,y}f_{x,y}d\nu_Z=\int_{G/Z}\overline{\check{f}}_{x,y}\check{f}_{x,y}d\nu_Z

since G/ZG/Z is unimodular (lemma 7 of V, p. 417). Noting that fˇx,y=fy,x\check{f}_{x,y}=f_{y,x}, we obtain

λx∥y∥2=∥fx,y∥2=∫G/Zfy,xf‾y,xdνZ=∥fy,x∥2=λy∥x∥2 \lambda_x\|y\|^2=\|f_{x,y}\|^2=\int_{G/Z}f_{y,x}\overline{f}_{y,x}d\nu_Z=\|f_{y,x}\|^2=\lambda_y\|x\|^2

This means that the positive real number λx/∥x∥2\lambda_x/\|x\|^2 is independent of the choice of the nonzero element xx of E. It is strictly positive since, for every nonzero xx, the function fx,xf_{x,x} is continuous and takes the value ∥x∥2>0\|x\|^2>0 at ee, whence ∥ux(x)∥=∥fx,x∥>0\|u_x(x)\|=\|f_{x,x}\|>0. Let us denote this real number by c−1c^{-1}.

For every (x,y)∈E×E(x, y)\in E\times E, it follows that

∥v(x⊗y)∥2=∥fx,y∥2=λx∥y∥2=c−1∥x∥2∥y∥2=c−1∥x⊗y∥2 \|v(x\otimes y)\|^2=\|f_{x,y}\|^2=\lambda_x\|y\|^2=c^{-1}\|x\|^2\|y\|^2=c^{-1}\|x\otimes y\|^2

Using EVT, V, p. 29, cor. 1, we deduce that the linear mapping w=c1/2vw=c^{1/2}v of E‾⊗^2E\overline{E}\widehat{\otimes}_2E into Lχ2(G)L^2_{\chi}(G) is isometric, as required.

Corollary 03AW

Let π\pi be an irreducible unitary representation of G and let χ\chi be the restriction to Z of its central character. The representation π\pi is square-integrable modulo the center if and only if it is isomorphic to a subrepresentation of the representation γG,χ\boldsymbol{\gamma }_{G,\chi} of G in Lχ‾2(G)L^2_{\overline{\chi}}(G) (resp. of the representation δG,χ\boldsymbol{\delta }_{G,\chi} of G in Lχ2(G)L^2_{\chi}(G)).

Let us prove the assertion concerning γG,χ\boldsymbol{\gamma }_{G,\chi}, the second being proved in a similar way.

Suppose first that there exists a subrepresentation E of the representation γG,χ\boldsymbol{\gamma }_{G,\chi} isomorphic to π\pi. Since the space E is nonzero, there exists a function f1∈Kχ‾(G)f_1\in \mathscr{K}_{\overline{\chi}}(G) whose class f~1\widetilde{f}_1 is not orthogonal to E. We have f1∈Lχ‾1(G)f_1\in \mathscr{L}_{\overline{\chi}}^1(G). Let f~1,E\widetilde{f}_{1,E} denote the orthogonal projection of f~1\widetilde{f}_1 on E; it is a nonzero element of E. Let moreover f~2∈E\widetilde{f}_2\in E be nonzero. The mapping h:g↦⟨f~1,E∣γG,χ(g)f~2⟩h:g\mapsto \langle \widetilde{f}_{1,E}|\boldsymbol{\gamma }_{G,\chi}(g)\widetilde{f}_2\rangle is a matrix coefficient of π\pi. For every g∈Gg\in G, we have h(g)=⟨f~1∣γG,χ‾(g)f~2⟩h(g) =\langle \widetilde{f}_1|\boldsymbol{\gamma }_{G\overline{,\chi}}(g)\widetilde{f}_2\rangle since f~1−f~1,E\widetilde{f}_1-\widetilde{f}_{1,E} is orthogonal to E. By Lemma 8 of V, p. 418, the function hh belongs to Lχ2\mathscr{L}_{\chi}^2(G), hence Proposition 6 implies that π\pi is square-integrable modulo the center.

Conversely, suppose that π\pi is square-integrable modulo the center. Let x0∈Ex_0\in E be a nonzero vector. By Prop. 7 and formula (10), the mapping y↦fˇx0,yy\mapsto \check{f}_{x_0,y} is an injective G-morphism of π\pi into γG,χ\boldsymbol{\gamma }_{G,\chi}.

Definition 4 03AX

Let Z be a closed subgroup of C such that C/ZC/Z is compact. Let π\pi be an irreducible unitary representation of G which is square-integrable modulo the center. The unique real number c>0c >0 which satisfies the property of Proposition 7 is called the formal degree of π\pi relative to Z. It is denoted by cZ(π)c_Z(\pi ).

The formal degree depends on the choice of the Haar measure on Z. If the Haar measure βZ\beta_Z on Z is multiplied by a real number t>0t >0, then the measure νZ=μ/βZ\nu_Z=\mu/\beta_Z on G/ZG/Z is multiplied by t−1t^{-1}, and the formal degree of π\pi is multiplied by tt.

The formal degree is characterized by the following property:

Proposition 8 (Orthogonality relations) 03AY

Let π\pi be an irreducible unitary representation of G in a Hilbert space E which is square-integrable modulo the center. One has

cZ(π)∫G/Z⟨x∣π(g)x′⟩⟨y∣π(g)y′⟩dνZ(g)=⟨x∣y⟩⟨x′∣y′⟩ c_Z(\pi )\int_{G/Z}\langle x|\pi (g)x'\rangle \langle y|\pi (g)y'\rangle d\nu_Z(g) =\langle x|y\rangle \langle x'|y'\rangle

for every (x,y,x′,y′)∈E4(x, y, x', y')\in E^4.

Let ww denote the morphism of Prop. 7. One has

∫G/Z⟨x∣π(g)x′⟩⟨y∣π(g)y′⟩dνZ(g)=⟨fx,x′∣fy,y′⟩ \int_{G/Z}\langle x|\pi (g)x'\rangle \langle y|\pi (g)y'\rangle d\nu_Z(g) =\langle f_{x,x'}|f_{y,y'}\rangle

and by loc. cit., it follows that

⟨fx,x′∣fy,y′⟩=1cZ(π)⟨w(x⊗x′)∣w(y⊗y′)⟩ \langle f_{x,x'}|f_{y,y'}\rangle =\frac{1}{c_Z(\pi)}\langle w(x\otimes x')|w(y\otimes y')\rangle
=1cZ(π)⟨x⊗x′∣y⊗y′⟩=1cZ(π)⟨x∣y⟩E‾⟨x′∣y′⟩E =\frac{1}{c_Z(\pi)}\langle x\otimes x'|y\otimes y'\rangle =\frac{1}{c_Z(\pi)}\langle x|y\rangle_{\overline{E}}\langle x'|y'\rangle_E

whence the result.

As a complement to the preceding proposition, one also has the following relations for nonisomorphic irreducible square-integrable representations.

Proposition 9 03AZ

Let π1\pi_1 and π2\pi_2 be nonisomorphic irreducible unitary representations of G in Hilbert spaces E1E_1 and E2E_2. Suppose that π1\pi_1 and π2\pi_2 are square-integrable modulo the center and that the restrictions to Z of their central characters coincide. Then

∫G/Z⟨x∣π1(g)x′⟩⟨y∣π2(g)y′⟩dνZ(g)=0 \int_{G/Z}\langle x|\pi_1(g)x'\rangle \langle y|\pi_2(g)y'\rangle d\nu_Z(g) = 0

for every (x,x′,y,y′)∈E12×E22(x, x', y, y')\in E^2_1\times E^2_2.

For i=1,2i= 1, 2, let wiw_i denote the morphism of Proposition 7 for the representation πi\pi_i. By Lemma 8, b) of V, p. 384 and assertion b) of Proposition 8 of V, p. 394, the image of wiw_i is contained in the πi\pi_i-isotypical component of δG,χ\boldsymbol{\delta }_{G,\chi}. By assertion a) of loc. cit., the image of w1w_1 is therefore orthogonal to the image of w2w_2. Consequently, one has ⟨w1(x⊗x′)∣w2(y⊗y′)⟩=0\langle w_1(x\otimes x')|w_2(y\otimes y')\rangle = 0 for every (x,x′,y,y′)∈E12×E22(x, x', y, y')\in E^2_1\times E^2_2, which is the required formula.

Remark 03B0

The orthogonality relations of Props. 8 and 9 generalize those of A, VIII, p. 399 (see also the case where G is compact in § 2 of V, p. 457).

9. Subrepresentations of the regular representation of a commutative group

In this number, G is a locally compact commutative group and μ\mu a Haar measure on G. We denote by G^\widehat{G} the dual group of G (Definition 2 of II, p. 201) and by μ^\widehat{\mu} the dual Haar measure of μ\mu on G^\widehat{G} (Definition 4 of II, p. 214). The notions of measurability will always be relative to μ\mu and μ^\widehat{\mu}.

We propose to determine all the subrepresentations of the left regular representation γG\boldsymbol{\gamma }_G of G in L2(G,μ)L^2(G, \mu). Since G is commutative, one has moreover δG(g)=γG(g−1)\boldsymbol{\delta }_G(g) =\boldsymbol{\gamma }_G(g^{-1}), so that these subrepresentations are also the subrepresentations of the right regular representation.

For every measurable subset M of G^\widehat{G}, we denote by EME_M the set of the f∈L2(G,μ)f\in L^2(G, \mu) such that the Fourier transform FG(f)\mathscr{F}_G(f) is zero almost everywhere on M (cf. No.o3^o3 of II, p. 210). It is the kernel of the continuous linear mapping f↦φMFG(f)f\mapsto \varphi_M\mathscr{F}_G(f) of L2(G,μ)L^2(G, \mu) into L2(G^,μ^)L^2(\widehat{G},\widehat{\mu}), where φM\varphi_M denotes the characteristic function of M (cf. Theorem 1 of II, p. 215), and is therefore a closed subspace of L2(G,μ)L^2(G, \mu).

We say that measurable subsets M and N of G^\widehat{G} are equal up to a locally negligible set if (M∪N)(M\cup N)- (M∩N)(M\cap N) is locally negligible. Equivalently, measurable subsets M and N are equal up to a locally negligible set if and only if the characteristic functions of M and N are equal in L∞(G^,μ^)L^{\infty}(\widehat{G},\widehat{\mu}).

Proposition 10 03B1

a) Let M be a measurable subset of G^\widehat{G}. The space EME_M is a subrepresentation of the representation γG\boldsymbol{\gamma }_G;

b) Let M and N be measurable subsets of G^\widehat{G}. One has EM=ENE_M= E_N if and only if M and N are equal up to a locally negligible set;

c) Every subrepresentation of γG\boldsymbol{\gamma }_G is of the form EME_M for a measurable subset M of G^\widehat{G}.

Let η\eta be the canonical mapping of G into G^^(\widehat{\widehat{G}} (cf. II, p. 216, Remark 1). Since EME_M is closed, assertion a) follows from the formulae

γG(x)(f)=εx∗f,FG(εx∗f)=η(x)FG(f) \boldsymbol{\gamma }_G(x)(f) =\varepsilon_x*f,\mathscr{F}_G(\varepsilon_x*f) =\eta (x)\mathscr{F}_G(f)

for x∈Gx\in G and f∈L2(G,μ)f\in L^2(G, \mu).

Let M and N be measurable subsets equal up to a locally negligible set. Since φM\varphi_M is then equal to φN\varphi_N in L∞(G^,μ^)L^{\infty}(\widehat{G},\widehat{\mu}), this condition implies that EM=ENE_M= E_N.

Suppose conversely that M and N are not equal up to a locally negligible set. Possibly interchanging the roles of M and N, there then exists a compact subset K such that the set L=K∩(ML = K\cap (M - (M∩N))(M\cap N)) is not negligible. Let φL∈L2(G^,μ^)\varphi_L\in L^2(\widehat{G},\widehat{\mu}) be the class of the characteristic function of L, and put f=F‾G^(φL)∈L2(G,μ)f=\overline{\mathscr{F}}_{\widehat{G}}(\varphi_L)\in L^2(G, \mu); one has FG(f)=φL\mathscr{F}_G(f) =\varphi_L (Corollary to Theorem 2 of II, p. 220). Then ff belongs to ENE_N, since L∩NL\cap N is empty, but not to EME_M, since φMF(f)=φMφL=φL\varphi_M\mathscr{F}(f) =\varphi_M\varphi_L=\varphi_L. Hence EM≠ENE_M\not = E_N, which proves b).

Let now E be a subrepresentation of γG\boldsymbol{\gamma }_G. Let pEp_E be the orthogonal projector of L2(G,μ)L^2(G, \mu) with image E and let qE=FG∘pE∘FG−1q_E=\mathscr{F}_G\circ p_E\circ \mathscr{F}_G^{-1}. The projector pEp_E belong to HomG(γG,γG)_G(\boldsymbol{\gamma }_G,\boldsymbol{\gamma }_G) (prop. 4 of V, p. 383), hence it commutes with γG(f)\boldsymbol{\gamma }_G(f) for every f∈L1(G,μ)(f\in L^1(G, \mu) (cf. V, p. 401). This means that it commutes with the endomorphisms φ↦f∗φ\varphi \mapsto f*\varphi for f∈L1(G,μ)f\in L^1(G, \mu) (lemma 4 of V, p. 407). Consequently, the endomorphism qEq_E of L2(G^,μ^)L^2(\widehat{G},\widehat{\mu}) commutes with the multiplication endomorphism by gg for every function g∈C0(G^)g\in \mathscr{C}_0(\widehat{G}) belonging to the image of the Fourier transform of L1(G,μ)L^1(G, \mu) in C0(G^)\mathscr{C}_0(\widehat{G}) (prop. 14 of II, p. 223). Since the image of the Fourier transform is dense in C0(G^)\mathscr{C}_0(\widehat{G}) (corollary of prop. 5 of II, p. 209), the continuity of the morphism g↦mgg\mapsto m_g implies that qEq_E commutes with mgm_g for every function g∈C0(G^)g\in \mathscr{C}_0(\widehat{G}).

By the corollary of proposition 7 of IV, p. 188, there therefore exists a function φ∈L∞(G^,μ^)\varphi \in \mathscr{L}^{\infty}(\widehat{G},\widehat{\mu}) such that qE=mφq_E=m_{\varphi}. Since qE=qE2q_E=q^2_E, we have mφ=mφ2=mφ2m_{\varphi}=m^2_{\varphi}=m_{\varphi^2}, whence φ=φ2\varphi =\varphi^2 in L∞(G^,μ^)L^{\infty}(\widehat{G},\widehat{\mu}) (prop. 5 of IV, p. 186); this means that φ\varphi is equal in L∞(G^,μ^)L^{\infty}(\widehat{G},\widehat{\mu}) to the class of the characteristic function of a measurable subset N of G^\widehat{G}. Put M=G^−M =\widehat{G}- N. Let f∈L2(G,μ)f\in L^2(G, \mu). We have f∈Ef\in E if and only if pE(f)=fp_E(f) =f, if and only if φFG(f)=FG(f)\varphi \mathscr{F}_G(f) =\mathscr{F}_G(f), which is equivalent to f∈EMf\in E_M.

Remark 03B2

Let χ\chi be a character of G. If G is not compact, the χ\chi-isotypical component of the regular representation of G in L2(G)L^2(G) is trivial. If G is compact, the χ\chi-isotypical component of the regular representation of G is of dimension 1 and the function χ∈L2(G)\chi \in L^2(G) is a basis of it.

10. Unitary representations of the group R

In this number, E denotes a complex Hilbert space. The group R\mathbf{R} is endowed with Lebesgue measure.

Lemma 11 03B3

Let uu be a self-adjoint partial operator on E. For t∈Rt\in \mathbf{R}, put ϱ(t)=eitu∈L(E)\varrho (t) =e^{itu}\in \mathscr{L}(E). Then the mapping ϱ\varrho is a unitary representation of R\mathbf{R}.

The operator ϱ(t)\varrho (t) is defined by the universally measurable functional calculus (def. 5 of IV, p. 272); it is an endomorphism of E since the function x↦eitxx\mapsto e^{itx} is bounded on Sp(uu) (prop. 5, a) of IV, p. 275).

By Prop. 5 of IV, p. 275, we have ϱ(0)=1E,ϱ(t)∗=ϱ(−t)\varrho (0) = 1_E,\varrho (t)^*=\varrho (-t) for every t∈Rt\in \mathbf{R} and ϱ(t1+t2)=ϱ(t1)ϱ(t2)\varrho (t_1+t_2) =\varrho (t_1)\varrho (t_2) for all t1t_1 and t2t_2 in R\mathbf{R}. In particular, the endomorphism ϱ(t)\varrho (t) is unitary for every t∈Rt\in \mathbf{R}. For every x∈Ex\in E, the mapping of R\mathbf{R} into E defined by x↦ϱ(t)xx\mapsto \varrho (t)x is continuous at t=0t= 0 by Prop. 6 of IV, p. 276, hence ϱ\varrho is a unitary representation of R\mathbf{R} in E (V, p. 380, Lemma 4).

Lemma 12 03B4

Let ϱ\varrho be a unitary representation of R\mathbf{R} in E. Let D be the set of elements xx of E such that the mapping ψx:t↦ϱ(t)x\psi_x:t\mapsto \varrho (t)x is differentiable at 0. The mapping uu of D into E given by x↦i−1ψx′(0)x\mapsto i^{-1}\psi '_x(0) defines a symmetric partial operator on E.

Let f∈D(R)f\in \mathscr{D}(\mathbf{R}) and x∈Ex\in E. Put y=ϱ(f)xy=\varrho (f)x. For every h∈Rh\in \mathbf{R}, we have

ψy(h)=ϱ(h)ϱ(f)x=ϱ(f)ϱ(h)x \psi_y(h) =\varrho (h)\varrho (f)x=\varrho (f)\varrho (h)x
=∫Rf(t)ϱ(t+h)xdt=∫Rf(t−h)ψx(t)dt =\int_{\mathbf{R}}f(t)\varrho (t+h)x dt=\int_{\mathbf{R}}f(t-h)\psi_x(t)dt

The function of R2\mathbf{R}^2 into C\mathbf{C} defined by (t,h)↦f(t−h)(t, h)\mapsto f(t-h) is indefinitely differentiable; its derivative with respect to hh is the function defined by (t,h)↦(t, h)\mapsto −f′(t−h)-f'(t-h), which is bounded by ∥f′∥∞\|f'\|_{\infty}. When h=0h= 0, this derivative is zero for tt outside a compact set. Since ∥ψx(t)∥=∥x∥\|\psi_x(t)\|=\|x\| for every tt, we deduce from Prop. 2 of IV, p. 197 that the function ψy\psi_y is differentiable at 0 and that its derivative is given by

ψy′(0)=−∫Rf′(t)ψx(t)dt=−ϱ(f′)x \psi '_y(0) =-\int_{\mathbf{R}}f'(t)\psi_x(t)dt=-\varrho (f')x

Hence y∈Dy\in D. Since the space D(R)\mathscr{D}(\mathbf{R}) is dense in L1(R)L^1(\mathbf{R}) (Prop. 4 of IV, p. 202), we deduce from INT, VIII, p. 139, § 2, no7^o7, Prop. 10 that the space D is dense in E.

Let x1x_1 and x2x_2 be in D. We compute

i i

⟨u(x1)∣x2⟩=\langle u(x_1)|x_2\rangle = lim ⟨(ϱ(h)−1E)x1∣x2⟩\langle (\varrho (h)-1_E)x_1|x_2\rangle

h→0h _{h\rightarrow 0}h
i i

= lim ⟨x1∣(ϱ(−h)−1E)x2⟩=⟨x1∣u(x2)⟩\langle x_1|(\varrho (-h)-1_E)x_2\rangle =\langle x_1|u(x_2)\rangle.

h→0h _{h\rightarrow 0}h

Consequently, the partial operator uu is symmetric.

Definition 5 03B5

Let ϱ\varrho be a unitary representation of R\mathbf{R} in E. The symmetric partial operator defined in Lemma 12 is called the infinitesimal generator of ϱ\varrho.

Theorem 1 (Stone) 03B6

The mapping σ\sigma which to a unitary representation ϱ\varrho of R\mathbf{R} in E associates its infinitesimal generator uu defines a bijection of the set of unitary representations of R\mathbf{R} in E onto the set of self-adjoint partial operators on E. The reciprocal bijection τ\tau associates to a self-adjoint partial operator the unitary representation t↦eitut\mapsto e^{itu}.

Let us first prove some lemmas.

Lemma 13 03B7

Let ϱ\varrho be a unitary representation of R\mathbf{R} in E and let uu be its infinitesimal generator.

a) The domain of uu is the set of x∈Ex\in E such that the mapping ψx:t↦ϱ(t)x\psi_x:t\mapsto \varrho (t)x is differentiable on R\mathbf{R};

b) For every t∈Rt\in \mathbf{R} and every x∈x\in dom(uu), one has ϱ(t)x∈\varrho (t)x\in dom(uu) and ψx′(t)=iu(ϱ(t)x)\psi '_x(t) =iu(\varrho (t)x);

c) The partial operator uu is essentially self-adjoint.

For every x∈Ex\in E, let us denote by ψx\psi_x the mapping of R\mathbf{R} into E defined by ψx(t)=ϱ(t)x\psi_x(t) =\varrho (t)x. For every t∈Rt\in \mathbf{R} and every h∈Rh\in \mathbf{R}, one has

ψx(t+h)−ψx(t)=ϱ(t)(ψx(h)−ψx(0)) \psi_x(t+h)-\psi_x(t) =\varrho (t)(\psi_x(h)-\psi_x(0))

which proves that dom(uu) is the space of elements x∈Ex\in E such that ψx\psi_x is differentiable on R\mathbf{R} and establishes that ψx′(t)=ϱ(t)ψx′(0)=iϱ(t)(u(x))\psi '_x(t) =\varrho (t)\psi '_x(0) =i\varrho (t)(u(x)) for every t∈Rt\in \mathbf{R}.

Let x∈x\in E and t∈Rt\in \mathbf{R}. One has ψϱ(t)x(s)=ψx(s+t)\psi_{\varrho(t)x}(s) =\psi_x(s+t) for every s∈Rs\in \mathbf{R}. Consequently, one has ϱ(t)x∈\varrho (t)x\in dom(uu) if x∈x\in dom(uu), and moreover u(ϱ(t)x)=i−1ψx′(t)=ϱ(t)u(x)u(\varrho (t)x) =i^{-1}\psi '_x(t) =\varrho (t)u(x) by a). One then obtains assertion b).

Let us prove c). Let x∈x\in Ker(u∗−i1Eu^*-i1_E). Let us prove that x=0x= 0. Let y∈y\in dom(uu), and let ff be the function on R\mathbf{R} defined by f(t)=⟨ψy(t)∣x⟩f(t) =\langle \psi_y(t)|x\rangle for t∈Rt\in \mathbf{R}. The function ff is bounded since ∥ψy(t)∥=∥y∥\|\psi_y(t)\|=\|y\| for every t∈Rt\in \mathbf{R}; it is differentiable in R\mathbf{R} and, for every t∈Rt\in \mathbf{R}, assertion b) implies

f′(t)=⟨ψy′(t)∣x⟩=⟨iu(ϱ(t)y)∣x⟩ f'(t) =\langle \psi '_y(t)|x\rangle =\langle iu(\varrho (t)y)|x\rangle
=−i⟨ϱ(t)y∣u∗(x)⟩=−i⟨ψy(t)∣ix⟩=f(t) =-i\langle \varrho (t)y|u^*(x)\rangle =-i\langle \psi_y(t)|ix\rangle =f(t)

since u∗(x)=ixu^*(x) =ix. Hence f(t)=f(0)etf(t) =f(0)e^t for all t∈Rt\in \mathbf{R} (FVR, IV, p. 27). Since ff is bounded, the function ff is zero and, in particular, we have ⟨y∣x⟩=f(0)=0\langle y|x\rangle =f(0) = 0. As the space dom(uu) is dense in E, we conclude that x=0x= 0. Analogously, one proves that Ker(u∗+i1Eu^*+i1_E) is reduced to 0. By Corollary 3 of IV, p. 261, the partial operator uu is therefore essentially self-adjoint.

Lemma 14 03B8

Let uu be a self-adjoint partial operator on E and let ϱ(t)=eitu\varrho (t) =e^{itu} be the unitary representation of R\mathbf{R} defined by uu. The infinitesimal generator of ϱ\varrho is equal to uu.

Let x∈x\in dom(uu). Put ψx(t)=ϱ(t)x\psi_x(t) =\varrho (t)x for all t∈Rt\in \mathbf{R}. For every nonzero real number hh, we have

1h(ψx(t+h)−ψx(t))=(1h(eihu−1E))eitux=(1h(eihu−1E))ϱ(t)x \frac{1}{h}(\psi_x(t+h)-\psi_x(t)) =(\frac{1}{h}(e^{ihu}-1_E))e^{itu}x=(\frac{1}{h}(e^{ihu}-1_E))\varrho (t)x

When hh tends to 0, we have

1 iht_{iht}

(e−1)→it (e-1)\rightarrow it
h h

for all t∈Rt\in \mathbf{R}. Moreover,

∣1h(eiht−1)∣=∣t∣∣1h∫0heitsds∣⩽∣t∣ |\frac{1}{h}(e^{iht}-1)|=|t||\frac{1}{h}\int_0^he^{its}ds|\leqslant |t|

It then follows from Proposition 6 of IV, p. 276 that the function ψx\psi_x is differentiable on R\mathbf{R} and satisfies ψx′(t)=iu(ϱ(t)x)\psi '_x(t) =iu(\varrho (t)x) for all t∈Rt\in \mathbf{R}. Consequently, the domain of uu is included in the set of x∈Ex\in E such that ψx\psi_x is differentiable at 0 and one then has ψx′(0)=iu(x)\psi '_x(0) =iu(x). This means by definition that the infinitesimal generator of ϱ\varrho is an extension of uu. These two operators are therefore equal since they are symmetric and uu is self-adjoint (IV, p. 238, Remark 5).

Lemma 15 03B9

Let ϱ\varrho be a unitary representation of R\mathbf{R} in E. Then the infinitesimal generator uu of ϱ\varrho is self-adjoint and ϱ(t)=eitu\varrho (t) =e^{itu} for all t∈Rt\in \mathbf{R}.

By Lemma 13, c), the partial operator uu is essentially self-adjoint. Its closure u‾\overline{u} is therefore a self-adjoint operator. Let π\pi denote the unitary representation of R\mathbf{R} defined by π(t)=eitu\pi (t) =e^{itu} (Lemma 11).

For every x∈Ex\in E, let ψx\psi_x (resp. ψ~x\widetilde{\psi}_x) denote the mapping of R\mathbf{R} into E defined by ψx(t)=ϱ(t)x\psi_x(t) =\varrho (t)x (resp. by ψ~x(t)=π(t)x\widetilde{\psi}_x(t) =\pi (t)x).

By lemma 13, a) and b), the space dom(uu) is the subspace of E consisting of the elements x∈Ex\in E such that the mapping ψx\psi_x is differentiable on R\mathbf{R}, and for every x∈x\in dom(uu) and every t∈Rt\in \mathbf{R}, one has ψx′(t)=iu(ψx(t))\psi '_x(t) =iu(\psi_x(t)). Analogously, the space dom(u‾\overline{u}) is the subspace of E consisting of the elements x∈Ex\in E such that the mapping ψ~x\widetilde{\psi}_x is differentiable on R\mathbf{R}, and for every x∈x\in dom(u‾\overline{u}) and every t∈Rt\in \mathbf{R}, one has ψ~x′(t)=iu(ψ~x(t))\widetilde{\psi}'_x(t) =iu(\widetilde{\psi}_x(t)).

Let x∈x\in dom(uu)⊂\subset dom(u‾\overline{u}). Put f=ψx−ψ~xf=\psi_x-\widetilde{\psi}_x. This is a differentiable function from R\mathbf{R} into E. For every t∈Rt\in \mathbf{R}, we have

f′(t)=iu(ψx(t))−iu(ψ~x(t))=iu(f(t)) f'(t) =iu(\psi_x(t))-iu(\widetilde{\psi}_x(t)) =iu(f(t))

since ψx(t)∈\psi_x(t)\in dom(uu) and u⊂u‾u\subset \overline{u}. Put g=∥f∥2g=\|f\|^2; this is a differentiable mapping from R\mathbf{R} into R\mathbf{R} such that g(0)=0g(0) = 0. For t∈Rt\in \mathbf{R}, we obtain from FVR, I, p. 28, Prop. 2

g′(t)=⟨f′(t)∣f(t)⟩+⟨f(t)∣f′(t)⟩ g'(t) =\langle f'(t)|f(t)\rangle +\langle f(t)|f'(t)\rangle
=⟨iu(f(t))∣f(t)⟩+⟨f(t)∣iu(f(t))⟩=0 =\langle iu(f(t))|f(t)\rangle +\langle f(t)|iu(f(t))\rangle = 0

since u‾\overline{u} is self-adjoint. Hence f=0f= 0, whence ϱ(t)x=π(t)x\varrho (t)x=\pi (t)x for every t∈Rt\in \mathbf{R}. The continuous endomorphisms ϱ(t)\varrho (t) and π(t)\pi (t) of E coincide on dom(uu), and are therefore equal for every t∈Rt\in \mathbf{R}. Thus one has π=ϱ\pi =\varrho; since u‾\overline{u} is the infinitesimal generator of π\pi (lemma. 14), one has u‾=u\overline{u}=u, which proves that uu is self-adjoint.

We can now prove Theorem 1.

The mappings σ\sigma and τ\tau are well defined (lemma 15 and lemma 11, respectively).

Let ϱ\varrho be a unitary representation of R\mathbf{R}. Let uu denote its infinitesimal generator. The relation ϱ(t)=eitu\varrho (t) =e^{itu} for every t∈Rt\in \mathbf{R} (lemma 15) proves that τ∘σ\tau \circ \sigma is the identity mapping.

Let uu be a self-adjoint partial operator on E. Lemma 14 proves that the infinitesimal generator of the unitary representation t↦eitut\mapsto e^{itu} is equal to uu, hence σ∘τ\sigma \circ \tau is the identity mapping.

Let uu be a self-adjoint partial operator on E and let ϱ(t)=eitu\varrho (t) =e^{itu} for t∈Rt\in \mathbf{R} be the unitary representation of R\mathbf{R} in E associated with it. Let x∈x\in dom(uu). The equation ∂tϱ(t)x=iu(ϱ(t)x)\partial_t\varrho (t)x=iu(\varrho (t)x) which is then satisfied (Lemma 13, b)) is called Schrödinger's equation.

Corollary 03BA

Let ϱ\varrho be a unitary representation of R\mathbf{R} in a Hilbert space E. There exist a locally compact space X, a positive measure μ\mu on X and a continuous function gg on X with real values such that ϱ\varrho is isomorphic to the representation π\pi of R\mathbf{R} in L2(X,μ)L^2(X, \mu) defined by π(t)f=eitgf\pi (t)f=e^{itg}f for every t∈Rt\in \mathbf{R} and every f∈L2(X,μ)f\in L^2(X, \mu).

Let uu be the self-adjoint operator on E such that ϱ(t)=eitu\varrho (t) =e^{itu} for every t∈Rt\in \mathbf{R} (Theorem 1). There exist a locally compact space X, a positive measure μ\mu on X, an isometric isomorphism θ\theta of L2(X,μ)L^2(X, \mu) onto E and a continuous function gg on X with real values such that u=θ∘mg∘θ−1u=\theta \circ m_g\circ \theta^{-1} (Th. 1 of IV, p. 266). The assertion follows from the formula eitu=θ∘eitmg∘θ−1=θ∘meitg∘θ−1e^{itu}=\theta \circ e^{itm_g}\circ \theta^{-1}=\theta \circ m_{e^{itg}}\circ \theta^{-1} (Lemma 4 of IV, p. 269).

Remark 03BB

Suppose that uu is an endomorphism of E. The unitary representation of R\mathbf{R} in E defined by ϱ(t)=eitu\varrho (t) =e^{itu} then satisfies the inequality ∥ϱ(t)−1E∥⩽∣t∣∥u∥\|\varrho (t)-1_E\|\leqslant |t| \|u\| for every t∈Rt\in \mathbf{R}, and the mapping ϱ\varrho of R\mathbf{R} into the Banach space L(E)\mathscr{L}(E) is the unique solution of the linear differential equation

1dϱ 1d\varrho
=u∘ϱ =u\circ \varrho
idt idt

(cf. FVR, IV, p. 26, §6).

Example 03BC

Let ϱ\varrho be the regular representation of R\mathbf{R} in L2(R)L^2(\mathbf{R}). The infinitesimal generator of ϱ\varrho is the closure of the differential operator with domain D(R)\mathscr{D}(\mathbf{R}) defined by f↦−if′f\mapsto -if'.

Exercises

In the exercises of this paragraph, unless otherwise stated, G denotes a locally compact topological group, endowed with a left Haar measure denoted by μ\mu.

See the exercises for § 2.

Machine translation of the English, by gpt-5.4, gpt-5-6-mini, against glossary version 34. Not checked by a person. That model is a cut down version of the one the rest of this language was written by.