§ 2. Linear differential equations
1. Existence of integrals of a linear differential equation
Let E be a complete normed space over the field , and J an interval in , not reducing to a point. One says that the differential equation
(1) where is defined on , is a linear equation if, for every , the map is a continuous affine linear map [^1] from into itself; if one puts the map is then a continuous linear map from to itself; from now on we shall denote this map by and write , (or simply ) for its value at the point ; thus the linear differential equation (1) may be written
(2)
where is a map from into ; when one says that the linear differential equation (2) is homogeneous.
Example 1
When is of finite dimension over one can identify the endomorphism with its matrix with respect to any basis of (Alg., II, p. 343); when one identifies a vector with the column matrix of its components with respect to the basis of under consideration the expression conforms to the general conventions of Algebra (Alg., II, p. 343, prop 2). In this case, equation (2) is equivalent to the system of scalar differential equations
(3)
Example 2
Let be a complete normed algebra over , and , and three maps from into ; the equation
is a linear differential equation; here is the linear map of to itself.
For every , is an element of the set of continuous linear maps from to itself (continuous endomorphisms of ); one knows (Gen. Top., X, p. 298) that , endowed with the norm is a complete normed algebra over the field , and that .
Throughout this section we shall assume that the following conditions are satisfied:
a) The map of into is regulated.
b) The map of into is regulated.
When has dimension , is isomorphic to (as a topological vector space) and condition a) means that each of the elements of the matrix is a regulated function on .
Since , the map
Theorem 1
Let* be a regulated map of into , and be a regulated map of into . For every point of the linear equation (2) admits one and only one solution defined on all of and equal to at the point .
2. Linearity of the integrals of a linear differential equation
Solving a linear differential equation (2) is a linear problem (Alg., II, p. 240); the homogeneous linear equation
Proposition 1
The set* of integrals of the homogeneous linear equation (4), defined on , is a vector subspace of the space of continuous maps from into .
The proof is immediate.
Theorem 2
For every point* of let be the integral of the homogeneous equation (4) defined on and equal to at . 1. For every point the map is a bijective bicontinuous linear map of to itself. 2. The map of into is identical to the integral of the homogeneous linear differential equation
By prop. 1, (resp. ) is an integral of (4) and takes the value (resp. ) at , so, by th. 1 of IV, p. 179, is identical to (resp. ); the map is thus a linear map of E into itself, and one can write .
Since the map of into is continuous (Gen. Top., X, p. 298, prop. 8), the map of J into is regulated for all ; further (Gen. Top., X, p. 296)
so one can apply th. I of IV, p. 179 to the homogeneous linear equation (5); let be the integral of this equation defined on J and equal to at . One has (I, p. 6, prop. 3)
and for we have ; by th. 1 of IV, p. 179 one must have for all , that is, ; this proves that belongs to , in other words, that is continuous on E, and that the map is the integral of (5) which is equal to at .
Finally, the integral of (4) is equal to at the point , so, by definition,
for any , whence the first relation (6); since one has , for any and in J; this proves (Set Theory, II, p. 86, corollary) that is a bijective map of E onto itself, with inverse map . This completes the proof of the theorem.
One says that is the resolvent of equation (2) of IV, p. 178.
Corollary 1
The map which to every point associates the continuous function , defined on J, is an isomorphism of the normed space E onto the vector space of integrals of (4), endowed with the topology of compact convergence.
It is certainly a bijective linear map of E onto : now is bounded on a compact set , so for any and , which shows that this map is continuous; and since
it is clear that the inverse map is also continuous.
Corollary 2
The map of into is continuous.
By (6) we have ; now, the map of into is continuous, as is the map of the (open) group of invertible elements of onto itself (TG, IX, p. 40, prop. 14).
One may note that the map
Corollary 3
Let K be a compact interval contained in J, and let . For all t and in K*
Indeed, for all ; on K the constant function equal to is thus an approximate integral to within by equation (4) of IV, p. 18; by formula (15) of IV, p. 170, one thus has
Proposition 2
Let B be a continuous endomorphism of E, independent of t, and commuting with A(t) for all ; then B commutes with for all t and in J.
Indeed, by (5)
An important instance of prop. 2 is that where E is endowed with the structure of a normed vector space with respect to the field of complex numbers , and where, for every , is an endomorphism of E for this vector space structure; this means that commutes with the continuous endomorphism of E (for the vector space structure over ); then commutes with this endomorphism, which means that for any and in J, the map is a continuous endomorphism for the normed vector space structure of E over .
3. Integrating the inhomogeneous linear equation
Integrating the inhomogeneous linear equation
reduces to integrating the associated homogeneous equation
and evaluating a primitive. With the notation of th. 2 of IV, p. 179, let us put , whence, from the second formula (6) of IV, p. 179, ; if is an integral of (2) then is an integral of the equation ; since the bilinear map
of into is continuous (\emph{Gen. Top.}, X, p. 297, prop. 6), admits a derivative (except on a countable subset of J) and one has, by the formula for differentiating a bilinear function (I, p. 6, prop. 3)
(replacing by according to (5) (IV, p. 179)). The equation for then reduces to , or again to
by the second formula (6) of IV, p. 179. Now the right-hand side of equation (8) is a regulated function on J, having been obtained by substituting the regulated functions and in the continuous bilinear function (\emph{cf.} II, p. 55, cor. 2); equation (8) thus has one and only one integral taking the value at , given by the formula
Since one has (II, p. 59, formula (9)), one obtains (taking account of the first formula (6) of IV, p. 179) the following result:
Proposition 3
With the notation of th. 2* (IV, p. 179), for every point of the integral of the linear equation (2) defined on and equal to at *is given by the formula
The method which leads to formula (10), which consists of taking the function as a new unknown function, is often called the "method of variation of parameters".
4. Fundamental systems of integrals of a linear system of scalar differential equations
In this subsection and the next we shall consider the case where E is a vector space of finite dimension n over the field of complex numbers (so of dimension 2n over ), and where, for every , is an endomorphism of E with respect to the vector space structure over . One can then identify with its matrix with respect to a basis of E (over the field ), the this time being complex functions defined and regulated on J; letting () denote the (complex) components of a vector with respect to the chosen basis, the linear equation
is again equivalent to the system
Theorems 1 (IV, p. 179) and 2 (IV, p. 179) and prop. 2 (IV, p. 181) then show that for every in E there exists one and only one integral of the equation
defined on E and equal to at the point ; this integral can be written
being an invertible square matrix of order whose entries are continuous complex functions on and such that is a primitive of a regulated function on J.
In the particular case where the system (3) reduces to a single scalar equation
and being complex regulated functions on J); one verifies immediately that the (one element) matrix is equal to ; the integral of (11) equal to at the point is thus given explicitly by the formula
In the space of continuous maps from J into E, endowed with the topology of compact convergence, the set of integrals of equation (4) is a vector subspace (over ) isomorphic to E, therefore to (IV, p. 180, cor. 1, and IV, p. 181, prop. 2).
A basis of this space (over the field ) is called a fundamental system of integrals of (4).
Proposition 4
For the integrals () of equation (4) to form a fundamental system it is necessary and sufficient that their values at a point be linearly independent vectors in .
Indeed, the map which to every associates the integral is an isomorphism of onto (IV, p. 180, cor. 1 and IV, p. 181, prop. 2).
If is any basis of over , the integrals
Given any integrals () of (4) one terms the determinant of these integrals at a point with respect to a basis of , the determinant
By prop. 4 of IV, p. 184, for to be a fundamental system of integrals of (4) it is necessary and sufficient that the determinant of the be at some one point of ; the formula (14) then shows that at every point of , in other words, that the vectors () are always linearly independent.
Proposition 5
The determinant of the matrix is given by the formula*
Indeed, if one puts one has, by the formula for the derivative of a determinant (I, p. 8, formula (3))
that is, by the differential equation (5) of IV, p. 179 satisfied by ,
Since the formula (15) follows from the expression (12) (IV, p. 183) for the integral of a scalar linear equation.
Specifying linearly independent integrals of (4) determines all the integrals of this equation, as we have just seen. We shall now show that for the knowledge of linearly independent integrals () of equation (4) reduces the integration of this equation to that of a homogeneous linear system of scalar equations. Suppose that on an interval there are maps
of into , which are primitives of regulated functions on , and such that, for every , the vectors () form a basis of .
For every point there always exists an interval , a neighbourhood of in , on which there are defined functions () having the preceding properties. For, let be a basis of ; there exist vectors of this basis which form with the () a basis of (Alg., II, p. 292, th. 2); suppose for example that they are ; since the determinant (with respect to the basis ) is a continuous function of and does not vanish for there exists a neighbourhood of on which it does not vanish; one can then take () for .
There exists an invertible matrix of order , whose elements are primitives of regulated functions on , such that for . Let us put ; then satisfies the equation , which can also be written
where is a matrix with regulated entries on . By the definition of this linear equation admits the constant vectors () as integrals; one concludes immediately that necessarily for ; thus the components of (with respect to the basis ) with index satisfy a homogeneous linear system of equations; once the solutions of this system are determined, the for indices are linear functions of the with , so are known, and the primitives of these functions will give the for indices .
In particular, when one knows linearly independent integrals of equation (4) of IV, p. 183, integrating this equation reduces to that of a single homogeneous scalar equation, and then the evaluation of primitives.
Remark 1
All the above applies also to the case where E is of dimension over the field and is an endomorphism of E for every : one has only to replace by throughout.
Remark 2
Let be a square matrix of order whose entries are real (resp. complex) regulated functions of on , and let be the resolvent matrix of the corresponding linear system (3) (IV, p. 22). Let F be an arbitrary complete normed space over (resp. ) and let us consider the system of linear differential equations
where the unknown functions , take their values in F. It is immediate that the solution of this system such that for ( being arbitrary in F) is given by the formulae
We consider in particular the case where is an endomorphism of a vector space E of finite dimension over , such that there exists a basis of E with respect to which the matrix of has real elements for every . Then the above shows (by th. 1 of IV, p. 179) that the resolvent matrix with respect to the same basis also has real elements: it suffices to consider the vector space over generated by the basis of E under consideration, and to remark that the restriction of to is an endomorphism of this vector space.
5. Adjoint equation
Assuming always that the space E is of finite dimension over , let be its dual (A, II, p. 40), which is a space of dimension over (Alg., II, p. 299, th. 4); the canonical bilinear form defined on (Alg., II, p. 234) is continuous on this product (being a polynomial in the components of and ).
Given a homogeneous linear equation (4) (IV, p. 183), where is a regulated map of J into , let us see if there exists a map of J into , a primitive of a regulated function on J, and such that the scalar function is constant on J when is an arbitrary solution of (4); it comes to the same to write that the derivative of this function should be zero at every point where and are differentiable, that is, one must have
at such points.
Now, by (4), where is the transpose of (Alg., II, p. 234). The relation that must satisfy can thus be written
at all points where is continuous and is differentiable. Now for such a point and an arbitrary point there exists, by th. 1 of IV, p. 179, a solution of (4) such that ; one thus must have for all , which entails . Consequently:
Proposition 6
The map of J into , a primitive of a regulated function on J, is such that is constant on J for every solution of the equation* (4) *of IV, p. 183 if and only if is a solution of the homogeneous linear equation
where is the transpose of .
Equation (16) is called the adjoint of (4); clearly (4) is the adjoint of (16). The elements of the matrix being regulated functions of on J, the results obtained above on linear equations apply to (16). In particular, the integral of (16) taking the value at the point can be written as , where is a bijective linear map of onto itself, identical to the integral of the equation
which takes the value at the point . As a result one has (with the notation of IV, p. 179)
for any and , which shows that
(the contragradient of ). In particular, if one knows a fundamental system of integrals of the adjoint equation (16) the matrix is determined, so is also, and as a result, so are all the integrals of equation (4).
Remark
Let E and F be two complete normed spaces over (or over ), and a continuous bilinear form on , such that the relation “ for all ” (resp. for all ”) implies (resp. ). Suppose further that for every there is a continuous linear map of F into itself, such that for every . In these circumstances one sees as before that for a map of J into F, a primitive of a regulated function, to be such that is constant for every integral of (4), it is necessary and sufficient that should be an integral of (16), which again we call the adjoint of (4).
6. Linear differential equations with constant coefficients
Suppose again that E is an arbitrary complete normed space over ; let A be a continuous endomorphism of A, independent of t, and consider the homogeneous linear equation
When E is of finite dimension the equation (19) is equivalent to a homogeneous system (3) (IV, p. 183) of scalar differential equations, where the coefficients are constant.
By th. 1 (IV, p. 179), every integral of (19) is defined on all of ; by th. 2 (IV, p. 179) the integral of (19) taking the value at a point can be written as , where is a bijective bicontinuous linear map of E onto itself that satisfies the equation
and is such that . Moreover, we have the identity
for any : indeed, one has by (20), and since A is constant one also has
moreover
whence we have the identity (21), since the integral of (20) equal to I at the point is unique.
If one puts then ; moreover, for every , is identical to the integral of the equation
which takes the value I at the point 0. We make the following definition:
Definition 1
Given a continuous endomorphism A of E we denote by or the automorphism of E equal to the value at the point of the integral of the equation (20) which takes the value I at the point .
With this notation the remarks preceding def. 1 show that
The exponential notation just introduced is justified by the following properties, which are entirely analogous to those of the function exp z, for z real or complex (cf. III, p. 98 and 106):
Proposition 7
1' The map is a continuous map of into the group of automorphisms of E (invertible elements of* ).
2 The map of into is differentiable, and
3 For any one has
the right-hand side being absolutely and uniformly convergent on every bounded subset of ; in particular, for .
4) If X and Y commute then Y and commute with , and
The relation (24) follows from the expression (23) for and from the fact that this function is an integral of (20); by recursion on n one deduces from (24) that is indefinitely differentiable on and that
By Taylor’s formula one thus can write
On the other hand, cor. 3 of IV, p. 181 shows that . Thus the remainder in formula (27) satisfies the inequality
whence one deduces the formula (25), the series on the right-hand side being absolutely and uniformly convergent on every bounded subset of . For every pair of elements of one thus has
Now, one can write , where the sum is taken over the sequences of elements of such that or for , and at least one of the is equal to ; the inequality
Finally, if and commute, then commutes with (IV, p. 181, prop. 2), so
On the contrary one notes that (26) need not remain valid if and are no longer assumed to commute: indeed it would imply that and always commute, which is not the case, as is shown by simple examples (IV, p. 204, exerc. 3).
Now let us assume that is a vector space of finite dimension over the field , and an endomorphism of (for its vector space structure over ) which one can identify with its matrix with respect to a basis of ; then, for all , is an automorphism of for the same structure (IV, p. 181, prop. 2). Let () be the distinct roots (in ) of the characteristic polynomial of the endomorphism (the "characteristic roots" of ); if is the order of multiplicity of then . One knows that (Alg., VII, 31, n° 3) to each root there corresponds a subspace of , of dimension , such that is stable under , and that is the direct sum of the : can be defined as the subspace of vectors such that
But since one has
Thus every integral of the equation (19) of IV, p. 188, can be written as
where is a polynomial in , with coefficients in the vector space , and of degree . In particular, if all the roots of the characteristic equation of are simple, the spaces () are all of dimension 1 over the field , so there exist vectors such that the functions () form a fundamental system of integrals of the equation (19) of IV, p. 188.
The characteristic roots of the endomorphism are also called characteristic roots of the linear equation (19) of IV, p. 188. One may observe that one obtains the characteristic equation of by writing that the function is an integral of (19) for a vector .
When one has determined the roots () explicitly, and thus the order of multiplicity of , in practice one obtains the integrals of (19) by writing that this equation is satisfied by the expression (32) of IV, p. 191, where is an arbitrary polynomial of degree , with coefficients in ; on identifying the coefficients of (for ) in the two sides of the equation so obtained one obtains linear equations for the coefficients of the polynomials : one establishes easily that these equations determine the terms of degree of as functions of the constant term, and that the latter is a solution of the equation , which defines the subspace (method of "undetermined coefficients").
Remark
When there exists a basis of such that the matrix of with respect to this basis has real elements (cf. IV, p. 186, Remark 2), the characteristic equation of has real coefficients. For every of , expressed in the basis under consideration, let ; the map is an antilinear involution of . One knows (Alg., VII) that, if is a non-real root of the characteristic equation, and is the corresponding stable subspace, then is a characteristic root having the same multiplicity as , and the image of under the map is the stable subspace corresponding to . One deduces from this that if () are linearly independent integrals with values in , then the integrals are linearly independent, and have, with respect to the chosen basis of , components which are real functions of . If is a real characteristic root Remark 2 of IV, p. 186, shows that (with the same notation) there are linearly independent integrals () with values in whose components are real. That way one obtains a fundamental system of integrals of (19) whose components are all real.
7. Linear equations of order
One calls a linear differential equation of order an equation of the form
where the () and are real (complex) functions of the real variable , defined on an interval of . The general procedure of IV, p. 164 shows that this equation is equivalent to the linear system of first order equations
that is to say, to the linear equation
where we have put , , and where the matrix is defined by
The study of the linear equation of order thus consists of applying the general results above to the particular linear equation (35). For every interval where the functions () and are regulated there exists one and only one function , defined on , having a continuous derivative of order , and a regulated derivative of order on this interval (except at the points of a countable set), satisfying (33) on the complement of a countable subset of , and such that
where is an arbitrary point of , and are arbitrary complex numbers.
For the integrals () of the homogeneous equation
associated with (33) to be linearly independent (in the space of continuous maps from into , considered as a vector space over ), it is necessary and sufficient that the corresponding integrals of the homogeneous equation should be linearly independent (in the space of continuous maps from into ). It is clear that this condition is necessary.
Conversely, if there are complex constants , not all zero, such that identically on , one deduces that on for every integer such that , which means that on .
Consequently (IV, p. 180, cor. 1)
Proposition 8
The set of integrals of the homogeneous linear equation (37), defined on , is a vector space of dimension over the field .
Given any integrals () of equation (37) one calls the Wronskian of this system of integrals the determinant (with respect to the canonical basis of ) of the corresponding integrals of the equation , that is to say, the function
For the integrals to be linearly independent it is necessary and sufficient that on ; moreover, it suffices for this that at only one of (IV, p. 184, prop. 4); further, one has (IV, p. 184, prop. 5)
We identify the resolvent of equation (35) with its matrix with respect to the canonical basis of ; the columns () of this matrix are then linearly independent integrals
of the homogeneous equation which correspond to linearly independent integrals of equation (37) such that
(Kronecker delta) for (on agreeing to put ). It results in particular that the method of variation of parameters (IV, p. 182) applied to equation (35) here gives as a particular integral of (33), equal to 0 together with its first derivatives at the point , the function
In the particular case of the equation the formula (39) again gives the formula expressing the primitive of the regulated function which vanishes with its first derivatives at the point , namely
8. Linear equations of order with constant coefficients
If the coefficients in equation (33) are constant, the corresponding matrix is constant; the characteristic equation is obtained by writing that is a solution, which gives
Proposition 9
Let () be the distinct roots of the characteristic equation (40), and let be the multiplicity of the root (). Then the functions () are linearly independent integrals of the homogeneous equation (41).
One can prove this result directly in the following way. It follows from equation (41) that the derivative of every integral of this equation is differentiable on , from which one deduces immediately, by induction on the integer , that every integral of (41) admits a derivative of order , that is, is indefinitely differentiable on . Let be the (non-topological) vector space over of indefinitely differentiable complex-valued functions on ; the map is an endomorphism of this space, and equation (41) can be written
where (Alg., IV, p. 4).
Proposition 10
Let g and h be two relatively prime polynomials such that . The subspace of solutions of (42) is the direct sum of the subspaces of solutions of the two equations
Now, by the Bezout identity (Alg., VII. 2, th. 1) there exist two polynomials and such that . For every solution of (42) one can write , where and ; and then and . On the other hand, if both and , one deduces that
which completes the proof.
With the preceding notation one can write
and prop. 10, by induction on , shows that the subspace of solutions of (42) is the direct sum of the subspaces of solutions of the equations
Now, for every complex number one has
so (43) is equivalent to
and thus has as solutions the functions , where runs through the set of polynomials of degree ; thus one recovers prop. 9 of IV, p. 194.
Assuming that the homogeneous equation (41) has been solved (that is, assuming that the characteristic roots have been found), one knows that the method of variation of parameters allows one to find the solutions of the inhomogeneous equation
where is an arbitrary regulated function (IV, p. 182); we note that if is indefinitely differentiable on an interval J then all the integrals of (45) are indefinitely differentiable on J. In the particular case , where is a polynomial (with complex coefficients) and is an arbitrary complex number, one obtains an integral of (45) more simply by the following method. Put ; the equation
can, by (44), be written
or, by Taylor’s formula applied to the polynomial ,
Let be the degree of the polynomial ; if (that is, if is not a characteristic root), there exists one and only one polynomial of degree which is a solution of (46), for the coefficients are determined by the system of linear equations
which clearly admits one and only one solution. If, on the other hand, is a characteristic root, and is its multiplicity, the preceding calculation shows that there is one and only one polynomial of degree such that every solution of is an integral; in other words, every polynomial solution of (46) is then of degree ("resonance").
9. Systems of linear equations with constant coefficients
With the notation of n° 8, let us consider more generally a system of differential equations of the form
where the unknowns () and the right-hand sides () are complex functions of the real variable , and where the are polynomials (of any degree) with constant (complex) coefficients in the differentiation operator ().
Such systems are not of the same type as those considered in IV, p. 1164 (formula (5)), as the following example shows:
We shall confine ourselves to the case where the functions are indefinitely differentiable on the interval J, and we shall look only for solutions which are indefinitely differentiable on J. On putting , (a map from J into ), and , the system (47) can be written as
where is the matrix with m rows and n columns, whose coefficients belong to the ring of polynomials in D, with coefficients in . Let () be the nonzero similarity invariants of the matrix ; one knows (Alg., VII, p. 32) that these are well-determined monic polynomials, such that divides for ( being the rank of ); further, there are two square matrices and of order m and n respectively, invertible (in the rings of square matrices of order m and n respectively, with coefficients in the ring of polynomials in D with complex coefficients), and such that all the entries of the matrix are zero, apart from the diagonal terms for . Now we put ; the equation (49) is equivalent to the equation
that is, to
since is invertible. Now, if , and if
then equation (50) can be written
The system thus does not admit any indefinitely differentiable solutions unless the conditions (52) are satisfied; the determination of the for indices then reduces to integrating the r linear differential equations with constant coefficients (51); the for indices are arbitrary indefinitely differentiable functions. Once the solutions of (50) have thus been determined, one deduces the solutions of (47) from the formula .
Remark 1
Some of the polynomials may reduce to nonzero constants; the corresponding are then completely determined.
Remark 2
When the are all zero, that is, if the system (47) is homogeneous, the conditions (52) are always satisfied; if, further, , one sees that the set of solutions of (47) is a vector space over , of dimension equal to the sum of the degrees of the , that is, to the degree of .
Remark 3
Given the polynomials , a system (47) which admits solutions when the right-hand sides are indefinitely differentiable (or differentiable of a certain order) may not admit them when the right hand sides are arbitrary regulated functions: this is shown by the example (48), which has no solution when is not a primitive. We shall not undertake here to seek for supplementary possibility conditions which enter when the right-hand sides are arbitrary regulated functions.
Exercises
See the exercises for § 2.
[^1]: Recall that if is of finite dimension then every affine linear map from into itself is continuous (Gen. Top., VI, p. 33 and 37).