Lyapunov stability

The article's lead section may need to be rewritten. Please help improve the lead and read the lead layout guide.(December 2021) ( Learn how and when to remove this message )

Part of a series on
Astrodynamics
Orbital mechanics
Orbital elements Apsis Argument of periapsis Eccentricity Inclination Mean anomaly Orbital nodes Semi-major axis True anomaly
Types of two-body orbits by eccentricity Circular orbit Elliptic orbit Transfer orbit (Hohmann transfer orbit Bi-elliptic transfer orbit) Parabolic orbit Hyperbolic orbit Radial orbit Decaying orbit
Equations Dynamical friction Escape velocity Kepler's equation Kepler's laws of planetary motion Orbital period Orbital velocity Surface gravity Specific orbital energy Vis-viva equation
Celestial mechanics
Gravitational influences Barycenter Hill sphere Perturbations Sphere of influence
N-body orbits Lagrangian points (Halo orbits) Lissajous orbits Lyapunov orbits
Engineering and efficiency
Preflight engineering Mass ratio Payload fraction Propellant mass fraction Tsiolkovsky rocket equation
Efficiency measures Gravity assist Oberth effect
Propulsive maneuvers Orbital maneuver Orbit insertion
v t e

Various types of stability may be discussed for the solutions of differential equations or difference equations describing dynamical systems. The most important type is that concerning the stability of solutions near to a point of equilibrium. This may be discussed by the theory of Aleksandr Lyapunov. In simple terms, if the solutions that start out near an equilibrium point ${\displaystyle x_{e}}$ stay near ${\displaystyle x_{e}}$ forever, then ${\displaystyle x_{e}}$ is Lyapunov stable. More strongly, if ${\displaystyle x_{e}}$ is Lyapunov stable and all solutions that start out near ${\displaystyle x_{e}}$ converge to ${\displaystyle x_{e}}$, then ${\displaystyle x_{e}}$ is said to be asymptotically stable (see asymptotic analysis). The notion of exponential stability guarantees a minimal rate of decay, i.e., an estimate of how quickly the solutions converge. The idea of Lyapunov stability can be extended to infinite-dimensional manifolds, where it is known as structural stability, which concerns the behavior of different but "nearby" solutions to differential equations. Input-to-state stability (ISS) applies Lyapunov notions to systems with inputs.

Contents

• History
• Definition for continuous-time systems
• System of deviations
• Lyapunov's second method for stability
• Definition for discrete-time systems
• Stability for linear state space models
• Stability for systems with inputs
• Example
• Barbalat's lemma and stability of time-varying systems
• See also
• References
• Further reading

History

Lyapunov stability is named after Aleksandr Mikhailovich Lyapunov, a Russian mathematician who defended the thesis The General Problem of Stability of Motion at Kharkov University in 1892. ^[1] A. M. Lyapunov was a pioneer in successful endeavors to develop a global approach to the analysis of the stability of nonlinear dynamical systems by comparison with the widely spread local method of linearizing them about points of equilibrium. His work, initially published in Russian and then translated to French, received little attention for many years. The mathematical theory of stability of motion, founded by A. M. Lyapunov, considerably anticipated the time for its implementation in science and technology. Moreover Lyapunov did not himself make application in this field, his own interest being in the stability of rotating fluid masses with astronomical application. He did not have doctoral students who followed the research in the field of stability and his own destiny was terribly tragic because of his suicide in 1918 ^{[ citation needed ]}. For several decades the theory of stability sank into complete oblivion. The Russian-Soviet mathematician and mechanician Nikolay Gur'yevich Chetaev working at the Kazan Aviation Institute in the 1930s was the first who realized the incredible magnitude of the discovery made by A. M. Lyapunov. The contribution to the theory made by N. G. Chetaev ^[2] was so significant that many mathematicians, physicists and engineers consider him Lyapunov's direct successor and the next-in-line scientific descendant in the creation and development of the mathematical theory of stability.

The interest in it suddenly skyrocketed during the Cold War period when the so-called "Second Method of Lyapunov" (see below) was found to be applicable to the stability of aerospace guidance systems which typically contain strong nonlinearities not treatable by other methods. A large number of publications appeared then and since in the control and systems literature. ^{[3] [4] [5] [6] [7]} More recently the concept of the Lyapunov exponent (related to Lyapunov's First Method of discussing stability) has received wide interest in connection with chaos theory. Lyapunov stability methods have also been applied to finding equilibrium solutions in traffic assignment problems. ^[8]

Definition for continuous-time systems

Consider an autonomous nonlinear dynamical system

${\displaystyle {\dot {x}}=f(x(t)),\;\;\;\;x(0)=x_{0}}$,

where ${\displaystyle x(t)\in {\mathcal {D}}\subseteq \mathbb {R} ^{n}}$ denotes the system state vector, ${\displaystyle {\mathcal {D}}}$ an open set containing the origin, and ${\displaystyle f:{\mathcal {D}}\rightarrow \mathbb {R} ^{n}}$ is a continuous vector field on ${\displaystyle {\mathcal {D}}}$. Suppose ${\displaystyle f}$ has an equilibrium at ${\displaystyle x_{e}}$ so that ${\displaystyle f(x_{e})=0}$ then

1. This equilibrium is said to be Lyapunov stable if for every ${\displaystyle \epsilon >0}$ there exists a ${\displaystyle \delta >0}$ such that if ${\displaystyle \|x(0)-x_{e}\|<\delta }$ then for every ${\displaystyle t\geq 0}$ we have ${\displaystyle \|x(t)-x_{e}\|<\epsilon }$.
2. The equilibrium of the above system is said to be asymptotically stable if it is Lyapunov stable and there exists ${\displaystyle \delta >0}$ such that if ${\displaystyle \|x(0)-x_{e}\|<\delta }$ then ${\displaystyle \lim _{t\rightarrow \infty }\|x(t)-x_{e}\|=0}$.
3. The equilibrium of the above system is said to be exponentially stable if it is asymptotically stable and there exist ${\displaystyle \alpha >0,~\beta >0,~\delta >0}$ such that if ${\displaystyle \|x(0)-x_{e}\|<\delta }$ then ${\displaystyle \|x(t)-x_{e}\|\leq \alpha \|x(0)-x_{e}\|e^{-\beta t}}$ for all ${\displaystyle t\geq 0}$.

Conceptually, the meanings of the above terms are the following:

1. Lyapunov stability of an equilibrium means that solutions starting "close enough" to the equilibrium (within a distance ${\displaystyle \delta }$ from it) remain "close enough" forever (within a distance ${\displaystyle \epsilon }$ from it). Note that this must be true for any${\displaystyle \epsilon }$ that one may want to choose.
2. Asymptotic stability means that solutions that start close enough not only remain close enough but also eventually converge to the equilibrium.
3. Exponential stability means that solutions not only converge, but in fact converge faster than or at least as fast as a particular known rate ${\displaystyle \alpha \|x(0)-x_{e}\|e^{-\beta t}}$.

The trajectory ${\displaystyle x(t)=\phi (t)}$ is (locally) attractive if

${\displaystyle \|x(t)-\phi (t)\|\rightarrow 0}$ as ${\displaystyle t\rightarrow \infty }$

for all trajectories ${\displaystyle x(t)}$ that start close enough to ${\displaystyle \phi (t)}$, and globally attractive if this property holds for all trajectories.

That is, if x belongs to the interior of its stable manifold, it is asymptotically stable if it is both attractive and stable. (There are examples showing that attractivity does not imply asymptotic stability. ^{[9] [10] [11]} Such examples are easy to create using homoclinic connections.)

If the Jacobian of the dynamical system at an equilibrium happens to be a stability matrix (i.e., if the real part of each eigenvalue is strictly negative), then the equilibrium is asymptotically stable.

Definition for discrete-time systems

The definition for discrete-time systems is almost identical to that for continuous-time systems. The definition below provides this, using an alternate language commonly used in more mathematical texts.

Let (X, d) be a metric space and f : X → X a continuous function. A point x in X is said to be Lyapunov stable, if,

${\displaystyle \forall \epsilon >0\ \exists \delta >0\ \forall y\in X\ \left[d(x,y)<\delta \Rightarrow \forall n\in \mathbf {N} \ d\left(f^{n}(x),f^{n}(y)\right)<\epsilon \right].}$

We say that x is asymptotically stable if it belongs to the interior of its stable set, i.e. if,

${\displaystyle \exists \delta >0\left[d(x,y)<\delta \Rightarrow \lim _{n\to \infty }d\left(f^{n}(x),f^{n}(y)\right)=0\right].}$

Stability for linear state space models

A linear state space model

${\displaystyle {\dot {\textbf {x}}}=A{\textbf {x}}}$,

where ${\displaystyle A}$ is a finite matrix, is asymptotically stable (in fact, exponentially stable) if all real parts of the eigenvalues of ${\displaystyle A}$ are negative. This condition is equivalent to the following one: ^[12]

${\displaystyle A^{\textsf {T}}M+MA}$

is negative definite for some positive definite matrix ${\displaystyle M=M^{\textsf {T}}}$. (The relevant Lyapunov function is ${\displaystyle V(x)=x^{\textsf {T}}Mx}$.)

Correspondingly, a time-discrete linear state space model

${\displaystyle {\textbf {x}}_{t+1}=A{\textbf {x}}_{t}}$

is asymptotically stable (in fact, exponentially stable) if all the eigenvalues of ${\displaystyle A}$ have a modulus smaller than one.

This latter condition has been generalized to switched systems: a linear switched discrete time system (ruled by a set of matrices ${\displaystyle \{A_{1},\dots ,A_{m}\}}$)

${\displaystyle {{\textbf {x}}_{t+1}}=A_{i_{t}}{\textbf {x}}_{t},\quad A_{i_{t}}\in \{A_{1},\dots ,A_{m}\}}$

is asymptotically stable (in fact, exponentially stable) if the joint spectral radius of the set ${\displaystyle \{A_{1},\dots ,A_{m}\}}$ is smaller than one.

Stability for systems with inputs

A system with inputs (or controls) has the form

${\displaystyle {\dot {\textbf {x}}}={\textbf {f}}({\textbf {x}},{\textbf {u}})}$

where the (generally time-dependent) input u(t) may be viewed as a control, external input, stimulus, disturbance, or forcing function. It has been shown ^[13] that near to a point of equilibrium which is Lyapunov stable the system remains stable under small disturbances. For larger input disturbances the study of such systems is the subject of control theory and applied in control engineering. For systems with inputs, one must quantify the effect of inputs on the stability of the system. The main two approaches to this analysis are BIBO stability (for linear systems) and input-to-state stability (ISS) (for nonlinear systems)

Example

This example shows a system where a Lyapunov function can be used to prove Lyapunov stability but cannot show asymptotic stability. Consider the following equation, based on the Van der Pol oscillator equation with the friction term changed:

${\displaystyle {\ddot {y}}+y-\varepsilon \left({\frac {{\dot {y}}^{3}}{3}}-{\dot {y}}\right)=0.}$

Let

${\displaystyle x_{1}=y,x_{2}={\dot {y}}}$

so that the corresponding system is

${\displaystyle {\begin{aligned}&{\dot {x}}_{1}=x_{2},\\&{\dot {x}}_{2}=-x_{1}+\varepsilon \left({\frac {x_{2}^{3}}{3}}-{x_{2}}\right).\end{aligned}}}$

The origin ${\displaystyle x_{1}=0,\ x_{2}=0}$ is the only equilibrium point. Let us choose as a Lyapunov function

${\displaystyle V={\frac {1}{2}}\left(x_{1}^{2}+x_{2}^{2}\right)}$

which is clearly positive definite. Its derivative is

${\displaystyle {\dot {V}}=x_{1}{\dot {x}}_{1}+x_{2}{\dot {x}}_{2}=x_{1}x_{2}-x_{1}x_{2}+\varepsilon {\frac {x_{2}^{4}}{3}}-\varepsilon {x_{2}^{2}}=\varepsilon {\frac {x_{2}^{4}}{3}}-\varepsilon {x_{2}^{2}}.}$

It seems that if the parameter ${\displaystyle \varepsilon }$ is positive, stability is asymptotic for ${\displaystyle x_{2}^{2}<3.}$ But this is wrong, since ${\displaystyle {\dot {V}}}$ does not depend on ${\displaystyle x_{1}}$, and will be 0 everywhere on the ${\displaystyle x_{1}}$ axis. The equilibrium is Lyapunov stable but not asymptotically stable.

Barbalat's lemma and stability of time-varying systems

It may be difficult to find a Lyapunov function with a negative definite derivative as required by the Lyapunov stability criterion, however a function ${\displaystyle V}$ with ${\displaystyle {\dot {V}}}$ that is only negative semi-definite may be available. In autonomous systems, the invariant set theorem can be applied to prove asymptotic stability, but this theorem is not applicable when the dynamics are a function of time. ^[14]

Instead, Barbalat's lemma allows for Lyapunov-like analysis of these non-autonomous systems. The lemma is motivated by the following observations. Assuming f is a function of time only:

• Having ${\displaystyle {\dot {f}}(t)\to 0}$ does not imply that ${\displaystyle f(t)}$ has a limit at ${\displaystyle t\to \infty }$. For example, ${\displaystyle f(t)=\sin(\ln(t)),\;t>0}$.
• Having ${\displaystyle f(t)}$ approaching a limit as ${\displaystyle t\to \infty }$ does not imply that ${\displaystyle {\dot {f}}(t)\to 0}$. For example, ${\displaystyle f(t)=\sin \left(t^{2}\right)/t,\;t>0}$.
• Having ${\displaystyle f(t)}$ lower bounded and decreasing (${\displaystyle {\dot {f}}\leq 0}$) implies it converges to a limit. But it does not say whether or not ${\displaystyle {\dot {f}}\to 0}$ as ${\displaystyle t\to \infty }$.

Barbalat's Lemma says:

If ${\displaystyle f(t)}$ has a finite limit as ${\displaystyle t\to \infty }$ and if ${\displaystyle {\dot {f}}}$ is uniformly continuous (a sufficient condition for uniform continuity is that ${\displaystyle {\ddot {f}}}$ is bounded), then ${\displaystyle {\dot {f}}(t)\to 0}$ as ${\displaystyle t\to \infty }$. ^[15]

An alternative version is as follows:

Let ${\displaystyle p\in [1,\infty )}$ and ${\displaystyle q\in (1,\infty ]}$. If ${\displaystyle f\in L^{p}(0,\infty )}$ and ${\displaystyle {\dot {f}}\in L^{q}(0,\infty )}$, then ${\displaystyle f(t)\to 0}$ as ${\displaystyle t\to \infty .}$ ^[16]

In the following form the Lemma is true also in the vector valued case:

Let ${\displaystyle f(t)}$ be a uniformly continuous function with values in a Banach space ${\displaystyle E}$ and assume that ${\displaystyle \textstyle \int _{0}^{t}f(\tau )\mathrm {d} \tau }$ has a finite limit as ${\displaystyle t\to \infty }$. Then ${\displaystyle f(t)\to 0}$ as ${\displaystyle t\to \infty }$. ^[17]

The following example is taken from page 125 of Slotine and Li's book Applied Nonlinear Control. ^[14]

Consider a non-autonomous system

${\displaystyle {\dot {e}}=-e+g\cdot w(t)}$

${\displaystyle {\dot {g}}=-e\cdot w(t).}$

This is non-autonomous because the input ${\displaystyle w}$ is a function of time. Assume that the input ${\displaystyle w(t)}$ is bounded.

Taking ${\displaystyle V=e^{2}+g^{2}}$ gives ${\displaystyle {\dot {V}}=-2e^{2}\leq 0.}$

This says that ${\displaystyle V(t)\leq V(0)}$ by first two conditions and hence ${\displaystyle e}$ and ${\displaystyle g}$ are bounded. But it does not say anything about the convergence of ${\displaystyle e}$ to zero, as ${\displaystyle {\dot {V}}}$ is only negative semi-definite (note ${\displaystyle g}$ can be non-zero when ${\displaystyle {\dot {V}}}$=0) and the dynamics are non-autonomous.

Using Barbalat's lemma:

${\displaystyle {\ddot {V}}=-4e(-e+g\cdot w)}$.

This is bounded because ${\displaystyle e}$, ${\displaystyle g}$ and ${\displaystyle w}$ are bounded. This implies ${\displaystyle {\dot {V}}\to 0}$ as ${\displaystyle t\to \infty }$ and hence ${\displaystyle e\to 0}$. This proves that the error converges.

See also

• Lyapunov function
• LaSalle's invariance principle
• Lyapunov–Malkin theorem
• Markus–Yamabe conjecture
• Libration point orbit
• Hartman–Grobman theorem
• Perturbation theory

Related Research Articles

The logistic map is a polynomial mapping of degree 2, often referred to as an archetypal example of how complex, chaotic behaviour can arise from very simple nonlinear dynamical equations. The map, initially utilized by Edward Lorenz in the 1960s to showcase irregular solutions, was popularized in a 1976 paper by the biologist Robert May, in part as a discrete-time demographic model analogous to the logistic equation written down by Pierre François Verhulst. Mathematically, the logistic map is written

In probability theory, the central limit theorem (CLT) states that, under appropriate conditions, the distribution of a normalized version of the sample mean converges to a standard normal distribution. This holds even if the original variables themselves are not normally distributed. There are several versions of the CLT, each applying in the context of different conditions.

In mathematics, the Lyapunov exponent or Lyapunov characteristic exponent of a dynamical system is a quantity that characterizes the rate of separation of infinitesimally close trajectories. Quantitatively, two trajectories in phase space with initial separation vector diverge at a rate given by

In the theory of ordinary differential equations (ODEs), Lyapunov functions, named after Aleksandr Lyapunov, are scalar functions that may be used to prove the stability of an equilibrium of an ODE. Lyapunov functions are important to stability theory of dynamical systems and control theory. A similar concept appears in the theory of general state-space Markov chains usually under the name Foster–Lyapunov functions.

In control engineering and system identification, a state-space representation is a mathematical model of a physical system specified as a set of input, output, and variables related by first-order differential equations or difference equations. Such variables, called state variables, evolve over time in a way that depends on the values they have at any given instant and on the externally imposed values of input variables. Output variables’ values depend on the state variable values and may also depend on the input variable values.

In mathematics, Laplace's method, named after Pierre-Simon Laplace, is a technique used to approximate integrals of the form

The Lyapunov equation, named after the Russian mathematician Aleksandr Lyapunov, is a matrix equation used in the stability analysis of linear dynamical systems.

In mathematics, a Hurwitz matrix, or Routh–Hurwitz matrix, in engineering stability matrix, is a structured real square matrix constructed with coefficients of a real polynomial.

The Duffing equation, named after Georg Duffing (1861–1944), is a non-linear second-order differential equation used to model certain damped and driven oscillators. The equation is given by

Nonlinear control theory is the area of control theory which deals with systems that are nonlinear, time-variant, or both. Control theory is an interdisciplinary branch of engineering and mathematics that is concerned with the behavior of dynamical systems with inputs, and how to modify the output by changes in the input using feedback, feedforward, or signal filtering. The system to be controlled is called the "plant". One way to make the output of a system follow a desired reference signal is to compare the output of the plant to the desired output, and provide feedback to the plant to modify the output to bring it closer to the desired output.

In the mathematics of evolving systems, the concept of a center manifold was originally developed to determine stability of degenerate equilibria. Subsequently, the concept of center manifolds was realised to be fundamental to mathematical modelling.

LaSalle's invariance principle is a criterion for the asymptotic stability of an autonomous dynamical system.

In applied mathematics, comparison functions are several classes of continuous functions, which are used in stability theory to characterize the stability properties of control systems as Lyapunov stability, uniform asymptotic stability etc.

In mathematics, stability theory addresses the stability of solutions of differential equations and of trajectories of dynamical systems under small perturbations of initial conditions. The heat equation, for example, is a stable partial differential equation because small perturbations of initial data lead to small variations in temperature at a later time as a result of the maximum principle. In partial differential equations one may measure the distances between functions using L^p norms or the sup norm, while in differential geometry one may measure the distance between spaces using the Gromov–Hausdorff distance.

In control theory, a control-Lyapunov function (CLF) is an extension of the idea of Lyapunov function to systems with control inputs. The ordinary Lyapunov function is used to test whether a dynamical system is (Lyapunov) stable or asymptotically stable. Lyapunov stability means that if the system starts in a state in some domain D, then the state will remain in D for all time. For asymptotic stability, the state is also required to converge to . A control-Lyapunov function is used to test whether a system is asymptotically stabilizable, that is whether for any state x there exists a control such that the system can be brought to the zero state asymptotically by applying the control u.

In control theory, backstepping is a technique developed circa 1990 by Myroslav Sparavalo, Petar V. Kokotovic, and others for designing stabilizing controls for a special class of nonlinear dynamical systems. These systems are built from subsystems that radiate out from an irreducible subsystem that can be stabilized using some other method. Because of this recursive structure, the designer can start the design process at the known-stable system and "back out" new controllers that progressively stabilize each outer subsystem. The process terminates when the final external control is reached. Hence, this process is known as backstepping.

For applied mathematics, in nonlinear control theory, a non-linear system of the form is said to satisfy the small control property if for every there exists a so that for all there exists a so that the time derivative of the system's Lyapunov function is negative definite at that point.

The Lyapunov–Malkin theorem is a mathematical theorem detailing stability of nonlinear systems.

In mathematical physics and the theory of partial differential equations, the solitary wave solution of the form is said to be orbitally stable if any solution with the initial data sufficiently close to forever remains in a given small neighborhood of the trajectory of

Input-to-state stability (ISS) is a stability notion widely used to study stability of nonlinear control systems with external inputs. Roughly speaking, a control system is ISS if it is globally asymptotically stable in the absence of external inputs and if its trajectories are bounded by a function of the size of the input for all sufficiently large times. The importance of ISS is due to the fact that the concept has bridged the gap between input–output and state-space methods, widely used within the control systems community.

References

Further reading

• Bhatia, Nam Parshad; Szegő, Giorgio P. (2002). Stability theory of dynamical systems. Springer. ISBN   978-3-540-42748-3.
• Chervin, Robert (1971). Lyapunov Stability and Feedback Control of Two-Stream Plasma Systems (PhD). Columbia University.
• Gandolfo, Giancarlo (1996). Economic Dynamics (Third ed.). Berlin: Springer. pp. 407–428. ISBN   978-3-540-60988-9.
• Parks, P. C. (1992). "A. M. Lyapunov's stability theory—100 years on". IMA Journal of Mathematical Control & Information. 9 (4): 275–303. doi:10.1093/imamci/9.4.275.
• Slotine, Jean-Jacques E.; Weiping Li (1991). Applied Nonlinear Control. NJ: Prentice Hall.
• Teschl, G. (2012). Ordinary Differential Equations and Dynamical Systems. Providence: American Mathematical Society. ISBN   978-0-8218-8328-0.
• Wiggins, S. (2003). Introduction to Applied Nonlinear Dynamical Systems and Chaos (2nd ed.). New York: Springer Verlag. ISBN   978-0-387-00177-7.

This article incorporates material from asymptotically stable on PlanetMath, which is licensed under the Creative Commons Attribution/Share-Alike License.