[足式机器人]Part4 南科大高等机器人控制课 CH10 Bascis of Stability Analysis

本文仅供学习使用
本文参考：
B站：CLEAR_LAB
笔者带更新-运动学
课程主讲教师：
Prof. Wei Zhang

---

This lecture introduces basic concepts and results on Lyapunov stability of nonlinear systems

1. Background

1.1 What is Stability Analysis

• system asymptotic/??simp't?tik,-k?l/ 渐进的 behavior (not too much about transient/'tr?nz??nt/短暂的)
• ability to return to the desired asymptotic behavior (nout just convergence)

示例-小球平衡系统与反馈控制

1.2 General ODE Models for Dynamical Systems

• ODE: $\dot{x}=f\left(x,u\right)$ , with $x\left(0\right)=x_0$
  $x\in \mathcal{X}?{\mathbb{R}}^n$ : state
  $u\in \mathcal{U}?{\mathbb{R}}^m$ : control input
  $f:{\mathbb{R}}^n\times {\mathbb{R}}^m\to {\mathbb{R}}^n$ : (time-invariant) vector field
• System output $y=g\left(x,u\right)$
• (static)Control law : $\mu :\mathcal{X}\to \mathcal{U}$ , $u=\mu \left(x\right)$
  
• Closed-loop dynamics under $\mu$ : $\dot{x}=f\left(x,\mu \left(x\right)\right)$ $?\dot{x}=f_{\mathrm{cl}}\left(x\right)$
• Autonomous system :
  $\dot{x}=f\left(x,u\right)$ , with $x\left(0\right)=x_0$

1.3 Example

1.3.1 Pendulum

1.3.2 Adaptive Control

Closed-loop dynamics under adaptive control:
$$\{\begin{array}{l}\dot{y}=y+u\\ u=?ky,\dot{k}=y^2\end{array}$$

1.4 Equilibrium Point of Dynamical Systems

Definition 1 (Equilibrium Point) - 平衡点
A state $x^{?}$ is an equilibrium point of system (1) if once $x\left(t\right)=x^{?}$ , it remains equal to $x^{?}$ at all future time.

• Mathematically : $f\left(x^{?}\right)=0$
• e.g. undamped pendulum with no driving force: $f\left(x\right)=\dot{x}$ velocity
  $\dot{x}=\left[\begin{array}{c}{x}_2\\ \frac{g}{l}\cos x_1\end{array}\right]=0?\{\begin{array}{l}{x}_2=0\\ \cos x_1=0,x_1=\frac{2k\pi +\pi }{2},k\in \mathbb{Z}\end{array}$

1.5 Invariant Set of Dynamical Systems

Definition 2 (Invariant Set) - 不变集
A set $E$ is an invariant set of system (1) if every trajectory which starts from a point $E$ remains in $E$ at all future time.

• Mathematically : If $x\left(t_0\right)\in E$ , then $x\left(t\right)\in E,?t?t_0$
• e.g. Closed-loop dynamics under adaptive control :
  
  $f\left(x\right)=\dot{x}=\left[\begin{array}{c}{x}_1?x_1{x}_2\\ {x_1}^2\end{array}\right]?\{\begin{array}{l}{x}_1=0\\ x_2=arbitrary\end{array}?E=\left\{x\in {\mathbb{R}}^2,x_1=0\right\}$

2. Lyapunov Stability Definitions

Stability :

1. about equilibrium
2. ability to stay close or return to equilibrium

2.1 Lyapunov Stability Definitions

Consider a time-invariant autonomous (with no control) nonlinear system : (on closed-loop system : $\dot{x}=f\left(x,u\left(x\right)\right)=f_{\mathrm{cl}}\left(x\right)$)
$\dot{x}=f\left(x\right),x\in {\mathbb{R}}^n$ , with I.C. $x\left(0\right)=x_0$
$f\left(x\right)$ - vector field

• Assumption :
  (i) $f$ Lipshitz continuous —— existence & uniqueness of ODE
  (ii) origin is an isolated equilibrium $f\left(0\right)=0$ —— $f\left(x^{?}\right)=0$
  If equilibrium $x^{?}$ is not at the origin define $\tilde{x}=x?x^{?}$ , $\dot{\tilde{x}}=\dot{x}?0=f\left(\tilde{x}+x^{?}\right)$
• Stability Definitions :

1. The equilibrium $x=0$ is called stable(stay close to equilibrium) in the sense of Lyapunov , if
   $??\delta$ argument —— $??>0,?\delta >0,s.t.\Vert x\left(0\right)\Vert ?\delta ?\Vert x\left(t\right)\Vert ??,?t?0$
   
   Objective: For any $?>0$ , ensure $\Vert x\left(t\right)\Vert ??$ for all $t$
   our choice : selecting initial state $x\left(0\right)$
   stability : objective can be ensure by choosing I.C. sufficiently small

2. asymptotically stable (stay close + convergence) if it is stable and $\delta$ can be chosen so that
   $\Vert x\left(0\right)\Vert ?\delta ?\Vert x\left(t\right)\Vert \to 0$ as $t\to \infty$ (convergence)

3. exponentially stable if there exist positive constants $\delta ,\lambda ,c$ such that
   $\Vert x\left(t\right)\Vert ?c\Vert x\left(0\right)\Vert e^{?\lambda t},?\Vert x\left(0\right)\Vert ?\delta$
   

4. globallt asymptomtotically / exponentially stable (G.A.S / G.E.S) if the above conditions holds for all $\delta >0$

5. Region of Attraction - 吸引域 : R A ? { x ∈ R n : w h e v e r ?? x ( 0 ) = x , t h e n ?? x ( t ) → 0 } R_A\triangleq \left\{ x\in \mathbb{R} ^n:whever\,\,x\left( 0 \right) =x,then\,\,x\left( t \right) \rightarrow 0 \right\} RA??{x∈Rn:wheverx(0)=x,thenx(t)→0}
   Globaly asymptotically stable $R_A?{\mathbb{R}}^n$

2.2 Stability Examples using 2D Phase Portrait

• Undamped pendulum with no driving force :
  $\dot{x}=\left[\begin{array}{c}{x}_2\\ \frac{g}{l}\cos x_1\end{array}\right]=0?\{\begin{array}{l}{x}_2=0\\ \cos x_1=0,x_1=\frac{2k\pi +\pi }{2},k\in \mathbb{Z}\end{array}$
  
• Closed-loop dynamics under adaptive control :
  $f\left(x\right)=\dot{x}=\left[\begin{array}{c}{x}_1?x_1{x}_2\\ {x_1}^2\end{array}\right]?\{\begin{array}{l}{x}_1=0\\ x_2=arbitrary\end{array}?E=\left\{x\in {\mathbb{R}}^2,x_1=0\right\}$
  
• Does attractiveness implies stable in Lyapunov sense?
  Answer is No —— e.g. $\{\begin{array}{l}{\dot{x}}_1={x_1}^2?{x_2}^2\\ {\dot{x}}_2=2x_1{x}_2\end{array}$ —— asymptotically stable : 1. stable 2. convergence
  By inspection of its vector field, we see that $x\left(t\right)\to 0$ for all $x\left(0\right)\in {\mathbb{R}}^2$
  However, there is no $\delta$-ball satisfying the Lyapunov stability condition
  
  convergence but not stable

3. Lyapunov Stability Theorem

3.1 How to verify stability of a system?

• Find explicit solution of the ODE $x\left(t\right)$ and check stability definitions (typically not possible for nonlinear systems) —— e.g. $x\left(t\right)=e^{?t}{x}_0$
• Numerical simulations of ODE do not provide stability guarantees and offer limited insights
• Need to determine stability without explicitly solving the ODE
• Perferably, analysis only depends on the vector field
• The most powerful tool is : Lyapunov function
• State trajectory $x\left(t\right)$ governed by complex dynamics in ${\mathbb{R}}^n$ —— $\dot{x}\left(t\right)=f\left(x\left(t\right)\right)$
• Lyapunov function $V:{\mathbb{R}}^n\to \mathbb{R}$ maps $x\left(t\right)$ to a scalar function of time $V\left(x\left(t\right)\right)$
  scalar - $V\left(x\left(t\right)\right)?\dot{V}\left(x\left(t\right)\right)=\frac{\mathrm{d}}{\mathrm{d}t}V\left(x\left(t\right)\right)=g\left(V\left(\right)\right)$ - scalar ODE
• If the function is designed such that : $\left[x\left(t\right)\to equilibrium\right]?\left[V\left(x\left(t\right)\right)\to 0\right]$. Then we can study $V\left(x\left(t\right)\right)$ as function of time $t$ to infer stability of the state trajectory in ${\mathbb{R}}^n$

3.2 Sign Definite Functions

Assume that $0\in D?{\mathbb{R}}^n$

• $g:D\to \mathbb{R}$ is called positive semidefinite (PSD) on $D$ if $g\left(0\right)=0$ and $g\left(0\right)?0,?x\in D$
  For quadratic function : $g\left(x\right)=x^{\mathrm{T}}Px:\left[gisPSD\right]?\left[PisaPSDmatrix\right]$
  e.g. : $g\left(x\right)={\left[\begin{array}{c}{x}_1\\ x_2\end{array}\right]}^{\mathrm{T}}P\left[\begin{array}{c}{x}_1\\ x_2\end{array}\right]={x_1}^2+x_1{x}_2+3{x_2}^2$
• $g:D\to \mathbb{R}$ is called positive definite (PD) on $D$ if $g\left(0\right)=0$ and g ( x ) > 0 , ? x ∈ D \ { 0 } g\left( x \right) >0,\forall x\in D\backslash\{0\} g(x)>0,?x∈D\{0}
  Similarly, if $g\left(x\right)=x^{\mathrm{T}}Px$ is quadratic, then $\left[gisPD\right]?\left[PisaPDmatrix\right]$
• $g$ is negative semidefinite (NSD) if $?g$ is PSD
• $g:{\mathbb{R}}^n\to \mathbb{R}$ is radically unbounded if $g\left(x\right)\to \infty$ as $\Vert x\Vert \to \infty$
  

3.3 Lyapunov Stability Theorem

[Lyapunov Theorem] : Let $D?{\mathbb{R}}^n$ be a set containing an open neighborhood of the origin. If there exists a ${\mathcal{C}}^1$ (continuous differentiable) function $V:D\to \mathbb{R}$ (observable condition - e.g. $V\left(x\right)={x_1}^2,x=\left[\begin{array}{c}{x}_1\\ x_2\end{array}\right]=\left[\begin{array}{c}0\\ 100\end{array}\right],V\left(x\right)=0isPSD$) such that
$$\{\begin{array}{l}VisPD\\ \dot{V}\left(x\right)??V{\left(x\right)}^{\mathrm{T}}f\left(x\right)isNSD\end{array}$$
the value of $V$ along sys state trajectory nonincreasing $\dot{V}\left(x\left(t\right)\right)={\left(\frac{?V}{?x}\right)}^{\mathrm{T}}\frac{?x}{?t}=?V{\left(x\right)}^{\mathrm{T}}f\left(x\right),?V\left(x\right)\left[\begin{array}{c}\frac{?V}{?x_1}\\ \frac{?V}{?x_2}\\ ?\\ \frac{?V}{?x_{\mathrm{n}}}\end{array}\right]$ , $?V{\left(x\right)}^{\mathrm{T}}f\left(x\right)?Lf\left[V\right]$ Lie derivative of $V\left(?\right)$ with vetor field $f$

then the origin is stable. If in addition ,
$$\dot{V}\left(x\right)??V{\left(x\right)}^{\mathrm{T}}f\left(x\right)isND$$
then the origin is asymptotically stable —— Value of $V$ along sys state trajectory is decreasing

Remarks:
A PD ${\mathcal{C}}^1$ function satisfying above equation will be called a Lyapunov function (1+2 or 1+3)
Under condition 3 , if $V$ is also radially unbounded —— globally asympotically stable (G.A.S)

3.4 Proof of Lyapunov Stability Theorem

Main idea : 1+2 —— stability

• Fact : suppose $V$ function satisfies 1+2 , then the sub level set Ω b ( V ) ? { x ∈ R n : V ( x ) ? b } \varOmega _{\mathrm{b}}\left( V \right) \triangleq \left\{ x\in \mathbb{R} ^n:V\left( x \right) \leqslant b \right\} Ωb?(V)?{x∈Rn:V(x)?b} is forward invariant
  Proof Fact : if $x\left(0\right)\in {\Omega }_{\mathrm{b}}$ fro some $b?0$ , we have $V\left(x\left(t\right)\right)?V\left(x\left(0\right)\right)?b$ $?x\left(t\right)\in {\Omega }_{\mathrm{b}}$

• Proof of stability : Given $\epsilon >0$ , goal is to find $\delta >0$, such that $\Vert x\left(0\right)\Vert ?\delta ?\Vert x\left(t\right)\Vert ?\epsilon$
  

1. Ω b { 0 } \varOmega _{\mathrm{b}}\left\{ 0 \right\} Ωb?{0} if $b=0$ (due to P.D. of $V$)
2. As $b$ increases , level set ${\Omega }_{\mathrm{b}}$ grows in size until bitting $Ball?\epsilon$ then fix $b=\hat{b}$
3. Find $Ball?\delta$ inside ${\Omega }_{\mathrm{b}}$ (because $V$ is continuous at $0$) then $x_0\in Ball?\delta ?x_0\in {\Omega }_{\mathrm{b}}?x\left(t\right)\in {\Omega }_{\mathrm{b}}$ (${\Omega }_{\mathrm{b}}$ is invariant)

Sketch of proof of Lyapunov Stability theorem:

• First show stability under condition 2

Define sublevel set Ω b = { x ∈ R n : V ( x ) ? b } \varOmega _{\mathrm{b}}=\left\{ x\in \mathbb{R} ^n:V\left( x \right) \leqslant b \right\} Ωb?={x∈Rn:V(x)?b}. Condition 2 implies $V\left(x\left(t\right)\right)$ nonincreasing along system trajectory $?$ if $x_0\in {\Omega }_{\mathrm{b}}$ , then $x\left(t\right)\in {\Omega }_{\mathrm{b}}$, $?t$
Given arbitrary $\epsilon >0$ , if we can find $\delta ,b$ such that $B\left(0,\delta \right)?{\Omega }_{\mathrm{b}}?B\left(0,\epsilon \right)$. Then the Lyapunov stability conditions are satisfied. Below is to show how we can find such $b$ and $\delta$
$V$ is continuous $?$ $m={\min }_{\Vert x\Vert =\epsilon }V\left(x\right)$ exists (due to Weierstrass theorem). In addition, $V$ is PD $?$ $m>0$. Therefore, if we choose $b\in \left(0,m\right)$ , then ${\Omega }_{\mathrm{b}}?B\left(0,\epsilon \right)$
$V\left(x\right)$ is continuous at origin $?$ for any $b>0$ , there exists $\delta >0$ such that $\left|V\left(x\right)?V\left(0\right)\right|=V\left(x\right)<b,?x\in B\left(0,\delta \right)$ . This implies that $B\left(0,\delta \right)?{\Omega }_{\mathrm{b}}$

• Second, show asymptotic stability under condition 3:

We know $V\left(x\left(t\right)\right)$ decreases monotonically as $t\to \infty$ and $V\left(x\left(t\right)\right)?0$, $?t$. Therefore, $c={\lim }_{t\to \infty }V\left(x\left(t\right)\right)$ exists . So it suffices to show $c=0$. Let us use a contradiction argument.
Suppose $c\ne 0$. Then $c>0$. Therefore, x ( t ) ? Ω c = { x ∈ R n : V ( x ) ? c } x\left( t \right) \notin \varOmega _{\mathrm{c}}=\left\{ x\in \mathbb{R} ^n:V\left( x \right) \leqslant c \right\} x(t)∈/Ωc?={x∈Rn:V(x)?c} , $?t$ . We can choose $\beta >0$ such that $B\left(0,\beta \right)?{\Omega }_{\mathrm{c}}$ (due to continuity of $V$ at $0$)
Now let $a=?{\max }_{\beta ?\Vert x\Vert ?\epsilon }\dot{V}\left(x\right)$. Since $V$ is ND, then $a>0$
$V\left(x\left(t\right)\right)=V\left(x\left(0\right)\right)+{\int }_0^t\dot{V}\left(x\left(s\right)\right)\mathrm{d}s?V\left(x\left(0\right)\right)?a?t<0$ for sufficiently large $t$. $?$ contradiction !

3.5 Exponential Lyapunov Function

Definition 3 (Exponential Lyapunov Function) —— Important for application
$V:D\to \mathbb{R}$ is called an Exponential Lyapunov Function (ELF) on $D?{\mathbb{R}}^n$ if $?k_1,k_2,k_3,\alpha >0$ such that
$\{\begin{array}{l}{k}_1{\Vert x\Vert }^{\alpha }?V\left(x\right)?k_2{\Vert x\Vert }^{\alpha }\\ {\mathcal{L}}_{\mathrm{f}}V\left(x\right)??k_{3}V\left(x\right)\end{array}$

Lyapunov stability $?{\mathcal{C}}^1$ func $V$
$V$ is PD - deserable ; $\dot{V}$ is ND/NSD
$k_1{\Vert x\Vert }^{\alpha }?V\left(x\right)?k_2{\Vert x\Vert }^{\alpha }$ $?V$ is PD (radially unbounded)
${\mathcal{L}}_{\mathrm{f}}V\left(x\right)??k_{3}V\left(x\right)$ $?\dot{V}$ is ND, $\dot{V}??k_{3}V$

Droof sketch :
recall : $z\in {\mathbb{R}}^1,\dot{z}=?k_{3}z?z\left(t\right)=e^{?k_{3}t}z\left(0\right)$
By comparison theorem : $\dot{V}??k_{3}V?V\left(t\right)?e^{?k_{3}t}V\left(0\right)$
$?{\Vert x\left(t\right)\Vert }^{\alpha }?\frac{1}{k_1}V\left(x\left(t\right)\right)?\frac{1}{k_1}{e}^{?k_{3}t}V\left(x\left(0\right)\right)?\frac{k_2}{k_1}{e}^{?k_{3}t}{\Vert x\left(0\right)\Vert }^{\alpha }?{\Vert x\left(t\right)\Vert }^{\alpha }?c{e}^{?\beta t}{\Vert x\left(0\right)\Vert }^{\alpha }$

Theorem 1 (ELF Theorem)
If system 2 has an ELF, then it is exponentially stable

3.6 Stability Analysis Examples

• Example 1 :
  $\{\begin{array}{l}{\dot{x}}_1=?x_1+x_2+x_1{x}_2\\ {\dot{x}}_2=x_1?x_2?{x_1}^2?{x_2}^3\end{array}$ Try $V\left(x\right)={\Vert x\Vert }^2={x_1}^2+{x_2}^2$
  equilibrium : $\dot{x}=0?\left(\begin{array}{c}{x}_1\\ x_2\end{array}\right)=\left(\begin{array}{c}0\\ 0\end{array}\right)$
  check Lyapunov conditions

1. $V\left(x\right)={x_1}^2+{x_2}^2=x^{\mathrm{T}}\left[\begin{array}{cc}1& 0\\ 0& 1\end{array}\right]x$ is PD and ${\mathcal{C}}^1$
2. ${\mathcal{L}}_{\mathrm{f}}V\left(x\right)={\left(\frac{?V}{?x}\right)}^{\mathrm{T}}f\left(x\right)={\left[\begin{array}{c}2x_1\\ 2x_2\end{array}\right]}^{\mathrm{T}}\left[\begin{array}{c}{f}_1\left(x\right)\\ f_2\left(x\right)\end{array}\right]=2x_1\left(?x_1+x_2+x_1{x}_2\right)+2x_2\left(x_1?x_2?{x_1}^2?{x_2}^3\right)=?2{\left(x_1?x_2\right)}^2?2{x_2}^4?ND$

$?$ system is asymptotically stable

• Example 2 :
  $\{\begin{array}{l}{\dot{x}}_1=?x_1+x_1{x}_2\\ {\dot{x}}_2=?x_2\end{array}$
  Can we find a simple quadratic Lyapunov function ? First try $V\left(x\right)={x_1}^2+{x_2}^2$

1. $V$ is PD
2. ${\mathcal{L}}_{\mathrm{f}}V\left(x\right)=?2\left({\left(x_2?4\right)}^2?8\right)$ Not ND

In fact the system does not have any (global polynomial Lyapunov function.) But it is GAS with a Lyapunov function $V\left(x\right)=\ln \left(1+{x_1}^2\right)+{x_2}^2$

4. Lyapunov Stability of Linear Systems

4.1 Stability of Linear Systems

Consider autonomous linear system : $\dot{x}=f\left(x\right)=Ax$

• Recall solution to the linear system : $x\left(t\right)=e^{At}x\left(0\right)$
• If isolated equilibrium only possible equilibrium is origin $x=0$
  $f\left(x\right)=0?Ax=0$ : 1. if $A$ is nonsingular $?x=0$ . 2. If $A$ is singular, ?? $A$ is the set of equilibrium
• Fact : Origin asympt. stable $?$ $\mathrm{Re}\left({\lambda }_{\mathrm{i}}\right)<0$ for all eigenvalues ${\lambda }_{\mathrm{i}}$ of $A$
  suppose we have isolated equilibrium $x^{?}=0$
  For simplicity, consider a simple case when $A$ is diagonalizable : $A=TD{T}^{?1}$ where $D=\left[\begin{array}{cccc}{\lambda }_1& & & \\ & {\lambda }_2& & \\ & & ?& \\ & & & {\lambda }_{\mathrm{n}}\end{array}\right]$ $?e^{At}=T{e}^{Dt}{T}^{?1}=T\left[\begin{array}{cccc}{e}^{{\lambda }_{1}t}& & & \\ & e^{{\lambda }_{2}t}& & \\ & & ?& \\ & & & e^{{\lambda }_{\mathrm{n}}t}\end{array}\right]T^{?1}$ . If $\mathrm{Re}\left({\lambda }_{\mathrm{i}}\right)<0$ , for all $i$ , every entry of $e^{At}\to 0$ $?e^{At}x\left(0\right)$ expenentially
• Discrete time system : $x\left(k+1\right)=Ax\left(k\right)$ os asymptotically stable if $eig\left(A\right)$ inside unit circle

4.1 Lyapunov Function of Linear Systems

• Consider a quadratic Lyapunov function candidate : $V\left(x\right)=x^{\mathrm{T}}Px$ , with $P\in {\mathbb{R}}^{n\times n}$
  V is PD $?P?0$ ( $P$ is a PD matrix)
  ${\mathcal{L}}_{\mathrm{f}}V$ is ND $?$ ${\mathcal{L}}_{\mathrm{f}}V?{\left(\frac{?V}{?x}\right)}^{\mathrm{T}}Ax={\left(2Px\right)}^{\mathrm{T}}Ax=2x^{\mathrm{T}}{P}^{\mathrm{T}}Ax$ or equirelatly, $\dot{V}\left(x\left(t\right)\right)={\dot{x}}^{\mathrm{T}}Px+x^{\mathrm{T}}P\dot{x}=x^{\mathrm{T}}{A}^{\mathrm{T}}Px+x^{\mathrm{T}}PAx$ —— Is $2P^{\mathrm{T}}A=A^{\mathrm{T}}P+PA$ ? —— $x^{\mathrm{T}}{P}^{\mathrm{T}}Ax=x^{\mathrm{T}}{A}^{\mathrm{T}}Px$

$?V$ is LF if $P$ is PD and $A^{\mathrm{T}}P+PA$ is ND

Fact ： for Linear System , quadratic form of LF , ai all we need to consider. —— $A$ is asym stable if and only if ??

In proof of the above function , we assumed $P$ is symmetric so $P^{\mathrm{T}}A=PA$
e.g. $P^{\mathrm{T}}A=PA$ , $Q=\left[\begin{array}{cc}1& 1\\ ?1& 1\end{array}\right],g\left(x\right)=x^{\mathrm{T}}Qx={\left[\begin{array}{c}{x}_1\\ x_2\end{array}\right]}^{\mathrm{T}}\left[\begin{array}{cc}1& 1\\ ?1& 1\end{array}\right]\left[\begin{array}{c}{x}_1\\ x_2\end{array}\right]={x_1}^2+{x_2}^2?{\left[\begin{array}{c}{x}_1\\ x_2\end{array}\right]}^{\mathrm{T}}\left[\begin{array}{cc}1& 0\\ 0& 1\end{array}\right]\left[\begin{array}{c}{x}_1\\ x_2\end{array}\right]$ ， $\hat{Q}=\frac{1}{2}Q+\frac{1}{2}{Q}^{\mathrm{T}}$

Fact ： $A$ is asym stable if and only if

1. $?P?0$ , such that $A^{\mathrm{T}}P+PA?0$
2. equivalently , for any $Q?0,?P$ such that $A^{\mathrm{T}}P+PA=?Q$ (Lyapunov equation)

4.2 Stability Conditions for Linear Systems

Theorem 1 (Stability Conditions for Linear System)
For an autonomous Linear system $\dot{x}=Ax$. The following statements are equivalent.

• (Linear) System is (globally) asmptotically stable
• (Linear) System is (globally) exponentially stable
• $\mathrm{Re}\left({\lambda }_{\mathrm{i}}\right)<0$ for all eigenvalues ${\lambda }_{\mathrm{i}}$ of $A$ —— lie on open left half complex plane (OLHP)
• System has a quadratic Lyapunov function $V\left(x\right)=x^{\mathrm{T}}Px$
• For ant symmetric $Q?0$ , there exists a symmetric $P?0$ that solves the following Lyapunov equation :
  $$A^{\mathrm{T}}P+PA=?Q$$
  $Q?0$ is given , $P$ is the variale to be solved , and $V\left(x\right)=x^{\mathrm{T}}Px$ is Lyapunov function of the system

5. Converse Lyapunov Function

When there is a Lyapunov Function?

• Converse Lyapunov Theorem for Asymptotic Stability
  origin asymptotically stable ; $f$ is locallt Lipschitz on D with region of attration $R_A$ $?Vs.t.$ $V$ is continuuos and PD on $R_A$ ; $L_{\mathrm{f}}V$ is ND on $R_A$ ; $V\left(x\right)\to \infty$ as $x\to ?R_{\mathrm{A}}$
  convex result that is not constructive

• Converse Lyapunov Theorem for Exponential Stability
  origin exponentially stable on $D$ ; $f$ is ${\mathcal{C}}^1$ $??$ an ELF $V$ on $D$

• For nonlinear sys , $?V?$ stability (sufficient condition)

• Proofs are involved especially for the converse theorem for asymptotic stability

• Important : proofs of converse theorems often assume the knowledge of system solution and hence are not constructive

6. Extension of Discrete-Time System

6.1 What about Discrete Time Systems?

• So far, all our definitions, results, examples are given using continuous dynamical system models.
• All of them have discrete-time counterparts. The ideas and conclusions are the “same” (in sprit)
• For example, given autonomous discrete-time system : $x\left(k+1\right)=f\left(x\left(k\right)\right)$ with $f\left(0\right)=0$ (origin is an isolated equilibrium)
  Rate of change of a function $V\left(x\right)$ along system trajectory can be defined as : ${\Delta }_{\mathrm{f}}V\left(x\right)=V\left(f\left(x\right)\right)?V\left(x\right)?V\left(x\left(k+1\right)\right)?V\left(x\left(k\right)\right)$ , where $L_{\mathrm{f}}V\left(x\right)={\left(\frac{?V}{?x}\right)}^{\mathrm{T}}f\left(x\right)$
  Asymptotically stable requires : $V$ is PD(observable all the bad behavior of ‘x’ shows up in $V$) and ${\Delta }_{\mathrm{f}}V$ is ND —— ${\Delta }_{\mathrm{f}}V\left(x\right)?0$ for all x ∈ R n / { 0 } x\in \mathbb{R} ^n/\left\{ 0 \right\} x∈Rn/{0}
  Exponentially stable requires : $k_1{\Vert x\Vert }^{\alpha }?V\left(x\right)?k_2{\Vert x\Vert }^{\alpha }and{\Delta }_{\mathrm{f}}V\left(x\right)??k_{3}V\left(x\right)$

6.2 Concluding Remarks

• We have learned different notions of internal stability, e.g. stability in Lyapunov sense, asymptotic stability, globally asymptotic stability (G.A.S), exponential stability, globally exponential stability(G.E.S)
• Sufficient condition to ensure stability is often the existence of a properly defined Lyapunov function
• Key requirements for a Lyapunov function :
  Positive definite and is zero at the system equilibrium
  Descease along system trajectory
• For linear system : G.A.S $?$ G.E.S $?$ Existence of a quadratic Lyapunov function
• The definitions and results in this lecture have sometimes been stated in simplified form to facilitate presentation. More general version can be found in standard textbooks on nonlinear systems
• Next Lecture : Semidefinite Programming and computational stability analysis