Adaptive Control Theory

Core Idea

Adaptive control automatically adjusts controller parameters in real-time to compensate for changing plant dynamics or initially unknown parameters. Key approaches include direct adaptive control (estimate the controller parameters directly) and indirect adaptive control (estimate plant parameters, then compute controller parameters). Lyapunov stability analysis guarantees convergence of parameter estimates and stability of the closed loop. Model Reference Adaptive Systems (MRAS) adjust controller gain to make closed-loop behavior track a reference model; Self-Tuning Regulators estimate plant parameters recursively and solve the control problem at each step. Persistence of excitation is required for convergence of parameter estimates.

How It's Best Learned

Simulate a plant with uncertain or time-varying parameters (e.g., mass m unknown, or drag coefficient changing). Design a direct adaptive controller using the MIT rule or Lyapunov synthesis: compute parameter update laws such that a Lyapunov function V decreases along closed-loop trajectories. Observe that the error between the system and the reference model decreases only when the input signal is persistently exciting — without sufficient excitation, parameters drift with no feedback about estimate quality.

Common Misconceptions

• Adaptive control automatically tunes itself for any system; without persistent excitation (sufficient input variance at multiple frequencies), parameters cannot converge, and the system may become unstable or diverge slowly.
• Faster parameter adaptation (larger adaptation gains) is always better; too-fast adaptation can lead to bursting (rapid oscillations) or instability when disturbances are large, whereas slower adaptation with proper excitation is more robust.
• Lyapunov stability guarantees globally asymptotic stability; Lyapunov analysis for adaptive systems often guarantees stability in the sense of Lyapunov (bounded) but not convergence of parameter estimates to true values — only convergence of the error to zero is guaranteed.

Explainer

You've studied state feedback control where controller gains are computed offline assuming the plant model is known. But real systems have unknown or changing parameters: motor inductance varies with temperature, aerodynamic coefficients change with altitude and airspeed, plant wear changes friction and damping. Adaptive control continuously adjusts the controller parameters online to compensate for these changes.

Direct adaptive control adjusts the controller parameters (e.g., proportional gain Kp, integral gain Ki) directly based on observed error. The simplest approach is the MIT rule: dθ/dt = −γ·e(t)·∂y/∂θ, where θ is a controller parameter, e is the error, and ∂y/∂θ is the sensitivity of the output to parameter changes. This steepest-descent law adjusts parameters to minimize error. The problem: without persistent excitation (sufficient input signal variation at the frequencies where the system responds), the parameter estimates drift randomly despite zero instantaneous error. This counterintuitive behavior is the biggest challenge in adaptive control — zero error at this moment does not tell you whether your parameter estimate is correct for the next disturbance.

Indirect adaptive control separates the problem into two steps: (1) estimate unknown plant parameters online using recursive least squares (RLS) or other estimation algorithms; (2) compute controller parameters from current parameter estimates (the certainty equivalence principle — treat the estimates as true). For example, if you estimate the plant's natural frequency and damping, you can immediately compute the optimal LQR gains for that estimated plant. As parameter estimates improve, the controller automatically improves. Indirect control is more modular: parameter estimation and control design can be validated independently. If the estimator is robust, the subsequent control computation is transparent.

Model Reference Adaptive Systems (MRAS) define a reference model that describes desired closed-loop behavior, then adapt the controller to make the actual plant output track the reference. The error between plant and reference is fed back to an adaptation law that adjusts the controller. MRAS is intuitive and works well when the reference model is achievable (its bandwidth is not faster than the plant can follow). The method is older (1960s) and less rigorous than Lyapunov-based approaches but remains practical.

Lyapunov stability analysis guarantees convergence and stability rigorously. You propose a Lyapunov function V (a measure of system energy or combined error + parameter error) and choose the adaptation law such that dV/dt ≤ 0 along trajectories. For example, in a direct adaptive controller, define V = e² + (θ̃)²·P (where θ̃ is the parameter estimation error and P is a positive weighting matrix). If you can design dθ/dt such that dV/dt ≤ −e², then V decreases, guaranteeing that both error and parameter estimation error remain bounded. Under persistent excitation, estimates converge to true values. The challenge: Lyapunov analysis requires knowing the plant structure (knowing what to estimate) and is more complex for MIMO systems or nonlinear plants.

Persistence of excitation is non-negotiable. The condition is technical (∫_t^t+T φ(τ)φ(τ)ᵀ dτ ≥ αI for some α > 0, period T, and all t), but intuitively: the input signal must have variance at the frequency scales where the plant responds, for a long enough duration to resolve the parameters of interest. In a constant setpoint with no disturbances, the input is zero, so persistence of excitation is violated and estimates drift. In practice, natural disturbances often provide sufficient excitation, but if not, small probing signals (dither) can be added — at the cost of control effort and output ripple.

Industrial applications of adaptive control include autopilots (estimating aircraft aerodynamics that change with altitude/speed), motor drives (estimating electrical constants and load torque), and process control (estimating reaction kinetics or heat transfer coefficients). The main limitation is that rigorous stability guarantees require unrealistic assumptions (known plant structure, persistent excitation, linear time-invariant system). Modern robust adaptive control relaxes these requirements by combining adaptation with robust controllers — the adaptive law is slow enough that the robust controller maintains stability even if adaptation is sluggish or estimates are noisy. This hybrid approach — conservative robust control with slow online tuning — is increasingly common in practice.