MPC Week 1 Introduction

.
ACS6116
Advanced Industrial Control
Week 1 Model Predictive Control
Dr Paul Trodden
Department of Automatic Control & Systems Engineering
1 / 253
.
.
Introduction to the module

Aim
This module aims to provide an introduction to the application
of advanced control techniques and the solution of control
problems often experienced in industrial environments. It
includes the advanced approach of model predictive control
(MPC) and covers the concepts of active noise (ANC) and
vibration control (AVC).
Organization
This week Model predictive control (Dr P Trodden)
Next week Active noise and vibration control (ANC/AVC)
(Drs MO Tokhi and SA Pope)
Third week Shared labs and tutorials
.
2 / 253
Teaching contact hours
25 hours of lectures
13 hours for Model predictive control
12 hours for ANC/AVC
12 hours of labs
11 hours for ANC/AVC
7 hours of tutorial sessions

4 hours for ANC/AVC
Around 110 hours of independent study time
3 / 253
.
.
Timetable Week 1
4 / 253
Timetable Week 3
5 / 253
.
.

Assessment
60% written examination
2-hour examination paper in May/June: answer 3 questions

from 4
2 questions on Model predictive control
1 question on Active noise control
1 question on Active vibration control
40% continuous assessment

20% Model predictive control
10% Active noise control
10% Active vibration control
6 / 253

Feedback
Feedback is an important part of how you learn
Applies to knowledge, understanding, specic and more

general skills
A key part of your academic and professional development
Learning is not just about the marks you get
Feedback can be from me, your peers and most

importantly yourself
Ultimately to benet from feedback you must reect on

your own learning
Make use of information provided in many forms make

sure you pick up feedback when it is provided
7 / 253
.
.

Feedback in this module
Reect on your own understanding throughout the module

self-feedback
Discussions with other students
Ask questions during/after lectures
In-class questions and exercises
Do the problem sets and attend labs and tutorial classes
Associate tutors in labs and tutorial classes
Individual written feedback on assessment performance
Whole-class feedback on exam performance
8 / 253
This week Model predictive control

Intended learning outcomes
1. Describe the receding horizon principle.
2. Construct a nite-horizon optimal control problem.
3. Re-formulate a nite-horizon optimal control problem as an
optimization problem.
4. Recall and evaluate the analytical expression for the
unconstrained MPC control law.
5. Describe and explain the dierences between LQR control and
MPC, including advantages and disadvantages.
6. Describe and explain qualitatively the eect of tuning parameters
on closed-loop performance.
7. Design MPC controllers with guaranteed nominal feasibility and
stability.
8. Modify MPC controllers to include oset-free tracking.
9. Write MATLAB code to design, implement and simulate MPC
controllers.
9 / 253
.
.
This week Model predictive control

Syllabus and outlines
1. What is Model Predictive Control?

2. Unconstrained model predictive control
3. Constrained model predictive control
4. Stability and feasibility
5. Oset-free tracking and disturbance rejection
10 / 253
Part I
What is Model Predictive Control?
11 / 253
.
.
Section 1
Overview
12 / 253
What is model predictive control (MPC)?

Reading: Ch. 1 of Maciejowski
r.
Controller
System
dynamics dx
dt = f(x, u, t), y = h(x, t)
possibly multivariable/MIMO
Aim: provide controls, u, so to
meet control objective
have output (y) track setpoint (r)
regulate state (x) to 0
minimize cost / maximize performance
satisfy constraints
System:
13 / 253
.
.
Constraints are ubiquitous
Physical limits
Input constraints, e.g. actuator limits
State constraints, e.g. capacity, ow limits
Performance specications
Maximum overshoot
Safety limits
Maximum pressure, temperature
Optimal operation often means operating near constraints
14 / 253
Performance
Operating near limits
.
Output
(Redrawn from Maciejowski)
15 / 253
.
.
Constraints are ubiquitous

but very tricky to handle
Classical and even most advanced control methods are
restricted to a-posterior handling of constraints
Anti-windup techniques for PID
Detuning optimal LQR
Trial and error
Why?
Because they all try to determine the control law o-line
t
uPID = KP e + KI
e() d + KD
=0
de
dt
uLQR = K x
.
16 / 253
Enter model predictive control
Constraints handled explicitly in design
Handles multivariable systems easily
Like LQR, optimizes a system performance measure
Allows optimal operation, closer to limits
MPC is the only advanced control technique to have made

signicant impact in industrial control domain1
It is the second-most popular control technique in industry2
1
J. M. Maciejowski. Predictive Control with Constraints. Prentice Hall,

2002, p. 352.
2
J. B. Rawlings and B. T. Stewart. Coordinating multiple
optimization-based controllers: New opportunities and challenges. In:
Journal of Process Control 18 (2008), pp. 839845.
17 / 253
.
.
MPC the basic idea
Measure the state or output of the system at the current

sampling instant
Solve an optimization problem to nd the best control

input to apply to the real system. The optimization
uses a dynamic model of the system to
predict/forecast behaviour for a limited time ahead
from the current state
chooses the forecast that optimizes the performance
measure while satisfying all constraints
Apply the optimized control input
Repeat at the next sampling instant
18 / 253
Section 2
The basic algorithm
19 / 253
.
.
MPC the basic algorithm
output
Constraint
Setpoint
time
.
k
k+1
input
Constraint
time
k
k+1
Constraint
20 / 253
output
Constraint
Setpoint
horizon
.
time
.
k
k+1
input
Constraint
time
k
k+1
Constraint
20 / 253
output
Constraint
Setpoint
horizon
.
time
.
k
k+1
input
Constraint
time
k
k+1
Constraint
20 / 253
output
Constraint
Setpoint
horizon
horizon
time
.
k
k+1
input
Constraint
time
k
k+1
Constraint
20 / 253
Three ingredients
Prediction
Optimization
Receding horizon
21 / 253
Prediction
Use dynamic model of plant to predict

Mainly, well use discrete-time state-space models
x(k + 1) = f (x(k), u(k))
y(k) = g (x(k))
where u(k), x(k), y(k) are input, state, output at k

Predictions from measured state x(k|k) = x(k)
{
}
u(k|k), u(k + 1|k), . . . , u(k + N 1|k)
|
{z
}
N future controls
{
}
x(k|k), x(k + 1|k), . . . , x(k + N|k)
|
{z
}
current plus N future states
}
{
y(k|k), y(k + 1|k), . . . , y(k + N|k)
{z
}
|
current plus N future outputs
22 / 253
.
.
Optimization
Choose forecast that minimizes a predicted cost

N
(
)
l x(k + j|k), u(k + j|k)
j=0
while satisfying any constraints on u, x, y
Use constrained optimization to do this
23 / 253
The receding horizon principle
Apply to the real system the rst control u (k|k) from the
optimized sequence
{
}
u (k|k), u (k + 1|k), . . . , u (k + N 1|k)
Actual plant evolves to

x(k + 1) = f (x(k), u (k|k))
(x(k + 1))
y(k + 1) = g
Repeat at next sampling instant
24 / 253
.
.
output
Constraint
Setpoint
time
.
k
k+1
input
Constraint
time
k
k+1
Constraint
25 / 253
output
Constraint
Setpoint
horizon
.
time
.
k
k+1
input
Constraint
time
k
k+1
Constraint
25 / 253
output
Constraint
Setpoint
horizon
.
time
.
k
k+1
input
Constraint
time
k
k+1
Constraint
25 / 253
output
Constraint
Setpoint
horizon
horizon
time
.
k
k+1
input
Constraint
time
k
k+1
Constraint
25 / 253
Section 3
History and examples of MPC
26 / 253
History and invention

Roots in
Optimal control in the 1950s and 60s
Industrial control in the 1970s and 80s
Nonlinear, robust and constrained control (1990s)
Reinvented several times (under the monikers DMC, MAC,

EPSAC, GPC, IDCOM, PFC, QDMC, SOLO, RHC, MBPC inter alia)
MPC is a generic name for the approach, not a single algorithm
27 / 253
.
.
Roots in optimal control
min
(
)
l x(t), u(t), t dt
subject to
dx
dt
= f(x, u, t)
A 300-year history
Signicant theory emerged in 1950s onwards
(Motivated by aerospace: military aircraft, missiles, space)
LQR and LQG led to MPC
28 / 253
Roots in industrial process control

Earliest(?)
Richalet et al. (1976) of Adersa: IDCOM
Cutler and Ramaker (1980) of Shell Oil: Dynamic Matrix
Control (DMC)
Reproduced from S. J. Qin and T. A. Badgwell. A survey of

industrial model predictive control technology. In: Control
Engineering Practice 11 (2003), pp. 733764
29 / 253
.
.
Historical usage in process control
Reproduced from Qin and Badgwell
30 / 253
The future
Traditionally used on stable plants with slow dynamics and
other control layers
But with rapid advances in
computing hardware
MPC theory
optimization solution methods
new applications are emerging
31 / 253
.
.
Emerging applications
Aerospace
Automative
Energy and power
Robotics and autonomous systems
to name a few
32 / 253
Example: power systems
Automatic generation control3

Line over-load prevention4
A. N. Venkat et al. Distributed MPC Strategies With Application to Power

System Automatic Generation Control. In: IEEE Transactions on Control
Systems Technology 16.6 (2008), pp. 11921206.
4
M. R. Almassalkhi and I. A. Hiskens. Model-Predictive Cascade Mitigation
in Electric Power Systems With Storage and RenewablesPart I: Theory and
Implementation. In: IEEE Transactions on Power Systems 30 (2015),
pp. 6777.
33 / 253
.
.
Example: Spacecraft control
Rendezvous and capture of sample container

Minimize fuel use
Avoid collision with container
Capture within specied time limit
E. N. Hartley et al. Model predictive control system design and
implementation for spacecraft rendezvous. In: Control
Engineering Practice 20.7 (July 2012), pp. 695713
.
34 / 253
Section 4
This course
35 / 253
.
.
Topics
Unconstrained model predictive control
Constrained model predictive control
Stability and feasibility
Oset-free tracking and disturbance rejection
36 / 253
MPC is a family of algorithms
System might be
nonlinear or linear
continuous or discrete time
continuous or discrete input/state/output
deterministic or uncertain
Well restrict ourselves to linear, discrete-time, deterministic

systems, with continuous inputs/states/outputs
37 / 253
.
.
Books
J. M. Maciejowski. Predictive Control with Constraints.

Prentice Hall, 2002, p. 352
J. B. Rawlings and D. Q. Mayne. Model Predictive Control:

Theory and Design. Nob Hill Publishing, 2009, p. 711
Freely(!) available online:
http://jbrwww.che.wisc.edu/home/jbraw/mpc/
J. A. Rossiter. Model-Based Predictive Control: A Practical

Approach. CRC Press, 2003, p. 344
E. F. Camacho and C. Bordons. Model Predictive Control.

2nd edition. Springer, 2004, p. 405
38 / 253
Part II
Unconstrained model predictive
control
39 / 253
.
.
Section 1
Problem statement
40 / 253
Baseline assumptions
.
MPC
System
Discrete-time linear state-space model

x(k + 1) = Ax(k) + Bu(k)
y(k) = Cx(k)
State x(k) is measurable at every k

Control objective is to regulate x to 0 while minimizing a
stage cost function
(
)
l x(k), u(k)
(Note l : Rn Rm 7 R)
No disturbances, noise, model errors, delays
41 / 253
.
.
The optimal control problem

From an initial state x(0)
(
)
min
l x(k), u(k)
k=0
subject to
x(k + 1) = Ax(k) + Bu(k), k = 0, 1, 2, . . .
Often l(x, u) = (1/2)x Qx + (1/2)u Ru, in which case this is

the innite-horizon LQR problem.
Solve once and apply u(k), k = 0, 1, 2, . . .
42 / 253
Innite-horizon LQR
State space
Controls
u(k)
x2
x(0)
0
.
10
20
30
0
x1
43 / 253
.
.
Section 2
LQ optimal control
44 / 253
Innite-horizon LQR
Problem statement discrete-time system
For a system
x(k + 1) = Ax(k) + Bu(k)
with initial
( state
) x(0) at k = 0, nd the control law
u(k) = x(k) that minimizes the objective function
x (k)Qx(k) + u (k)Ru(k)
k=0
Q, R are weighting matrices

Stage cost is a quadratic form
Q and R are usually positive denite
Common to set Q = C C then x Qx = y y
45 / 253
.
.
Aside: what is a quadratic form?

(See Mini-Tutorial 1 in Maciejowski)
A function of the form
f(z) = z Mz =
Mij zi zj
i,j=1
Example
[ ]
[
]
Q11 Q12
x1
with Q =
For x =
Q21 Q22
x2
x Qx = Q11 x21 + Q12 x1 x2 + Q21 x2 x1 + Q22 x22
If Q is symmetric, x Qx = Q11 x21 + 2Q12 x1 x2 + Q22 x22

If Q is diagonal, x Qx = Q11 x21 + Q22 x22
For any Q, x Qx = x Sx where S is symmetric
46 / 253
x Qx
Example Q11 = Q22 = 1, Q12 = Q21 = 0.1
0
0
.
x2
0
x1
47 / 253
Aside: what is a positive-denite matrix?

A symmetric matrix M is positive denite if
z Mz > 0
for all non-zero z.
We often write M 0
Equivalent to M having all positive eigenvalues
Q 0 and R 0 means our LQR cost is zero at zero but

positive everywhere else.
Also notion of positive semideniteness: M 0
48 / 253
x Qx
Example Q11 = Q22 = 1, Q12 = Q21 = 0.1 ( Q 0)
0
0
.
x2
0
x1
49 / 253
x Qx
Example Q11 = 1, Q22 = Q12 = Q21 = 0 ( Q 0)
0
0
.
x2
0
x1
50 / 253
x Qx
Example Q11 = Q22 = 0.1, Q12 = Q21 = 1 ( Q 0)
0
.
x2
0
x1
51 / 253
Innite-horizon LQR
Solution discrete-time system
min
k=0
subject to
x(k + 1) = Ax(k) + Bu(k), k = 0, 1, 2, . . .
has an unique optimal solution (which is a linear time-invariant
control law!)
u(k) = K x(k)
if
R is positive denite (R 0)
Q is positive semi-denite (Q 0)
The pair (A, B) is stabilizable
1
The pair (Q 2 , A) is detectable
52 / 253
Aside: what is stablizability and detectability?

Recall that an nth-order system
x(k + 1) = Ax(k) + Bu(k)
y(k) = Cx(k)
is controllable if and only if rank(C) = n, where
[
]
C = B AB . . . An1 B ,
and observable if and only if rank(O) = n, where
C
CA
O=
... .
CAn1
53 / 253
.
.
Controllable: the system can be steered, in nite time,

from any state x to any other state x
Observable: the system initial state x(0) can be

determined, in nite time, for any possible state and
control input trajectories x(k) and u(k), k 0
Stabilizable: all uncontrollable modes are stable and

decay to steady state
Detectable: all unobservable modes are stable and decay

to steady state
54 / 253
Example 1
The system
[
]
[ ]
1 1
0.5
x(k + 1) =
x(k) +
u(k)
0 1
1
[
]
y(k) = 1 0 x(k)
[
]
1
0
with Q = C C =
0 0
(A, B) is controllable (rank(C) = 2), therefore stabilizable
1
(Q 2 , A) = (C, A) is observable (rank(O) = 2), therefore

detectable
(Note Q 0)
55 / 253
.
.

Example 2
The system
[
]
[ ]
1 1
0.5
x(k + 1) =
x(k) +
u(k)
0 1
1
[
]
y(k) = 0 1 x(k)
[
]
0
0
with Q = C C =
0 1
(A, B) is controllable (rank(C) = 2), therefore stabilizable
(Q 2 , A) = (C, A) is not observable (rank(O) = 1), so we

cannot conclude detectability
1
Is (Q 2 , A) detectable? Check the unobservable modes
(obsvf.m) if they are stable, the system is detectable
56 / 253

Observability canonical form
Apply similarity transformation z = Px
z(k + 1) = PAP1 z(k) + PBu(k)
[
][
]
11 0
A
z1 (k)
=
22 z2 (k) + PBu(k)
A21 A
y(k) = CP1 z(k)
[
]
] z1 (k)
[
1 0
= C
z2 (k)
z1 observable modes, z2 unobservable modes

22 stable
Detectable if and only if A
57 / 253
.
.

Example 2
]
[
]
1 1
Here, with A =
and C = 0 1
0 1
[
] [
]
C
0 1
O=
=
CA
0 1
[
Let P =
0 1
. Then
1 1
[
= PAP1
A
] [
]
11 0
A
1 0
=
22 = 1 1
A21 A
A22 = 1, which is only neutrally stable (C, A) is not detectable.

.
58 / 253
Back to innite-horizon LQR

Solution discrete-time system
min
k=0
subject to
x(k + 1) = Ax(k) + Bu(k), k = 0, 1, 2, . . .
has a unique optimal solution
u(k) = K x(k)
How do we nd K ?
Solve the discrete algebraic Riccati equation (DARE)
(See Mini-Tutorial 7 in Maciejowski)
Can we use optimization instead?
59 / 253
.
.

Solving by optimization
min
{u(0),u(1),u(2),... }
k=0
subject to
x(k + 1) = Ax(k) + Bu(k), k = 0, 1, 2, . . .
Optimize over control input sequence

{
}
u(0), u(1), u(2), . . .
Quadratic objective, linear equality constraints a QP?

Innite sequence, therefore innite decision variables in
the optimization problem intractable!
60 / 253
Finite-horizon LQR
Solving by optimization
min
{u(0),u(1),...,u(N1)}
N1
)
x (k)Qx(k) + u (k)Ru(k) + x (N)Px(N)
k=0
subject to
x(k + 1) = Ax(k) + Bu(k), k = 0, 1, 2, . . . , N 1
Integer N is the prediction horizon length

P is a terminal cost matrix (more later)
From initial state x(0), we optimize control input sequence
{
}
u(0), u(1), u(2), . . . , u(N 1)
Corresponding state predictions are

{
}
x(0), x(1), x(2), . . . , x(N)
Quadratic objective, linear equality constraints a QP?61 / 253
Section 3
Formulating the optimization problem
62 / 253
Two steps
1. Construct the prediction matrices
2. Construct the cost matrices
63 / 253
.
.
Constructing prediction matrices
{
}
Control sequence is u(0), u(1), u(2), . . . , u(N 1)
Starting from x(0) and applying the model recursively
x(j) = Aj x(0) + A(j1) Bu(0) + A(j2) Bu(1) + + Bu(j 1)
Collect predictions over all steps j = 1, . . . , N

x = Fx(0) + Gu
(1)
where
0
B
... 0
A
u(0)
x(1)
AB
A2
u(1)
x(2)
B
. . . 0
,F = . ,G = .
x . ,u
.
.
.
.
..
. . ..
..
..
..
..
u(N 1)
x(N)
AN1 B AN2 B . . . B
AN
64 / 253
Constructing prediction matrices

Example
]
[ ]
1 1
0.5
x(k + 1) =
x(k) +
u(k)
(2)
0 1
1
u(0)
x(1)
For N = 3, x(2) = Fx(0) + G u(1) , where
u(2)
x(3)
0.5 0
0
1 1
1
0 1
0
0
B
0
0
A
1.5
0.5
0
1
2
2
F= A =
, G = AB B 0 = 1
1
0
0
1
2
3
A B AB B
A
2.5 1.5 0.5
1 3
1
1
1
0 1
65 / 253
.
.
Constructing cost matrices

The FH-LQR cost function is
N1
(
)
x (k)Qx(k) + u (k)Ru(k) + x (N)Px(N)
k=0
Write as
Q 0
x(1)
x(2)
0 Q
x (0)Qx(0) +
. . . ..
.
x(N)
0 ...
u(1)
u(2) 0

+
. . . ..
.
u(N 1)
0
... 0
x(1)
..
.
x(2)
...
Q 0
x(N)
0 P
0 ... 0
u(0)
..
R
.
u(1)
...
R 0
u(N 1)
... 0 R
66 / 253

Then the problem is
+ u Ru
min x (0)Qx(0) + x Qx
subject to
x = Fx(0) + Gu
where
Q 0 ... 0
..
0 Q
.
=
,
Q
..
.
Q 0
0 ... 0 P
... 0
..
0 R
.
.
=
R
..
.
R 0
0 ... 0 R
Now eliminate the equality constraints by substituting for x (left

as an exercise)
67 / 253
.
.

The nal FH-LQR problem from initial state x(0) is
1
min u Hu + c u +
u 2
(3)
where
+ R)
is the Hessian matrix, and depends only
H = 2(G QG
on the cost matrices (Q, R, P) and system matrices (A, B)
is a vector of constants,
c = Lx(0), where L = 2G QF,
depending on x(0)
+ Q, is a scalar constant
= x (0)Mx(0), where M = F QF
depending on x(0)
Note Q, P 0, R 0 H 0
68 / 253

Example
For the system (2), with N = 3, suppose Q = P = I22 , R = 100.
= I66 , R
= 100I33 , and
Then, Q
+ R)
= 2G I66 G + 2I33
H = 2(G QG
1.75 6.5 2.25

= 2 6.5 4.5 1.75 + 200I33
2.25 1.75 1.25
223.5 13
4.5
209 3.5
= 13
4.5
3.5 202.5
Note H is symmetric and positive denite
69 / 253
.
.

Example
= I66 , R
= 100I33 , and
Then, Q
c = Lx(0) = 2G QFx(0)
= 2G I66 Fx(0)
4.5 14
= 2 2 7.5 x(0)
0.5 2.5
9 28
= 4 15 x(0)
1 5
70 / 253

Example
= I66 , R
= 100I33 , and
Then, Q
+ Q)x(0)
= x(0) Mx(0) = x(0) (F QF
= x(0) (F F + I22 )x(0)
[
]
4
6
= x(0)
x(0)
6 18
71 / 253
.
.
Section 4
Solving the optimization problem
72 / 253

1
min u Hu + c u +
u 2
This is an unconstrained QP: minimize a quadratic function

(
)
1
J x(0), u = u Hu + c u +
2
(
)
Compute the gradient u J x(0), u
(
)
Set u J x(0), u = 0 and solve for u
73 / 253
.
.
Function
(
)
1
J x(0), u = u Hu + c u +
2
Gradient
(
)
u J x(0), u = Hu + c
Set to zero and solve for u

Hu + c = 0
u = H1 c
But c = Lx(0). Therefore,

u = H1 Lx(0)
(4)
Unique, global optimum if H 0 ( H is invertible)
74 / 253
The FH-LQR control law

u = H1 Lx(0)
(5)
Note that u does not depend on = x (0)Mx(0)
So we can compute u with only H, L and x(0)

(
)
But would need to compute correct cost, J x(0), u (0)
(This is is important later for stability analysis)
Finally, and most importantly, we never directly invert H to

compute u (0)
75 / 253
.
.

u = H1 Lx(0)
Recall u stacked vector of future inputs

Therefore
[
] ( 1 )
u(0) = Im 0 0 . . . 0 H L x(0)
[
](
)
u(1) = 0 Im 0 . . . 0 H1 L x(0)
..
.
[
](
)
u(j) = 0 . . . Im . . . 0 H1 L x(0)
..
.
[
](
)
u(N 1) = 0 0 0 . . . Im H1 L x(0)
76 / 253

Example
For the system (2), with N = 3 and Q = P = I22 , R = 100,
9 28
223.5 13
4.5
209 3.5 4 15 x(0)
u = H1 Lx(0) = 13
1 5
4.5
3.5 202.5
0.0392 0.1211
= 0.0166 0.0639 x(0)
0.0038 0.0209
Therefore,
]
u(0) = 0.0392 0.1211 x(0)
[
]
u(1) = 0.0166 0.0639 x(0)
[
]
u(2) = 0.0038 0.0209 x(0)
77 / 253
.
.
Finite-horizon LQR versus Innite-horizon LQR

State space
Controls
u(k)
.
.
.
.
x2
N =.
N =. 7
N =. 12
N =. 20
x(0)
0
.
10
15
20
0
x1
78 / 253
Beyond the horizon
We solved the FH-LQR problem at x(0)
Solution gives N open-loop controls, minimizing

N1
)
x (k)Qx(k) + u (k)Ru(k) + x (k + N)Px(k + N)
k=0
But what about k N?

Could solve FH-LQR problem again at k = N
But in MPC we solve FH-LQR problem at every k
Receding horizon
Close the loop
79 / 253
.
.
Section 5
The receding-horizon control law
80 / 253
Receding-horizon FH-LQR
or MPC with linear model and quadratic cost (LQ-MPC)
At time step k
1. Measure state x(k)
2. Solve FH-LQR problem for u (k)
1
u (k) = arg min u (k)Hu(k) + x (k)L u(k)
u(k) 2
3. Implement u(k) as rst control in u (k)
4. Wait one step; increment k; return to 1
81 / 253
.
.
output or state, x(k)
MPC receding horizon control
Constraint
Setpoint
x(k)
x (k)
x(k + 1)
x (k + 1)
horizon
horizon
time
.
k
k+1
input, u(k)
u(k 1)
u (k)
u(k)
k
Constraint
u (k + 1)
time
k+1
Constraint
82 / 253
Some notation
x(k) is the state at time k

x(k + j|k) is the prediction, made at k, of the state at time
k + j (i.e. j steps ahead)
Similarly, u(k) and u(k + j|k)
Given current state x(k), the prediction equation is
x(k) = Fx(k) + Gu(k)
where F and G are as before, and
u(k|k)
x(k + 1|k)
u(k + 1|k)
x(k + 2|k)
x(k)
, u(k)
..
..
.
.
u(k + N 1|k)
x(k + N|k)
83 / 253
.
.
The unconstrained LQ-MPC problem

At a state x(k) at time k,
min
u(k)
N1
x (k + j|k)Qx(k + j|k) + u (k + j|k)Ru(k + j|k)
j=0
+ x (k + N|k)Px(k + N|k)
subject to
x(k + j + 1) = Ax(k + j|k) + Bu(k + j|k), j = 0, 1, 2, . . . , N 1
x(k|k) = x(k)
84 / 253
The unconstrained LQ-MPC problem
Equivalently
1
min u (k)Hu(k) + x (k)L u(k) (+)
u(k) 2
85 / 253
.
.
Some denitions
The cost function is

JN
N1
(
)
x (k+j|k)Qx(k+j|k)+u (k+j|k)Ru(k+j|k)
x(k), u(k) =
j=0
+ x (k + N|k)Px(k + N|k)
The value function is

(
)
(
)
JN x(k) = min JN x(k), u(k)
u(k)
The optimal control sequence is

(
)
u (k) = arg min JN x(k), u(k)
u(k)
{
}
= u (k|k), u (k + 1|k), . . . , u (k + N 1|k)
86 / 253
The receding-horizon LQR control law

We saw that, for the initial state x(0),
u (0) = H1 Lx(0)
[
](
)
u(0) = Im 0 0 . . . 0 H1 L x(0)
What happens at x(k)? Know that
+ R)
does not depend on x(k) or k
H = 2(G QG
does not depend on x(k) or k
L = 2G QF
Therefore,
u (k) = H1 Lx(k)
u(k) = KN x(k)
is a linear, time-invariant control law, where
[
](
)
KN = Im 0 0 . . . 0 H1 L
87 / 253
.
.
The receding-horizon LQR control law

Example
For the system (2), with N = 3 and Q = P = I22 , R = 100,
0.0392 0.1211
u (k) = H1 Lx(k) = 0.0166 0.0639 x(k)
0.0038 0.0209
Therefore, MPC law is u(k) = K3 x(k) where
[
]
K3 = 0.0392 0.1211
88 / 253
Unconstrained LQ-MPC revised algorithm
At time step k
2. Apply optimal RH control law
u(k) = KN x(k)
No need to solve optimization on-line!
89 / 253
.
.
LQ-MPC receding-horizon control

State space
Controls
u(k)
N =.
x2
x(0)
0
.
10
0
x1
90 / 253

State space
Controls
u(k)
N =.
x2
x(0)
0
.
10
0
x1
90 / 253
.
.

State space
Controls
u(k)
N =.
x2
x(1)
x(0)
0
.
10
0
x1
90 / 253

State space
Controls
u(k)
N =.
x2
x(1)
x(0)
0
.
10
0
x1
90 / 253
.
.

State space
Controls
u(k)
N =.
x2
x(1)
x(0)
0
.
10
0
x1
90 / 253

State space
Controls
u(k)
N =.
x2
x(2)
x(1)
x(0)
0
.
10
0
x1
90 / 253
.
.

State space
Controls
u(k)
N =.
x2
x(2)
x(1)
x(0)
0
.
10
0
x1
90 / 253

State space
Controls
u(k)
N =.
x2
x(2)
x(1)
x(0)
10
0
x1
90 / 253
.
.
LQ-MPC versus Innite-horizon LQR

State space
Controls
u(k)
.
.
.
.
.
x2
x(0)
N =.
N =. 7
N =. 12
N =. 20
N =. 5
10
15
20
0
x1
91 / 253
Section 6
A general unconstrained MPC formulation
92 / 253
.
.

N1
(
)
(
)
min
l x(k + j|k), u(k + j|k) + F x(k + N|k)
u(k)
j=0
subject to
(
)
x(k + j + 1|k) = f x(k + j|k), u(k + j|k) , k = 0, 1, . . . , N 1
x(k|k) = x(k)
l is the stage cost and F is a{terminal cost (more later)

}
Control sequence u (k) = u(k|k), . . . , u(k + N 1|k)
Depending on l, F and f, problem may have
A unique, global optimum (strictly convex problem)
A set of global optima (convex problem)
Multiple local optima (nonconvex problem)
An unbounded objective
93 / 253
x Qx
Strictly convex function
0
0
.
x2
0
x1
94 / 253
.
.
x Qx
Non-strictly convex function
0
0
.
x2
0
x1
95 / 253
V(x)
Nonconvex function
0
0
.
x2
0
x1
96 / 253
.
.
x Qx
Unboundedness
0
.
x2
0
x1
97 / 253

N1
(
)
(
)
min
l x(k + j|k), u(k + j|k) + F x(k + N|k)
u(k)
j=0
subject to
(
)
x(k|k) = x(k)
Control implemented is rst element of u (k)

The (implicit) MPC control law is
(
)
u(k) = N x(k)
Usually, no closed-form expression for N ()
LQR one of the only formulations with closed-form control
law, N (x) = KN x
98 / 253
.
.
Some useful alternative MPC formulations

The Linear Absolute Regulator (LAR)
N1

)

(
q x(k + j|k) 1 + r u(k + j|k) 1 + p x(k + N|k) 1
min
u(k)
j=0
subject to
x(k + j + 1|k) = Ax(k + j|k) + Bu(k + j|k), k = 0, 1, . . . , N 1
x(k|k) = x(k)
Minimize total, rather than RMS, control eort

No closed-form solution for N () solve numerically for u
Problem transforms to a constrained linear program (LP)
rather than unconstrained QP
99 / 253
Some useful alternative MPC formulations
Optimize over input changes u(k) = u(k) u(k 1)

min
N1
u(k)
j=0
Useful for suppressing rapid control changes
Separately dened prediction and control horizons

min
u(k)
j=0
x (k + j|k)Qx(k + j|k) +
N
c 1
u (k + j|k)Ru(k + j|k)
j=0
with Nc N and u(k + j|k) = Kx(k + j|k) for j Nc
100 / 253
.
.
Section 7
Closed-loop performance and stability
101 / 253
Back to unconstrained LQ-MPC

Problem:
min
u(k)
N1
j=0
+ x (k + N|k)Px(k + N|k)
subject to
x(k|k) = x(k)
Optimal control law:
u(k) = KN x(k)
How do we choose Q, R, P and N?
102 / 253
.
.
LQ-MPC versus Innite-horizon LQR

State space
Controls
u(k)
.
.
.
.
.
x2
x(0)
N =.
N =. 7
N =. 12
N =. 20
N =. 5
10
15
20
0
x1
103 / 253
The eect of prediction horizon length

Example
The following system with Q = P = I, R = 100.
[
]
[ ]
2 1
0.5
x(k + 1) =
x(k) +
u(k)
0 1
1
N
3
5
7
12
20
25
KN
[0.3576
[1.0160
[1.0791
[1.1087
[1.1278
[1.1299
[1.1303
0.3234]
0.9637]
1.0381]
1.0534]
1.0629]
1.0640]
1.0642]
KN K as N
104 / 253
.
.
How do we choose Q, R, P and N?
Q, R usually tuned to deliver desired response
P = Q seems sensible?
And N? KN K as N . But
With increasing N
computational burden increases
QP matrices more ill-conditioned
Decreasing N worsens performance
K might not even be stabilizing!
N
Choose smallest acceptable N
105 / 253
KN might not even be stabilizing?

Recall we can assess the stability of a controlled linear system
x(k + 1) = (A + BK)x(k)
by nding the eigenvalues of (A + BK). The system is
globally asympotically stable if and only if

|i | < 1, i = 1 . . . n
marginally stable if |i | 1, with |j | = 1 for some j
unstable if |i | > 1 for any i
In other words, a stable closed-loop system has all eigenvalues

of (A + BK) inside the unit circle.
106 / 253
.
.
Aside: what is global asymptotic stability?

From any initial state x(0), the system remains bounded and
converges (settles) asymptically to 0
Formal denition
(
)
For a system x(k + 1) = f x(k) , the origin x = 0 is
stable if for any positive scalar there exists a positive

scalar such that

x(0) < x(k) < , k > 0
globally asymptotically stable if it is stable and also, for

any initial state x(0),

x(k) 0 as k
unstable if it is not stable
107 / 253
KN might not even be stabilizing

Example
The following system with Q = P = I, R = 100.
[
]
[ ]
2 1
0.5
x(k + 1) =
x(k) +
u(k)
0 1
1
N
3
5
7
12
20
25
KN
[0.3576
[1.0160
[1.0791
[1.1087
[1.1278
[1.1299
[1.1303
0.3234]
0.9637]
1.0381]
1.0534]
1.0629]
1.0640]
1.0642]
(A + BKN )
Stable?
1.41, 1.08
0.82, 0.71
0.92, 0.51
0.89, 0.50
0.87, 0.50
0.87, 0.50
0.87, 0.50
No
Yes
Yes
Yes
Yes
Yes
Yes
108 / 253
.
.
The eect of N on stability
Suggests we just need N large enough
Unfortunately, not that simple: very complex relationship

between stability and N, Q, R and P, as the next example
shows.
109 / 253
The eects of N and R on stability

Example (Maciejowski)
The following system with Q = P = I,
[
]
[
]
1.216 0.055
0.02763
x(k + 1) =
x(k) +
u(k)
0.221 0.9947
0.002763
8
Stable (A. + BKN )
6
4
2
0.
0
10
15
20
N
25
30
40
35
110 / 253
Section 8
Guaranteeing stability of unconstrained
LQ-MPC
111 / 253

min
k=0
subject to
x(k + 1) = Ax(k) + Bu(k), k = 0, 1, 2, . . .
The closed-loop system
x(k + 1) = (A + BK )x(k)
is globally asymptotically stable if
R is positive denite (R 0)
Q is positive semi-denite (Q 0)
The pair (A, B) is stabilizable
1
The pair (Q 2 , A) is detectable
112 / 253
.
.
Stability of unconstrained LQ-MPC

min
u(k)
N1
j=0
+ x (k + N|k)Px(k + N|k)
subject to
x(k|k) = x(k)
The closed-loop system is
x(k + 1) = (A + BKN )x(k)
1
Well assume R 0, Q 0, (A, B) stabilizable, (Q 2 , A) detectable.

Question: when is KN stabilizing?
.
113 / 253
When is KN stabilizing?
As we saw, even if K is stabilizing, KN is not necessarily
stabilizing for a given N and Q, R, P
How can we make sure KN is stabilizing?
Innite horizons are stabilizing

Use suciently large N so that horizon is innite
Use a terminal constraint
114 / 253
.
.
Terminal state constraint for stability

State space
Controls
u(k)
x2
0
.
10
0
x1
Observation: because N is nite, x(k + N|k) = 0 the plan

stops short of the origin (the target)
.
115 / 253

Idea
Add the constraint x(k + N|k) = 0 to the MPC problem
Then a plan must end at the origin to be feasible
If x(k + N|k) = 0, then x(k + N + 1|k) = Ax(k + N|k) = 0 for

u(k + N|k) = 0
The state remains at the origin for all k N!
116 / 253
.
.

Formulation
N1
(
)
min
u(k)
j=0
subject to
x(k|k) = x(k)
x(k + N|k) = 0
No terminal cost needed why?

Note that cost for k = N . . . is zero
The cost is an innite-horizon cost
117 / 253

Drawbacks
Several
Problem is a constrained QP harder to solve
We lose the closed-form linear control law; now u = N (x)
Can lead to large and very active control signals

For small N, x(0) far from 0 will mean large |u| in order
for x(0 + N|0) = 0
Conversely, for x(0) far from 0, a large N will be
needed to keep |u| small
Results in poor robustness to disturbances and modelling

errors
118 / 253
.
.

Estimating the innite-horizon cost
Rather than requiring x(k + N|k) = 0, what if we could estimate
the innite-horizon cost?
j=0
N1
(
)
=
j=0
(
j=N
|
.
{z
cost over nite horizon

{z
cost-to-go
)
}
119 / 253

Estimating the cost-to-go
The nite-horizon MPC cost is
N1
j=0
{z
)
}
cost over nite horizon
+ x (k + N|k)Px(k + N|k)
|
{z
}
terminal cost
So far, weve always set P = Q. But what if we could set P so that

terminal cost = cost-to-go
Then the nite-horizon MPC cost would estimate the
innite-horizon cost
120 / 253
.
.
Terminal cost for stability

Want
x (k + N|k)Px(k + N|k) =
(
)
j=N
The trick is to assume the use of a stabilizing control law beyond

the horizon
u(k + N + j|k) = Kx(k + N + j|k), j 0
Then problem reduces to nding P that satises the Lyapunov
equation
(A + BK) P(A + BK) P + (Q + K RK) = 0
.
121 / 253
Dual-mode MPC
The resulting approach is often called dual-mode MPC
{
optimization variables j = 0, 1, . . . , N 1 (mode 1)
u(k+j|k) =
Kx(k + j|k)
j = N, N + 1, . . . (mode 2)
Mode 2 is used only for stability; the implemented control

is still the rst in the optimal control sequence
Can choose any K we like, provided (A + BK) is stable
If (A, B) is stabilizable, such a K must exist
122 / 253
.
.
Dual-mode MPC
Example
Lets look again at the system
[
]
[ ]
2 1
0.5
x(k + 1) =
x(k) +
u(k)
0 1
1
with Q = I and R = 100. This was unstable with P = I, since
[
]
K3 = 0.3576 0.3234
led to (A + BK3 ) having eigenvalues outside the unit circle.
Lets try to nd a P that leads to a stabilizing K3
.
123 / 253
Dual-mode MPC
Example
Find a K for mode 2 already know

[
]
K = 1.1303 1.0642
Solve the Lyapunov equation

(A + BK) P(A + BK) P + (Q + K RK) = 0
Using M
P = dlyap((A+B*K)',(Q+K'*R*K))
[
]
194.64 161.43
P=
161.43 147.77
New RH controller is
[
]
K3 = 1.1303 1.0642
Notice anything?
124 / 253
Dual-mode MPC
Summary
The MPC predictions are

{
optimization variables
u(k+j|k) =
Kx(k + j|k)
j = 0, 1, . . . , N 1 (mode 1)
j = N, N + 1, . . . (mode 2)
K chosen to stabilize (A, B); P obtained from Lyapunov

equation
The MPC (receding-horizon) control law is
u (k) = H1 Lx(k)
u(k) = KN x(k)
if K = K , then KN = K
Otherwise, K = K (sub-optimal)
125 / 253
Part III
Constrained model predictive
control
126 / 253
.
.
Section 1
Motivation: all systems are subject to
constraints
127 / 253
Constraints
System variables are always constrained
Physical limits
Input constraints, e.g. actuator limits
State constraints, e.g. capacity, ow limits
Performance specications
Maximum overshoot
Safety limits
Maximum pressure, temperature
Some constraints are harder than others
128 / 253
.
.
Input constraints
Actuators are always physically limited
Saturation limits
sat(u)
u.
umax
sat(u) = u
umin
Rate (slew) limits
if u umax
if umin u umax
if u umin

du
R
dt
but most controllers are not designed with this in mind

.
129 / 253
Constraints are nonlinearities

but are often easily converted to limits on linear systems
Saturation limits
(
)
x(k + 1) = Ax(k) + B sat u(k)
x(k + 1) = Ax(k) + Bu(k)

umin u(k) umax
Rate limits
x(k + 1) = Ax(k) + Bu(k)
RT u(k) u(k 1) RT
130 / 253
.
.
Control in the presence of constraints is hard

even for linear systems
For
x(k + 1) = Ax(k) + Bu(k)
y(k) = Cx(k)
x(k), u(k), y(k) subject to constraints
determine the u = (x) that is guaranteed to satisfy all
constraints for all time
Common approach is to design u = (x) using your favourite
technique, and then de-tune to avoid constraint violation
Trouble is, optimal operation usually means operating at limits
.
131 / 253
Performance
Operating near limits
.
Output
(Redrawn from Maciejowski)
132 / 253
.
.
Section 2
Problem statement
133 / 253
Constrained innite-horizon LQR

For a system
x(k + 1) = Ax(k) + Bu(k)
with initial
( state
) x(0) at k = 0, nd the control law
u(k) = x(k) that minimizes the objective function
k=0
while guaranteeing constraint satisfaction for all time

Usually impossible to solve this problem
MPC provides an approximate solution
Solve a nite-horizon version of this problem, on-line, and
apply the rst control in the optimized sequence
receding horizon
134 / 253
.
.
Constrained nite-horizon optimal control problem

For a system
x(k + 1) = Ax(k) + Bu(k)
with initial
{ state x(k), nd the control sequence
}
u(k) = u(k|k), u(k + 1|k), . . . , u(k + N 1|k) that minimizes the
objective function
N1
j=0
+ x (k + N|k)Px(k + N|k)
while guaranteeing constraint satisfaction over the horizon

Can solve this via constrained optimization
Optimized control sequence u (k) will satisfy constraints
Associated state predictions will satisfy constraints 135 / 253
Constrained MPC and the receding-horizon principle
output
Constraint
Setpoint
time
.
k
k+1
input
Constraint
time
k
k+1
Constraint
136 / 253
output
Constraint
Setpoint
horizon
.
time
.
k
k+1
input
Constraint
time
k
k+1
Constraint
136 / 253
output
Constraint
Setpoint
horizon
.
time
.
k
k+1
input
Constraint
time
k
k+1
Constraint
136 / 253
output
Constraint
Setpoint
horizon
horizon
time
.
k
k+1
input
Constraint
time
k
k+1
Constraint
136 / 253
Receding-horizon constrained FH-LQR

or MPC with linear model and quadratic cost (LQ-MPC)
At time step k
2. Solve constrained FH optimal control problem for u (k)
137 / 253
.
.
Constrained LQ-MPC
Problem formulation
min
u(k)
N1
j=0
+ x (k + N|k)Px(k + N|k)
subject to
x(k|k) = x(k)
u(k + j|k), x(k + j|k) satisfy constraints for j = 0, 1, 2, . . . , N
.
138 / 253
Constrained MPC
A general formulation
N1
(
)
(
)
min
l x(k + j|k), u(k + j|k) + F x(k + N|k)
u(k)
j=0
subject to
(
)
x(k|k) = x(k)
u(k + j|k), x(k + j|k) satisfy constraints for j = 0, 1, 2, . . . , N
139 / 253
.
.
Section 3
Constraint modelling
140 / 253
Many types
State and input constraints

xX
Terminal state constraints

x(k + N|k) = 0
uU
x(k + N|k) = xtarg
x(k + N|k) XN
Output constraints
yY
Mixed constraints
c(x, u) Z
Rate constraints
u V
141 / 253
.
.
Many types
Upper/lower bounds on variables (box constraints)

xmin x xmax
umin u umax
(That is, xmin,i xi xmax .i for all i = 1, 2, . . . n)
Linear inequality constraints

Px x q x
Nonlinear constraints
g(x, u) 0
Pu u qu
h(x, u) = b
x2 1
142 / 253

Well consider linear inequality constraints on the predicted
states and inputs
Px x(k + j|k) qx ,
Pu u(k + j|k) qu , for all j = 0, 1, . . . , N 1
PxN x(k + N|k) qxN
Very general form that can capture many real constraints
Can also capture output constraints (since y = Cx)
Can allow constraints to vary over horizon

(i.e., Px (j)x(k + j|k) qx (j)), but well not consider that in
this course
143 / 253
.
.

Examples
[ ]
x
Suppose x = 1 and u is scalar. Box constraints
x2
xmin x(k + j|k) xmax
umin u(k + j|k) umax
are implemented as
+1 0
+xmax,1
0 +1
x(k + j|k) +xmax,2
1 0
xmin,1
0 1
xmin,2
| {z }
| {z }
qx
Px
]
[
]
+1
+umax
u(k + j|k)
1
umin
| {z }
| {z }
Pu
qu
144 / 253

Examples
More generally,
]
[
]
+Inn
+xmax
x(k + j|k)
Inn
xmin
| {z }
| {z }
[
Px
qx
]
+Imm
+umax
u(k + j|k)
Imm
umin
| {z }
| {z }
qu
Pu
Similar for terminal state constraints (PxN , qxN )

For output constraints
[ ]
[
]
+C
+ymax
x(k + j|k)
C
ymin
| {z }
| {z }
qx
Px
145 / 253
Section 4
146 / 253
The constrained LQ-MPC problem

min
u(k)
N1
j=0
+ x (k + N|k)Px(k + N|k)
subject to
x(k|k) = x(k)
Px x(k + j|k) qx , j = 0, 1, . . . , N 1
Pu u(k + j|k) qu , j = 0, 1, . . . , N 1
PxN x(k + N|k) qxN
147 / 253
.
.
Prediction matrices
Recall that, in the unconstrained case, we reformulated the
LQ-MPC as a QP problem
1
u(k) 2
by constructing
1. prediction matrices (F and G)
2. cost matrices (H and L)
Well use these again, but we also need constraint matrices.
148 / 253
Standard form of a constrained QP

1
min z Hz + f z
z 2
subject to
Dz b
Well show that the LQ-MPC QP problem is
1
u(k) 2
subject to
Pc u(k) qc + Sc x(k)
149 / 253
.
.
Recap: constructing prediction matrices
{
}
Control sequence is u(k|k), u(k + 1|k), . . . , u(k + N 1|k)
Starting from x(k) and applying the model recursively
x(k + j|k) = Aj x(k) + A(j1) Bu(k|k) + + Bu(k + j 1|k)
Collect predictions over all steps j = 1, . . . , N

x(k) = Fx(k) + Gu(k)
where
B
0
... 0
A
AB
A2
B
. . . 0

F = . ,G = .
.
.
.
..
. . ..
..
..
AN1 B AN2 B . . . B
AN
150 / 253
Recap: constructing cost matrices
Recall that the cost function

N1
(
)
(
)
J x(k), u(k) =
j=0
+ x (k + N|k)Px(k + N|k)
may be rewritten as
(
)
1
J x(k), u(k) = u (k)Hu(k) + x (k)L u + x (k)Mx(k)
{z
}
|
2
independent of u
where H, L, M are dened on p 68.
Recall that H 0 if Q 0, P 0, R 0
151 / 253
.
.
Constructing constraint matrices
Start with input constraints

Pu u(k + j|k) qu , j = 0, 1, . . . , N 1
Collect and stack
Pu 0 . . .
0 Pu . . .
..
.. . .
.
.
.
|

qu
0
u(k|k)
0 u(k + 1|k) qu
..
..
..
.
.
.
qu
0 . . . Pu
u(k + N 1|k)
| {z }
{z
}
u
q
u
P
Therefore
u u(k) q
u
P
152 / 253
Now state constraints

Px x(k + j|k) qx , j = 0, 1, . . . , N 1
PxN x(k + N|k) qxN
Collect and stack

Px
0 0
0
Px 0

x(k|k) + 0 Px
..
..
..
.
.
.
0
0 0
| {z }
|
x
P
0
qx
x(k + 1|k)

x(k + 2|k) qx
qx

..
..
.
.
x(k + N|k)
qx
. . . Px N
| {zN }
{z
}
...
...
...
..
.
0
0
0
..
.
x
q
x
P
Therefore, recalling that x(k|k) = x(k)

x x(k) + P
x x(k) q
x
P
0
153 / 253
.
.

u u(k) q
u
P
x x(k) q
x x(k)
x P
P
0
Use x(k) = Fx(k) + Gu(k) to eliminate x(k)

(
)
x Fx(k) + Gu(k) q
x x(k)
x P
P
0
x Gu(k) q
x P
x F)x(k)
x + (P
P
0
Stack
]
]
[ ] [
u
u
0
P
q
+
x F x(k)
x G u(k) q
x
Px0 P
P
| {z } |
{z
}
| {z }
[
Pc
qc
Sc
Therefore
154 / 253

Summary of procedure
1. Dene linear inequalities in x(|k), u(|k), y(|k)
2. Write as
Px x(k + j|k) qx , j = 0, 1, . . . , N 1
Pu u(k + j|k) qu , j = 0, 1, . . . , N 1
PxN x(k + N|k) qxN
3. Stack the inequalities to give
u u(k) q
u
P
x x(k) q
x x(k)
x P
P
0
4. Use x(k) = Fx(k) + Gu(k) to eliminate x(k), and stack
further
155 / 253
.
.
Section 5
156 / 253
Solving the constrained LQ-MPC problem

1
u(k) 2
subject to
No closed-form solution need numerical methods.
But, if H 0, then
The problem is strictly convex
If the problem is feasible, a global minimizer can always be

found
That global mimimizer is unique
157 / 253
.
.
Feasibility
The problem needs to be feasible for u (k) to exist
(
)
The feasible set U x(k) is the set of all u(k) that satisfy the
constraints
}
(
) {
U x(k) = u : Pc u qc + Sc x(k)
and depends on x(k) (so may change at each sampling instant)
The MPC problem could even be infeasible at some k
The state/output has strayed outside of limits
There exists no control sequence that maintains constraint

satisfaction over the horizon
For now, well assume the MPC problem is feasible at every k

.
158 / 253
The solution of a constrained QP
z2
Unconstrained minimum inside the feasible region
. .
z1
159 / 253
.
.
The solution of a constrained QP
z2
Unconstrained minimum outside the feasible region
. .
z1
160 / 253
The solution of the constrained QP
Without constraints, u (k) is a linear function of x(k)

u (k) = H1 Lx(k)
With constraints, u (k) is nonlinear
The constraints are usually xed cant just move them so

that the unconstrained minimum inside the feasible region
(The cost, on the other hand, can often be tuned, which

leads to a nice feature of constrained LQ-MPC see
Section 5.4 in Maciejowski)
Therefore, we need to re-compute u (k) at each k by

solving a constrained QP
161 / 253
.
.
Solving a constrained QP
Two classes of methods
Active set
Interior point
You (hopefully) covered these in ACS6102. (If not, see Section
3.3 of Maciejowski for a brief introduction and references.)
For our purposes, well assume the problem can be solved
eciently via software algorithms; e.g., quadprog.m in M
uses
ustar = quadprog(H,L*x,Pc,qc+Sc*x)
to solve
}
1
u = arg min u Hu + x L u : Pc u qc + Sc x
u
2
162 / 253
Section 6
163 / 253
.
.
Constrained LQ-MPC
At time step k
2. Solve constrained FH-LQR problem for u (k)
1
u (k) = arg min u (k)Hu(k) + x (k)L u(k)
u(k) 2
subject to Pc u(k) qc + Sc x(k)
164 / 253
Control implemented is rst element of u (k)
The implicit MPC control law is

(
)
u(k) = N x(k)
No closed-form expression for N ()
N () is non-linear
165 / 253
.
.
Constrained LQ-MPC
Example loss of linearity
Consider the scalar system
x(k + 1) = x(k) + u(k)
subject to the input constraints
0.5 u(k) +0.5
Lets now obtain the unconstrained and constrained control

laws, with Q = P = 1, R = 1 and N = 3.
166 / 253
Constrained LQ-MPC
Example loss of linearity: single-state system
1
KN
N
.
.
2
0
x
Three regions of operation
167 / 253
.
.
Constrained LQ-MPC
Example loss of linearity: two-state system
x1
x2
59 regions of operation!
.
168 / 253
Constrained LQ-MPC
Example
Lets revisit the system
[
]
[ ]
1 1
0.5
x(k + 1) =
x(k) +
u(k)
0 1
1
Previously, we obtained the MPC controller KN in the absence of
constraints.
Now, well consider the constraints
1 u(k) +1
[ ]
[
]
5
+5
x(k)
2
+0.5
and set Q = P = I22 , R = 10.
169 / 253
.
.
Constrained LQ-MPC
Example
State space
Controls
u(k)
K.N
x2
x(0)
0
.
10
15
20
0
x1
170 / 253
Constrained LQ-MPC
Example
State space
Controls
u(k)
.
.
K.N
.N
x2
x(0)
0
.
10
15
20
0
x1
170 / 253
.
.
Part IV
Stability and feasibility
171 / 253
Section 1
172 / 253
.
.
MPC problem:
min
u(k)
N1
j=0
+ x (k + N|k)Px(k + N|k)
subject to
x(k|k) = x(k)
The optimal control law is

u(k) = KN x(k)
Therefore, the closed-loop system is linear

x(k + 1) = (A + BKN )x(k)
173 / 253

Recall that a linear system
x(k + 1) = (A + BK)x(k)
is stable if and only if all eigenvalues of (A + BK) are inside the
unit circle

So KN is stabilizing if i (A + BKN ) < 1 for all i
More precisely, we dened global asymptotic stability of

the origin
From any initial state, the system state x(k) remains

bounded and converges (settles) to 0 as k
174 / 253
.
.

KN might not be stabilizing
Innite horizons are stabilizing, but large (or innite) N leads to
problems of tractability and ill-conditioning
Therefore, we proposed
dual-mode MPC }
{
We optimize u(k|k), . . . , u(k + N 1|k) by minimizing
their cost over the horizon this is mode 1.
Trick is to assume a stabilizing control law u = Kx (mode
2) beyond the horizon
We can work out the cost of mode 2 this forms an
estimate of the cost-to-go from j = N to
But rather than explicitly calculating this, we can select the
terminal cost matrix P so that the terminal cost is always
equal to the cost-to-go
And therefore the MPC cost is equal to the innite-horizon
cost (the cost of mode 1 and mode 2)
.
175 / 253
Dual-mode MPC
Summary
The MPC predictions are

{
u(k+j|k) =
Kx(k + j|k)
j = 0, 1, . . . , N 1 (mode 1)
j = N, N + 1, . . . (mode 2)
K chosen to stabilize (A, B); P obtained from Lyapunov

equation
(A + BK) P(A + BK) P + (Q + K RK) = 0
The MPC (receding-horizon) control law is

u (k) = KN x(k)
System is stable under usual assumptions on (A, B, Q, R)

If K = K , then KN = K ; otherwise, K = K (sub-optimal)
176 / 253
.
.
Section 2
Stability of constrained LQ-MPC
177 / 253
Dual-mode constrained MPC is not necessarily stable

Example
We found that the unconstrained system
[
]
[ ]
2 1
0.5
x(k + 1) =
x(k) +
u(k)
0 1
1
with Q = I, R = 3 and N = 3 was closed-loop unstable with P = I,
since
[
]
0.3576
0.3234
K3 =
led to (A + BK3 ) having eigenvalues outside the unit circle.
But we managed to obtain a stabilizing K3 via the dual-mode
procedure with
[
]
194.64 161.43
P=
161.43 147.77
178 / 253
.
.

Example
Now lets use the same system and cost matrices, and
dual-mode predictions, but subject to the input constraints
1 u(k) +1
In the MPC optimization problem, we impose these over the
horizon
1 u(k + j|k) +1, j = 0, 1, . . . , N 1
179 / 253

Example initial state x(0) = [0.74 0.74]
40
x(k)
20
0
20
40 .
u(k)
1
0
1
.
0
10
15
k
20
25
30
180 / 253

40
x(k)
20
0
20
40 .
u(k)
1
0
1
.
0
10
15
k
20
25
30
181 / 253

Whats going on?
Unconstrained system was globally stable i.e., for any x(0)
Constrained system is apparently stable for some x(0) but

unstable for others
We say that the system is locally stable
How can we analyse and guarantee local stability?
Further complication:
(
)
x(k + 1) = Ax(k) + BN x(k)
is nonlinear
Standard tools from linear systems theory useless
182 / 253
.
.
Section 3
Lyapunov stability of constrained MPC
183 / 253
Stability analysis of nonlinear systems

Reading: Appendix B of Rawlings & Mayne
Consider the nonlinear discrete-time system
(
)
x(k + 1) = f x(k)
(6)
with f : Rn 7 Rn continuous and f(0) = 0.
Proposition
If there exists a scalar function V : Rn 7 R such that
V(0) = 0
(7a)
V(x) > 0, x X \ {0}

(
)
V f(x) V(x) < 0, x X \ {0}
(7b)
(7c)
then the origin is an locally asymptotically stable (LAS)

equilibrium point for (6), with region of attraction X.
184 / 253
.
.
Lyapunov functions
V is said to be a Lyapunov function
Conditions (7a) and (7b) mean V must be positive denite
Condition (7c) means V must be strictly monotonically

decreasing along the closed-loop trajectories of the system
If we nd a V that satises these conditions in some

neighbourhood X of x = 0, then x = 0 is a LAS equilibrium
point
(The origin could still be LAS even if we cant nd a V)
If X = Rn (whole state-space), result is global asymptotic

stability (GAS)
185 / 253
Finding a Lyapunov function for MPC

Usually tricky. Fortunately, in MPC, we have a natural candidate.
Recall
The LQ-MPC cost function is
JN
N1
(
)
x(k), u(k) =
j=0
+ x (k + N|k)Px(k + N|k)

{
}
u (k) = u (k|k), u (k + 1|k), . . . , u (k + N 1|k)
The value function is

(
)
(
)
(
)
JN x(k) = JN x(k), u (k) = min JN x(k), u(k)
u(k)
186 / 253
.
.
Finding a Lyapunov function

for MPC
(
)
We use the value function, JN x(k) , as a Lyapunov function.
Proposition
If
1
(a) (Q 2 , A) is detectable, and Q 0, R 0

(b) P satises the Lyapunov equation
(A + BK) P(A + BK) P + (Q + K RK) = 0

for some K such that i (A + BK) < 1 for all i,
(
)
then JN x(k) is a Lyapunov function for the system
(
)
x(k + 1) = Ax(k) + BN x(k)
for all x(0) X.
.
187 / 253
What this means
(
)
If, for some x(0), JN x(k) decreases monotonically and
asymptotically to 0, then we infer that the origin is LAS
If it does not, then we do not infer anything
188 / 253
.
.
Lyapunov stability of unconstrained MPC

Example
We found that the unconstrained system
[
]
[ ]
2 1
0.5
x(k + 1) =
x(k) +
u(k)
0 1
1
with N = 3, Q = I, R = 100,
[
]
194.64 161.43
P=
161.43 147.77
is globally asymptotically stable under the MPC control law
u = K3 x.
189 / 253
Value function unconstrained MPC

400
(
)
JN x(k) is Lyapunov
(
)
JN x(k)
300
200
100
0.
0
10
k
12
14
16
18
20
190 / 253
.
.

Example
We found that same system, with the input constraints

1 u(k + j|k) +1, j = 0, 1, . . . , N 1
when controlled by constrained MPC
lost stability for x(0) = [0.75 0.75]
maintained stability for x(0) = [0.74 0.74]
191 / 253
Value function constrained MPC

2
104
(
)
JN x(k) is not Lyapunov, and system is unstable
(
)
JN x(k)
1.5
0.5
0.
0
10
k
12
14
16
18
20
192 / 253

1,200
1,000
(
)
JN x(k) is not Lyapunov, but system is stable
(
)
JN x(k)
800
600
400
200
0.
0
10
k
12
14
16
18
20
193 / 253

800
(
)
JN x(k) is Lyapunov system is stable
(
)
JN x(k)
600
400
200
0.
0
10
k
12
14
16
18
20
194 / 253
.
.
So whats going on?
JN is a Lyapunov function for unconstrained MPC, but not

always for constrained MPC?
We havent said anything about X
Remember, to be a Lyapunov function, JN needs to meet

conditions (7a)(7c) for all x X
For unconstrained MPC, JN is Lyapunov for all x(0): so

X = Rn (well show this later)
For constrained MPC

x(0) = [0.75
0.75]
/ X, as JN is not Lyapunov
x(0) = [0.74
0.74]
/ X, as JN is not Lyapunov
x(0) = [0.70
0.70] X, as JN is Lyapunov
195 / 253
So whats going on?

Recall that the dual-mode scheme makes predictions
{
optimization variables j = 0, 1, . . . , N 1 (mode 1)
u(k+j|k) =
Kx(k + j|k)
j = N, N + 1, . . . (mode 2)
The optimization variables are

{
}
u (k) = u(k|k), u(k + 1|k), . . . , u(k + N 1|k)
These and the predicted states x(k) are designed to

satisfy all constraints over the horizon
The mode-2 predictions beyond the horizon ignore

constraints
196 / 253
.
.

Example
Back to our example:
]
[ ]
2 1
0.5
x(k + 1) =
x(k) +
u(k)
0 1
1
[
]
194.64 161.43
with N = 3, Q = I, R = 100, P =
and
161.43 147.77
1 u(k) +1
Lets look at the mode-2 predictions
197 / 253
Mode-2 predictions
Example
.
.
.
.
Mode 2
u(0 + j|0)
.
x(0) = [0.70
0.70]
.
x(0) = [0.74
0.74]
.
x(0) = [0.75
0.75]
.
0
10
j
12
14
16
18
20
198 / 253
Feasibility of mode-2 predictions

It can be shown that JN is Lyapunov only if the mode-2
predictions satisfy constraints
Our Lyapunov function candidate JN meets all criteria bar this
one
So, if we could guarantee that the mode-2 predictions
}
u(k + j|k) = Kx(k + j|k)
j = N, N + 1, . . .
x(k + j + 1|k) = (A + BK)x(k + j|k)
satisfy all constraints, then JN will satisfy the Lyapunov function
conditions.
.
199 / 253
Section 4
Terminal constraints for guaranteed
feasibility
200 / 253
.
.
Feasibility of mode-2 predictions

Feasibility implies stability
If we could guarantee that the mode-2 predictions
}
u(k + j|k) = Kx(k + j|k)
j = N, N + 1, . . .
x(k + j + 1|k) = (A + BK)x(k + j|k)
satisfy all constraints, then JN will satisfy the Lyapunov function
conditions.
If we were able to do this, we would also guarantee the
extremely attractive property of recursive feasibility
201 / 253
Recursive feasibility
Suppose that
{
}
u (k) = u (k|k), u (k + 1|k), . . . , u (k + N 1|k)
is a feasible solution to the MPC problem at time k

}
{ (
)
min JN x(k), u(k) : constraints on x and u
u(k)
Then, if the candidate solution

{
}
u(k + 1) = u (k + 1|k), . . . , u (k + N 1|k), Kx (k + N|k)

is a feasible solution to the problem at time k + 1
}
{ (
)
min JN x(k + 1), u(k + 1) : constraints on x and u
u(k+1)
the system is said to be recursively feasible
202 / 253
.
.
Recursive feasibility
Very desirable
If we have an feasible solution at time k, we can generate
another at the next sampling instant, k + 1, by
taking the tail of the previous solution
{
}
(k + 1|k), . . . , u (k + N 1|k)

u
(k|k),u

and adding a terminal step of the mode-2 control

{
}

u
(k|k),u
(k
+
1|k),
.
.
.
,
u
(k
+
N
1|k),
Kx
(k
+
N|k)

That is, we do not need to solve the optimization at k + 1 to

maintain constraint satisfaction
(But we might want to, for the sake of optimality)
It can be shown that, for a recursively feasible system,
feasibility at k = 0 implies feasibility for all k > 0
203 / 253
Guaranteeing recursive feasibility
We could add explicit constraints to the MPC problem
But there could be an innite number
Instead, we use an invariant set
204 / 253
.
.
x2
Invariant sets
.
0
x1
Denition
(
)
For a system x(k + 1) = f x(k) , a set is invariant if
x(0) x(k) , k > 0
.
205 / 253
Invariant sets
Examples
The origin, or an equilibrium point

0 = (A + BK)0
xe = f(xe )
Limit cycles and periodic orbits
206 / 253
.
.
Invariant terminal constraints

For dual-mode MPC, recall
{
u(k+j|k) =
Kx(k + j|k)
j = 0, 1, . . . , N 1 (mode 1)
j = N, N + 1, . . . (mode 2)
Mode-2 closed loop dynamics

x(k + j + 1|k) = (A + BK)x(k + j|k)
(8)
Can construct a invariant under (8)

Then, if impose the terminal constraint
x(k + N|k)
then x(k + N + j|k) for all j 0.
207 / 253
Invariant terminal set

.
.
. 2
Mode
. 1
Mode
0
x2
x(k + N|k)
x(k|k)
.
0
x1
208 / 253
.
.
Constraint-admissible invariant terminal set

Moreover, we can construct so that all constraints are
satised within it under the mode-2 control law u = Kx
}
Px x q x
for all x
Pu Kx qu
Then,
all future mode-2 predictions satisfy constraints
recursive feasibility is guaranteed
J is a Lyapunov function
N
the closed-loop system
(
)
x(k + 1) = Ax(k) + BN x(k)
is LAS (region of attraction X)
.
209 / 253
Guaranteed recursive feasibility
Suppose we have feasible solution at time k

{
}
u (k) = u (k|k), u (k + 1|k), . . . , u (k + N 1|k)
Then we also have a feasible solution at k + 1 by

taking the tail of the previous solution
}
{

u
(k|k),u
(k
+
1|k),
.
.
.
,
u
(k
+
N
1|k)

So
and adding a terminal step of the mode-2 control

{
}
(k + 1|k), . . . , u (k + N 1|k), Kx (k + N|k)

u
(k|k),u

{
}
u(k) = u (k + 1|k), . . . , u (k + N 1|k), Kx (k + N|k)
210 / 253
.
.
Implementing an invariant terminal set

Recall the constrained MPC problem: at a state x(k) at time k,
min
u(k)
N1
j=0
+ x (k + N|k)Px(k + N|k)
subject to
x(k|k) = x(k)
Px x(k + j|k) qx , j = 0, 1, . . . , N 1
Pu u(k + j|k) qu , j = 0, 1, . . . , N 1
PxN x(k + N|k) qxN
Design (PxN , qxN ) to be a constraint-admissible invariant set
.
211 / 253
Constructing an invariant terminal set

Beyond the scope of this module well assume that we are
given a constraint-admissible invariant set
}
{
= x Rn : PxN x qxN
However, the interested student is encouraged to consult
Section 8.5.1 of Maciejowski
the seminal paper by Gilbert and Tan5
E. G. Gilbert and K. T. Tan. Linear systems with state and control

constraints: the theory and application of maximal output admissible sets.
In: IEEE Transactions on Automatic Control 36 (1991), pp. 10081020.
212 / 253
.
.
Stable constrained MPC

Summary of procedure
1
1. Choose Q 0, R 0 (assuming (Q 2 , A) detectable)

2. Compute stabilizing mode-2 control law u = Kx
3. Compute terminal matrix P to satisfy Lyapunov equation
(A + BK) P(A + BK) P + (Q + K RK) = 0
4. Compute (PxN , qxN ) such that the terminal constraint set
}
{
= x Rn : PxN x qxN
is constraint admissible and invariant for the mode-2
closed-loop system x(k + 1) = (A + BK)x(k)
Then, the closed-loop MPC-controlled system is recursively
feasible and locally asymptotically stable (region of attraction X)
.
213 / 253
Section 5
The region of attraction
214 / 253
.
.
Feasible set
Were almost ready to dene X. First, recall
The collection of input, state/output and terminal
constraints
Px x(k + j|k) qx , j = 0, 1, . . . , N 1
Pu u(k + j|k) qu , j = 0, 1, . . . , N 1
PxN x(k + N|k) qxN
may be written
Pc u qc + Sc x(k)
)
x(k) is the set of all u(k) that satisfy
the feasible set UN

the constraints
}
(
) {
UN x(k) = u : Pc u qc + Sc x(k)
215 / 253
Feasible set dependence on x(k)

UN
Propositions
{
}
x(k) = u : Pc u qc + Sc x(k)
)
With no constraints, UN x(k) is the full space

Rm Rm
(
)
With only input constraints, UN x(k) is non-empty for all
x(k) Rn
(
)
With both input and state/output constraints, UN x(k)
may be empty for some x(k) Rn
216 / 253
.
.
Set of feasible initial states

Motivated by these results, we dene
{
}
XN = x : there exists a u UN (x)
Propositions
With no constraints, XN = Rn
With only input constraints, XN = Rn
With both input and state/output constraints, XN Rn
217 / 253
Lyapunov functions and stability of MPC

For linear MPC,
(
)
x(k + 1) = Ax(k) + BN x(k)
Proposition
If there exists a scalar function V : Rn 7 R such that
V(0) = 0
(
V(x) > 0, x X \ {0}
V Ax + BN (x) V(x) < 0, x X \ {0}

then the origin is an locally asymptotically stable
(LAS)
(
)
equilibrium point for x(k + 1) = Ax(k) + BN x(k) , with region
of attraction X.
218 / 253
.
.
Stability of MPC
Proposition
If
1
(a) (Q 2 , A) is detectable, and Q 0, R 0
(b) P satises the Lyapunov equation
(A + BK) P(A + BK) P + (Q + K RK) = 0

for some K such that i (A + BK) < 1 for all i,
(c) the terminal set is constraint-admissible and invariant for
x(k + 1) = (A + BK)x(k)
then
J is a Lyapunov function for x X = XN
N
The MPC-controlled system is locally asymptotically stable
The region of attraction is X = XN
.
219 / 253
Stability of MPC
No constraints
XN = Rn
The value function JN is a global Lyapunov function
The MPC-controlled system is globally asymptotically

stable
220 / 253
.
.
Stability of MPC
Input and state/output constraints
XN Rn
The value function JN is a local Lyapunov function
221 / 253
Stability of MPC
Input constraints
With strictly only input constraints XN = Rn
But we impose the terminal set Rn
Therefore, XN Rn
The value function JN is a local Lyapunov function
(If the system is open-loop stable, however, it is possible to

guarantee global stability without the terminal state constraint,
via a dierent P and Lyapunov function see Section 2.5.2 of
Rawlings and Mayne)
222 / 253
.
.
Part V
Oset-free tracking and
disturbance rejection
223 / 253
Section 1
Setpoint tracking
224 / 253
.
.
Setpoint tracking
To now, weve studied the regulation problem
.
MPC
System
We assumed
objective is to steer x(k) 0 as k
the state x(k) is known at each k
225 / 253
Setpoint tracking
Commonly, however, we are interested in tracking a setpoint or
reference signal
r.
MPC
System
where the objective is to steer y(k) r as k

Essentially, this is a problem of regulating the tracking error,
r y(k), to zero, but there are some subtleties
226 / 253
.
.
Baseline assumptions
Discrete-time linear state-space model

x(k + 1) = Ax(k) + Bu(k)
y(k) = Cx(k)
Here x Rn , u Rm , y Rp
State x(k) is measurable at every k
Reference r is piecewise constant
Control objective is to have y track r while minimizing a
stage cost function
(
)
l y(k) r, u(k) uss
k=0
Well rst assume no uncertainty, then generalize to the

uncertain case
227 / 253
Tracking output
Of course, it is not always possible or desirable to steer all
outputs to arbitrary setpoints
not possible to maintain a constant level in a tank while

maintaining a constant net in-/out-ow
not possible to maintain a car at constant speed and

position
Therefore, it is often convenient to dene a tracking output

z(k) = Hx(k)
where z Rq , q < p, and aim for z(k) r.
Here, to simplify exposition, well assume H = C so z = y
228 / 253
.
.
Section 2
Setpoint tracking no uncertainty
229 / 253
An MPC framework for setpoint tracking

r.
uss
xss +
SSTO
MPC
u(k) uss
Dene
(k) x(k) xss
Full state measurement/feedback

Steady-state target optimizer (SSTO) computes (xss , uss )
given setpoint r
MPC has to steer
x(k) xss
Ax + Bu
(k) u(k) uss
Then the aim is to regulate

(k) 0
(k) 0
230 / 253
The LQ-MPC tracking problem

min
(k)
N1
(k + j|k)Q(k + j|k) + (k + j|k)R(k + j|k)
j=0
+ (k + N|k)P(k + N|k)
subject to
(k + j + 1) = A(k + j|k) + B(k + j|k), j = 0, 1, 2, . . . , N 1
(k|k) = (k)
Px ((k + j|k) + xss ) qx , j = 0, 1, . . . , N 1
Pu ((k + j|k) + uss ) qu , j = 0, 1, . . . , N 1
PxN ((k + N|k) + xss ) qxN
.
231 / 253

Dealing with constraints
Px ((k + j|k) + xss ) qx , j = 0, 1, . . . , N 1
Pu ((k + j|k) + uss ) qu , j = 0, 1, . . . , N 1
PxN ((k + N|k) + xss ) qxN
Why? We want, for example,
xmin x(k) xmax
xmin (k) + xss xmax
In practice, we change the right-hand sides
xmin xss (k) xmax xss
Px (k) qx Px xss
232 / 253
.
.

min
(k)
N1
(k + j|k)Q(k + j|k) + (k + j|k)R(k + j|k)
j=0
+ (k + N|k)P(k + N|k)
subject to
(k + j + 1) = A(k + j|k) + B(k + j|k), j = 0, 1, 2, . . . , N 1
(k|k) = (k)
Px (k + j|k) qx Px xss , j = 0, 1, . . . , N 1
Pu (k + j|k) qu Pu uss , j = 0, 1, . . . , N 1
PxN (k + N|k) qxN PxN xss
This is a standard MPC problem, albeit in (, )
.
233 / 253

Given (xss , uss ) the theory and algorithms developed for
regulation still apply
{
}
(k) = (k|k), (k + 1|k), . . . , (k + N 1|k)
The applied control is
(
)
(k) = (k|k) = N (k)
u(k) = uss + (k|k) = uss + N x(k) xss
If N is stabilizing for (k + 1) = A(k) + B(k), then

(k) 0, (k) 0 x(k) xss , u(k) uss
The subleties are in target calculation: we need (xss , uss ) to

correspond to
lim y(k) = yss = Cxss = r
234 / 253
Section 3
Target optimization
235 / 253
Target equilibrium pairs
Given (xss , uss ), the system is in equilibrium if and only if

xss = Axss + Buss
The equilibrium is oset-free (i.e., y tracks r with zero

steady-state error) if and only if
Cxss = r
(9)
(10)
Combining (9) and (10),

[
][ ] [ ]
I A B xss
0
=
C
0
uss
r
236 / 253
.
.

[
][ ] [ ]
I A B xss
0
=
C
0
uss
r
|
{z
}
T
When does a solution exist?

T is an (n + p)-by-(n + m) matrix
If rank(T) = n + p and p m (T full row rank), then for any
r there exists a pair (xss , uss )
(Note this requires number of outputs number of inputs)
If rank(T) = n + p and p = m (T full rank), then for any r
there exists a unique pair (xss , uss )
(Note this requires number of outputs = number of inputs)
If T is only full column rank, then a pair (xss , uss ) exists for
only some r
.
237 / 253

Examples
]
[ ]
1 1
0.5
For the system x(k + 1) =
x(k) +
u(k)
0 1
1
If C = [1 0], r = ysp , then m = p = 1, T is 3 3, rank(T) = 3
and

0
xss,1
0 1 0.5
0 0
1 xss,2 = 0
ysp
uss
1 0
0
xss,1 = ysp
uss = 0
xss,2 = 0
But if C = I, then p = 2 > m = 1, T is 4 3, rank(T) = 3, and

no solution exists unless r2 = 0
238 / 253
.
.
Target optimization under constraints

It might be that the desired (xss , uss ) does not satisfy constraints
In that case, a popular approach is to solve an optimization
problem to determine the nearest equilibrium pair within the
constraints. For example,
{
}
min yss r+uss : xss = Axss +Buss , Px xss qx , Pu uss qu
{xss ,uss }
A steady-state error is inevitable, since yss = Cxss = r
239 / 253
Disadvantage of this approach

What if uss is not known exactly?
An estimate has been used
Modelling errors
Numerical precision
ss in the MPC
Suppose the correct value is uss but we use u
optimization and control law. Then,
ss + (k|k)
u(k) = u
ss uss ) + (k|k)
= uss + (u
Applying this to the system
(
)
ss uss ) + (k|k)
x(k + 1) = Ax(k) + B uss + (u
(
)
(
)
ss uss
= Ax(k) + B uss + (k|k) + B u
240 / 253
.
.
Disadvantage of this approach

(
)
(
)
ss uss
x(k + 1) = Ax(k) + B uss + (k|k) + B u
The system will not converge to xss . Suppose x(k) = xss
x(k) = xss (k) = 0
(k|k) = 0
ss uss )
x(k + 1) = Axss + Buss + B(u
ss uss )
x(k + 1) = xss + B(u
It can be shown that the system will converge to some xss = xss
ss and
Therefore, if there is even the smallest error between u
uss , then there will be a steady-state error between yss and r!
.
241 / 253
Eliminating oset the u form

To avoid this issue, an alternative formulation of MPC is used
min
u(k)
N1
[y(k+j|k)r] S[y(k+j|k)r]+u (k+j|k)Ru(k+j|k)
j=0
+ (k + N|k)P(k + N|k)
where
u(k + j|k) = u(k + j|k) u(k + j 1|k)
u(k|k) = u(k|k) u(k 1)
Can be shown that u(k) 0 doesnt matter what uss is
Assuming yss = r is feasible, y(k) r
Standard practice in industry; also form adopted in Maciejowski
242 / 253
.
.
Section 4
Setpoint tracking under uncertainty
243 / 253
Tracking under uncertainty

ss = uss issue indicates that there could be a
Our glance at the u
problem if a disturbance acts on the system
u )
x(k + 1) xss = A(x(k) xss ) + B (k|k) + B(u
| ss{z ss}
disturbance
since y(k) yss = r

More generally, well consider the uncertain system
x(k + 1) = Ax(k) + Bu(k) + Bd d(k)
y(k) = Cx(k) + Dd d(k)
where d is an disturbance that aects the process and/or the
output
244 / 253
.
.
Tracking under output disturbance

Example
Lets look again at
]
[ ]
1 1
0.5
x(k + 1) =
x(k) +
u(k)
0 1
1
[
]
y(k) = 1 0 x(k) + d
and r = ysp
Using the SSTO equations, we found that
[
][ ] [ ]
[ ]
I A B xss
0
y
=
xss = sp , uss = 0
C
0
uss
r
0
Applying tracking MPC, x(k) xss , u(k) uss = 0
Hence, y(k) ysp + d
Clearly, unless we model d, therell always be an oset
245 / 253
An MPC framework for tracking under uncertainty

d
r.
SSTO
uss
+
xss
MPC
Dd
Ax + Bu + Bd d
+ +
d
Observer
x
x(k + 1) = Ax(k) + Bu(k) + Bd d(k)

y(k) = Cx(k) + Dd d(k)
246 / 253
.
.
An MPC framework for tracking under uncertainty

Assumptions
The disturbance is (piecewise) constant: d(k + 1) = d(k)

We can measure perfectly
the state:
x=x
=d
the disturbance: d
SSTO computes (xss , uss ) given r and d
MPC has to steer
x(k) xss
Dene
(k) x(k) xss
(k) u(k) uss
Then the aim is to regulate

(k) 0
u(k) uss
(k) 0
247 / 253
State and disturbance estimation

If we could not measure x and d, we would have to estimate
them from (possibly noisy) measurements of the output y(k)
To do this, we design an observer
[
] ([
] [ ]
)[
]
] x(k|k 1)
x(k + 1|k)
A Bd
Lx [
C Dd
+ 1|k) =
0 I
Ld
d(k
d(k|k
1)
{z
}
|
A
[ ]
[ ]
B
L
+
u(k) + x y(k)
0
Ld
With no noise, estimation error converges to zero if A is

stable (i.e., has eigenvalues within the unit circle)
With noise, Kalman lter theory tells us how to set (Lx , Ld )
to minimize the mean-square estimation error
248 / 253
.
.
SSTO under output disturbance

The SSTO equations are modied from
[
][ ] [ ]
I A B xss
0
=
C
0
uss
r
|
{z
}
T
to
][ ] [
]
I A B xss
Bd d
=
C
0
uss
r Dd d
|
{z
}
T
(xss , uss ) now account for d
Otherwise, the same conditions hold for the existence of

target equilibrium pairs
249 / 253
The LQ-MPC oset-free tracking problem

min
(k)
N1
(k + j|k)Q(k + j|k) + (k + j|k)R(k + j|k)
j=0
+ (k + N|k)P(k + N|k)
subject to
(k + j + 1) = A(k + j|k) + B(k + j|k), j = 0, 1, 2, . . . , N 1
(k|k) = (k)
Px (k + j|k) qx Px xss , j = 0, 1, . . . , N 1
Pu (k + j|k) qu Pu uss , j = 0, 1, . . . , N 1
PxN (k + N|k) qxN PxN xss
(xss , uss ) already account for d
250 / 253
.
.
Oset-free tracking
Example
Our system
]
[ ]
1 1
0.5
x(k + 1) =
x(k) +
u(k)
0 1
1
[
]
y(k) = 1 0 x(k) + d
previously tracked r = ysp with non-zero oset

The revised SSTO equations give
[
][ ] [
]
[
]
I A B xss
0
rd
=
xss =
, uss = 0
C
0
uss
rd
0
Applying tracking MPC, x(k) xss , u(k) uss = 0
Hence, y(k) (r d) + d = r
The observer and controller ensure oset-free tracking
251 / 253
Oset-free tracking
Summary
r.
SSTO
uss
+
xss
MPC
Dd
Ax + Bu + Bd d
+ +
d
Observer
x
Use SSTO with estimate of d to compute (xss , uss )

Use tracking MPC to send x(k) xss , u(k) uss
Disadvantages
Whenever r or d changes, have to recompute (x , u )
ss ss
Success depends on getting (x , u ) right
ss ss
252 / 253
.
.
Recall: eliminating oset with the u form

To avoid this issue, an alternative formulation of MPC is used
min
u(k)
N1
[y(k+j|k)r] S[y(k+j|k)r]+u (k+j|k)Ru(k+j|k)
j=0
+ [x(k + N|k) xss ] P[x(k + N|k) xss ]

where
u(k + j|k) = u(k + j|k) u(k + j 1|k)
u(k|k) = u(k|k) u(k 1)
Can be shown that u(k) 0 doesnt matter what uss is
Assuming yss = r is feasible, y(k) r
Standard practice in industry; also form adopted in Maciejowski
.
253 / 253

MPC Week 1 Introduction

Transféré par

Informations du document

Titre original

Copyright

Formats disponibles

Partager ce document

Partager ou intégrer le document

Options de partage

Avez-vous trouvé ce document utile ?

Ce contenu est-il inapproprié ?

Droits d'auteur :

Formats disponibles

MPC Week 1 Introduction

Transféré par

Droits d'auteur :

Formats disponibles

.

Introduction to the module

Teaching contact hours

7 hours of tutorial sessions

Around 110 hours of independent study time

Introduction to the module

60% written examination

2-hour examination paper in May/June: answer 3 questions

40% continuous assessment

Introduction to the module

Feedback is an important part of how you learn

Applies to knowledge, understanding, specic and more

A key part of your academic and professional development

Learning is not just about the marks you get

Feedback can be from me, your peers and most

Ultimately to benet from feedback you must reect on

Make use of information provided in many forms make

Introduction to the module

Reect on your own understanding throughout the module

Discussions with other students

Ask questions during/after lectures

In-class questions and exercises

Do the problem sets and attend labs and tutorial classes

Associate tutors in labs and tutorial classes

Individual written feedback on assessment performance

Whole-class feedback on exam performance

This week Model predictive control

This week Model predictive control

1. What is Model Predictive Control?

What is model predictive control (MPC)?

Constraints are ubiquitous

Optimal operation often means operating near constraints

Operating near limits

(Redrawn from Maciejowski)

Constraints are ubiquitous

Anti-windup techniques for PID

Detuning optimal LQR

Trial and error

Enter model predictive control

Constraints handled explicitly in design

Handles multivariable systems easily

Like LQR, optimizes a system performance measure

Allows optimal operation, closer to limits

MPC is the only advanced control technique to have made

J. M. Maciejowski. Predictive Control with Constraints. Prentice Hall,

MPC the basic idea

Measure the state or output of the system at the current

Solve an optimization problem to nd the best control

Apply the optimized control input

Repeat at the next sampling instant

MPC the basic algorithm

MPC the basic algorithm

MPC the basic algorithm

MPC the basic algorithm

MPC the basic algorithm

Use dynamic model of plant to predict

where u(k), x(k), y(k) are input, state, output at k

Choose forecast that minimizes a predicted cost

while satisfying any constraints on u, x, y

Use constrained optimization to do this

The receding horizon principle

Actual plant evolves to

Repeat at next sampling instant