Complex numbers.

Reference note to lecture 1 ECON 5101/9101,

Time Series Econometrics
Ragnar Nymoen
Feb 3 2011
1 Introduction
This note gives the denitions and theorems related to complex numbers that are
used in the course. The note is a stand alone supplement to Hamiltons book and
there has been no attempt to synchronize the notation.
2 Denition and representations
. is a complex number if
. = c + i/
where c,/ are real numbers and i =
_
1 is an imaginary number that satises
i
2
= 1. We often write
Re(.) = c
for the real part of . and
Im(.) = /
for the imaginary part of ..
A real number like c can often be interpreted as a special complex number by
writing it as c + i 0. Similarly: A way of writing i is 0 + i 1.
Denition 1 (Addition and multiplication) We have the following denitions
for addition and multiplication of complex numbers:
.
1
+ .
2
= (c
1
+ i/
1
) + (c
2
+ i/
2
)
def
= (c
1
+ c
2
) + i(/
1
+ /
2
)
.
1
.
2
= (c
1
+ i/
1
)(c
2
+ i/
2
)
def
= (c
1
c
2
/
1
/
2
) + i(c
1
/
2
+ c
1
/
2
)
With the use of these denitions we have all the rules we need for working
with complex numbers (except for inequalities).
A complex number (c + i/) is often shown graphically in a diagram with the
real part (c) along the horizontal axis, and the imaginary part (/) along the vertical
axis. Note that i is the unit of measurement on the vertical axis.
Denition 2 (Norm) The distance from . = c + i/ to origo is the norm of .:
[.[ =
_
c
2
+ /
2
.
Norm and modulus are synonyms.
1
Denition 3 (Conjugate) The complex conjugate to . = c + i/ is
. = c i/
With these denitions we have for example: i + 1 = 1 i, i = 1 and 2 = 2.
Denition 4 (Trigonometric form) The trigonometric representation of the com-
plex number . is:
. = c + i/ = [.[ cos o + i [.[ sin o = [.[ (cos o + i sin o)
where o, called the argument is given by
(2.1) sin o =
/
_
c
2
+ /
2
=
/
[.[
(2.2) cos o =
c
_
c
2
+ /
2
=
c
[.[
The representation is often referred to as the polar-coordinate form.
Note that the argument o is not uniquely dened: If o ts in (2.1) and (2.2),
then o + 2/:, / = 1. 2. . . . also t. A convention is to choose o to be in region
: < o _ :. If :,2 < o < :,2 we nd o as
o = arctan(
/
c
)
since tan(o) = sin(o), cos(o) = /,c.
3 Frequency and period
In time series analysis, it is practical to measure the frequency in cycles per unit of
time, which we denote by . If the unit of time is 1 year, the frequencies could be
for example 1,8, 1,4, 1 or maybe 2 cycles per year. Hence in this application the
relevant argument in the trigonometric function is positive. In classical harmonic
analysis, the frequency is measured in terms of radians per unit of time, and we have
the equation
o = 2:
relating the frequency in cycles per unit of time to radians per unit of time. From
the properties of the cosine function we have for example: = 0 = cos(2:0) = 1.
= 1,4 =cos(:,2) = 0. = 3,4 =cos(3:,2) = 0, = 1 =cos(2:) = 1.
In line with this convention, dened as cycles per unit of time, we therefore
determine the argument of the trigonometric form by solving (2.2)
cos(2:) =
c
[.[
=
2: = cos
1
(
c
[.[
) = arccos(
c
[.[
).
2
The period (some authors write periodicity) is dened as the inverse of the frequency:
jc:iod =
1

and gives the number of periods between two peaks. Hence a frequency of 1,2
corresponds to a jc:iod of 2 time periods for example.
As an example consider the complex pair . = 0.25 0.86i. Hence [.[ = 0.9.
2: = 1.29 and = 1.29,(2 3.14159) = 0.20531. The period is then
jc:iod =
1
0.20531
= 4.8707.
Complex roots root play a central role as drivers of the solutions of dynamic
equations, and of the properties of dynamic multipliers. Hence, if the pair . =
0.25 0.86i are the roots in the solution of model with second order dynamics, the
solution will be cyclical (with dampened cycles) and there will be approximately 5
periods between two peaks. Hence about 1,5 of a cycle is completed in each time
period. (e.g., a year).
Formally, the denition of period requires 0. However, in practice it
creates no misunderstanding to say that the zero frequency corresponds to an
innite jc:iod. In fact, many economic time series variables are charaterized by
low (estimated) frequenzies, and we speak of low frequency data and long-memory
processes as typical features in economics.
4 The exponential function
A function of a complex number is referred to as a complex function of a complex
variable. In this course we will need to the complex exponential function.
Denition 5 (The exponential function) If . is a complex number
. = r + i
we have that
exp(.)
def
= exp(r)(cos + i sin )
which is the denition of the (the natural) exponential function for complex values
of ..
In most cases the complex exponential function have the same properties as the
real version of the function (except when expressions involve or <). For example
we have
(4.3) exp(.
1
) exp(.
2
) = exp(.
1
+ .
2
)
since
exp(r
1
)cos(
1
) + i sin(
1
) exp(r
2
)cos(
2
) + i sin(
2
) =
exp(r
1
+ r
1
)cos(
1
+
2
) + i sin(
1
+
2
) = exp(.
1
+ .
2
).
However, the complex exponential function also has certain unique properties:
(4.4) exp(.) = exp(.)
3
and
(4.5) exp(. + i/2:) = exp(.) / = 0. 1. 2. ..
(4.5) follows from (4.3) together with
(4.6) exp(i/2:) = cos(/2:) + i sin(/2:) = 1
since sin and cos have the same period 2:.
Denition 6 (Exponential form) From the trigonometric representation we have
that
. = c + i/ = [.[ (cos o + i sin o).
From the denition of the exponential function, we see that
(cos o + i sin o) = exp(io)
implying that another way of writing the complex number . is
(4.7) . = c + i/ = [.[ exp(io).
The following rules are useful:
(4.8) exp(ir) = cos(r) + i sin(r)
exp(r) = cos(r) i sin(r)
cos(r) = exp(ir) + exp(ir),2
sin(r) = exp(ir) exp(ir),2i
5 The unit circle
The so called unit circle, see Hamilton (1994, p 709), can be dened with the use of
this representation.
Denition 7 The complex unit circle is dened as the set of complex numbers that
have norm (or modulus) equal to one 1.
We say that . = c + i/ = [.[ exp(io) in on the unit circle when [.[ = 1. . is
inside the unit circle when [.[ < 1. and nally, that . is outside the unit circle when
[.[ 1.
The complex number given by
(5.9) . = exp(i) = cos() + i sin()
denes the unit circle when 0 _ _ 2:, since [exp(i)[ =
p
cos()
2
+ sin()
2
= 1
from the properties of :i: and co:; or directly:
[exp(i)[ =
q
[exp(i)[
2
=
p
exp(i) exp(i) =
p
exp(0) = 1.
In spectral analysis we will dene a variable 0 _ _ 1 called the frequency
which measures the number of cycles per unit of time. With reference to (5.9) we
4
set = 2:. This gives the following listing of the relationship between frequency
and points on the unit circle:
cos(2:) sin(2:) . [.[
= 0 1 0 1 1
= 1,4 0 1 i 1
= 1,2 1 0 1 1
= 3,4 1 1 i 1
6 The fundamental theorem of algebra
We have from, for example Sydster (1978, Ch. 12) or Sydster and Hammond
(2002, p 114), that:
Theorem 1 (The Fundamental Theorem of Algebra) Any polynomial of de-
gree j can be factorized into factors of degree 1:
j(r) = c
0
r
n
+ c
1
r
n1
+ ... + c
p1
r + c
p
(6.10)
= c
0
(r :
1
)
m
1
(r :
2
)
m
2
...(c :
l
)
m
2
(6.11)
where multiplicities :
j
satisfy:
:
1
+ :
2
+ ... + :
l
= j.
:
1
. :
2
. ...:
l
are roots of the homogenous :th order equation:
c
0
r
p
+ c
1
r
p1
+ ... + c
p1
r + c
p
= 0.
In general the roots are (or can be written as) complex numbers. If each :
l
is counted
:
j
times, it follows that at any equation of degree j has : roots.
Theorem 2 (Complex pairs) If : is a root in an pth order equation with real
coecents c
i
, it follows that that also the conjugate, :, is a root. This implies that
complex roots always come in pairs.
Proof 1 (Complex pairs) From the rules for complex numbers:
c
0
:
p
+ c
1
:
n1
+ ... + c
p1
: + c
p
= 0 =
c
0
:
p
+ c
1
:
p1
+ ... + c
p1
: + c
p
= 0 = 0 =
c
0
:
p
+ c
1
:
p1
+ ... + c
p1
: + c
p
= 0
It follows that if j is odd there must be at least one real root.
In particuar we have that the pth order equation:
(6.12) A
p
= c
has j roots: We rst express c with the use of the exponential form c = [c[ exp(i(o +
/2:)), / = 0. 1. 2. .., where we have used that exp(/2:i) = 1. We can then write:
(6.12) as:
A =
n
p
[c[ exp(i
(o + /2:)
:
)
5
and the solution is found by choosing / such that 0 _ (o+/2:),: < 2:. Specically
we have
A
3
= 1 =A = exp(i
/2:
3
)
which gives the roots:
A = exp(i 0) = 1
A = exp(i
2
3
) = cos(

6
) + i sin(

6
) =
p
3
2
+ i
1
2
A = exp(i
4
3
) = cos(
2
6
) + i sin(
2
6
) =
p
3
2
i
1
2
where we use the trigonometric form and that complex roots always come in pairs.
7 Complex functions of a real variable
f
is a complex function of a real variable r if
f
can be written
f
(r) = u(r) + i v(r)
where u and v are usual real functions. Derivation and integration are dened in a
natural way:
Denition 8 (Derivation and integration)
f
0
(r)
def
= u
0
(r) + i v
0
(r)
R
b
a
f
(r)dr
def
=
R
b
a
u(r)dr + i
R
b
a
v(r)dr
The usual rules for derivations and integration can be used, here are some
examples:
(
f
+
g
)
0
=
f
0
+
g
0
(
f
g
)
0
=
f
0
g
+
g
0
f

f
g

0
=
f
0
g

g
0
f
g
2
R
(
f
+
g
)dr =
R
f
dr +
R
g
dr
R
b
a
f
0
dr =
f
(/)
f
(c)
Example 1 Since exp(ir) = cos(r) + i sin(r) we have
f
0
(r) = sin(r) + i cos(r)
= i

1
i
sin(r) + cos(r)

= i [(i) sin(r) + cos(r)]

= i exp(ir)
where we use cos
0
(r) = sin(r) and sin
0
(r) = cos(r) and 1,i = i and the rules in
(4.8).
Exercise 1 Show that
Z
b
a
exp(ir)dr =
1
i
(exp(i/) exp(ic))
6
References
Hamilton, J. D. (1994). Time Series Analysis. Princeton University Press, Prince-
ton.
Sydster, K. (1978). Matematisk analyse, Bind II . Universitetsforlaget, Oslo.
Sydster, K. and P. Hammond (2002). Essential Mathematics for Economics Anal-
ysis. Pearson Education, Essex.
7