Académique Documents
Professionnel Documents
Culture Documents
pradeepr@cs.utexas.edu
Outline
Vectors (Norms, Distances, Inner Products, Orthogonality, Linear
Combinations, Linear Independence, Linear Subspace, Basis, Orthogonal
Basis)
Vectors
Vectors
v
u
u-v
u
u+v
v
v
Vectors
v
u
u-v
u
u+v
v
v
Vectors
v
u
u-v
u
u+v
v
v
Vectors
v
u
u-v
u
u+v
v
v
Vectors
v
u
u-v
u
u+v
v
v
Vectors
u
2u
Vectors
u
2u
Vectors
u
2u
Vectors
u
2u
Vectors
u
2u
Vector Space
A vector space is a set of vectors, along with associated scalars (typically:
real numbers), that satisfy properties in previous two slides, and that are
closed under vector addition and scalar multiplication
And from the previous two slides, we can treat them like ordinary numbers
for the most part
2 x2 +
= ... =
= 0.
3 x3 .
2 x2 +
= ... =
= 0.
3 x3 .
2 x2 +
= ... =
= 0.
3 x3 .
Vectors
x=
2
1
2
=1
1
0
+2
0
1
Can thus represent a vector as an array of numbers: where the numbers are
the coecients of the basis vectors in the linear combination
Vectors
A vector can be thought of as having a direction and a magnitude
Vectors
A vector can be thought of as having a direction and a magnitude
This magnitude is called a vector norm
Vectors
A vector can be thought of as having a direction and a magnitude
This magnitude is called a vector norm
Properties satisfied by vector norms || . ||
Vectors
A vector can be thought of as having a direction and a magnitude
This magnitude is called a vector norm
Properties satisfied by vector norms || . ||
|| x || >= 0 and || x || = 0 if and only if x = 0
Vectors
A vector can be thought of as having a direction and a magnitude
This magnitude is called a vector norm
Properties satisfied by vector norms || . ||
|| x || >= 0 and || x || = 0 if and only if x = 0
|| a x || = | a | || x ||
(Homegeneity)
Vectors
A vector can be thought of as having a direction and a magnitude
This magnitude is called a vector norm
Properties satisfied by vector norms || . ||
|| x || >= 0 and || x || = 0 if and only if x = 0
|| a x || = | a | || x ||
(Homegeneity)
|| x + y || <= || x || + || y ||
(Triangle Inequality)
x1
x2
..
.
6
6
x=6
4
x2 =
xn
3
7
7
7
5
p
p
: 1-norm
x1 = max |xi |
i=1
-norm
: p-norm
Distances
x=
1
2
y=
2
1
1
2
2
2
x y2 =
= (1 2) + (2 1) = 2
2
1
2
x
y1 = 2
y1 = 1
Metrics
A distance d(x, y) is a metric i
d(x, y)
0, and d(x, y) = 0 i x = y
d(x, y) = d(y, x)
(Symmetry)
(Triangle Inequality)
Metrics
A distance d(x, y) is a metric i
d(x, y)
0, and d(x, y) = 0 i x = y
d(x, y) = d(y, x)
(Symmetry)
(Triangle Inequality)
zk = k(x
d(x, y) = kx
y) + (y
yk is a valid metric.
yk + ky
Metrics
A distance d(x, y) is a metric i
d(x, y)
0, and d(x, y) = 0 i x = y
d(x, y) = d(y, x)
(Symmetry)
(Triangle Inequality)
zk = k(x
d(x, y) = kx
y) + (y
yk is a valid metric.
yk + ky
Metrics
A distance d(x, y) is a metric i
d(x, y)
0, and d(x, y) = 0 i x = y
d(x, y) = d(y, x)
(Symmetry)
(Triangle Inequality)
zk = k(x
d(x, y) = kx
y) + (y
yk is a valid metric.
yk + ky
6
6
x=6
4
x1
x2
..
.
xn
7
7
7
5
6
6
y=6
4
y1
y2
..
.
yn
3
7
7
7
5
Inner Product: x y = x1 y1 + x2 y2 + . . . + xn yn =
2
3
y1
7
y
6
2
7
6
Can be viewed as: x1 x2 . . . xn 6 . 7
4 .. 5
yn
Examples: x2 = kxk22 , kx
yk22 = (x
y)T (x
y)
Pn
i=1
x i yi
6
6
x=6
4
x1
x2
..
.
xn
7
7
7
5
6
6
y=6
4
y1
y2
..
.
yn
3
7
7
7
5
Inner Product: x y = x1 y1 + x2 y2 + . . . + xn yn =
2
3
y1
7
y
6
2
7
6
Can be viewed as: x1 x2 . . . xn 6 . 7
4 .. 5
yn
Examples: xT x = kxk22 , (x
y)T (x
y) = kx
Pn
yk22
i=1
x i yi
Projections
x=
1
2
y=
2
1
xT y
cos =
kxk2 kyk2
Projections
x=
1
2
y=
2
1
xT y
cos =
kxk2 kyk2
Projection of x onto y:
Magnitude: kxk2 cos = xT
y
kyk2
= xT
yb
|{z}
Unit norm
Orthogonal
y