Académique Documents
Professionnel Documents
Culture Documents
3.1.1. Definition
The outcomes in the sample space generated from a random experiment can be
qualitative or quantitative:
The quantification of qualitative outcomes from a sample space can be useful and,
by means of numerical measures, we may study the random behaviour.
The random variable concept provides us with a means for relating any outcome
to a quantitative measure. The random variable is a function that assigns a numerical
value to each elementary event in the sample space.
X :
Two possibilities:
a) When having numerical outcomes from the experiment, the potential values for
the variable can be the same than those for the experiment,
b) But, when having qualitative outcomes from the experiment, it will be necessary to
assign real values, that is, arbitrarily chosen values.
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~2~
______________________________________________________________________
of X is a function F that assigns, to each real number x, the probability that the
variable takes on values less than or equal to that number. That is,
1. 0 F(x) 1, x
2. lim F x 1
x
3. lim F x 0
x
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~3~
______________________________________________________________________
P(X=xi) = pi
Probability function
1. 0 P(xi) 1, xi
2. P X x p
i 1
i
i 1
i 1
k n
3. P(xk X xk+n)= p
i k
i pk pk n
In the same manner, the distribution of a variable can be characterized with the
cumulative probability distribution, F(xi):
F(xi) = P (X xi) = P X x
x j xi
j Cumulative probability distribution
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~4~
______________________________________________________________________
This expression reflects the relationship between the probability function and the
cumulative probability distribution.
Conclusion: a discrete random variable is defined when the set of possible values it
can take on and their respective probabilities are determined [through F(xi) or
P(X=xi)].
P(X=x) = 0, x
,
F x x F x
lim F x f x
x 0 x
Remember:
f x dx
a
F(a) = P (X a) = P(x < X x+dx) =
All infinitesimal
intervals on the
left of a
The density function and the cumulative probability distribution are two different
manners of getting the probability of an event.
i. f x 0, x
ii. The total area under the function f x is equal to one: f x dx 1 .
f x dx .
b
2. P (a < X < b) = P (a X < b) = P (a < X b) = P (a X b) = F(b) F(a) = a
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~6~
______________________________________________________________________
Let consider g(X)=Xr. The moment with respect to the origin of order r, r,
of the random variable X is
r E X r
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~7~
______________________________________________________________________
x
xi
r
i P X xi X discrete r.v.
r E X r
x r f x dx X continuous r.v.
Property
If there exists the moment with respect to the origin of order r (r), then all the
moments with respect to the origin of order s (s), with s < r, exist.
Let consider g(X)=(X-)r, where =E(x). The moment with respect to the
mean of order r, r, of the random variable X is defined as
r E X r
x
xi
i r P X xi X discrete r.v.
r E X r
x f x dx
r
X continuous r.v.
Property
If there exists the moment with respect to the mean of order r (r), then all the
moments with respect to the mean of order s (s), with s < r, exist.
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~8~
______________________________________________________________________
Moments with respect to the mean can be calculated, if they exist, as a function of
moments with respect to the origin.
Moments with respect to the mean Moments with respect to the origin
2 E( X )2 2 12
3 E( X ) 3 3 31 2 213
4 E( X )4 4 41 3 612 2 314
EXPECTED VALUE
g x P X x
xi
i i X discrete r.v.
E g X
g x f x dx
X continuous r.v.
Expected value of X
x i P X xi X discrete r.v.
xi
E X
x f x dx X continuous r.v.
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~9~
______________________________________________________________________
E c c , c constant
E X c E X c , c constant
Ec X c E X , c constant
Ea b X a b E X
4th) The mathematical expectation of the values deviations with respect to the mean of
the random variable equals zero
E X 0
Measures of position
These measures show the location or the values around which the variable is set. They
can be grouped into:
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~ 10 ~
______________________________________________________________________
1 E X
1 E X
b) Median (Me)
1 E X
Value of the random variable X that simultaneously satisfies
c) Mode (Mo)
Quantiles are values from the distribution that divide it into equal parts. The most
common types of quantiles are:
- Quartiles: these are three values that divide the distribution into four equiprobable parts.
- Deciles: these are nine values that divide the distribution into ten equiprobable parts.
- Percentiles: these are ninety nine values that divide the distribution into a hundred
equiprobable parts.
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~ 11 ~
______________________________________________________________________
Measures of dispersion
These measures show the degree of variability of the values from a random
variable with respect to the mean value considered as the representative one for the
distribution. The main measures are the variance and the standard deviation.
VARIANCE
Let consider g(X)=(X-)2. The variance is defined as the moment with respect
to the mean of order 2 and it is denoted by Var(X), V(X) or 2:
x
xi
i 2 P X xi X discrete r.v.
Var X 2 2 E X 2
x f x dx
2
X continuous r.v.
From properties 2 and 3, the variance of a linear combination of the r.v. X can be
determined as follows:
Var a b X b 2 Var X
4th) An abbreviated way of calculation for the variance of X is given by the expression
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~ 12 ~
______________________________________________________________________
Var X 2 2 12 2 2
5th) The variance of the sum of independent random variables equals the sum of
variances.
General case:
Var(X+Y)= Var(X) + Var(Y) + 2cov (X,Y)
Var(X- Y)= Var(X) + Var(Y) - 2cov (X,Y)
STANDARD DEVIATION
2 E X 2
2nd) A change of origin in r.v. X does not affect its standard deviation
X c X , c constant
cX c X , c constant
4th)
2 12 2 2
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~ 13 ~
______________________________________________________________________
X
Z
Let X be a random variable and g(X) a function of that variable, so that g(x) 0,
x. Then, for any constant c > 0 it is fulfilled:
E g X
Pg X c
c
E g X
In the same manner, Pg X c 1 .
c
Tchebychevs inequality
P X k
1
k2
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~ 14 ~
______________________________________________________________________
P X k 1
1
In the same manner, we have: .
k2
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~ 15 ~
______________________________________________________________________
X , Y : 2
that associates each elementary event with a pair of real numbers.
The joint cumulative probability distribution F(x,y) for the random variable
(X,Y) is an appliccation 2 [0,1] defined as follows:
Properties
1. 0 F(x,y) 1, (x,y) 2
2. F(-,y) = P (X < -; Y y) = 0
x, y
F(x,-) = P (X x; Y < -) = 0
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~ 16 ~
______________________________________________________________________
F1(x) and F2(y) are one-dimension cumulative probability distributions that indicate
the behaviour of each variable regardless of the behaviour of the other variable.
F(x|y) = P (X x|Y = y)
This function reflects the behaviour of one of the variables when the other is
subject to certain condition.
Properties
1. 0 pij 1, i,j
2. p
i 1 j 1
ij 1
The joint cumulative probability distribution for a discrete random variable (X,Y)
is given by:
Let (X,Y) be a discrete random variable. The marginal probability function for X is
pi P X xi P X xi , Y y j
y j
p j P Y y j P X xi , Y y j .
xi
F1 xi PX x ;Y y ;
xr xi y j
r j P X xi ; Y y s
F2 y j
xi ys y j
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~ 18 ~
______________________________________________________________________
Be (X,Y) a discrete random variable: the conditional probability function for X, given
the value yj with PY(yj) > 0, is
P X xi , Y y j
P xi | y j P X xi | Y y j
P Y yj
The conditional probability function for Y, given the value xi with PX(xi) > 0, is
P X xi , Y y j
P y j | xi P Y y j | X xi P X xi
The expressions for the conditional cumulative probability distributions for (X,Y) are:
P X x , Y y r j
F xi | y j P X xi | Y y j x r xi
P Y yj
P X x , Y y i s
F y j | xi P Y y j | X xi ys y j
P X xi
The joint density function, f x, y , for a random variable is the derivative with
Px X x x, y Y y y 2 F x, y
lim f x, y
x 0, y 0 x y x y
x y
F(x,y) = P (X x, Y y) = f u, v du dv
i. f x, y 0, (x,y) 2
ii. f x, y dx dy 1
f x, y dx dy
b d
2. P (a X b, c Y d) =
a c
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~ 20 ~
______________________________________________________________________
f1 x f x, y dy
f 2 y f x, y dx
.
F1 x P X x, Y f u, v du dv f1 u du ,
x x
F2 y P X , Y y f u, v du dv f 2 v dv .
y y
f x, y
f x | y
For X f2 y (condition: y < Y < y+y)
f x, y
f y | x
For Y f1 x (condition: x < X < x+x)
F x | y lim P X x | y Y y y f u | y du
x
y 0
F y | x lim P Y y | x X x x f v | x dv
y
x0
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~ 21 ~
______________________________________________________________________
- Discrete case: P X xi , Y y j P X xi P Y y j pi p j , xi, yj
- Continuous case: f x, y f1 x f 2 y
- Discrete case:
P X xi | Y y j P X xi ,
P Y y j | X x i P Y y j , x i , yj
- Continuous case: f x | y f1 x , f y | x f 2 y .
g x , y PX x , Y y
xi y j
i j i j (X,Y) discrete r.v.
Eg X ,Y
g x, y f x, y dx dy (X,Y) continuous r.v.
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~ 22 ~
______________________________________________________________________
x r
i
y sj P X xi , Y y j (X,Y) discrete r.v.
xi y j
rs E X r Y s
x r y s f x, y dx dy (X,Y) continuous r.v.
Property
If r=0 or s=0, the moments become marginal moments, that is, they can be
calculated from the corresponding marginal distributions of the variable.
x y
xi y j
i X
r
j Y s P X xi , Y y j
rs E X X r Y Y s (X,Y) discrete r.v.
x y f x, y dx dy
r s
X Y
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017
Lesson 3. Random variables Statistics I ~ 23 ~
______________________________________________________________________
Property
If r=0 or s=0, the moments become marginal moments, that is, they can be
calculated from the corresponding marginal distributions of the variable.
COVARIANCE (XY)
x y
xi y j
i X j Y P X xi , Y y j
x X y Y f x, y dx dy
1st) A change of origin in the r.v. (X,Y) does not affect its covariance
Properties 2 and 3 determine the covariance for the linear combination of variables X and Y:
Cov X , Y XY 11 10 01
The sign of the covariance of two rr.vv. reflects the direction of the linear relationship
that might exist between them:
Particular case:
E (X + Y) = E(X) + E(Y)
E (X - Y) = E(X) - E(Y)
Particular case:
E (X . Y) = E(X) . E(X|Y) , h1(X)=X, h2(Y)=Y
3rd) We had already seen the variance for the sum and for the difference of two
random variables,
Var (X + Y) = Var (X) + Var (Y) + 2 . Cov (X,Y)
Given the random variable (X,Y), the mathematical expectation for the r.v. X
conditional to certain value for Y (Y=y) is defined as:
x P X x | Y y
xi
i i (X,Y) discrete r.v.
E X | Y y
x f x | Y y dx (X,Y) continuous r.v.
The conditional expectation indicates which is the expected value for a variable given
the value for the other variable.
Property
E X | Y y E X E Y | X x E Y
______________________________________________________________________
Degree in Economics / Estefana Mourelle Espasandn 2016/2017