ONE-WAY ANALYSIS OF VARIANCE.
Another important example of the general linear hypothesis involves
the analysis of variance. We have already derived tests of hypotheses regarding the
equality of the means of two normal populations when the variances are equal. In
practice, one is frequently interested in the equality of several means when the vari-
ances are the same, that is, one has & samples from N(it1,0),--- NC, 0),
where 0? is unknown and one wants to test Ho: 1 = 2 = Mg (see Ex-
ample 1). Such a situation is of common occurrence in agricultural experiments.
Suppose that k treatments are applied to experimental units (plots), the ith treatment
is applied ton; randomly chosen units, i = 1,2,... ,k, 4.4 mi =n, and the obser-
vation yi; represents some numerical characteristic (yield) of the jth experimental
unit under the ith treatment. Suppose also that
Yj = Mi + &ijs j=1,2,.
where ei; are iid W(0, 0?) RVs. We are interested in testing Ho: #1 = w2 = -~
pg. We write
‘The model described in this example is frequently referred to as a one-way anal-
ysis of variance model. ‘This is a very simple example of an analysis of variance
‘One-Way Analysis of Variance
Source of Degrees of Mean Sum
Variation ‘Sum of Squares Freedom —_of Squares F-Ratio
[ : BSS/(k—1)
Between BSS = done. Yy k-1 BSS/(k — 1) Wisin
Within wss = 73, - Yi, n-k WSS/(n — k)
ft jot
Mean ny” 1
Total Tss => 0 ¥} n
‘The third row, “Mean,” has been included to make the total of the second column
add up to the total sum of squares (TSS), 7}_ 77, ¥3Example I. The lifetimes (in hours) of samples from three different brands of
batteries, Y), Yz, and Y3, were recorded, with the following results:
%
Ys
60 60
40 50
55 10
65 65
15
40
hl
We wish to test whether the three brands have different average lifetimes. We will as-
‘sume that the three samples come from normal populations with common (unknown)
standard deviation .
From the data ny = 5,2 = 4,n3 = 6,n = 15, and
200
-
220 sy,
4 3
n=
5 4 6
Lon - 91? = 400, S02 — ¥2)? = 350, S01 — ¥5)? = 850.
ii at
mi
Also, the grand mean is
200+ 220+ 360 _ 780 _
15 “1S
‘Thus
BSS = 5(40 — 52)? + 4(55 — 52)? + 660 — 52)?
= 1140
and
WSS = 400 + 350 + 850 = 1600.
Analysis of Variance
Source SS df. MSS F-Ratio
Between 1140 2 570 570/133.33=4.28
Within = 160012 133.33
Choosing a = 0.05, we see that Fy = Fs,12,0.05 = 3.89. Thus we reject Ho: 41 =
Hz = U3 at level @ = 0.05.TWO-WAY ANALYSIS OF VARIANCE WITH
ONE OBSERVATION PER CELL
In many practical problems one is interested in investigating the effects of two fac-
tors that influence an outcome. For example, the variety of grain and the type of
fertilizer used both affect the yield of a plot; or the score on a standard examination
is influenced by the size of the class and the instructor.
Let us suppose that two factors affect the outcome of an experiment. Suppose also
that one observation is available at each of a number of levels of these two factors
Let ¥j@ = 1,2,... a; j = 1,2,... ,6) be the observation when the first factor is
at the ith level and the second factor at the jth level. Assume that
qd) y;
M+ a + Bj + bij, WQ...,a) 0 fHd.2....b
where aj is the effect of the ith level of the first factor, f; is the effect of the jth level
of the second factor, and ¢;; is the random error, which is assumed to be normally dis-
tributed with mean 0 and variance o?. We will assume that the ¢;;'s are independent.If the data are put into the following form:
Level of factor 2
Bh 1 2 b | Row mean
@
17%, Yin or, Ye Yr.
Level 2 | Yo, Yor, +++» Yon Y2.
of : : :
factor 1
a |} Yai, Yar Yat
Column mean | ¥4, ¥.2, » Yo
so that the rows represent various levels of factor 1, and the columns, the levels of
factor 2, one can write
between sum of squares for rows = b ) (¥,. - ¥)*
a
= sum of squares for factor 1
=SS).
Similarly,
—
between sum of squares for columns =a) (¥.; — ¥)?
a
= sum of squares for factor 2
= SS.
=Y Iris usual to write error or residual sum of squares (SSE)
Tha Djely —P Py +
‘Two-Way Analysis of Variance Table with One Observation per Cell
Source of Sum of Degrees of Mean
Variation Squares Freedom Square F-Ratio
Rows SS, a-1 MS, = SS, /(a- 1) MS, /MSE
Columns SS, b-1 MS; = SS2/(b - 1) MS, /MSE
Error SSE (@-1)@-1) MSE=SSE/(a — 1)(b- 1)
Mean aby" 1 aby”
Total xy > Y} ab y y Yj /ab
aeExample 1. The following table gives the yield (pounds per plot) of three vari-
eties of wheat, obtained with four different kinds of fertilizers.
Variety of Wheat
Fentilizer A B G
@ 8 3 7
8 10 4 8
y 6 5 6
5 8 4 7
Let us test the hypothesis of equality in the average yields of the three varieties of
wheat and the null hypothesis that the four fertilizers are equally effective.
In our notation, b 4, ¥y. = 6, Yo. = 7.33, Va. = 5.67, ¥q. = 6.33,
y =4,93 6.33.
SS) = sum of squares due to fertilizer
= 30.33)? + 1? + (0.66)? + 0]
4.67;
SS2 = sum of squares due to variety of wheat
= 4((1.67)? + (2.33)? + 0.67)7)
= 34.67
and
43
SSE = 7° i —F;-- Fj +P
=i
=7:33
‘The results are shown in the following table:
Analysis of Variance
Source SS) df. MS F-Ratio
Variety of wheat 34672 17.33 14.2
Fertilizer 4673 1561.28
Error iG 1,22
Mean 481.3300 1 481.33
Total 528.00 12 44.00
Now F2,6,0.05 14 and F3,6,0,95 = 4.76. Since 14.2 > 5.14, we reject Hg, that
there is equality in the average yield of the three varieties; but since 1.28 ¥ 4.76, we
accept Ha, that the four fertilizers are equally effective.sre are we ive oct ice Ise GSC L9E BLE SRE BE TOY OIF wy OY RY ws
It Wl WT HL BT TET RET WT WT IST ST OT BT LZ WT WE WE we el
HE SEE WE WE OE OSE OE SLE OE BEE SUF STF TY OEY soy wy 905 sos
OT IT TET SET 9% OFZ WE OT HT OO WE HT WT wT wz we IIe ore a
OE WE we OLE BLE ORE tee WY Oy ITY 6rP OY SFY HOSP er ws ws ws
OT IT WE ST ve ost IST 19Z SOT OLT WT BLT BT M67 le @€ ore we "
T6E GE 96 TOP SUP UY sty teh Wy Us OF Tey BLP seY Ws 6s Hs 39
BT SST HT OT IVT 197 OT HT LT WT BT 167 HOT LOT we we et We or
Teh cy Ser THY gyF ISy wr LY Oey Tey OOS ITS B'S 9TS Ws 08s 909 69
We we ELT OT LET Bz RZ 06% 6% 867 WE WE ore Ere ore WE are oe 6
RY BBY Isr 96r OOS WS Ors 8S 9S BS OFS LS WS THs 19 Leo 99 6
£67 MOT 96% 86% ODE EOE WE WE STE ore &E BE Ike HEE OSE BSE OE wr 8
sys iS WS SUS BLS SHS aes 09 STO LTO SED v9 B59 TD OL OL FL sv8
TE WE STE WE OE EE BEE WE WE OE TE LOE OE OE oe WE UE sey L
89 069 P69 669 TL OL WL TEL OL TL OL WL OL UBL oe 8 SLB a6
WE WE OE LE WE see IE WE LSE TE 96 OOF COP We Tey ste EY oy 9
ws ws Wwe ETE LTS Ws 86 LS S56 896 LE HE 966 SHOT SYOT LOT L6OT 6ETT wz
9b Ly Rey OF thy Fry Ost ESF SY ODF HY BF OCF Hy Bey Seb US 1s $
HEL GEL TTEL AFC WEL GEL HET EVEL EEL CWE SIT HEFT LEME SPOT PSHE R6YT IZST WEST 86ST 699T
9S WS SHS 9S HS OLS ILS HLS LS OBS HRS WAS 16S GS 965 9 919 979 69 ’
U9 PENT BIN ETH LTH OCS IH OF ON KIT KOM THT SULT TLE ETL HE OFLA LL ILE WR We oFEL
{$8 HSB HSB IR LOB RSF OTF TR 198 HF GE ILE WE NS RE 18S HBR BR HOR 106 U6 sS €
05°66 0566 665 F655 BY'SG BY'65 LYS IY6S SY'65 HE B66 THOS THOS YS B66 9EK HEH {E65 OCG STH LIE
OSG OSI GHST GFT BEI LYST LHI SGI SHOT HOI EFOI CHOI I¥6I OYE GES! BEI LES! HOI ESI OFT STOI 9161 t
9969 19D TSC HEED ETED TORY 98L9 BETD HET O29 GID THI 9OT9 7809 9509 TOY TREE BLES 6SRE HOLS SC9S COS GO6y ZSOP
WS HS HST EL EST TST ST OS GH BT OOM SH HE EH CTH ONCOL CLETCMELCOEL:CSe:COOT OCT 1
cot ois i Goc OUT ccm Os in Oe nT cents ne Tne nn