EEM424 Design of Experiments

Lecture 2

24-9-2018
Mohd Nazri Mahmud
 AGENDA

• Learning activity: Planning for a simple comparative

experiment
• Lesson & Examples:
– Data analysis for a simple comparative experiment
• Assignment 1: Executing a simple comparative
experiment and analysing data
 Learning activity

• Planning for a simple comparative experiment

involving paper aeroplanes.
• After 1 hour share your plan in class
 AGENDA 2

• Data Analyses for a simple comparative experiments

DATA ANALYSIS

We are interested in comparing the

strength of two different formulations:
an unmodified mortar
and a modified mortar.
In general, we can think of these two
formulations as two levels of the
factor “formulations.”
 DATA ANALYSIS 1:
THE DOT DIAGRAM

By visual examination of the data:

• the strength of the unmodified mortar
MAY BE greater than the strength of the
modified mortar.
 DATA ANALYSIS 1:
THE DOT DIAGRAM

The dot diagram enables the experimenter to see quickly

• the general location or central tendency of the
observations and
• their spread or variability.
The dot diagram reveals that
• the two formulations MAY differ in mean strength
but
• both formulations produce about the same
variability in strength.
 DATA ANALYSIS 1:
THE DOT DIAGRAM

By comparing the statistical property of the data

• average tension bond strengths
• 17.04 vs 16.76
However, it is not obvious that this difference is large enough
to imply that the two formulations really are different.
Perhaps this observed difference in
average strengths is the result of sampling fluctuation and
the two formulations are really identical.
Possibly another two samples would give opposite results,
with the strength of the modified mortar exceeding that of the
unmodified formulation.
 DATA ANALYSIS 2:
HYPOTHESIS TESTING

Hypothesis testing can be used to assist

the experimenter in comparing these two formulations.

Hypothesis testing allows the comparison

of the two formulations to be made on objective terms,
with knowledge of the risks associated with reaching the
wrong conclusion.
 The Hypothesis Testing
Framework

• Statistical hypothesis testing is a useful

framework for many experimental situations
• Origins of the methodology date from the
early 1900s
• We will use a procedure known as the two-
sample t-test

10
 The Hypothesis Testing
Framework

• Sampling from a normal distribution H 0 : 1  2

• Statistical hypotheses:
H1 : 1   2

11
 Estimation of Parameters

1 n
y   yi estimates the population mean 
n i 1
n
1
S 
2

n  1 i 1
( yi  y ) estimates the variance 
2 2

12
 The t-Test
A t test is any statistical hypothesis test for two groups in which the test statistic
has a t distribution if the null hypothesis is true.

A test of the null hypothesis that the means of two normally distributed populations
are equal.

Used for investigating the statistical significance of the difference

between two sample means, and for confidence intervals for the difference between
two population means.

Given two data sets, each characterized by its mean, standard deviation
and number of data points, we can use some kind of t test to determine whether
the means are distinct, provided that the underlying distributions can be assumed
to be normal.

The t-distribution is a probability distribution that arises in the problem of estimating

the mean of a normally distributed population when the sample size is small.

13
 The two sample t-Test
The t statistics compares two means to see if they are significantly different from
each other (For the table of t-statistics see Table 2-4 and Table 2-5 page 52)

14
 Steps for the two sample t-test
1. State the null hypothesis and the alternative hypothesis

2. Set the alpha level.

Example= .05, we have 5 chances in 100 of making a type I error.

3. Select an appropriate test statistics from Table 2-4p or 2-5 p.52

4. Calculate the value of the appropriate statistic.

Also indicate the degrees of freedom for the statistical test. (n1+ n2 -2)

5. Write the decision rule for rejecting the null hypothesis. Refer Table 2-4 / 2-5
Example : Reject H0 if t0 is >= talpha or if t0 <= taplha

6. Write a summary statement based on the decision.

Example: Reject H0

7. Write a statement of results in standard English.

Example: There is a significant difference in the sample mean between
16
the two groups
• Suppose that we could assume that the variances of tension bond
strengths were identical for both mortar formulations.
• Then the appropriate test statistic to use for comparing two treatment
means in the completely randomized design is
 Exercise 1
A design engineer would like to compare the mean burning times of
chemical flare of two different formulations. The burning times (in minutes) are
tabulated below
Formulation A Formulation B
65 82 64 56
81 67 71 69
57 59 83 74
66 75 59 82
82 70 65 79

State the hypothesis to be tested and using alpha = 0.05, test the hypotheses?

21
 Answer

y1  y 2
Test statistic to be used ; t0 
1 1
Sp 
n1 n2
Degrees of freedom = n1 + n2 -2
y1 mean = 70.4 To find Sp use formula for the estimate of
Y2 mean = 70.2 the common variance ( ie Formula 2-25.p36)

n
S2  1
 1S1
2
 ( n2  1) S 2
2
n1  n2  2
p

Sp = 9
t0=0.050
So, do not reject H0
T0.025,18=2.101
22
 Exercise 2
A new filtering device is designed for installation in a chemical system.
Before its installation, a random sample yielded the following information
about the percentage of impurity:

y1  12.5 S12  101.17 n1  8

After installation, a random sample yielded

y 2  10.2 S 22  94.73 n2  9

Has the filtering device changed the percentage of impurity significantly?

Use alpha= 0.05.

23
 Answer

y1  y 2
Test statistic to be used ; t0 
1 1
Sp 
n1 n2
Degrees of freedom = n1 + n2 -2

To find Sp use formula for the estimate of

the common variance ( ie Formula 2-25.p36)
n
S2  1
 1S1
2
 ( n2  1) S 2
2
n1  n2  2
p

Sp = 9.89

t0=0.479
Do not reject H0
T0.025,15=2.131 So, There is no evidence to indicate that the new filtering
device has affected the mean
24
 The case of different variances
If we are testing

and cannot reasonably assume that the variances of the two samples are equal,
We must use the test statistic given by equation 2-31 p 48 and degrees of freedom
given by equation 2-32 p 48.

The case when the variances for both

populations are known
If we are testing

and the variances for both populations are known, use the test statistics given
by equation 2-33 p. 50.

25
 Comparing a single mean to a specified value

Some experiments involve comparing only one population mean to a specified

value
The hypotheses are
H 0 :   0
H1 :   0

Use the test statistics given by equation 2-35 p. 51

Example: Ex 2-2 p51

If the variance of the population is unknown use the test statistic given by
Equation 2-37 p.51.

EEM332 Lecture Slides 26

 Exercise:
The case when the variances for both populations are known
Two devices are used for filling containers with a net volume of
16.0 litre. The filling processes can be assumed to be normal,
with standard deviation of  1 = 0.015 and  2 = 0.018.
The quality engineering department suspects that both devices fill to the
same net volume, whether or not this volume is 16.0 litre.
An experiment is performed by taking a random sample from the output
of each device.
Device 1 Device 2
16.03 16.01 16.02 16.03
16.04 15.96 15.97 16.04
16.05 15.98 15.96 16.02
16.05 16.02 16.01 16.01
16.02 15.99 15.99 16.00

State the hypotheses that should be tested in this experiment and test these
hypotheses using =0.05. What are your conclusions?
27
 Answer

Test statistic to be used = equation 2-33

z0=1.35

z0.025 =1.96

since z0=1.35 is not greater than z0.025 =1.96

Therefore, do not reject H0

EEM332 Lecture Slides 28

 Activity for tomorrow: Assignment 1

Execute your plan for a simple comparative experiment involving

paper airplanes and perform the appropriate data analysis to reach
an appropriate conclusion.
 A problem-based learning:
Planning for designing a simple
comparative experiment
• an experiment performed to determine whether two
different formulations of a product give equivalent
results.
• Paper airplane made from 2 different papers. Do they
give equivalent results?
• Formulation 1: Using xxx gsm paper
• Formulation 2: Using xxx gsm paper
 Step 1

• Specify the problem that needs experimentation clearly

• What is the problem that you have?
– I do not know whether or not the two plane designed using
two different paper types would give equivalent
performance.
– I do not know whether changing the current material from
….paper to a new material …..paper result in a better or
worse performance?
• What is your objective of carrying the experiment?
– To determine whether or not the two plane designed using
two different paper types would give equivalent
performance.
– To investigate the effect of changing the material from
…………paper to…….paper
 Step 2

• Specify factors, levels and ranges.

1) Potential design factors
a. The design factors
– Material / the weight of the paper/ the ‘grams per square meter’. 55gsm,
90gsm, 100gsm, 120gsm, 140gsm, 210gsm, 250gsm, 300gsm, 350gsm
and 400gsm
b. Held-constant factors
– Dimensions: Plane size, Length, width,
– Paper size: A4
– The thrower (his height)
c. allowed-to-vary factors
– The paper might be taken from different rims or different brands even
though of the same weight
– The colour of the paper might differ
2) Nuisance factors
a. A controllable nuisance factor – can be controlled when the plane are
made and thrown
- Shape: Design/Structure/Nose style etc
- Position when throwing: Standing , sitting
b. Uncontrollable during the experiment, but can be measured
– The ambient temperature, the humidity, the precipitation level
c. Noise factor
– factor that varies naturally and uncontrollably in the process, but can be
controlled for purposes of an experiment
– Control by selecting several different times of the day when the experiment
will be carried out (since the user might use the plane at any time and you
cant control this when they are using it, but you can control it for the
experiment
– The angle of projection – users may toss the plane at any angle, which you
cant control, but you can control it for the experiment.
– The thrust: slow, hard, medium
– Age of the plane: old, new, etc
– must choose the ranges over which these factors will be
varied and the specific levels at which runs will be made.
– Thought must also be given to how these factors are to be
controlled at the desired values and how they are to be
measured
 Next week

• Simple comparative experiment

– Share your plans
– Perform the experiment
– Collect the data
– Learn the analysis of the data
 Thank You
Transforming Higher Education For A Sustainable Tomorrow
Additional notes/slides
We lead