Académique Documents
Professionnel Documents
Culture Documents
6
Error
and
power
o Type
I
error
():
Rejecting
the
null
when
the
effect
isnt
real
o Type
II
error
():
Failing
to
reject
the
null
when
the
effect
is
real
o Power
(1-):
Probability
of
seeing
a
true
effect
if
one
exists.
Power
increases
with
size
of
the
effect
and
sample
size.
It
decreases
with
standard
deviation
of
characteristic
and
significance
level
desired.
P-value
pitfalls
o Statistical
vs.
clinical
significance:
Trivial
effects
may
achieve
statistical
significance
if
the
sample
size
is
large
enough
o Multiple
testing:
If
multiple
tests
are
run
on
data,
some
effects
may
seem
statistically
significant
just
by
chance.
Use
Bonferroni,
Holm
or
Hochberg
to
control
for
this
type
of
error.
o Comparing
p-values:
Controlled
trials
should
report
between-group
comparisons.
Comparing
two
within-group
p-values
may
be
misleading.
o Failure
to
prove
an
effect
is
not
proof
of
no
effect
o Association
does
not
imply
causation
o Accounting
for
Correlated
Observations
It
is
important
to
identify
if
the
units
of
observations
are
independent
(e.g.
different,
unrelated
people)
or
correlated
(e.g.
repeated
observations
of
the
same
person
over
time)
Ignoring
correlations
will
overestimate
p-values
for
within-
person
or
withincluster
comparisons,
and
underestimate
p-values
for
between-person
or
between-cluster
comparisons
Which
test
to
use?