Vous êtes sur la page 1sur 1

Unit

6
Error and power
o Type I error (): Rejecting the null when the effect isnt real
o Type II error (): Failing to reject the null when the effect is real
o Power (1-): Probability of seeing a true effect if one exists.
Power increases with size of the effect and sample size. It
decreases with standard deviation of characteristic and
significance level desired.


P-value pitfalls
o Statistical vs. clinical significance: Trivial effects may achieve statistical
significance if the sample size is large enough
o Multiple testing: If multiple tests are run on data, some effects may seem
statistically significant just by chance. Use Bonferroni, Holm or Hochberg
to control for this type of error.
o Comparing p-values: Controlled trials should report between-group
comparisons. Comparing two within-group p-values may be misleading.
o Failure to prove an effect is not proof of no effect
o Association does not imply causation
o Accounting for Correlated Observations
It is important to identify if the units of observations are
independent (e.g. different, unrelated people) or correlated (e.g.
repeated observations of the same person over time)
Ignoring correlations will overestimate p-values for within-
person or withincluster comparisons, and underestimate
p-values for between-person or between-cluster
comparisons
Which test to use?

Vous aimerez peut-être aussi