XXXXXX XXXXXXX

May 05, 2013

COUN 503

WEB CALCULATOR EXERCISE 5

ANOVAs 1. A researcher is interested in comparing the effectiveness of three different kinds of therapy for anger problems. Eight participants are randomly assigned to three treatment conditions: Cognitive Therapy (CT), Cognitive-Behavioral Therapy (CBT), and Interpersonal Therapy (IT). All participants complete the weekly treatment for 8 weeks. Participants take an anger test before and after the 8-week treatments. Each participants difference score (= anger score after the treatment minus () anger score before the treatment) is shown in the following table. The three therapists in this experiment have equal educational levels and clinical experiences. CT CBT IT 3 5 7 4 4 8 4 6 9 4 6 10 3 5 6 8 4 7 6 9 11 2 7 10 a. What statistical test should be used to analyze the data? The between subjects one-way randomized ANOVA should be used to analyze the data. Although the total number of participants is not indicated it would not make sense to have each participant in the three different therapies either concurrently or consecutively. The data are on an interval/ratio scale. The following assumptions are met: The underlying distribution is normally distributed. The variances among the populations being compared are homogeneous. The observations are all independent of one another. b. Identify H0 and Ha for this study. H0 there is no significant difference between the mean values of the treatment therapies Ha there is a significant difference between the mean values of the treatment therapies H0: There will be no difference in the statistics competency scores among the four groups of counseling students. OR 1= 2 =3 Ha: There will be a difference in the statistics competency scores among the four groups of counseling students. OR at least one another

Page 1 of 11

XXXXXX XXXXXXX

May 05, 2013

COUN 503

c. Conduct the appropriate analysis. In order for Anova (F-test) used for the analysis to be done the following steps will need to take place: 1 - Arrange the collected data in their respective cells 2 - Determine the mean for each cell 3 - Sum the means together and then divide by the number of cells to obtain the Grand mean 4 - For each value calculate the squared deviation from the grand mean and sum them together to determine the SSTotal 5 - Using the mean for each group, calculate the squared value for each scores deviation from the mean of its group/cell 6 Sum these values for each group/cell to determine SSWithin 7 - For each group subtract the grand mean from the group mean, square this value and multiply by the number of participants in the group to determine the between group score for each group. Add these values together to obtain the between group sum of squares SSBetween . As a check add SSWithin and SSBetween which should equal SSTotal 8 - Next the mean square scores need to be calculated for each group, SSWithin, SSBetween ,and SSTotal by their respective degrees of freedom. The calculations are: dfTotal = total number of scores (N) 1, dfWithin = N - number of groups (k, and dfBetween = number of groups (k) 1. As a check sum, dfWithin plus dfBetween = dfTotal 9 - Now perform the calculations for the mean squares MSBetween = SSBetween / dfBetween 10 - Next perform the calculation for mean squares MSWithin = SSWithin / dfWithin 11 - The F ratio must be calculated F = MSBetween / MSWithin 12 - To determine Fcritical consult the Table A.8 in the text using the degrees of freedom within on the left side of the table and the degrees of freedom between across the top of the table and use the value where these intersect. If there number of degrees of freedom with is not found in the table round down to the nearest value. 13 - If FObtain is greater than Fcritical the results are statistically significant and the null hypothesis should be rejected 14 - Effect size will need to be calculated by using the formula for Eta squared which is, n2 = SSBetween / SSTotal which indicates the percentage that can be attributed to the independent variable 15 - If the results are statistically significant it is important to find out where the differences actually occur so a post hoc test such as Tukeys honestly significant difference (HSD) which can identify differences between any two groups to the alpha .05 or .01 level The formula for this test is HSD = Q * (k, / dfWithin) times the square root of (MSWithin / n). Q can be found in Table A.9 using a k (number of groups) and dfWithin 16 - Calculate the HSD at both the .05 and .01 level, whatever values are above the HSD must be considered honestly significantly different.

Page 2 of 11

XXXXXX XXXXXXX

May 05, 2013

COUN 503

http://easycalculation.com/statistics/one-way-anova.php

Page 3 of 11

XXXXXX XXXXXXX

May 05, 2013

COUN 503

From personal spreadsheet

Note = FCritical from Table A.8 (degrees of freedom of within and between) and HSD.01 from table A.9 Reject if FObtained is > FCritical

FCritical @ .05 = 3.49 and FCritical at .01 = 5.85 F(2, 21) = 11.65, p < .01 d. Should H0 be rejected? What should the researcher conclude?

The null hypothesis should be rejected that there is no difference between treatment methods because the calculation show that the treatments are statistically different. 2. A teacher is interested in comparing the effects of three different types of rehearsal methods (Rote rehearsal, Imagery, and Story) on number of words recalled. Participants are randomly

Page 4 of 11

XXXXXX XXXXXXX

May 05, 2013

COUN 503

assigned into three different groups. In each group, participants are asked to study a list of words using the assigned method. The following table shows the result. Rote Imagery rehearsal 5 5 5 4 4 6 6 7 5 7 4 6 3 8 5 5 6 7 Story 7 6 8 9 6 9 8 10 9

a. What statistical test should be used to analyze the data? The between subjects one-way randomized ANOVA should be used to analyze the data. The assumptions were outlined in question 1. b. Identify H0 and Ha for this study. H0 there is no difference between techniques and word type on the memorization of words Ha there is a difference between techniques and word type on the memorization of words c. Conduct the appropriate analysis. The steps used in the analysis are outlined in question 1

Page 5 of 11

XXXXXX XXXXXXX

May 05, 2013

COUN 503

Note = FCritical from Table A.8 and HSD.xx from table A.9 FCritical @ .05 = 3.63 and FCritical at .01 = 6.23 F(2, 24) = 15.54, p < .01 d. Should H0 be rejected? What should the researcher conclude?

The null hypothesis should be rejected because the calculations show that the recalled words between methods are statistically different.

e. If there is a significant difference, conduct the post hoc test. Tukeys honestly significant differences revealed that scores in Story group were significantly different at .01 level.

Page 6 of 11

XXXXXX XXXXXXX

May 05, 2013

COUN 503

http://faculty.vassar.edu/lowry/hsd.html 3. A professor is interested in whether there is a difference in counseling students statistics competency scores among 1) those who have never taken any statistics course, 2) those who have only taken an undergraduate statistics course, 3) those who have taken COUN 503, and 4) those who have taken an advanced statistic course while working on a Ph. D. The professor gathers information from a random sample of students and obtains the statistics competency scores. The scores are normally distributed. 1) 7 6 8 5 4 4 2) 11 11 10 12 13 15 3) 13 14 15 12 13 13 4) 15 14 15 15 10 15

a. What statistical test should be used to analyze these data?

Page 7 of 11

XXXXXX XXXXXXX

May 05, 2013

COUN 503

The between subjects one-way randomized ANOVA should be used to analyze the data. The assumptions of this test are outlined in question 1.

b. Identify H0 and Ha for this study H0 there is no difference between statistics competency scores between the four groups listed above Ha there is a difference between statistics competency scores between the four groups listed above c. Conduct the appropriate analysis. The steps involved were already outlined in question 1. Using a web calculator the following results were found: Note = FCritical from Table A.8 (degrees of freedom of within and between) and HSD.01 from table A.9 FCritical @ .05 = 3.10 and FCritical at .01 = 4.94 F(3, 20) = 31.93, p < .01

Page 8 of 11

XXXXXX XXXXXXX

May 05, 2013

COUN 503

http://easycalculation.com/statistics/standard-deviation.php

d. Should H0 be rejected? What should the researcher conclude?

FCritical @ .05 = 3.10 and FCritical at .01 = 4.94 The null hypothesis should be rejected because the calculation shows that the statistics competency scores are statistically different between the 4 groups. Eta squared and Post Hoc tests would be recommended.

Page 9 of 11

XXXXXX XXXXXXX

May 05, 2013 References

COUN 503

Anova (n. d. Retrieved from: http://turner.faculty.swau.edu/mathematics/math241/ materials/anova/acalculate.php Easy Calculation (n.d.). Retrieved from: http://easycalculation.com/statistics/standarddeviation.php GraphPad Software (2013). Retrieved from: http://www.graphpad.com/quickcalcs/ttest1/ Jackson, S.L. (2012). Research methods and statistics: A critical thinking approach (4th ed.). Belmont, CA: Wadworth, Cengage Learning. Tukey HSD Test (n.d.), Retrieved from http://faculty.vassar.edu/lowry/hsd.html

Page 10 of 11

XXXXXX XXXXXXX

May 05, 2013

COUN 503

WEB CALCULATOR EXERCISE SCORING RUBRIC

Student Name: XXXXXX XXXXXXXX

Element Attempted to answer all the questions (their answers do not have to be correct in order to receive the credit) Discussed how they arrived at the answers (process). Answers were easy to find. Explanations of how students arrived at the answers (process) were clear. Identified appropriate statistical procedures.

Pts 8

Comments from Instructor 8

12 8 4

12 8 4

Attempted to find the web-calculator link. If a link was broken, students documented the problem. Students submitted on time.

Page 11 of 11