Académique Documents
Professionnel Documents
Culture Documents
1177/0163278705275341
Evaluation & the Health Professions / June 2005
Brucker et al. / FACT-G NORMATIVE DATA
EVALUATION & THE HEALTH PROFESSIONS, Vol. 28 No. 2, June 2005 192-211
DOI: 10.1177/0163278705275341
© 2005 Sage Publications
192
Brucker et al. / FACT-G NORMATIVE DATA 193
There are several ways normative data can facilitate the interpreta-
tion of HRQOL assessment scores. The raw score means and standard
deviations of HRQOL assessment scores for an individual patient
with cancer or for a sample of patients with cancer can be compared to
the normative data of a reference group to determine whether the
patient’s or sample’s HRQOL score is lower, higher, or similar to that
of the reference group. Comparing the percentage of scores at the ceil-
ing and floor, percentiles, and the minimum and maximum values for
a study sample to a reference group can provide useful information on
the distribution of the study sample data relative to the reference
groups. In addition, T-scores, which rescale raw scores into standard-
ized scores with a mean of 50 and a standard deviation (SD) of 10, can
be generated allowing consumers to make direct comparison of scores
that are measured on different scales. Finally, standardized effect
sizes, which allow effect sizes to be compared across studies, can be
computed by using the normative data. We provide examples of how
the normative data can facilitate the interpretation of the FACT-G
assessment scores.
Interpretation of differences or change scores should take into con-
sideration whether the reported differences are statistically significant
and/or clinically meaningful. When reviewing difference or change
scores, consumers of HRQOL information (e.g., clinicians) are often
more interested in clinical than statistical significance. One sugges-
tion that an effect size of .5 (or one half SD) is a relatively stable
important difference (Norman, Sloan, & Wyrwich, 2003; Sloan,
Symonds, Vargas-Chanes, & Fridley, 2003) may best be understood
as a conservative estimate of a minimally important difference (MID).
In the case of the FACT-G, the .5 SD benchmark appears to be some-
what larger than our estimated MID. Based on our work on MIDs,
using raw scores and clinical anchors to guide interpretation (Cella,
Eton, Lai, Peterman, & Merkel, 2002a; Webster, Cella, & Yost, 2003;
Yost & Eton, 2005), we have determined a two-point difference on the
FACT-G subscale scores and a five-point difference on the FACT-G
total score to be associated with meaningful differences on clinical
and subjective indicators. These differences are closer to one third SD.
This has led us to conclude that MIDs for FACT-G often fall in the
range of 0.3 to 0.5 SDs.
Brucker et al. / FACT-G NORMATIVE DATA 195
METHOD
The FACT-G normative sample data for the general U.S. adult pop-
ulation reference group were collected by Knowledge Networks (KN;
Menlo Park, CA), a marketing information and decision support sys-
tem. KN drew a random sample of 1,400 people, age 18 years and
older, from more than 100,000 individuals who were members of an
Internet-based survey panel. According to KN, the panel was a demo-
graphically representative sample of the general U.S. adult popula-
tion. Members of the survey panel responded to one survey per month
in exchange for free installation of WebTV Internet service. The
FACT-G (Version 4) was one such survey that was presented electron-
ically to the panel members who completed the survey in their homes
(Cella et al., 2003).
The FACT-G sample data used for the adult patient with cancer ref-
erence group were generated by combining two data sets from previ-
ous studies. The first study, referred to as the Bilingual Intercultural
Oncology Quality of Life (BIOQOL) project (National Institutes of
Health [NIH] Grant #CA 61679), was a 3-year validation study of the
FACT measurement system. The core aim of the current study, from
which the sample data were drawn, was to test the psychometric prop-
erties and statistical equivalence of FACT scales across language, cul-
ture, literacy, and mode of administration. Data were collected from
patients located in three cities: Atlanta, Georgia; Chicago, Illinois;
and San Juan, Puerto Rico. Patients were recruited from public care
settings and private care settings. To be eligible, patients were
required to be older than age 17 years and have had one of the follow-
ing diagnoses: breast cancer, lung cancer, colorectal cancer, head
and/or neck cancer, and/or HIV-related malignancy. Institutions
recruited eligible patients consecutively to obtain a reasonable repre-
sentative sample of patients with respect to performance status, socio-
economic status, age, and gender. Participants provided
196 Evaluation & the Health Professions / June 2005
Respondents from the U.S. general population sample did not com-
plete 6 of the 27 FACT-G items because these items addressed issues
specific to illness or treatment and were not considered appropriate to
administer to a general U.S. adult population sample. To ensure that
the range of scores for this 21-item version of the FACT-G would be
equivalent to scores for the complete 27-item instrument, the 4
subscales scores (PWB, SWB, EWB, FWB) were prorated. For exam-
ple, the SWB subscale has 7 items; however, only 5 were administered
to the general U.S. adult population sample. Assuming all 5 of the
administered items were answered, the prorated score for the SWB
would be computed by multiplying the sum of individual SWB items
by 7 and then dividing the sum by 5.
5
∑ SWBi × 7
i =1
SWB subscale score =
5
TABLE 1
General U.S. Adult Population Sample Characteristics (N = 1,075)
n (Percentage)
a. MOS SF-1 = First item (measuring general health perceptions) from the Medical Outcomes
Study 36-item Short Form (SF-36; Ware, Snow, & Kosinski, 2000)
TABLE 2
Adult Cancer Patient Sample Characteristics (N = 2,236)
n (Percentage)
NORMATIVE DATA
Raw scores. We present the raw scores of the normative data in the
Appendix (see Tables A1 and A2). The following descriptive statistics
are provided for each of the subscale scores (PWB, SWB, EWB,
FWB) and the FACT-G total score: mean, standard deviation, percent-
age at floor (i.e., percentage scoring the lowest possible score), per-
centage at the ceiling (i.e., percentage scoring the highest possible
score), the lowest and highest observed scores, the 25th, 50th
(median), and 75th percentiles. Descriptive statistics are presented
separately for each of the reference samples (i.e., the general U.S.
adult population sample and the adult patient with cancer sample). In
addition, normative data are presented separately for men and women
within each reference sample.
To illustrate the usefulness of normative raw data, we compared
previously published raw score FACT-G data to our general U.S. adult
population norms (see Table 3). Cella, Hahn, and Dineen (2002) pub-
lished the baseline means and standard deviations for FACT-G
Brucker et al. / FACT-G NORMATIVE DATA 201
TABLE 3
Comparing a 2002 Study Sample With the General U.S. Adult
Population Norms (Standard Deviations in Parentheses)
a. Example sample data taken from Cella, Hahn, & Dineen (2002) sample of 308 male and female
patients with mixed cancer diagnoses.
b. Data taken from Table A1.
subscales and FACT-G total score for a sample of 308 patients with
mixed cancer diagnoses. We compared these mean scores to the nor-
mative mean scores found in the general U.S. adult population sample
taken from Table A1. We found that the patients with cancer in Cella,
Hahn, and Dineen’s (2002) study had comparable scores to the gen-
eral U.S. adult population sample. Small differences in PWB, EWB,
FWB, and total FACT-G scores were noted but did not exceed our cri-
teria for a MID. There was a meaningful difference (i.e., > 2 points) on
the SWB subscale between Cella, Hahn, and Dineen’s (2002) sample
(M = 22.3) and the general U.S. adult population norms (M = 19.1).
This suggests that the people with cancer from Cella, Hahn, and
Dineen’s (2002) study may actually be comparable to those in the gen-
eral population in regard to physical, emotional, functional, and over-
all well-being. In addition, participants in the Cella, Hahn, and Dineen
(2002) study may actually have more social support than what is
reported in the general population, which may be explained by the
social support need caused by serious illness.
higher than the mean), one might conclude that the scores for the
patients with cancer are meaningfully different from the general U.S.
population scores. In our example, the mean raw PWB score of 21.2
for the patients with cancer corresponds to a T score of 47.2, which
would not be considered meaningfully different while comparing this
score to a patient without cancer reference group (see Figure A3).
Effect sizes. Effect sizes are useful for interpreting the magnitude of
a difference in FACT-G scores between two groups or of changes in
FACT-G scores over time in one group. Although there are many ways
of computing effect sizes, one approach is to divide the difference in
FACT-G scores for two groups by the overall standard deviation. Nor-
mative data are useful here because they can be used to compute stan-
dardized effect sizes where the differences in FACT-G scores for two
groups are divided by the standard deviation in a reference population.
Standardized effect sizes are valuable because they allow effect size
information to be comparable across studies.
For example, assume two separate studies, A and B, reported dif-
ferences in FACT-G total scores between groups of patients (e.g.,
early stage vs. late state). Assume that the FACT-G mean scores and
mean score differences across stage of diagnosis for the two studies
are exactly the same (mean score = 82.0; mean score difference = 10),
although the two samples have different standard deviations (e.g.,
Study A’s SD = 20.0; Study B’s SD = 16.0). If the standard deviation in
each study was used to compute effect sizes, they would be 0.50
(10.0/20.0) for Study A and 0.63 (10.0/16.0) for Study B. Thus,
slightly different interpretations regarding the magnitude of the
10-point difference would arise for the two studies. However, by using
the standard deviation from a normative data table, a consistent inter-
pretation would result. For the purpose of illustration, we use the stan-
dard deviation for FACT-G scores for the general U.S. population,
which is 18.1 as reported in Table A1. The standardized effect sizes
associated with a 10-point difference for both Studies A and B would
be 0.55 (10/18.1).
In summary, HRQOL has become an important endpoint in cancer
care. With the widespread use of HRQOL measures comes a need for
enhancing the interpretability of the scores generated from these
assessments. Comparing HRQOL scores for a group of patients or for
an individual patient to normative data facilitates meaningful
204 Evaluation & the Health Professions / June 2005
APPENDIX
TABLE A1
Normative Data of General U.S. Adult Population
Males (n = 516)
Mean 23.3 18.4 20.5 18.6 80.9
Standard Deviation 5.1 6.7 4.4 6.7 17.4
Percentage at floor 0.2 1.0 0.8 1.6 0.0
Percentage at ceiling 16.1 9.9 34.9 9.1 1.9
Minimum observed score 0.0 0.0 0.0 0.0 17.1
25th percentile 22.2 14.0 18.0 14.0 71.2
50th percentile (Median) 25.7 19.6 22.5 19.8 83.0
75th percentile 26.8 23.8 24.0 23.3 93.2
Maximum observed score 28.0 28.0 24.0 28.0 108.0
Females (n = 544)
Mean 22.1 19.8 19.4 18.3 79.6
Standard Deviation 5.4 6.8 5.1 6.9 18.6
Percentage at floor 0.0 0.9 0.7 1.8 0.0
Percentage At ceiling 10.5 16.4 28.9 8.6 2.2
Minimum observed score 3.5 0.0 0.0 0.0 15.4
25th percentile 19.8 15.4 18.0 12.8 68.4
50th percentile (Median) 23.3 21.0 21.0 18.7 83.0
75th percentile 25.7 25.2 24.0 23.3 93.2
Maximum observed score 28.0 28.0 24.0 28.0 108.0
TABLE A2
Normative Data of Cancer Sample
Males (n = 964)
Mean 20.8 21.8 18.6 18.1 79.3
Standard Deviation 6.2 5.4 4.5 7.0 17.7
Percentage at floor 0.2 0.0 0.1 0.6 0.0
Percentage at ceiling 10.6 12.8 11.5 8.8 0.7
Minimum observed score 0.0 4.7 0.0 0.0 19.8
25th percentile 17.0 18.8 16.0 13.0 68.0
50th percentile (Median) 22.0 23.3 20.0 19.0 81.3
75th percentile 26.0 26.0 22.0 24.0 93.2
Maximum observed score 28.0 28.0 24.0 28.0 108.0
Females (n = 1271)
Mean 21.6 22.3 18.7 19.5 82.1
Standard Deviation 5.8 5.3 4.5 6.6 16.3
Percentage at floor 0.2 0.1 0.1 0.3 0.0
Percentage at ceiling 12.7 17.7 13.4 10.0 0.8
Minimum observed score 0.0 0.0 0.0 0.0 28.7
25th percentile 19.0 19.6 16.0 15.0 71.0
50th percentile (Median) 23.0 23.3 20.0 21.0 85.0
75th percentile 26.0 26.8 22.0 25.0 95.0
Maximum observed score 28.0 28.0 24.0 28.0 108.0
TABLE A3
T-score Conversion Table for the General
U.S. Adult Population (N = 1075)
TABLE A4
T-score Conversion Table for the Adult
Cancer Patient Sample (N = 2236)
70
108 107
28 106 105
One SD 28 104
AB OVE 27 102 103
27 26 100 101
the M
60 28 26 98 99
25 97
25 24 96 95
27 24 94
24 93
26 23 23 92 91
23 22 90
22 88 89
25 22 21 87
21 86 85
24 21 20 84
20 83
M EA N 23 19 82 81
50 19 20 80
18 79
22 18 78 77
19 17 76
21 17 74 75
16
T Scores for General Population Norms
18 72 73
20 16 15 71
One SD 15 17 70 69
19 14 68
B ELOW 14 66 67
18 16 13 65
the M 13 64 63
40 15 12 62
17 12 61
11 60
11 14 58 59
16 10 57
10 56 55
15 13 9 54
9 8 53
14 52 51
8 12 7 50
48 49
13 7 6 47
11 46
12 6 45
30 5 44 43
5 10 42
11 4 41
4 9 3 40 39
10 3 38 37
8 2 36
9 2 34 35
1 33
1 7 32 31
8 0 30
0 29
7 6 28 27
20 26 25
6 5 24
22 23
5 4 20 21
18 19
4 17
3 16
3 14 15
2 12 13
2 10 11
1 8 9
10 1 7
0 6 5
0 4 3
2 1
0
0
g
-G
g
g
in
in
in
in
T
Be
Be
Be
Be
AC
l
l
lF
l
el
el
el
el
W
W
lW
lW
ta
To
ily
l
ca
na
na
am
si
io
tio
y
ot
/F
nc
Ph
Em
al
Fu
ci
So
Figure A1: T-score Template for the General U.S. Adult Population (N = 1075)
SOURCE: Copyright 2004, David Cella, Ph.D.
Brucker et al. / FACT-G NORMATIVE DATA 209
70
108 107
106
One SD 104 105
28 103
AB OVE
27 102
28 24 100 101
the M 28 99
60 26 98
27 27 23 25 97
96
26 94 95
26 22 24 93
25 23 92
25 90 91
21 22 89
24 88
24 21 87
23 20 86 85
22 23 20 84 83
M EA N 19 19 82 81
50 21 22 80
18 18 79
20 21 78 77
17 76
19 20 17 75
74
T Scores for Cancer Population Norms
16 73
18 19 15 72 71
One SD 16 70
17 14 68 69
B ELOW 18 15 67
the M 16 13 66
17 64 65
40 15 14 12 63
16 11 62
14 60 61
13 10 59
13 15 58
9 56 57
14 12 55
12 8 54
52 53
11 13 11 7 51
10 50 49
12 10 6 48
30 5 47
9 11 46 45
8 9 4 44
10 43
3 42 41
7 8 40
9 2 39
6 38 37
7 1 36
5 8 35
0 34
4 7 6 32 33
30 31
20 3 6 5 29
28
2 5 26 27
4 25
1 24
4 22 23
3 21
0 3 20
18 19
2 17
2 16
1 15
1 14 13
10 12
0 11
0 10 9
8 7
6 5
4 3
2 1
0
0
g
G
ng
ng
g
in
T-
in
ei
ei
Be
Be
AC
lB
lB
l
lF
l
el
el
el
el
W
W
lW
lW
ta
To
ily
l
ca
na
na
am
si
io
tio
y
ot
/F
nc
Ph
Em
al
Fu
ci
So
70
108 107
28 106 105
One SD 28 104
AB OVE 27 102 103
27 26 100 101
the M
60 28 26 98 99
25 97
25 24 96 95
27 24 94
24 93
26 23 23 92 91
23 22 90
22 88 89
25 22 21 87
21 86 85
24 21 20 84
20 83
M EA N 23 19 82 81
50 19 20 80
18 79
22 18 78 77
19 17 76
21 17 74 75
16
T Scores for General Population Norms
18 72 73
20 16 15 71
15 17 70 69
One SD 14 68
19 67
B ELOW 14 16 13 66
18 64 65
the M 13 63
40 15 12 62
17 12 61
11 60
11 14 58 59
16 10 57
10 56 55
15 13 9 54
9 8 53
14 52 51
8 12 7 50
48 49
13 7 6 47
11 46
12 6 45
30 5 44 43
5 10 42
11 4 41
4 9 3 40 39
10 3 38 37
8 2 36
9 2 34 35
1 33
1 7 32 31
8 0 30
0 29
7 6 28 27
20 26 25
6 5 24
22 23
5 4 20 21
18 19
4 17
3 16
3 14 15
2 12 13
2 10 11
1 8 9
10 1 7
0 6 5
0 4 3
2 1
0
a
Cancer Patient Sample Data
0
ng
ng
ng
ng
G
ei
ei
ei
-
ei
CT
lB
lB
B
lB
A
l
el
el
el
el
lF
W
W
lW
W
ta
l
il y
al
na
na
To
am
ic
io
t io
ys
ot
/F
nc
Ph
Em
al
Fu
ci
So
Figure A3: An Example Plotting a Cancer Sample on the General U.S. Adult Norms
Templatea
NOTE: Mean scores for the subscales and total FACT-G are indicated with a diamond in the fig-
ure above and are as follows: Physical Well-Being = 21.2, Social/Family Well-Being = 22.3,
Emotional Well-Being = 18.1, Functional Well-Being = 18.8, and FACT-General Total = 80.4.
SOURCE: Copyright 2004, David Cella, Ph.D.
a. Example sample data taken from Cella, Hahn, and Dineen (2002) sample of 308 male and fe-
male patients with mixed cancer diagnoses.
Brucker et al. / FACT-G NORMATIVE DATA 211
NOTE
REFERENCES
American Cancer Society. (2005). Cancer facts and figures. Retrieved November 28, 2005, from
www.cancer.org/downloads/STT/CAFF2005PWSecured.pdf
Cella, D. (2004). Manual of the Functional Assessment of Chronic Illness Therapy (FACIT
Scales) (Version 4.1). Evanston, IL: Center on Outcomes Research and Education (CORE)
Evanston Northwestern Healthcare.
Cella, D., Eton, D. T., Lai, J.-S., Peterman, A. H., & Merkel, D. E. (2002). Combining anchor-
and distribution-based methods to derive minimal clinically important differences on the
Functional Assessment of Cancer Therapy (FACT) Anemia and Fatigue scales. Journal of
Pain and Symptom Management, 24, 547-561.
Cella, D., Hahn, E. A., & Dineen, K. (2002). Meaningful change in cancer-specific quality of life
scores: Differences between improvement and worsening. Quality of Life Research, 11,
207-221.
Cella, D. F., Tulsky, D. S., Gray, G., Sarafian, B., Lin, E., Bonomi, A., et al. (1993). The Func-
tional Assessment of Cancer Therapy Scale: Development and validation of the general mea-
sure. Journal of Clinical Oncology, 11(3), 570-579.
Cella, D., Zagari, M. J., Vandoros, C., Gagnon, D. D., Hurtz, H. J., & Nortier, J. W. (2003).
Epoetin alfa treatment results in clinically significant improvements in quality of life in ane-
mic cancer patients when referenced to the general population. Journal of Clinical Oncology,
21, 366-373.
Norman, G., Sloan, J., & Wyrwich, K. (2003). Interpretation of changes in health-related quality
of life: The remarkable universality of half a standard deviation. Medical Care, 41, 582-592.
Overcash, J., Extermann, M., Parr, J., Perry, J., & Balducci, L. (2001). Validity and reliability of
the FACT-G Scale for use in the older person with cancer. American Journal of Clinical
Oncology, 24(6), 591-596.
Sloan, J. A., Symonds, T., Vargas-Chanes, D., & Fridley, B. (2003). Practical guidelines for
assessing the clinical significance of health-related quality of life changes within clinical tri-
als. Drug Information Journal, 37, 23-31.
Surveillance, Epidemiology, and End Results (SEER) Program. (2004, April) SEER*Stat Data-
base: Incidence - SEER 9 Regs Public-Use, Nov 2003 Sub (1973-2001). Rockville, MD:
National Cancer Institute, Division of Cancer Control and Population Sciences, Surveillance
Research Program, Cancer Statistics Branch.
Ware, J. E., Snow, K. K., & Kosinski, M. (2000). SF-36 Health Survey: Manual and interpreta-
tion guide. Lincoln, RI: QualityMetric.
Webster, K., Cella, D., & Yost, K. (2003). The Functional Assessment of Chronic Illness Therapy
(FACIT) measurement system: Properties, applications, and interpretation. Health and
Quality of Life Outcomes, 1, 79.
Winstead-Fry, P., & Schultz, A. (1997). Psychometric assessment of the Functional Assessment
of Cancer Therapy–General (FACT-G) Scale in a rural sample. Cancer, 79(12), 2446-2452.
Yost, K., & Eton, D. T. (2005). Combining distribution- and anchor-based approaches to deter-
mine minimally important differences: The FACIT experience. Evaluation & the Health
Professions, 28(2), 172-191.