Académique Documents
Professionnel Documents
Culture Documents
To cite this article: Patricia A. Aren & Jennifer Alvidrez (2002) Ethical Considerations in
Psychotherapy Effectiveness Research: Choosing the Comparison Group, Ethics & Behavior,
12:1, 63-73, DOI: 10.1207/S15327019EB1201_4
Article views: 41
Download by: [Florida Atlantic University] Date: 06 November 2015, At: 04:11
ETHICS & BEHAVIOR, 12(1), 6373
Copyright 2002, Lawrence Erlbaum Associates, Inc.
Ethical Considerations in
Psychotherapy Effectiveness Research:
Choosing the Comparison Group
Downloaded by [Florida Atlantic University] at 04:11 06 November 2015
Requests for reprints should be sent to Patricia A. Aren, Department of Psychiatry, 401 Parnassus
Avenue, Box F-0984, San Francisco, CA 94143-0984. E-mail: pata@lppi.ucsf.edu
64 AREN AND ALVIDREZ
ventions (Persons & Silberschatz, 1998). This debate has led the field to shift
away from the traditional clinical trial and to begin conducting psychotherapy
effectiveness studies.
Considerable discussion and debate has ensued regarding how to conduct
psychotherapy effectiveness research that is both scientifically sound and useful
in answering policy-related questions (Hollon, 1996). Very few people have
considered the ethical ramifications of this type of research, particularly regard-
ing the use of comparison conditions. Because effectiveness research is generally
concerned with the effectiveness of new interventions compared to existing treat-
ment, the typical comparison condition in this research is usual care, sometimes
called treatment as usual (TAU). As a comparison condition, TAU provides a
powerful means of demonstrating the effectiveness of interventions. People who
make decisions about how mental health problems should be treated are more
likely to implement policy changes if the data from research show a new inter-
vention to be more effective and less costly than care that is currently being
provided. However, in some situations, TAU is equivalent to substandard treat-
ment, or no treatment. The effectiveness researcher is pulled between making an
impact on policy (justice) and minimizing harm to the research participant
(beneficence).
The purpose of this article is to highlight how effectiveness researchers have
faced this dilemma and to discuss the pros and cons of using TAU versus other
comparisons. We start by discussing the importance of conducting effectiveness
research, how it differs from traditional clinical trials, and why TAU is generally
considered to be the best comparison intervention. We then discuss under what
circumstances TAU is necessary and offer suggestions for those instances when
TAU may not be an ethical alternative. We begin with the caveat that our discus-
sion is specific to psychotherapy effectiveness research. In addition, our sugges-
tions are not meant to be the final word on how to best tackle the ethical dilemmas
in effectiveness research. They are offered as a starting point to encourage re-
searchers to think about the ethical ramifications of choosing different compari-
son conditions in their research.
ETHICS IN PSYCHOTHERAPY EFFECTIVENESS RESEARCH 65
delivered, or TAU.
Policymakers often disregard the traditional research studies, not only due to
external validity issues but also because comparison conditions like placebo
controls or dismantled treatments often have little meaning for individuals not
immersed in the research world. For example, from the perspective of the medical
director of a health maintenance organization (HMO), placebos do not exist in
their formulary and therapists do not intentionally omit critical components of
psychotherapy when treating a patient. Even though waiting lists do exist in the
community, policymakers and providers rarely consider these to be active forms
of treatment. To the medical directors mind, patients are given pharmacologic or
psychosocial treatments in their entirety, and any change in how care is delivered
will only occur if research can show that a new intervention is any better (or more
cost-effective) than the care that patients currently receive. Demonstrating that an
intervention is better than no treatment does not answer the policymakers or
providers ultimate question: Is this intervention any better or cheaper than what
my organization already provides?
TAU varies from system to system. In the generic sense, TAU is whatever care
patients already have access to. For instance, in effectiveness studies on the
improvement of depression treatment in primary care medicine, TAU is typically
primary care provider treatment of depression with medication (Schulberg et al.,
1997). In psychotherapy studies, TAU may be whatever intervention providers in
a community already offer. If a researcher wants to document the effectiveness of
interpersonal therapy in treating depression, the appropriate TAU comparison may
be medication management, supportive therapy, or any treatment that the patient
would normally receive if the research study were not in place.
It is important to note that the research should do little to control TAU. Al-
though researchers can define what constitutes TAU in the research study, they
should not manipulate its components. TAU must be ecologically valid. Because
ETHICS IN PSYCHOTHERAPY EFFECTIVENESS RESEARCH 67
of shifting mental health policies and changes in patient benefits, TAU may
change a number of times during the course of a study. Therefore, continued doc-
umentation of treatment as it occurs naturally is very important. Because of the
shifting nature of mental health policy, in some populations (Alvidrez & Aren,
this issue) TAU may mean substandard or no treatment, or access to care may be
very difficult (Degenholtz, Parker, & Reynolds, this issue). Under these circum-
stances, researchers must be very careful to define what TAU is for their particu-
lar study to ensure that their participants are being treated ethically. If existing
treatment falls below a standard set by either the national or local community,
Downloaded by [Florida Atlantic University] at 04:11 06 November 2015
This first question is concerned with whether or not best-practice guidelines exist
for a target condition at the national level. The most common and least time-
consuming way to answer this question is to look to existing guidelines produced
by national organizations, such as the National Institutes of Health, the American
Psychological Association, the American Psychiatric Association, and the
National Association of Social Workers (NASW). The information obtained from
these sources helps to determine whether or not any existing intervention is felt to
be effective in treating the disorder.
68 AREN AND ALVIDREZ
In the case of major depression, several guidelines exist. Although they differ as
to the relative importance of psychotherapy or medication, they all indicate that ei-
ther treatment is preferred over no treatment, and hence TAU that offers neither
psychotherapy nor medication would be considered unethical. For an effectiveness
trial to be ethical, research participants should have access to one of these inter-
ventions. In the case of adjustment disorder, however, no standard guidelines exist,
and thus a TAU that did not offer any particular type of treatment would not neces-
sarily violate an individuals right to treatment. Participants would receive care as
they would normally under the best circumstances, and there is no guarantee that
Downloaded by [Florida Atlantic University] at 04:11 06 November 2015
The second question is concerned with whether or not the mental health com-
munity the scientist is sampling from offers the minimal level of effective treat-
ment for the target condition. In other words, is there a match between national
standards of minimumor ethicalcare and what is provided in the target
community? For instance, if a researcher were to conduct a psychotherapy
effectiveness study in a group-model HMO, the researcher would need to ob-
tain the HMOs policy on the treatment of the target condition. In situations
Downloaded by [Florida Atlantic University] at 04:11 06 November 2015
where no single policy exists (e.g., community providers who are paid by a va-
riety of sources), the researcher will have to document the typical care given by
providers in the community. As an example, the researcher may have to inter-
view or survey providers in the target community about the extent and type of
care they provide for patients with the target condition. In the case of schizo-
phrenia, the minimum national standard is medication combined with case
management. If a psychotherapy researcher wishes to study the effectiveness
of cognitivebehavioral intervention in controlling negative symptoms of
schizophrenia, the TAU condition must contain medication and case manage-
ment. The scientist cannot assume that patients in the study are receiving this
care. It is imperative that the scientist defines TAU for the population being
sampled and to make sure that the community treatment meets the minimum
requirements of care.
There is not always a match between national opinion as to minimally standard
psychotherapy and what is provided in different settings. For instance, many
psychotherapists feel that 10 sessions of treatment (the usual number of outpatient
psychotherapy sessions approved by HMOs) is insufficient to treat some disor-
ders. However, there is considerable disagreement as to what is an adequate
number of sessions, as the answer to that question often varies depending on the
type of treatment offered and the condition being treated. In this case, the
researcher must take into consideration the purpose of the study and what could
be done to ensure that participants are not harmed by participating in the study.
If a researcher wishes to demonstrate that a manualized, 20-session cognitive
behavioral therapy is superior to TAU in an HMO (usually 10 initially approved
sessions with an option to request more), then the 10-session limit, with proper
participant monitoring, is ethical.
What should researchers do in the unusual event that TAU is above the national
or community standard? Should the researchers use this setting for their studies?
As mentioned before, the purpose of effectiveness research is to measure the gen-
eralizability of an intervention to the larger community and to affect change in
policy. If a clinic or institution offers unusually good caremore than is expected
in the communitythen this is not likely to provide a meaningful comparison
unless the researchers purpose is to improve services primarily within this setting.
70 AREN AND ALVIDREZ
The researcher, before embarking on a study, should have in mind the community
to which the results should generalize. Defining the population or setting the
researcher wishes to impact on will help the decision as to whether or not the TAU
in a particular setting will provide a meaningful comparison.
tion, can people with the target condition access this care? In some populations,
such as elderly and minority individuals, minimally effective care for mood
disorders exists in the community, but these populations rarely have access to
treatment (Alvidrez & Aren, this issue; Degenholtz et al., this issue). How TAU
is managed very much depends on the research question. If the purpose of the
study is to improve African Americans use of mental health services and utiliza-
tion is the main outcome, then TAU is the only viable alternative. No policymaker
will invest funds in a program to increase service use if the new intervention is not
compared to the utilization rates that would exist under the usual circumstances.
However, if the intent of the study is to demonstrate the effectiveness of
cognitivebehavioral treatment of panic disorder in African Americans, then TAU
should include some methods for assuring that the participants have access to ex-
isting care. In this last case, the comparison condition is not technically TAU but
an augmented version of it.
ALTERNATIVES TO TAU
patients do not usually access usual care. Under those circumstances, the more
ethical alternative is to augment the mental health services in such a way that
the chances of getting TAU are greater than usual. The augmentation has to be
rather minimal so that the augmented version of TAU is not too different from
actual TAU. Examples of augmentations could be some minimal patient educa-
tion to enhance treatment acceptance or provider education to increase the like-
lihood that the treatment will be offered (Brown, Schulberg, Madonia, Shear, &
Houk, 1996).
A variation of augmented TAU is minimal intervention. In the event that TAU
Downloaded by [Florida Atlantic University] at 04:11 06 November 2015
in the community is less than what is considered to be standard care, the scientist
may have to create a comparison arm that consists of a minimal level of accept-
able treatment. For instance, in some rural areas, certain counties may not have
any mental health services. For a psychotherapy study, this may mean having to
hire people to provide the minimally acceptable service. The risk here is that the
new intervention is being compared to another intervention that does not exist in
the community. Policymakers for that community may not find the outcomes
supporting the new therapy very compelling if the comparison condition is not an
intervention that they feel has merit. Scientists should have input from the com-
munity and policymakers to make sure that the comparison intervention is a
meaningful one.
Another alternative to TAU is to use a historical control. Historical controls
are particularly useful for studies in which the outcome is already being moni-
tored. This method involves comparing the outcomes of TAU prior to initiating
the new intervention with the outcomes after the new intervention is initiated. A
scientist interested in the impact that psychotherapy has on independent func-
tioning could compare hospitalization rates, medication adherence, employment,
and emergency room use to those after the program is initiated. However, to say
that the psychotherapy intervention was responsible for any change in function-
ing, the scientist would have to make sure that there were not fluctuations in the
financing of severe mental illness or the introduction of new medications during
the assessment period. Historical controls are also limited in that other outcomes,
such as self-report measures, cannot be collected in the comparison group unless
those measures were administered as part of the ongoing service prior to the
study period. No psychotherapy effectiveness studies have used this comparison
method to date.
In summary, the intent of our discussion was to explore the ethical ramifications
of using TAU as a comparison condition in psychotherapy studies. To that end,
our discussion may be less relevant to scientists who wish to study practice
72 AREN AND ALVIDREZ
REFERENCES
Brown, C., Schulberg, H. C., Madonia, M. J., Shear, M. K., & Houk, P. R. (1996). Treatment outcomes
for primary care patients with major depression and lifetime anxiety disorders. American Journal
of Psychiatry, 153, 12931300.
Clarke, G. (1995). Improving the transition from basic efficacy research to effectiveness studies:
Methodological issues and procedures. Journal of Consulting and Clinical Psychology, 63,
718725.
Hohmann, A. A., & Parron, D. L. (1996). How the new NIH guidelines on inclusion of women and
minorities apply: Efficacy trials, effectiveness trials and validity. Journal of Consulting and Clini-
cal Psychology, 64, 851855.
Hollon, S. (1996). The efficacy and effectiveness of psychotherapy relative to medications. American
Psychologist, 51, 10251030.
Jacobson, N. S., & Christensen, A. (1996). Studying the effectiveness of psychotherapy: How well can
clinical trials do the job? American Psychologist, 51, 10311039.
ETHICS IN PSYCHOTHERAPY EFFECTIVENESS RESEARCH 73
Norcross, J. C., Prochaska, J. O., & Farber, J. A. (1993). Psychologists conducting psychotherapy: New
findings and historical comparisons on the psychotherapy division membership. Psychotherapy,
30, 692697.
Persons, J., & Silberschatz, G. (1998). Are results of randomized controlled trials useful to psy-
chotherapists? Journal of Consulting and Clinical Psychology, 66, 126135.
Schulberg, H. C., Block, M. R., Madonia, M. J., Scott, C. P., Lave, J. R., Rodriquez, E., & Coulehan,
J. L. (1997). The usual care of major depression in primary care practice. Archives of Family
Medicine, 6, 334339.
Seligman, M. E. P. (1995). The effectiveness of psychotherapy: The Consumer Reports study.
American Psychologist, 50, 965974.
Downloaded by [Florida Atlantic University] at 04:11 06 November 2015
Downloaded by [Florida Atlantic University] at 04:11 06 November 2015