Académique Documents
Professionnel Documents
Culture Documents
4.18
Therapeutic Assessment: Linking
Assessment and Treatment
MARK E. MARUISH
Strategic Advantage, Minneapolis, MN, USA
4.18.1 INTRODUCTION
526
528
530
525
530
530
531
531
532
532
533
534
534
535
535
536
538
539
540
541
541
542
542
542
543
544
545
545
546
546
547
547
547
548
548
549
549
550
526
550
550
551
551
552
553
554
555
555
556
556
557
4.18.10 SUMMARY
558
4.18.11 REFERENCES
559
4.18.1 INTRODUCTION
The cost of health care in the USA has
reached astronomical heights. In 1995, approximately $1 trillion, or 14.9% of the gross
domestic product, was spent on health care,
and a 20% increase is expected by the year 2000
(Mental Health Weekly, 1996a). The cost and
prevalence of mental health problems and the
accompanying need for behavioral health care
services in the USA continue to rise at rates
which give cause for concern. America's mental
health bill in 1990 was $147 billion (Mental
Health Weekly, 1996c). The Center for Disease
Control and Prevention (1994) recently reported on the results of a survey of 45 000
randomly interviewed Americans regarding
their quality of life. The survey found that
one-third of the respondents reported they
suffered from depression, stress, or emotional
problems at least one day a month, and 11%
percent of the sample reported having these
problems more than eight days a month.
The American Psychological Association
(APA; 1996) also reports statistics, summarized
below, that bear attention.
(i) It is estimated that 1518% of Americans
suffer from a mental disorder; 14 million of
these individuals are children.
(ii) Approximately eight million Americans
suffer from depression in any given one-month
period.
(iii) As many as 20% of Americans will suffer
one or more major episodes of depression
during their lifetime.
(iv) An estimated 80% of elderly residents in
Medicaid facilities were found to have moderate
to intensive needs for mental health services.
Moreover, information from various studies
indicates that at least 25% of primary health
care patients have a diagnosable behavioral
disorder (Mental Health Weekly, 1996b).
The need for behavioral health care services is
significant. In analyzing data from a 1987
Introduction
conducted between 1988 and 1994 and listed in
the Cost of addictive and mental disorders and
effectiveness of treatment report published by
the Substance Abuse and Mental Health Services Administration (SAMHSA). One conclusion derived from a meta-analysis of offset
effect was that treatment for mental health
problems results in an approximately 20%
reduction in the overall cost of health care.
The report also concluded that while alcoholics
were found to spend twice as much on health
care as those without abuse problems, one-half
of the cost of substance abuse treatment is offset
within one year by subsequent reductions in the
combined medical cost savings for the patient
and his or her family.
(iii) Strain et al. (1991) found that screening a
group of 452 elderly hip fracture patients for
psychiatric disorders prior to surgery and
providing mental health treatment to the 60%
of the sample needing treatment reduced total
medical expenses by $270 000. The cost of the
psychological/psychiatric services provided to
this group was only $40 000.
(iv) Simmons, Avant, Demski, and Parisher
(1988) compared the average medical costs for
chronic back pain patients at a multidimensional pain center (providing psychological and
other types of intervention) during the year
prior to treatment to those costs of the year
following treatment. The pretreatment costs per
patient were $13 284 while post-treatment costs
were $5596.
The reader is referred to Friedman, Sobel,
Myers, Caudill, and Benson (1995) for a detailed
discussion of various ways in which behavioral
interventions can both maximize care to medical
patients and achieve significant economic gains.
APA (1996) has very succinctly summarized
what appears to be the prevalent findings of the
medical cost offset literature.
(i) Patients with mental disorders are heavy
users of medical services, averaging twice as many
visits to their primary care physicians as patients
without mental disorders.
(ii) When appropriate mental health services
are made available, this heavy use of the system
often decreases, resulting in overall health savings.
(iii) Cost offset studies show a decrease in total
health care costs following mental health interventions even when the cost of the intervention is
included.
(iv) In addition, cost offset increases over time,
largely because . . . patients continue to decrease
their overall use of the health care system, and
don't require additional mental health services.
(p. 2)
527
528
529
530
General Considerations for the Selection and Use of Psychological Test Instrumentation 531
the patient's reactions to them; and an in-depth
discussion of the meaning of the results in terms
of patient-defined assessment goals. In essence,
the assessment data can serve as a catalyst for
the therapeutic encounter via the objective
feedback that is provided to the patient, the
patient self-assessment that is stimulated, and
the opportunity for patient and therapist to
arrive at mutually agreed upon therapeutic
goals, based on impressionistic and objective
data available to both parties.
4.18.3.3 Psychological Assessment for
Outcomes Assessment
Currently, one of the most common reasons
for conducting psychological assessment in the
USA is to assess the outcomes of behavioral
health care treatment. It is difficult to open a
trade paper or health care newsletter or to
attend a professional conference without being
presented with a discussion on either how to do
outcomes or what the results of a certain
facility's outcomes study have revealed. The
focus on outcomes assessment most probably
can be traced to the continuous quality
improvement (CQI) movement that was
initially implemented in business and industrial
settings. The impetus for the movement originally was a desire to produce quality products in
the most efficient manner, resulting in increased
revenues and decreased costs.
In the health care arena, outcomes assessment
has multiple purposes, not the least of which is
as a tool for marketing the organization's
services. Related to this, those organizations
vying for lucrative contracts from third-party
payers to provide health care services to their
covered lives frequently require outcomes data
demonstrating the effectiveness of the services
offered by the bidders. Equally important to
those awarding contracts is how satisfied
patients are with the provider's services. But
probably the most important potential use of
this data for provider organizations (although
not always recognized as such) can be found in
the knowledge it yields about what works and
what doesn't. In this regard it can serve a
program evaluation function. It is this knowledge that, if attended to and acted upon, can
lead to improvement in the services the
organization offers. When used in this manner,
outcomes assessment can become an integral
component of the organization's CQI initiative.
But more importantly for the individual
patient, outcomes assessment provides a means
of objectively measuring how much improvement he or she has made from the time of
treatment initiation to the time of treatment
termination. Feedback to this effect may serve
532
General Considerations for the Selection and Use of Psychological Test Instrumentation 533
SCL-90-R (Derogatis, 1983). Both of these
instruments contain a checklist of 90 psychological symptoms, most of which score on the
instruments' nine symptom scales. For each of
these instruments an even briefer version has
been developed. The first is the Brief Symptom
Inventory (BSI; Derogatis, 1992), which was
derived from the SCL-90-R. In a health care
environment that is cost-conscious and unwilling to make too many demands on patient
time, this 53-item instrument is gaining popularity over its longer and more expensive 90item parent instrument. Similarly, a brief form
of the original SCL-90 has been developed.
Titled the Symptom Assessment-45 Questionnaire (SA-45; Strategic Advantage, Inc., 1996),
its development did not follow Derogatis'
approach to the development of the BSI;
instead, cluster analytic techniques were used
to select five items each for assessing each of the
nine symptom domains found on the three
Derogatis checklists.
The major strength of the abbreviated multiscale instruments is their ability to broadly and
very quickly survey several psychological
symptom domains and/or disorders relative to
the patient. Its value is most clearly evident in
settings where both the time and dollars
available for assessment services are quite
limited. These instruments provide a lot of
information quickly. Because of their brevity,
they are much more likely to be completed by
patients than their lengthier comprehensive
counterparts. This last point is particularly
important if one is interested in monitoring
treatment or assessing outcomes, both of which
require at least two or more assessments to
obtain the desired information.
4.18.4.1.2 Measures of general health status and
role functioning
During the past decade, there has been an
increasing interest in the assessment of health
status in health care delivery systems. Initially,
this interest was shown mostly by those
organizations and settings focusing primarily
on the treatment of physical diseases and
disorders. Within recent years, behavioral
health care providers have recognized the value
in assessing the patient's general level of health.
It is important to recognize that the term
health means more than just the absence of
disease or debility; it also implies a state of wellbeing throughout the individual's physical,
psychological, and social spheres of existence
(World Health Organization [WHO], 1948).
Dickey and Wagenaar (1996) point out how this
view of health recognizes the importance of
eliciting the patient's point of view in assessing
534
General Considerations for the Selection and Use of Psychological Test Instrumentation 535
4.18.4.2 Guidelines for Instrument Selection
Regardless of the type of instrument one
might consider using in the therapeutic environment, many clinical psychologists frequently
must choose between many product offerings.
But what are the general criteria for the selection
of any instrument for psychological assessment?
What should guide the clinician's selection of an
instrument for a specific therapeutic purpose?
As part of their training, clinical psychologists
and professionals from related psychological
specialties have been educated about the
important psychometric properties that should
be considered when determining the appropriateness of an instrument for its intended use.
However, this is just one of several issues that
should be taken into account in an evaluation of
a specific instrument for a specific therapeutic
use. The guidance that has been offered by
experts with regard to instrument selection is
worth noting here.
536
General Considerations for the Selection and Use of Psychological Test Instrumentation 537
with the needs of MCOs. The solution to the
problem appears simple:
the underlying objectives of testing must be aligned
with the values and processes of MCOs. In short,
this means identifying decision points in managed
care processes that could be improved with
objective, standardized data. There are two avenues in which these can be pursued: through
facilitation/objectification of clinical-decision processes and through outcome assessment. (p. 12)
538
identification of those not having the characteristic vs. the importance of optimizing the
identification of both groups. This in turn will
be dependent on the cutoff score recommended
by the developer of the instrument and/or the
efficiency values that are available when other
cutoff scores are applied. These and related
issues are discussed more extensively in the next
section.
4.18.5 PSYCHOLOGICAL ASSESSMENT
AS A TOOL FOR SCREENING
One of the most significant ways in which
psychological assessment can contribute to the
development of an economic and efficient
behavioral health care delivery system is by
using it to screen potential patients for need for
behavioral health care services, and/or to
determine the likelihood that the problem being
screened is a particular disorder of interest.
Probably the most concise, informative treatment of the topic of the use of psychological
tests in screening for behavioral health care
disorders is provided by Derogatis and DellaPietra (1994). In this work, these authors turn to
the Commission on Chronic Illness (1987) to
provide a good working definition of health care
screening in general, that being:
the presumptive identification of unrecognized
disease or defect by the application of tests,
examinations or other procedures which can be
applied rapidly to sort out apparently well persons
who probably have a disease from those who
probably do not. (Commission on Chronic Illness,
1987, p. 45)
539
540
A note of caution is warranted when evaluating the two predictive powers of a test. Unlike
sensitivity and specificity, both PPP and NPP
are affected and change according to the prevalence or base rate at which the condition or
characteristic of interest (i.e., that which is being
screened by the test) occurs within a given
setting. As Elwood (1993) reports, the lowering
of base rates results in lower PPPs while
increasing base rates result in higher PPPs.
The opposite trend is true for NPPs. He notes
that this is an important consideration because
clinical tests are frequently validated using
samples in which the prevalence rate is 0.50,
or 50%. Thus, it is not surprising to see a test's
PPP drop in real-life applications where the
prevalence is lower.
Derogatis and DellaPietra (1994) indicate
that a procedure referred to as sequential
screening may provide at least a partial
solution to the limitations or other problems
that low base rates may pose for the predictive
powers of an instrument. Sequential screening
essentially involves the administration of two
screeners, each of which measures the condition
of interest, and two-phase screening. In the first
phase, one screener is administered to the low
base rate population. The purpose of this is to
identify those individuals without the condition,
thus requiring relatively good specificity. These
individuals are eliminated from involvement in
the second phase, resulting in an increase in the
prevalence of the condition among those who
remain. This group is then administered another
screener of equal or better sensitivity. With the
increased prevalence of the condition in the
remaining group, the false positive rate will be
much lower. As Derogatis and DellaPietra point
out,
Sequential screening essentially zeros in on a highrisk subgroup of the population of interest by
virtue of a series of consecutive sieves. These have
the effect of eliminating from consideration individuals with low likelihood of having the disorder, and simultaneously raising the base rate of
the condition in the remaining sample. (p. 45)
541
542
543
544
Similarly, knowledge of the patient's weaknesses or deficits may impact the type of
treatment plan that is devised. Greene and
Clopton (1994) provided numerous types of
deficit-relevant information from the MMPI-2
Content Scales that have implications for
treatment planning. For example, a clinically
significant score (T 4 64) on the Anger scale
should lead one to consider the inclusion of
training in assertiveness and/or anger control as
part of the patient's treatment. On the other
hand, uneasiness in social situations, as suggested by a significantly elevated score on either
the Low Self-Esteem or Social Discomfort scale,
suggests that a supportive approach to the
intervention would be beneficial, at least
initially.
Moreover, use of specially designed scales
and procedures can provide information related
to the patient's ability to become engaged in the
therapeutic process. For example, the MMPI-2
Negative Treatment Indicators content scale
developed by Butcher and his colleagues
(Butcher, Graham, Williams, & Ben-Porath,
1989) may be useful in determining whether the
patient is likely to be resistant to any form of
talk therapy. Morey and Henry (1994) have
supplied algorithms utilizing T scores for
various PAI scales to make statements about
the presence of positive characteristics, such as
the presence of sufficient distress to motivate
engagement in treatment, the ability to form a
therapeutic alliance, and the capacity to utilize
psychotherapy. The Therapeutic Reactance
Scale (Dowd, Milne, & Wise, 1991) is yet
another example of an instrument from which
the clinician can be forewarned of potential
resistance to therapeutic intervention.
Other types of patient characteristics that can
be identified through psychological assessment
have implications for the choice of the therapeutic approach and thus can contribute
significantly to the treatment planning process.
Beutler and his colleagues (Beutler & Clarkin,
1990; Beutler, Wakefield, & Williams, 1994;
Beutler & Williams, 1995) have identified four
patient characteristics that are thought to be
important to matching patients and treatment
approach for maximized therapeutic effectiveness. These include symptom severity, symptom
complexity, coping style, and potential resistance to treatment. At different points in time,
other patient variables also have been identified
by these investigators as important considerations in the selection of the best treatment for a
given patient. These include the problemsolving phase the patient has reached (Beutler
& Clarkin, 1990), and subjective distress and
social support (L.E. Beutler, personal communication, January 15, 1996).
Moreland (1996) points out how psychological assessment can assist in determining whether
the patient deals with problems through internalizing or externalizing behaviors. All things
being equal, internalizers would probably profit
most from an insight-oriented approach rather
than a behaviorally oriented approach. The
reverse would be true for externalizers. In
addition, cognitive factors also are important.
Knowing that intelligence test results indicate
an average or above IQ can assist the clinician in
determining whether a patient will be able to
benefit from a cognitive approach.
4.18.6.2.4 Monitoring of progress along the path
of expected improvement
Information from repeated testing during the
treatment process can help the clinician to
determine if the treatment plan is appropriate
for the patient at that particular point in time.
Thus, many clinicians use psychological assessment to determine whether their patients are
showing the expected improvement as treatment
progresses. If not, adjustments can be made.
These adjustments may reflect the need for a
more intensive or aggressive treatment approach (e.g., increased number of psychotherapeutic sessions each week, addition of a
medication adjunct) or for a less intensive
approach (e.g., reduce or terminate medication,
transfer from inpatient to outpatient care).
Either way, this may require further retesting in
order to determine whether the treatment
revisions have impacted the course of change
in the expected direction. This process may be
repeated any number of times. In-treatment
retestings also can provide information relevant
to the decision of when to terminate treatment.
The goal of monitoring is to determine
whether treatment is on track with the
progress that is expected at a given point in
time. When and how often one might assess the
patient is dependent on a few factors. The first is
the instrumentation. Many instruments are
designed to assess the patient's status at the
time of testing. Items on these measures are
generally worded in the present tense (e.g., I
feel tense and nervous, I feel that my family
loves and cares about me). Changes from one
day to the next on the constructs measured by
the instrument should be reflected in the test
results.
Other instruments, however, ask the patient
to indicate if a variable of interest has been
present, or how much or to what extent it has
occurred during a specific time period in the
past. The items usually are asked in the context
of something like During the past month, how
often have you . . . or During the past week, to
545
546
Many clinicians and other psychologists involved in assessment activities (e.g., counseling
psychologists, neuropsychologists) have had to
modify their practice routine to accommodate
this requirement. Some view this requirement as
resulting in an improvement in the quality of
their services; others likely see it as nothing
more than an inconvenience which, in the era of
managed care and limited access to treatment,
further limits the amount of time they have to
work with a patient. However, most would
agree that the patient has benefited from the
required feedback.
Finn and Tonsager (1992) identified other
factors that may have contributed to the recent
interest in providing patients with assessment
feedback. One is another external influence,
that is, the recognition of the patient's right to
see their medical and psychiatric health care
records. However, they also point to several
clinically and research-based findings and
impressions that suggest that therapeutic assessment enhances patient care through the
facilitation of patienttherapist rapport, cooperation during the assessment process, positive
feelings about the process and the clinician,
improvement in mental health status, and
feelings of being understood by another. In
addition, Finn and Tonsager refer to Finn and
Butcher's (1991) summary of potential benefits
that may accrue from providing test results
feedback. The listed benefits, based on clinical
experience, include increased feelings of selfesteem and hope, reduced symptomatology and
feelings of isolation, increased understanding
and self-awareness, and increased motivation to
seek or be more actively involved in mental
health treatment. Finally, Finn and Martin (in
press) note that the therapeutic assessment
process can lead to increased feelings of mastery
and control and decreased feelings of alienation. At the same time, it can serve as a model
for relationships that can result in mutual
respect and the patient being seen for who he or
she is.
4.18.7.3 The Therapeutic Assessment Process
Finn (1996a) has outlined a three-step
procedure for therapeutic assessment using
the MMPI-2. As indicated above, it should
547
relationships, implications for treatment, diagnostic impression, and recommendations. Unfortunately, clinicians who do not or cannot use
the MMPI-2 or other well-researched, multidimensional instruments will not have the same
amount or type of data available to them. (This
should not preclude them from identifying the
types of valid and useful information that can
be derived from the instruments and organizing
it into a usable form for presentation to the
patient.) This is followed by a determination of
how to present the results to the patient. This
can be guided by the clinician asking himself or
herself the following questions:
(i) How do the (test) findings relate to the client's
goals?
(ii) What are the most important findings of the
(tests administered)?
(iii) To what extent is the client likely to already
know about and agree with the (test) findings?
(iv) How much new information is the client likely
to be able to integrate in the feedback session?
(v) What is likely to happen if the client becomes
overwhelmed or is presented with findings that are
greatly discrepant from his/her current self-concept? (p. 34)
548
549
550
551
552
553
554
H2 (SEM)2
where SEM is the standard error of measurement for a functional group (e.g., normals,
nonpatients) on the instrument. If the RC index
is greater than 1.96, the change in scores is not
likely to be due to chance (p 5 0.05), but rather
to reflect real change.
Speer (1992) recommended a different approach when regression to the mean has been
demonstrated to contribute to the improvement
in scores from pre- to post-test. The alternate
approach, based on the combined work of
Nunnally (1967) and Edwards, Yarvis, Mueller,
Zingale, and Wagman (1978), involves developing a confidence interval of +2 SEMs around
the estimated true pretest score. A post-test
Future Directions
score falling outside of this confidence interval
is considered significantly different from the
initial pretest score at p 5 0.05. Using this
approach, more change is needed to show
clinically significant improvement than to show
clinically significant deterioration. Note that the
criterion for determining whether regression to
the mean is occurring is met when a negative
correlation is found to exist between the
pretreatment score and amount of change that
has taken place. This implies the evaluation of
group data, and for this reason this empirical
criterion may not be of use for the individual
patient unless the latter is a member of a sample
for which test results are available.
Lambert (1994) proposes a modified recommendation for the dual criteria for clinically
significant change (that is, RC greater than 1.96
and movement of the patient's score from the
dysfunctional group's distribution to the functional group's distribution) such that movement
from one degree of dysfunction to a lesser
degree would also meet one of the two criteria
for clinically significant change. In an example,
Lambert illustrated that normative data for the
Global Severity Index (GSI) found in the SCL90-R literature can be used to empirically define
four levels of symptom intensity: asymptomatic,
mildly symptomatic, moderately symptomatic,
and severely symptomatic. Assuming an RC of
1.96 or greater, clinically significant change can
be said to have occurred if a patient's GSI score
moves from severely to moderately or mildly
symptomatic, or to asymptomatic; from moderately to mildly symptomatic, or to asymptomatic; or from mildly symptomatic to
asymptomatic. Although this criterion is less
stringent than having to move from being
symptomatic (regardless of the severity) to
asymptomatic, it still provides information that
is quite useful for clinical decision making.
4.18.9 FUTURE DIRECTIONS
The ways in which clinical psychologists have
conducted the types of psychological assessment described in this chapter have undergone
dramatic changes during the 1990s. This should
come as no surprise to anyone who spends a few
minutes a day skimming the newspaper or
watching television. The health care revolution
started gaining momentum at the beginning of
the 1990s and has not since slowed down. And
there are no indications that it will subside in
the foreseeable future. There was no real reason
to think that behavioral health care would be
spared from being a target of the revolution,
and there is no good reason why it should have
been spared. The behavioral health care
555
556
Future Directions
national databases of therapeutic assessment
data. Patient data gathered by various providers, organizations or programs within organizations, at one or more points during the
therapeutic episode, can be pooled and used for
various purposes. These databases can then
serve as the bases for two highly beneficial (and
probably profitable) endeavors. The first is the
generation of sets of normative data for various
populations delineated along any number of
parameters. Norms for any number of instruments or health care variables could be
generated on demand and continuously
updated to reflect trends in behavioral health
care. This author is aware of one large, national
behavioral health care system where such a
database already exists. He also is aware of
efforts at establishing cross-organizational
databases of this kind.
The second benefit afforded by the information contained in these databases is that of
predictive modeling. For example, the behavioral health care organization mentioned
above has taken advantage of the organizational
data available to it to investigate the relationships between a number of treatment, demographic and other variables and the outcomes of
treatment. Subjecting the large data sets available to it to sophisticated statistical analyses has
allowed this organization to determine those
types of patients requiring special care or
attention in order to achieve desired outcomes
at the time of treatment termination. Predictive
modeling can also be used for identifying
variables related to other aspects of patient
care, such as patient satisfaction with the care
received. The possibilities for the use of data in
this manner are enormous.
4.18.9.4 Trends in the Application of
Technology
Clinical psychologists have not been shy
when it has come to taking advantage of the
technological advances that have been achieved
since the late 1970s. This is no more evident than
in the extent to which the personal computer
and the vast array of psychological assessment
software have been incorporated into their
delivery of clinical services. Automated administration, scoring, and interpretation and reporting of the results of nearly all major
objective tests are currently available to the
clinician through PC-based software. In addition, the availability of affordable desktop
optical scanners allows the clinician to maintain
the portability of the assessment instruments
while retaining the scoring and interpreting
power of the computer for processing the test
data.
557
558
References
therapeutic assessment, situations in which
patients are evaluated via psychological testing
are used as opportunities for the process itself to
serve as a form of therapeutic intervention. This
is accomplished through involving the patient as
an active participant in the assessment process,
not just as the object of the assessment.
Thirdly, psychological assessment can be
employed as the primary mechanism by which
the outcomes or results of treatment can be
measured. However, the use of assessment for
this purpose is not a cut-and-dried matter. As
discussed, there are issues, pertaining to what to
measure, how to measure, and when to measure,
that require considerable thought prior to
undertaking any standard (or even nonstandard) plan to assess outcomes. Guidelines for
resolving these issues are presented, as is
information pertaining to how to determine
whether the measured outcomes of treatment
are indeed significant.
In the final section of the chapter, this author
shares some thoughts about where psychological assessment is probably heading in the future.
No radical revelations are presented since no
signs really point in that direction. What is
foreseen is the appearance of more quality
assessment instruments that will remain in the
public domain, and greater application of
communications technology, fax and the Internet, in particular, as assessment delivery,
scoring and reporting mechanisms. Also predicted is the application of tomorrow's computer technology to available assessment data
for optimized treatmentpatienttherapist
matching. The innovative proposals of Beutler
and Williams in this regard seem to represent
the state-of-the-art thinking at this time.
There is no doubt that the practice of
psychological assessment has been dealt a blow
within recent years. However, as this chapter
hopefully has shown, clinical psychologists have
the skills to take this powerful tool, apply it in
ways that will benefit those suffering from
mental health and substance abuse problems,
and demonstrate its benefits and their skills to
patients and payers. Whether they will be
successful in this demonstration will be determined in the near future. In the meantime,
advances will continue to be made that will
facilitate their work and improve its quality.
4.18.11 REFERENCES
American Psychological Association (1992). Ethical principles of psychologists. Washington, DC: Author.
American Psychological Association (1996). The costs of
failing to provide appropriate mental health care.
Washington, DC: Author.
Andrews, G., Peters, L., & Teesson, M. (1994). The
measurement of consumer outcomes in mental health.
559
560
Derogatis, L. R., Lipman, R. S., & Covi, L. (1973). SCL90: An outpatient psychiatric rating scalepreliminary
report. Psychopharmacology Bulletin, 9, 1327.
Dickey, B., & Wagenaar, H. (1996). Evaluating health
status. In L. I. Sederer & B. Dickey (Eds.), Outcomes
assessment in clinical practice (pp. 5560). Baltimore:
Williams & Wilkins.
Donabedian, A. (1985). Explorations in quality assessment
and monitoring: Vol. III. The methods and findings of
quality assessment monitoring: An illlustrative analysis.
Ann Arbor, MI: Health Administration Press.
Dorwart, R. A. (1996). Outcomes management strategies in
mental health: Applications and implications for clinical
practice. In L. I. Sederer & B. Dickey (Eds.), Outcomes
assessment in clinical practice (pp. 4554). Baltimore:
Williams & Wilkins.
Dowd, E. T., Milne, C. R., & Wise, S. L. (1991). The
therapeutic Reactance Scale: A measure of psychological
reactance. Journal of Counseling and Development, 69,
541545.
Edwards, D. W., Yarvis, R. M., Mueller, D. P., Zingale, H.
C., & Wagman, W. J. (1978). Test-taking and the
stability of adjustment scales: Can we assess patient
deterioration? Evaluation Quarterly, 2, 275292.
Eisen, S. V., Grob, M. C., & Klein, A. A. (1986). BASIS:
The development of a self-report measure for psychiatric
inpatient evaluation. The Psychiatric Hospital, 17,
165171.
Elwood, R. W. (1993). Psychological tests and clinical
discrimination: Beginning to address the base rate
problem. Clinical Psychology Review, 13, 409419.
Ficken, J. (1995). New directions for psychological testing.
Behavioral Health Management, 20, 1214.
Finn, S. E. (1996a). Manual for using the MMPI-2 as a
therapeutic intervention. Minneapolis, MN: University of
Minnesota Press.
Finn, S. E. (1996b). Assessment feedback integrating
MMPI-2 and Rorschach findings. Journal of Personality
Assessment, 67, 543557.
Finn, S. E., & Butcher, J. N. (1991). Clinical objective
personality assessment. In M. Hersen, A. E. Kazdin, &
A. S. Bellack (Eds.), The clinical psychology handbook
(2nd ed., pp. 362373). New York: Pergamon.
Finn, S. E., & Martin, H. (in press). Therapeutic
assessment with the MMPI-2 in managed health care.
In J. N. Butcher (Ed.), Objective personality assessment in
managed health care: A practitioner's guide. Minneapolis,
MN: University of Minnesota Press.
Finn, S. E., & Tonsager, M. E. (1992). Therapeutic effects
of providing MMPI-2 test feedback to college students
awaiting therapy. Psychological Assessment, 4, 278287.
Friedman, R., Sobel, D., Myers, P., Caudill, M., & Benson,
H. (1995). Behavioral medicine, clinical health psychology, and cost offset. Health Psychology, 14, 509518.
Gough, H. G., McClosky, H., & Meehl, P. E. (1951). A
personality scale for dominance. Journal of Abnormal
and Social Psychology, 46, 360366.
Gough, H. G., McClosky, H., & Meehl, P. E. (1952). A
personality scale for social responsibility. Journal of
Abnormal and Social Psychology, 47, 7380.
Greene, R. L. (1991). The MMPI-2/MMPI: An interpretive
manual. Boston: Allyn & Bacon.
Greene, R. L., & Clopton, J. R. (1994). Minnesota
Multiphasic Personality Inventory2. In M. E. Maruish
(Ed.), The use of psychological testing for treatment
planning and outcome assessment (pp. 137159). Hillsdale, NJ: Erlbaum.
Greenfield, T. K., & Attkisson, C. C. (1989). Progress
toward a multifactorial service satisfaction scale for
evaluating primary care and mental health services.
Evaluation and Program Planning, 12, 271278.
Hathaway, S. R., & McKinley, J. C. (1951). MMPI manual.
New York: The Psychological Corporation.
Health Outcomes Institute (1993). Health Status Questionnaire 2.0 manual. Bloomington, MN: Author.
Hsiao, J. K., Bartko, J. J., & Potter, W. Z. (1989).
Diagnosing diagnoses: Receiver operating characteristic
methods and psychiatry. Archives of General Psychiatry,
46, 664667.
Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984).
Psychotherapy outcome research: Methods for reporting
variability and evaluating clinical significance. Behavior
Therapy, 15, 336352.
Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1986).
Toward a standard definition of clinically significant
change [Letter to the editor]. Behavior Therapy, 17,
309311.
Jacobson, N. S., & Truax, P. (1991). Clinical significance:
A statistical approach to defining meaningful change in
psychotherapy research. Journal of Consulting and
Clinical Psychology, 59, 1219.
Jahoda, M. (1958). Current concepts of mental health. New
York: Basic Books.
Lambert, M. J. (1994). Use of psychological tests for
outcome assessment. In M. E. Maruish (Ed.), The use of
psychological testing for treatment planning and outcome
assessment (pp. 7597). Hillsdale, NJ: Erlbaum.
Lambert, M. J., Lunnen, K., Umphress, V., Hansen, N. B.,
& Burlingame, G. M. (1994). Administration and scoring
manual for the Outcome Questionnaire (OQ-45.1). Salt
Lake City, UT: IHC Center for Behavioral health care
Efficacy.
Larsen, D. L., Attkisson, C. C., Hargreaves, W. A., &
Nguyen, T. D. (1979). Assessment of client/patient
satisfaction: Development of a general scale. Evaluation
and Program Planning, 2, 197207.
LeVois, M., Nguyen, T. D., & Attkisson, C. C. (1981).
Artifact in client satisfaction assessment: Experience in
community mental health settings. Evaluation and
Program Planning, 4, 139150.
Maruish, M. (1990, Fall). Psychological assessment: What
will its role be in the future? Assessment Applications,
78.
Maruish, M. E. (1994). Introduction. In M. E. Maruish
(Ed.), The use of psychological testing for treatment
planning and outcome assessment (pp. 321). Hillsdale,
NJ: Erlbaum.
Megargee, E. I., & Spielberger, C. D. (1992). Reflections on
fifty years of personality assessment and future directions for the field. In E. I. Megargee & C. D. Spielberger
(Eds.), Personality assessment in America (pp. 170190).
Hillsdale, NJ: Erlbaum.
Mental Health Weekly. (1996a, April 8). Future targets
behavioral health field's quest for survival, 12.
Mental Health Weekly. (1996b, April 8). Leaders predict
integration of MH primary care by 2000, 16.
Mental Health Weekly. (1996c, April 29). Anxiety disorders
screening day occurs this week, 7.
Metz, C. E. (1978). Basic principles of ROC analysis.
Seminars in Nuclear Medicine, 8, 283298.
Migdail, K. J., Youngs, M. T., & Bengen-Seltzer, B. (Eds.)
(1995). The 1995 behavioral outcomes & guidelines
sourcebook. New York: Faulkner & Gray.
Millon, T. (1994). MCMI-III manual. Minneapolis, MN:
National Computer Systems.
Moreland, K. L. (1996). How psychological testing can
reinstate its value in an era of cost containment.
Behavioral health care Tomorrow, 5, 5961.
Morey, L. C. (1991). The Personality Assessment Inventory
professional manual. Odessa, FL: Psychological Assessment Resources.
Morey, L. C., & Henry, W. (1994). Personality Assessment
Inventory. In M. E. Maruish (Ed.), The use of
psychological testing for treatment planning and outcome
assessment (pp. 185216). Hillsdale, NJ: Erlbaum.
Newman, F. L. (1994). Selection of design and statistical
References
procedures for progress and outcome assessment. In M.
E. Maruish (Ed.), The use of psychological testing for
treatment planning and outcome assessment (pp. 111134).
Hillsdale, NJ: Erlbaum.
Newman, F. L., & Ciarlo, J. A. (1994). Criteria for
selecting psychological instruments for treatment outcome assessment. In M. E. Maruish (Ed.), The use of
psychological testing for treatment planning and outcome
assessment (pp. 98110). Hillsdale, NJ: Erlbaum.
Nguyen, T. D., Attkisson, C. C., & Stegner, B. L. (1983).
Assessment of patient satisfaction: Development and
refinement of a service evaluation questionnaire. Evaluation and Program Planning, 6, 299313.
Nunnally, J. C. (1967). Psychometric theory. New York:
McGraw-Hill.
Olfson, M., & Pincus, H. A. (1994a). Outpatient psychotherapy in the United States, I: Volume, costs, and
user characteristics. American Journal of Psychiatry, 151,
12811288.
Olfson, M., & Pincus, H. A. (1994b). Outpatient psychotherapy in the United States, II: Patterns of utilization. American Journal of Psychiatry, 151, 1289.
Oss, M. E. (1996). Managed behavioral health care: A look
at the numbers. Behavioral Health Management, 16,
1617.
Pallak, M. S. (1994). National outcomes management
survey: Summary report. Behavioral health care Tomorrow, 3, 6369.
Phelps, R. (1996, February). Preliminary practitioner
survey results enhance APA's understanding of health
care environment. Practitioner Focus, 9, 5.
Psychotherapy Finances (1995, January). Fee, practice and
managed care survey. 21(1), Issue 249.
Radosevich, D., & Pruitt, M. (1996). Twelve-item Health
Status Questionnaire (HSQ-12) version 2.0 user's guide.
Bloomington, MN: Health Outcomes Institute.
Radosevich, D. M., Wetzler, H., & Wilson, S. M. (1994).
Health Status Questionnaire (HSQ) 2.0: Scoring comparisons and reference data. Bloomington, MN: Health
Outcomes Institute.
Schlosser, B. (1995). The ecology of assessment: A
patient-centric perspective. Behavioral health care
Tomorrow, 4, 6668.
Sederer, L. I., Dickey, B., & Hermann, R. C. (1996). The
imperative of outcomes assessment in psychiatry. In L. I.
Sederer & B. Dickey (Eds.), Outcomes assessment in
clinical practice (pp. 17). Baltimore: Williams &
Wilkins.
Simmons, J. W., Avant, W. S., Demski, J., & Parisher, D.
(1988). Determining successful pain clinic treatment
through validation of cost effectiveness. Spine, 13, 34.
561