Vous êtes sur la page 1sur 14

VOL.8, NO.

1, 1982 85
Social Dysfunction and
Treatment Failure in
Schizophrenia

by Carmi Schooler Abstract chological condition than patients


and Herbert E. Spohn on the custodially oriented control
Recent evaluation of a 20-year-old ward.
experimental ward resocialization Although we believe the evalua-
program for chronic schizophren- tion, design, and measurement of
ics indicates that the general level

Downloaded from http://schizophreniabulletin.oxfordjournals.org/ by guest on September 16, 2016


this program are reasonable by
of activity, much of it social, was contemporary standards and the
disruptive to the psychological approach and its rationale careful-
functioning of patients, particu- ly documented, the report of such
larly sicker ones. Antipsychotic an "ancient" failure would be of
drugs positively affected psycho- no more than historical interest
logical functioning and also de- and cathartic value if it did not add
creased social behavior. A review something to our present knowl-
of other studies indicates that we edge. One value such findings
are not unique in finding that in- have is that they serve as a van-
tensive socioenvironmental thera- tage point for reviewing subse-
pies have adverse effects on schiz- quent research by showing how, if
ophrenics. Furthermore, a wide we had known then what we
range of studies indicates that know now, we would not have
schizophrenics are prone to avoid been so bitterly surprised and dis-
social interaction and show a dec- appointed. These data, however,
rement in functioning as the in- can do more than serve as a focus
tensity of such interactions in- for a literature review. Both their
creases. Unfortunately, although quality and the emergence of new
various hypotheses seem feasible, statistical techniques make it pos-
little is known about the reasons sible to use these data to add
for schizophrenics' social dys- meaningfully to what we now
function and little research is know.
presently being done. Given the
recent findings that neuroleptic
drug treatment by itself is insuffi- The Pretreatment Ward
cient to keep many patients out of Setting
the hospital and that those that
stay in the community show an in- In 1956 when planning for the ex-
crease in withdrawal, the devel- perimental milieu treatment
opment of successful treatment started, medication was just be-
programs for schizophrenia may ginning to come into use, but the
.hinge upon our learning more liberalizing spirit that subsequent-
about the nature of and reasons ly pervaded the mental hospital
for the schizophrenic's social dys- world was in no way manifest at
function. the large Veterans Administration
hospital at which our work was
done. Well over 60 percent of the
This article reports an experimen- patient population of this hospital
tal treatment failure that took
place 20 years ago. Our general Reprint requests should be sent to
finding is that the chronic schizo- Dr. C. Schooler at the Laboratory of
phrenic patients on a resorializa- Socio-environmental Studies, NIMH,
tion-oriented experimental ward Bldg. 31, Rm. 4C-21, 9000 Rockville
ended our program in worse psy- Pike, Bethesda, MD 20205.
86 SCHIZOPHRENIA BULLETIN

were chronic schizophrenics. Men- extreme control of every aspect of Changes on the Experimental
tal patients who were susceptible the patient's life, which cast him in Ward
to social rehabilitation by means the role of a total dependent. This
then available had been dis- implied not only that a variety of Major changes in the social,
charged years before. Besides the choices, normally made by indi- administrative, and physical struc-
occasional use of the new viduals for themselves, were made ture were implemented on the

Downloaded from http://schizophreniabulletin.oxfordjournals.org/ by guest on September 16, 2016


antipsychotic drugs, treatment of for chronic schizophrenic patients 48-patient experimental ward. The
chronic schizophrenics under this by hospital personnel but also, total ward group was subdivided
regimen consisted largely of the and more significantly, that the into five six-man and two nine-
busy-work adjunctive therapies. community of patients on the man groups. A "group leader,"
Discharge rates were low, read- ward was thus no community at usually a psychiatric aide, but in
mission rates high. A heavy aura all. There were no common pur- some cases an adjunctive thera-
of pessimism pervaded, and per- poses achievable through pist, was permanently assigned to
sonnel at all levels regarded as fu- cooperative or competitive enter- each group. These leaders met
tile any concerted treatment ef- prise, there was no pattern of role with their groups twice a day, 5
forts. Preoccupation with differentiation and, of course, no days a week, in permanently as-
administrative detail and very extended social interaction. The signed group meeting rooms or al-
tight control over patient move- ward in this hospital setting was coves. Group leaders were trained
ment and initiative served to limit primarily an aggregate of isolates to encourage discussion among
any contact with patients that (Schooler and Spohn 1960a). patients about attitudes and feel-
might lead to what was widely re- We came to believe that the pat- ings they shared concerning
garded as inevitably painful and tern of asocial and inappropriate events in and outside the hospital.
disappointing therapeutic involve- behavior of hospitalized chronic They were also trained to promote
ment. schizophrenics resulted from an feelings of group participation and
In this context, we came to re- interaction between institutional belonging and to foster the view
gard the chronic schizophrenic pa- processes on the one hand and that the group was a small social
tient as a socially disengaged, disease processes on the other. It unit which both satisfied individu-
anomic individual, who purpose- seemed to us that the schizo- al needs and made demands for
fully avoided interpersonal phrenic's need for social with- individual contributions to group
engagement and preferred the drawal, self-isolation, self- welfare.
impoverished and undemanding effacement, and restriction of his In order to achieve these aims
role that the institution assigned to life space was sometimes subtly, through the group meetings proc-
him. The institution, in turn, sometimes overtly fostered and ess, group leaders employed a
imposed no sanction upon the ex- abetted by the institution. Con- number of procedures. They
pression of pathological or abnor- sciously or unconsciously, these sought to stimulate group
mal behavior which did not inter- patient orientations were used by discussion of current events. Indi-
fere with the smooth functioning the hospital staff to make the pa- vidual patients were asked to read
of ward routine. Thus, the tient into a tractable hospital citi- news stories out loud and others
interpersonal environment of the zen who fitted smoothly and effi- were encouraged to comment on
ward provided no opportunity for ciently into a network of adminis- them. Similarly, individual group
reality testing and the discovery of trative and management routines members described projects
the social inutility of inappropriate predicated on the assumption of undertaken in occupational thera-
behavior. his incurability. py and were urged to comment on
The hospital's view of the chron- Such insights and feelings those of other patients in the
ic schizophrenic as incompetent guided the development and im- group. Games entailing coopera-
and unable to take any rational ini- plementation of an experimental tive and competitive behavior
tiative on his own behalf was "socioenvironmental" treatment were widely used by group leaders
made manifest in the form of an program at the ward level. to stimulate and sustain social in-
VOL 8, NO. 1, 1982 87

teraction. Patients who anticipated signments were made for many Methods of Measurement and
family visits were encouraged to patients, while the most with- Evaluation
share their feelings in this regard drawn and confused patients re-
with the group both before and af- ceived daily periods of occupa- Measurement. The 100 male veter-
ter such visits. Groups went on tional therapy and recreational an patients selected for this study

Downloaded from http://schizophreniabulletin.oxfordjournals.org/ by guest on September 16, 2016


trips together to athletic games, to activity. All patients were encour- were randomly assigned to two
theaters and for shopping and aged to avail themselves of in- closed wards, one experimental,
were escorted on such trips by creased opportunities to exercise one control. The selection criteria
their group leader. Afterwards the individual choice in matters of were primary diagnosis of schizo-
group was encouraged to discuss food, personal care, clothing, lux- phrenia, 3 or more years of hospi-
the trip experience. uries, and participation in recrea- talization, a stable adjustment on a
Finally the group leaders were tional activities. The formerly closed ward, and poor prognosis
trained to function as models and white and beige color scheme of for recovery. The patient groups
guides in reality testing, the walls and the dormitory beds thus selected had been continu-
emphasizing, especially in the was broken by a variety of drapes, ously hospitalized for an average
context of the group situation, the colored bedspreads, and pictures, number of 8 years, with an aver-
importance of controlling sympto- in part selected by the patients age age of 42.7 years. Every major
matology in the interest of clear themselves. subdiagnostic category was repre-
communication and group partici- The group leaders were super- sented in balanced numbers on
pation. Levels of group discussion vised by the ward nurse and ward both wards.
and activity were carefully ad- psychologist at regularly sched- Baseline measures were collect-
justed to the capacities of each uled semiweekly conferences. ed for a period of more than a
group. In order to associate as During both the training period year, while the two wards contin-
closely as possible with the group and the supervisory conferences, ued to function under psychiatric,
experience those gratifications emphasis was placed on the belief nursing, and administrative proce-
which remain important to chronic that the chronic withdrawal and dures in every way similar to those
schizophrenics, group leaders dis- alienation of the schizophrenic pa- of the rest of the hospital.
tributed patient luxuries (mostly tient could be reversed through Evaluations were focused on
cigarettes) before one of the group the intensification of interpersonal two concepts—social behavior and
experience periods, while before relationships. It was stressed that psychological functioning.
the second, they supervised a attention to individual needs and The measures of social behavior
snack period with beverages and capacities would restore feelings of included:
food. Typically, individual pa- identity, self-confidence, and initi- • Percentage of observations of
tients were encouraged to partici- ative, and that the example and individual patients when engaged
pate in the process of dispensing guidance of group leaders would in social interaction. The Location
luxuries and comestibles to the lead to the development of ward Activity Inventory (LAI) (Hunter,
members of their group. In order standards of behavior similar to Schooler, and Spohn 1962;
to extend the activity of the group those of a normal human commu- Schooler and Parkel 1966) is a
beyond these sessions and to pro- nity. As the implementation of the structured observational technique
vide as many group-shared experi- group process progressed, super- that gathers minimally inferential
ences as possible, the major ward visory conferences began to take profiles of patients' location and
activities—cleanup, shaving, on increasing importance for activity patterns on a time-
showering, and eating—were re- group leaders. In such conferences sampling bases.
organized as group functions. they were helped to share and • Rate of interaction with oth-
Parallel with the small group come to terms with feelings of ers. The Interaction Protocol (IP)
structure, a program of intensified frustration, resentment, and guilt (Solomon and Spohn 1958;
individually oriented activity was in response to the difficulties they Wilensky and Solomon 1960) is a
instituted. After a careful review encountered in efforts to promote prestructured observation instru-
of individual needs and capacities,. social interaction among the pa- ment designed to assess the char-
off-ward therapeutic activity as- tients in their gToups. acteristics of patients' social inter-
88 SCHIZOPHRENIA BULLETIN

actions on the ward. During each • Mental Health Rating Scale. A life on the wards. Patients spent
evaluation period, 55 one-hour pe- six-level global rating (made by the less than 3 percent of their time in
riods of observation were made at ward psychologist) is focused on any kind of social interaction, and
random times during the day. The the patient's presumed ability to about 19 percent in nonfunctional
interaction rate is the ratio of the assume independent responsibility pathological behavior. (For a more

Downloaded from http://schizophreniabulletin.oxfordjournals.org/ by guest on September 16, 2016


number of a patient's social con- in caring for himself. extensive description, see Hunter,
tacts to the number of observation • Nonfunctional behavior on the Schooler, and Spohn 1962).
periods in which he was on the LAI (Hunter, Schooler, and Spohn Given both the nature of the
ward. 1962). Included are nonfunctional population and of several of the
• Rate of interaction specifically movement and object manipula- individual measures of social be-
with other patients (IP). tion, nonsocial verbal, gestural havior and psychological func-
• Number of interactions initi- and laughing behavior. tioning, the question of the relia-
ated toward other patients (IP). The measures used during the bility of the measurement of these
• Number of interactions initi- baseline period to examine patient two concepts arises. Test-retest
ated toward staff (IP). adjustment were readministered studies such as this are particular-
• Number of interactions re- on both wards after the experi- ly susceptible to the eventuality of
ceived from other patients (IP). mental program had been in oper- measurement error because the
• Number of interactions re- ation for 2 years. During this peri- magnitude of the effect of the
ceived from staff (IP). od the control ward remained pretreatment (independent) varia-
The measures of psychological under the standard regimen used bles on the posttreatment (de-
functioning included: by the hospital to treat chronic pendent) variables will be
• An abbreviated Wechsler schizophrenics. At this time, 41 underestimated in direct propor-
Adult Intelligence Scale (WAIS). members of the experimental tion to the amount of error in the
The subtests used include infor- group and 34 of the control group measurement of the pretreatment
mation, Digit Span, Picture Com- were still on their respective variables (Blalock 1972; Heise
pletion, Block Completion, Block wards. 1975).
Design, and Digit Symbol Among the patients who re- Fortunately, Linear Structural
(Wilensky and Solomon I960). 1 mained in the study through the Equations System Analysis
• Rorschach Developmental posttreatment measurement peri- (LISREL) makes it possible to ob-
Level Score (Becker 1956). This od, there were two significant dif- tain a measurement-error-free
score is based on a one-response- ferences in baseline measures, measure of a concept through the
per-card Rorschach in which a both of them on social variables, use of confirmatory factor analysis
high score is interpreted as indi- between the two wards. Among (Joreskog 1973; Maruyama and
cating a high level of perceptual these patients there were signifi- McGarvey 1980; Schooler, in press).
organization and by inference a cant differences in rate of interac- Given multiple indicators of a con-
mature level of personality inte- tion (p = .021) and rate of patient- cept, models can be constructed
gration. patient interaction (p = .037). In which divide the variance of each
• Goodrich Psychiatric Rating both cases the patients who re- of the indicators into two
Score (Goodrich 1953). Evaluation mained on the control ward parts—one part reflecting the con-
is based on a written report of a showed a higher level of interac- cept being measured, the second
standard mental status exam con- tion than those who stayed on the part reflecting anything else,
ducted by psychiatric residents experimental ward. As will be which for measurement purposes
under staff supervision. seen, the direction of this differ- is considered error. Such models
ence runs counter to the experi- can take into account the possibili-
1 mental effect which resulted in an ty that errors of measurement are
Some IQ data were missing for 26 increase in social behavior on the correlated over time—that what-
subjects. Estimates of these scores experimental ward. ever errors there may have been in
were made by using the other varia-
bles in the model to predict IQ and Examination of the baseline ob- the measurement of any of the in-
using the resultant constants and beta servational data mirrored our dices of a concept in the
weights to construct estimated scores. bleak impressionistic picture of pretreatment period are correlated
VOL. 8, NO. 1, 1982 S9

with errors in the measurement of than the pretreatment period. In other hand, rate of patient-patient
that index in the posttreatment pe- the pretreatment period the LAI interactions, which had the lowest
riod. The program reduces these measure of social activity, which loading on the pretreatment meas-
models to a series of simultaneous does not specify the initiator or the ure, had the second highest load-
equations, which it solves using it- other participants, had the highest ing on the posttreatment measure

Downloaded from http://schizophreniabulletin.oxfordjournals.org/ by guest on September 16, 2016


erative function minimization pro- loading while in the posttreatment and initiating interactions with
cedures. It also tests the signifi- period it had the lowest. Receiving other patients had the highest.
cance of the loadings of the indices social interactions from the staff, This pattern of different loadings
on the concepts and the degree of which had the second lowest load- suggests that social behavior was
fit of the model to the original ing on the posttreatment measure, more reliably measured by indices
data. also had a higher loading on the reflecting passive social behavior
The measurement models for pretreatment measure. Receiving during the pretreatment and indi-
both social behavior and psycho- interactions from other patients ces reflecting active social behavior
logical functioning seem to reflect had a similarly higher loading on during the posttreatment. Despite
their respective underlying con- the pretreatment than the these differences both
cepts and to fit the original data posttreatment measure. On the pretreatment and posttreatment
quite well.2 Examination of the
measurement models for social be- Table 1. Measurement model for social behavior
havior (see table 1) indicates that
there was a shift between the Standardized Standardized
pretreatment and the posttreat- loading on loading on
ment concepts in the relative im- pretreatment posttreatment Standardized
portance of the different indicators social social over-time
of social behavior. Initiating inter- Indicator behavior factor behavior factor correlated error
actions and interacting with peers
were more reliable indices of social Percent social
behavior during the posttreatment behavior (LAI) .89 .38 ( - .005)

Rate of
2
The confirmatory factor analyses interaction (IP) .35 .61 (-.006)
of the measurement models were
carried out using the MILS program, Rate of inter-
an advanced version of LISREL action with
(Joreskog and van Thillo 1972) devel- patients (IP) .26 .94 (-.01)
oped by Ronald Schoenberg. The cor-
relations between the confirmatory Interactions
factor analysis based concepts and initiated toward
other concepts used in the causal patients (IP) .82 .95 (-.01)
analyses were obtained through the
use of factor scores based on Interactions
Bartlett's method (Lawley and Max- initiated toward
well 1971, pp. 109-112). MILS not staff (IP) .76 .77 .16
only provides factor weights for
deriving such scores but also makes Interactions
possible an estimate of their reliability received from
by producing their correlations with patients (IP) .70 .61 (•10)
the true scores. The correlations be-
tween these factor scores and the oth- Interactions
er variables were then computed and received
the resulting correlations corrected from staff (IP) .57 .39 . .49
for the known unreliability of the
Bartlett factor scores. Chi-squared/c/r - 4 8950; () indicates NS, p > .05.
90 SCHIZOPHRENIA BULLETIN

measures unquestionably index measurement error, since the re- psychological functioning; (3)
patient social behavior. sultant output is a variance- pretreatment social behavior; (4)
Examination of the measure- covariance matrix among the rel- age; (5) number of weeks on
ment model for psychological evant variables. Such a matrix can, antipsychotic drugs;5 (6) the
functioning indicates that the however, be used for reduced residualized orthogonal interaction

Downloaded from http://schizophreniabulletin.oxfordjournals.org/ by guest on September 16, 2016


loadings of the different indices form equation analysis, the second of experimental condition and
are remarkably similar for both pe- type of analysis presented, which pretreatment psychological func-
riods (see table 2). Level of intel- simply consists of a set of multiple tioning;6 and (7) the residualized
lectual functioning as measured by regression analyses in which each
the abbreviated WAIS has the dependent variable is allowed to
3
highest loading at both times, and be affected by the complete set of The two drugs used were
the other loadings, including the independent variables. Besides reserpine and chlorpromazine. Unfor-
one based on ward observations making it possible to adjust for the tunately, this is the only measure of
(LAI nonfunctional), are reasona- effects of measurement error, such chemotherapy recoverable. Among
the patients who stayed through the
bly high and significant.3 an analysis has several additional posttreatment measurement, there
advantages.4 It is very similar to were no significant differences be-
Evaluation. Two types of statistic- analysis of variance when the lat- tween the two wards in average per-
al analysis were carried out to ex- ter is reduced to its basic regres- cent weeks on medication (control
amine the effectiveness of the sion components. The standard- ward = 71 percent, experimental
ward program. The first is an anal- ized reduced form coefficients ward = 78 percent, p = .47).
6
ysis of covariance comparing the (which are the paths cited in the Residualized interaction terms or-
posttreatment means of the exper- text) tell how much change can be thogonal to the main effects whose in-
imental and control wards ad- expected in the dependent variable teraction they represent had to be
justed for pretreatment level. This per unit change in the independ- constructed because the inclusion of
ent variable. nonorthogonalized interaction terms
analysis is performed on each of in a regression equation would render
the 12 variables used as indicators The dependent variables in the meaningless the main effect estimates
of the psychological and social reduced forms equation analysis (Cohen 1978; Cohen and Cohen 1978).
measurement models (contained are (1) posttreatment psychological Briefly, the residualized interaction
in tables 1 and 2). functioning; (2) posttreatment so- terms were developed by first con-
However, such an analysis can- cial behavior. The independent structing an "observed" interaction
not readily be carried out when the variables are (1) experimental con- term. Subjects who were in the exper-
factor scores based on the meas- dition (experimental ward = 1, imental group and above the sample
median in social behavior were as-
urement models are adjusted for control ward = 0); (2) pretreatment signed the score they had obtained for
social behavior while all other sub-
jects were assigned a value of 0. This
'Although there were some signifi- 'Since every independent variable observed interaction term was then
cant differences in the individual in- is allowed to affect every dependent used as a dependent variable in a
dices, there was no significant differ- variable, such an analysis should not multiple regression equation in which
ence between the two wards in the be confused with a confirmatory caus- the independent variables were ex-
social behavior factor among the pa- al analysis, in which the paths from perimental group and social behavior
tients who remained in the study some of the independent to some of score. Estimated scores were then
through the posttreatment measure- the dependent variables may be hy- constructed on the basis of the con-
ment phase. There was, however, a pothesized not to exist. Several more stants and beta weights of the result-
significant difference (p = .05) on the complex forms of causal analysis were ant regression equations and the esti-
psychological functioning factor. The mated scores subtracted from the
tried in an attempt to confirm observed ones. When they are in this
subjects who stayed on the experi- hypotheses about reciprocal causal ef-
mental ward had a higher level of residual form, the interaction terms
fects among the posttreatment meas- are uncorrelated with the main effects
pretreatment functioning than those ures, but relatively parsimonious re-
who remained on the control ward, a and they measure only that variance
duced form equation analysis which is unexplained by the main ef-
difference which runs counter to the provides the clearest and least ambig-
experimental effect. fects.
uous results.
VOL. 8, NO. 1, 1982 91

Table 2. Measurement model for psychological functioning in table 3 reveals something about
both the quantitative differences
Standardized Standardized and the qualitative differences be-
loading on loading on tween the two groups. Thus the
pretreatment posttreatment experimental ward group is seen

Downloaded from http://schizophreniabulletin.oxfordjournals.org/ by guest on September 16, 2016


psychological psychological Standardized not only as socially more active at
functioning functioning over-time posttreatment and as receiving a
Indicator factor factor correlated error much greater number of social
overtures from staff, but they also
IQ (abbreviated show a trend toward initiating a
WAIS) .80 .78 .27 larger number of interactions vis-
a-vis both staff and other patients
Developmental than the control group. This
level implies some reduction in the ex-
(Rorschach) .61 .49 .47 perimental ward group in social
passivity characteristic of chronic
Goodrich schizophrenic patients (such as the
Psychiatric control group) on custodially ori-
Rating .74 .73 (09) ented wards in public mental hos-
pitals in the era in which this
Montrose Mental study was performed.
Health Rating .77 .67 (•06) Examination of the reduced form
equation analysis, in which the ef-
Percent fects of measurement error have
nonfunctional been purged from the psychologi-
behavior (LAI) -.37 -.37 -.33 cal and social measures, reveals
that the level of stability from
pretreatment to posttreatment of
Chl-squared/d/ - 2.4651; () Indicates NS, p > .05 both psychological and social func-
tioning is very high (see table 4).
orthogonal interaction of experi- The only two exceptions are The standardized reduced form co-
mental condition and pretreatment nonfunctional behavior, where efficient from pretreatment to
level of social behavior. there is no difference between the postreatment psychological func-
wards, and the mental health rat- tioning is .92, and from pretreat-
Results ing scale, on which the experi- ment social behavior to post-
mental ward did relatively better treatment social behavior .92.
For the individual items that than the control ward. In Since we never expected any mira-
were the dependent variables in evaluating the latter finding, it cles, we were not surprised by the
the covariance analyses, the differ- should be borne in mind that the high stability of the patients' social
ences between the experimental global mental health ratings were and psychological functioning.
and control wards in the posttest not made blindly, but by the ward What we were not originally pre-
means adjusted for initial level psychologist. In such circum- pared for is the negative effect on
(but not measurement error) are stances raters' expectations may the patients' psychological func-
not generally significant. Howev- well produce results contrary to tioning of being on the experimen-
er, the direction of the differences those obtained by more controlled tal ward. The path from being in
is congruent with the hypothesis evaluation procedures. the experimental condition to
that the experimental condition in- Comparison of the patterning of posttreatment psychological func-
creased the level of social behavior the control and experimental tioning is —.20. Furthermore, this
and decreased the level of psycho- group posttreatment adjusted decrement in the experimental
logical functioning (see table 3). means for social behavior shown ward patients' psychological func-
92 SCHIZOPHRENIA BULLETIN

Table 3. Analysis of covariance of individual posttreatment measures covarying pretreatment level

Adjusted means
Variable Control Experimental F P

Downloaded from http://schizophreniabulletin.oxfordjournals.org/ by guest on September 16, 2016


Social behavior Indicators
Percent of social
interaction (LAI) .03 .07 8.683 .004
Rate of interaction
with others (IP) .37 .46 .055 .815
Rate of interaction
with patients (IP) .13 .19 .496 .484
Number of interactions
initiated toward
patients (IP) 6.04 7.21 .506 .479
Number of interactions
initiated toward
staff (IP) 4.12 7.87 1.791 .185
Number of interactions
received from patients (IP) 6.59 9.00 2.734 .103
Number of interactions
received from staff (IP) 6.53 14.63 39.235 .000
Psychological functioning Indicators
Abbreviated WAIS 81.08 76.31 .551 .460
Rorschach developmental
level score 26.38 22.26 1.991 .166
Goodrich Psychiatric
Rating score 2.48 2.20 .563 .128
Mental Health Rating
Scale 31.65 36.08 9.577 .003
Nonfunctional behavior
(LAI) .13 .13 1.358 .248

Honing took place in a context of scribed his preexperimental ward for ward indicates that being on
increased social interaction. The program self-isolation and with- the experimental ward resulted in
path of .13 from experimental con- drawal as akin to being inside a poorer psychological functioning,
dition to posttreatment social glass shell from which he could the significant residualized inter-
functioning indicates that the ex- see out but could not hear what action effect (path = .14) of ward
perimental manipulations did suc- was going on around him. With and initial psychological level indi-
ceed in increasing the level of the the advent of the program, he ex- cates that this effect is stronger for
patients' social behavior compared perienced both staff and other pa- patients whose initial level of psy-
to that on the control ward. tients as seeking to shatter his chological functioning was lower.
An anecdote may serve to dram- shell and this frightened him Thus the sicker patients on the ex-
atize our finding that as social in- greatly. Such a reaction seems to perimental ward were relatively
teraction on the experimental ward have been more prevalent among more adversely affected than were
increased, the level of psychologi- the sicker than the healthier pa- the healthier ones.
cal functioning decreased. A pa- tients on the experimental ward. In this sample of chronic schizo-
tient on the experimental ward de- While the significant main effect phrenics, age, not surprisingly, is
VOL. 8, NO. 1, 1982 93

Table 4. Significant standardized reduced form coefficients1 ever, an examination of the litera-
ture indicates that congruent
Po8ttreatment findings have generally emerged
Psychological Social among a wide range of schizo-
functioning behavior phrenic populations and social

Downloaded from http://schizophreniabulletin.oxfordjournals.org/ by guest on September 16, 2016


contexts. Thus more recent studies
1. Experimental ward -.20 .13 indicate that we were not unique
2. Pretrial psychological functioning .92 in finding that intensive
3. Pretrial social behavior .92 socioenvironmental therapies have
4. Interaction ward x pretrial psychological .14 an adverse effect on the psycho-
functioning (residualized) logical functioning of hospitalized
5. Age -.10 -.18 schizophrenics. In a review article
6. Antipsychotic medication .13 -.08 Hemsley (1978) cites a series of re-
1
ports of deterioration in the be-
Indicate the amount of change In standard units that can be expected in a dependent varia-
ble per unit change In an independent variable with the effects of the other mdspendent varia-
havior of at least a minority of
bles controlled. schizophrenics in intensive reha-
bilitation programs. He also finds
related to low levels of both social mental treatment effort did not re- evidence of increased behavioral
behavior and psychological func- pay its cost to patients by abnormality among schizophrenics
tioning in the posttreatment peri- preparing them for life outside of who took part in token economy
od. The path from age to the hospital. There were no signif- programs.
posttreatment social behavior is icant differences between the ex- Reviewing his own and related
-.18 and to posttreatment psycho- perimental and control groups in work, Wing (1975) concludes:
logical functioning -.10. discharge or length of stay in the negative impairments [e.g., so-
Initially more surprising, but community during a period fol- cial withdrawal, flatness of af-
more in line with the findings on lowing termination of the project fect, and lack of motivation] oc-
the negative effects of the experi- from May 1960 to September 1965. cur more frequently and more
mental ward on psychological That the proportion of experimen- intensely in conditions of social
poverty. . . . Florid relapse
functioning, are the negative ef- tal ward patients (25 percent) dis- [unpredictable associations, in-
fects of antipsychotic medication charged in the first 3 years after coherence of speech, hallucina-
on social behavior. The path from termination of the program was tions] occurs more frequently
number of weeks on antipsychotic slightly larger than that of control and intensely in socially
ward patients (9 percent) is proba- overstimulating environments
drugs to posttreatment social be- . . . through too vigorous at-
havior is -.08. At the same time, bly due to the fact that experimen- tempts at rehabilitation or too
the path from weeks on medica- tal ward patients were better intensive group therapy,
tion to posttreatment level of psy- known to staff than control ward [p. 257]
chological functioning is moder- patients. In another review article Van
ately strong and positive (.13). Putten and May (1976) conclude
The pattern of results strongly Discussion "that milieu therapy does not add
suggests that the general level of much to the treatment of schizo-
activity on the experimental ward, The results described above are phrenics once adequate chemo-
much of it social, is disruptive to obviously most applicable to long- therapy is used and gross neglect
the psychological functioning of term, chronic, male, veteran schiz- corrected" (p. 230). They cite a
the patients, particularly the sicker ophrenics subjected to a particular series of treatment studies sup-
ones. In this situation medication treatment regimen in the late porting "the concept that the ap-
decreases the amount of social be- 1950s. There may well be a plication of intensive milieu thera-
havior and possibly blunts its ef- declining gradient of generaliza- py is conceptually unsound for
fects. tion to the extent that the nature of some schizophrenic patients"
Finally, our evidence suggests the social situation or of the schiz- (p. 233). They also discuss three
that our intensive socioenviron- ophrenic population differs. How- studies (Hamilton et al. 1960;
94 SCHIZOPHRENIA BULLETIN

Freedman et al. 1961; Paul et al. adult status. What both of these become less surprising when we
1972) in which drug treatment characteristics may have in com- consider the evidence that schizo-
seems to increase social withdraw- mon is greater social intrusive- phrenics are more likely than oth-
al and to decrease both social re- ness. Other patients' aggressive ers both to avoid social contacts
sponsiveness and the effectiveness and bizarre behavior can be as in- and to show a decrement of psy-

Downloaded from http://schizophreniabulletin.oxfordjournals.org/ by guest on September 16, 2016


of social interventions. These latter trusive as the social demands chological functioning as social sit-
results are intriguing from the implied by treating the patient as uations become more intense.
vantage point of our finding that an adult. Interestingly, in terms of Examination of both their actual
chemotherapy has a positive effect the hypothesis that antipsychotic behavior and their expressed pref-
on psychological functioning and a drugs act to dampen the effects of erences indicates that schizo-
negative effect on social interac- social intrusion, the effects of phrenics are more prone to avoid
tion. these two ward characteristics are social interaction than are others
Also relevant are the ward stud- greater for patients receiving pla- in similar situations. Thus the only
ies carried out by Kellam et al. cebo than for those receiving significant behavioral difference
(1966, 1967) on the effects of ward drugs.7 between hospitalized schizophren-
atmosphere on the psychological The adverse effect of intensive ics and other chronic psychiatric
functioning of schizophrenics on socioenvironmental therapy pro- patients observed in an LAI study
admission wards. In these studies grams is not limited to hospital- of randomly selected patients in a
which were conducted as ized schizophrenics. Goldberg et large mental hospital is that the
part of a larger study on the effects al. (1977) found that symptomatic schizophrenics engage in less ver-
of phenothiazines, ward atmos- schizophrenic patients in the com- bal social behavior (Schooler and •
phere was characterized in terms munity relapsed more quickly Parkel 1966). In the same study the
of a series of dimensions measured when they received Major Role schizophrenic patients rated them-
by staff report or observation. Therapy (a combination of social selves as significantly more likely
Among these dimensions are dis- casework and vocational rehabili- to inhibit the expression of
turbed behavior (divided into ag- tation) than when they did not. interpersonal emotion than did the
gressive and bizarre) and adult The results of this study are also other patients. In another study,
status (a measure of the degree to similar to ours (and in keeping schizophrenics were found to ex-
which patients on wards are al- with those of Fairweather et al. press a distinct preference, com-
lowed to maintain basic symbols of 1960) in that a significant interac- pared to normals, for reducing the
adulthood). The first of these stud- tion was found, indicating that the degree of interpersonal inteirelat-
ies reports a correlation of .43 be- more symptomatic patients were edness in a two-person task situa-
tween the ward characteristics of more likely to be adversely affect- tion or, if possible, for doing the
aggressive behavior and staff pa- ed by the social intervention. task alone (Schooler 1963).
tient contact. Although some of The negative effects of socio- That such a preference for social
this correlation may be due to the environmental treatment programs withdrawal is not an ephemeral
staff's response to the patients' ag- problem is suggested by an analy-
gressive behavior, it is also possi- sis limited to "behavior anteceding
7
ble that some of the patients' ag- Analyses were also performed for the first manifestation of psychotic
gressive behavior may be a three ward atmosphere measures of onset" (Gittelman-Klein and Klein
reaction to the staff's social intru- social contact: aloneness, cluster-size, 1969, p. 39). The results show that
siveness. The second article pre- and staff-patient contact. The most "withdrawn asocial behavior, and
sents results which the authors find frequent significant findings were for a lack of interest in activities
paradoxical. Although, as they cluster size. Unfortunately, the social involving one's peers are uniform-
predicted, ward atmospheres implications of this variable are ly associated with decreased fre-
unclear. It is indexed by "the average
characterized by disturbed behavior number of patients present per social quency of successful, lasting re-
seemed to lead to greater sympto- occasion." A high number may well covery" (Gittelman-Klein and
matology, contrary to their expec- mean that the social interaction that Klein 1969, p. 44).
tations, so did ward atmospheres does take place is less individualized Both experimental and
which allocated the patients more and intense. nonexperimental evidence also in-
VOL. 8, NO. 1, 1982 95

dicate that increasing the intensi- As a possible protection against sive levels of arousal (Spohn et al.
ty of schizophrenics' social inter- such an overload, acute schizo- 1977). It may be, therefore, that
actions may result in a decrement phrenics tend to adopt a perceptu- medicated patients can, as noted
in their psychological functioning. al style which reduces the per- above, tolerate social interaction
An experiment by Hunter (1960) ceived intensity of stimuli somewhat longer than nonmed-
demonstrated that the level of task (Schooler et al. 1976). Chronic

Downloaded from http://schizophreniabulletin.oxfordjournals.org/ by guest on September 16, 2016


icated patients.
performance of chronic schizo- schizophrenics, who reduce the Schizophrenics differ not only in
phrenics decreases as a function of perceived intensity of stimuli less the level but also in the pattern of
their interdependence with their than do acutes, may protect them- their arousal. The schizophrenic's
task partners. Johannsen (1961) selves from cognitive overload by arousal pattern shows less specific
showed that schizophrenics per- reducing their social contacts fur- responses to environmental de-
form at a significantly lower level ther. mands (Zahn, Carpenter, and
with social than with nonsodal re- There are also noncognitive rea- McGlashan 1981), and even among
inforcement. Schooler and Spohn sons why schizophrenics may be schizophrenics specific responses
(1960b) found that experimentally negatively affected by social inter- are linked to better performance.
increasing group pressure disrupts action. Besides being a cognitively Being in a social situation may af-
the performance of chronic pa- complex object, another person is fect the schizophrenics' ability to
tients more than it does that of also likely to be a source or target fit their responses to the
normal controls. of emotion. Schizophrenics may situational requirements. Experi-
Examining schizophrenics' ad- have particular difficulties in giv- mental evidence suggests that "the
justment in the community, ing or receiving positive or nega- social nature of the situation can
Vaughn and Leff (1976), tive emotion (Fromm-Reichmann affect the direction of the relation-
replicating an earlier study by 1950; Schooler 1963). Nor can psy- ship between arousal and per-
Brown, Birley, and Wing (1972), chodynamic explanations not re- formance" (Schooler and Zahn
found that contact with a relative lated to emotional difficulties be 1968, p. 400).
who expresses a high degree of emo- ruled out. Thus it is possible, as A cursory examination of the
tion is significantly associated with Fromm-Reichmann (1952) has sug- reference list for the present article
a high relapse rate of schizophren- gested, that interpersonal "close- quickly reveals that most of the
ics. Furthermore, although main- ness increases the schizophrenic's studies specifically directed at ex-
tenance therapy with pheno- ever-existing fear of . . . losing his amining the schizophrenic's social
thiazines partially ameliorates the identity, of losing the sense of the functioning are not particularly
negative effect of extensive contact boundaries between himself and new. Perhaps in part because of
with an emotionally expressive rel- the outside world" (p. 105). the search for an underlying bio-
ative, the negative effects of such In any case, the evidence is pre- chemical cause and the apparent
interpersonal contact are also seen ponderantly in the direction of efficacy of the psychotherapeutic
among patients receiving these higher autonomic arousal for drugs, there have been few recent
drugs. schizophrenics (Zahn, Carpenter, studies concerned with either the
The reasons for the deleterious and McGlashan 1981) and the causes or the therapeutic implica-
effects of social interaction on added arousal coming, for whatev- tions of the schizophrenic's social
schizophrenics remain in question. er reason, from interpersonal in- dysfunction.
Given the present state of our teraction may be dysfunctional. Findings from -a recent study by
knowledge, many plausible and The possibility that highly aroused N.R. Schooler et al. (1979) should
not necessarily contradictory patients may therefore avoid social serve to revive concern with these
hypotheses can be put forth. The contact is suggested by Venables problems. In their study of the
problem may be primarily a cogni- and Wing's (1962) finding that for comparative effectiveness of
tive one. Social interactions are all but coherent deluded schizo- injectable depot fluphenazine
generally cognitively complex. phrenics, withdrawal is highly re- decanoate or oral fluphenazine hy-
Hemsley (1977), among others, has lated to arousal. Moreover, in drochloride, 28 percent of the pa-
argued that schizophrenics may be chronic schizophrenics pheno- tients relapsed within their first
in a state of information overload. thiazines somewhat reduce exces- year of community treatment.
96 SCHIZOPHRENIA BULLETIN

Contrary to the original hypothe- The development of successful IL: University of Chicago Press,
sis, there were no significant dif- treatment programs for schizo- 1950.
ferences between the two treat- phrenia may hinge upon our Fromm-Reichmann, F. Some as-
ments, thus ruling out the widely learning more about the nature of pects of psychoanalytic psycho-
held belief that phenothiazine this social dysfunction. therapy with schizophrenics. In;
treatment failures are primarily Brody, E.B., and Redlich, F.C.

Downloaded from http://schizophreniabulletin.oxfordjournals.org/ by guest on September 16, 2016


due to patient noncompliance in Psychotherapy With Schizophrenics.
taking their oral medication. In- References New York: International Universi-
stead the evidence suggests that
ty Press, Inc., 1952. pp. 89-111.
phenothiazines by themselves do Becker, W.C. A genetic approach
not necessarily permit schizo- Gittelman-Klein, R., and Klein,
to the interpretation and evalua- D.F. Premorbid asocial adjustment
phrenics to function at a level tion of the process-reactive dis-
which will permit them to stay in and prognosis of schizophrenia.
tinction in schizophrenia, journal journal of Psychiatric Research,
the community.
of Abnormal and Social Psychology, 7:35-53, 1969.
Even more pertinent to the re- 53:229-236, 1956.
sults of our socioenvironmental Goldberg, S.C.; Schooler, N.R.;
Blalock, H.M., Jr. Social Statistics. Hogarty, G.E.; and Roper, M. Pre-
treatment study is the finding that
2nd ed. New York: McGraw-Hill, diction of relapse in schizophrenic
the symptoms of emotional with-
1972. outpatients treated by drug and
drawal and blunted affect were ac-
tually more prevalent among Brown, G.W.; Birley, J.L.T.; and sociotherapy. Archives of General
nonrelapsed patients at the end of Wing, J.K. Influence of family life Psychiatry, 34:171-184, 1977.
the 1-year community mainte- on the course of schizophrenic dis- Goodrich, D.W. Quantification of
nance phase than they were in the orders: A replication. British jour- the severity of overt psychotic
beginning, although the preva- nal of Psychiatry, 121:241-258, 1972. symptoms. American Journal of
lence of all other symptoms had Cohen, J. Partialed products are Psychiatry, 110:334-341, 1953.
decreased. Thus it would appear interactions; Partialed powers are Hamilton, M.; Smith, A.L.G.;
that some level of social withdraw- curve components. Psychological
al and noninvolvement is func- Lapidus, H.E.; and Cadogan, E.P.
Bulletin, 85:858-866, 1978. A controlled trial of thiopropazate
tional for the schizophrenics' ad-
Cohen, J., and Cohen, P. Applied hydrochloride (Dartalen),
justment to their social
Multiple Regression Correlation Anal- chlorpromazine and occupational
environment. It should be remem-
ysis for the Behavioral Sciences. therapy in chronic schizophrenics.
bered that in our study not only
Hillsdale, NJ: Laurence Erlbaum jour)ial of Mental Science,
did psychotherapeutic medication
Associates, 1978. 106:40-55, 1960.
increase level of psychological
functioning, it also decreased social Fairweather, G.; Simon, R.; Heise, D.R. Causal Analysis. New
behavior. We are, however, left Gebhard, M.; Weingarten, E.; Hol- York: John Wiley & Sons, Inc.,
with a difficult conundrum. On land, J.; Sanders, R.; Stone, G.; 1975.
the one hand, the N.R. Schooler et and Reahl, J. Relative effectiveness
Hemsley, D.R. What have cogni-
al. study demonstrates that medi- of psychotherapeutic programs.
tive effects to do with schizo-
cation by itself is not sufficient to Psychological Monographs, 74:492,
phrenic symptoms? British journal
keep many schizophrenics ad- 1960.
of Psychiatry, 130:167-173, 1977.
justed at a level acceptable to the Freedman, N.; Engelhardt, D.M.;
community. On the other hand, Hemsley, D.R. Limitations of op-
Hankoff, L.D.; Schwartz, S.; and erant procedures in the modifica-
socially based attempts at improv- Zobel, H. Patterns of verbal group
ing the schizophrenics' adjustment tion of schizophrenic functioning:
participation in the drug treatment The possible relevance of studies
seem to founder on the schizo- of chronic schizophrenic patients.
phrenics' apparent need to avoid of cognitive disturbance. Behavior
International journal of Group Psy- Analysis and Modification,
social interaction and apparent chotherapy, 11:60, 1961.
disturbance in psychological func- 2:165-193, 1978.
Fromm-Reichmann, F. Principles of
tioning when they cannot do so.
Intensive Psychotherapy. Chicago,
VOL. 8, NO. 1, 1982 97

Hunter, M. "The Effects of Maruyama, G., and McGarvey, B. ments. Journal of Abnormal and So-
Interpersonal Interaction Upon the Evaluating causal models: An ap- cial Psychology, 61:348-354, 1960b.
Task Performance of Chronic plication of maximum-likelihood Schooler, C , and Zahn, T.P. The
Schizophrenics." Unpublished analysis of structural equations. effect of closeness of social
Ph.D. dissertation, Columbia Uni- Psychological Bulletin, 87:502-512, interaction on task performance

Downloaded from http://schizophreniabulletin.oxfordjournals.org/ by guest on September 16, 2016


versity, 1960. 1980. and arousal in chronic schizophre-
Hunter, M.; Schooler, C ; and Paul, G.L.; Tobias, L.L.; and Hol- nia. Journal of Nervous and Mental
Spohn, H.E. The measurement of ly, B.L. Maintenance psychotropic Disease, 147:394-401, 1968.
characteristic patterns of ward be- drugs in the presence of active Schooler, N.R.; Levine, J.; Severe,
havior in chronic schizophrenics. treatment programs. A "triple- J.B.; Brauzer, B.; DiMascio, A.;
Journal of Consulting Psychology, blind" withdrawal study with Klerman, G.L. ; and Tuason, V.B.
26:69-73, 1962. long-term mental patients. Ar- Prevention of relapse in schizo-
Johannsen, W.J. Responsiveness chives of General Psychiatry, phrenia: An evaluation of
of chronic schizophrenics and nor- 27:106-115, 1972. fluphenazine decanoate. Archives
mals to social and nonsocial feed- Schooler, C. Affiliation among of General Psychiatry, 37:16-24,
back, journal of Abnormal and Social schizophrenics: Preferred charac- 1979.
Psychology, 62:106-113, 1961. teristics of the other, journal of Solomon, L., and Spohn, H.E. A
Jdreskog, K.G. A general method Nervous and Mental Disease, method for the systematic analysis
for estimating .a linear structural 135:438-446, 1963. of social interaction on a ward of
equation system. In: Goldberger, Schooler, C. The application of chronic schizophrenics. American
A.S., and Duncan, O.D., eds. confirmatory factor analysis to lon- Psychological Association, 1958.
Structural Equation Models in the So- gitudinal data. In: Ricks, D., and Spohn, H.E.; Lacoursier, R.B.;
cial Sciences. New York: Seminar Dohrenwend, B., eds. Origins of Thompson, K.; and Coyne, L.
Press, 1973. pp. 85-112. Psychopathology: Research and Public Phenothiazine effects on psycho-
Joreskog, K.G., and van Thillo, M. Policy. Cambridge, MA: logical and psychophysiological
LISREL: A general computer pro- Cambridge University Press, in dysfunction in chronic schizophre-
gram for estimating a linear struc- press. nia. Archives of General Psychiatry,
tural equation system involving Schooler, C ; Buchsbaum, M.S.; 34:633-644, 1977.
multiple indicators of unmeasured and Carpenter, W.T. Evoked re- Van Putten, T., and May, P.R.A.
variables. ETS Research Bulletin sponse and kinesthetic measures Milieu therapy of schizo-
72-56. Princeton, NJ: Educational of augmenting/reducing in schizo- phrenics. In: West, L.J., and Flinn,
Testing Service, 1972. phrenics: Replications and exten- D.F., eds. Treatment of Schizophren-
Kellam, S.G.; Goldberg, S.C.; sions. Journal of Nervous and Mental ia: Progress and Prospects. New
Schooler, N.R.; Berman, A.; and Disease, 163:221-231, 1976. York: Grune & Stratton, Inc.,
Shmelzer, J.L. Ward atmosphere Schooler, C , and Parkel, D. The 1976.
and outcome of treatment of acute overt behavior of chronic schizo- Vaughn, C , and Leff, J.P. The in-
schizophrenia. Journal of Psychiat- phrenics and its relationship to fluence of family and social factors
ric Research, 5:145-163, 1967. their internal status and personal on the course of psychiatric ill-
Kellam, S.G.; Shmelzer, J.L.; and history. Psychiatry, 29:67-77, 1966. ness. British Journal of Psychiatry,
Berman, A. Variation in the at- Schooler, C , and Spohn, H.E. So- 129:125-137, 1976.
mosphere of psychiatric wards. cial interaction on a ward of chron- Venables, P.H., and Wing, J.K.
Archives of General Psychiatry, ic schizophrenics. The International Level of arousal and the
14:561-570, 1966. Journal of Social Psychiatry, subclassification of schizophrenia.
Lawley, D.N., and Maxwell, H.E. 6:115-119, 1960a. Archives of General Psychiatry,
Factor Analysis as a Statistical Meth- Schooler, C , and Spohn, H.E. The 7:114-121, 1962.
od. New York: Elsevier Publishing susceptibility of chronic schizo- Wilensky, H., and Solomon, L.
Company, 1971. phrenics to social influence in the The characteristics of untestable
formation of perceptual judg-
98 SCHIZOPHRENIA BULLETIN

chronic schizophrenic patients. and Harold Wilensky concep- posite implementation of the pro-
Journal of Abnormal and Social Psy- tualized, developed, and imple- gram over a period of several
chology, 61:155-158, 1960. mented the socioenvironmental years. We would like to extend a
Wing, J.K. Impairments in schizo- treatment program, and devised very special thanks to Barbara
phrenia: A rational basis for social its evaluation design and measure- Miller for her instrumental role in
ment. We would also like to thank carrying out the statistical analy-

Downloaded from http://schizophreniabulletin.oxfordjournals.org/ by guest on September 16, 2016


treatment. In: Wirt, R.D.;
Winokur, G.; and Roff, M., eds. Nina Schooler for directing our in- ses. In addition, we are also grate-
Life History Research in Psychopa- terest back to these data and for ful to Ronald Schoenberg for his
thology. Minneapolis, MN: Uni- her substantial help in preparing important advice on the use of
versity of Minnesota Press, 1975. this report. MILS, an advanced version of
pp. 236-269. Grateful acknowledgment for LISREL, and Jacob Cohen for his
their roles in the implementation statistical consultation both 20
Zahn, T.P.; Carpenter, W.T.; and of the socioenvironmental treat- years ago and now.
McGlashan, T.H. Autonomic nerv- ment program is due to a large
ous system activity in acute schiz- number of individuals. Unfor-
ophrenia: Parts I and II. Archives of tunately, not all of them can be The Authors
General Psychiatry, 38:251-270,
mentioned here. Without the sup-
1981.
port of Dr. Oscar Diethelm, Dr. Carmi Schooler, Ph.D., is Re-
Leon Rackow, and Dr. Seymour search Psychologist, Laboratory of
Acknowledgment Klebanoff, this program could not Socioenvironmental Studies, Na-
have been implemented. Also, tional Institute of Mental Health,
Herbert E. Spohn, in collaboration special recognition should be ac- Bethesda, MD. Herbert E. Spohn,
with Carmi Schooler, Richard corded to Dr. Alvin Bernstein Ph.D., is Director, Research De-
Blumental, Marvin Hunter, who, as ward director of the pro- partment, The Menninger Founda-
Edward Klein, Leonard Soloman, gram, was able to sustain the ap- tion, Topeka, KS.

Vous aimerez peut-être aussi