Académique Documents
Professionnel Documents
Culture Documents
Review article
art ic l e i nf o
a b s t r a c t
Article history:
Received 12 January 2016
Received in revised form
17 February 2016
Accepted 7 March 2016
Available online 24 March 2016
An increasing number of computerised transdiagnostic cognitive behavioural therapy programs (TDcCBT) have been developed in the past decade, but there are no meta-analyses to explore the efcacy of
these programs, nor moderators of the effects. The current meta-analysis focused on studies evaluating
TD-cCBT interventions to examine their effects on anxiety, depression and quality of life (QOL). Results
from 17 RCTs showed computerised TD-cCBT outperformed control conditions on all outcome measures
at post-treatment, with large effect sizes for depression (g's .84), and medium effect sizes for anxiety
(g .78) and QOL (g .48). RCT quality was generally good, although heterogeneity was moderate to high.
Further analyses revealed that studies comparing TD-cCBT to waitlist controls had the largest differences
(g .93) compared to active (g .59) and usual care control groups (g .37) on anxiety outcomes, but
there was no inuence of control group subtype on depression outcomes. Treatment length, symptom
target (mixed versus anxiety only), treatment design (standardised versus tailored), and therapist
experience (students versus qualied therapists) did not inuence the results. Preliminary evidence
from 4 comparisons with disorder-specic treatments suggests transdiagnostic treatments are as effective for reducing anxiety, and there may be small but superior outcomes for TD-cCBT programs for
reducing depression (g .21) and improving QOL (g .21) compared to disorder-specic cCBT. These
ndings show that TD-cCBT programs are efcacious, and have comparable effects to disorder-specic
cCBT programs.
& 2016 Elsevier B.V. All rights reserved.
Keywords:
Transdiagnostic, Cognitive Behaviour Therapy (CBT), depression, anxiety, computer,
internettreatment outcome
Meta-analysis
Systematic review
Depression
Anxiety
Transdiagnostic
Contents
1.
2.
3.
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
1.1.
Aim/objectives . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31
Methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
2.1.
Protocol and registration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
2.2.
Inclusion/Eligibility criteria (PICOS) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
2.3.
Excluded studies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
2.4.
Identication and selection of studies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
2.5.
Study selection. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
2.6.
Data extraction and management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
2.7.
Primary and secondary outcomes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
2.7.1.
Primary outcomes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
2.7.2.
Secondary outcomes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
2.7.3.
Follow-up . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
2.8.
Risk of bias in individual studies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Statistical analyses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
3.1.
Calculation of effect sizes: TD-cCBT versus controls . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
3.2.
Testing homogeneity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Corresponding author.
E-mail address: j.newby@unsw.edu.au (J.M. Newby).
http://dx.doi.org/10.1016/j.jad.2016.03.018
0165-0327/& 2016 Elsevier B.V. All rights reserved.
31
3.2.1.
Subgroup analyses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Risk of bias across studies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
3.3.1.
Testing for publication bias and dealing with publication bias . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
4. Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
4.1.
Study selection. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
4.2.
Study characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
4.3.
Risk of bias in randomised controlled trials . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
4.4.
Synthesis of results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
4.4.1.
Between-group effects of TD-cCBT versus control groups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
4.4.2.
Comparisons between TD-cCBT versus controls on secondary outcome measures (generalised anxiety, social anxiety and panic
disorder severity). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
4.4.3.
Comparisons between TD-cCBT versus disorder-specic treatments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
4.5.
Subgroup analyses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
4.5.1.
Tailored versus standardised . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
4.5.2.
Treatment modules (less than 6 modules [short] versus 6 or more [long]) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
4.5.3.
Treatment target (anxiety only versus anxiety and depression) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
4.5.4.
Control type (waitlist control, usual care, active control) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
4.5.5.
Clinical prole (clinical versus non-clinical) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
4.5.6.
Therapist experience level. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
4.6.
Publication bias . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
5. Discussion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
5.1.
Limitations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
5.2.
Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
Appendix A. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
3.3.
1. Introduction
Depression and anxiety disorders represent two of the top ve
leading causes of disability worldwide (Vos et al., 2015). These
disorders have high comorbidity rates, share many similar symptoms, features, latent structure, and vulnerability factors (Goldberg
et al., 2009; Watson, 2005). Cognitive Behavioural Therapy (CBT) is
currently recommended as the rst-line treatment for depressive
and anxiety disorders, as a stand-alone intervention for mild to
moderate cases, or in combination with pharmacological treatments for more complex cases and those with comorbidities
(Pilling et al., 2011). While the majority of CBT manuals and
treatment evaluations have been diagnosis-driven (i.e., designed
to target specic disorders), transdiagnostic CBT protocols have
also been shown to be effective (Norton and Philipp, 2008).
Transdiagnostic CBT interventions bring together the core components of CBT, such as psychoeducation, skills practice (e.g., cognitive
challenging, graded exposure, activity planning) and relapse prevention, with the aim of targeting shared cognitive, emotional and behavioural maintaining factors cutting across diagnostic categories
(McEvoy et al., 2009). Rather than delivering separate programs for
separate diagnoses, transdiagnostic CBT interventions focus on commonalities across disorders and address heterogeneous emotional
disorders and comorbidities within the one treatment protocol. There
are several practical advantages of the transdiagnostic approach including increased efciency, and ease of implementation. Although the
majority of studies of transdiagnostic interventions report the efcacy
of face-to-face treatments (e.g., Barlow et al., 2004 and see; Newby
et al. (2015) for a review), there is now a substantive literature reporting positive effects of transdiagnostic CBT programs delivered via
the computer or internet. There have been a wide variety of TD-cCBT
programs that have now been shown to be effective, including standardised programs for mixed anxiety disorders (Johnston et al., 2013),
and anxiety and depression (Newby et al., 2013; Titov et al., 2011), as
well as modularised and tailored treatment packages (Carlbring et al.,
2011; Nordgren et al., 2014).
Computerised CBT has several benets compared to face-to-face
treatment, including high treatment delity, increased convenience,
reduced cost, and scalability. Computerised interventions essentially
deliver CBT 101; the core components of CBT including psychoeducation, cognitive (e.g., thought monitoring, cognitive restructuring) and
behavioural therapy (e.g., behavioural activation and graded exposure)
components within a series of modules/lessons, supplemented by
additional homework assignments to consolidate the learning of key
concepts. Clinician guidance is typically provided in the form of email
or telephone contact throughout the intervention period.
To our knowledge there are no existing systematic reviews or
meta-analyses solely focused on transdiagnostic computerised CBT
interventions (TD-cCBT). In the only meta-analysis to include TD-cCBT
with face-to-face protocols, Newby et al. (2015) found that the
pooled within-group effect sizes pre-to-post treatment reductions in
depression and anxiety symptoms were large for TD-cCBT, and
similar to the effect sizes pooled across individual face-to-face transdiagnostic interventions. However, the study by Newby et al. (2015)
was focused on a broad array of transdiagnostic treatment approaches
including CBT and other psychotherapies (e.g., mindfulness-based interventions), and did not examine the overall efcacy of TD-cCBT
programs.
There have been no meta-analytic reviews to explore the overall
efcacy of computerised TD-cCBT interventions versus control
groups, including disorder-specic CBT control interventions. Individual RCTs have generally failed to nd a signicant difference
between computerised TD-cCBT versus disorder-specic CBT interventions (e.g., Berger et al., 2014; Dear et al., 2015). However, is
unclear whether these ndings are due to a lack of power, or lack of
difference between the two approaches. Combining the results
across individual RCTs using meta-analytic techniques will result in
greater power to explore this question. It is also unknown what
features, components and aspects of the program render these TDcCBT programs efcacious. The existing programs differ in their
targeted conditions (e.g., mixed anxiety disorders versus anxiety
and depression), the length, whether they are self-or clinicianguided, and the level of therapist expertise and training.
1.1. Aim/objectives
The overall aim of this study was to conduct a systematic review and meta-analysis of RCTs of computerised TD-cCBT. Our
32
2. Methods
2.1. Protocol and registration
This systematic review was conducted in accordance with the
PRISMA guidelines (Moher et al., 2009), and the review protocol
was developed following the procedures outlined in the Cochrane
Handbook for systematic reviews (Higgins and Green, 2011). The
protocol was registered with PROSPERO1 [CRD42015023744].
2.2. Inclusion/Eligibility criteria (PICOS)
http://www.crd.york.ac.uk/PROSPERO/index.asp
anxiety), qualication level of clinicians, tailored/standardised intervention, self-report symptom severity (depression, generalised
anxiety, social anxiety, panic disorder, quality of life), adherence,
adverse events. For multiple reports of the same study, we combined the outcome measures and considered them as one study.
2.7. Primary and secondary outcomes
2.7.1. Primary outcomes
Self-reported symptoms of depression, anxiety and functional impairment/quality of life according to continuous outcome measures.
2.7.2. Secondary outcomes
(i) Self-reported generalised anxiety, social anxiety and panic
disorder severity, according to continuous symptom measures.
(ii) Adherence (proportion of participants who complete the
treatment).
(iii) Adverse reactions (patients with worsening, or other negative effects during the intervention or control period).
2.7.3. Follow-up
We analysed data comparing TD-cCBT to control groups at posttreatment. We extracted and analysed outcome data on primary
and secondary outcomes at post-treatment. There was not enough
information reported in the studies to analyse diagnostic status
following treatment, nor follow-up comparisons. Because many of
the studies used more than one instrument to measure depression
or anxiety, we used the primary outcome as reported by the study
investigators, or if absent, we used the most frequently used measures across studies (e.g., BDI, PHQ-9, DASS-21 depression subscale).
All included studies reported means and standard deviations at
post-intervention, allowing us to calculate the effect size directly.
2.8. Risk of bias in individual studies
We assessed the quality and risk of bias of included trials using the
Risk of Bias tool, developed by the Cochrane Collaboration (Higgins
and Green, 2011). This tool allowed us to assess possible sources of risk
in RCTs, including: (1) allocation sequence, (2) allocation concealment,
(3) blinding of participants, personnel and outcome assessors, (4) incomplete outcome data, and (5) selective reporting. The assessment of
study quality was conducted by two independent reviewers (JN and an
independent research assistant) and disagreements were resolved via
discussion. See Table 1 for quality ratings of included controlled trials.
3. Statistical analyses
3.1. Calculation of effect sizes: TD-cCBT versus controls
For each comparison between TD-cCBT and a control condition, we
calculated the effect size (Hedges g) referring to the difference between the two groups at post-treatment (standardised mean difference) and the 95% condence intervals around the effect sizes. Effect
sizes were calculated by subtracting the average score of the transdiagnostic treatment at post-treatment from the average score for the
control group, and dividing the result by the pooled standard deviation of the two groups. Effect sizes of .2, .5 and .8 refer to small,
moderate and large effect sizes respectively (Cohen, 1988). Effect sizes
were also adjusted to address small sample sizes, according to the
procedures outlined in Hedges and Olin (1985, or Hedges g).
To calculate pooled mean effect sizes, we used the program
Comprehensive Meta-Analysis (version 3.0, Biostat Inc.). Given
there is variability across the interventions, we calculated the mean
effect sizes using a random effects model. The random effects model
assumes that the true effect size varies from one study to the next,
33
2
These studies were not included in the calculation of effect sizes comparing
transdiagnostic treatments versus control groups, as they did not fall within the
control group categories that were the focus of this review.
34
Table 1
Study characteristics of randomised controlled trials evaluating computerised transdiagnostic cognitive behavioural therapy.
Study
Country
Sample
Clinical
Mean age N
Transdiagnostic
treatment target
Switzerland,
Germany,
Austria
Clinical
35
Anx
Carlbring
et al.,
2011
Day et al.,
2013
Sweden
DSM-IV anxiety
disorder (including
ADNOS)
University students
with elevated depression, anxiety or
stress
Older adults (60 )
with anxiety
symptoms
DSM-IV
GAD comorbid
disorders
MDD comorbid
symptoms
Clinical
39
iCBT: 27 Online
forum: 27
Anx
Nonclinical
23
TD-iCBT: 33,
WLC: 33
Dep/Anx
Nonclinical
65
TD-iCBT: 33,
WLC: 37
Anx
Clinical
44
Clinical
45
Canada
Dear et al.,
2015 #1
Australia
Dear et al.,
2015 #2
Australia
Johansson
et al.,
2012
Sweden
Johnston
et al.,
2011
Australia
Clinical
42
Marks
et al.,
2004
Mullin
et al.,
2015
United
Kingdom
ICD-10 Phobia or
Panic/Ag
Clinical
38
Australia
University students
with anxiety and
depression
symptoms
GAD/MDD
Nonclinical
Newby
et al.,
2013
Nordgren
et al.,
2014
Australia
Delivery
format
Number
modules
Therapist
Outcome
measures
10
MADRS-S,
BAI, QOLI
5 core 6
optional
Graduate or undergraduate
student
DASS-D,
DASS-A
Internet
Masters/doctoral
level psychologist
Internet
Masters/doctoral
level psychologist
BDI-II, BAI,
QOLI
WLC
DS-iCBT
(for GAD)
810
10
Masters level
psychologists
Internet
10
TD-CBT
(f2f), RT
Computer
10
Dep/Anx
WLC
Internet
Dep/Anx
WLC
Internet
6
Phase 1:
3, Phase
2/3: 6,
Phase 4: 5
6
10
Anx
27
TD-iCBT: 30
WLC: 23
Clinical
44
TD-iCBT: 46,
WLC: 53
Sweden
DSM-IV principal
anxiety disorder
Clinical
35
TAU
Internet
710
Proudfoot
et al.,
2004
United
Kingdom
Clinical
44
TD-CCBT: 146
TAU: 128
TAU
Computer
Schneider
et al.,
2005
United
Kingdom
ICD-10 depression,
mixed anxiety/depression or anxiety
disorder
ICD-10 agoraphobia
(with or without
panic disorder), social or specic
phobia
Clinical
39
Anx
TD-CCBT (with
exposure): 45,
TD-CCBT (without exposure): 12
CCBT without
exposure
Computer
Dep/Anx
Internet
WLC
WLC
610
Anx
BAI, BDI-II,
Internet
DS-iCBT
(for MDD),
Online
Forum
a
Master of Science
students and
psychologist
Dep/Anx
Quality ratings
Internet
DS-iCBT
(for the
primary
disorder),
WLC
Online
Forum
Number
weeks
10
10
Provisionally registered
psychologist
Doctoral level
psychologist
Masters students
supervised by licensed clinical
psychologists
Nurse
BDI-II, BAI,
WSAS
FQ-total
phobia, FQ
depression,
WSAS
Psychiatrists
Berger
et al.,
2014
Control
35
the sample characteristics, the majority of trials (n 14) included participants with
clinical levels of symptoms who met diagnostic criteria for either ICD or DSM diagnoses according to structured diagnostic interview.
A wide range of outcome measures were used to assess self-reported anxiety
and depressive symptoms and quality of life, with the most common the PHQ-9
and BDI-II for depression and the GAD-7 and BAI for anxiety. Of the 17 trials, three
did not include quality of life assessment measures. There were only two studies
that reported outcomes for both the TD-cCBT group and control group at follow-up
(one at 3-months, and the second at 6-month follow-up). The remaining studies
generally reported outcomes for the TD-cCBT groups at either short- or long-term
follow-up, but the control group went on to receive treatment during the follow-up
period.
Adherence rates ranged between 43% and 90%, although the denition used to
dene adherence or program completion varied across studies. Some used the
denition of having completed all modules, whereas others used the denition of
having completed more than 75% of the modules. No studies specically reported
on adverse events or unwanted negative side effects attributed to the program.
However, of the four studies which reported information about symptom deterioration, one study found no evidence of clinically reliable deterioration, two
studies found under ve percent of the TD-cCBT participants evidenced reliable
deterioration, and the nal study found that 7.5% of the TD-cCBT group experienced
increases in GAD-7 or PHQ-9 scores by more than 5 points at post-treatment
(compared to 13.7% of the WLC group).
4.3. Risk of bias in randomised controlled trials
The methodological quality of studies varied, but was generally of good quality
(see Table 1). All studies (100%) reported adequate generation of random sequencing,
16 (94%) reported adequately concealing group allocation, and 5 (24%) reported
appropriate blinding of outcome assessments (double blinding is very difcult and
with internet delivered treatment delivered to people in remote locations, single
blinding even more difcult). All studies (100%) appropriately managed incomplete
outcome data by including intention to treat analyses, and 16 studies (94%) were
found to have low risk of bias for selective reporting of outcomes. Overall, only four
studies were classied by reviewers as at low risk of bias on all ve measures of risk
of bias, although 12 were coded as low risk of bias on four measures.
Titov et al. (2013) was combined with Titov et al. (2014) which reported the 12-month follow-up data.
Note: Programs/Control Groups: TD-CCBT transdiagnostic computerised cognitive behavioural therapy; DS-iCBT disorder-specic internet-delivered cognitive behavioural therapy, TD-iCBT transdiagnostic internet-delivered
cognitive behavioural therapy, iCBT internet-delivered cognitive behavioural therapy, iCBT (CO) internet cognitive behavioural therapy with coach guidance, iCBT (CL) internet cognitive behavioural therapy with clinician
guidance, TAUtreatment as usual, WLC waiting list control. SG self-guided, AE automatic emails, RT relaxation training, WLC waiting list control. Diagnoses: ADNOS Anxiety Disorder not Otherwise Specied. anxiety
disorder, MADD mixed anxiety and depressive disorder, MDD major depressive disorder, OCD obsessive compulsive disorder, Panic/Ag panic disorder and/or agoraphobia, PTSD posttraumatic stress disorder, SocPhob social phobia or social anxiety disorder. Depression Outcome measures: BDI-II Beck Depression Inventory, DASS-D Depression Anxiety Stress Scale Depression subscale, PHQ-9 Patient Health Questionnaire-9,
MADRS-S: Montgomery-Asberg Depression Rating Scale self rated version. Anxiety outcome measures: BAI Beck Anxiety Inventory, FQ Fear Questionnaire; GAD-7 Generalised Anxiety Disorder 7, DASS-A Depression
Anxiety Stress Scale - Anxiety subscale. Quality of life/functional impairment outcome measures: SDS Sheehan Disability Scale; WSAS: Work and Social Adjustment Scale; QOLI: Quality of Life Inventory; WHODAS-II: World
Health Organisation Disability Assessment Schedule. Quality ratings a allocation sequence adequately generated, b allocation adequately concealed, c blinding of outcome assessment, d incompletely data adequately
addressed, eselective reporting. low risk (included information protecting against bias); high risk (did not protect against source of bias), ? unclear risk.
Masters/doctoral
level psychologist
8
Internet
44
Clinical
Australia
Titov et al.,
2015
Dep/Anx
DS-iCBT
(for MDD)
8
Internet
41
NonClinical
Anx/Dep
TD-ICBT(AE):
100, TD-ICBT (no
AE): 106, WLC, 51
WLC
10
Internet
Anx
TD-iCBT: 37
WLC: 38
Australia
Titov et al.,
2011
44
WLC
PHQ-9, GAD7,
Internet
Dep/Anx
TD-iCBT: 40
WLC: 38
39
WLC
10
36
4.5.2. Treatment modules (less than 6 modules [short] versus 6 or more [long])
To explore whether the number of modules made a difference, we coded each
study into less than 6 modules or 6 or more modules. There were no signicant
differences in the effect sizes for anxiety (short: n 4, g1.08, 95% CI:.491.66; long:
n 10, g.67, 95% CI:..49.85) (Q*bet 1.71, df1, p .19) nor depression (short: n 4,
g1.17, 95% CI:.531.71; long: n9, g.74, 95% CI:.61.87) (Q*bet 1.49, df1, p .22).
4.5.3. Treatment target (anxiety only versus anxiety and depression)
In the next subgroup analysis, we compared the mean controlled effect size for
sub-groups based on treatment target. There were no statistically signicant differences in the controlled effect size obtained for anxiety outcomes between
TDcCBT interventions targeting anxiety only (n 7, g .94, 95% CI:.591.29) or depression and anxiety (n 7, g .63, 95% CI:.42.84) (Q*bet 2.21, df 1, p .14), or on
depression outcomes (anxiety only: n 6, g 1.02, 95% CI:.651.38; depression and
anxiety: n 7, g .72, 95% CI:.57.86) (Q*bet 2.24, df 1, p .14).
Study name
Comparison
Outcome
37
TD-ICBT vs WLC
TD-ICBT vs DF
TD-ICBT vs WLC
TD-ICBT vs WLC
TD-ICBT vs DF
TD-ICBT vs WLC
TD-CCBT vs RT
TD-ICBT vs WLC
TD-ICBT vs WLC
TD-ICBT vs TAU
TD-CCBT vs TAU
TD-ICBT vs WLC
TD-ICBT vs WLC
TD-ICBT vs WLC
Anxiety
Anxiety
Anxiety
Anxiety
Anxiety
Anxiety
Anxiety
Anxiety
Anxiety
Anxiety
Anxiety
Anxiety
Anxiety
Anxiety
0.802
0.765
0.603
2.132
0.452
1.079
0.642
0.839
0.844
0.555
0.261
0.768
0.690
0.816
0.779
0.371
0.220
0.115
1.548
0.005
0.691
-0.018
0.280
0.434
0.158
0.001
0.312
0.226
0.503
0.573
1.233
1.310
1.090
2.715
0.898
1.466
1.301
1.397
1.253
0.951
0.520
1.224
1.155
1.130
0.985
-2.00
-1.00
Favours Control
0.00
1.00
2.00
Favours Transdiagnostic
Fig. 2. Forest plot of controlled between-group effect sizes for comparisons between transdiagnostic computerised cognitive behavioural therapy and control groups on selfreported anxiety.
Study name
Comparison
Outcome
TD-ICBT vs WLC
TD-ICBT vs DF
TD-ICBT vs WLC
TD-ICBT vs WLC
TD-ICBT vs DF
TD-ICBT vs WLC
TD-ICBT vs WLC
TD-ICBT vs WLC
TD-ICBT vs TAU
TD-CCBT vs TAU
TD-ICBT vs WLC
TD-ICBT vs WLC
TD-ICBT vs WLC
Depression
Depression
Depression
Depression
Depression
Depression
Depression
Depression
Depression
Depression
Depression
Depression
Depression
0.873
0.774
0.957
2.174
0.847
0.790
0.602
0.739
0.929
0.642
0.479
0.732
0.820
0.841
0.439
0.228
0.453
1.587
0.387
0.413
0.055
0.333
0.519
0.384
0.033
0.266
0.506
0.668
1.306
1.319
1.461
2.762
1.308
1.168
1.149
1.144
1.339
0.901
0.925
1.198
1.134
1.015
-2.00
-1.00
Favours Control
0.00
1.00
2.00
Favours Transdiagnostic
Fig. 3. Forest plot of controlled between-group effect sizes for comparisons between transdiagnostic computerised cognitive behavioural therapy and control groups on selfreported depression.
differences in the controlled effect size obtained for anxiety outcomes (Q*bet 1.71, df 1,
p .19; clinical: n 10, g .67, 95% CI:.49.85, non-clinical/mixed: n 4, g .1.08, 95%
CI:.491.66), nor depression outcomes (Q*bet 1.49, df 1, p .22; clinical: n9, g .74,
95% CI:.61.87, non-clinical/mixed: n 4, g .1.17, 95% CI:.521.71).
4.5.6. Therapist experience level
We conducted a subgroup analysis to compare the effects of studies where the
participants were supervised by qualied psychologists versus students. Of those
that reported both students and other psychologists were coded in the student
category. There were no differences for anxiety (Q*bet .51, df 1, p .47; psychologists: n 7, g .91, 95% CI:.561.25, students: n4, g .75, 95% CI:.501.00), or
depression outcomes (Q*bet .27, df 1, p .61; psychologists: n7, g .92, 95%
CI:.60.1.25, students: n 4, g .82, 95% CI:.571.07).
4.6. Publication bias
There was no evidence of risk of bias observed within the funnel plot, or when
conducting Duval and Tweedie's trim and ll procedure for anxiety, depression.
However there was evidence of risk of bias for the measure of quality of life, with
2 studies trimmed, and the adjusted point estimate of n 2 studies trimmed,
g .42, 95%CI:.29.56.
5. Discussion
The current study is the rst systematic review and meta-analysis of
the effects of computerised transdiagnostic CBT (TD-cCBT) interventions
in adults. This study examined the relative efcacy of computerised and
internet-delivered TD-cCBT programs compared to control conditions,
including how TD-cCBT programs perform relative to disorder-specic
programs. We identied 17 RCTs with a total of 2290 participants
evaluating these programs. The majority were designed to target mixed
38
Study name
Comparison
Outcome
TD-ICBT vs DF
TD-ICBT vs DF
TD-ICBT vs WLC
TD-CCBT vs RT
TD-ICBT vs WLC
TD-ICBT vs WLC
TD-ICBT vs TAU
TD-CCBT vs TAU
TD-ICBT vs WLC
TD-ICBT vs WLC
QOL
QOL
QOL
QOL
QOL
QOL
QOL
QOL
QOL
QOL
0.572
0.589
0.846
0.209
0.597
0.268
0.473
0.335
0.531
0.513
0.478
0.035
0.138
0.467
-0.436
0.050
-0.126
0.079
0.082
0.084
0.054
0.348
1.109
1.039
1.224
0.853
1.144
0.661
0.868
0.589
0.978
0.971
0.608
-2.00
-1.00
0.00
Favours Control
1.00
2.00
Favours Transdiagnostic
Fig. 4. Forest plot of controlled between-group effect sizes for comparisons between transdiagnostic computerised cognitive behavioural therapy and control groups on selfreported quality of life.
Fig. 5. Forest plot of controlled between-group effect sizes for comparisons between transdiagnostic computerised cognitive behavioural therapy and disorder-specic
cognitive behavioural therapy on self-reported anxiety.
Fig. 6. Forest plot of controlled between-group effect sizes for comparisons between transdiagnostic computerised cognitive behavioural therapy and disorder-specic
cognitive behavioural therapy on self-reported depression.
Study name
Comparison
Outcome
Lower
limit
Upper
limit
0.420
0.206
-0.007
0.214
-0.241
0.670
0.272
0.005
0.538
0.230
0.074
0.386
-2.00
-1.00
0.00
Favours Disorder-Specific
1.00
2.00
Favours Transdiagnostic
Fig. 7. Forest plot of controlled between-group effect sizes for comparisons between transdiagnostic computerised cognitive behavioural therapy and disorder-specic
cognitive behavioural therapy on self-reported quality of life.
anxiety disorders, were clinician-guided and targeted patients with diagnosed disorders. There were no RCTs of mobile phone applications.
The majority of trials compared transdiagnostic treatments to
WLC groups, but transdiagnostic treatments were also compared
to usual care, and online discussion forums. There were no comparisons between TD-cCBT with pharmacotherapies. Pooling the
results across RCTs demonstrated that TD-cCBT outperformed
control groups on depression (g .84), anxiety (g .78,) and quality of life (g .48), as well as the secondary outcome measures of
generalised anxiety severity (g.98), panic severity (g .65), and
social anxiety severity (g .58) at post-treatment. There were too
few studies with results for the TD-cCBT intervention and control
groups to synthesise the data at follow-up. The controlled effect
sizes corresponding to the differences between computerised TDcCBT and controls were moderate for anxiety, which is consistent
with previous ndings from meta-analyses of face to face CBT
programs (Reinholt and Krogh, 2014), and a more broad range of
transdiagnostic psychological interventions (Newby et al., 2015).
Evidence of reliable deterioration was relatively rare, although
only 4 studies reported any information about whether participants experienced symptom deterioration, and none reported on
adverse events. Heterogeneity was also moderate to high for all
outcome measures, suggesting there was signicant variability
amongst these effects. We also found some evidence of publication
bias for quality of life outcomes, which suggests these effect estimates may be inated, but only to a small degree.
A major aim of this study was to examine whether there were
any components or features of the transdiagnostic programs that
inuenced the efcacy of the programs, as this question has never
been studied. This was to attempt to clarify the reasons for the
heterogeneity and to account for the mixed ndings in the literature regarding the size of the effects observed across studies. When
we examined potential sources of heterogeneity, we could nd no
differences between tailored and standardised protocols, protocols
that targeted depression and anxiety versus mixed anxiety symptoms/disorders, studies that were short (less than 6 modules) versus long (6 or more modules or lessons), or programs that were
supervised by students versus qualied psychologists. It is possible
that the failure to nd differences between these subgroups was
due to a lack of power. With growing numbers of RCTs being conducted in the eld, we will be able to conduct a follow-up metaanalysis in future to examine this question, and other important
questions such as the impact of adherence on outcomes. The only
signicant nding that may account for the source of heterogeneity
was the control group used: studies that compared TD-cCBT to WLC
had the largest between-groups effect sizes compared to those
which used a usual care or active psychological treatment control
group for anxiety outcomes (but not depression).
Another aim of this study was to compare the efcacy of
transdiagnostic versus disorder-specic CBT interventions. Recent
studies by Titov and colleagues (Dear et al., 2015) have enabled us
to pool the effects across large scale studies to begin to examine
this issue. We found overall that there was minimal difference
between TD-CCBT and disorder-specic computerised CBT for anxiety outcomes, but there was a small but superior gain in TD-cCBT
protocols for depression and quality of life outcomes. Studies using
39
Appendix A
PsycINFO search terms
1 (Anxiety or Social Anxiety or Anxiety Disorder$ or Generali$ed Anxiety Disorder or Generali$ed Anxiety or Panic or Panic Attack$ or
Panic Disorder or Agoraphobia or Phobias or Acute Stress Disorder or Obsessive Compulsive Disorder or Phobia$ or Posttraumatic
40
Stress Disorder or Separation Anxiety or $phobia or Social Phobia or Social Anxiety Disorder or Affective Disorders or Mood Disorder
$ or Depression or Major Depression or Major Depressive Disorder or Dysthymic Disorder or Dysthym$ or Endogenous Depression or
Postpartum Depression or Reactive Depression or Treatment Resistant Depression or Atypical Depression or Recurrent Depression or
Mental Health or (Mixed anxiety and depression) or Depressive or Depressed or Panic or Phobic* or phobia or Obsessive compulsive
or Mood disorder* or compulsive hoarding or post-traumatic stress or anxiety disorder* or dysthymia or transdiagnostic or illness
anxiety or illness anxiety disorder or health anxiety or health anxiety disorder or hypochondria$ or tailor*).mp. [mp title, abstract,
heading word, table of contents, key concepts, original title, tests & measures]
2 (Online Therapy or Internet or Internet-delivered or Web-based or Web or Computer or Computer$ or Computer Application$ or
Computer Assisted Therapy or Computer Therapy or Computerized or Computerised or Online or Websites or e-mail or email or
technology-assisted or computer-based or Internet-based or mobile or smartphone or tablet).mp. or *phone/[mp title, abstract,
heading word, table of contents, key concepts, original title, tests & measures]
3 (Online Therapy or Psychotherapy or Psychotherapy or Behavior Therapy or Behaviour Therapy or Brief Psychotherapy or Cognitive
4Behavior Therapy or Cognitive Behaviour Therapy or Cognitive Behavio$ Therapy or Cognitive Behavioural Therapy or Cognitive
Behavioral Therapy or Unied Protocol or Emotion Focused or Experiential Psychotherapy or Expressive Psychotherapy or Eye
Movement Desensitization Therapy or Geriatric Psychotherapy or Group Psychotherapy or Individual Psychotherapy or Narrative
Therapy or Solution Focused Therapy or Supportive Psychotherapy or Cognitive Therapy or Dialectical Behaviour Therapy or Dialectical Behaviour Therapy or Exposure Therapy or Implosive Therapy or (Exposure and Response Prevention) or Systematic Desensiti$ation Therapy or Behavior Modication or Behaviour Modication or Counseling or Self Help or Self Help Techniques or CCBT
or minimal therapist support or guided self-help or supervised self-help or minimal contact therap* or clinician-guided or relaxation
or therapy).mp. [mp title, abstract, heading word, table of contents, key concepts, original title, tests & measures]
4 (Randomized Controlled Trial or Randomised Controlled Trial or controlled trial or randomi$ed or Randomized or randomization or
randomisation or randomly assigned or Controlled or trial or RCT).mp. [mp title, abstract, heading word, table of contents, key
concepts, original title, tests & measures]
5 1 and 2 and 3 and 4
References
Barlow, D.H., Allen, L.B., Choate, M.L., 2004. Toward a unied treatment for emotional disorders. Behav. Ther. 35 (2), 205230. http://dx.doi.org/10.1016/
S0005-7894(04)80036-4.
Berger, T., Boettcher, J., Caspar, F., 2014. Internet-based guided self-help for several
anxiety disorders: a randomized controlled trial comparing a tailored with a
standardized disorder-specic approach. Psychotherapy 51 (2), 207219. http:
//dx.doi.org/10.1037/a0032527.
Borenstein, M., Hedges, L.V., Higgins, J.P.T., Rothstein, H.R., 2009. Introduction to
Meta-Analysis. Wiley, Chicester, UK.
Borenstein, M., Higgins, J.T., 2013. Meta-analysis and subgroups. Prev. Sci. 14 (2),
134143. http://dx.doi.org/10.1007/s11121-013-0377-7.
Carlbring, P., Maurin, L., Torngren, C., Linna, E., Eriksson, T., Sparthan, E., et al., 2011.
Individually-tailored, Internet-based treatment for anxiety disorders: a randomized controlled trial. Behav. Res. Ther. 49 (1), 1824.
Cohen, J., 1988. Statistical power Analysis for Behavioral Sciences, 2nd ed. Erlbaum,
Hillsdale, NJ.
Day, V., Mcgrath, P.J., Wojtowicz, M., 2013. Internet-based guided self-help for
university students with anxiety, depression and stress: a randomized controlled clinical trial. Behav. Res. Ther. 51 (7), 344351.
Dear, B.F., Staples, L.G., Terides, M.D., Karin, E., Zou, J., Johnston, L., et al., 2015.
Transdiagnostic versus disorder-specic and clinician-guided versus self-guided internet-delivered treatment for generalized anxiety disorder and comorbid disorders: a randomized controlled trial. J. Anxiety Disord. 36, 6377.
http://dx.doi.org/10.1016/j.janxdis.2015.09.003.
Duval, S., Tweedie, R., 2000a. A nonparametric Trim and Fill method of accounting
for publication bias in meta-analysis. J. Am. Stat. Assoc. 95 (449), 8998. http:
//dx.doi.org/10.1080/01621459.2000.10473905.
Duval, S., Tweedie, R., 2000b. Trim and ll: a simple funnel-plot-based method of
testing and adjusting for publication bias in meta-analysis. Biometrics 56 (2),
455463. http://dx.doi.org/10.2307/2676988.
Egger, M., Davey Smith, G., Schneider, M., Minder, C., 1997. Bias in meta-analysis
detected by a simple, graphical test. BMJ 315 (7109), 629634.
Goldberg, D.P., Krueger, R.F., Andrews, G., Hobbs, M.J., 2009. Emotional disorders:
cluster 4 of the proposed meta-structure for DSM-V and ICD-11. Psychol. Med.
39 (12), 20432059. http://dx.doi.org/10.1017/s0033291709990298.
J.P.T., Higgins, Green, S., 2011. Cochrane Handbook for Systematic Reviews of Interventions, Retrieved from www.cochrane-handbook.org.
Johansson, R., Sjoberg, E., Sjogren, M., Johnsson, E., Carlbring, P., Andersson, T., et al.,
2012. Tailored vs. standardized internet-based cognitive behavior therapy for depression and comorbid symptoms: a randomized controlled trial. PLoS One 7 (5).
Johnston, L., Titov, N., Andrews, G., Dear, B.F., Spence, J., 2013. Comorbidity and
internet-delivered transdiagnostic cognitive behavioural therapy for anxiety
disorders. Cogn. Behav. Ther. . http://dx.doi.org/10.1080/16506073.2012.753108
Johnston, L., Titov, N., Andrews, G., Spence, J., Dear, B.F., 2011. A RCT of a
transdiagnostic internet-delivered treatment for three anxiety disorders: examination of support roles and disorder-specic outcomes. PLoS One 6 (11),
e28079. http://dx.doi.org/10.1371/journal.pone.0028079.
Marks, I.M., Kenwright, M., Mcdonough, M., Whittaker, M., Mataiz-Cols, D., 2004.
Saving clinicians time by delegating routine aspects of therapy to a computer:
a randomized controlled trial in phobia/panic disorder. Psychol. Med. 34, 918.
http://dx.doi.org/10.1017/S003329170300878X.
Mcevoy, P.M., Nathan, P., Norton, P.J., 2009. Efcacy of transdiagnostic treatments: a
review of published outcome studies and future research directions. J. Cognit.
Psychother. 23 (1), 2033. http://dx.doi.org/10.1891/08898391.23.1.20.
Moher, D., Liberati, A., Tetzlaff, J., Altman, D.G., The, P.G., 2009. Preferred reporting
items for systematic reviews and meta-analyses: the PRISMA statement. PLoS
Med. 6 (7), e1000097. http://dx.doi.org/10.1371/journal.pmed.1000097.
Mullin, A., Dear, B.F., Karin, E., Wootton, B.M., Staples, L.G., Johnston, L., et al., 2015.
The UniWellbeing course: a randomised controlled trial of a transdiagnostic
internet-delivered cognitive behavioural therapy (CBT) programme for university students with symptoms of anxiety and depression. Internet Inter. 2 (2),
128136. http://dx.doi.org/10.1016/j.invent.2015.02.002.
Newby, J.M., Mackenzie, A., Williams, A.D., Mcintyre, K., Watts, S., Wong, N., et al.,
2013. Internet cognitive behavioural therapy for mixed anxiety and depression:
a randomized controlled trial and evidence of effectiveness in primary care.
Psychol. Med., 114. http://dx.doi.org/10.1017/s0033291713000111.
Newby, J.M., Mckinnon, A., Kuyken, W., Gilbody, S., Dalgleish, T., 2015. Systematic
review and meta-analysis of transdiagnostic psychological treatments for anxiety and depressive disorders in adulthood. Clin. Psychol. Rev. 40 (0), 91110.
http://dx.doi.org/10.1016/j.cpr.2015.06.002.
Nordgren, L.B., Hedman, E., Etienne, J., Bodin, J., Kadowaki, A., Eriksson, S., et al.,
2014. Effectiveness and cost-effectiveness of individually tailored Internet-delivered cognitive behavior therapy for anxiety disorders in a primary care population: a randomized controlled trial. Behav. Res. Ther. 59, 111. http://dx.doi.
org/10.1016/j.brat.2014.05.007.
Norton, P.J., Philipp, L.M., 2008. Transdiagnostic approaches to the treatment of
anxiety disorders: a quantitative review. Psychother.: Theory Res. Pract. Train.
45 (2), 214226. http://dx.doi.org/10.1037/00333204.45.2.214.
Pilling, S., Whittington, C., Taylor, C., Kendrick, T., 2011. Identication and care
pathways for common mental health disorders: summary of NICE guidance.
BMJ 342, d2868. http://dx.doi.org/10.1136/bmj.d2868.
Proudfoot, J., Ryden, C., Everitt, B., Shapiro, D.A., Goldberg, D., Mann, A., et al., 2004.
Clinical efcacy of computerised cognitive-behavioural therapy for anxiety and
depression in primary care: randomised controlled trial. Br. J. Psychiatry 185
(1), 4654. http://dx.doi.org/10.1192/bjp.185.1.46.
Reinholt, N., Krogh, J., 2014. Efcacy of transdiagnostic cognitive behaviour therapy
for anxiety disorders: a systematic review and meta-analysis of published
outcome studies. Cognit. Behav. Ther. . http://dx.doi.org/10.1080/
16506073.2014.897367
Schneider, A.J., Mataix-Cols, D., Marks, I.M., Bachofen, M., 2005. Internet-guided
self-help with or without exposure therapy for phobic and panic disorders: a
randomised controlled trial. Psychother. Psychosom. 74 (3), 154164.
Titov, N., Andrews, G., Johnston, L., Robinson, E., Spence, J., 2010. Transdiagnostic
Internet treatment for anxiety disorders: a randomized controlled trial. Behav.
Res. Ther. 48 (9), 890899. http://dx.doi.org/10.1016/j.brat.2010.05.014.
Titov, N., Dear, B.F., Johnston, L., Lorian, C., Zou, J., Wootton, B., et al., 2013. Improving adherence and clinical outcomes in self-guided internet treatment for
anxiety and depression: randomised controlled trial. PloS One 8 (7).
Titov, N., Dear, B.F., Johnston, L., Mcevoy, P.M., Wootton, B., Terides, M.D., et al.,
2014. Improving adherence and clinical outcomes in self-guided internet
treatment for anxiety and depression: a 12-month follow-up of a randomised
controlled trial. PloS One 9 (2).
Titov, N., Dear, B.F., Schwencke, G., Andrews, G., Johnston, L., Craske, M.G., et al.,
41
2011. Transdiagnostic internet treatment for anxiety and depression: a randomised controlled trial. Behav. Res. Ther. 49 (8), 441452. http://dx.doi.org/
10.1016/j.brat.2011.03.007.
Titov, N., Dear, B.F., Staples, L.G., Terides, M.D., Karin, E., Sheehan, J., et al., 2015.
Disorder-specic versus transdiagnostic and clinician-guided versus self-guided treatment for major depressive disorder and comorbid anxiety disorders: a
randomized controlled trial. J. Anxiety Disord. 35, 88102. http://dx.doi.org/
10.1016/j.janxdis.2015.08.002.
Vos, T., Barber, R.M., Bell, B., Bertozzi-Villa, A., Biryukov, S., Bolliger, I., et al., 2015.
Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic diseases and injuries in 188 countries, 1990
2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet
386 (9995), 743800. http://dx.doi.org/10.1016/S0140-6736(15)60692-4.
Watson, D., 2005. Rethinking the mood and anxiety disorders: a quantitative
hierarchical model for DSM-V. J. Abnorm. Psychol. 114 (4), 522536.