Académique Documents
Professionnel Documents
Culture Documents
We have endeavored to build consensus among experts from diverse fields of study and theoretical
orientation. We collaboratively determined the strategies used to evaluate the literature on the
treatment of Autism Spectrum Disorders. In addition, we jointly determined the intended use of
this document. We used a systematic process to provide all of our experts multiple opportunities to
provide feedback on both the process and the document. Given the diversity of perspectives held by
our experts, the information contained in this report does not necessarily reflect the unique views
of each of its contributors on every point. We are pleased with the spirit of collaboration these
experts brought to this process.
in memory of edward g. carr, ph.d., bcba
This report is dedicated to the memory of Dr. Ted Carr, an internationally
recognized leader in the treatment of Autism Spectrum Disorders and in
the field of Positive Behavior Supports.
Throughout his career, Ted often led the charge for the intelligent
care and compassionate and respectful treatment of individuals with
Autism Spectrum Disorders and other developmental disabilities. We
at the National Autism Center, along with countless organizations and
professionals throughout the world, will miss him and keenly feel his loss.
vi }
Table of Contents
Acknowledgments ix
Contributors x
1 Introduction
About the National Standards Project. . . . . . . . . . . . . . . 1
1
3 Outcomes
Established Treatments . . . . . . . . . . . . . . . . . . . . 11
11
5
Evidence-based Practice 27
6
Limitations 29
7
Future Directions
Future Directions for the Scientific Community . . . . . . . . . . 33
33
References 49
Index 51
{ ix
Acknowledgments
There are many challenges in undertaking a project of this nature. A series of complex decisions must be made over the
course of several years that influence the usefulness of the final document. I would like to take the opportunity to thank
the extraordinary number of professionals, family members, and organizations that have made this task easier.
I have had the good fortune to receive feedback from family members and individuals on the autism spectrum at
the numerous conferences at which I have discussed the National Standards Project. Your input has influenced both
the process we have used and this final document. I hope you continue to provide us feedback as we develop future
editions of the National Standards Project. I have also received feedback at these conferences from professionals
representing different fields of expertise and theoretical orientations. These professionals grapple with the very compli-
cated process of providing best practices in homes, schools, and communities. Thank you for your assistance and your
sustained input to the National Standards Project.
I am also grateful to the professionals and lay members of the autism community who provided very detailed feedback
at various stages of this project. It would be hard to overstate the importance of your contributions. Your disparate
views aided in the development of the review process and the completion of this document. Many of you are identi-
fied in our contributors section. I appreciate the consistent support of our expert panelists and conceptual reviewers
who contributed tirelessly throughout this process. The input of families and professionals was also essential to the
development of this project.
The National Standards Project could not have been completed without an important group of organizations and indi-
viduals. We appreciate both their willingness to underwrite the costs associated with the project and their consistent
neutrality regarding the outcomes reported in this document. May Institute has supported the National Standards
Project from its inception. Most costs associated with the first plenary session which began the development of
this project were provided by the Autism Education Network (AEN). Without the support of Michelle Waterman and
Janet Lishman of AEN, the early development of this project would have been far more challenging. Additional costs
for the project were underwritten by the California Department of Developmental Services. We also appreciate the
support and feedback we received from the Oversight and Advisory Committees through the California Department of
Developmental Services and the professionals involved in the “Autism Spectrum Disorders: Guidelines for Effective
Interventions” document that will be available soon.
Contributors
Pilot Teams
Team 1
Gina Green, Ph.D., BCBA-D
Joseph N. Ricciardi, Psy.D., ABPP, BCBA
Team 2
Brian A. Boyd, Ph.D
Kara Anne Hume, Ph.D.
Mara V. Ladd, Ph.D.
Samuel L. Odom, Ph.D.
Hanna C. Rue, Ph.D.
Article Reviewers
Amanda N. Adams, Ph.D., BCBA Daniel J. Krenzer, M.S. Jana M. Sarno, M.A.
Amanda K. Albertson, M.A. Mara V. Ladd, Ph.D. Stephanie L. Schmitz, Ed.S.
Keith D. Allen, Ph.D., BCBA Courtney M. LeClair, M.A. Mark D. Shriver, Ph.D.
Angela M. Arnold-Seritepe, Ph.D. Celia Lie, Ph.D. Jennifer M. Silber, Ph.D., BCBA
Judah B. Axe, Ph.D., BCBA Ethan S. Long, Ph.D., BCBA-D Torri Smith Tejral, M.S., BCBA
Jennifer D. Bass, Psy.D. James K. Luiselli, Ed.D., ABPP, BCBA-D Tristram H. Smith, Ph.D.
Barbara Becker-Cottrill, Ed.D. Elizabeth A. Lyons, Ph.D., BCBA Debborah E. Smyth, Ph.D.
Stacy Lynn Bliss Fudge, Ph.D. Gwen Martin, Ph.D., BCBA Aubyn C. Stahmer, Ph.D.
Brian A. Boyd, Ph.D. Britney N. Mauldin, M.S. CarrieAnne St. Armand, M.B.A., M.S., BCBA
James E. Carr, Ph.D., BCBA Judy A. McCarty, Ph.D., NCSP, BCBA Ravit R. Stein, Ph.D.
Stephanie Chopko, M.A. J. Christopher McGinnis, Ph.D., NCSP, BCBA Catherine E. Sumpter, Ph.D.
Costanza Colombi, Ph.D. Christine McGrath, Ph.D., NCSP Bridget A. Taylor, Psy.D., BCBA
Shannon E. Crozier, Ph.D., BCBA Victoria Moore, Psy.D. Susan F. Thibadeau, Ph.D., BCBA-D
Elizabeth Delpizzo-Cheng, Ph.D., BCBA, NCSP Oliver C. Mudford, Ph.D., BCBA Matthew J. Tincani, Ph.D.
Ronnie Detrich, Ph.D., BCBA Dipti Mudgal, Ph.D. Jennifer Wick, M.A.
Melanie D. Dubard, Ph.D., BCBA Samuel L. Odom, Ph.D. Susan M. Wilczynski, Ph.D., BCBA
Stephen E. Eversole, Ed.D., BCBA-D Gary M. Pace, Ph.D., BCBA-D Pamela S. Wolfe, Ph.D.
Adam B. Feinberg, Ph.D., BCBA-D Heather Peters, Ph.D. April S. Worsdell, Ph.D., BCBA
Laura F. Fisher, Psy.D. Marisa Petruccelli, Psy.D.
Wayne W. Fisher, Ph.D. Katrina J. Phillips, Ph.D., BCBA
William Frea, Ph.D. Patricia A. Prelock, Ph.D., CCC-SLP
William A. Galbraith, Ph.D., BCBA Jane E. Prochnow, Ed.D.
Katherine T. Gilligan, M.S., BCBA Robert F. Putnam, Ph.D., BCBA
Gina Green, Ph.D., BCBA-D Sarah G. Reck, B.A.
Tracy D. Guiou, Ph.D., BCABA Henry S. Roane, Ph.D., BCBA
Neelima Gutti, B.S. Lise Roll-Peterson, Ph.D., BCBA
Lisa M. Hagermoser Sanetti, Ph.D. Hannah C. Rue, Ph.D.
Alan E. Harchik, Ph.D., BCBA-D Dennis C. Russo, Ph.D, ABBP, ABPP
Patrick F. Heick, Ph.D., BCBA-D
Thomas S. Higbee, Ph.D., BCBA
Kara Anne Hume, Ph.D.
Maree Hunt, Ph.D.
Melissa D. Hunter, Ph.D.
Heather Jennett, Ph.D., BCBA
Kristen N. Johnson-Gros, Ph.D., NCSP
Debra M. Kamps, Ph.D.
Amanda M. Karsten, M.A.
Shannon Kay, Ph.D., BCBA
Courtney L. Keegan, M.Ed., BCBA
Penelope K. Knapp, M.D.
1 Introduction
1
For the purpose of this report, we use the phrase “individuals with Autism Spectrum Disorders” to refer to individuals on
the autism spectrum who are under 22 years of age.
2
The pilot team relied on the following sources: Sidman (1960); Johnston & Pennypacker (1993); Kazdin (1982; 1998);
New York State Department of Health, Early Intervention Program (1999) and; Task Force on Promotion and Dissemination of
Psychological Procedures (1995).
3
These systems were developed based on an examination of previous evidence-based practice guidelines including
the Agency for Healthcare Research and Quality (West, King, Carey, Lohr, McKoy et al., 2002), American Psychological
Association Presidential Task Force on Evidence-Based Practice (2003), and the Task Force on Evidence-Based Interventions
in School Psychology (APA, 2005). These were also based on an examination of publications about evidence-based practice
by authors {a} Chambless, Baker, Baucom, Beutler, Calhoun, Crits-Christoph, et al., (1998) and {b} Horner, Carr, Halle, McGee,
Odom, & Wolery (2005).
Treatment categorization
Measurement of
Design:
Dependent Variable: Measurement of Participant Generalization
Two classes of research
Two types of data were Independent Variable Ascertainment of Tx Effect(s)
design were considered
considered
Group Single- Test, scale, Direct
subject checklist, behavioral
etc. observation
Answers Answers Answers Answers
questions questions questions questions Answers questions such Answers ques- Answers ques-
such as: such as: such as: such as: as: tions such as: tions such as:
How many How many Was the What type of Is there evidence the treat- Who delivered the Were objective data
partici- comparisons protocol measurement ment was implemented diagnosis? collected?
pants were were made? standardized? was used? accurately?
Was the diagnosis Were maintenance
included?
How many What are the Is there How much treatment fidelity confirmed? and/or generaliza-
How many data points psychometric evidence of data were collected? tion data collected?
Were psycho-
groups were were properties? reliability?
Is there evidence of reliabil- metrically sound
included? collected?
Were the How much ity for treatment fidelity? instruments used?
Were relevant How many evaluators data were
Were DSM or ICD
data lost? partici- blind and/or collected?
criteria used?
pants were independent?
What was
included?
the research
design? Were relevant
data lost?
Each category was weighted. Dimensions that have been consistently acknowl-
edged as essential in research since the first studies were published were given
stronger weights. Factors that have most recently been considered important were
given lesser weights. The weights assigned were as follows: Research Design (.30) +
Dependent Variable (.25) + Participant Ascertainment (.20) + Procedural Integrity (.15) +
Generalization (.10).
5
Professionals often describe a treatment as “effective” when it has been shown to work in real world settings such as
home, school, and community. For the purposes of this report, the word “effective” refers to studies conducted in real world,
clinical, and research settings.
6
The Strength of Evidence Classification System was modified to its current four-point format to ease interpretation of out-
comes for the general public. Although the Strength of Evidence Classification System was modified from a six-point format,
the interpretation of outcomes remains identical across formats. For example, all treatments that were previously identified
as having sufficient evidence of effectiveness did not vary across the two systems.
Severala published, peer- Fewb published, peer-reviewed May or may not be based on Severala published, peer-
reviewed studies studies research reviewed studies
••Scientific Merit Rating Scales ••Scientific Merit Rating Scale ••Beneficial treatment effects ••Scientific Merit Rating Scales
scores of 3, 4, or 5 scores of 2 reported based on very poorly scores of 3
controlled studies (scores of
••Beneficial treatment effects ••Beneficial treatment effects ••No beneficial treatment effects
0 or 1 on the Scientific Merit
for a specific target reported for one dependent reported for one dependent
Rating Scale)
variable for a specific target measure for a specific target
These may be supplemented
••Claims based on testimonials, (Ineffective)
by studies with lower scores These may be supplemented
unverified clinical observa-
on the Scientific Merit Rating by studies with higher or lower OR
tions, opinions, or speculation
Scale. scores on the Scientific Merit
••Adverse treatment effects
Rating Scale. ••Ineffective, unknown, or
reported for one dependent
adverse treatment effects
variable for a specific target
reported based on poorly
(Harmful)
controlled studies
Note: Ineffective treatments are
indicated with an “I” and Harm-
ful treatments are indicated
with an “H”
a
Several is defined as 2 group design or 4 single-subject design studies with a minimum of 12 participants for which there are no con-
flicting results or at least 3 group design or 6 single-subject design studies with a minimum of 18 participants with no more than 1 study
reporting conflicting results. Group and single-case design methodologies may be combined.
b
Few is defined as a minimum of 1 group design study or 2 single-subject design studies with a minimum of 6 participants for which no
conflicting results are reported.* Group and single-subject design methodologies may be combined.
*Conflicting results are reported when a better or equally controlled study that is assigned a score of at least 3 reports either {a} inef-
fective treatment effects or {b} adverse treatment effects.
Established Treatments
We identified 11 treatments as Established (i.e., they were established as
Treatments are those for which several well-controlled studies have shown
Examples include but are not restricted to: behavior chain interruption (for increasing behaviors); behavioral
momentum; choice; contriving motivational operations; cueing and prompting/prompt fading procedures; envi-
ronmental enrichment; environmental modification of task demands, social comments, adult presence, intertrial
interval, seating, familiarity with stimuli; errorless learning; errorless compliance; habit reversal; incorporating
echolalia, special interests, thematic activities, or ritualistic/obsessional activities into tasks; maintenance inter-
spersal; noncontingent access; noncontingent reinforcement; priming; stimulus variation; and time delay.
◖◖ Behavioral Package {231 studies}. These interventions are designed to reduce problem
behavior and teach functional alternative behaviors or skills through the application of basic
principles of behavior change. Treatments falling into this category reflect research repre-
senting the fields of applied behavior analysis, behavioral psychology, and positive behavior
supports.
Examples include but are not restricted to: behavioral sleep package; behavioral toilet training/dry bed train-
ing; chaining; contingency contracting; contingency mapping; delayed contingencies; differential reinforcement
strategies; discrete trial teaching; functional communication training; generalization training; mand training; non-
contingent escape with instructional fading; progressive relaxation; reinforcement; scheduled awakenings; shaping;
stimulus-stimulus pairing with reinforcement; successive approximation; task analysis; and token economy.
Treatments involving a complex combination of behavioral procedures that may be listed elsewhere in this docu-
ment are also included in the behavioral package category. Examples include but are not restricted to: choice +
embedding + functional communication training + reinforcement; task interspersal with differential reinforcement;
tokens + reinforcement + choice + contingent exercise + overcorrection; noncontingent reinforcement + differential
reinforcement; modeling + contingency management; and schedules + reinforcement + redirection + response
prevention. Studies targeting verbal operants also fall into this category.
Treatments identified
non-behavioral literature as
we move forward.
Treatment Targets
Established Treatments have demonstrated favorable outcomes for many treat-
ment targets. See Appendix 4 for definitions for each of the treatment targets.
◖◖ Antecedent Package, Behavioral Package, and Comprehensive Behavioral Treat-
ment for Young Children have demonstrated favorable outcomes with more
than half of the skills that are often targeted to be increased (see Table 3 for
examples).
◖◖ Behavioral Package has demonstrated favorable outcomes with three-quarters of
the behaviors that are often targeted to decrease (see Table 3 for examples).
◖◖ Other Established Treatments have demonstrated favorable outcomes with a
smaller range of treatment targets. In many cases, this provides a rich opportu-
nity to extend research findings.
Behaviors Decreased
Ages
Diagnostic Classification
individuals with ASD are needed before we can be fully confident that the
treatments are effective. Based on the available evidence, we are not yet in
a position to rule out the possibility that Emerging Treatments are, in fact, not
effective.
A large number of studies fall into the “Emerging” level of evidence. We believe
scientists should find fertile ground for further research in these areas. The number of
studies conducted that contributed to this rating is listed in parentheses after the treat-
ment name.
The following treatments have been identified as falling into the Emerging
level of evidence:
◖◖ Augmentative and Alternative Communication Device {14 studies}
◖◖ Cognitive Behavioral Intervention Package {3 studies}
◖◖ Developmental Relationship-based Treatment {7 studies}
◖◖ Exercise {4 studies}
◖◖ Exposure Package {4 studies}
◖◖ Imitation-based Interaction {6 studies}
◖◖ Initiation Training {7 studies}
◖◖ Language Training (Production) {13 studies}
◖◖ Language Training (Production & Understanding) {7 studies}
◖◖ Massage/Touch Therapy {2 studies}
◖◖ Multi-component Package {10 studies}
Each of these treatments is defined in Appendix 5. Interested readers may wish to refer to the full
National Standards Report for additional details regarding these treatments.
in the scientific literature that allows us to draw firm conclusions about the
1. Arnold, G. L., Hyman, S. L., Mooney, R. A., & Kirby, R. S. (2003). Plasma
amino acids profiles in children with autism: Potential risk of nutritional defi-
ciencies, Journal of Autism and Developmental Disabilities, 33, 449-454.
2. Heiger, M. L., England, L. J., Molloy, C. A., Yu, K. F., Manning-Courtney, P., &
Mills, J. L. (2008). Reduced bone cortical thickness in boys with autism or
autism spectrum disorders. Journal of Autism and Developmental Disorders,
38, 848-856.
Each of these treatments is defined in Appendix 5. Interested readers may wish to refer to the full
National Standards Report for additional details regarding these treatments.
There are likely many more treatments that fall into this category for which no research has been
conducted or, if studies have been published, the accepted process for publishing scientific work
was not followed. There are a growing number of treatments that have not yet been investigated
scientifically. These would all be Unestablished Treatments. Further, any treatments for which stud-
ies were published exclusively in non-peer-reviewed journals would be Unestablished Treatments.
outcomes, respectively. At this time, there are no treatments that have suffi-
cient evidence specific to the ASD population that meet these criteria.
This outcome is not entirely unexpected. When preliminary research findings sug-
gest a treatment is ineffective or harmful, researchers tend to change the focus of their
scientific inquiries into treatments that may be effective. That is, research often stops
once there is a suggestion that the treatment does not work or that it is harmful. Fur-
ther, research showing a treatment to be ineffective or harmful may be available with
different populations (e.g., developmental disabilities, general populations, etc.). Ethical
researchers are not going to then apply these ineffective or harmful treatments specifi-
cally to children or adolescents on the autism spectrum just to show that the treatment
is equally ineffective or harmful with individuals with ASD.
viduals who can consider the unique needs and history of the individual with
she lives. We do not intend for this document to dictate which treatments can
Having stated this, we have been asked by families, educators, and service provid-
ers to recommend how our results might be helpful to them in their decision-making.
As an effort to meet this request, we provide suggestions regarding the interpretation
of our outcomes. In all cases, we strongly encourage decision-makers to select an
evidence-based practice approach.
Research findings are not the sole factor that should be considered when treat-
ments are selected. The suggestions we make here refer only to the “research
findings” component of evidence-based practice and should be only one factor consid-
ered when selecting treatments.
treatments. We are not alone in this activity. The National Standards Project
the New York State Department of Health, Early Intervention Division {1999},
◖◖ Values and Preferences. The values and preferences of parents, careproviders, and the
individual with ASD should be considered. Stakeholder values and preference may play a par-
ticularly important role in decision-making when:
◗◗ A treatment has been correctly implemented in the past and was not effective or had
harmful side effects.
◗◗ A treatment is contrary to the values of family members.
◗◗ The individual with ASD indicates that he or she does not want a specific treatment.
◖◖ Capacity. Treatment providers should be well positioned to correctly implement the interven-
tion. Developing capacity and sustainability may take a great deal of time and effort, but all
people involved in treatment should have proper training, adequate resources, and ongoing
feedback about treatment fidelity. Capacity may play a particularly important role in decision-
making when:
◗◗ A service delivery system has never implemented the intervention before. Many of these
treatments are very complex and require precise use of techniques that can only be devel-
oped over time.
◗◗ A professional is considered the “local expert” for a given treatment but he or she actually
has limited formal training in the technique.
◗◗ A service delivery system has implemented a system for years without a process in place
to ensure the treatment is still being implemented correctly.
Like other projects of this nature, there are limitations to the National
◗◗ This document is not an exhaustive review of all treatments for all individuals.
There are treatments that might have solid research support for related popula-
tions (e.g., developmental disabilities, anxiety, depression, etc.) but have limited
or no evidence of research support for individuals with ASD in the National Stan-
dards Report. See Chapter 5 for how this might influence treatment selection.
◖◖ As noted in the treatment classification section of this report, determining the
categories for treatments presents a real challenge. This is equally true whenever
comprehensive reviews of the literature are completed for any diagnostic group.
Some of our experts suggested making the unit of analysis larger for some catego-
ries; others suggested making the unit of analysis smaller for most categories. In
the end, we attempted to develop categories that “made sense.” We expect that
7
Klin, A., Lin, D.J., Gorrindo, P., Ramsay, G., & Jones, W. (2009). Two-year-olds with autism orient to non-social contingen-
cies rather than biological motion. Nature, 1-7. doi:10.1038/nature07868.
8
Dawson, G. (2008). Early behavioral intervention, brain plasticity, and the prevention of autism spectrum disorders.
Development and Psychopathology, 20, 775-803.
“ The committee recommends that educational services begin as soon as a child is suspected of having
an autistic spectrum disorder. Those services should include a minimum of 25 hours a week, 12 months
a year, in which the child is engaged in systematically planned, and developmentally appropriate edu-
cational activity toward identified objectives. What constitutes these hours, however, will vary accord-
ing to a child’s chronological age, developmental level, specific strengths and weaknesses, and family
needs. Each child must receive sufficient individualized attention on a daily basis so that adequate
implementation of objectives can be carried out effectively. The priorities of focus include functional
spontaneous communication, social instruction delivered throughout the day in various settings,
cognitive development and play skills, and proactive approaches to behavior problems. To the extent
that it leads to the acquisition of children’s educational goals, young children with an autistic spectrum
disorder should receive specialized instruction in a setting in which ongoing interactions occur with
”
typically developing children.
◗◗ Social validity;
Despite its limitations, we sincerely hope this document is useful to you. We also recognize that
even more information might be helpful. For example, there may be new or different ways of orga-
nizing information that you believe could be useful. If you would like to help shape the direction of
the next version of the National Standards Project, please provide feedback to the National Autism
Center at info@nationalautismcenter.org.
of the existing literature base. We believe we have done so in two ways: {a}
and {b} we have developed the Scientific Merit Rating Scale and Strength of
There is room for additional research for all treatments. It will be important to
extend the current research base for Established Treatments to all reasonable treat-
ment goals, age groups, and diagnostic groups. Additional research must be conducted
for treatments falling in the Emerging and Unestablished Treatment categories to
determine if {a} the treatments are effective and {b} the treatments are ineffective or
harmful. High quality research is perhaps most important for treatments falling into the
Unestablished Treatments category.
research design, {b} dependent variable, {c} treatment fidelity, {d} partici-
pant ascertainment, and {e} generalization (see Table 3). We identified these
dimensions based on the most recent scientific standards that are being
Similarly, it is only recently that evidence of treatment fidelity has been consistently
emphasized by the scientific community. This means that although many studies may
do an excellent job of describing the procedures used, they still received low rat-
ings on their ability to provide evidence that they completed all procedures exactly as
prescribed. This leaves room for improvement in the scientific literature in either the
research design or the extent to which scientists report on these important variables.
With additional funding, we hope to help address questions related to cost effec-
tiveness, social validity, studies examining mediating variables, and effectiveness of
treatments in real world settings.
We suspect that this report will raise additional questions that we hope to address
in future publications. Our ultimate goal is to answer relevant questions related to
evidence-based practice in response to the changing expectations of professionals and
the needs of families, educators, and service providers.
Inclusionary Criteria
The National Standards Project is a systemic review of the behavioral and educational treatment literature
involving individuals with Autism Spectrum Disorders (ASD) under the age of 22. For the purposes of this
review, Autism Spectrum Disorders were defined to include Autistic Disorder, Asperger’s Syndrome, and
Pervasive Developmental Disorder — Not Otherwise Specified (PDD-NOS).
Exclusionary Criteria
Participants who were identified as “at risk” for an ASD or who were described as having “autistic
characteristics” or “a suspicion of ASD” were not included in this review.
Studies were included if the treatments could have been implemented in or by school systems, including
toddler, early childhood, home-based, school-based, and community-based programs.
Studies in which parents, care providers, educators, or service providers were the sole subject of treatment
were not included in the review. If these adults were one subject but data were also available regarding
changes in child behavior or skills, the study was retained, but only those results pertaining to the child’s
behavior or skills were included in the review.
Articles were only included in the review if they had been published in peer-reviewed journals.
Studies examining biochemical, genetic, and psychopharmacological treatments were excluded (see
exception below). These treatments have not historically focused on the core characteristics of ASD.
We made the decision to include curative diets because professionals are often expected to implement
curative diets across a variety of settings with a high degree of fidelity and the treatment is intended to
address the core characteristics of ASD.
Results for study participants who were diagnosed with both ASD and co-morbid conditions that do
not commonly co-occur with ASD were excluded from this review because their results could skew the
outcomes.
Articles were excluded if they did not include empirical data, if there were no statistical analyses available
for studies using group research design, if there was no linear graphical presentation of data for studies
using single-case research design, or if the studies relied on qualitative methods.
Studies were excluded if their sole purpose was to identify mediating or moderating variables.
Articles were excluded if all participants were over the age of 22 or if a study included participants both
over and under the age of 22, but separate analyses were not conducted for individuals under the age of
22. We anticipate the next version of the National Standards Project will expand the focus of the review to
include treatments involving participants across the lifespan.
Articles were excluded from the National Standards Project if they were published exclusively in
languages other than English.
Findings and Conclusions: National Standards Project ( 38
SMRS} Rating 5
Measurement of
Measurement of Independent Variable Participant Generalization
Research Design
Dependent Variable (procedural integrity or Ascertainment of Tx Effect(s)
treatment fidelity)
Group Single- Test, scale, Direct
subjecta checklist, behavioral
etc. observation
Number of A minimum Type of Type of Implementation accuracy Diagnosed Objective data
groups: two or of three measurement: measurement: measured at > 80% by a qualified
Maintenance data
more comparisons Observation- continuous professional
Implementation accuracy collected
of control and based or discon-
Design: measured in 25% of total Diagnosis confirmed
treatment tinuous with AND
Random Protocol: sessions by independent and
conditions calibration Generalization data
assignment standardized blind evaluators for
data showing IOA for treatment fidelity
and/or no Number of research purposes collected across
Psychometric low levels of > 80%
significant data points using at least one at least two of the
properties error
differences per condition: psychometrically following: setting,
solid instru-
pre-Tx > five Reliability: solid instrument stimuli, persons
ment
IOA > 90% or
Participants: n Number of DSM or ICD
Evaluators: kappa > .75
> 10 per group participants: > criteria or commonly
blind and
or sufficient three Percentage accepted criteria
independent
power for of sessions: during the identified
Data loss:
lower number Reliability time period reported
no data loss
of participants collected in > to be met
possible
25%
Data Loss: no
data loss Type of condi-
tions in which
data were
collected: all
sessions
39 } Appendices
SMRS} Rating 4
Measurement of
Measurement of Independent Variable Participant Generalization
Research Design
Dependent Variable (procedural integrity or Ascertainment of Tx Effect(s)
treatment fidelity)
Group Single- Test, scale, Direct
subjecta checklist, behavioral
etc. observation
Number of A minimum Type of Type of Implementation accuracy Diagnosis provided/ Objective data
groups: two or of three measurement: measurement: measured at > 80% confirmed by
Maintenance data
more comparisons Observation- continuous or independent and
Implementation accuracy collected
of control and based discontinu- blind evaluators for
Design: measured in 20% of total
treatment measurement ous with no research purposes AND
Matched session for focused interven-
conditions calibration using at least one Generalization data
groups; No Protocol: tions only
data psychometrically collected across
significant Number of standardized
IOA for treatment fidelity: sufficient instrument
differences data points Reliability: at least one of the
Psychometric not reported
pre-Tx; or bet- per condition: IOA > 80% or following: setting,
properties
ter design > five kappa > .75 stimuli, persons
sufficient
Participants: n Number of Percentage
Evaluators:
> 10 per group participants: > of sessions:
blind
or sufficient three Reliability
power for OR collected in >
Data loss:
lower number independent 25%
some data
of participants
loss possible Type of condi-
Data Loss: tions in which
some data data were
loss possible collected: all
sessions
Findings and Conclusions: National Standards Project ( 40
SMRS} Rating 3
Measurement of
Measurement of Independent Variable Participant Generalization
Research Design
Dependent Variable (procedural integrity or Ascertainment of Tx Effect(s)
treatment fidelity)
Group Single- Test, scale, Direct
subjecta checklist, behavioral
etc. observation
Number of A minimum Type of Type of Implementation accuracy Diagnosis provided/ Objective data
groups: two or of two measurement: measurement: measured at > 80% confirmed by
Maintenance data
more comparisons Observation- continuous or independent
Implementation accuracy collected
of control and based discontinu-
Design: Pre-Tx measured in 20% of partial OR
treatment measurement ous with no OR
differences session for focused interven-
conditions calibration blind evalua-
controlled Protocol: tions only Generalization data
data tor for research
statistically or Number of non-stan- collected across
IOA for treatment fidelity: purposes using at
better design data points dardized or Reliability: at least one of the
not reported least one psycho-
per condition: standardized IOA > 80% or following: setting,
Data loss: metrically adequate
> three kappa > .4 stimuli, persons
some data Psychometric instrument
loss possible Number of properties Percentage
OR
participants: adequate of sessions:
> two Reliability DSM criteria con-
Evaluators:
collected in > firmed by a qualified
Data loss: neither blind
20% diagnostician or
some data nor indepen-
independent and/or
loss possible dent required Type of condi-
blind evaluator
tions in which
data were col-
lected: all or
experimental
sessions only
41 } Appendices
SMRS} Rating 2
Measurement of
Measurement of Independent Variable Participant Generalization
Research Design
Dependent Variable (procedural integrity or Ascertainment of Tx Effect(s)
treatment fidelity)
Group Single- Test, scale, Direct
subjecta checklist, behavioral
etc. observation
Number of A minimum Type of Type of Control condition is Diagnosis with at Subjective data
groups and of two measurement: measurement: operationally defined at an least one psycho-
Maintenance data
Design: If two comparisons Observation- continuous or inadequate level or better metrically modest
collected
groups, pre-Tx of control and based or discontinu- instrument
Experimental (Tx) procedures
difference treatment subjective ous with no AND
are operationally defined at a OR
not controlled conditions calibration Generalization data
Protocol: rudimentary level or better
or better data diagnosis provided
Number of non-stan- collected across
research Implementation accuracy by a qualified diag-
data points dardized or Reliability: at least 1 of the
design measured at > 80% nostician or blind
per Tx condi- standardized IOA > 80% or following: setting,
and/or independent
OR tion: > three kappa > .4 Implementation accuracy stimuli, persons
Psychometric evaluator with no
regarding percentage of
a one group Number of properties Percentage of reference to psycho-
total or partial sessions: not
repeated participants: modest sessions: Not metric properties of
reported
measures pre- > two reported instrument
Evaluators:
test/post-test IOA for treatment fidelity:
Data loss: sig- neither blind Type of condi-
design not reported
nificant data nor indepen- tions in which
Data Loss: loss possible dent required data were
significant collected: not
data loss necessarily
possible reported
Operational
definitions are
extensive or
rudimentary
Findings and Conclusions: National Standards Project ( 42
SMRS} Rating 1
Measurement of
Measurement of Independent Variable Participant Generalization
Research Design
Dependent Variable (procedural integrity or Ascertainment of Tx Effect(s)
treatment fidelity)
Group Single- Test, scale, Direct
subjecta checklist, behavioral
etc. observation
Number of A minimum Type of Type of Control condition is Diagnosis provided Subjective
groups and of two measurement: measurement: operationally defined at an by {a} review of or subjective
Design: comparisons Observation- continuous or inadequate level or better records supplemented with
two group, of control and based or discontinu- objective data
Experimental (Tx) procedures OR
post-test treatment subjective ous with no
are operationally defined at a Maintenance data
only or better conditions calibration {b} instrument with
Protocol: rudimentary level or better collected
research data weak psychometric
Number of non-stan-
design IOA and procedural fidelity support OR
participants: dardized or Type of condi-
data are unreported
OR > one standardized tions in which Generalization data
data were collected across
retrospective Data loss: sig- Psychometric
collected: not at least one of the
comparison of nificant data properties
necessarily following: setting,
one or more loss possible weak
reported stimuli, persons
matched
Evaluators:
groups Operational
Neither blind
definitions are
Data loss: nor indepen-
extensive or
significant dent required
rudimentary
data loss
possible
SMRS} Rating 0
Does not meet Does not meet Does not meet Does not meet Does not meet criterion for a Does not meet Does not meet
criterion for a criterion for a criterion for a criterion for a score of 1 criterion for a score criterion for a score
score of 1 score of 1 score of 1 score of 1 of 1 of 1
a
For all designs except alternating treatments design (ATD). For an ATD, the following rules apply:
{5} Comparison of baseline and experimental condition; > five data points per experimental condition, follow-up data collected, carryover effects
minimized through counterbalancing of key variables (e.g., time of day), and condition discriminability; n > three; no data loss
{4} Comparison of baseline and experimental condition; > five data points per experimental condition; carryover effects minimized through counter-
balancing of key variables (e.g., time of day), OR condition discriminability; n > three; some data loss possible
{3} > five data points per condition, carryover effects minimized counterbalancing of key variables OR condition discriminability; n > two; some data
loss possible
{2} > five data points per condition; n > two; significant data loss possible
{1} > five data points per condition; n > one; significant data loss possible
{0} Does not meet criterion for a score 1
43 } Appendices
1
Although placement is not a “skill,” it represents an important accomplishment toward which intervention programs strive.
45 } Appendices
Emerging Treatments
Unestablished Treatments
Academic Interventions
These interventions involve the use of traditional teaching methods to improve academic performance.
Examples include but are not restricted to: “personal instruction”; paired associate; picture-to-text
matching; The Expression Connection; answering pre-reading questions; completing cloze sentences;
resolving anaphora; sentence combining; “special education”; speech output and orthographic feed-
back; and handwriting training.
Auditory Integration Training
This intervention involves the presentation of modulated sounds through headphones in an attempt to
retrain an individual’s auditory system with the goal of improving distortions in hearing or sensitivities
to sound.
Facilitated Communication
This intervention involves having a facilitator support the hand or arm of an individual with limited
communication skills, helping the individual express words, sentences, or complete thoughts by using a
keyboard of words or pictures or typing device.
Gluten- and Casein-Free Diet
These interventions involve elimination of an individual’s intake of naturally occurring proteins gluten
and casein.
Sensory Integrative Package
These treatments involve establishing an environment that stimulates or challenges the individual to
effectively use all of their senses as a means of addressing overstimulation or understimulation from
the environment.
49 } References
References}
Chambless, D.L., Baker, M.J., Baucom, D.H., Kazdin, A. E. (1998). Methodological issues and
Beutler, L., Calhoun, K.S., Crits-Christoph, strategies in clinical research (2nd ed.).
P. et al. (1998). Update on empirically Washington, DC: American Psychological
validated therapies: II. The Clinical Association.
Psychologist, 51(1), 3-16.
Findings and Conclusions: National Standards Project ( 50
Klin, A., Lin, D. J., Gorrindo, P., Ramsay, G., & Sidman, M. (1960). Tactics of scientific research:
Jones, W. (2009). Two-year-olds with Evaluating experimental data in psychology.
autism orient to non-social contingencies New York: Basic Books, Inc.
rather than biological motion. Nature, 1-7.
doi:10.1038/nature07868. Task Force on Promotion and Dissemination of
Psychological Procedures (1995). Training in
National Research Council (2001). Educating and dissemination of empirically-validated
children with autism. Committee on psychological treatments: Report and rec-
Educational Interventions for Children With ommendations. The Clinical Psychologist,
Autism, Division of Behavioral and Social 48, 3-23.
Sciences and Education. Washington, DC:
National Academy Press. West, S., King, V., Carey, T.S., Lohr, K.N., McKoy,
N. et al. (2002). Systems to rate the
New York State Department of Health Early strength of scientific evidence. Evidence
Intervention Program (1999). Clinical Report/Technology Assessment No. 47.
practice guideline: Report of the recommen- (Prepared by the Research Triangle Institute-
dations. Autism/Pervasive developmental University of North Carolina Evidence-Based
disorders, assessment and intervention for Practice Center under Contract No. 290-
young children (age 0-3 years). Albany, NY: 97-0011. AHRQ Publication No. 02-E016.)
New York State Department of Health Early Rockville, Md: Agency for Healthcare
Intervention Program. Research and Quality.
A
C
Academic Interventions 22, 48
Chaining 12 E
Adult Presence (environmental
modifications of) 12 Choice 12, 14 Early Intensive Behavioral Intervention 13
H
Habit Reversal 12 M
P
Handwriting Training 48 Maintenance Interspersal 12
Pager 47
Mand Training 12
I Paired Associate 48
Massage/Touch Therapy 20, 46
Protective Equipment 46
53 } Index
R
T
Reductive Package 21, 46
Task Analysis 12
Reinforcement 12, 13, 14, 15
Task Demands (environmental modifications
Relationship Development Intervention 45
of) 12
Resolving Anaphora 48
TEACCH (Treatment and Education of
Responsive Education and Prelinguistic Autistic and related Communication-
Milieu Teaching 14 handicapped CHildren) 47
S Time Delay 12
Social Stories™ 15