Académique Documents
Professionnel Documents
Culture Documents
Author manuscript
Curr Top Behav Neurosci. Author manuscript; available in PMC 2016 December 01.
Author Manuscript
Peter D. Balsam
Author Manuscript
Abstract
Motivation, defined as the energizing of behavior in pursuit of a goal, is a fundamental element of
our interaction with the world and with each other. All animals share motivation to obtain their
basic needs, including food, water, sex and social interaction. Meeting these needs is a requirement
for survival, but in all cases the goals must be met in appropriate quantities and at appropriate
times. Therefore motivational drive must be modulated as a function of both internal states as well
as external environmental conditions. The regulation of motivated behaviors is achieved by the
coordinated action of molecules (peptides, hormones, neurotransmitters etc), acting within specific
Author Manuscript
circuits that integrate multiple signals in order for complex decisions to be made. In the past few
decades, there has been a great deal of research on the biology and psychology of motivation. This
work includes the investigation of specific aspects of motived behavior using multiple levels of
analyses, which allows for the identification of the underpinning neurobiological mechanisms that
support relevant psychological processes. In this chapter we provide an overview to the volume
“The Behavioural Neuroscience of Motivation”. The volume includes succinct summaries of; The
neurobiology of components of healthy motivational drive, neural measures and correlates of
motivation in humans and other animals as well as information on disorders in which abnormal
motivation plays a major role. Deficits in motivation occur in a number of psychiatric disorders,
affecting a large population, and severe disturbance of motivation can be devastating. Therefore,
we also include a section on the development of treatments for disorders of motivation. It is hoped
that the collection of reviews in the volume will expose scientists to a breadth of ideas from
Author Manuscript
several different subdisciplines, thereby inspiring new directions of research that may increase our
understanding of motivational regulation and bring us closer to effective treatments for disorders
of motivation.
Keywords
Motivation; Cost-benefit analysis; Addiction; Apathy; Translational research
Understanding what drives motivated behavior in humans is a truly fascinating endeavor. But
as important as our curiosity for knowing what drives us as individuals, and what supports
individual differences in levels of motivation among our friends and colleagues, is the
critical question; why do motivational processes get disrupted when the clinical and personal
consequences can be so devastating? As we will see across this volume, motivated behaviors
involve biological and psychological processes that have undergone evolution at numerous
levels, from individual molecules all the way to species-specific social organization. While
motivational processes represent heritable traits of fitness, humans suffer from a number of
disorders of motivation that can be organized into two distinct categories. The first category
is composed of the apathy and pathological deficits in motivation commonly seen in patients
with schizophrenia and affective disorders. The second category involves problematic
excesses in behavior including addictions, the pathological misdirection of motivation.
Author Manuscript
deliberative behaviors. One of the earliest psychological theories of motivation, Hull’s drive
theory, posited that behaviors occur to reduce biological needs, thereby optimizing the
organism’s potential for survival (Hull 1943). However in Hull’s theory, motivational drive
functioned solely to energize responding, drive was not responsible for initiating, or
maintaining the direction of action. Later, motivation was conceptualized to consist of both a
goal-directed, directional component and an arousal, activational component (Duffy 1957;
Hebb 1955). This is the framework of motivation still in use, such that if motivation were a
vector—its length would represent the amplitude, or intensity of pursuit, and the angle of the
vector would represent its focus on a specific goal. In this analogy, a motivation vector
affected by apathy might have a reduced length in all directions and a motivation vector
affected by addiction might have an increased length and a less flexible direction. The
chapters in this volume explicitly acknowledge that motivation affects which responses
Author Manuscript
occur as well as the vigor of those responses. It appears that we are just beginning to
understand that these two aspects of motivation have both common and distinctive neural
underpinnings. For example, circadian factors may energize the general motive of seeking
food or mate (Antle and Silver, this volume), but the specific actions that occur in pursuit of
these goals are regulated by different substrates (see Caldwell and Alders, Woods and Begg,
Magarinos and Pfaff, all in this volume). Similarly, local cues that signal food availability
may energize many food seeking actions, signals for specific foods differentially energize
actions associated with obtaining the specific outcome. Again, the neural substrates of the
Curr Top Behav Neurosci. Author manuscript; available in PMC 2016 December 01.
Simpson and Balsam Page 3
general and specific effects are somewhat distinctive. At each level, whole classes of specific
Author Manuscript
actions are made more or less likely by these factors (Neuringer and Jensen 2010). We
suggest that there is generally a hierarchical structure to motivation in the sense that general
arousal factors such as sleep–wake cycles will affect many different motives, that activation
of specific motives (e.g., hunger, thirst, social motives) can activate many specific actions
that could lead to many specific outcomes within a general class of goals, and that more
temporally and situationally specific factors determine the specific actions that occur in
pursuit of that goal (Timberlake 2001). With this in mind, it is clear that disruptions in
motivation can occur at multiple levels of control which suggests there may be multiple
interacting ways to attempt to treat disruptions.
states, the current environmental conditions, as well as the organism’s past history and
experiences. In order for all these factors to influence motivation, information about them
must be processed in a number of ways; it must be evaluated and encoded, and unless the
motives are novel, the valuation and encoding will be affected by learning and retrieval
processes. A simplified overview of how such diversity of information must be processed
and integrated to result in motivation (both response selection and action vigor) is shown in
Fig. 1. Here, we organize the problem into a single, highest order concept that motivated
behaviors represent the actions associated with the highest net value that results from a cost–
benefit analysis that encompasses all of the potential influencing factors and processes.
The costs associated with behavioral action may include physical effort, mental effort, time,
loss of potential opportunities, discomfort, and danger (the risk of pain and potential death).
The benefits associated with behavioral action might include fulfilling physiological and
psychological needs, obtaining reinforcement secondary to those needs, escaping from harm,
or avoidance of some of the costs listed above. As mentioned above, information entering
the cost–benefit computation for any specific motive will be processed in several ways. The
value of every cost and every benefit must be calculated and encoded. The concept of
encoding value and experimental methods for measuring encoded value are discussed in
detail by Redish et al., in this volume. It is important to consider that value must be encoded
when a goal is obtained and then stored for future retrieval when obtaining that goal again
becomes relevant. When that happens in the current moment, the assessment of value must
be conditioned both on this past experience as well as the current state and environmental
Author Manuscript
conditions. Goals are likely to be obtained with some temporal distance from the initiation,
or even conclusion of behavioral output. Single neuron activity in several brain regions
including orbitofrontal cortex, anterior cingulate, and basolateral amygdala has been shown
to correlate with reward prediction and this work is reviewed by Bissonette and Roesch in
this volume. The encoded values of costs and benefits do not belong in absolute scales
because the values of all costs and benefits are rendered relative to the animal’s current
physiological state as well as the current conditions of the surrounding environment.
Curr Top Behav Neurosci. Author manuscript; available in PMC 2016 December 01.
Simpson and Balsam Page 4
Much has been learned about the role of dopamine in reinforcement learning, and its impact
Author Manuscript
Another aspect of the computation that energizes specific action has to do with signals that a
Author Manuscript
particular goal is currently available. These signals occur on multiple timescales. Specific
times of day can become associated with the opportunity to obtain specific goals, and
discrete cues can signal the opportunity to achieve a goal as well as what specific ways there
are to achieve it. For example, when meals occur at a regular time of day, there are
behavioral, hormonal, and neural changes that occur in anticipation of a meal time that give
rise to the motivation to seek food (Antle and Silver, in this volume). Encountering a
restaurant can activate the specific behavioral sequences that lead to the ordering of food and
the specific foods themselves can activate specific consummatory responses. All along this
sequence of temporally organized behavior, there are concomitant changes in hormonal and
neural states that energize and guide action (Woods and Begg in this volume).
After effective encoding of all the relevant costs and benefits, a computational process (the
Author Manuscript
cost–benefit computation) is required to resolve the appropriate direction and vigor of action
to be taken. This complex interplay of factors and processes is schematized in Fig. 1.
response selection and determine action vigor. Do all factors enter into a singular, highly
complex equation, as our simplified diagram (Fig. 1) may seem to imply? Or do some
systems continually run in parallel, with behavioral output as the result of a hierarchical
switching from one system to another? Or perhaps there is fluctuation in the degree to which
different factors influence the computation, e.g., the relative weights of physical and mental
costs depend on the energy state of the organism.
Curr Top Behav Neurosci. Author manuscript; available in PMC 2016 December 01.
Simpson and Balsam Page 5
Furthermore, it is possible that these alternative regulatory schemes are not mutually
Author Manuscript
Above we have described the complex situation of many different factors influencing a
single motive. It must also be recognized that at any given time, there may be competition
for multiple goals and that imbalances in the strength of the motivations for each goal can
cause conflict and dysfunctional behavior. The chapter by Cornwell et al. describes how
human well-being depends not only on satisfying specific motives, but also on ensuring that
motives work together such that no individual motive is too weak or too strong. It is
becoming clear that different motivational systems have control elements that are unique to
each system but that there may also be common substrates, perhaps close to the final steps
that determine behavioral output. This is well illustrated in the chapter on defensive
motivation by Campese et al. and in the chapter on social motivation by Caldwell and
Alders. Again, the neurobiological mechanism whereby different motive systems interact is
an important but not yet well-understood problem. Of particular interest will be to
Author Manuscript
understand how defensive motivations interact with appetitive ones. The vast majority of
modern work on motivation concerns itself with the mechanisms of appetitive motivation.
Campese et al. show how to leverage what is now known about fear learning to understand
the neurobiological mechanisms of defensive motivations. In a similar vein, Cornwell et al.
argue for the importance of understanding how promotion/prevention motives in humans is
an important modulator of other motives. Hopefully, the future will include a greater focus
on understanding defensive motivations.
research reviewed includes clinical, experimental, and comparative psychology; and several
neuroscience subfields including, cognitive, molecular, cellular, behavioral, and systems
neuroscience. This means that specific questions or single hypotheses can be, and often are
being, approached at multiple levels of analysis. Indeed, it is when research programs
combine a number of techniques, or use information derived from a few different techniques
to propose (and test) new hypotheses that the most compelling results are obtained. For
example, the work described by O’Doherty in this volume includes the use of human fMRI
studies to investigate potential action-value signals that have been proposed from rat
Curr Top Behav Neurosci. Author manuscript; available in PMC 2016 December 01.
Simpson and Balsam Page 6
computational models of decision making and tests these models by measuring neuronal
activity during deliberative behavior. In the chapter by Ward, the approach to testing
motivational deficits in mice has very much been informed by the data from molecular and
clinical studies in humans. By phenocopying in mice the molecular changes that have been
detected in patients using PET imaging techniques, the behavioral consequences can be
probed under well-controlled conditions. In a similarly translational manner, the research
described by Robinson et al. in this volume applies electrophysiological and optogenetic
techniques in rodents to probe behaviors that are altered in people with addictions. In the
chapter by Barrus et al., the authors discuss the development of rodent paradigms designed
to test various psychological theories of substance use and gambling disorders.
When multiple levels of analyses are used to investigate motivational processes, a critically
important concept becomes apparent. While the evolution of traits that support motivation
occurs at the level of molecules, proteins, cells, and circuits, it is the entire organism, and its
interaction with the environment that is selected. An example of this concept is easily seen
in the research on circadian modulation of motivation (Antle and Silver) and in the work on
motivation for eating (Woods and Begg). For example, in the case of feeding we know many
of the molecules and circuits involved in both the intrinsic, homeostatic factors which drive
the motivational to eat, such as hormones and peptides, and we also know the
neuromodulators and circuits that are responsible for some of the extrinsic/environmental
influences on eating such as predictive cues. We are beginning to understand how these
signals are integrated in order for decisions to be made and behavioral responses to occur;
though as described above, understanding the mechanism of integration is currently a critical
Author Manuscript
area of research.
differences. These differences occur because as mentioned above, there are many
components involved in motivated behavior and each of them represent potential
vulnerabilities that may be involved in different pathophysiological mechanisms. An
excellent review of the similarities and differences in mechanisms underlying motivational
deficits in depression and schizophrenia is provided by Barch et al. in this volume. The
central difference in these types of pathologies is that many depressed patients suffer from
impairments of in-the-moment hedonic reaction. Such anhedonia can diminish an
individual’s capacity for anticipation, learning, and effort. In contrast, patients with
Curr Top Behav Neurosci. Author manuscript; available in PMC 2016 December 01.
Simpson and Balsam Page 7
There are also separate chapters that go into more specific detail for each of these
pathophysiological conditions. An update on candidate pathomechanisms for motivational
deficits in depression is provided by Treadway’s chapter. This volume devotes two chapters
to the topic of motivation deficit in schizophrenia because this area of research has been
more active than it has been in depression. This is likely because antipsychotic medications
that successfully ameliorate the positive symptoms of schizophrenia (delusions,
hallucinations, etc.) have been available for some time, leaving patients with the residual
negative symptoms, of which a motivation is the primary driver of poor outcome and low
quality of life (Kiang et al. 2003).
Author Manuscript
Current concepts of motivation deficits and how motivation is assessed in patients with
schizophrenia is reviewed by Reddy et al. Waltz and Gold extend these concepts into the
exploration of the relationship between a motivation and the representation of expected
value. The clinical research reviewed in the chapters that deal with apathy and motivation in
humans is complimented by a chapter on methods for dissecting motivation and related
psychological processes in rodents (Ward). Research using animal models is critical for
several obvious reasons, including the availability of genetic manipulations, molecular
modifications as well as invasive in vivo monitoring procedures that are not possible in
human subjects. What hasn’t previously been obvious is how well we can use such animal
models to investigate the various components of motivation that are particularly relevant to
human disease. Ward describes such procedures and explains how best to leverage our
current clinical knowledge using state-of-the-art mouse models.
Author Manuscript
On the flip side of apathy may be when motivation for a specific goal can come to dominate
action in maladaptive ways as appears to be the case in addictions. Excessive behavior for
many types of rewards including drugs, food, gambling, and sex can be problematic. In
addiction, rapid and strong learning about what leads to reward, excesses in experiencing the
hedonic value of rewards, exaggeration in representing those values, and dominance in being
guided by those representations can all lead to significant narrowing in the diversity of
motives. Several theories exist that attempt to explain the process of addiction in terms of
disruption of motivational processes. Each theory differs in the emphasis on which specific
aspects of motivation are primarily affected. The chapters by both Meyer et al. and Robinson
et al. describe the motivational processes underlying substance abuse disorder. The chapter
by Barrus et al. extends this discussion into the field of gambling. Barrus et al. suggest that
Author Manuscript
many of the processes affected in gambling are the same as those affected in drug addiction,
and therefore, the paradigms that have been successfully used to study drug addiction in
animal models can be successfully modified to identify neurobiological mechanisms related
to gambling. The central hypothesis in these analyses of addictions of drugs and gambling
(as well as addiction to food and other things) is that an aberration in reward processing
and/or in the control by cues associated with these rewards underlies the problematic nature
of addictive behavior and its resistance to change.
Curr Top Behav Neurosci. Author manuscript; available in PMC 2016 December 01.
Simpson and Balsam Page 8
8 Treatments
Author Manuscript
We are hopeful that the great progress in understanding the neurobiology of motivation
described in this book will influence new ideas that will lead to novel pharmacological,
physiological and psychological/psychosocial approaches to treatments for disorders of
motivation. The identification of novel pharmacological treatments is dependent on the
ability of preclinical researchers to investigate potential targets and screen potential
candidate compounds using truly meaningful endophenotypic assays. The chapters in this
volume that describe clinical studies of patient with disorders of motivation describe how
motivation has been dissected into a number of component processes and the specific
processes that are selectively disrupted in disease have been identified (Reddy et al., Barch
et al., Waltz and Gold). To identify drugs that will be effective for disorders of motivation,
preclinical assays must focus on the same specific processes affected in humans (see Ward in
Author Manuscript
this volume). A recent example of the development of the kind of research tools that are
needed for the purpose of investigating potential treatment targets is the strategy of
dissecting goal-directed action from arousal by modifying previously existing rodent
behavioral tasks (Bailey et al. 2015a). These new tools can then be used to assay specific
effects of drugs that affect novel treatment targets (Simpson et al. 2011) and Bailey et al.
(2015b). This novel approach was directly inspired by the literature on the selectivity of
processes disrupted in humans with disorders of motivation.
has been used to treat essential tremor, Parkinson’s disease, treatment refractory major
depression, severe obsessive–compulsive disorder, and chronic pain for several years.
Several other applications are in experimental stages, including clinical trials for pervasive
addiction and symptoms of schizophrenia. Such an invasive procedure requires many
successive small-scale clinical trials before optimal procedures can be successfully
developed. A significantly less invasive procedure used to modulate brain activity is
transcranial magnetic stimulation (TMS). While the mechanism(s) by which TMS alters
neuronal function and network activity is not understood, due to its noninvasiveness,
Curr Top Behav Neurosci. Author manuscript; available in PMC 2016 December 01.
Simpson and Balsam Page 9
hundreds of clinical trials have been conducted for a long list of neuropsychiatric conditions,
Author Manuscript
Lastly, we are also hopeful that the emerging understanding that there are multiple systems
driving motivation on an organismal level will lead to the development of treatment schemes
that are more comprehensive than those that have been developed in the past. It may be that
subtle adjustments in several of the factors that are involved in disorders of motivation (the
endocrine system, circadian system, neurotransmitter function, etc.) can result in greater
improvements and less side effects than treatments that focus on a single system.
References
Bailey MR, Jensen G, Taylor K, Mezias C, Williamson C, Silver R, Simpson EH, Balsam PD. A novel
Author Manuscript
strategy for dissecting goal-directed action and arousal components of motivated behavior with a
progressive hold-down task. Behav Neurosci. 2015a; 129:269–280. [PubMed: 26030428]
Bailey MR, Williamson C, Mezias C, Winiger V, Silver R, Balsam PD, Simpson EH. The effects of
pharmacological modulation of the serotonin 2C receptor on goal-directed behavior in mice.
Psychopharmacology. 2015b10.1007/s00213-015-4135-3
Barch DM, Treadway MT, Schoen N. Effort, anhedonia, and function in schizophrenia: reduced effort
allocation predicts a motivation and functional impairment. J Abnorm Psychol. 2014; 123:387–397.
[PubMed: 24886012]
Duffy E. The psychological significance of the concept of arousal or activation. Psychol Rev. 1957;
64:265–275. [PubMed: 13494613]
Gremel CM, Costa RM. Orbitofrontal and striatal circuits dynamically encode the shift between goal-
directed and habitual actions. Nat Commun. 2013; 4:2264. [PubMed: 23921250]
Hebb DO. Drives and the C.N.S. (conceptual nervous system). Psychol Rev. 1955; 62:243–254.
[PubMed: 14395368]
Hull, CL. Principles of behavior: an introduction to behavior theory. D. Appleton-century company;
Author Manuscript
Oxford: 1943.
Kiang M, Christensen BK, Remington G, Kapur S. Apathy in schizophrenia: clinical correlates and
association with functional outcome. Schizophr Res. 2003; 63:79–88. [PubMed: 12892861]
Kocabicak E, Temel Y, Hollig A, Falkenburger B, Tan S. Current perspectives on deep brain
stimulation for severe neurological and psychiatric disorders. Neuropsychiatr Dis Treat. 2015;
11:1051–1066. [PubMed: 25914538]
Kringelbach ML, Jenkinson N, Owen SL, Aziz TZ. Translational principles of deep brain stimulation.
Nat Rev Neurosci. 2007; 8:623–635. [PubMed: 17637800]
Lefaucheur JP, Andre-Obadia N, Antal A, Ayache SS, Baeken C, Benninger DH, Cantello RM,
Cincotta M, de Carvalho M, de Ridder D, Devanne H, di Lazzaro V, Filipovic SR, Hummel FC,
Jaaskelainen SK, Kimiskidis VK, Koch G, Langguth B, Nyffeler T, Oliviero A, Padberg F, Poulet
E, Rossi S, Rossini PM, Rothwell JC, Schonfeldt-Lecuona C, Siebner HR, Slotema CW, Stagg CJ,
Valls-Sole J, Ziemann U, Paulus W, Garcia-Larrea L. Evidence-based guidelines on the therapeutic
use of repetitive transcranial magnetic stimulation (rTMS). Clin Neurophysiol. 2014; 125:2150–
Author Manuscript
Curr Top Behav Neurosci. Author manuscript; available in PMC 2016 December 01.
Simpson and Balsam Page 10
diminished expression clusters predict clinical presentation and functional outcome. J Psychiatr
Res. 2013; 47:783–790. [PubMed: 23453820]
Author Manuscript
Timberlake, W. Motivational modes in behavior systems. In: Mowrer, RR.; Klein, SB., editors.
Handbook of contemporary learning theories. Erlbaum Associates; Hillsdale: 2001. p. 155-209.
Udupa K, Chen R. The mechanisms of action of deep brain stimulation and ideas for the future
development. Prog Neurobiol. 2015
Author Manuscript
Author Manuscript
Author Manuscript
Curr Top Behav Neurosci. Author manuscript; available in PMC 2016 December 01.
Simpson and Balsam Page 11
Author Manuscript
Author Manuscript
Fig. 1.
A simplified diagram of the influencing factors and processes that are involved in
motivation. This framework of motivation places cost–benefit analysis central to the concept
of motivation. Three major categories of factors are known to influence motivation: the
individual’s physiological state, the environment, and the individual’s past history.
Information about all 3 categories of factors will be subject to a number of processes
(represented inside the blue oval), including evaluation and encoding. In almost all
Author Manuscript
circumstances, the motive, environment, and physiological state will not be novel; therefore,
information will also undergo learning and retrieval processes. All of the combined
processes result in weighting of all the costs and benefits related to the motive, and the
output of the cost–benefit calculation will impact upon the direction and vigor of action that
the individual takes toward the motive goal
Author Manuscript
Curr Top Behav Neurosci. Author manuscript; available in PMC 2016 December 01.