Académique Documents
Professionnel Documents
Culture Documents
\302\251
1977by John
Wiley
Canada.
Reproduction or translation of any part of this work beyond that of the 1976United States Copypermitted by Sections 107or 108 Act without the permission of the copyright owner is unlawshould be Requests for permission or further information addressed to the Permissions Department, John Wiley & Sons, Inc.
Copyright unlawful.
Library
in Publication
Data:
Self-organization in nonequilibrium
publication.\"
systems.
Bibliography: p. Includes index. Self-organizing systems. 2. Chemistry, 3. Biological chemistry. Physical and theoretical. 4. Nonequilibrium Phenomena. 5. Fluctuation Theory. Title. Prigogine, Ilya, joint author.
1.
I.
76-49019
II.
of America.
10
98765432
Contents
General Introduction
ART
I.
19
26 26
27
3. Thermodynamicsof IrreversibleProcesses: The Linear Region 3.1. Gibbs's Formula: Entropy Production, 31
3.3. Symmetry 3.4. Stationary Nonequilibrium States, 41 3.5. Theorem of Minimum Entropy Production,
3.7.Diffusion,
45 Processes, Range of Irreversible 46 Coefficients, 39
31
42
Nonlinear Thermodynamics Introduction, 49 4.2. The GeneralEvolution Criterion, 50 4.3. Evolution Criterion and Kinetic Potential, 4.4.Stability of Nonequilibrium States. Structures, 55 Dissipative
4.1.
49 51
vi
Contents
PART
II.
5. Systems Involving
Stability
6.
Mathematical Tools Introduction, 70 6.2. Theory of Bifurcations, 70 6.3. Stability Theory, 71 6.4. Theory of Catastrophes, 74
6.1.
6.5. Homogeneous Systems Involving Two Variables, 6.6. Branchings,Bifurcations, and Limit Cycles, 83
7. SimpleAutocatalytic Models
76
7.1.Two Intermediates, 90
7.4. 7.5. 7.7.
90
7.2. The Trimolecular Model(the \" Brusselator \,") 93 7.3. Scaling,SteadyStates,and Boundary Conditions, 94
Linear Stability Analysis, 96 Bifurcation of Steady-state Dissipative
7.6. Bifurcation: FixedBoundary Conditions, 109 7.8. Qualitative Propertiesof Dissipative Structures 7.9. Successive and Secondary Instabilities
in Vicinity
113
115
Bifurcations, 120 7.10. with ComputerSimulations, 124 Comparison 7.11. Localized Structures, 131 Steady-state Dissipative 7.12. Bifurcation of Time-periodic Dissipative Structures, 140 7.13. Qualitative Propertiesof Time-periodic
Structures, 147 Dissipative PeriodicGeometries, 153 7.15. The Brusselator as a Closed System, 156 7.16. Remarks, 158 Concluding
Contents
8. SomeFurther
Aspectsof DissipativeStructures and Self-organizationPhenomena Introduction, 160 8.2.Conservative Oscillations, 160 8.3.SimpleModelsGiving Rise to Limit Cycles, 165 8.4. Multiple SteadyStatesand All-or-none Transitions, 169 8.5.Two-dimensionalProblems, 178 8.6.SystemsInvolving Morethan Two Chemical Variables, 192 8.7. CoupledOscillators, 195 8.8.Heterogeneous Catalysisand Localized Transitions, 197 8.9. SystemsInvolving Photochemical Steps, 200 8.10. Some Further Methodsof Analysis of Reaction-Diffusion Equations, 202 Thermodynamic Aspectsof Dissipative
8.1.
160
8.11.
Structures,
PART
212
9.1.
223
239
10.2. Limitations of Birth-and-death Formalism, 241 Some 10.3. Methodsof Analysis of Birth-and-death 10.5. SimpleExamples, 257 10.6. Variables: Systems Involving Two Stochastic
10.7. Remarks, Concluding
The Lotka-VolterraModel, 264 272 252
vili
Contents
11.Effectof Diffusion:Phase-space Descriptionand Multivariate MasterEquation 273 for a LocalDescription 11.1. of Necessity Fluctuations, 273 11.2. of Fluctuations, 274 Phase-space Description A SimpleModel, 276 11.3. 11.4. Approximate Solutionof MasterEquation, 280 MolecularDynamicsStudiesof Fluctuations, 283 11.5. 11.6. Discussion, 284 11.7. Reduction to a Multivariate MasterEquation in Concentration Space, 285 The Multivariate MasterEquation in a Model 11.8. System, 289 in the Trimolecular 11.9. SpatialCorrelations Model, 297 11.10. Critical Behavior, 302 11.11. Remarks, 309 Concluding
12. A \" Mean-field\" Descriptionof Fluctuations:
313 Nonlinear MasterEquation Introduction, 313 12.2. Derivation of Nonlinear MasterEquation, 314 12.3. Further Propertiesand Moment Equations, 317 12.4.Onsetof a Limit Cycle, 319 12.5. Onsetof a SpatialDissipative Structure, 324 Transitions and 12.6. Multiple Steady-state Metastability, 327 12.7.Asymptotic Solutionsof Nonlinear Master Equation, 331 12.8. Remarks, 334 Concluding
12.1.
BIOLOGICALSYSTEMS
13.Self-organizationin ChemicalReactions 13.1. Introduction, 339 13.3. Mechanism, 343 13.4. 345 The\"Oregonator\", 13.5. Oscillatory Behavior, 347
13.6. SpatialPatterns,
13.7.Briggs-Rauscher Reaction,
351 Experimental Facts, 339
339
352
Contents
ix
14. RegulatoryProcesses at the Subcellular Level 14.1. MetabolicOscillations, 354 14.2. The Glycolytic Cycle, 354 14.3. Allosteric Modelfor Glycolytic Oscillations, 358 14.4. Limit-cycleOscillations, 369 14.5. Effectof External Distrubances on Limit-cycle 371 Oscillation, 14.6. Patterns of Spatiotemporal Organization in
14.7. of cAMP, Periodic Synthesis
354
Allosteric Enzyme Model, 375 379 Reactions Involving Membrane-bound 14.8. Enzymes, 382 of Metabolic 14.9. PhysiologicalSignificance Oscillations, 384 387
15.Regulatory Processes at CellularLevel 15.1. Introduction, 387 15.2. LacOperon, 388 15.3. Mathematical Modelfor Induction of
All-or-none Transitions, 391 15.4.
M-Galactosidase,389
16. Cellular Differentiation and Pattern Formation 409 16.1. 409 Introductory Remarks, 16.2. Positional Information, 410 16.3. Mechanisms Involved in Positional Information, 413 16.4. Structures and Onsetof Polarity, 415 Dissipative A Quantitative Model, 416 16.5. 16.6. Positional Differentiation, 421
16.7. Applications,
424 PART V. EVOLUTIONAND POPULATIONDYNAMICS
429 429
Contents
446
18. Thermodynamicsof Ecosystems 18.1. Introduction, 448 BasicEquations, 448 18.2. 18.3. Exampleof OrderedBehavior:Organization in
Evolution 18.4.
InsectSocieties, 452 of Ecosystems, 455 of Complexity: 18.5. Structural Instabilities and Increase Division of Labor, 459
462 464
2. 3.
4.
1.
5.
Introduction, 464 Fluctuation Chemistry, 464 Neural and Immune Networks, 466 Immune Surveillanceagainst Cancer, 469 Social and Epistemological Systems Aspects, 472 475 487 489
References
Addendum:Mathematical Problems
Index
Symbols
LATIN
A,B,...
E
ec
f J
k k
A:eq
l\"
Lkl
P
S
So
T
V
of reaction p and final productsin a reaction sequence diffusion coefficient of constituent i diffusion frequency of constituent i internal energy internal energy per unit volume free energy; generating function reducedgenerating function generalized flux equilibrium constant wave number rate constant characteristic length coefficients phenomenological linearized operator of a reaction-diffusion system entropy production;probability distribution entropy entropy density independentvariable in generating function representation temperature; period of oscillation
affinity
initial
volume
AF
\\
wp wki
X,
X
Y,...
volume element constant of motion velocity of reaction p transition probability per unit time variable intermediates in a reaction sequence generalized flux
GREEK
diffusion frequency of constituent ;
equation
in
formalism
xjj
Symbols
@ A
master equa-
ft.
v,
in
reaction p
mass density
entropy-production density surface cumulant generating function eigenvalue; oscillation frequency
2
d,
w
GeneralIntroduction
Finally, a number of novel features relating to the very character of the physical world have beendiscovered recently. We now see Classicalphysicshas emphasized stability and permanence. at such to a limited that, best, qualification appliesonly very aspects.Wherereceived).
Our era is witnessinggreat advances in knowledge in the natural sciences. The dimensions of the physical world that we can explore at present have to truly fantastic proportions. On the microscopic increased scale, elementary of the order reveals processes involving physical dimensions particle physics of 10~15 s.On the other hand, cosmology cm and times of the orderof 10~22 leadsus to times of the order of 1010 years (the \"age\" of the universe)and, therefore, to distancesof the orderof 1028cm (the distanceto the event the furthest distancefrom which physical signalscan be rehorizon, i.e.,
ever we look, we discoverevolutionary processes leading to diversification and increasing complexity. This shift in our vision of the physical world leadsus to investigate branchesof physicsand mathematics that are likely to be of interest in this new context. The main objectof this monograph is to presentan introduction into these new branchesfor a better understanding of the problemof self-organizationin physical or biological systems. Classicalmechanicshas been immensely successfulin dealing with probof classicalmechanics has been concerning trajectories.The scope the formulation of greatly enlargedby quantum mechanics and relativity. But even when suitably generalized, the standard formulation of dynamics makesno distinctionbetweenthe future and the past.The motions \"forward\" and \"backward\" in time are both possible. Yet, without introducing the direction of time, we cannot describeprocesses involving evolution in any nontrivial way. Obviously, new tools are necessary. It is not our purposein this monograph to discuss the relation between the directionof time and dynamics.This is a subject ofa highly technicalcharacter.
problems
General Introduction
Sufficeit to mention that irreversibility, as related to the direction of time, is on the contrary, it by no means in contradiction with the laws of dynamics; of sufficient a follows from these laws whenever degree \"complexity\" is
Independentlyof dynamics, the idea of evolution was introduced in physicsin the 19th century through the so-calledsecond law of thermoIt was noticed that from a purely phenomenological levela basic thermodynamics. distinction had to be introducedbetween \"reversible\"and \"irreversible\" which An example of an irreversible processis heat conduction, processes. leads to a uniform distribution of temperature, if compatiblewith the An example ofa reversibleprocess is wavepropagation, boundary conditions. and The with this distincfriction losses. law deals second energy neglecting It introduces a new between reversible and irreversible processes. as the result of irreversible processes. function, entropy, which increases Clausiusgave a dramatic formulation to this law when he stated that
distinction
reached.*
entropy of the universe is increasing.\" According to this statement, the universe is driven to the \" heat death.\" This is, however,not what we observe around us in the presentstage of the universe or what we can infer from its past so far as it is known to us. There, as already mentioned, we observe continuous diversification and evolution toward complexity. Remarkably, the idea of evolution that appearedin physicsthrough the secondlaw was formulated almost simultaneously in the 19th century in biologyt and the interpretation of this conceptwas % However, as we shall see, sociology. quite different in these various fields. Let us briefly outline the principal stagesof the development of thermothermodynamics. Accordingto the secondlaw an isolatedsystemreachesin time the state of \" thermodynamic equilibrium,\" which correspondsto a maximum entropy. In its most general formulation this law appliesto both equilibrium and nonequilibrium situations. Nevertheless,most of the striking resultsof in the 19thcentury referto equilibrium classical thermodynamicsasdeveloped situations. Well-known examplesare the Gibbs phase rule and the law of massaction, which have become integral parts of every introductory text in physicalchemistry. There may have been various reasonsfor this. Nonequilibrium was conof structure as a perturbation temporarily preventing the appearance considered identifiedwith the orderat equilibrium.To grow a beautiful crystal we require near-equilibrium conditions,and to obtain a good yield from a thermal
\"the
and C.George, Nat. Acad. Sci. and Prigogine, A. P. Grecos, A976), Proc. 73, 1802 (U.S.A.) Celestial Mech., submitted. See alsoa forthcoming monograph by Prigogine. t C. Darwin A859), The Origin of Species, John Murray, London. + H. Spencer A904), Study of Sociology, Paul Kegan, London.
I.
I.
General Introduction
such as friction and heat engine we need to minimize irreversible processes The situation changeddrastically with the appearanceof Onsager's losses. \" discovery of the reciprocity relations,\"*which confirmed that, at least in the neighborhood of equilibrium, thermodynamic methods could provide useful information. This led to an extension of classical thermodynamics that may be approcalled \"linear nonequilibrium thermodynamics\" and that covers the range of situations in which the flows (or rates) of irreversible processes are linear functions of the \"thermodynamic forces\" (e.g., temperature or concentration gradients).A situation to which this linear nonequilibrium thermodynamics applies is thermal diffusion. When we apply a thermal we observean enrichment of one gradient to a mixture of two different gases, at the cold of the components at the hot wall, while the other concentrates wall. As a result, the entropy is generally lower than it would be in a uniform mixture. We see later that Boltzmann's order principle associateslow entropy with order and high entropy with disorder.Therefore, we have here an exampleof a situation where nonequilibrium may be a sourceof order. This observation was the starting point of the outlook pioneeredby the
appropriately
Brussels school.t
However, in the framework of linear nonequilibrium thermodynamics we cannot really speak of new structures.We deal with the equilibrium structures modified by the constraints preventing the system from reaching equilibrium. This was why our group started the investigation of situations in terms further away from equilibrium, that, however,couldstill bedescribed of macroscopic, thermodynamic variables. The main The results have been most unexpected and even spectacular. The rate of situation of interest for us here is the case of chemical reactions. chemicalreactions is generally a nonlinear function of the variables involved concentration or temperature). As the result, a chemically reacting (e.g., mixture is describedby nonlinear equationshaving, in general, more than one solution (even when boundary and initial conditionsare taken into to equilibrium account). Let us then considerthe solution corresponding conditions(this implies maximum entropy for isolatedsystems,minimum Helmholtz free energy for systems at given temperature and volume). We call this solution the \"thermodynamic branch.\" Supposewe now vary the constraints soasto forcethe systemfurther and further away from equilibrium. Then, nonequilibrium thermodynamics leads us to formulate a sufficient condition for the stability of the thermodynamic branch.If this condition is
37, Onsager A931), 11. Prigogine A945), Thesede doctorat,
Phys. Rev.
* L.
405.
Universite Libre de Bruxelles. For a recent historical 59,672. A973), Bull. Acad. Roy. Belt/. Ci. Sci.
account,
seeI.Prigogine
and
P. Glansdorff
General Introduction
not satisfied the thermodynamic branch may become unstable, and the coherent system may evolvetoward a new structure involving behavior^ Suchbehavior has long been known to occurin hydrodynamics. A wellWhen the temperature known example is a pan of liquid heated from below. to some characteristic value, heat passes gradient remains small in respect A s the is the liquid by conduction. heating intensified,however, at a through
certain well-defined temperature gradient regular convection cells appear to a high degree of molecular organization Thesecorrespond spontaneously. transfer of and become energy from thermal motion to possiblethrough T his is the currents. so-called Benardinstability. convection macroscopic the is of the thermodynamic that essential The beyond instability point branch we may have a new type of organization relating the coherent chemical kinetics behavior to the dynamical processes (e.g., space-time feedback conditions and convection) insidethe system. Only_ifjtpgro\302\243riate are satisfiedcan the thermodynamic branch becomeunstable at a sufficient distancefrom equilibrium. The new structures that appear in this way are radically different from the \"equilibrium structures\" studied in classical thermodynamics, such as crystals or liquids.They can be maintained in far-from-equilibriumconditions only through a sufficient flow of energy and matter. An appropriateillustration would be a town that can only survive and as long as it is a center of inflow of food, fuel, and other commodities sendsout productsand wastes. We have introduced the term \"dissipative structures\" to contrast such structures from the equilibrium structures^ Dissipative structures provide a striking exampleof nonequilibrium as a sourceof order. Moreover,the mechanism of the formation of dissipative structures has to be contrasted with that of equilibrium structures basedon Boltzmann's order principle. It was, indeed, Boltzmann* who first pointed out that entropy was a measure of disorderand concluded, therefore, that the law of entropy inincrease was simply a law of increasingdisorganization. In a more quantitative P fashion, Boltzmann related entropy to the \"number of complexions\" through the relation
S = kB\\ogP
A)
where kB is Boltzmann's universal constant. This relation indicates that thermodynamic equilibrium of an isolated system (Smax) correspondsto situations where the number of complexions is maximum. We may extend theseconsiderations to closed systems(which exchange
* L. Boltzmann
A896), Vorlesungen tiber Gastheorie,
J. A.
Barth, Leipzig.
General Introduction
energy but not matter with the outsideworld) at a given temperature. The situation remains similar exceptthat insteadof the entropy S we must now considerthe free-energyfunction F defined by
F
=E
- TS
B)
where E is the energy of the system and T the absolutetemperature (in a minimum value. degrees Kelvin).At equilibrium the free energy reaches The structure of Eq. B) reflectsa competition between the energy E and the entropy S. At low temperatures the secondterm is negligible and the minimum of F imposesstructures corresponding to minimum energy and to low At increasing temperatures, however, the system generally entropy. shifts to structures of increasinglyhigh entropy. sinceat low temperatures we find Experiment confirms thesepredictions the solid state characterized by an ordered structure of low entropy, while at higher temperatures we find the high-entropy gaseousstate. We may, that equilibrium structuresare dominated by Boltzmann's therefore,conclude order as principle expressed through Eqs.A) and B).* Boltzmann's order However, principle is inapplicableto dissipative structures.Consider again the B6nard instability. Boltzmann's principle of a coherent would assignan almost zero probability to the occurrence We then have to convection pattern involving more than 1020molecules. We may imagine that there are introduce quite different considerations. always small convectioncurrents appearingas fluctuations from the average state, but below a certain critical value of the temperature gradient these fluctuations are damped and disappear. On the contrary, above some critical value certain fluctuations are amplifiedand give riseto a macroscopic current. A new molecular order appears that correspondsbasically to a fluctuation stabilized by exchanges of energy with the outside macroscopic of dissipative world. This is the order characterized by the occurrence structures.We call this order \"orderthrough fluctuations\" to contrast it with the Boltzmann order principle, which is basicfor the understanding of
equilibrium structures. The aim of the presentmonograph can now
as the study of be expressed characterized by the appearance self-organizationin nonequilibrium systems, of dissipativestructures through the amplificationof appropriate fluctuations. While relatively new, this field of investigationencompasses already at present a wide range of problems from chemistryto biologyand population dynamics.
* Or,
alternatively,
seeL.D. Landau
through the canonical distribution used in equilibrium statistical mechanics, and E. M. Lifshitz A957), Statistical Physics, Pergamon, Oxford.
6 In
General Introduction
one of the authors (I. Prigogine) Theory of Structure, Stability, and Fluctuations* The aim of this monograph was to outline the thermodynamic theory of nonequilibrium systems in the entire range of macroscopic description,starting from equilibrium and including nonnonlinear situations and instabilities. This monograph contains the thermocriterion for the occurrence of dissipative structures, as well as to situations in applications simple hydrodynamics and chemistry. A great amount of work has sincebeendevoted to this type of problem.Important progresshas been realized mainly in the following directions:
Thermodynamic
thermodynamic
of the thermodynamic branch? and how are they related to the molecular mechanisnisTnvo1ved;aT welhas-tcrtheconstraints \"acting on the are problemsrelated to \" bifurcation th^bTyT^which deals sysTem?(These with the appearance_of new types of solution of differential equations at critical or bifurcation points.) (ii) What is the kineticsof the growth of dissipative structures, and how can fluctuation theory be applied to these nonlinear, far-from-equilibrium
(i) Wha^ happens beyond the instability What are the types of coherent behavior
situations?
(iii) What
are the situations to which we may usefully apply the concepts of dissipative structures and order through fluctuations? to incorporatethese new developments in It would have been impossible the framework of a new edition of the book by Glansdorff and Prigogine. To avoid duplication we Therefore, we decidedto write a new monograph.t the aspects have keptthe thermodynamic theory to a minimum and expanded that could not have been treated adequately in Glansdorff and Prigogine's monograph, as they report the result of work performed sinceits publication. Let us briefly outline the structure of the presentwork. We attempt to Part I is devoted to \"the thermodynamic background.\" of the basic of nonconcise a b ut self-contained give principles presentation on chemical reactions with specialemphasis equilibrium thermodynamics, such as diffusion. coupledto transport processes We The term \"chemicalreactions\" is taken in a general, formal sense. or meet similar equations in different problems,such as the ecological
*A971), Wiley, New York-London; A971), French ed., Masson, Paris; A973), Russian translation, Mir, Moscow, Japanese translation to appear 1976. t An interesting and compact review of some aspects of self-organization can alsobe found in the recent mornograph by Ebeling (Strukturbildung bei irreversiblen Prozessen BSB B.G. Teubner Verlagsgesellschaft, 1976).
General Introduction
solution of such equations,oncesuitable initial and boundary conditions are provided, is notoriously difficult. In general, there existsmore than one solution. It is here that thermodynamics singlesout a special solution, namely, that correspondingto the \"thermodynamic branch\" as defined above. When we permit the system to deviate from equilibrium, new solu\" may or may not replacethe thermodynamic branch.\" Distancefrom thermodynamic equilibrium then becomesthe natural parameter in disthe appearance of new types of solution. discussing The main problemdiscussed in Part IIof this monograph is the question of how to construct solutionsthat occurwhen the thermodynamic branch becomes unstable.We first discussthe conceptof stability, which plays such an important role in our whole approach(Chapter 5).In equilibrium thermowas Gibbs.* introduced Stability can be easily thermodynamics, stability theory by formulated and discussedin terms of thermodynamic potentials such as we know that the systemis in a state of minimum entropy or freeenergy.Once free energy, we may concludethat it is stable.Even if a fluctuation would drive it momentarily away from the equilibrium state, the system would respondby loweringits free energy till it reachesagain the equilibrium value. The situation is radically different in the nonequilibrium situations of ininterest to us here, as there existsin general no potential whosevalue would characterize the state of the system. It is for this reasonthat stability theory plays an important role. of new patterns The natural approachto the problemof the emergence is in terms of the bifurcation theory. The purposeof this theory is to study the possiblebranching of solutions that may ariseunder certain conditions. We have tried to presenta readableintroduction to this rapidly expanding field and have not always presented proofs of theorems that are easily
solutions
The time evolution of systems involving chemical reactionsand diffusion The is described by a set of couplednonlinear partial differential equations.
in textbooks. accessible
Our main emphasisis in physical examples and in simplebut representamodels,and our aim is to give to reader an idea of the variety of structures that may arise through bifurcation. We may find space-time \"chemicalclocks,\" to time independentbut coherent states corresponding spatiallyinhomogeneousdistribution of matter, or chemicalwavespresenting a considerable variety. We are far from the situations studiedin linear matheto a where the equationslead,together with the boundary conditions, single solution.This multiplicity of solutions in nonlinear systems correrepresentative
mathematics
corresponds
* J.W. Gibbs
A928), CollectedWorks, Longmans, New York. For a more general formulation, and Prigogine A971), Chapter 5.
General Introduction
Besides bifurcation theory, in Part IIwe presenta survey ofother techniques suitable to study the appearanceof new structures, where the \"catastrophe theory\" due to R. Thorn is of specialinterest. However, for most of the with in this monograph this method is not problemsthat we are concerned rate equationsgenerally do not derive from applicable, notably becausethe a potential. The role offluctuations Part IIdealsentirely with \"deterministic\" methods. is the the the proIII. T his of where is studiedin Part probably part theory the most over the last where new and has been spectacular years progress in the near future. are expected developments molecules The systemswe considerconsistof a large number of units (e.g., in a liquid, cellsin an organism, and neurons in the brain). Obviously, all of these units cannot be in the same state; therefore, a macroscopic system spontaneously generates\"noise,\" which plays somewhat the roleof perturin stability theory. But here the perturbations are generatedby the itself system (in addition, we have fluctuations introducedby the external medium). We have to expectthesefluctuations to play an especially important role near bifurcation points.Thus, the system has to \"choose\" oneof the possible stablebranchesof the macroscopic equations.But nothing in the macrofor Therefore,stochastic equations justifiespreference any onechoice. elements must be taken into account, and we need a finer description involving fluctuations. We have, therefore, to consider standard techniques such as Markov to include fluctuations. However, in the chains or birth-and-death processes problemsof interest to us somequite specificnew features appear.The usual for which the transition examplesin Markov chains refer to processes are constant (i.e., {to the \"left\" and to the \"right\") or linear probabilities functions of the stochastic variables. On the contrary, here we have to considernonlinear chemical equations, and the transition probabilities nonlinear functions of the fluctuating become variables. The theory of fluctuations at equilibrium is well known.* Of special formula for the probability distribution of fluctuaimportance is Einstein's which correspondsto the inversion of Boltzmann's definition of entropy. It expressesthe probability of a state (related to the number of distribution to its entropy. Einstein's formula leadsto a Poisson complexions) for fluctuating variables in ideal systems. We show that this result remains valid for nonequilibrium situations when linear chemical equations are involved. However, for nonlinear situations the whole picture changes.
perturbations macroscopic
fluctuations,
General Introduction
The probability distribution of the fluctuations dependson their size and conditionsthat prevail in the system. In a suffirange and on macroscopic small scale we obtain, indeed,a nearly Poissondistribution, while witrTmcreasingrange the fluctuations deviate from a Poissondistribution. Thesedeviations become near a bifurcation point where speciallyspectacular correlations The long-rangespatial appear. analogy betweennonequilibrium instabilities and phase transitions is striking. Much of the recent statistical theory of phasetransitions and critical behavior finds here a direct analog. in time and finally Beyond the instability, the statistical fluctuations increase drive the average values to their new macroscopic state. We seehere very clearly the meaning of the conceptof orderthrough fluctuations that wehave as already mentioned in this introduction. We may considersuch processes When this law is a of the of breakdown \"law numbers.\" large expressing satisfied the average provides an adequatedescription of the system. Here, on the contrary, fluctuations drive the averages. There are even classes of nonlinear phenomena involving no phase transition where fluctuations may play a much more important role than Forexample, thus far supposed. in explosions dueto freeradical propagation, the conditions for the explosion in a domain small from be first satisfied may of view while the macroscopic still containing a large number of point molecules. This leads to a kind of new \"fluctuation chemistry\" which we discussbriefly in the concluding chapter. of selfWe now turn to Parts IV and V, which discussspecificexamples organization chosenin various fields of interest from chemistry to socioAgain, the situation has greatly changed sincethe publication of the biology. were when few examples monograph by Glansdorff and Prigogine in 1971, known. Now so much material has becomeavailable that we had to make a choicebetween the most important features of self-organization in nonsufficiently
systems.* the existence of oscillating chemicalreactions in a homohomogeneous phase was a matter of controversy. It is true that Lotkat and VolterraJ had introduceda kinetic schemeof an oscillatory reaction in the context of the competition between prey and predator (see ecological in Chapter8, this schemeleadsto a set However, as discussed Chapter 18). of periodicmotions, each with a different period. As a result, it cannot be usedto model chemical reactionswith a well-definedperioddetermined by
equilibrium
of nonequilibrium phenomena is not stability of interfaces in the presence discussed. SeeT. S.Sofensen, M. Hennenberg, A. Steinchen-Sanfeld and A. Sanfeld A976), Progr. Coll. Pol.Set,61,64. t A. Lotka A920), Proc. Nat. Acad. Sci. 6, 420. (U.S.A.), + V. Volterra A936), Lemons sur la Theorie Mathemalique dela Lullepour la Vie, Gauthier-Villars, Paris.
General Introduction
temperature. Fortunately, today we know oscillatory chemical reactions such as the Belousov-Zhabotinski reaction, which presents striking features of selfand whose mechanismhas beenlargely elucidated the organization through work of Noyesand his school. While vastly more complex, the kinetic scheme to the Belousov-Zhabotinski reaction presentsa qualitative corresponding behavior closelyrelated to the simplemodelstreated in Part II,and there is no doubt that the spatial and temporal self-organizationpatterns may be explainedin terms of dissipative structures arising in far-from-equilibrium
conditions.
A
is devoted to self-organization in
biological problems. Even in the simplest cells, the metabolic function involves several thousands of coupled chemical reactionsand requires,therefore, delicate mechanisms for coordinationand regulation. In other words,we need an functional organization. Furthermore, the metabolic extremelysophisticated reactions require specific catalysts, namely, the enzymes. Each enzyme performs onespecifictask, and if we considerthe manner in which the cell of operations,we find that it is organized on performs a complexsequence There Chapter 14). exactly the samelines as a modern \"assemblyline\" (see is a definite relation between structure as expressed in space-time patterns and function. Biological orderis both architectural and functional.* But that is preciselythe type of order characterizing dissipative structures, which by the chemicalprocesses) appearas the result of their function (asdescribed in far-from-equilibriumconditions. in this Therefore, it is of specialinterest to apply the approachdeveloped Let us emphasize that there is a striking monograph to biological problems. of even the simplestcell and differencebetween the chemical composition
its environment (remember that the average molecular weight of a protein is ~ 105, We are in a sensein the positionof a while that of water is 18). visitor from another planet who, finding a suburban house, wishes to understand its origin. Of course, the houseis not in conflict with the laws of the otherwise it would have fallen down.However,this is besides mechanics, point, namely, what is of interest is the technology available to the house the needsof the occupants, and so on.The housecannot be underbuilders, outsidethe culture in which it is embedded. in biology. This is precisely our positionin respectto problems While each of the important biomolecules discoveredin the recent years is obviously
understood
New Press.
by
some biologists.
York.
\"The
General Introduction
11
formed accordingto the laws of physicsand chemistry, we have to identify the mechanismsthat make the \"mass production\"of thesemolecules possible and coordinatetheir productionaccordingto the needs of the organism. It has often been stated that biologicalorganization requiresa series of structures and functions of growing complexity and hierarchical character. One of our main concerns is to understand the way in which transitions betweenlevelsoccurand to relate the molecular levelto the supermolecular The examples in Parts IV and V one,and the cellular to the supracellular. show that this problemcan be formulated and in somecases solved using the methods we have introduced. We start with two chapters(Chapters14 and 15)devoted to regulatory at the subcellular level (e.g., thoseinvolved in the glycolyticcycle) processes and at the cellular level (e.g., thoseinvolved in the lac operon). is a phenomenon of the greatest importance for the energetics Glycolysis of living cells. It leads to the production of ATP molecules(adenosine which becauseof their high energy content play an important triphosphate), rolein the synthesis of biomolecules. Now glycolytic oscillations, that is, in time of the chemical components oscillations involved in the glycolytic and extensively cycle,have beendiscovered by B.Chanceand his co-workers Hess and his B. school since, investigated (seeChapter 14 for notably by detailed references).It appeared immediately that becauseof their reprocould only be modeledby kinetic schemes ducibility glycolytic oscillations presentingdissipative structures (and not by the Lotka-Volterratype of equations).This was, then, the first examplein biology where the roleof a temporal dissipative structure could unambiguously be recognized.* Hence,the glycolytic cycle takes place beyond the stability limit of the thermodynamic branch. It is quite remarkablethat some of the most spectacularaspectsof biosuch as control of cellular division (seeChapter 15)or biological activity, cellular differentiation and morphogenesis (Chapter 16)can, at present,be modeledin terms of dissipative structures.Instability in respectto diffusion plays an essentialrolehere as it may generate a privileged axis of polarity
starting from an
The question of stability with respectto diffusion was first investigated by Turing A952)in a remarkable paperon the chemical basisof morphogenesis. This was one of the first examplesof dissipative structures ever studied. However, this work remained unknown outside the context of morphoand even there was severely criticized on various grounds (see Chapter 16).These criticisms originate from a somewhat unfortunate
morphogenesis,
isotropicstate.
223.913.
I.Prigogine,
R.
A969), Nature
12
General Introduction
the rate positive and boundedsolutionsis not satisfied).We see now that this criticism doesnot touch the essential point.In fact, Turing's is one of the most striking phenomena associated with the breakinstability of the stability of the thermodynamic branch. The spectacularprogress of molecular biology has been of utmost importance in the formulation of our approachto self-organization.Indeed, a preliminary condition for the study of the relation between function and of the chemicalmechanismsinvolved. structure is a detailed knowledge our However, approachemphasizes supplementary aspects.Forexample, an instability can occuronly if suitable conditions on the sizeof the system While the genome producesthe morphogens, are satisfied. the morphogens to the of a lead if certain conditions on the appearance may polarity only cell as a whole are satisfied.If so, back on the then act genome and they may lead to a morphogenetic differentiation. There is a deep and unexpectedrelation between the \"chemistry\" as studiedby molecular biology and the \"space-time structure\" as determined the mathematical of the kinetic by properties equations when various conditions are satisfied.It is this relation betweenchemistry,thermodynamics and mathematics that is so fascinating in the study of self-organization. There seemsto be no doubt that dissipative structures play an essential rolein the function of living systems as we see them today. What was the roleof dissipative structures in evolution? It is very tempting to speculate ofinstabilities that prebiotic evolution corresponds essentiallyto a succession are discussed to an level of These questions leading increasing complexity. in Chapter 17, where the conceptof competition is formulated in molecular terms. Herewe make contact with the important work of Eigen on the evolution of interacting and self-replicatingmacromolecules. In very general terms, evolution may be viewedas a problemin structural stability. The fluctuations involved are not fluctuations in concentrations or other macroscopic but fluctuations in the mechanismsleading to parameters modificationsof the kinetic equations.To clarify our point, let us consider a chemical scheme somepolymerization processwhere polymers describing are constructedfrom molecules A and B that are pumpedinto the system. Supposethe polymer has the following molecular configuration
equationsmust
breakdown
admit
ABAB...
erroroccurs and a modified polymer appearssuch as
ABAABBABAB... Supposethe reaction producingthis polymer is autocatalytic. Then
if
an
General Introduction
13
it may multiply in the system as a result of a modified autocatalytic mechWill this new product die out, or will it take over (with the initial This is the type of question in which fluctuations and polymer dying
mechanism.
structural stability play a significant role.Similar questionsare essential to the understanding of the evolution of ecosystems, the generation and the propagationof \"innovations,\" and similar phenomena (seeChapter 18). Most of the other examples studiedin Chapter 18 refer to the realization of collective tasks in insect societies nest building) and provide striking (e.g., illustrations of the conceptof \"orderthrough fluctuations.\" Note that we may always introduce fluctuations that will lead to instaand to new types of function and structure. In other words,no system is structurally stable, the evolution of a dissipative structure is a selfto the scheme determining sequence according
instabilities
out)?
Function
> <
Structure
Fluctuations to concludethis introduction with a few general remarks. our approach combinesboth deterministic and we have emphasized, elements in the time evolution of the macroscopic probabilistic system.At whereasnear far from the deterministic bifurcation, equationssuffice, points essential. the bifurcation points the stochastic elements become For A similar distinction was introduced some time ago by sociologists. between the distinction example,Carneiro,following Spencer, emphasized quantitative and qualitative changesin culture. He distinguished cultural development, in which new cultural traits are coming into being, from cultural growth. In our terminology,cultural developmentwould correspond to instabilities in which stochasticeflects play a basic role, while cultural growth correspondsto \"deterministicdevelopments.\"We do not go into further detail here, as these aspectsare analyzed in another work, where detailedreferencesto the work of Carneiroand Spencer are given.* Before any interpretation of functional orderof comparablegenerality to equilibrium order was available, \"living\" processes were in somesense nature\" and physical laws.One was tempted to ascribean pushed\"outside accidental character to living organismsand to imagine the origin of life as being the result of a seriesof highly improbable events. Now, in classical
We would like As *
I.Prigogine, P. Allen,
Nature,\"
and R. Herman A977),\"The evolution of complexity and the Laws of Report to the Club of Rome, ed.by E. Laszlo and J. Bierman.
14
General Introduction
dynamics a sharp distinction is made between \"events\" and \"regularities.\" The laws of dynamics deal with regularities betweenevents but not with the events themselves.The eventsare the initial conditions about which classical At use Boltzmann's we could no statement. can make most, dynamics the second of law of probabilistic thermodynamics to ascribe interpretation a probability to each possibleinitial condition.Oncean initial condition is the system will be led to its most probable state through an irspecified,
irreversible
as a result of \"improbable\"initial conditions Life considered is,therefore, with the laws of physics(initial conditionscan be arbitrarily compatible but doesnot follow from the laws of physics (which do not prescribe chosen) This is the outlooksupported, the initial conditions). for example, by Monod's life the of would well known book.* maintainance Moreover, appearin this view to correspondto an ongoing struggle of an army of Maxwell demons against the laws of physicsto maintain the highly improbableconditions that permit its existence. The results summarized in this book support a different point of view. Far from being outsidenature, biological processes follow from the laws of physics,appropriate to specific nonlinear interinteractions and to conditionsfar from equilibrium. Thanks to these specific features, the flow of energy and matter may be used to build and maintain functional and structural order.
have insistedon the variety of the situations involved in self-organizaInevitably, the toolsand the techniquesemployed to tackle phenomena. theseproblemsare extremely diverse, and so is also the backgroundof the potential readersof this monograph.We think, therefore, that it would be useful to make a number of suggestions concerning the way this monograph
We
process.
self-organization
shouldbe studied.
(i) For readers interested primarily in applications (e.g., experimental or sociologists), the thermodynamic analysis (Part I), chemists,biologists, shouldprovide an adequate Chapters5, 6, and Chapter7 up to Section7.5, for to IV Parts and V, devotedto concrete background switching immediately and physicochemical problems. biological Readers interested in the generaltheory and its physicochemical (ii) primarily are to all of Chapter 7, as well as Chapter 8 read implications encouraged and Part III. On the other hand, thesereadersmight not insist in many of the detailsof Chapters14,15, and 17. and 12 (iii) Most of the readers are likely to find Chapters 11 technically * J. Monod A970),
LeHasardet
General Introduction
15
than the others.We feel this is an inevitablefeature of the more complicated of state fluctuation theory. We did not hesitate including these present in the monograph, in order to give to the reader an up-to-date Chapters of this picture growing and increasinglyimportant aspectof self-organization
phenomena.
Owing to the fact that many results describedin the monograph are the subject of active research,we found it necessaryto switch from time to time from a \"tutorial\" style appropriate for presentinggeneral methodsand techniques to the style of \"progress report.\"Readersshould be progressin the field is likely to occur fully aware of the fact that further explosively,in the form of a true instability!
(iv)
still in this monograph reflecta collective Severalaspects of the work developed in this the members of the statistical mechanics and and effort, respect in the and in the University thermodynamics groups University of Brussels We are particularly indebted of Texasat Austin have played an essential role. to P. Allen, A. Babloyantz, J. L. Deneubourg,T. Erneux, R. Garay, A. Goldbeter, M. Herschkowitz-Kaufman, J. Hiernaux, W. Horsthemke, L. Kaczmarek, K. Kitahara, R. Lefever, M. Malek-Mansour, A. Nazarea, J. Portnow, M. Sanglier,J. S. Turner, J. W. Turner, A. Van Nypelseer, and R. Welch. the fruitful discussionsand the Moreover, we gratefully acknowledge and encouragementsreceivedfrom J.F.G.Auchmuty of Indiana suggestions of the University of Brussels, J.Chanu of the University University, R. Balescu of Paris VII, M. Eigen of the Max-Planck Institute at Gottingen, P. Glansdorffof the University of Brussels, B.Hessof the Max-Planck Institute at Dortmund, J. Kozak of the University of Notre Dame,R. Mazo of the J. S.Nicolisof the University of Patras, R. Noyesof University of Oregon, the University of Oregon, P. Resiboisof the University of Brussels, J. Ross of the Massachusets Institute of Technology, Albert and Annie Sanfeld of the University of Brussels, R. S. Schechterof the University of Texas at D. Thomas of the Technological Austin, University at Compiegne,R. Thomas of the University of Brussels, and D. Walls of the University of Waikato. The late Professor Aharon Katzir-Katchalsky has been an active protagonist in the field of self-organization phenomena.We have greatly benefited from the stimulating exchanges of ideaswe had with him. We have been greatly encouraged in pursuing the line of approachsumsummarized in the monograph by the continuous interest and support of Mr. J. Solvay and of ProfessorA. Jaumotte, Presidentof the Universite
Librede Bruxelles.
16
General Introduction
We have alsoappreciated the numerous contacts wehad with the members of the ResearchLaboratories, GeneralMotors Technical Center,Warren, Michigan,particularly with Vice PresidentDr.P.F.Chenea,Dr.R. Herman and Mr. A. Butterworth. Finally, it is a pleasureto thank Mrs.S. Dereumaux-Wellensand Mrs.L. Fevrier for the difficult task of typing the manuscript and Mr. P. Kinet for in the work. his efficient technical assistance has been supportedby the Fonds National de la Recherche This research Fondamentale Collective (Belgium), the Belgian Ministry of Education de l'EducationNationale et de la Culture Francaise et Ministere (Ministere de l'EducationNationale et de la Culture Neerlandaise), the R. A. Welch Foundation (Houston,Texas),and the Fonds cancerologique de la Caisse Generated'Epargneet de Retraite (Belgium).
Parti
The ThermodynamicBackground
Chapter 1
Introduction
GENERAL 1.1.
COMMENTS
The objectof this monograph, as stated in the General Introduction, is to present a unified formulation of self-organizationphenomena in complex that is, systems involving a large number of interacting subunits. systems, Experimental evidence,as well as daily observation, show that such systems a marked coherent behavior extending can present,under certain conditions, well beyond the scaleof the individual subunit. Biological order,the generaof coherent light by a laser,the emergence or of spatial temporal patterns of activity in chemical kineticsand in fluid dynamics,or finally, the functionof an animal ecosystem or of a human society, provide some striking illustrations of the occurrence of such self-organizationphenomena. In addition to the pointsdeveloped in the GeneralIntroduction, we want to in this present introductory chapter some further comments on biological which order, certainly constitutes the prototype of systemspresenting various of patterns self-organizationand coherent behavior. It is well known that the status of living beingsin respectto the laws of physics, particularly thermois a controversial matter that has thermodynamics, given rise to passionate very discussion. It will, therefore, be useful to presenta few introductory remarks in order to make our positionmore precise beforewe undertake the analysis of specificproblems. are extremelycomplex and orderedobjects. Biological systems They have the unique ability to preserveand transmit information, in the form of structures and functions acquiredin the past during a long evolution. On the other hand, the maintenance of life, even in its simplestbacterial form, implies a continuous metabolism and synthesis of macromolecular subas well as the regulation of these processes. Thesephenomena are substances, thanks of matter in living to a distribution possible highly inhomogeneous cells,which is the result of several thousandsof chemicalreactions involving and taking place simultaneously in a crowdedspaceof complexfeedbacks a few fi3 (cubicmicrons). Finally, the processof development of a fertilized 19
generation functioning
20
Introduction
an adult organism implies the transmission of genetic information over macroscopic time intervals. Here distances and during macroscopic too, F rom the role. first cellular division to the regulation plays a primordial formation of the adult organism, through the differentiation to specialized cellsand the tissueand organ formation, all of the events must occurat the right time and place, otherwise the result would be a completely chaotic behavior resulting in death. Modern molecular biology has been remarkably successful in interthis coherent behavior of living systems in terms of the structure of interpreting the constituting molecules. Therefore, it regardsthe functional order prea of an architectural order. in as result It describes vital prevailing living beings in terms of of o f code. I t assimilates the information, phenomena message, material of a to the cell of a T he genetic magnetic tape computer. program printed therein describesa seriesof operationsto be carriedout, with the in of their succession sharpness briefly, everything that is related to the survival of the organism and to reproduction. Nevertheless,not everything is fixed equally sharply in the genetic program.Phenomena such as the regeneration of tissues,or even memory or learning in organismswith a nervous system, illustrate a certain plasticity that permits highly developed the organism to acquire a supplement of information coming from the environment. Doubtless, the determination of the structure of biological macrohave solved a great many molecules and the discovery of the genetic code to others on a more firm in and have several helped problems biology pose and concrete basis.However, most of theseproblemsrefer to intracellular phenomena at the enzymatic or the genetic levels.Considernow a different kind of phenomenon, such as the development of a fertilizedeggto an adult of the brain of higher mammals, the immune organism, the functioning responsein higher vertebrates, or the major problemof biology,namely, the what and the origin of life. In all of theseexamples, evolution of biopolymers (and even supermolecular happensis the manifestation at a macroscopic, scale level of a seriesof events originating at the microscopic supercellular) of individual molecules. Here, physicsand physical chemistry can provide new conceptsand new deal with this continual interplay between ideas. Indeed,both disciplines to such an extent, level and propertiesat the atomic scale, macroscopic in fact, that the explanation of the observablepropertiesof macroscopic bodies(heat capacity, thermal conductivity, etc.)in terms of the properties of atoms and their interactions is the object of statistical mechanics,a Forthe purposesof our discussion, oneof the most specialbranch of physics. of this type of analysis of macroscopic systemsis important conclusions that the macroscopic descriptionintroduces somenew qualitative aspects.
eggto
time\342\200\224
21
Think, for a moment, of the conduction of heat acrossa fluid submitted to a temperature difference AT. Locally, each particle undergoesa disordered of the contraints experienced thermal motion. And yet, on the whole, because a of energy is propagating the outside from world, macroscopic quantity a the to which fluid, good approximation is simply proportional through AT. such to macroscopic properties are perfectly compatible Naturally, of of motion the individual particles.The only the laws with microscopic is is that the microscopic language simply not adequate onceone point
Our approach to the study of biologicaland other complexsystemsis in the above-definedcontext. We start from the results carriedout precisely of molecular biology to provide the analog of what we refer to above as level.\" We are then interested in large-scale the \"microscopic phenomena and in constructing modelsthat couple among themselvesseveral variables,
each one referring to a particular molecular event. In this way we try to obtain a satisfactorypicture of somemacroscopic propertiesof living systems the such factors as the t he geometry,the boundary influenceof size, reflecting and so on (see alsoremarksin the General Let us conditions, Introduction). stressthat such a program can now be envisaged thanks to the impressive progressof molecular biology. What tools are we going to use in order to carry out our program? our basic postulate is that all vital phenomena can be studied Naturally, with referenceto both the laws of physics appropriateto the specificnonlinear interactions we have to considerand to the far-from-equilibriumconditions. Furthermore, the very fact that we are interested in the modeling of macroa most drasticsimplification,permitting us to phenomena introduces in terms of a limited number of observables adopt a contracted description such as the concentrations (pu pn) of the cellular chemicalconstituents and the temperature T, and ignore finer propertiessuch as the distribution of instantaneous velocitiesor relative positionsof the molecules. In this respect,our object is to understand biologicalorder by limiting ourselvesto the laws of macroscopic that is, essentially,the laws of physics, thermodynamics. As usual, however, it is necessaryto supplement these laws by equationsdescribing explicitlythe time evolution of macrovariables such as pu in pn and T The justification of these equations (discussed detail in Chapters2, 4, and Part II)is beyond the scope of this bookas it is, a problem of statistical mechanics.In general, they have the typically, following form:
macroscopic
...,
...,
^
V2T,...) j, {V2Pj},...,T,\\T,
A.1)
22
Introduction
of theseequations are the various conservation equations Typical examples of matter, energy, momentum, and so on. These equationsdescribeonly time evolution of averages. In addition, it is often necessary to discussthe fluctuations of the macrovariables. The necessarytools are introduced in Part III. somewhatand analyze Having now definedour viewpoint, let us retrogress somenew aspectsonemight encounter in this context. We want to explain the origin and the maintenance of the extremely sophisticated ordercharNow a deep using the laws of macroscopic living beings, physics. characterizing has always been that the evolution of a physicobelief of most physicists chemical systemshouldinvariably leadto an equilibrium state that is entirely disorderedat the molecular level. In an isolatedsystem, which cannot exchangeenergy and matter with the surroundings,this tendency is expressedby the second law of thermoThe latter is ascertaining the existence of a function of the macrothermodynamics. state of the system, namely, the entropy S, which increasesmonoits maximum at a state known as thermodynamic tonically until it reaches
macroscopic
equilibrium:
\342\200\224->0
at
(isolated system)
A.2)
the wholevolumeand destroy the initial order. Moreover, this tendency is an irreversible processin the sensethat the inverse phenomenon cannot occur
spontaneously. Considernext a system that is at equilibrium but that can now exchange energy with the outsideworld at a certain constant temperature T (closed system). Equilibrium thermodynamics showsthat its behavior is described
by a new state function, the Helmholtz free energy F given
by
the following
=E
- TS
(closedsystem)
A.3)
where E is the internal energy. At equilibrium F is minimum. This minimum has a simplemicroscopic interpretation. Supposethe system may be found on various energy levels.Then, at equilibrium the probability that the system
23
equationsimply that only the levelsof low En will be populatedappreciably. As T increases, the contributions of E and S in F become and comparable, the populationsof the various energetic levels tend to become equal. We seethat in a nonisolatedsystem there exists a possibilityto form lowentropy ordered structures provided T is low. This ordering principle, referred to in the GeneralIntroduction as the Boltzmann orderingprinciple, is responsiblefor the appearanceof structures such as crystals and also for phasetransitions. Is this principlesufficient to explain the origin of biologicalstructures?
is easy to realizethat the probability A.4)to have,at ordinary temperatures, the condensation of a macroscopic number of molecules giving risenot only to the highly ordered structures (macromolecules, membranes,etc.)charlife but also to the coordinatedfunction of the thousands of characterizing chemical reactionsper cell, is practically vanishing. As an example,let us
It
For sufficiently
considera biological macromolecule such as a protein chain of about 100 amino acids.In nature there exist20 types of amino acid.It is known that the
physiologicalfunction of a protein is fulfilled only if the arrangement of the The constituting amino acids along the chain follows a well-definedorder. number of permutations necessary to obtain this arrangement starting from
an arbitrary
initial
distribution N
is:
~ 20100^ 10130
and we assumethat all corresponding configurations are equally probable a priori. Thus, even if a change of structure (e.g., a \"mutation\ through of this \"initial\" protein could occurevery 10~8 s (which is certainly too rapid), one would need
t
~ 10122s
to form the desiredprotein.As the age of the earth is \"only\" of 1017 s, we realize that the spontaneousformation of this (rather small) protein must be ruled out (Eigen, 1971). order and In conclusion, the apparent contradiction between biological the laws of physics\342\200\224particularly the second law of thermodynamics cannot be removed as long as onetries to understand living systems by the methods of equilibrium thermodynamics. As we shall see, the very concept of the probability of various statesas expressed, for example, through Eq. A.4), has to be reconsidered.
24
Introduction
1.1):
A.5) (ofenergyormatter) with the environde S is the entropy flux dueto exchanges and d,S is the entropy production due to the irreversible processes insidethe system,such as diffusion, heat conduction, and chemical reactions. The secondlaw implies:
environment
dS = deS + d,S
d,S > 0
( = 0 at equilibrium)
A.6)
A.7)
terms,
deS, in
of flow open systemsdiffer from isolatedonesby the presence to never the entropy change. which can be Contrary d{S,
Figure
1.1.
Entropy
flux
system.
25
one:
negative,theseterms do not havea definitesign.As a result, onemay imagine evolutions where the system attains a state of lower entropy than the initial
AS
=
path
dS < 0
This state, which from the point of view of the equilibrium relation A.4) can be maintained indefinitely provided the would be highly improbable, is allowed to attain a steady state such that dS = 0 or system
deS =
flow this
-d,S< 0
A.8)
if we give a system a sufficient amount of negativeentropy Thus, in principle, we enableit to maintain an orderedconfiguration. As Eq. A.8) shows, supply must occurunder nonequilibrium conditions,otherwise both and deS would vanish. We can already feel the possibilityof a new, dtS nonequilibrium order principle.More precisely, nonequilibrium may be a source of order. This is of obvious interest for living systems; the biosphere as a whole is a nonequilibrium system, as it is subjectto the flow of solar energy. In the cellular level, cell membranes or the various biochemical reaction chains are subject to concentration gradients of chemical conconstituents. Moreover it is quite common to have elementary reaction steps, such as those involving regulatory enzymes,that are practically irreversible
(Atkinson,
to say, thesesimpleremarkscannot sufficeto solve the problem Needless of biological One would likenot only to establishthat the secondlaw order. of the overall entropy (dS < 0), (rfjS > 0) is compatiblewith a decrease but also to indicate the mechanisms responsiblefor the emergence and maintenance of coherent states.Our principal goal in this monograph is to provide the elements of a responseto this question.One of our conclusions
is that there exist systemsshowing two types of behavior, namely, a tendency to a disordered state under certain conditions and a coherent behavior under others.The destruction of order prevails in the neighborhoodof thermodynamic equilibrium. Creation of order may occurfar from equilibrium the provided the system obeysto nonlinear laws of a certain type. In this case, of the spontaneousappearanceof order is accompanied by an instability states showing the usual thermodynamic behavior. Tradidisordered) Traditionally, thermodynamics was limited to equilibrium or near equilibrium and could only treat the first type of behavior. Recently an extension of
1968).
(i.e.,
irreversible thermodynamics to far-from-equilibriumconditionswas develthat permits treatment of both \"destruction\"and \"creation\"of order within the same formalism (Glansdorff and Prigogine, 1971). This theory is the subjectof Chapters2-4.
developed
Chapter 2
ConservationEquations
AT 2.1.OPEN SYSTEMS
MECHANICAL
EQUILIBRIUM
Beforewe undertake a detailed thermodynamic study of systems that may to define the class of situations in exhibit orderedbehavior it is necessary which we are primarily interested in this monograph. Considera reactive mixture of n constituents Xn. The system is from the outsideworld that are converted to open to the flow of chemicals Xu Xn within the reaction volume V. In most of the subsequent chapters we make the following assumptions:
...,
Xl,...,
The system is isothermal (T = constant). (ii) The system is at mechanical equilibrium (no mass flow) and is not subjectto external fields. (iii) The concentration gradients are not too high in the sense that the variables not vary appreciably within distances of composition in particular, the the order of the mean free path. This restriction implies, absenceof interfacesinsidethe volume V. (iv) The system is subjectto time-independentboundary conditions.
(i)
p1,...,pndo
The motivation behind theserestrictionsis fairly obvious.The behavior of living cellsis largelydetermined by chemicaltransformations and diffusion or of small metabolites such as ATP or phenomena of macromolecules cAMP. Most of these phenomena do not seem to involve convection. often develop complex homeostatic mechanisms Moreover, living organisms the at a certain pheconstant level. maintaining temperature Naturally, phenomena such as blood circulation in higher animals or the locomotion of microorganisms are specificallymechanical and are beyond the framework denned by our previous assumptions.On the contrary, all fundamental phenomena listed in Chapter 1 can still be analyzed without great sacrifices even if one adopts these simplifications. Referencesto the more general
26
2.2.
27
the coupling between mechanical motion, situations involving, for example, wheneverof interest. thermal effects,and chemical phenomena are presented What are the variables describingthe instantaneous state of a system obeying the above conditions,and how can one calculate their values? of the temperature and the Firstly, assumptions (i) and (ii) permit decoupling from convection velocity the compositionvariables (e.g., partial densities) to calculate the latter, we must establishequations of Xn. In order the evolution of the quantity of matter insidea multicomponent describing mixture. in Section2.2. This point is developed reacting
X!,...,
2.2.THE MASS-BALANCE
EQUATIONS
The principleof total mass conservation of an arbitrary (nonrelativistic) in the following form (seeFig.2.1): system can be expressed
dm
\342\200\224
= massflow
\342\200\236
through
surface
\342\200\236
\302\243
= dem
\342\200\224\342\200\224
B.1)
productionof massinside V, regardlessof the is different if onefocuseson the massof each chemicalconstituent separately. One has
dt
(/=
1,\342\200\242\342\200\242\342\200\242,\302\253)
B.2)
where
from
chemical reactions.
'
\342\226\240>
pn
Open system exchanging subFigure n with external world through stances where jf, . . . , jj; and surrounding surface , pi represent, respectively, values of (i\\, n diffusion fluxes and concentrations of on surface.
\342\226\240 \342\226\240 \342\226\240
2.1.
1....,1,
1,...,
28
Conservation Equations
Supposethat constituent Xj participatesin r chemical reactions and let (p = r) be the individual rates. The latter can be related to the compositionvariables {pj} provided one assumesthat the intermolecular interactions do not enter explicitly in the expressionfor the frequency of reactive encounters. This assumption extendsthe notion of an ideal mixture familiar from equilibrium thermodynamics,according to which each chemiin the mixture followsthe laws of perfect solutions. As an example,for a homogeneous reaction in a small volume AV: *' A + B A + X: B.3a)
Wp
1,...,
chemical
>
be:
= *i
AVpAPj
B.3b)
Similarly, for
A
-h 2Xj -
k2 ->
+B
hC
B.4a)
B.4b)
first
onewill have:
\\W2\\
= k2 AV
pAp)
We
reaction, and
in
two
disappearing
in in
thesereactionsare
is: case
1 and
\342\200\224
the stoichiometriccoefficientsv of Xj
= -kx AV
2k2 AV pAp]
B.5)
In
general:
^\342\204\242l
dt
ph,
Y vJp W\"
dems +
dt
p= i
yv JP wp
^.6)
be convenientto switch to massdensity variables, which we denoteas Pj, by reducing Eq. B.6)per unit volume V Moreover,we introduce the reaction rate per unit volume,wp, through the relation
It
will
Wp
J dV wp
B.7)
2.2.
29
We then
have:
in molar variables, particle densities, Note that onemay alsoexpress Eq.B.8) or mole or massfractions, that is, in terms of the ratios p/Z; Pj (Prigogine and Defay, 1951). In general,a chemicalsystemof the type weare interested in here is spatially The flow term demj/dt then describesthe distribution at inhomogeneous. each point insideV, of the matter penetrating into V through the surface T,. diffusion flux. Then Let jj be the corresponding
The surface 2.1). provided the normal vector n is oriented outward of V (Fig. can be the transformed Gaussian theorem: integral by divergence
J dL n
\342\200\242
j? = J dV
div
j,
B.10)
onemay obtain a local equation for p-s by requiring Combining with B.8), equality of the integrands at each point of V. The derivative d/dt commutes with the integral sign, thanks to the assumption about mechanicalequilibrium.
Thus, we obtain (DeGroot and Mazur, 1962):
^=-divj;+\302\243v;,,W,,
B.11)
As we saw earlier in this section,the wp values are even in simplecases nonlinear (polynomial) functions of {pj} values. Consequently, Eqs. B.11) constitute a system of nonlinear partial differential equations. necessarily In order to determine the solutionsof these equationsit is necessaryto These supplement them by suitable boundary conditions(Sneddon,1957). conditions,which reflect the extrinsic constraints acting on the system, can assumea considerable variety. In subsequent chapterswe are interested more specificallyin boundary conditionsprescribing or the the fluxes {jy}, concentrations {pj} on the surface T,. Theseconditionsare familiar from in fluid dynamics,and electromagnetictheory and boundary-valueproblems will be referred to, respectively, as Neumann and Dirichletconditions. Now the characteristic of nonlinearity implies that, even in relatively is an arduoustask. At the present the solution of Eqs. B.11) simple cases, time there is no general mathematical theory of these equations. It is, therefore, important to undertake a study of their qualitative behavior,
30
in
Conservative Equations
other words,of that part of their properties that is not strongly dependent on the detailsof the chemical stepsand diffusion. Part II is devoted to the mathematical aspectsof this question.Forthe time being we investigate how far one could go in the qualitative underof systems describedby Eq. B.11) understanding by the methods of thermodyof irreversibleprocesses.
thermodynamics
Chapter 3
pl5...,
...,
\342\200\242.;
S=
As
C.1)
However,the generalityof this Ansatz equation makesits usevery difficult. a matter of fact, there is no guarantee that an entropy function defined in terms of such a relation has always a macroscopic meaning arbitrarily far from equilibrium, that is, for arbitrarily high values of the gradients {Vp,} and of the time derivatives {dpjdt}. in order to selecta funcConsequently, form of the entropy that is both meaningful and pertinent to the type of problemwe must analyze in this monograph, we appealto someresults from statistical mechanics of irreversible processes 1949b), (Prigogine, which we simply enumerate without giving the proofs. One can show that condition (iii) of Section2.1 implies, from the microof the of particle momenta and that distribution functions point view, 31
functional microscopic
32
equilibrium
Thermodynamics
Region
relative positionsin the system are maintained, locally, close to the equiMaxwell-Boltzmann distribution. This means that dissipative processes arising primarily from the frequent elastic collisionsbetween molecules constitute the dominant contribution to the molecular distribution constraints functions, which is only slightly perturbedby the macroscopic A similar restriction is imposed (e.g., gradients) imposedon the boundaries. on chemical reactions: weshall supposethat reactivecollisions be sufficiently rare events (energy of activation sufficiently large) so that elasticcollisions the Maxwell-Boltzmann distribution. may restore Under these conditionsthe entropy of a nonequilibrium state can be defined, and contains a dominant contribution that is a local functional of the state variables pu pn:
...,
S = S(Pl(r,
C.2)
The functional relation C.2)has the samestructure as in thermodynamic equilibrium, exceptthat now it has to be understood locally, rather than for the entire system.Thus, entropy becomes an implicit function of time to the balance Eqs. through varying according Let us indicate here a few systems for which theseassumptions apply and that still may exhibit typical far-from-equilibrium behavior. Firstly, quite
p1,...,pn
B.11).
complexsystems of chemical reactionswith highly nonlinear kinetics can be treated by a local theory provided the rate of elasticcollisions remains
This is generally true in a not-toolarger than the rate of reactive collisions. rarefied system,in particular for all biological that occur in dense processes, media.Similarly, all convectiveand transport effectsdescribed by the NavierStokes equations, including hydrodynamic instabilities, are within the domain of validity of the local description. On the contrary, such phenomena as shockwaves, flows in rarefied systems, or plasticdeformations of solids are at present beyond the range of this approach.Let us emphasize once of a macroscopic these again that no proof of existence entropy describing situations has as yet beengiven.* The results mentioned so far define the domain of validity of local referredto as local equilibrium thermodynamics) thermodynamics (sometimes
statistical mechanics leads, indeed, to the definition of a functional that changes monotonously in time and may be used for the definition of entropy. However, this functions and not in terms of functional is expressed in terms of the statistical distribution This the macroscopicvariables such as the {pj(Prigogine, George, Henin, and Rosenfeld, 1973). of entropy. There also, result generalizes the well-known Boltzmann kinetic interpretation entropy may be defined in terms of the velocity distribution function. However, it is only when to their equilibrium form that Boltzmann's quantity locally the distribution functions are close can be expressed in terms of macroscopicquantities (Prigogine, 1949b).
* Nonequilibrium
Entropy Production
33
of matter. In description or, equivalently, the domain of a local macroscopic form we to in define the these results a more order express quantitative as entropy density sv
S=
with sv
[dVsv
= sv(Pl(r,
t),...,
pn(r, t))
obtain:
where sv is now an ordinary function. Taking time dsc _ y fdsv\\ dpj ~dt~ y \\dpj~dt
Now, using the assumptionsindicated above, we may introduce as equilibrium thermodynamics the relation
=
in
-y
C-5)
where p}is the chemical potential per unit massof constituent Xj (Prigogine and Defay, 1951). Thus
This relation is a particular case of the celebratedGibbs formula, equilibrium has the form (Prigogine and Defay, 1951):
which
at
TdS = dE + p dV
\342\200\224
Yj Mi drtij i
C.7)
for sv:
where E is the internal energy and p the pressure. We may now combineEqs.C.6) to deducea balance equation and B.11)
ds,,
iTSf,
The expression
+div^j,.-Ej,-vf
C.8)
MP=-ZWjP
C.9)
34
Thermodynamics
Region
occursfrequently in nonequilibrium thermodynamics. It is reaction p (De Donder, 1936). To seethe meaning of this
an 2.2,
the
affinity
of
it
quantity
is
C.10)
The affinity
becomes:
The quantity
K\302\260\302\253(T,
p)
= expf-X
njvj^
C.11)
is known
KeqG; P) = FI P^ec,
j
C-12)
where p, eq are the concentrations of the reactants at chemical equilibrium. Finally, 01 p takes the form:
[\\py
C12a)
= 0.Thus, the affinity At equilibrium, the law of mass action imposes (Xp measures the deviation of a chemicalreaction from the state of equilibrium. It plays a role in transport theory the similar to that of \\/ij, which measures deviation of the distribution of matter from the uniform state. Comingback now to C.8)we obtain:
ot j T j I
p
parts:
-divJs = -divS i jj j ^
and
C.14a)
C.14b)
S.I.Gibbs's Formula:
We
thought
Entropy Production
35
observethat a is a bilinear form of the quantities j,-, wp, which can be of as the flows, Jk associated with the various irreversibleprocesses, 01. and of the quantities V(^/T), JT,which can bethought of asthe generalized forces, Xk giving rise to theseflows:
o = Y,JkXk
k
C.15)
with
-V|
=
= wp;
X\342\204\242\302\253
-^
C.16)
To better understand the differencebetween the Js and a parts of C,14), we integrate this relation over the volume. After a partial integration and alsoEqs.B.9) and B.10)] application of the Gaussian divergencetheorem [see we obtain, using also the condition of mechanical equilibrium:
\342\200\224
= _ fdFdiv Js +
....... ...
\\dV
a=
- . dl.nJs+
.\342\200\236
\\
\\
d \\dV
arrive, therefore, at the decomposition, developedin Chapter 1,of the a term into and an flux entropy change entropy production term. As deS/dt is relatedto the constraints exertedby the outsideworld, we cannot impose law [see any restriction on this part ofdS/dt.In contrast, the second Eq. 1.6] never be negative: that the inside the can stipulates entropy produced system
We
d{S
dt
a >0
This relation leadsto the following classification: o> 0:irreversible processproducingentropy cr = 0: reversible processconnecting two equilibrium states
In
C.18a) C.18b)
we have expressed the entropy balancein terms of flows Jk conclusion, To go further which must be connected by inequality C.18a).
36
it
Thermodynamics
Region
which in principleare unknown which forces are known functions of the are related to the quantities, Xk local composition variables,provided thermodynamics remains valid.
RANGE
VI
\342\200\224
=0
(system at uniform
composition)
(chemicalequilibrium) C.19) On the other hand, by definition at equilibrium there is neither macroscopic transport of matter nor an overall production of constituents from the chemical reactions. We conclude that:
af = 0
\\,...,n
C.20)
Jekq
=0
From Eqs. C.19) it is natural to postulate that near equilibrium, and C.20) that is, when the generalized forces remain sufficiently \"weak,\" one might in series the of flows Xk: expand power
(/0
X,
I\302\243
Z lm \\0A!
y%-)
(\"Wo
XtXm
- C.21)
C.22)
The first term of this expansionvanishes identically owing to Eq. C.20). The contributions of the third and subsequentterms can be neglected provided the system remains near equilibrium. The remaining terms yield:
Jk
= YJLklXl
i
($)
The above two relations define the linear range of irreversible processes. The phenomenological coefficients Lkl are entirely determined by the internal structure of the medium, independently of the constraints applied on the system.They may depend,however, on the state variables such as and composition. temperature, pressure, the mass-balance Thanks to the phenomenological relations C.22), equathe of become closed, B.11) entirely enabling explicit computation values of the generalized forces or, equivalently, those of the state variables.
equations
3.2.
of Irreversible Processes
37
Note that the rigorous is beyond the framework justification of Eq. C.22) of thermodynamics and belongs, rather, to statistical mechanics.The latter also permits better specification of the domain of applicability of linear laws. One can show that all transport phenomena are described gradients vary on satisfactorilyby such relations, provided the macroscopic a scale lh, which is larger than the mean free path lr (Prigogine, 1949b):
/* We
>
C.24)
recover, therefore, the conditions for the validity of local thermoitself, based on the notion of local equilibrium (seeSection3.1). thermodynamics relations C.22) as far as transport phenomena are concerned, Alternatively, is as general as the local formulation of thermodynamics. The situation is entirely different for chemical reactions. As an example,
considerthe step
We
*'
<
>
C.25)
or:
In
C-26)
C27) I\302\243)<(\302\243))
order to recover a linear law such as C.22) to assume it is necessary
a< kBT
i^
C.28)
38
Thermodynamics
Region
Let us now examine the effectof the linear relations on the structure of the and C.22) oneobtains: entropy production.From Eqs.C.15)
kl
by the secondlaw) to remain valid for all (imposed the values of possible generalized forces.We also want the equality sign to to state of thermodynamic equilibrium: {Xk} = {0}. the correspond will these relations imposeconditionson the phenomenological Obviously, coefficientsLkl. In different terms, the couplingsbetween irreversible proprocessescannot be arbitrary but must remain compatiblewith inequality
We want this inequality
C.29).
Now, relation C.29)defines a positive definite quadratic form. This imposesthe restriction on the matrix of the coefficientsLk, to be positive definite, that is, to have eigenvalueswith positive real parts. An alternative condition can be obtainedif one observes that a quadratic form can always be symmetrized. Thus, the validity of inequality C.29)imposesthat all eigenvaluesof the symmetric matrix: LS = UL + Lt)
C.30)
where LT is the transposedof L = (Lkl), must be positive. Among the explicit criteria assuringthese propertieswe may quote the and Bellman, 1965). following theorem (Beckenbach Theorem. A necessaryand sufficient condition that a symmetric matrix Ls of matrix elements/-7 A < < n) be positive definite,is that the determideterminants
Lf | satisfy
the
inequalities:
i,j
l\\ 2
>0
C.31)
kl
'k2
k = 1,
...,
Ilk
In particular, this theorem impliesthat the diagonal elements /-, must cobe positive.According to C.30)it follows that the phenomenological coefficients L,, are themselvespositive:
Lit
>0
C.31a)
As an example, considerthe caseof two coupledirreversible processes. The entropy production,Eq. C.29), becomes:
3.3.
We
Symmetry
Properties
of the
Phenomenological Coefficients
39
as a trinome with respectto the variable (XJX2). regardthis expression condition for positive definitenessis,then, that the The well-knownalgebraic be positive and the discriminant coefficientof the highest power of (X1/X2) be negative:
Ls:
>0
Theseare precisely the conditions C.31) requiredby the general theorem of positive definiteness.
3.3.SYMMETRY
COEFFICIENTS
The phenomenological coefficientsC.23) introduce into irreversiblethermoa great number of parameterswhosevalues cannot be obtained thermodynamics within the framework of a macroscopic theory. Fortunately, it is possibleto reducethe number of independent phenomenological coefficientsby appealto symmetry arguments. We examine, successively, the influence of spatial and temporal symmetries.
appealing
SpatialSymmetries
each Cartesiancomponent of a flow Jk may depend, According to Eq.C.22), in principle, on the Cartesiancomponents of all generalized forces present. On the other hand, going back to the explicit propertiesof the entropy in Section that the irreversible processes we see of productiondiscussed interest can be decomposed into two quite different classes, namely, vector chemical reactions). phenomena (e.g., diffusion) and scalarphenomena (e.g., If thesetwo kinds of processes were coupled, then a chemicalreaction would be capableof giving rise spontaneously to an orienteddiffusion flux, even in the absence of a systematic initial concentration gradient. Intuitively, it is obvious that such a coupling is to be ruled out in an isotropic medium. In other words,the causesof different phenomena cannot have more elements
3.1,
40
Thermodynamics
Region
of symmetry th^rthe effectsproduced.* In fact, this property can bedemonexplicitly on both purely macroscopic groundsand kinetic theory in the linear approximation. It is important to realize that a system described by linear laws is always In contrast, isotropic as long as the equilibrium state itself is isotropic. ifi the nonlinear range the property of isotropy is lost independently of the structure of the medium at equilibrium. In this casethe Curie property in Part IIthis may leadto spectacular doesnot apply.As we see \"symmetryto the emergence of spatial patterns breaking\" phenomena corresponding in a previously uniform medium. In conclusion, in the linear range, entropy productioncan be decomposed,
demonstrated
uncoupled parts:
a = (Tch + ad
with
C.32)
C.33)
The OnsagerReciprocityRelations Temporal Symmetries:
Despite the spectacularreduction of the number of phenomenological coefficientsachieved by the analysis of spatial symmetries,there still remain n2 independentcoefficients for diffusion and r2 coefficients for chemical
reactions.
In
matrix
coefficients.
relations between these coHe showedthat in the linear domain of irreversible processes the of phenomenological coefficientsis symmetrical:
= L,k
C.34)
of flux Jk arising from a unit In other words,the increase X, (keeping constant) is equal to the increaseof flux
unit
increaseof
Xk.
relations. In his original derivation Onsagerappealedto considerations based on In particular, he showedthat fluctuation theory and stochasticprocesses.
* The
J, arising from
increaseof force
influence of spatial symmetries on coupling was first studied by Curie in relation to some problems in crystal physics such as piezoelectricity. It was then applied to nonequilibrium systems by one of the authors (Prigogine, 1947).
3.4.
Stationary
Nonequilibrium
States
41
of the property of the reciprocity relations are rigorous consequences detailed balance or, alternatively, of the time-reversal invariance of the elementary steps associatedwith the various irreversible phenomena.As the proof of Onsager's reciprocity relations is presentedin many textbooks De Groot and we do not reproduceit here.However, Mazur, 1962), (e.g., comments are made in in connection with the theory of additional Part around states. fluctuations nonequilibrium
III
3.4.
We
STATIONARY
STATES NONEQUILIBRIUM
are now in a position to apply the properties of phenomenological coefficientsto the analysis of nonequilibrium states. Among these,the socalled steady states play a privileged role.Indeed, in a great number of physicallyinteresting problemsa system either evolves in the neighborhood of such states or attains a steady state for sufficiently long times. Also, the mathematical analysis of steady statesis obviouslysimpler than that of time-
dependentstates.
By definition,
a system is at a steady state if the state our evolve in time. Within the dodomain of validity of local thermodynamics, this condition implies that the local state functions like the entropy density sv or the entropy production The resultsof Section3.1 lead,then, to density o are also time independent.
variables\342\200\224in
the following
relation:
deS =
<0 -d{S
C.35)
to Thus, in order to maintain a steady nonequilibrium state it is necessary pump, continuously, a negative flow of entropy of magnitude equal to the value of the internal entropy production.Note that in a system at or near a steady state the entropy flux cannot generally be imposedarbitrarily from outsidebut becomes, instead, a functional of the state of the system. It is a matter of observation that a system subjectto time-independent constraints reaches, after a sufficiently long time, a steady state.Consider first the case of constraints, compatiblewith the maintenance of an equiequilibrium state.The equilibrium state attained in this way is a particular case of a steady state.Imagine next that the constraints are progressivelymodified to shift the state of the system away from equilibrium. By continuity, one expectsthe new state, attained asymptotically,to be,again, a steady state. Now, in a system subjectto usual types of constraint, the only spatial inhomogeneities that can arise at equilibrium are those induced by the of external forces such as gravity and by the boundary conditions. presence In the absenceof such effects,the balanceequationsB.11) imply that the
42
Thermodynamics
Region
contribution of chemical reactions and of diffusion to the evolution of macrovariables vanish separately. Thus, by the same continuity argument as before, one should expectsteady states sufficiently close to equilibrium to exhibit similar properties. in Chapter4 and Part II, As we see the situation may change drastically for systemsmaintained beyond a critical distance from equilibrium.
ENTROPY PRODUCTION
of steady nonequilibrium We want now to study somequalitative properties states.The mass-balance equations B.11), by the linear laws, supplemented take the form:
|i
=
divELijV^+Ev1,W^
Lu = Ljt,
\\pp.
C.36) C.37)
with
= l,p
=
We
\\dVa
\342\226\240j
Lu
\302\243
lPP- MP
pp'
>0 aj\\ J
C.38)
are interestedin the way the system evolvesto the steady state.To this end,weevaluate the derivativedP/dt.In performingexplicitlythe time derivain Eq. C.38), we admit that the phenomenological coefficientsLti, lpp. remain constant, in other words, that their values depend only on the This assumption is more restrictive than linearity. equilibrium parameters. for a moment that LV] depends on a compositionvariable pa. Suppose One would have:
derivative
dpj it
the time derivative dpjdt would introduce higher According to Eq. C.36), order terms, rendering dP/dt a cubic function of the generalized forces. that the latter remain weak, this contribution couldbe neglected. Supposing the assumption of constant phenomenological coefficients, Alternatively, alsoreferredto as \"strict linearity\" condition, is equivalent to an assumption of \"weak amplitudes,\" whereas the assumption of linear laws implies \" weak gradients.\"
* We recall
that we
are interested
equilibrium.
3.5.
43
Bearing thesepoints in mind oneobtains,using the definition C.9)of the chemical affinity:
I
\\7
~~Z
d/l; .
~
^ \\ /
, /
'\342\226\240no'
fit
_,
o'
dill
\\)
in
= //,({p7}),that is,
=
-\302\243
Z[\302\243-)
ir
V
C-39)
Thus: dP
2 r
[\342\200\236
\\7^^A ^Pk
(^^l\\/7 ^Pj
In the first term we perform a partial integration. The divergenceterm is transformed to a surface integral:
By
imposingtime-independent boundary
state\342\200\224we
conditions\342\200\224in
order to enable
term automatically.
cancel this
dt
T2J\"'jj\\dPjJdt
At this point we may invoke someproperties of equilibrium state functions, also referred to as thermodynamic potentials. From classicalthermodyone knowsthat in an open system at a state of stableequilibrium
thermodynamics
0 = 0G;
>0
V,
is a {/i,})
minimum
=0
(<520)eq
C.43)
</>\342\200\236
through
0=
S(f>v
Lv(j)L,
= Yj Pi
i
<>Hi
C-44)
44
Thermodynamics
Region
and
C.45)
where the inequality follows from the secondrelation C.43). Inequalities such as Eq. C.45)are generally referred as thermodynamic stability conditions.We do not go into further detailshere concerning such thermodynamic stability conditions.This theory has been initiated by Gibbs and is presentedin many textbooks(for a recent presentation, see Let us only mention that in addition to Glansdorff and Prigogine, 1971). are: f amiliar C.45), thermodynamic stability conditions Eq.
where the specific heat at constant volume and the isothermal compresx are positive quantities. to Eq. C.45), we notice that the compositionvariations t)p, Returning there are appearing arbitrary. They may, therefore, representthe variations of p( arising during the time evolution of these quantities. This remark, in Section together with the validity of local thermodynamics discussed lead to the conclusion that the structures of the two quadratic forms C.42) and C.45) are identical. Thus, one may assertthat
compressibility
3.1,
Figure
of entropy
3.6.
in
Impossibility
of Ordered
of Irreversible Processes
45
<0
=0
C.46)
at the steady state
\342\200\224
at
the time variation of P. Figure 3.1 represents In summary, we have shown that linear systemsobey to a general ininequality implying that at a steady nonequilibrium state, entropy production a minimum, compatible with the constraints appliedon the system. becomes
IN
THE LINEAR
OF IRREVERSIBLE
PROCESSES
physical system is subject,inevitably, to perturbations of various kinds. Thesecan be either external excitations arising from a random or systematic or internal fluctuations generated variation of the environmental conditions by the system itself as a result of the molecular interactions and the random thermal motion of the particles. As a result, the system deviates continuously behavior described the macroscopic by the although usually
\342\200\224
weakly\342\200\224from
balance equations of the thermodynamic macrovariables. Imagine now a system initially at a steady state.The various perturbations and drive acting on it induce deviations from the steady-state regime it to time-dependent states {pi+ Spk(t)} (see virtue of the miniFig.3.2). By minimum entropy-production theorem, the entropy-production density of the
{p\302\260}
p\302\260
Figure
3.2.
Illustration
= perturbation
p\302\260
= steady-state
value
46
Thermodynamics
Region
latter statesis larger than the steady-state value a0. According to inequality the value + dpk(t)}) then evolves in time until the minimum C.46), value Go is attained or,equivalently, until the system is driven back to the reference state.The perturbation, therefore, regresses. By definition, we say that the referencestate is asymptotically stable.We see that the theorem of minimum entropy production guarantees the stability of steady nonequilibrium states. The notion of stability introduced in this section by intuitive arguments is developed fully in Chapter5. We see, the therefore, that in the linear range of irreversible processes, entropy productiona plays the sameroleas the thermodynamic potentials in equilibrium theory. Nevertheless, the general tendency of systemsnear equilibrium to approach a stable steady state does not necessarily imply that entropy is always increasing in these systems. Thus, it has been found that in simplesituations such as the approachto the steady state for thermal diffusion, entropy is decreasing. Also, its value at the nonequilibrium steady state corresponding to a minimum of P may be smaller than at equilibrium, = 0 (Prigogine, of entropy does not However, this decrease 1947). Pmin reflect the emergence of macroscopic order of any kind, as it occursin a continuous and smooth fashion as the constraint responsiblefor nonequilibrium is switchedon from its equilibrium value. More generally, as pointed out in Section 3.4, the steady states near equilibrium are essentially uniform in space if permitted by the external constraints.The stability of thesestates implies,therefore, that in a system of order in the form of obeying linear laws, the spontaneousemergence or temporal patterns differing qualitatively from equilibrium-like spatial behavior is ruled out. Moreover, any other type of order imposedon the system through the initial conditions is destroyed in the courseof the evolution to the steady state. of a variational principle Finally, it is of interest to point out the existence the theorem of minimum The great practical entropy production. implied by of is a such a to advantage generate convergent approximation principle scheme for calculating approximately the variables {p,}. The classical this of scheme is the from mathemethod familiar example Rayleigh-Ritz and (Kantorovich 1964). Krylov, physics
<r({p\302\260
mathematical
3.7. DIFFUSION
a local inhomogeneity is createdin an initially uniform system,say by a chemical reaction, the thermal motion of the particlestends to damp this inhomogeneity. This is the phenomenon of diffusion. In this way a macroWhen
3.7.
Diffusion
47
scopic quantity of matter is transported across a surface situated in the region of inhomogeneity. Diffusion is an extremely common phenomenon in nature. Quite often it constitutes the \"rate determining\" step in a lot of processes. Thus, the rate is about 0.3 ofwater evaporation from a freesurfaceat whereas g/cm2s ~1, mm is a the rate of diffusion acrossan unstirred air layer of a width of 0.1 thousand times less. Thus, diffusion acrossthe gaseouslayer just above the the rate of evaporation of the liquid. liquid surface determines In many instances,diffusion manifests itself as a transient process. In it is possible to set up a steady state of diffusion by maintaining other cases, This is particularly easy in diffusion constant constraints at the boundaries. across membranes or solid experiments phases. In this sectionwe give a quantitative formulation of diffusion. According in Section3.3 to discussion we may neglect the effectof chemical reactions, the two of will inevitably be coupledin the equations effect although types of evolution of the macrovariables. The entropy-production density takes the following form:
20\302\260
ffdiff
~t
W\302\243
C-47)
Note that, by definition, the n composition variables {p,} are independent. In this respect,our treatment differs from thosebased on classical thermoof closedsystems(Prigogine, De Groot and Mazur, 1962). 1947; thermodynamics In the latter, one starts with a number of constituents that are coupled
through
the
relation:
Ei = 0
i
C.48)
convection):
The latter is necessaryin order to assure the compatibility between the balanceequationsB.11) and the conservation equation (in the absenceof
dt with
= E Pi
C-49)
an opensystem The picture we adopt here is,instead, as follows.We consider inert gasor liquid solvent)which of n chemicalconstituents in a medium (e.g., is in excess. Thus, the fluxes j; are to be understoodas diffusion fluxes in the medium. If, in addition, the reactive mixture is dilute, then the couplings i and j is negligible. between diffusion fluxes of components
48
Thermodynamics
Region
C.50)
where LH dependson the propertiesof the solvent as well as on the mass fractions of i in the solvent. As /i,- = n,({pj}):
to: Usingagain the assumption of a dilute mixture we can reduceEq C.51) h=-Dt\\Pi
where we introduced the
diffusion Dt
C.52) C.53)
coefficientD,:
(f)
obtains:
\\-!r) V Ot /diff
In many cases can bereducedto a as constants, and C.54) D{can be regarded linear relation known as Fick's secondlaw (DeGroot and Mazur, 1962):
= Dt V2pt
f
C.55)
The diffusion laws analyzed in this sectionimply that the flux of matter is always directedto the region of low concentration. This situation prevails the state before the appearance of the inhomowhen the referencestate (i.e., or anisotropic and isotropic.In nonhomogeneous geneity) is homogeneous of highly media, such as in membranes or in fluid phasesin the presence nonlinear chemical reactions,the diffusion flux can be inverted. Matter is the system then transportedagainst the concentration gradient. In this case is said to undergo an active transport (examples are given in Chapters 14 and 16).
Chapter 4
NonlinearThermodynamics
4.1.INTRODUCTION
showsthat transport The analysis of linear laws performed in Section3.2 can be treated such as diffusion satisfactorily by linear thermophenomena of chemical reactions On the other hand, a realisticdescription thermodynamics. requiresan extensionof the theory to the nonlinear range:
a > kBr
As
D.i)
of we have seen,this condition is compatible with the local description as chemical irreversible processes as long reactions outlined in Section3.1 remain slow phenomena in respectto elasticcollisions within the reaction
mixture.
Nonlinear thermodynamics is, therefore, essentially a thermodynamics of chemical reactions.* The state variables of the system satisfy the balance equations B.11):
^= -divI +
P=
In
\302\243
vlpWf>
D.2)
Eq. D.2)it is understoodthat both j, and wp are related to ps values laws.An exampleof a suitable set of nonlinear phenomenological through
* We recall that we are interested here in isothermal systems in mechanical equilibrium. more general situations, additional nonlinearities appear through the Reynolds stress term
through In and
of chemical
rate constants.
49
50
Nonlinear
Thermodynamics
4.2.THE GENERAL
As in
EVOLUTION CRITERION
we are now interested in the way the system evolvesto the Section3.5, state. Unfortunately, by performing the derivative dP/dt one finds steady has no specialpropertiesoncethe domain of linear laws that this quantity and of Onsagerrelations is exceeded. Nevertheless,it is possibleto obtain a dP/dt as follows: general inequality by decomposing
dt
dt
dt
dt
dt
C.34):
D.5)
The last inequality is a consequence of the minimum entropy-production theorem. It turns out that beyond the linear range, dP/dt does not exhibit any property of general validity. However, as we show presently, dxP/dt satisfies a general inequality extending the theorem of minimum entropy production. We have: <46)
dt
first contribution is transformed by a partial integration. The surface term arising from this transformation vanishes for time-independent conconcentrations or for zero fluxes at the boundaries, by an argument identical to that in Section Theseconditionscorrespondto an open system in com-
The
3.5.
some external phasesthat are in a time-independent and spatially uniform state and are characterized by given valuesof temperature, pressure,and chemical potentials.Next we express(Itl in terms of the fij
communication
with
4.3.
51
taking
dfij/dt
Tj
where the surface term vanishes thanks to the boundary conditions we may transform the right-hand side to: Usingthe balanceequation D.2) T J
Again,
conclude
w^)!^
f/
\\dpj dt
dt
D8)
the arguments developed in Section 3.5 can be appliedhere to ensure the definite character of the quadratic form appearingin Eq. D.8). We conthat
D.9)
This inequality is as general as local thermodynamics itself.*The derivation outlined in this sectionshowsthat in the linear range it becomesidentical of its generality, to the theorem of minimum entropy production.Because it has been calledthe universal evolution criterion. In Section4.3we examine the information obtained from this criterion on the properties of nonequilibrium steady states.
AND KINETICPOTENTIAL 4.3. EVOLUTION CRITERION
Let {\\f}, {/if}be the values of flows, forces, and chemical the composition varipotentials at the steady state. According to Eq. D.2), {pf}at this state satisfy the relations: =0 -divj,<{pj}) +X D.10)
{w\302\260}, {<%\302\260},
variables
vipw\302\273({py0})
We
D.11)
fluxes
conditions different from those considered in this section, such as constant on the surface E, one can still derive a general inequality. However, the result can no longer be cast in the form of Eq. D.9).
boundary
* For
52
Nonlinear
Thermodynamics
performing the same transformations as in the previous section [Eq. and by taking Eq. D.10) into account, onecan seethat the first D.6)-D.8)] bracketvanishes identically. Thus, dxPis a quantity of secondorder in the excess flows and forcesaround the steady state:
By
Jkd5Xk<0
Figure 4.1 provides a schematic representation of this inequality. In the immediate neighborhood of the steady state oneexpectsthat
3Jk
J\302\260k
D.13)
bXk Ak
<
D.14)
By
to
set:
D.15)
where the coefficients /tt. are time independent.Note that relation D.15) can be compromisedin the presence of critical phenomena leading to in detail in Parts Such phenomena are discussed self-organizingprocesses. II and IIIfrom standpointsof both macroscopic equationsand stochastic theory.
TdxP=
kkf
D.16)
^
lkk.
is not symmetrical:
'kk'
Ik'k
antisymmetric
part:
4.3.
53
6X,
5X
-5X-
5X,
Figure 8X may
4.1. Geometrical
belessthan
interpretation
7t/2, angle
between
8J and
of inequality D.13). Whereas angle between d&X is necessarily larger than n/2.
8J and
Thus:
f J
V
kk'
f J
'\302\253\342\200\242
V
kk'
= d\\ (dVY, 2J
kk'
&Xk
&Xf
dd
Xk.
D.18) D.19)
The quantity
\\dV J
X
kk'
J\\dV
X
kk'
/\302\253-
<5Xt
The last term representsthe excess entropy production,that is, the part of the entropy productionarising from the excess flows and forces.Consider
next the quantity:
TSXP = (dV^JkSXk= (d
We now
Indeed:
first
D.21)
\342\226\240^
Nonlinear
Thermodynamics
In the first term we perform a partial integration and observe that the surface term vanishes for boundary conditionsof the type discussed in Section
4.2:
obtains:
taking
1 L
ip
D.23)
Returning
to
T 5XP = and
5Jk SXk
D.24)
SXk
kk1
dSXk.
<0
D.25)
In summary, dxPwould be the differential of the state functional SXPif the contribution of the antisymmetrical part llw could vanish. The situation would be as in the linear range, where the differential dP of P has a welldefined sign, thanks to the theorem of minimum entropy production.A would then permit straightforward extensionof the arguments of Section3.6 the asymptotic stability of steady nonequilibrium states to be established, provided 5XP is positive:
SXP> 0
D.26)
of an antisymmetric contribution in the general case Conversely,the presence raisesthe problemof stability of steady states far from equilibrium, which is no longer ensuredby inequality D.25). This important problemis examined this section in detail in the remaining part of this chapter. We close by recalling that the reasoningfollowed so far has been adapted to the case where the The in the reference states are steady states. evolution neighborhoodof
in
Chapter8.
4.4.
Stability
of Nonequilibrium
55
STATES.DISSIPATIVE 4.4. STABILITY OF NONEQUILIBRIUM STRUCTURES The important role played in the evolution criterion by the excess entropy that a study of stability of nonequilibrium statescouldbe production suggests based on the excess entropy-balance equation.To this end we introduce the and the entropy entropy productionvariations around the steady state:
AS
LSI
= S({Pi})
C
\342\200\224
S\302\260({pf})
I il
^ 7
J I.
y\\
I.
C
\342\200\224
\342\200\242Ik
If
^ 7
k
J i.
<427>
y\\
i.
these variations arise from either external discussedin Section 3.6, disturbancesor random internal fluctuations inducing deviations of the
As
from their steady values state variables {p,} Assuming that the deviations these remain can of variables one small,* {dpi} expand AS and AP in the form: following
{p\302\260).
fplfp%2Y+'.'.
with
D28)
\\8PiJo
-- [dVYfifSpt
TJ
i
D.29a)
D.29b)
S2S=
SP =
I*dV X
k
(J\302\260
+ X? SJk) =
J{dVY^X\302\260kdJk k
D.29c)
j S2P =
thermodynamics
\\dV
\302\243
SJk SXk
The point is that in the entire range where the local formulation of thermoremains valid, the quadratic form S2S [seeEq. D.29b)] has the samestructure as in equilibrium, and as a consequence it is a negativedefinite
quantity:
S2S=
* As
-I ~
dV \\dV
I*
Y X I
D.30)
of critical
pointed out in Section 4.3,this assumption can break down in the presence phenomena (see Part III for a detailed discussion of these phenomena).
56
Nonlinear
Thermodynamics
SSp:
dpi\342\200\224\342\200\2241
D.31)
D.32)
,.,,,
quantity
dPjj0 representsa symmetrical matrix in the indices/ and j. The time derivative balanceequations[see Eqs.D.2) dSpj/dtcan be substituted from the excess
l
and
D.11)]:
ddPi or
We
= -divdj, +
Ivi,\302\253Wp
D.33)
obtain:
-1
\\dvx(d\302\243)
In the first term we perform a partial integration. The surface term vanishes for constant concentration or for constant flux boundary conditions.The remaining terms yield:
Introducing the
affinity
through
\\dV
\342\200\242J
Yj
k
<>Jk
dXk
= Jk,
= Xk
D.35a)
D.35b)
and
= = jt &2SU jdV<r P>0 by the secondlaw, with [see Eq. D.30)]: (<52S)eq< 0 evolvesin time, as indicated in Fig.4.2. Thus, (<52S)eq
4.4.
Stability
of Nonequilibrium States.Dissipative
Structures
57
Figure
of second-order
excess entropy
(<52S)eq
around equilibrium.
The argument, by now familiar, first developedin Sections 3.5and 3.6 connection with the minimum entropy-production theorem, showsthat as f -> oo the system evolves to the reference state. Thus, we have demonthe asymptotic stability of equilibrium in respectto small perturbaNote that the argument about stability relieson the definitecharacter which vanishes only at the reference state. Such functions are of (E2S)eq, referred to in analysis as Lyapounov functions. Lyapounov's stability theory is discussed in somedetail in Chapter6. As we have indicated in Chapter 3, the equilibrium state is characterized The result we just established by the absenceof spatial or temporal order. implies,therefore, that this disorderedsituation cannot be modified as long as the systemdeviates from equilibrium only through fluctuations or through random disturbances. Imagine now a process causing a systematic deviation from equilibrium, for instance, the increase of a state parameter or of a constraint, X (affinity of an overall reaction, compositiongradient at the boundaries,etc.). The variables are subjectto the changesdescribedqualitatively in composition Fig.4.3. According to the theorem of minimum entropy production,the to equilibrium remain asymptotically stable [Fig.4.3, steady states close branch (a)].By continuity this branch of states\342\200\224subsequently referred to as the thermodynamic branch\342\200\224maintains its stability in a finite neighborhood of the equilibrium state. But beyond a critical value Xc one could not rule out the possibilitythat the states on the thermodynamic branch become unstable [Fig. the least disturbance 4.3,branch (b)].In this case compelsthe system to evolve away from this branch.The new stableregime attained by
in
demonstrated
perturbations.
58
Nonlinear
Thermodynamics
(a) stable part of Figure 4.3. Branching of states as the distance from equilibrium increases: branch; (b) this branch becoming unstable; (c) new solution (dissipative thermodynamic branch. structure) emerging beyond instability of thermodynamic
to an orderedconfiguration. can correspond the system [Fig. branch (c)] We say that at X = Xc we have a phenomenon of bifurcation of a new branch
4.3,
of solutions.
4<<52S)\342\200\224the
near equilibrium the property SXP> 0 is an immediate of the secondlaw, whatever the perturbations {Sp^of the state consequence variables might be.Far from equilibrium, however, the time derivative of not be positive definite. excess entropy production are indicated in in The possibilities that might arise this more general case
In summary,
5XP\342\200\224need
Fig.4.4.
F2S)
Stable
Figure
stable, marginally
caseof (asymptotically)
4.4.
As
unstable
Stability
of' Nonequilibrium
States.Dissipathe
Structures
59
unwe seefrom Eq. D.34),the nonequilibrium steady state becomes becomes as soon as the excess (and stays) entropy productionSXP negative for t > t0. (Glansdorffand Prigogine, 1971): SXP< 0 for t > t0 unstable referencestate SXP> 0 for t > t0 asymptotically stablereferencestate D.36)
: :
parameters measuring the distance from equilibrium. When a critical value Xc of X isreachedthe sign of the inequality in Eq.D.36) will be inverted, and the referencestate looses its stability. We referto this critical situation as the state of marginal stabiliy.
X
SXP(/.C) =
0 for
> t0 :marginal
stability
D.37)
This relation enablescalculation of the values of the constraints capableof inducing an instability of the thermodynamic branch. It is of interest to relate the thermodynamic stability conditionsD.36) and D.37) Considerfirst a unimoiecuiar to the kineticsof chemical reactions. in a reaction chain: step
X
j==\302\261
D.38)
We
3.1]
J = w = ka'a:
\"
>A
k2pA
a = kB T ln-'<lP'x
For pA, T constant (and
thus
sa = k,T-$Px Px
and
dxa = 5w 5 T = kBk,
We
in
px
\342\200\236'
>0
D.39)
r~^
2X
D.40)
60
Nonlinear
Thermodynamics
-k2p\\\\
Sw = (klpA
2k2p\302\260x)Spx
B^
Px
and
&x\302\260
- ^(kiPA Px
2k2p\302\260x)(dpxJ
D.41)
this expression can become Undercertain conditions, negative.We conclude that autocatalytic reactions or, more generally,reactions involving nonlinear steps tend to destabilizethe system.Naturally, a single reaction such as Eq.D.40)cannot producean instability, as it will always evolve to equilibOn the other hand, such a process can be a part of an open system and Prigogine, ofreactions (Glansdorff,Nicolis, undergoing a wholesequence Now, the most important biochemical reactionsin cellular dynamics 1974). are nonlinear, as they involve complexfeedbacks.Thus, the biological interest of these considerations is quite obvious. This point is discussed in detail in Parts IV and V. In summary, we have found that the distancefrom equilibrium and the of ordercapableof driving the system to an nonlinearity may both besources ordered configuration. A highly nontrivial connection between order, and dissipationappears.To indicate clearly this relation we call stability, the ordered configurations that emerge beyond instability of the thermoequilibrium.
Nevertheless,
dynamic branch the dissipativestructures. The analysis of this sectionshould already have clarified the important One can really speak of fluctuations in theseself-organizationprocesses. role of order through fluctuations in connection with these transitions. Neverthat what has been dealt with here is the it should, be emphasized time evolution of a macroscopic fluctuation, oncethe latter appearsin the The such and the a priori probability of a of fluctuations origin system. is a profound and important problem fluctuation enjoyingspecificproperties that will be approached in Part III. one should be Finally, fully aware that the results of this chapter merely the The real proof of of suggest possibility self-organization processes. existenceof such processes a detailed requires analysis of the balance II. this is in Part equations; analysis performed
Part II
Chapter 5
FORMULATION
The thermodynamic analysis of nonlinear systems outlined in Part I proved to be an extremelypowerful tool in that it sortedout the role of the distance from equilibrium as a source of order. We now turn to the kinetic aspectsof the purposeof this part of the monograph is to this problem. Moreprecisely, and to analyze the illustrate various types of self-organization processes mechanismsof emergence of the spatial or temporal patterns.The presentawe adopt is, of course, inspiredby the resultsof Part I.In addition, we to the techniques of nonlinear mathematics in appeal quite frequently order to obtain quantitative information about the solutionsdescribing the organized states. We consider again, as in Chapter2, an opensystem at mechanicalequilibXn. Under the involving n chemically reacting constituents instantaneous macroin the enunciated Section to 2.1, assumptions (i) (iv) state of the system is describedby the compositionvariables {/),}. The latter obey the massbalance equations[see Eq.
presentation
equilibrium
X1;...,
macroscopic
F.11)]:
^= -divj, +
Iv/pW/)
(i
=],...,n)
E.1)
In the nonlinear range ofirreversibleprocesses, j, and wp become complicated nonlinear expressions in physical However, in many instances involving p{. subof intermediate chemistry and biology one deals with the evolution substances that are very dilute. According to Section3.7, the diffusion flux j, for such systems takesthe form:
j;=-\302\243>iVpi
first (Fick's
law)
E.2)
63
*\"
Diffusion.
Stability
where the diffusion-coefficientmatrix has been taken diagonal and the takesthe form coefficientsDt are henceforthtaken constants.Equation E.1)
^ = MPi})
/\342\226\240
+ Dt V2Pi
E.3)
describes where the nonlinear function the overall rate of production of X, from the chemical reactions. for a physicoAccordingto Sections and chemical system obeying the law of mass action at equilibrium, j\\ will be of the polynomialtype. This makesthe differential nonlinear functions of {pj} system E.3)a system of nonlinear partial differential equations. According to the usual classificationof theseequations(Sneddon,1957), of first ordertime derivativesand second-order the presence spacederivatives This is a very general feature of confers to Eq. E.3)a paraboliccharacter.
4.1 2.2,
second evolution equationsdescribingdissipative systems,such as Fick's law law for diffusion or Fourier's for heat conduction. As emphasized in Section in order to have a well-posed 2.2, problemit is that conditions expressthe necessaryto prescribeappropriate boundary constraints acting on the systemfrom the outsideworld.In most applications we deal either with Dirichlet conditions:
{pf,
{n
\342\200\242
= {const} ...,pl)
\342\200\242
E.4a)
E.4b)
one of the with a linear combination of both conditions.Sometimes, the system is closed constantsin Eq.E.4b)vanishes identically. In this case with respect to exchanges chemical substance.This of the corresponding condition appliesto most of the experiments of the Belousov-Zhabotinski reaction, which is the bestknown chemical example giving riseto dissipative we in in as see detail 13. structures, Chapter We may also recall from Section4.2, that the conditionsof fixed conin deriving the concentrations or of zero fluxes at the boundaries was necessary < 0. form of the in terms evolution criterion of explicit dxP/dt Beforewe close this sectionwe want to insist on the generality of Eqs.E.3) as they apply in ordinary chemical kineticsas well as in biochemistry to E.4), at the cellular or the supercellular level. With slight modifications they can account for thermal effects;it sufficesto add to Eq. E.3)the equation for the internal-energy conservation:
or
c^ = div2VT+X(at
AHp)wp(T,
{Pj})
E.5)
5.2.
Lyapounov
Stability
65
where c is the specificheat of the mixture, AHP the heat of reaction p, and nonlinear (usually exponential) wp depends on temperature in a highly a simple fashionthrough the rate constants. Moreover, change in the interpreof the variables permits description diverse of such phenomena as the an of in or the electrical competition populations activity of the ecosystem brain. The modeling of a concrete problemamounts, therefore, to a judicious of the variables, of the form of the \"chemical\" laws determining fh choice in and to and the valuesof of the Eqs.E.3) E.5) parameters describing wp AHP, the latter the diffusion coefficients{DJ, the rate constants the system.-Among {kip}, the sizeof the system and, finally, the nature of the appliedconstraints, in the behavior of the system. play a decisiverole
interpretation
5.2. LYAPOUNOV
STABILITY
that an important The thermodynamic theory developed in Part I suggests is the loss of phenomenon accompanying a self-organization process of the thermodynamic branch. In this and subsequentsectionsof stability this chapter wedefinemore rigorously this important notion in a number of different situations. We first introduce the conceptof Lyapounov stability (Minorski,1962). Let Xi{r,t) be a solution of the differential system E.3),that is, a set of functions {X^r,t)} dependingon the respective space and time variables r and t, satisfying identically Eq. E.3),together with initial and boundary domain conditions. We assumethat the motion is defined in the space-time = < < < this a 0 t < that in domain and 1,2, 3; {0 rx lx, X^r, t) is oo} that bounded and is, physically meaningful, positive.
existsand tj = tj(E, t0) such that any solution Yj(r, t) for which \\xi(r, to) ^(r, to)I <1 satisfies also \\X;(r, t) Yfc, t)\\ < e for t > t0. If no such exists, the solution is unstable.We see that stability in the sense of Lyapounov is equivalent to the property of uniform continuity (familiar from differential calculus)of X(r, t) with respect to the initial conditions.
r\\
1. We
say
that
X,(r,t)
is Lyapounov stable
if
given e
> 0 and
Definition
2.
If ^,-(r,t)
is stable,and if
lim
f-\302\273OO
\\Xfa,
t)-
Yfc,t)\\
=0
E.6)
66
Diffusion.
Stability
-1 5.1. Stability
of steady-state solutions of Eq.
Figure
E.7).
In other terms a solution (or motion) is asymptoticallystableif all solutions coming near it approachit asymptotically. As an examplelet
as well as the
family
+1 of solutions(seeFig.5.1)
xOi x
-1,
+
k),
x02 =
E.8)
x@)
1
= th(f
to
= arth
1
E.9)
asymptotically stable.*
is found
that
5.3. ORBITALSTABILITY
In many cases of interest in physical chemistry and biology onedeals with systemssubjectto time-independent constraints.This is translated by the fact that the right-hand sideof Eq.E.3)\342\200\224essentially the rate function/\342\200\224does not dependon time explicitly.We call such systems autonomous. Let Xt(r, t) be a solution of Eq. E.3). It is then clear that any function X,(r, t + x) where
* Note that if we had considered stability for t x02 unstable.
\342\200\224 -\302\273
be asymptotically
stable and
5.3.
x
Orbital Stability
67
In other is an arbitrary constant (the phase),is still a solution of Eq. translational invariance. a utonomous exhibit the of words, systems property These infinitely many solutions,differing from each other by the phase, In the define a trajectory (or orbit) of the system in an appropriatespace. absence of spacedependences, this phasespaceis an n-dimensionalEuclidean a spacespanned by the n variables pu pn and the trajectory becomes In the more general case we deal with infinitely dimencurve in this space. We spacesspannedby sets of functions, known as functional spaces. in of orbits these 7. in give examples spaces Chapter a certain \"metric\" defining the distancein phase Supposeone chooses spaceand let C denotethe orbit. We say that C is orbitally stableif, given e 0, there existsn 0 such that if Xo is a representativepoint of another trajectory within a distancen from C at time t0, then X remains within a distancee from C for t C is orbitally unstable. Otherwise, If C is orbitally stableand the distancebetween X and C tendsto zero as t -* oo, C is asymptotically orbitally stable. Lyapounov stability and orbital stability should not be confused (see
E.3).
...,
dimensional
>
>
> t0.
Fig.5.2).
Figure 5.2. Comparison between Lyapounov stability and orbital stability. C,C\" aretwo orbits of different periods. Although their distance remains bounded for all times, distance between two points 1 and on these orbits can increase in time owing to phase shift induced by difference between periods. Thus, state 1 need not be Lyapounov stable, even if orbit C is orbitally stable.
1'
6*
A
Diffusion.
Stability
simpleillustration of the conceptof orbital stability (Minorski, following system due to Poincare
^=
at
X(\\
-X + 7A ^-= at
Switching to
- - X2 X2
1962):
Y2)
is provided by the
Y2)
Xo=Yo= 0
for X and Ycentered on this state: polar coordinates X
Y
= r cos6 = r sin 6
?=
dt
<
with
a finite
radius:
=1 e = eo-t
>\342\200\242
By applying the definitionsone finds that this orbit is asymptoticallystable in the phaseplane as t -> oo. and attracts the trajectories
instantaneous
unperturbed
In many physically interesting situations the evolution of the system of which are given in Section dependson a number of parameters, examples
system.
5.4.
Structural Stability
69
can themselveschange smoothly or even abruptly. someof theseparameters New parameterscan be \"turned on,\" thus increasing the number of interdegreesof freedom. Finally, others can become extinguished permathe change of the parameters or momentarily. In each case generally the structure of the equations themselvesby modifying the right-hand changes Let e be a measureof the change of some representative sidesof Eq. E.3). all If solutions of the modified system remain in a neighborhood parameter. e o f order of the solution of the \"initial system\" for e = 0, we say that 0{e) the latter is structurally stable.If no such neighborhood exists,the system is in a unstable. stable system the structurally Alternatively, structurally of in s tructure the topoiogical trajectories phase space (wheneverthe latter can be defined)remains unchanged. A simple illustration of the idea of structural stability is given by the
interacting permanently
motion of a pendulum. The usual mathematical model of this system is the and is characterized by an infinity of periodictrajectories harmonic oscillator dependingcontinuously on the initial conditions.In nature, however, a as it is always subjectto friction. pendulum is never a harmonic oscillator, As a result, the system evolves eventually to a unique equilibrium state of rest, reachedsooneror later dependingon the magnitude of friction. We that the equationsdescribing are structurally conclude harmonic oscillators unstable with respectto friction. The practical functioning of a dependable clock requires,therefore, a finite external driving force that compensates the effectof friction. Structural stability has long been known to play an important rolein electricalengineering.An extremely lucid description of particular problems involving this conceptis to be found in the monograph by Andronov, Vit, and Khaikin A966). More recently, Thorn drew attention to the generality We return to of this concept and its implications in a variety of phenomena. this conceptin Chapter6 and in Part V.
Chapter 6
Tools Mathematical
INTRODUCTION 6.1. The solution of the reaction-diffusion equations E.3)and E.4)is an extremely arduous task, primarily because of the nonlinear character of the rate functions. On the other hand, the thermodynamicanalysis of Part I suggests that an important feature common to a large class of self-organization shouldbe the loss of stability of the thermodynamic branch and processes the subsequent evolution to a stabledissipativestructure. At the point where the exchange of stability takes place,a branching of at least two solutions of Eqs.E.3)and thermodynamic branch and a dissipativestructure take place. To date there exist a number of general techniquesof nonlinear mathethat cover such phenomena.We discuss two that seem to be particularly well adapted to the analysis of pattern formation and the biologicalimplications: (a) theory of bifurcations and (b) theory of catasBoth theoriescorrespondto two different ways of extending the catastrophes. work of Poincare, who was the first to put the qualitative theory of nonlinear differential equationson a solid ground. A third mathematical technique, namely, stability theory, also retains our attention as it constitutes, in many arguments in ways, a powerful alternative to some otherwise complicated bifurcation theory.
E.4)\342\200\224the \342\200\224would mathematics
6.2.THEORYOF BIFURCATIONS
we pointedout repeatedly, the right-hand sideof Eq. E.3)dependson a X. Suppose X such that for X sufficiently setof parameters that we choose small, these and with time independent constraints, equationsadmit as t -* oo, a positive and bounded)solution.According single physical acceptable(i.e., to irreversible thermodynamics, the latter lies necessarily on the thermobranch. It may be further assumed that this branch depends smoothly on the parameter X.
As
thermodynamic
70
6.3.
Stability
Theory
71
Now for certain critical values Ac of X, the solutions on the thermodynamic their stability branch might no longer be unique and might even loose properties.In the neighborhoodof these critical points the system could evolveto a new regime exhibiting spatial or temporal order. We say that at thesecritical pointsthere is bifurcationof the solution on the thermodynamic branch.*In general, one expectsthat in the immediate neighborhood of Ac the new solutions will dependon A in a nonanalytic fashion. The purpose of bifurcation theory initiated by Poincare and developed his and others, is further school, by Andronov and Hopf, Krasnosel'skii, to develop methods enabling one to: demonstrate (a) rigorously the existence for certain of branching of solutions critical values kc, and (b)construct, in an and approximate fashion, analytic convergent expressionsfor certain of at solution important types emerging the bifurcation points. We illustrate this approach directly on a solvable model in Chapter 7. Herewe turn to the concept of stability, which recurs frequently in this monograph, and which is intimately connectedwith the very existenceof the phenomenon of bifurcation.
6.3.STABILITY THEORY
The mathematical definition of stability has already been developedin Chapter 5.Here we would like to outline a number of techniques enabling one to assessthe stability of solutionsof the differential equations. of LinearizedStability The \"Principle\"
oneis interestedusually in the stability of a particular type of solution of it is often convenientto study the behaviorofthese equations around Eq.E.3), this particular reference state {XOi{r, We as an also t)}. may regard {Xoi}
As
unperturbed solution that is continuously perturbedby the action of external disturbancesor by internal fluctuations x,(r,t). The latter lead from {XOi} to the new solution
F.1)
One can think of F.1) as denning a new coordinatesystem in phasespace, centeredon the referencestate rather than at the point @,..., 0). From Eqs.E.3)and F.1) one can deducethe system of equationsfor {xj:
^ = MXoj
* Note
evolution that
+ xj}) MXOj})+
\302\243>,
V2x,-
F.2)
the very occurrence of bifurcation implies nonlinear equations would admit a unique solution.
72
Mathematical
Tools
or,setting
vt
F.3)
F.4)
= v/L{xj}) + D, V2x,-
is now reflected by the stability of The stability of the referencestate {XOi} the \"trivial solution\" {x,= 0}of Eq. F.4). In general, the system of Eq. F.4)is nonlinear and as complicated to solve the behavior local as the original system E.3). Quite frequently, however, of the solutionsaround the origin:
X;
X0l
turns
F.5)
out to provide extremely significant information about the behavior of the completenonlinear system.To describethis local motion it suffices with respect Onethen obtainsthe linearized to linearize Eqs.F.2)-F.4) to x;. system, also referred to as variational system:
where the elements of the coefficient evaluated at the referencestate.The enormous is the linear that advantage system F.6) can be studied by such classicalmethodsof analysis as the normal mode method.We illustrate thesemethods with the examples in Chapter7. The following important theorem, first proved for ordinary differential links the stability 1962; equationsby Lyapounov (Minorski, Sattinger, 1973), the of a nd F.6) E.3). properties systems
matrix\342\200\224the Jacobian\342\200\224are
Theorem. If the trivial solution of Eq. F.6) is asymptotically stable,then of is an stable solution If it is unstable, then Eq. {XOi} asymptotically E.3). is alsounstable. {XOi} We note that the theorem gives no information in case the trivial solution of Eq. F.6) is (Lyapounov) stable but not asymptotically stable.This socalledcritical case has to bestudiedseparately. and Conti, 1964) As (Sansone a matter of fact, a state corresponding to the critical case is structurally unstable, as its propertiesare likely to change qualitatively on the action of a disturbance, The phenomenon even if the latter is made as small as desired. of branching, mentioned repeatedly in previous sections, occurs necessarily in this critical case.
6.3.
Stability
Theory
73
Method Lyapounov'sSecond The investigation of stability based on the system of linearized equations Forsystems amounts to the direct integration of this system. involving many chemicalvariablesthis can often be an awkward way of proceeding, especially In contrast, the method if the referencestate is spaceand/or time dependent. that are: known as Lyapounov'ssecond method providesstability conditions o f the to of the linearized applicable integration system, (b) (a) independent of all kinds, including spaceand/ortime-dependent referencesolutions{Xoi} The ones,and (c) applicabledirectly to the nonlinear systemsE.3)or F.4). informaone to is that the has method qualitative usually pay provides price and does not enable determination of such quantities as relaxation times or oscillation frequencies. We first considerthe nonlinear system F.4)with diffusion terms absent:
information
~=
We
v&{xj})
F.7)
Definition. Considera function of n variables V = V(xu xn). We say Fis definite in a domain D in phasespace around the origin (D: < n, where n is a positive constant), if it takes values having a single sign in D = xn = 0. V is semidefinite if it takes the and vanishes only for x l = in In V is indefinite. same sign or vanishes D. all other cases
\342\226\240 \342\226\240 \342\226\240
...,|x,|
Next we consider the derivativeof V along a solution of Eq.F.4). Fortimehas: constraints becomes and one autonomous, independent system F.7)
where v
= (vu
...,
vn)
and
(\302\243\342\200\242\342\226\240\342\200\242\342\200\242\342\200\242\302\243
inD.
= xn = 0) isstablein a domain D Theorem The referencestate (xt = one can determine in D a definite function V whose \"Eulerian derivative\" is either semidefiniteof sign oppositeto V or vanishes identically [Eq. F.8)]
\342\200\242 \342\226\240 \342\226\240
1.
if
74
Mathematical
Tools
without
= xn = 0) is asymptotically stable if one Theorem2. The state (xi = can determine a definite function V whose Eulerian derivative is definite and has a sign oppositeto that of V. = xn = 0) is unstable if one can determine Theorem3. The state (xt = a function V whoseEulerian derivativeis definite and V assumes in D values such that V(dV/dt) >0.
\342\200\242 \342\200\242 \342\200\242
Note that these theorems only provide sufficient conditionsfor stability. Indeed,in general the way of constructing a Lyapounov function V is not by the theory. prescribed theoremsand the ideasunderlying equilibrium thermodynamics. In essence, whenever it can be constructed,a Lyapounov function plays the roleof a
It is instructive to point out the
closerelation
between Lyapounov's
potential in the immediate vicinity of the reference state, whose extremal propertiesdetermine the stability of this state. The ideas outlined for the ordinary differential system F.7) have been extendedto partial differential equations by Zubov (e.g., Zubov, 1961). Sufficeit to mention that in this case one dealswith Lyapounov functionals rather than with Lyapounov functions which are, typically, integrals over spaceof appropriatelocal quantities. It is important to recall here that the entire discussionof Section4.4 dealing with the stability of nonequilibrium stateswas, in fact, an application of the above-mentioned Lyapounov theorems. The Lyapounov functional, whosepossibletime behaviors are illustrated on Fig.4.4,is in this case the excess entropy
E2SH= Jf dVE2sH=
-~
f dV X SPidPj 1 J ij \\Cpj/o
(\342\200\224)
F.9)
6.4.
Theory of Catastrophes
75
solutionsof such equationshas been achieved as of now. At best, we can construct approximate expressions for specialtypes of solutionssuch as or almost steady-state,periodic, periodic ones, without being able to of bifurcation in the assertthat these solutionsexhaust all of the possibilities system. In recent years, Thorn (e.g., a powerful method has developed Thorn, 1972) term can be suppressed such a the diffusion classification,provided enabling The entire spatial dependence\342\200\224that is, the entire morphology in Eq. E.4). of the rates of the accountedfor by a parametric dependence an in and time. The differential then, ordinary system E.4)becomes, fi space system:
solutions\342\200\224is
~ = MP]),l>)
fi
(i
=1
\302\253)
F-10)
with
= (t,t;X)
F.11)
initial symmetries are broken by an unidentified external action rather than by the system itself. The spontaneouscharacter of selfis, therefore, not accountedfor explicitly. organization processes in the theory\342\200\224although A second assumption that plays an important role that Eq. F.10) a great deal of current attempts aim to relax derives from a potential
it\342\200\224is
dp, = _ dV({pj},,)
dt dpt
where V is the \"potential\" function. We note that from the standpoint of irreversible thermodynamics (seeespecially Section4.3),the dynamics of a dissipative system can derive from a potential only in some exceptional situations such as systemsinvolving a single variable, or systemsoperating in a small neighborhood around the state of thermodynamic equilibrium. is not representative of a system subjectto strongly nonThus, Eq. F.12) of this is that some equilibrium constraints.An important consequence which become oscillations, very widely spreadphenomena such as sustained possiblebeyond the instability of the thermodynamic branch, cannot be
classification
described by theseequations. Underthesetwo assumptions, one may now undertake a general classifiof the solutionsof Eq. F.12) based on the breakdownin structural stability, by lookingfor the points where there is a change in the stability propertiesof the steady statesdV/dpt = 0.The latter exist as long as Fdoes not dependon time explicitly.These ensemblede catastrophes by hypersurfaces in the parameter space along which either
points\342\200\224called Thorn\342\200\224are
76
Mathematical
Tools
a branching of solutionsof the equationstakesplace,or where V attains its absoluteminimum in at least two distinct points.In other words,by crossing these hypersurfaces one switches from a region where a certain dynamics takes placeto a region where the dynamics is qualitatively different. In a hypersurface defines a spatial domain having a general [seeEq. certain morphology, separating different types of regime.In this way intimately related.We illustrate Thom'stheory dynamics and form become on an explicitexample in Section8.4.
F.11)]
TWO
VARIABLES
General Considerations Before we proceed to the analysis of specific models,we illustrate in this sectionsome of the conceptsdevelopedthus far on the simplest possible nontrivial caseof systemscapable of undergoing cooperative behavior. Obviously, the simplestsuch examplein the context of chemical kinetics are systemsinvolving two variable concentrations.* Our main purpose is to seethe conditionsunder which such systems can exhibit instabilities in the steady-state solutions,without explicit reference to the details of the kinetics.To simplify even further we ignore the effectsof diffusion. The Let X, Y denotethe composition variables of the two intermediates. rate equationstake the form:
F.13)
Ht
Y)
is autonomous. dependon time explicitly.Thus the differential system F.13) We assumethat fx, fY are continuous and satisfy the Lipschitz condition in a certain boundeddomain, D, of the phasespace(X, Y), in other words,
\\fx(X2, Y2)
\\fy(X2,Y2)-fY(X1,Yl\\<K\\X2-Xl\\
* Systems
of their inability to give rise to involving a single variable are excluded here because oscillatory behavior and/or spatial structures arising beyond instability of the thermodynamic branch. They are studied briefly in Section 8.4.
6.5.
Variables
77
always fulfilled
in D and for We observethat Eq. is the kinetics is polynomial, that is,if the individual chemical stepssatisfy the law of massaction at equilibrium. Undertheseconditions, an important theorem of analysis due to Cauchy and Levinson, 1955) assertsthat the solutionsof and Picard (Coddington to a certain initial condition in D exist and are corresponding Eq. unique for t within a boundedinterval @, T). In order to appreciate better the meaning of this theorem, let us eliminate t in Eq. the two We obtain: between equalities
= {X,, Yt)
if
K>0.
F.14)
F.13)
F.13).
dXMX,Y)
FJ5)
The solution of this (nonlinear)first-order equation provides a one-parameter in the phaseplane (X, Y). To each point on thesecurves family of trajectories Thus, time can be used to correspondsa solution of the system F.13). theorem stated Moreover, from the uniqueness parameterize the trajectories. to different initial above, any intersection of the trajectoriescorresponding conditionsis ruled out. Another important point is that a closedtrajectory, a periodicsolution of the difC, in the (X, Y) plane describesnecessarily differential system. Indeed,from Eq. F.13):
dt
dX
fx(X, Y)
A V*
\\
T7V~v\\
this
= const
F-15a)
motion.
Forevery point (X, Y) in the plane there corto Eq. F.15). a well-definedvalue of the slope dY/dX of the trajectory, except corresponds for the points where
Let us
return
We call these the singular points.Note that by Eq.F.13) a singular point is a steady-state solution of the differential system. All other points in the plane are calledregular points.Accordingto our previousanalysis,one of the singular points correspondsto the extrapolation of the thermodynamic branch in the far-from-equilibrium region.Thus, in order to investigate
Mathematical
Tools
the possibility of self-organization processes we must analyze the stability of this particular steady state {Xo,Yo). To this end we construct the corcorresponding linearized system [cf. Eq. F.6)]:
\342\200\224
dx = aux + al2y
dy
\342\200\224
= a21x + a22y
F.16)
with
au = (j^\\
and
XY=Yo
(etc)
F.17)
of the form: admits solutions Owing to its linear structure, the systemF.16)
x
xoe\302\260\",y
yoe\302\260\"
Suchsolutionsare called normal modes.Substituting back into we obtain a homogeneous for the coefficients algebraic system of first degree x0,y0. The condition for having nontrivial solutionsof this system is
=0 F.20) det|fly -(oS%\\ This equation is known as the lie characteristic equation.In the presentcase of a two-variable system it takesthe form co2 Tco + A = 0 F.21) where
>
are, respectively,the trace and the determinant of the matrix of the coefficoefficients.
In general, Eq. F.21) admits two distinct solutions(ou at2. Thus, the is of the form: solution of Eq. F.16)
+ CtS* x-c^' = +
y
CiKte\"\"
c2K2ea2t
F23)
6.5.
79
where ct, c2 are determined by the initial conditions,and the coefficients referred to as distribution coefficients(Andronov et al., Ku K2, sometimes the are roots of the equation [see 1966), Eq. F.16)]:
- a21 =0
F.23a)
stability
criteria:
\342\200\242
the following
stable..
\342\200\242
is unstable.
\342\200\242
If for at least
remain negative, the system is stable in the senseof Lyapounov, but not asymptotically stable.We call this situation marginal stability. of T and A Now onceEq. F.21) is known, that is, oncethe dependence on the parameters it is immediatelypossible to seewhich of these is specified, we can determine is actually realized. Moreover, from Eq. F.23) possibilities how the perturbedsystem evolves back or departsfrom the singular point. Thesevarious types of behavior are briefly compiledin the next subsection. Classificationof the Singular Points: SimpleSingular Points
Both Roots Are Real, T2
(i) If in
others
4A
>0
to\342\200\224or from\342\200\224
addition, A > 0, both roots a>; have the same sign. According to this implies a nonoscillatory approach Eq. F.23), departure the singular point.*One speaksin this case, respectively,of a stable or of an unstable node. Figure 6Aa,b describesthe qualitative behavior of the tratrajectories in
thesecases.
Two particular cases, both corresponding to a double root of the charfirst correspondsto the The are worth equation, mentioning. situation a12 = a21 = 0, an = a22 = a # 0:
characteristic
dx
\342\200\224
dt dy
= ax
F.24)
that the behavior may well be nonmonototic for some finite time interval. arises when the signs off, and c2(or of the Ku K2) are not identical.
* We note
This
so
Mathematical
Tools
(a)
(b)
stable node; (b) unstable node.
The trajectories,besidesthe singular point S, are all rays issuing from S, if a > 0.Point S is called a in the direction of S if a < 0, toward infinity or stellar node, stable unstable, respectively(Fig. 6.2a,b). This yields: to T2 4A = 0. The secondcase corresponds
\342\200\224
It = ax + ay
The solutionsare given by:
x
y
dx
F.25)
= x01ea = yOiea
ay01tea
F.25a)
By eliminating t one sees that the trajectoriesare the curves y = 0 and in Fig. x = y log | y | + cy, with c a constant.Thesecurves are represented
(a)
Figure
(b)
stable stellar node; (b) unstable stellar node.
6.5.
81
Figure
< 0, then the two (real)rootsa>i have different signs.From Eq.F.23) one obtains:
(ii) If A
e0\"' =
F.26)
Taking coj > 0 and co2 < 0, one deducesthen the following equations
for the
trajectories:
- K,
F.27)
These are hyperboloidcurves with two asymptotes passing through the singular point, which is calleda saddlepoint. Theseasymptotes correspond to the particular choice of initial conditionsc2 = 0 or c, = 0.Their slopes are, therefore, K^ and K2, respectively and are the roots of Eq. F.23a). these trajectories in the phaseplane (x,y). We note that Figure 6.4represents
Figure
trajectories
6.4.
of tra-
82
Mathematical
Tools
(a)
Figure
(b)
asymptotes, as t -* oo. Thus, a saddlepoint is always unstable.We call of the saddlepoint. the two asymptotes the separatrices goesto
infinity
\342\200\224
4A
<0
addition, T # 0, then the two roots have nonvanishing real part. this implies an oscillatory approach to (T < 0) According to Eq. F.23), or departure from (T > 0), the singular point. One speaks,respectively, of a stable or an unstable focus. The trajectoriesare representedin Fig.
6.5a,b.
(iv)
\342\200\224
0,
but
imaginary,
a>i
\302\261
iy.
Thus,
phasespaceundergoesundamped oscillations^ of course linearization constitutes a valid approximation. provided to the in the beginning of this section, considerations According developed the trajectories are necessarily curves surrounding the singular point, closed which is referred to as a center. The situation is describedin Fig.6.6. The exhibits neither S nor the however, points Lyapounov stability; singular orbits are asymptotically stable.
the representative point
Figure
6.6. Closedtrajectories
surrounding
a center.
was The classificationof the singular pointsgiven in the previous subsection based on the existenceof two nonvanishing roots of the characteristic and F.22)]. equation, that is, on the assumption A # 0 [seeEqs. F.21)
6.6.
Branchings,
Bifurcations,
83
Figure type.
6.7.
Configuration
of trajectories
in vicinity of a multiple
singular
point of saddle-node
a point Topologically,this implies that the singular point is then necessarily of intersection of the curves
fx(X0, Y0) = 0; fY(X0, Yo) = 0 Such singular points are referred to as simple singular points.
singular points, or points for which A of contact of the curves F.28), dennedby points
F.28)
Multiple
Owingto this, for arbitrarily smallvariations of the functionsfx, fY a multiple singular point generallysplitsinto two or more singular points.According to the previous subsection,in systems involving two variables a multiple between a node and a saddlepoint. An singular point is a borderlinecase in the vicinity of this point givesthe image depicted analysisof the trajectories in Fig. 6.7 (Andronov, Vit, and Khaikin, 1966). As we see, the stability propertiesbecomequite complex. In systemsinvolving several variables, new types of multiple singular points may appear.Nevertheless,they can always be viewed as coalescence some points of simplesingular points as a certain set of parameterscrosses \"critical\" value.
6.6.BRANCHINGS,
involving two
As emphasized in Chapter5, the properties of a chemical system repeatedly depend,in general, on a set of parametersX. In a homogeneous system
fx, fY
that
S4
Mathematical
Tools
dependexplicitlyon X. According to the classificationof the singular points of Section6.5, for a sufficiently small variation of X the character of the
singular point may only vary
A(X0(X), when
Y0(X), Y0(X),
X)
T(X0{X),
= Q (saddle-node) X) = (center)
Theserelations provide us with a set of critical values, Xc. A slight variation of X from Xc resultsin qualitatively different trajectories in the phaseplane. two cases c ited above to the Thus, correspond structurally unstable situait is also quite clear that at From the classification of Section6.5, with trajectories that passin its immediate X = Xc the singular point coexists it. without from therefore, one vicinity emanating necessarily Intuitively, = A is that a of a Xc point bifurcation,whereby branching of solutions expects of the differential equationsF.13) occurs. We now discussa number of general theorems stating the conditions
situations.
To this end we write the nonlinear under which bifurcation may occur. differential system for the perturbationsaround the thermodynamic branch in the form (seebeginning of Section6.3)
dx
\342\200\224
or
J(X)x
F-30)
+
N(X\\x)
=0
where x is now regardedas a vector whosecomponents are the linearized operatorappearingin Eqs.F.6) orF.16), and N comprises all contributions that are nonlinear in x. Note that in the second form of J contains both the time derivativesand the Laplaceoperators,in Eq. F.30) addition to the contributions due to the chemical reactions. An equivalent way to formulate the problemis to define X in such a way that J can be split into a A-independentpart Jo and a contribution proto X: proportional
(x1,...,xn),Li
Jox
Xx
+ N(X;x)= 0
F.31)
6.6.
Branchings,
Bifurcations,
85
branchesfor the nonlinear problem,we have to introduce the conceptof of an eigenvalue. Let us first illustrate this conceptin the case multiplicity where L is a squarematrix, and let / be the unit matrix. We say that Xk is an /, if: eigenvalueof algebraic multiplicity
det|L
with
A/|
= (A #0
Xjh(X)
F.32)
h(Xk)
More generally, consider the set of linearly independent eigenvectors null spaceof the operator to Xk, which belongto the so-called corresponding L XkI. The multiplicity of Xk is then dennedas the dimension of the union It can be shown (Riesz of the null spacesof (L XkI)m, where m = 1, 2, that as m increases each null spaceis strictly contained and Sz.Nagy, 1955) in the succeeding one until a certain index / is reached; thereafter, all null the same have finite. dimension, necessarily spaces We are now in positionto state the following theorem due to Leray and
\342\200\224
SchauderA934):
then Xc is
of Join Eq.F.31),
The proof of this important theorem isbasedon topological degree theory and is omitted (seeKrasnosel'skii, Note that there 1964; 1973). may Sattinger, on Jo and N, a large or even an be, even under the smoothestassumptions infinite number of bifurcating solutions, discussion and a complete including If the eigenvalue is of also their stability propertiesseemsto be impossible. even multiplicity, the additional element is that there may be no bifurcating solutionsat all. It is only in someparticular cases (McLeodand Sattinger, that one can discussbifurcation from and Reiss,1975), 1973; Bauer, Keller, a multiple eigenvaluein full detail. As an example of the roleof the multiplicity of the eigenvalue,consider the simplealgebraic equation
One has a nontrivial to an eigenvalue of odd multiplicity corresponds In contrast, in the problem(Stakgold, 1971)
xt
= mx
\342\200\224
Xx
= (m
\342\200\224
X)x
+
\342\200\224
x\\ x\\
\342\200\224
Xxx
x2
Xx2
=0 =0
*\"
Mathematical
Tools
A = 1 as a doubleeigenvalue.No nontrivial realvalued branches of solutions can be issued from this value as one sees immediately by reducing this system to the singleequation x\\ + x\\ = 0
Two important cases for which the theory is quite complete (Pimbley,1969; are those in which:(a) a simpleeigenvalue of the operator Sattinger, 1973) that is an eigenvalue of multiplicity L in Eq. F.30), / = 1, the origin crosses or (b) a pair of simplecomplexeigenvalues of L cross the imaginary axis. In both cases we assume
Re\342\200\224^^>0
F.30)
where cocis one of the critical eigenvalues of the operator L. This implies behavior for atc as shown in Fig.6.8a,b. we have at Then, in both cases X = Xc bifurcation corresponding either to a new branch of steady-state solutionsor to a periodictrajectory. Fora two-variable system thesecases correspond, respectively, to A(AC) = 0 and to T(XC)= 0 [cf. Eq. F.29)]. that in the vicinity of A = Xc Moreover,one can show (Sattinger, 1973) solutionsthat bifurcate above critical level, that is, for X > Xc, are asympstable, while solutions bifurcating below criticality, that is, for X < Xc, are unstable. We illustrate these results in detail on the models
asymptotically
in Chapter7. developed It is remarkablethat these highly nontrivial results are based on the of the linearizedsystem.This is due to the fact that one is interested properties in the propertiesof the solutionsbelow or above the bifurcation primarily In point. contrast, at A = Ac, the principleof linearized stability (cf. Section 6.3)does not apply, as the system is in a state of marginal stability. In this
(b)
Figure vicinity
6.8.
Behavior
ofa bifurcation
of (simple)
point
Xc:
eigenvalue
of operator L
corresponding to Eq.
F.30) in
6.6.
Branchings,
Bifurcations,
87
full nonlinear system to obtain information about the character of the critical points,as well as about the possiblebifurcations. The emergence of multiple steady statesand asymptoticallystableperiodic orbitsis most important in terms of physicochemical Consider application. first the case of many steady states. Of particular interest is the situation where the system can exhibit more than one simultaneously stable state of this kind. In this case a certain functional order becomes possiblethrough transitions betweenthesestates,providing a self-regulationof the concentraof the various chemicals. Note,however,that in cases involving bifurcathis need not always be the case. Forinstance, a single singular point It may also can be succeeded by a single new asymptotically stablesolution. the system doesnot admit bounded happen that for certain initial conditions solutionsas t -* oo or that it even explodesat a finite value of t. As we see repeatedly in the sequel,multiple steady statesarise in a great number of modelsof physicochemicalor of biochemicalinterest. solutions,we seethat we now Comingto the bifurcation of time-periodic have the possibilityof cooperative behavior in the form of a \"temporal \" Now temporal organization implies necessarily organization in the system. structural stability. Therefore, two periodic(i.e., closed) trajectoriesin the via a mechanism are bifurcation necessarily phasespacearising separated from each other as well as from the singular point.Accordby a finite distance to Poincare, we call them limit cycles. In contrast, structurally unstable an of exhibit in a finite closed domain of systems may phasespace infinity are the Their and determined initial trajectories. by amplitudes periods the in the are w hereas case determined conditions, by system limit-cycle they itself. Forthis reason,periodictrajectories surrounding a center are hencedismissed as a model of chemical oscillations (we return to this point in Sections 7.1and 8.2). Note that a limit cycle neednot always be asymptoticallystable.Unstable or even semistable on Fig.6.9. limit cycles are possible, as described
concentrations bifurcation According
henceforth
Figure
6.9. Asymptotically
cycles.
88
limit
Mathematicals
Tools
1966):
(i)
A
Let us mention, without proof, some important resultsestablishedfor cyclesin two-dimensional phasespaces(Andronov, Vit, and Khaikin,
a single It singular point is inside,this point can only be a focus, a center or a node. can be neither a saddlepoint nor a multiple singular point, if the expression (ii) Forthe negative criterion of Bendixson,
->
dnf^8X
dfx
= /fy 8Y Wkh/
dfY
->
a domain of the (X, Y) plane, there can doesnot [cf. Eq.F.13)] be no limit cyclesin this domain.This statement alsoshowsthat limit cycles can only arise in nonlinear systems. (iii) Simpleasymptotically stable limit cyclescan emerge smoothly from a singular point via the bifurcation mechanismoutlined earlier in this section. (iv) Stablelimit cyclescan emerge from multiple limit cyclesarising from the coalescence of a stableand an unstable limit cycle. (v) Two or several limit cyclessurrounding a singular point are possible, as a result of a subcritical bifurcation of a periodictrajectory from this A concrete singular point, arising for certain criticalvaluesof the parameters. example of this behavior is analyzed in Section15.5. bifurcationsof limit cycles are possible in the presence (vi) Morecomplicated of separatriceloops joining two singular points, one of which is a saddle 6.10). point, (Fig. change sign in
Ml
Multiple
singular
point
(saddle-node)
Figure
one
of which
Bifurcation 6.10.
of separatrices joining two singular points, of limit cycles in presence is a saddle point (after Andronov et al.,1966).
6.6.
Branchings,
Bifurcations,
89
As we seeshortly, a great number of chemical systems may exhibit limit cycle behavior under conditions(c).However, modelsare now known (see Chapter 15)giving rise to the more complexbehavior describedunder (v) and (vi). Although we comment more extensively of the significance of limit cycleslater in the sequel,we may already stress that the ability to exhibit a sharp periodicity in the concentrations shouldbe an important means for regulating chemical or biologicalactivities in a great variety of situations. Having seen that the relatively simpletwo-variable systems can already exhibit complexbehavior, we now addressourselves to the conditionsthat have to be fulfilled by the kinetics in order to get cooperative behavior. We already know from Part I that the system must be open, driven far from Our purpose,however, is to produce equilibrium and subjectto feedbacks. more precise statements regarding the nature of the individual chemical stepsinvolved in the reaction sequence.
Chapter 7
SimpleAutocatalyticModels
7.1.TWO INTERMEDIATES
consider a chemical system involving two variable intermediates, together with a number of initial and final productswhoseconcentrations are assumedto be controlledthroughout the reaction process. The reason we are interested in chemical systemsinvolving two variables is not only As we seein Part IV, an impressive number of biochemical academic. problemscan be describedby modelsthat can be reducedto two variables under quite realistic conditions. We now show the following:
We
to have a limit cycle surrounding an unstable Theorem. It is impossible node or focus in a reaction sequence involving two variable intermediates if the reaction stepsare only uni- and bimolecular. Thus, a trimolecular or higher orderstep is necessaryfor the onset of cooperative behavior in time. The theorem was first proven by Hanusse Tyson and Light A973)rederived systems. A972)for spatially homogeneous and extended it to systems involving diffusion the theorem independently as well. and X Proof. Let {A} denote the initial and final \"reservoir\"chemicals, The system is taken to be isothermal and and Y the two intermediates. with no convectivemotion. Denoting the concentration of X, Y by the same as the chemicals themselves,we have, in the notation of Section6.5: symbols
~=fx(X,Y) ~ = fr(X, Y)
90
G.1)
7.1.Two Intermediates
The steady statesare given by:
91
G.2)
dx =
dy
aux + a12y
G.3)
\342\200\224
= a21x + a22y
- Tco+
\\dXj0
=0
G.4)
= ana22 ai2a2l
\\3Yjo
G.5)
kinetics, taking Assuming now that the system is subjectto a mass-action the mixture to be ideal and consideringthat only uni- and bimolecular stepsare present,we may write:
fx
fY=
where X,
+ aX + /?y +
yXY
+ SX2+ eY2
G.6)
fareconstants independent of X, Y. At the steady state: X0(a + cY0 + dX0)= -(X + bY0 + eY2) UP+ yX0 + eY0) = -(?+ aX0 + 5X2) G.7)
+ 2dX0 + p +
yX0
T= a + cY0
2eY0
^]
G.8)
92
Simple Autocatalytic
Models
Table7.1): (see
Let us now compilethe various processes in the system that are possible
Table7.1
Contribution to Contribution
dY/dt
(if
to
Step
X
(if
* 0)
^ 0)
A-+ ->
1 >0 a?
b d
x + y->
2y->
y->
c?
>0
<0
y> o >0
/J?
y?
e>0
E>0
\302\243
<0
We
i, 7, b, e, a, 5 >0
G.9)
d,
\302\243
and
<0
whatever the details of the kinetics.On the other hand, a, c, jS, y have no definite sign.Forexample,for a it is sufficient to realize that the reaction X-> can produce,consumeor leave X unchanged:
Xh u Xh iA A X
\342\200\224 \342\200\224>
\342\200\224*
+ 2X
X
\342\200\224
\342\200\224*
a a a
=0
>0
<0
Finally, we want Xo, Yo to be positive on physical grounds.Thus, we cannot become concludethat expression greater than zero. Combining G.8) 6.5we concludethat with the classificationof the singular pointsin Section it is not possible to obtain, by removing the system from equilibrium, either an unstable focus or an unstable node.The formation of a saddle is not interesting in the context of instabilities point, which remains possible, as we saw in item (i) on p. 88, a limit to coherent behavior. Indeed, leading
cycle can bifurcate only from an unstable focus or, more generally, it can surround only a node or a focus.
7.2.
93
2X +
\302\253=\302\261
3X
or through a symmetrical step interchanging the roles of X and Y. Let us, conditions: of reactions under open-system therefore, considerthe sequence
<
'
+D
2X +Y
E
In
G.10)
L4 = L2 = 0, To
order to achieve nonequilibrium constraints we may assumethat the D, E are removed from the reaction spaceas soonas they products\" are produced.In terms of the rate equationsthis is equivalent to taking
\"final
simplify the analysis even further we then introduce the additional condition k_, ^ 0 (which is certainly justified as long as A is in excess) and k_ 3 ~ The scheme is then described by the rate equations
[cf.Eq.E.3)]:
PY
0.
^ = M~-
(k2B +
G.11)
so far, we expectthis system of equations According to the ideasdeveloped to feature various kinds of cooperative behavior. It is instructive to comment on the meaning of the cubicnonlinearity in this model, first proposed by Prigogine and Lefever in 1968 and often referred to sinceas the trimolecular modelor the Brusselator (Tyson, 1973). Firstly, it is important to realize that the primary objective in studying a model is to discover with some the types of qualitative behavior compatible fundamental and chemical such as the laws of laws, thermodynamics
94
Simple Autocatalytic
Models
kinetics.In this respect,regardlessof the reasonableness or not of a trimolecular reaction step,the Brusselator is a perfectlyacceptablemodel for It plays somewhat the study of cooperative processes in chemical kinetics. or the Heisenberg the same role as such modelsas the harmonic oscillator, model in ferromagnetism, which have both been widely used to illustrate basic features of systemsdescribedby the laws of classicalor quantum mechanics. in most branches of physics of cooperativephenomena Secondly, as or such laser physics,cubic nonlinearities translating multiple plasma couplingsbetween appropriately defined \"modes\" are, indeed, the first nonlinearities giving rise to cooperative behavior. Thirdly, nontrivial trimolecular although not nearly as common as bimolecular processes, the gaseous e ven in stepsare not completely unknown in chemical kinetics, of of of one the the phase.Forinstance, Chapman sequence reactions steps in the upperatmosphere involves the formation of ozone by (Nicolet,1964)
atomic oxygen via the triple collision:
O + O2 + M
>
O3 + M
where M is a third bodywhoserole is to dissipate the excess energy available in the reaction. of biochemical a number the rate in Finally, equations reactions involving enzyme catalysis can be reduced to cubic terms in certain limiting cases. One case is that of the glycolyticpathway (see Chapter is A nother the of enzymatic reactions: 14). example following sequence
x + E, <==>
E,Xh
h Y
?==?
\302\253=
=^
\342\200\224+ \342\200\224>
\342\200\224
\342\200\224+
i+X
where the enzyme Ex is assumed to have at least three catalytic sitescapable of X and one moleculeof Y simultaneously.Providing of fixing two molecules the rates of decomposition of the complexes are sufficiently large and the are in small one can easily show that this amounts, enzymes present very can bereduced a to overall sequence single stepgiving a nonlinear contribuin the rate equationsof the formX2Y.
contribution
STATES,AND
BOUNDARY
CONDITIONS
Equations G.11) depend on as many as six chemical parameters,the two Forbetter of the reaction vessel. coefficients,and the dimensions
7.3.
95
into the qualitative behavior we introduce the following scaled insight variables (Erneux and Herschkowitz-Kaufman,1975):
t
= kj = fU
(k) *
\\l/2
H \\J\\ G-12)
= ^B
By substituting
variables X,
Y satisfy
that
the
reduced
_ = - + l)X + + = BX + D2V2Y
A
(B
X2Y
\302\243>!
V2X
G.13)
\342\200\224
X2Y
where the Laplaceoperator refersto the same spacecoordinater as before. to Eq. G.12), Note that according quite realistic values of the rate constants in the reducedsystem G.13), to and diffusion coefficientsmay correspond, numerical values of the coefficientsof the order of unity. This point should be kept in mind in view of the computer simulationsto be reported,in which the values of A, B,Du and D2 may seemunrealistic at first sight. of Eq.G.13) We study the solutions under the following two types of boundboundary
conditions:
Xz
=A
\342\200\224
y1 = fdXY
n-f\342\200\224
G.14)
\\drj
fdYY =n'K\\drj
=\302\260
G.15)
96
With
Simple Autocatalytic
Models
solution: steady-state
= A,
Y0
l
A
G.16)
in Part I,this solution lieson the thermoAccording to the ideasdeveloped dynamic branch. This can be proven explicitly by taking the reversible schemeG.10) and gradually increasing the overall affinity of the reaction, to remove the system from equilibrium (Lefever, 1970; Glansdorff and Note that if the boundary values G.14) had been chosen 1971). Prigogine, different from A and B/A the thermodynamic branch would not be uniform, of boundary-layer effects.However, theseeffectsare owing to the presence and are not considered from the standpoint of cooperative processes spurious explicitly in this chapter. thus far, we carry out a linear Following the general methodsestablished We expectthat this of the stability analysis thermodynamic branch G.16). will the information analysis give interesting possibilityof selfregarding the within organization processes system.
7.4. LINEAR
We set
STABILITY ANALYSIS
X
Y
=A + x = +y
G.17)
for the linearized system [seeEq. F.6)] and construct, from Eq. G.13), either as external disturNote that be can (x, systematic (x, y). interpreted y) or as internal fluctuations around the reference state. In the latter case,the problem we address ourselves to for the time being is not the a priori probability for having such a fluctuation but, rather, its time evoluonceit has beenestablished by somemechanism in the system. It is convenientto write the linearized system for x,y in the form:
disturbances
evolution
subjectto:
or
ICK)
x=y =0
on
I
on
G.19a)
n-Vx = n-Vy = 0
G.19b)
7.4.
Linear Stability
Analysis
97
in
some appropriatespace.
finds
\\yJ
1+
-B
\302\243>!
-A2 +
D2\\
This is a parabolicoperator(Sneddon,1957). To analyze the asymptotic behavior of the solutionsof G.18) as t -* oo it is sufficient to find the eigeneigenvalues
(om and
the eigenvectorsI
of L:
V72 M
1+
-B
\302\243>!
V2
2 , r. -A2 +
..
\342\200\224
^m\\
..
G.21)
G.22a)
subjectto
ul = vl = 0
or
n
\342\200\242 V\302\253\302\243
=n
(
\342\200\242
Vt\302\243
=0
G.22b)
In terms of
\"m
G.23)
Thus, the reference state (A, B/A) is asymptotically stable if for all m the eigenvaluesa>m obey Re com < 0
If for somem Re (om 0, then the solution on the thermodynamic branch is unstable. According to the Leray-Schaudertheorem (Section6.6),at Re com = 0 onehas a bifurcation phenomenon provided the eigenvalueis of odd multiplicity. We are interestedespecially in simple eigenvalues. In order to display the detailsof the calculation in a transparent way we considerin this chapter the case of one-dimensional systems(higher dimensystemsare treated in Chapter8). Note that throughout the analysis we deal with boundedmedia.One reasonis that in chemistry, and to an even greater extent in biology, boundariessuch as membranes play a very Another reasonis that the mathematical analysis becomes important role. simpler as the spectrum of the operator L is then discrete,and one can
dimensional
>
98
Simple Autocatalytic
Models
for the solutions of the nonlinear systems construct analytic expressions beyond the instability. Let / be the length of the system.The LaplaceoperatorV2 reducesto:
V2
= -r-2
dr
<r <1
V2
o,l,2,...
G.25)
for the no-flux boundary conditions.We now deal successivelywith the eigenvalues,the eigenvectors,and the structure of the operatorL in a space of square-integrable functions, for which the set of normal modes in Eq. basis. provide a complete G.24)or G.25)
Eigenvalues
into Eq. and G.25) oneobtainsa characteristic Introducing Eqs.G.24) 6.5) equation (seeSection expressing in terms of m and the parametersof the system. After a few algebraic manipulations one finds:
<x>m
G.21),
\342\200\224
wm
(Pm
\342\200\224
Xmfelm
A2B
am
jSm
=0
G-26)
with
m2n2
G.27)
The solution of this equation yields:
i=
K\302\253m
-Pm\302\261
G.28)
7.4.
Linear Stability
Analysis
99
-> ao. Thus, for finite 4 oo, (am + pmJ -> (m*n*//*)(D2 is necessarily real.Moreover, as D2 + Di > \\D2 D^, com is always negative. We seealready that all normal modesdo not play the as thosewith m -> oo tend to stabilize the system, same role, if (ii) com is complex + /U2 *A2B < 0,
\302\243>iJ
(\302\253*
or
B2
with
2(A2
SJB+ (A2
SmJ
<0
G.29) G.30)
Sm
=l
+\"}2j^(D1-D2)
\302\261
= A2 + Sm
Sm
>0
G.31a)
and
G.31b)
G.32)
D2-Dl^
In particular,
if
the value m
= 0 can be
D2
- D,.> ^
I2 in
(iii) A
complexeigenvaluehas a positive real part if the coefficientof com is negative,or if [see definitions G.27)]: Eq. G.26)
B>A2
Bm
+1
+ D2) +m~^-{D1
of m along the critical curve
(\302\243>!
= A2 +
l+ \"^
+ D2)
G.33)
100
Simple Autocatalytic
Models
Linear stability diagram associated with bifurcation of time-periodic solutions, Figure where m wave number; Bm (m corresponding value of bifurcation parameter. At first bifurcation point Bo one always has appearance ofa spatially homogeneous limit cycle.
7.1.
=
= 0,1,...) =
Obviously, the (purely imaginary) eigenvalues com are simplein this case. the points on the in Section Thus, accordingto the theoremsdiscussed 6.6, curve Bm corresponding to integer values of m are necessarily bifurcation from a of As B solutions. increases points time-periodic region of small with the boundary conditions occurs values, the first bifurcation compatible = either at m = 0 for no-flux conditions 1for o r at m Dirichlet [see Eq.G.25)]
-A2B>0
I2
or
D2mznz
~T2
G.34)
Fora given B the zero eigenvaluescom = 0 are generally simple, exceptfor someexceptional values of the parameters(seebelow). Thus, the points on the curve Bm corresponding to integer values of m are necessarily bifurcation
the points ofsteady-statesolutions.As B increases,
first instability
for a occurs
7.4.
Linear Stability
Analysis
101
Figure 7.2. Linear stability diagram associated with bifurcation First bifurcation point Bc lies in vicinity of minimum Bu of marginal
of steady-state
solutions.
in
general
Bc
# B,,.
closestto the
minimum
(jU,
of
G.35)
(v) (iii) and (iv) we may derive conditionsconcerning the Combining cases to take place in the system as B increases. Obviously, this B 7 .1 and when the value crosses 7.2): (seeFigs. happens
first instability
B for no-flux
= min(Bc,Bo) = min(Bc,
and conditions,
B
conditions
we find that for Dirichlet conComparingEqs. G.33), G.34),and G.32) the first bifurcation leadsto time-periodic solutionsprovided
102 and
Simple Autocatalytic
Models
or
In particular, for
D, = D2 = oneobtains:
\302\243>
D<
-^
/I/2
G.37)
equal diffusion coefficients,provided the latter satisfy the inverse inequality various possibilities G.37). concerning the first bifurcaFigure 7.3describes
bifurcation.
is On the other hand, for Dl/D2~* 0 or for Dl/D2-> oo, inequality G.36) is favored the of solutions bifurcation Thus, time-periodic compromised. when the diffusion coefficientsbecome Note, however, that for very close. Dirichlet conditionsthe bifurcation of steady-state solutionsis possiblefor
(vi)
that
Forcompleteness, let us finally derive the conditionsunder which the in case eigenvaluecom (iv) is doubly degenerate. Obviously, what isneededis
which is regarded as an equation for m2, be written Eq.G.34), in
the form:
(m2
m\\)(m2
m22)
=0
where mu m2 are two positive integers. In particular, if wetake m^ = mc < \\x, then we necessarily have m2 ~ mc + The condition for doubledegeneracy is, then, that the productof the roots of Eq.G.34)be mc(mc + 1).By working this condition out explicitly one finds (Mahar and Matkowsky,1976; and Nicolis,1975): Auchmuty
1.
^w^=m^ + 1)
G38)
we assume that this rather exceptional condition is not Subsequently, satisfied.We return to the problemof degenerate eigenvaluesin Section7.9. Throughout this subsectionwe have been interested only in the first bifurcation from the thermodynamic branch.The reasonis that, as we see shortly, bifurcation theory can give information about the stability of the
7.4.
Linear Stability
Analysis
103
V*
B,
50
f
\\
40
,
I I
(c)
1 '
1
*4*l
'
'i
\342\200\242
H
1A
\"i\\
30 -
\\
20
'if if
/'
(a)
/ /
/
/1 1
1 B,
20
1
-1
1
'
i
J
15 1
f
@
J/
\342\226\240
10
V i
10
\\\\\\y
(all
10
Figure
20
30
10
20
30
Linear stability diagrams resulting from Eqs. G.33)-G.35). Bifurcation parameter wave number n. (a) and (b) show region of complex eigenvalues; (b) shows region corresponding to an unstable focus; (c) shows unstable region corresponding to a saddle point. Vertical lines indicate allowed discrete values of n for a system submitted to zerofluxes or 8.0 x 10~3. fixed boundary conditions. (A) shows A D, 1.6x 1(T3;(B) shows A 2, / 1, D, = 1.6x 10\" \\ D2 8.0x 10\023. Line limiting regions (a) and (b) have not been drawn fully in Fig. (B).
7.3.
B is plotted against
= 2,/= 1,O, = =
bifurcating
instabilities
is dealt with
of OperatorL Eigenvectors
preceding
is not satisfied, we concludefrom the precondition G.38) of a steady-state analysis that in the vicinity of B = Bc and in the case null space bifurcation, the operator L has a one-dimensional spannedby the functions (depending on the boundary conditions):
Assuming that Ci
\\
. mnr sin
-\342\200\224
G.39)
Cl)cos
mnr
104
Substituting
Simple Autocatatytic
Models
into the linearized system G.21) one obtains the value of the ratio c2/cias follows:
c2 _
(\302\243>,m27t2//2)
Bn
A1
G.40)
or,for m = mc ^
jx:
So far,
Ci remains undetermined.
One can
fix
it by
requiring a specific
normalization for
nonlinear analysis beyond the bifurcation point can remove this indetermiindeterminacy.
w.
m
solutionsI
dependence
fx\\
in
the
vicinity
exp i(lma>cf)sin^
G.42a)
bifurcation (mc = 0): G-42b>
Forno-flux
first
w = u-1)expi{lmoi^
The steady state (/I,B/A) behaves like a center in much the sameway as in the system discussed 6.5. in Section in According to the theorems developed we expectthat for B > Bothis situation givesriseto a limit-cycle Section6.6, behavior.
o
Figure
7.4. Polar
eigenfunction
of linearized operator
L for zero-flux
boundary
conditions.
7.4.
Linear Stability
Analysis
105
An important feature of the spatial part of eigenfunctionscorresponding to exhibit a macroscopic to no-flux boundary conditionsis the possibility the system, as shown on Fig.7.4.Thus, we have a general gradient across onset of polarity in a previously unoriented mechanism for the spontaneous space(Babloyantz and Hiernaux, 1975).
operatorL, in
V =I
+B <DlT1 T1 clr
1 I
G.43)
Obviously, the eigenvaluesof this operatorare the same as for L, whereas the eigenfunctionsfeature the same spacedependence. Forinstance, in the caseof Dirichlet conditionsand in the vicinity of a steady-state bifurcation
mnr
1 1
\342\200\224
'~WV
I2
G.44)
Note that under no conditionscan the operator L be self-adjoint for the trimolecular model. Stated differently, the linearized equations for this model cannot derive from a potential. We have here a striking confirmation of the results of Part I (seealso comments in Section6.4),accordingto which nonlinear systemsfar from equilibrium cannot, in general,bedescribed by the extrema of a state functional. The analysis of the presentsection refers specificallyto the trimolecular model.Scriven and co-workers(Gmitro and Scriven, 1966; Othmer and carriedout a formal linear-stabilityanalysisof general reaction Scriven,1969) in Section 6.5. schemes, extending the results,described We now study, successively, the two kinds of bifurcation suggested by the linear stability analysis of the trimolecular model.
106
Simple Autocatalytic
Models
DISSIPATIVE STRUCTURES:
SCHEME
in case on eigenvalues. (iv) of the previous subsection placeourselves Our aim is to produceexplicit forms of the steady-state solutionsbifurcating G.17) beyond the critical value Bc.To this end we insert the decomposition into the rate equationsG.13), keepingthis time the nonlinear contributions the operator L in G.20) in a way in x and y. Moreover, we decompose similar to Eq. G.31):
We now
G.45)
where Lc is the operatorL evaluated at the critical point of the first bifurcais the property established The main motivation for this decomposition in the previous section,that Lc is a parabolicoperator which admits a
bifurcation.
m\" J
real parts. Such operators are referred to as dissipative operators in the literature. They are well known from stochastic processes and kinetic theory where the Fokker-Planck operator provides the most familiar
\\ mcj
example.
= 0):
We
obtain
in
this
way
where
h(x, y)
= (B
- Bc)x+
AA
\\yj
2Axy
\342\200\224
x2
+ x2y
G.47)
The boundary conditions Note that in are,again, the sameas in Eq. G.22). the excess variables x and y the nonlinearity is not only cubicbut also gives riseto quadratic terms. To calculate the solutions
point the
we observethat
close to the
A \\
I
bifurcation
should besmall.
\\d/AJ
7.5.
We
Bifurcation
of Stead-State
by
Dissipative
107
expressthis
expandingboth
(x\\
\\yj
and y
=B
Bc in terms of a small
parameter e*:
yj
y
=B
\\yoj
\\yi,
\342\226\240\342\226\240\342\226\240
Bc = ey, + e2y2 +
(IAS)
it
be developedin powers of (B
\342\200\224
Bc); in particular,
enables
and identify equal powers into Eq.G.46) We now introduce the expansion of e.We then obtain a set of relations of the form:
- Bc).
of a fractional powerdependence
(Vj =
or
dr
f~ak\\
fc
al
G.49)
= xk(l) =
dr
=0
The first
few
coefficientsak are:
~Jxo
+ +
As
IB
+ xly0 -7 A
x2
2Axoyt
Vi
G.50)
a result:
/vA
=0
G.51)
Recently bifurcation
briefly
Lefever, Herschkowitz-Kaufman and Turner were able to carry out an exact calculation in a simplified version of the trimolecular model. Their results are described in the Concluding Remarks.
108
In other
Simple Autocatalytic
Models
words,I
\302\260
me
of Lc.
On the other hand, Eqs.G.49)for k > 1 constitute inhomogeneous systems of linear equationswith constant coefficients.If the operator Lc were invertible, these systemswould be solved straightforwardly by constructing function for the operator* Lc (Sneddon,1957) and by converting Green's them to a set of linear integral equations.In our case, however, Lc is not null admits one nontrivial A as it invertible eigenfunction [seeEq. C.51)]. somewhat analogoussituation familiar from linear algebrais that of a set where the matrix of the of inhomogeneous algebraicequationsof first degree, coefficientswould be singular, that is,it would have a vanishing determinant.
The following theorem, which constitutes the extension of a result first the conditions proven in the context of problemsof linear algebra,specifies under which the systems admit a solution G.49) (Sattinger, 1973). Theorem(Fredholm alternative). The vector I provided the right-hand side I
k
/x \\
k
is a solution of Eq G.49)
null
is orthogonal to the
eigenvector
of the adjoint operatorL*. In the problem we are concerned with \"orthogonality\" is defined by means of a scalarproduct that is a combination of the scalarproductfamiliar from vector analysis and the scalar product defined in functional spaces such as a Hilbertspace(Rieszand Sz. This leadsto the following Nagy, 1955). of the theorem: quantitative expression
(x*,
?*)(\"*)) |o
dr (y*
k=
<m<k I,...;
0
=0
G.52)
From section 7.4, subsectionon the adjoint operator, we know that the as the eigenvector of eigenvector (x*,y*) has the same spacedependence Lc and that the amplitudes du d2 of x*, y* are generally different. Thus, takes the explicit form (dependingon the choiceof boundary Eq. G.52)
conditions):
sin
I Jo
mcnr\\
\342\200\224\342\200\224
dr
cos
mc nr
{
( ak({xk-m(r),
J k
yk-m(r)})
=0
G.52a)
to speak in
0
terms
< m < k-
1,...
be more appropriate
of Green'smatrix
operator it would
7.6.
Bifurcation:
109
determine entirely the coefficients Theseconditions, together with Eq.G.50), e as a function of from the secondrelation G.48),onedetermines yt. Next, e this calculated relation into the first G.48)and solving (B Bc).Inserting for the the inhomogeneous equationsG.49),one has an explicit expression
solution I
I. It
turns
out
that
on whether mc is even or odd, so we treat these cases separately.In the as these following analysis we calculate only the first few terms in Eq.G.48), to the solutionsobtained numerialready give quite goodapproximations We treat, successively, the case of Dirichlet and of no-flux boundary Further detailsare to be found in Nicolisand Auchmuty A974), conditions. NicolisA974b), Auchmuty and NicolisA975), Boa and Cohen A976), and
numerically.
Herschkowitz-KaufmanA975).
FIXED 7.6. BIFURCATION: mc
BOUNDARY
CONDITIONS
IsEven
in
When mc is even and oneusesthe expression for ar G.50) condition G.52), onefinds: together with Eq. G.39),
Cl
the solvability
Jo or
(
\\
yt
. mcnr sin
I
-\302\261\342\200\224
_\342\200\236
-\302\261\342\200\224
C'
Vt
Jo /Jo V^ The coefficientof yx on the left-hand sideis always positive. On the other hand, sincemc is even, the integrand in the right-hand sideis an odd function of r in the interval 0 < r < I. Thus, the right-hand sidevanishes.We conclude that: =0 G.53) yi
\342\200\224^j\342\200\224
t/r
. mcnr sin2
\342\200\224\342\200\224
, '
= ~ (Bc I -j Cj + 2^c2\\I
mc7rr
Next,
/
by
G.54)
110
Substituting this
Simple Autocatalytic
Models
into
Eq.G.54)one seesthat
where
if
m is even
if
misodd
G.55b)
and
On
inverting
finds an explicit time for a2(r)~one again the solvability condition\342\200\224this value of the coefficienty2 in the form:
y-\\=
<b\\mc,A,Bc,-\302\261\\
When mc ^ /x, Bc ^
entirely
in
B,, (seeSection7.4)the
function
4>
can be expressed
The explicit expressions are of no importance here.The point is to realize that the sign of 4> determines the nature of the bifurcating solution. If > 0, from Eq.G.48) then one sees that
</>
4)'\"
that
re b>b.
is, that the solution is defined in the supercriticalregion. If, on the other
hand, 4>
7.6.
Bifurcation:
111
When y2 = 0 one has to and the solution is dennedin the subcritical region. continue the calculations still further. However, this is a singular caseof little physical interest. The bifurcating solutions near B Bc can-becalculatedto a first approxiby inserting this value of e into the first expressionG.48)and by retaining the first two terms.One finds that the arbitrary amplitude c, of and the linear stability analysis cancels,
\342\200\224
approximation
sm+ H
Bc\\1/2 . mcnr
Bc 8ro2/2
-2A
. mnr
X
sin\342\200\224\342\200\224
G\0256)
the following similar expression holdsfor y(r). Moreover, one can establish remarkable theorem (Sattinger, 1973):
solutions
Theorem. In the vicinity of the critical point Bc, the new bifurcating soluare asymptotically stable in the supercritical region B > Bc(y2 > 0). However, when y2 < 0 the subcritical branches are unstable. Note that the very occurrence of bifurcation here is compatible with the LeraySchaudertheorem discussedin Section6.6, as the multiplicity of the null to is one. of eigenvalue Lc equal
(a); (b)
Id) (f)
(a)
(b)
Figure 7.5. Bifurcation diagram for trimolecular model in one space dimension in caseof even critical wave number. Full and dotted lines represent, respectively, stable and unstable solutions, (a) shows supercritical bifurcation, (b) shows subcritical bifurcation.
112
minimum
Simple Autocatalytic
Models
value of B below which the complete nonlinear rate equations for the trimolecular model admit only one solution.Consequently, the subcritical branches(b) and (c) have to \"stop\" at some point Bmin. By a wellknown theorem of bifurcation theory either X -> oo at Bmin, or the branches turn and continue in the direction of increasing B values until B -> oo. Now, Auchmuty and Nicolishave found a priori boundsfor the steady-state solutions.Thus, the only issue is the one shown on Fig.7.5b.Moreover, the new branches (e)and(f) are likely to be stable,as pointedout by Sattinger A976) in a different context. When B an abrupt transition to one of these Bc the system undergoes whereas for B Bc there is one stablesolution on the thermotwo branches, dynamic branch and two stabledissipative structures.The particular soluthe system picks up dependson the initial conditionsand on the way the parameter B has been varied. This phenomenon is very similar to
>
<
solution
hysteresis.
mc
IsOdd
this
In
casethe
solvability condition
jf
I
Jo
^/
\\A
cj
G.57a)
'
Jc 0
, -~-=
4/
5mc n
Moreover, the ratio c^c-^can be expressedin terms of Bc and the other into Eq. G.57a) we obtain, Substituting parameters,thanks to Eq. G.40).
for
Bm
= Bc:
Vi
8
3mcn
+ 1) Bc] [_2(D^n2/l2
A
Ci
= g(mc,A,Bc,Dl/l2) Formc ^
fi,
G.57b)
Bc ~
B^,one gets:
c,
7.7.
Bifurcation:
113
7.6. Bifurcation diagram for trimolecular model in one spacedimension in caseof odd critical wave number. Full and dotted lines denote stable and unstable solutions, respectively, (a), (d) show thermodynamic branch, (b) supercritical dissipative structure, (c)subcritical dissipative structure, (e) finite-amplitude dissipative structure emerging when (a) is subject to finite perturand Bmm < B < Bc.
Figure
perturbations
X
tude
^^
(e)
j\\(c)
AmpI
(a)
X^
1
(d)
I
1 1
As in the
case where mc is even, the functions I(x1\\ can be determined from Eq. G.49)for k = 1 by means of a Fourier seriesexpansion.Combining
the two relations G.48) onefinally
with
finds:
O((B-Bcf)
Again
G.58)
there is a similar expression for y(r). see that in- the vicinity of Bc the bifurcating solution is defined for B on both sidesof Bc.According to the theorem quotedin the preceding subbranch new is stable on the solution the subsection, bifurcating supercritical where B > Bc and unstable on the subcritical branch where B < Bc.Using the same arguments that ledto Fig.7.5b, one obtains the bifurcation diagram shown in Fig.7.6. This diagram featuresa hysteresis phenomenon along with the possibility of an abrupt transition on branch (e)for B near Bc.Auchmuty and NicolisA975) derived expressions for x{r) on branch (e) as well as for the higher order corrections on branches(b) and (c).
We
mc
presenceof cosineterms in the solvability condition G.57a). 1\\I. The coefficienty2 is computed by first determining (x I The remarkable
to the point here is that, thanks to the particular structure of the inhomogeneous term a^r), the Fourier seriesreducesto a sum up to the secondharmonic
114
Simple Autocatalytic
Models
of the unstable mode m = mc. Otherwise, the procedureis quite similar to that in Section7.6, and one finally finds:
^^hH
(B
BA1/2
mcnr
2B
Bc
cosi-+9\342\200\224ir
rnr
cr-
G.59a)
^
IB -
~Bc
Z.
ip
f\\
G.59b)
where
Note that
supercritical
bifurcation
this
< 0 the bifurcaand one has a diagram similar to Fig.7.5a. When The is subcritical, and Fig.7.5bshowsthe phenomenon of hysteresis. of branches are 7.6. the bifurcated the same as in Section stability properties An elegant approximate method of solution of nonlinear differential equationsleading to periodicsolutions in spacehas beenproposedrecently by J.W. Turner A975).Forthe trimolecular reaction in a system with no-flux which can be thought boundary conditionsone recovers expressions G.59), of as an approximate representation of a \" spatial limit cycle.\" The method is inapplicable in the case of Dirichlet conditions, where the presenceof an infinite seriesin Eq. G.56) destroys the periodiccharacter of the dominant contribution proportionalto sin(mc7rr//).
</>
a periodicfunction with period2l/mc. expression represents of Section7.6,when > 0, the bifurcation is super</>
7.8. Qualitative
Properties
of Dissipative
Structures in Vicinity
of First
Bifurcation
115
Symmetry
equations
The most important property of the dissipative structures arising via the bifurcation mechanism outlined in the previous sectionsis their symmetryWhen a certain critical value of a parameter X (or of a breaking character. is crossed, the most symmetric solution of the rate equaset of parameters) ceases to be stable,and the system evolves to a regime with a lesser of no-flux conditions, of as well as in the case spatial symmetry. In the case Dirichlet conditionswith mc even, this symmetry breakingis accompanied of the solutions translated by the \"criticalexponent\" by a doubledegeneracy and G.59). Stated differently, beyond the transition the 1/2in Eqs. G.56) system has equal a priori probability to evolve to two different solutions, on the initial conditions. We discussthis important point in the depending Note that in the nostochastic analysis of dissipative structures in Part III. first a case the leads to Fourier serieswith a wellflux symmetry breaking defined fundamental mode cos(mc7rr//). In contrast, in the caseof fixed boundary conditionssuccessive approximations in terms of the parameter B Bc break successivelythe symmetry of the lower approximations and lead to spatially asymmetric solutions.A typical comparisonof xo(r) and cxj(r)given in Fig.7.7illustrates this point. In a sense,if the dissipative were to be comparedto a crystal, structures arising under no-flux conditions those arising under Dirichlet conditionsshouldbe regardedas \"imperfect
\342\200\224
crystals.\"
x(r)
x(r)
e sin 2m
Figure
7.7.
Illustration
Eq. G.56).
of spatial asymmetry
induced
by
116
In
Simple Autocatalytic
Models
The situation is different in the case of Dirichlet conditionswith mc odd. this case one cannot really speak of a spontaneoussymmetry breaking in the subcritical case, in the sense that in order to evolveto the branch (e) of Fig. 7.6from the thermodynamic branch one would need perturbations some threshold value related to the preciselocation of the unexceeding ForB > Bc,however,it is most likely that arbitrarily small unstable branch (c). (but still macroscopic) positive perturbations should lead to branch (e), whereas negative oneswould lead to branch (b). betweenthe formation of dissipativestructures Some preliminary analogies and phasetransitions can already be drawn here, although a more complete which is devoted to the stochastic view of this point is possible only in Part III, theory of fluctuations. Thus, in the caseof the smooth transitions described or by the passageto branch (b) in Fig.7.6,one can speakof a by Fig.7.5a second-order transition involving a soft mode (Stanley, 1971), in the sense that the amplitude of the bifurcating solution, which plays the role here of the \" order parameter,\"goesto zero as B -> Bc. On the other hand, in the case as well as in the passageto branch (e) in Fig.7.6,one of Fig.7.5b, can speak of a first-order transition. We may note, however, that this is a purely conventional classification which cannot possibly provide ininformation about the nature of the critical fluctuations in the transition This important point is fully discussed in Part III. region. Insofar as the purely formal analogy drawn above is acceptable,the of the Landau structure of Eqs.G.56) and G.59) is reminiscentof someaspects f or of transitions Consider, instance,expressions theory phase (Stanley,1971). To order (B BcI/2x(r) and y{r) are directly proportional.Thus, G.59). the passagethrough the critical regime can be describedby a single-order parameter, w, such that:
\342\200\224
l|w||2 =
\\\\x\\\\2
\\\\y\\\\2
r-r^
G.60a)
space.
||
in
the interval 0
Onefinds:
,,2 oc B~Bc ||wr t
,1
\342\200\224,\342\200\224-
that
unimportant
w
phasefactor:
oc +
(BjlAY2
G.60b)
7.8.
Qualitative
Properties
of Dissipative
Structures in Vicinity
of First
Bifurcation
117
Moreover, the dynamics of w in the vicinity of the critical point is governed by a single differential equation obtained by combining the differential This is the basisof the equations for x and y, together with relation G.60a). reductive perturbation approachto chemicalinstabilities developed recently and of the adiabatic approximation by Kuramoto and Tsuzuki A974, 1975) used by Haken A975a,b) in the context of laser theoretical problems. Now, a single differential equation for a real variable always derives from a consideran ordinary differential potential. To seethis on a simple example, form of the F.30): equation
= A(X)w -^ ot
Introducing the integral
JV(A; w)
F(w)=
- Jo
f dZlA(W
+ N&;m
3F
dw
Obviously, the extrema of F determine the steady-state solutions of the equation. In particular, the minima determine the stable solutions arising This property reminds beyond the bifurcation point, given by Eq. G.60b). a familiar situation encountered in strongly equilibrium statistical mechanics, where the critical behavior of the order parameter is determined by the extrema of the free energy, which in turn is expressed as a seriesof (even) In that sensethe potential F powersof the order parameter (Stanley, 1971). is the nonequilibrium analog of determining the parameter in Eq. G.60) free energy and can be thought of as an \"extendedLandau-Ginzburg functional\" Haken,1975a,b). (Graham and Haken;1971; Note that this procedurecannot be extendedstraightforwardly to higher ordersin B Bc.In this case and x(r) and y(r) are no longer proportional, the critical behavior cannot be characterized in a simple way by a single orderparameter.Fora discussion of the higher order adiabatic approximawe refer to HakenA975b).
</>
\342\200\224
approximations,
Amplitudes and
Mean Values
From the explicit expression in Eqs.G.57) oneseesthat, as a rule, and G.59) the total amounts of X and Y in the system are not conserved in the course
US
Simple Autocatalytic
Models
=
Jo
\\
dr x(r),
\\
Jo
dr y(r)
and
dy\\
in
side
y~2~$~
The fact
+ Bc -2(D1wc27r2//2
a3
that x and y are not conserved may have somefar reaching conas far as the functional propertiesof the reaction sequenceare consequences concerned. To illustrate this point, considerthe trimolecular model under no-flux boundary conditionsand in a range of parameter values where y is the rate of the autocatalytic step of the positive. According to Eq. G.10), is then I n other enhanced. words,the system tends to produceX sequence this in the through step preferentially right part of the reaction spaceunder the conditionsof Fig.7.8. The ability to produce enhanced quantities of certain chemicalsin a limited region of space confers to the system some remarkableregulatory properties.Moreover,owing to the polarity of the
structure in Fig.7.8, this regulation manifestsitself in the form of a vectorial in the sensethat the catalytic step of the reaction proceeds phenomenon, in a well-defineddirection rather than in a completely isotropicmanner. The phenomenon of vector catalysis is a well-knownone in cellular metaIt is striking to seea primitive form of this phenomenon already metabolism. in the simplest possiblemodel exhibiting dissipative structures.
7.8.
Qualitative
Properties
of Dissipative
Structures in Vicinity
of First
Bifurcation
119
A B/A
0
Figure 7.8. Vector catalysis boundary conditions.
r induced
by
Hitherto we have analyzed the transition to a dissipative structure by using initial product B as bifurcation parameter. In problemsinvolving gradual changesof shape or size of the system (e.g., cellular growth or various other developmental processes) it is of interest to consider the influenceof the length / in the formation of dissipativestructures To this end one switches (Hanson,1974a; Babloyantz and Hiernaux, 1975). to the new spacevariable
P
Tip
o<p< 1
The boundary conditionsremain the same as before, although they now refer to the interval @, 1).Thus changing / may be viewed as changing the diffusion coefficients in our problem. Alternatively, sinceDt and D2measure, in a sense,the strength of the coupling (through diffusion) of neighboring spatial regions,an increaseof / tends to diminish this coupling.All of the resultshold and in particular Eq.G.34), preceding provided B is kept fixed and / varies and plays the roleof the bifurcation parameter.The stability diagram of Fig. 7.2can be interpreted in the alternative form shown in Fig.7.9,where m is taken to be one of the integers compatiblewith the
120
(m/l)
Simple Autocatalytic
Models
(m/l).
Figure
7.9. Linear
conditions
as Fig. 7.2.
stability diagram
displaying
mc). The point is that for a given B, the unstable boundary conditions(e.g., reached couldbe for different values of m and /. Thus, the transition region to a dissipative structure involves explicitly the length. We need not be interested in the details of this dependence. However, from Eq. G.34)it is obvious that the marginal stability condition could never be satisfied if / is lessthan a critical value. Stateddifferently, a system can evolveto a dissipasomecritical value. As the size varies structure only if its size exceeds further from this critical value, new transitions are likely to occurcorreto different values of m. This point is confirmed explicitly in corresponding computer simulations (Hanson, 1974a; Babloyantz and Hiernaux, 1975). We return to this in Chapter 16, which is devoted to development and
dissipative
morphogenesis.
INSTABILITIES AND 7.9. SUCCESSIVE
SECONDARY
BIFURCATIONS
When m is not equal to the critical number mc, there is bifurcation of a new branch from the uniform solution each time B crosses a value B = Bm given 0 when is a at least Eq. G.34), simple eigenvalue of the operator LBm. by These new solutionsare similar to those bifurcating from B = Bc, which have been describedabove, but instead of being dominated by the mode sin(mcnr/l) or cos(mc7rr//), they contain the fundamental mode sin(m7rr//) or cos(mnr/l).When m is even, the new branchesare degenerateand have a critical exponentof \\, while for Dirichlet conditionsand m odd the new 7.6. branch is similar to thosedescribed in the secondpart of Section
121
from
successive
primary
bifurcations
of Bm Bmc the operator LBm has already at least one the are unstable in the neighborpositiveeigenvalue, new bifurcating branches of Bm. Unfortunately, we do not know in what regions,if any, these new branchescan becomestable. When B is much greater than Bc, there are many possibledissipative structures, someof which are stableto small perturbations and others which are not. The situation may be depictedby the diagram in Fig. In Fig.7.10 branch A) bifurcates when B = Bc, but branchesB) and C) bifurcate when B Bc. One sees that when B Bd, there may be seven solutionsof the equations. possible Now if after the first bifurcation the system is on branch A), there is no obvious reason why for B Bc it shouldmake a transition to branchesB) or C) bifurcating from the thermodynamic branch.In other words,onceon branch A) the system enjoys additional possibilities of complexification if the branch A) itself looses via new bifurcation phenomena.Such stability cascadephenomena are usually referred to as secondarybifurcations.Their for the trimolecular model has beenestablished occurrence analytically by Mahar and Matkowsky A976)and inferred, independently, from the results of computer simulations by Herschkowitz-Kaufman A975).This is a most in the context of biological important result, especially problems.It is only thanks to secondary and higher order bifurcations that an evolving system can give rise spontaneously to increasingly complexpatterns emerging
As in the vicinity
neighborhood
>
7.10.
>
>
>
a succession of instabilities. Let us briefly outline the main steps of the Mahar-Matkowsky method for fixed boundary conditions.According to linear stability analysis the zero eigenvalue of the operator Lc is doubly degenerate provided that (see
through
Eq.G.38)]:
8= -
2/4 A2l
m?(mc
IJ = 0
122
Simple Autocatalytic
Models
Thus, whenever S deviates from zero it provides a measure of the distance between the two smallest eigenvaluescorresponding, respectively,say to mc and mc + As S approaches to zero, the two eigenvaluescoalesce to form a 0 and small, the first primary branch bifurcating doubleeigenvalue.With at Bmc correspondsto the mode sin(mcnr/l), whereas the secondprimary to the modesin((mc + l)nr/l). branch bifurcating at Bmi + 1 corresponds One can now expandsystematicallyBmc, Bmc+1,in powersof 6 around a to a doubly degenerate value Bc corresponding eigenvalue.Next, one detereach of the primary branchesby bifurcation theory as in the previous To fix the ideaswe considerthe case of mc odd. We have: sections.
1.
<5
determines
uj
J =0
\\vj.
00
Bp = Bmc(S)+ Z?^
G.61)
primary
Formc:
(xp\\=e
with
BTp<
/mr~
-e
\342\200\224(-=^ + 2AAmc(S))
Formc +
yP,
1:
= BJd)
+ 0(e2)
G.62)
>mc+\\
_
\342\200\224
2A(S2+ Amc+l(d)S1)\\ +
0{\302\2433)
G.63)
Herea and
corresponding
Am(S)
to the
are, respectively, the amplitude and the yjx ratio eigenfunction: null-space
cor-
G.64)
According to the linearized equations,Am dependson S and can, therefore, be expandedin powersof this parameter around a value Am. Finally, Si
123
and S2 are well-definedcoefficientscontaining an infinite-seriescontribution arising in the evaluation of the coefficienty2. or The next step is to calculate the points on the primary branch +i from which branches can bifurcate. To this end one
B\342\204\242c
Thus, we set:
secondary e and 6. that the primary branchesare functions of the parameters observes we e Therefore, treat in the same way as B in the primary bifurcation and The latter are seekfor the \"nonlineareigenvalues\" en = en(d) of this problem. a in S (Bauer, Keller, and Reiss,1975). computed by perturbation expansion
gmc
e = d(b0 +
8b!+
\342\226\240 \342\200\242
\342\200\242)
I\"-\"
G.65)
is the appropriateexpansion where it has beenassumedthat 8ljl parameter. these into Substituting expressions the rate equations linearized around x \" \\
of which represents the linearized problem at the double eigenvalue. Obviously the solution of this problem
-V
first
is:
fuo\\
. mcnr = 0i sm
\342\200\224r-
(-1
\\
+ 02 sin
(mc + l)nr
(3 1
\\
G.66)
of The coefficientsfi^ and ft2 can be determined by the solvability conditions the higher order equations in the sequence. One disposesof two such conconditions here becauseof the double degeneracy. Whenever a contribution with /?2 # 0 arisesin Eq.G.66), bifurcation has we conclude that a secondary
taken
fx\\
at
this
containing the mode sin(mc 7tr)/7 to one containing, in addition, the higher mode sin((mc + l)nr/l). This situation is described in the bifurcation diagram of Fig. is determined by the the in coefficient b0 Eq. G.65) Finally,
7.11.
solvability
conditions and
by
Knowing b0 we can deduce8 in terms of e, that is, in terms of B Bc, and estimate in this way the \"distance\"from Bc at which secondary bifurcation took place.
124
Simple Autocatalytic
Models
11
model displaying possible secondary diagram for trimolecular of steady-state solutions from a previously established dissipative structure. Dotted and full lines denote plausible stability properties of the various branches (dotted line denotes instability and full line denotes stability).
Figure bifurcations
7.11. Bifurcation
The detailed construction of the secondarybranches in the nonlinear just straightforwardly, region beyond the secondarybifurcation proceeds here. and is not discussed as for the primary branches, In summary, in the supercritical region beyond the first bifurcation the system exhibits a striking multiplicity of qualitatively different solutions. Thesesolutionsare discreteand emerge only when the parameter B crosses somecritical values. One can really speakhere of a \"macroscopic quantizathe information of the states (Hanson,1974b). concerning Although one can expectthat at least someof stability of these statesis rather scarce, them would be stable and attract some specific sets of initial conditions. Sucha property would conferto the system a primitive \"memory\" associated the initial conditions with the capacity to store \"information,\" through attracted by the correspondingdissipative structure. This seems to be confirmed by computer simulations, to which we now turn in somedetail.
quantization\"
SIMULATIONS COMPUTER
have carried out Lefever A968) and Herschkowitz-Kaufman A973, 1975) Their results extensive numerical simulations on the trimolecular model.
7.10. Comparison
125
provide striking confirmations of the theoretical predictionsbased on the analytic calculations.Moreover, they suggest some fascinating trends concerning the evolution of the system in the supercriticalregion B $> Bc. Genera]Behavior of Dirichlet conditions. The numerical values A = 2, Considerfirst the case = = = x x 1.6 and 6 10~3 lead to a positive value of 4> I 1, 10~3, D2 Di which us to calculate x(r) and y(r) for B > Bc.The Eq. G.56)], permits [see solutions obtained
comparedwith
solution of the rate equations now indicates an abrupt transition to a state where, although the number of extrema remains the same,the maxima are near the boundaries. A great number of enhanced(and the minima depressed) numerical simulations with various initial conditionshave shown that this type of asymmetry does not depend on the way the system is perturbed
initially.
the two solutions agreevery well. computer.For B near Bc (Fig.7.12), the the influenceof critical Both mode,as well as its distortion predominant are the infinite series contribution, clearly seen.One observesthat the by maxima as r increases. distortion tendsto enhance the successive ForB > Bc(Fig. the becomes Indeed,the numerical 7.13), agreement poor.
in this way
0.5
Space
Figure
(arbitrary units)
7.12. Steady-state dissipative structure for fixed boundary conditions and B ^ Bc. Dashed line, analytical curve given by Eq. G.56); solid line, result of numerical integration on digital computer. The following numerical values of the parameters have been chosen: A = 2, 1 = = 4.17. The critical wave number is mf = 8and \\,Dl = 1.6x Kr3,ZJ = 6.0 x 10*3,B B, = 4.133. Boundary values for X and Y: X = A = 2, Y = B/A = 2.085.
126
Simple Autocatalytic
Models
0.5
Space
Figure
(arbitrary units)
7.13. Steady-state dissipative structure for fixed boundary conditions and B > Bc. Dashed line: analytical curve given by Eq. G.56). Solid line: result of numerical integration on digital computer. B = 4.6; other parameters areas in Fig. 7.12. Boundary values for X and
Y: X
Theseresultsindicate strongly the occurrence of a secondary bifurcation from the primary branch, in agreement with the analytic results presented The simulations also confirm the influence of the spacing in Section7.9. between the values of B corresponding to the first successive primary bibifurcations on the occurrence of the secondary bifurcation. In contrast with these results, for no-flux conditions the agreementbetween and numerical solutions remains analytic satisfactory, even for B con-
it considerably larger than Bc.Presumably, if a secondarybifurcation occurs, either occursmuch later or leadsto unstable branches. 7.14 describes Figure the concentration profiles.
Degeneracyand SpatialSymmetry The double degeneracyof the first bifurcating solutionsfor no-flux conconditions and for Dirichlet conditions with mc even are well confirmed by the numerical simulations, as shown in Fig.7.15. On applying a single,localized to the state as an initial condition, one perturbation homogeneous steady observestwo different solutions,dependingon the sign and location of the perturbation. The spatial asymmetry of the solution under Dirichlet conditionsand their periodiccharacter in the case of no-flux conditionsare also exhibited clearly. The case of mc odd under Dirichlet conditionshas alsobeen investigated
127
0
Space
Figure analytical
0.5
(arbitrary units)
dissipative structure for zero-flux boundary conditions. Dashed lines: Solid lines: result of numerical integration on digital curves given by Eq. G.59). B = 4. D[ = 1.6x 10~3, D2 = computer. Curves have been established for A = 2, / = 8.0 x 1(T3. Critical wave number: mL. = 8, B, = 3.602.
7.14.Steady-state
1.
and spatial asymmetry are verified numerically.ForB > Bc,both degeneracy in the same way as for mc even. ForB < Bc, a transient nonuniform state on a finite amplitude perturbation of the homogeneous appears: steady state, the system first evolvestoward a structured state with a number of extrema to mc. Subsequently, the system homogenizes slowly and corresponding returns to the thermodynamic branch. This result supports the general featuresof the bifurcation diagram depictedin Fig.7.6.
Multiplicity
of Solutions
Computer simulations have shown that more than one coupleof degenerate to a different number of extrema, can appear structures, each corresponding under the following conditions: simultaneously.This occurs
\342\200\242
\342\200\242
The values of B are large. At f = 0, the system is submitted simultaneously to different localized perturbations whoselocation obeyscertain rules. This situation is illustrated on Fig.7.16 in the
caseof no-flux
boundary
128
Simple Autocatalytic
Models
I,
I
steady-state dissipative structures obtained for same values of paramlocalized initial perturbation of homogeneous steady state of same strength but opposite sign (fixed boundary conditions). Arrows show for somepoints the sign of perturbation values used: A = 2, leading to corresponding spatial structure. Numerical Dl = 1.6x 10\023, D2 = 8.0 x 10~3, B = 4.6.Homogeneous steady-state concentrations X = A, Y B/A are maintained at boundaries.
Figure
parameters
7.15. Degenerate
a
by
1=1,
\342\200\224
three different stable dissipative structures with 8, 9, and 10extrema, respectively,dependingon the initial conditions.Each of these structures has also its \"symmetrical.\" As we emphasized in Section the stability of the successive 7.9, bifurcating solutionscannot be guaranteed a priori within the framework of a perturbative analysis.However, various computer simulations for B $> Bc indicate to the that there is a finite multiplicity of stablesolutionscorresponding fastest growing unstable modes,accordingto the linear stability analysis
7.10. Comparison
129
0.5
Space
(arbitrary units)
(B)
5 4 3 2
1
0.5
Space
(arbitrary units)
0
Space
0.5
(arbitrary
units)
Figure 7.16. Steady-state profiles obtained for same values of parameters but different initial conditions. For instance, one obtains spatial distributions with 8,9, or 10extrema shown here when length / is divided into 101 equal intervals and a positive perturbation applied at point 9 is combined with a second perturbation of same sign and strength, respectively, at points 21, 48, or 72; 17.34,43;55or 70. Numerical values of parameters are same as in Fig. 7.15.
around the thermodynamic branch. This can be seen on Fig.7.17, where m = 7, 8, and 9 appear as the leading modesfor the numerical values corThe existence of unstable modeswith corresponding to our previous example. amplification factors of the same order of magnitude as that of the critical one is due to the fact that the first few successive instabilities appearfor very closevalues of Bm, whereas for the others the spacingof the values of B tends to becomelarge. Periodic Boundary Conditions
In many instances of biological takesplaceon a interest a reaction sequence closed such as the surfaceof a t geometry, sphererepresentinghe membraneof a developingcell. The boundary conditions in this case are, obviously:
Y@)
G.67)
130
Simple Autocatalyric
Models
1.0
B = 4.6
0.5
10
Figure part of the eigenvalues con corresponding to unstable modes emerging from branch for different values of B (zero fluxes and fixed boundary conditions). thermodynamic Numerical values used:A = 2, / = 1,Dx = 1.6x 10\023, D2 = 8.0x 10~3.
7.17.Real
where / is the length of a closed coordinatecurve along the surface. For simplicity we only considerhere a ring of length /. The calculations reported in the precedingsections can be repeated one straightforwardly. The differenceis that instead of Eq. G.24)or G.25), now has a critical modeof the form:
e2ninr/l
G.68)
Relations G.33) and G.34) remain valid provided nn/I is replacedby 2nn/l. Numerical simulations (Herschkowitz-Kaufman, 1973, have been 1975) performed by dividing the ring into M equal intervals. ConditionsG.67)
become:
X M+\\
Yo
\342\200\224
As
exhibit a sharp spatial periodicity. The structures seemto dependstrongly on the initial conditions. However, they are all superposable by translation, and in the limit of a continuous space one should observe an infinity of solutionsdiffering only by the phase(seeFig.7.18).
which
7.11Localized Steady-State
Dissipative
Structures
131
Space
Figure
(arbitrary
units)
(XM + 1
concentration profiles of X for periodic boundary conditions and different initial conditions. Straight line, initial perturbations 6X = +0.02 at points 9 and at point dashed line, initial perturbation SX = +0.02 broken dotted line, initial perturbation SX +0.02 at point 9.Numerical values used:A = 2, I = 1.01, and mc = 4). B = 4.6, = 1.6x 10~\\D2= 8.0x 10 -'(Bc= 3.598
= Xt,
7.18. Stationary
VM + 1
= Vj)
21;
21;
\342\200\224
\302\243>,
The spatial dissipative structures described in the preceding sectionsextend the whole system. of assuming a uniform This is a consequence throughout medium where the concentrations of the initial productsA and B are mainconstant in space. Clearly, this is a highly idealized situation; in an actual physicochemicalexperimentthe reactants are injectedinto the reaction volume through the boundaries. At best,their concentrations or their fluxes can only becontrolled on theseboundaries. Thus, in the trimolecular scheme one expectsA and B to diffuse and react within the medium and establish in this way their own profile. In this section we analyze the transition the system, but we phenomena when A is no longer imposedthroughout still assumethat the concentration of B remains uniform. We see that this of A results in the localization of the dissipative \"spatial dispersion\" structures within natural boundaries Boaand (Auchmuty and Nicolis,1975;
maintained
are given
by
132
in where the concentration A depends, Eq. G.13), this
Simple Autocatalytic
Models
instance, on spaceand
equation:
G.69)
adopt for A the boundary conditions: 4@)= 4@ = A and apply Dirichlet conditionsfor X and Y with boundary values
We
= A,
\302\243
G.70)
is straightforward Eq. G.69)
1.
cosha
with /2
G71)
Becauseof the spatial dependenceof Ao, the steady-state solutions X0(r), Y0(r) on the thermodynamic branch can no longer be determined can, however, be set up in the exactly. Systematic approximation schemes
limit
\302\243>->
oo
Utilizing these two ratios as well as \\/D as perturbation parametersone finds to first approximation (Auchmuty and Nicolis,1975):
ID
1 ,
G.72)
Dissipathe Structures
133
100
III
75
50 25
D2M
10
of parameters B and D2-A = 14,D = 0.195, D, = diagram in space 10\023.1: region of emergence of (localized) region of stability of thermodynamic branch. dissipative structures. region of emergence of time-periodic solutions. time-independent
Figure
7.19.Stability
1.05x
Ill:
II:
of additional steadyWe want now to investigate the possibleexistence state solutionsof the dissipative structure type. Again, becauseof spatial cannot the stability analysis of the thermodynamic branch G.72) dispersion, becarriedout analytically.A variational technique, known as local potential has been applied by Herschkowitz(Glansdorff and Prigogine, 1971), Kaufman and Platten A971)to analyze these properties.The results are in the form of a stability summarized on Fig.7.19 diagram in the (B,D2) the existence of a domain fixed and D. for This reveals A, plane Du diagram IIwhere perturbations around the thermodynamic branch tend to amplify in a nonoscillatory fashion. Presumably, then, in this domain a steady bifurcate. We now outline an solution of the dissipative structure type does analytic construction of the solutionsto the linearizedequationsaround the with this dissipative structure. The nonthermodynamic branch associated nonlinear via bifurcation exactly as in the previous theory proceeds analysis sectionsand is not developed here.
Analytic
Constructionof LocalizedDissipativeStructures
We
D2y\"
-y = 0
= Dxx + D2y
134
Simple Autocatalytic
Models
Then the equationsG.21) are replacedby the single fourth-order equation + lBX0 D.Xly+ X\\z = 0 G.73) D,D2z\"\"
Y0-B-l)D2~
= exp@(r)) function of r.
z(r)
We know that if Xo, Yo are constant this equation admits solutionsof the form exp(ikr). coefficientsthe most natural extension Forspace-dependent is to assumea solution of the following form:
G.74)
where (f>'(r) is a slowly varying Neglecting all derivativesof 0 exceptthe first (in a manner similar to the WKB approximation familiar from quantum mechanics)one obtains DjZWL + [_BX0 \\)D2 D.XlW2 + X20 = 0 G.75)
Yo-B~F{r)
I\302\261
^{rJ = wx
where
x2\302\260
F(r)
= 2X0(r)Y0(r)
\302\261
B\302\261=[x0(r)
/gi
=0
lj
G.77)
If
= 0, which is impossible.However, were the case, then Xl(r)/DlD2 change from real to complexvalues when the right-hand side of from Eq. Eq. G.76) changesfrom real to complexvalues. In fact, one sees that 4>'(r) is real only when G.76)
this
4>'(r) can
F(r)
< 1 + ^ X20{r)
or F(r)
and
+ (r) F(r)>B
< B_(r)
G.78)
Forthis problemwe see that theseconditionshold in certain regionsof The boundariesbetween the two types of spacebut are violated elsewhere. behavior are called the turning points of the equation.On one side of a
Dissipative
Structures
[<\302\243'(>\")
135
while on the other real], point the solutions z(r) are monotonic sidez(r) is oscillatory [<j)'(r) complex]. The condition for a turning point in this problemis somewhat different from the definition for the second-order equation (Erdelyi, 1956):
z\"
+ f(r)z = 0
Forthis
which,
equation a turning
so that one cannot get a turning point in this manner and finds only delocalized structures. If F(r) < B _(r), then the first condition G.78) automatically holds. The the are given by following equation: turning points
2X0(r)Y0(r) 0(r)Y0(r)
When F(r)
as we have seen,is not the case for our problem. is contradicted, > B+(r),one observesthat the first Eq. G.78)
-1J -B = [xo(r)l^ -
G.79)
where
by
0 < P < \\ one sees that 0 < r_ < r+ < 1, and r_ , r+ are symmetrisituated about r = \\. When orr+ < r < 1,z(r) is monotonic, but in the middle, r_ < r < r+, it is oscillatory. As P tends to 0, one sees that these turning points are pushed to the r = 0 and r = In terms of B, this requiresthat boundaries
When
symmetrically
0<r<r_
1.
2/5
=1
- ~ (/ - 1)- t^t
|
G.80)
136
Simple Autocatalytii
Models
Figure
of
and this is a decreasing function of k for large k. Thesevarious relations are illustrated in Fig.7.20 also Eq. G.72)]. [see To find the form of z(r) near the turning points,one has to approximate 4>'(r)around thosepoints.Usingthe first few terms in the Taylor series expanabout r_, one finds (Auchmuty and Nicolis,1975):
expansions
x (r z(r) oc exp[i(const)
\342\200\224
r_)
G.81)
and this is nonsinusoidal. The constant in the exponent dependson Du and A. D2,B, However, near r = \\, one gets a very different form of the solution:
x (r z(r) oc exp[i(const) which
- |)]
G.82)
is approximately sinusoidal.
ComparisonWith Computer Simulations The existence of localized dissipative structures confined within the reaction a mechanism is confirmed entirely by the resultsof spaceby turning point simulations computer (Herschkowitz-Kaufman and Nicolis, 1972; Herschkowitz-Kaufman, 1973, gives a typical profile for 1975). Figure 7.21 the intermediate X. Figure 7.22 illustrates the dependence of the positionof the turning pointson the parameters. However,most of the numerical results have beencarriedout for values of Du D2, and D such that F(r) and B + (r) in the interval @, 1), vary considerably contrary to the situation depictedin 7.20 calculation. As a result, the to the theoretical Fig. corresponding condition F(r) < B + (r) is never satisfied for all r in @, 1).The situations to the numerical computations are illustrated in Figs.7.23 corresponding and 7.24.
Dissipative
Structures
137
10
0
Space
Figure
0.5
(arbitrary units)
7.21.Localized
1.71.
0.1972,
\302\243>,
= 1.052 x
10\023,
D2
case (Fig.7.23):
1
< b:= a
^7.21.
The corresponding Comparisonwith profile for X is shown in Fig. the theoretical analysis shows that although z(r) should be oscillatory within (r01,r02), the size of the numerically computeddissipative structure by the appearsto be much smaller than predicted.This couldbe explained varies with r in fact that the wavelength of the oscillatory solution G.82)
X>
15 A 10
_
V
J
n
J
0.5
Space
1
Figure
B = 30,
for
0.5
Space
Figure 7.23. Space dependence of Fig. 7.21.
(arbitrary units)
B+, B , F
0
Space
Figure 7.24. Space dependence of Fig. 7.22.
0.5
(arbitrary units)
B+, B_, F
138
\342\200\224
15'
B = 25
10
J
1
0.5
of dissipative structure obtained for successively higher values of Figure 7.25. Duplication parameter B and for relatively low value of the diffusion coefficient of A :D = 0.026.
139
140
Models
such a way
oscillations
it becomes very long near the turning points.Thus, oscilappear to be negligible,and so the exact boundariesof the dissipative structure becomehard to identify.
may
case2 (Fig.7.24):
B > Bb =
The corresponding profile of X is shown in Fig.7.22. While the theoretical calculations would predict an entirely delocalized dissipativestructure, one observesfrom the numerical calculations that the solution is apparently not oscillatory near the boundariesbut is, instead, confined approximately within the limits F(r) = B+(r).As previously, this could be explainedby the nonuniformity of the wavelength so that the oscillationsbehave differently near the boundaries(long wavelength) and near the middle (short wavelength).As a result, the solution appearsto be nonoscillatory near the boundaries.
In the case of very low values of the diffusion coefficientD one observes a very pronounced of X near the middle, together with a duplicadepression of the dissipative structure (see An extensionof the theoretical Fig.7.25). calculations presumably leadsto the appearance of additional turning points that separatethe two dissipative structure regions. Indeed,sincein this case can in the observed F(r) vary considerably space, depressionin the middle could correspondto the situation F(r) < B_(r) around r = \\, which corcorresponds to a nonoscillatory behavior. Finally, the localized dissipative structures exhibit both the degeneracy and the multiplicity observed in the case of a uniform distribution of A. The possibility of spontaneous formation of natural boundaries confining a dissipative structure is likely to have some far-reaching consequences. Obviously, localization is an efficient means of improving the stability properties of the pattern with respect to environmental disturbances, thanks to the \"buffer zone\" constituted by the thermodynamic branch. the ability to concentrate the chemicallyactivecomponents within Moreover, a limited spaceenhances the reactions of some considerably probability key that may subsequently give rise to further evolution.
duplication
7.12.BIFURCATION
According to the linear stability analysis outlined in Section7.4,when the the bifurcation parameter B crosses the critical value B given by Eq. G.33), linearized operatorL presentsa simplepair of purely imaginary eigenvalues.
7.12.Bifurcation
of Time-Periodic Dissipative
Structures
141
ForB larger than the first critical value of B compatiblewith the boundary we expectthere to be a stable periodicsolution of the equations. conditions, Such a phenomenon is already known for systemsof ordinary differential and is calleda Hopfbifurcation equationswhere it gives rise to limit cycles, In this sectionwe analyze the time-periodic solutionsin the (Hopf, 1942). of In presence diffusion. a sense,therefore, we are lookingfor limit cyclesin some appropriatespace of functions rather than in the usual phase space familiar from ordinary differential equations. We assume that condition G.36)
and that the first bifurcation from the thermodynamic branch solutions. leads,indeed,to time-periodic We write the rate equationsin a form similar to Eq. G.46),adding the time-derivativeterms:
is
fulfilled
G.83)
with
are interestedmore specificallyin the bifurcation occurring at Bo and Let 2n/Q, Q = Eq. G.22). Q(B Bm) be the periodof the solution.We introduce the scaledvariable
We
= Qt
and look for 27t-periodicsolutionsin this for periodicsolutionsof small amplitude near B = Bm and of frequency near icom, where com is the eigenvalue of the linearized operator. To this end we expand, as in Section x,y, B,and Q in terms of a parameter (Sattinger, 7.5,
\302\243
1973):
'\342\226\240
\342\200\224
<x2
\342\226\240\342\200\242\342\226\240
\342\226\240\342\226\240\342\226\240
G.85)
where
Hm
= Im<x>m
\302\243
Substituting
into
\342\200\236
>i
G-86)
142
Simple Autocatalytic
Models
The coefficients an involve the parametersyY to yn_l and the solutions are [cf. Eq. G.50)] as follows, xu yx to xn-1, ya-i- The first few expressions after taking into account the slight change in notation adoptedin this section: cii = 0
+ a2 = *i 7i + -f-Xi A
\\
2Ayx
7i 2Axiy2
Substituting
+ +
IB
\342\200\224f~xi
^
A
+ xjyi
first
G.87)
into
order:
G.88)
has the same form as the linearized equation Eq. G.88) thermodynamic branch. Thus,
I
proportional to the (complex) to the eigenvaluescom = + ijxm. We treat eigenfunction of Lm corresponding the cases of Dirichlet and of no-flux boundary conditions separately.
is
\\3V
(x'\\I
DirichletConditions
We
J
in
\\
\\c2
^ eh
G.89)
Forn > 1,Eq. G.86) is an inhomogeneous linear equation.As discussed detail in Section it has a B7t-periodic) solution provided a compatibility 7.5, condition holds. The Fredholmalternative (Sattinger, 1973) requiresthat the right-hand sideof Eq. G.86) be orthogonal to the vectors:
/x*\\
I
G.43)]:
\\y
is an eigenvector of
G.91)
7.12.Bifurcation
of Time-Periodic Dissipative
Structures
143
The scalar product here is defined to be the Hilbert space one, as in followed by a time integration over the period2n of the solution Eq. G.52), in expressed terms of the scaledvariable t. we may write the explicit term of the Fredholm Combining with Eq.G.86) as: alternative
p2n
/\342\200\242!
Jo Jo
[_x*(r,t)-y*(r,t)-]an(r,T)drdT
k
T, =
^ Jo
ox Jo [x*Txm.k \\
equation providestwo real equationsthat together parametersyn_1 and appearing in the expansionG.85). Using these values, one can then solve the second
for determining the
\302\253\342\200\236_!
(x \\1.Then,
\"
substituting
into the
small, yj
relation G.85), one has a convergentseriesexpansionfor e sufficiently which providesus with an analytic representation of the solution
in
We first
terms Let us briefly outline the calculations up to second-order construct the eigenvector
e.
We
the linearized
d=
where
BiPe\302\261ie
144
Simple Autocatalytic
Models
[^^^|f
I
,,,2,
\\-A2pe '7
whereasthe real normalized solution of Eq. G.88) reads:
7
The next step is to
study
= 2:
and G.93b)the explicit value of a2 can be written From Eqs. G.87) following form: a2 = 7i have:
A
in
the
cost
sin
\342\200\224
\342\200\224
cos2x +
2ABxp
\342\200\224
\\A
G.95)
One can now evaluate explicitly the compatibility condition G.91). We + A2pe+ W)
Cl
nr
C2n
yx
Isin
\342\200\224
G.95a)
7!cost
Becauseof the quadratic dependence of a2 in cost, the terms other than in the left-hand side vanish after time integration. Noting also that
i
Jo
cos2x dt = n sin(i +
G)\\
in
cos0
}n sin 0
Structures
145
reduceEq. G.95a) into the simpler form: + 7t(l + A2p e w)yl =@1in\\_- 1 + BiA2p2 e2W~\\
that,
Taking real and imaginary parts of this relation and noting 1 + A2p ew ^ 0 we conclude that: to Eq. G.92),
according
?1=0,
methods.
Xi,
w, = 0
I
G.95b)
2
I
by
Fourier expansion
into the compatibility condition containing a3 (and thus we may then compute w2 and y2. These calculations are We long and are not reproducedhere (seeAuchmuty and Nicolis,1976a). give, instead, the type of expressionone obtains finally on determining c, <x>2, v2, and y2 and inserting into expression G.85):
y2), yi,x2,
x(r,
t)\\
){
+
\302\261
(B-fliY'Y
)
fa
cosOr
ak
\\
nr
)Sm
+ +
ak
Bk
(odd
iy \\bk
cosBOt+
si
ij/k)\\
n = 1*1 +
^^
; ~T
. sin
knr
cu2
G.96)
<pk
and 4>u to2, ak, bk, ak,bk,i//k, Herep and 9 have beendefined in Eq.G.92) are well-definedexpressions on the coefficientsA, Du D2. depending
Note that the sign in front of the first term is now superfluous,in view of the change of sign of the trigonometric functions during a period. Another remarkable point is that Eq. G.96) representsthe first terms of a harmonic serieswith a well-definedperiod 2n/Q. Finally, when the coefficient in is positive, the bifurcation leadsto supercritical branches;otherEq. G.96) the branches will besubcritical. The stability of these various solutions can be analyzed by a suitable extension of Floquet's theory, familiar from One finds Minorski,1962). ordinary differential equations(Sattinger, 1973; again that supercritical branchesare stable, whereas subcritical branches are unstable.
<j>
otherwise,
No-flux
Boundary
Conditions
As we have
tion
in this
discussed 7.4,the first birfurcarepeatedly following from Section caseleads to a spatially uniform limit cycle.The latter can be
146
Simple Autocatalytic
Models
constructedusing bifurcation theory along the lines of the previous subsubsection. We first write the complexnormalized solution of the linearized
adjoint equation as:
au>
cost
P sin
y
p and 6 now
Dt
= 0]:
=~ =
with
B0 = A2 +
\\
fora2.
G.99)
=0,
co, = 0
(Auchmuty
y2
\342\200\242
B near Bo.
is positive. Thus, there is a supercritical bifurcation leading to an asymptotically stableorbit. is always negative. Thus, the period of the oscillations increaseswith
<x>2
fx\\
\\yj
reads:
fit
(B
\\
y(t)J
A2
<^o
B-l-A2 \\co2,co2<0
<Po
\\^o
+ b cosBf2f +
<Pi)
G.100)
7.13.Qualitative
Properties
of Time-Periodic
Dissipative
Structures
147
are explicit functions of the parameter A The coefficients<j>0,a,b0,b,\\j/x,(px and are given in the paper by Auchmuty and NicolisA976a).
7.13. QUALITATIVE
STRUCTURES
Synchronizationthrough
As
Diffusion
Coupling
is switched on these local oscillatorsbecomecoupled via a term proportionalto the \"coupling constant\" DJI2,as one can seefrom The fact that the system in the presence the third part of Section7.8. of difWhen diffusion
diffusion
we saw in Section7.12, in the absence of diffusion and as long as B the concentrations in the trimolecular model oscillate at each point in
> Bo,
space.
this coupling may, these local and maintain oscillators conditions,synchronize relations between which are them, sharp phase completely reproducible
a reaches
of having a bounded Clearly, this important property is a consequence medium. In an unboundedsystem no unique asymptotic state needsto be medium. travels through the system and leavesbehind it a quiescent in the form of planewave somecases, one can have periodic solutions trains (Kopell and Howard,1973a; Ortoleva and Ross,1973,1974a; Howard, families these are of solutions where the H owever, 1974). one-parameter can be This contrasts the described prescribed. amplitude arbitrarily patterns where frequency,amplitude, and wavelength are all determined by Eq.G.96) by the system itself independently of the initial excitation applied to the
activity
eachperiod.
medium. Another important difference between bounded and unboundedmedia concernsthe role of diffusion. As we have seen repeatedly in this chapter, the emergence of a stable space-dependent pattern in an initially uniform the result of an instability triggered by difboundedsystem is necessarily
diffusion.
This instability can leadto small-amplitude or relaxation-like spatioon the distanceof the bifurcation parameter temporal patterns,* depending from its critical value. In contrast, the investigation of plane-wavesolutions in unbounded media and someexperimental observations led to the concept of kinematic or pseudowaves(Kopelland Howard, 1973a). The latter are regardedas the result of a loose coupling of local oscillatorsof the limit
* The
latter patterns
are frequently
referred to
as trigger
Howard.
148
Simple Autocatalytic
Models
and produce cycle type, which is not sufficient to synchronize the oscillators a coherent regime. no instability involving diffusion occurs in this Hence, of the local oscillatorsdoes require an incase, although the functioning instability of the steady state with respectto a limit-cycleformation. Clearly, in bounded systemsthis type of behavior can only representa transient state that, eventually, is going to evolve to one of the asymptotic solutions evaluated in Section7.12. of a Propagation Velocity Existence
describes a superposition of standing wavesof two different Equation G.96) to an evolution of the frequencies Q and 2Q.Thus, each term corresponds chemical concentration in time in the form of a \"vibrating string.\" An imthis superposition can give rise important point is that under certain conditions is propagating fronts that can subsistduring part of the overall period. The situation isdescribed schematicallyin Fig.7.26. Nevertheless, one does not have true propagating waves. Indeed, let x be the ordinate of a wave front. Along this front x = x(r, f), and dx =
Thus
dt
\342\200\224-
dx dr dr
\342\200\224
dx dt ot
=0
dx/dr
of r and f. Forinstance,
= v(l, f) = 0 = + oo
and
lim v(r, f)
r-M/2
G.102)
to
Thus, the usual ideasassociatedwith propagating waves, as in electrodescribethe time-periodic magnetism or fluid dynamics, do not necessarily solutions of reaction-diffusion equations. The term \"chemical waves\" should,therefore, be usedwith caution, at least in one-dimensional systems. encountered Thesesolutions are more similar to the synchronous oscillations in many problemsin electrical engineering (Andronov, Vit, and Khaikin,
secondorder in c.
1966).
L (ii)
(iii)
Figure 7.26. Characteristic steps of evolution of spatial profile of X during one period as computed from Eq. G.96). (i) and (ii): modes m 1 and m = 3 predominate, (iii):m = 3 mode vanishes and that with m = 5 takes over. Comparing (ii) and (iii), we seethat, effectively, the two fronts denoted by dotted lines have propagated to the middle; thus, a wavelike activity has appeared in system during part of overall period.
149
ISO
Simple Autocatalytic
Models
Despite these differences, the chemical signalsdescribedby Eq. G.96) are capableof transporting matter in much the sameway as ordinary waves. To seethis one computesthe diffusion current of the X-componentat a point r
dx
nr D.nfB-B.X'2 ' coscosQf
1
Averaging
Jx(r)
=--J
D,nB
\342\200\224
B, ^ L
T\342\200\224L
I ma.cos
ma
mnr
\342\200\224
G-103)
onehas
=0 Jx(l/2)
and
D^B-B,
In this system, matter is transportedby the diffusion of the chemicals in the medium. This is different from transportation by particlesfollowing a in usual wave wave front during macroscopic time intervals, as is the case
fluid dynamics. From a purely mathematical point of view, onecan also understand the The reaction-diffusion systempropagates informaorigin of thesedifferences. with infinite velocity, as it is a parabolicsystem. Thus, its behavior is wave equations,which propagate quite different from those of the classical information at finite speeds. we are obtaining thesewaves as the Moreover, asymptotic behavior in time of the system for a wide range of initial conone getsdifferent wavesfor difconditions, whereas for the usual wave equations different initial conditions. Forinstance, the frequency of an electromagnetic wave in the vacuum is determined entirely by the frequency of the source has emitting the wave.The notion of propagation velocityin chemicalsystems alsobeenanalyzed in a recent seriesof papersby Othmer A975, 1976).
information
propagationin
7.13. Qualitative
Properties
of Time-Periodic Dissipative
Structures
151
Instabilities Successive
case of steady-state dissipative structures, each time the bifurcation B a crosses value with the boundary conditions Bm compatible parameter
As in
the
solution of the condition G.33), a time-periodic stability rate equationsbifurcates from the thermodynamic branch. Moreover,the possibility of secondarybifurcations from the primary branches cannot beruled out. Unfortunately, the stability of thesesolutionscannot beasserted has to be studiedseparately. in general, and each case Comparisonwith Computer Simulations
The numerical solution of the rate equations(Herschkowitz-Kaufmanand confirms the Herschkowitz-Kaufman and Erneux, 1975) Nicolis, 1972; of time-periodic solutionsexhibiting sharp wave fronts (seeFig. existence In the course of one periodthere appear wave fronts near the bound7.27). that propagateinwards. After collisionbetween two fronts the wave character is annihilated and the concentration pattern varies slowly like a vibrating string until the wave fronts are formed again and the entire phenomenon repeatsitself with a sharpperiodicity. The simulations also confirm the multiplicity of dissipative structures in the supercritical region B > Bc.Forinstance, for zero-flux boundary conconditions onecan find, in addition to the uniform limit cycle solution analyzed in Section7.12, solutionswith a nontrivial spacedependence persistingfor over 40 periods without any tendency to return to homogeneity. Again, these solutionsfeature a front that propagatesin a polarizedfashion (e.g., from left to right). Wave trains are also found under certain conditions. In concluding this subsection, let us stressagain someremarkablepropof the time-periodic solutionsin chemical kinetics.Thus, the ability to produce appreciablequantities of chemicals within a limited region of with powerful spaceand at regular time intervals endowschemicaloscillators regulatory properties.Moreover, the high velocity of propagationof the wave can exceed by ordersof magnitude the rate of spreadof a concentration front by diffusion\342\200\224provides an efficient meansof transmitting time information over the macroscopic distancesand during macroscopic intervals.The biological implications of this type of behavior are analyzed
boundaries
properties
fronts\342\200\224which
in
Chapter 14.
Section 7.8we insistedon the important role of the sizeof the systemin the of bifurcations from the thermodynamic branch. When timeoccurrence
In
152
t =0 t = 0.68
Simple Autocatalytic
Models
t=
1.10
t = 1.88
3 2
1
0
1
0
t = 3.435
X t
= 2.04
10
= =
Figure 7.27. Successive steps of evolution of spatial profile of concentration of constituent X in trimolecular model for fixed boundary conditions. Numerical values of parameters used in simulations are:/ 8 x 1(T3, D2 4 x 1,A 2, B 5.45,
0, =
\\03.
as we pointed out in the first subsection, are coupled, via a coupling constant that is inversely proportional to the square of the size parameter /. As a result of this coupling,coherent spatiotemporalstructures can arise and persistindefinitely. The remarkablepoint is that this is possibleonly if the system is above some critical size.The latter can be defined as that sizeup to which there exists exactly one unique time-independent solution, which is completely This solution characterizes the coupling of the reactive transport dominated. modesto diffusional transport.In a sense,the coupling between local oscilin this regime is so strong that the oscillatory behavior is entirely
oscillators
y.J4.
Traveling
153
In contrast, when this criticalsizeis exceeded the coupling becomes quenched. to a a nd is looser time-periodic activity superimposed a spatial structure Nazarea 1973). Recently, A974) was able to derive a theoretical (Goldbeter, of the critical estimate size,/*, by making useonly of the parameter-dependent of the oscillatory modeand of the diffusion coefficients. period He obtains
/*
where T is the period and S* is the maximum column sum of the inverse
diffusion
matrix.
Moreover, he provideshydrodynamic estimatesof /* for reactive processes are present in solutionsin which an arbitrary number of inert components These in addition to the bufferedand unbuffered reactants (Nazarea, 1975). estimates shouldbe applicableto complexreaction systemsof biological interest. the expression for /* is quite clear. Written in the equivalent Intuitively,
form
the equality between the periodof the oscillatory reactive mode expresses and the characteristic time of diffusion. When these two time scalesare equal, oneshould,indeed,expectthat new kinds of effectscouldarisefrom the competition between the chemical reactionsand the diffusion.
it
7.14.TRAVELING
WAVES
IN
PERIODICGEOMETRIES
The oscillatory solutionsstudied in the previous sectionsare subject to boundary conditions of either the Dirichlet or the Neumann type. An of true wave of theseconditions is to prevent the appearance important role fronts propagating at constant speed(Auchmuty and Nicolis,1976a). There is, however,another type of boundary condition of considerable interest, and which ariseswhen one solves the equationsin a medium that can be repreby a closedcurve in a two-dimensional space,or a closedsurface in or the surface three-dimensionalspace. The simplestcasesis a ring, a circle, of a sphere. is quite obvious. The biological importance of such geometries In many biological related to metabolism,to motion, or embryonic processes development, the cellular membrane plays a decisiverolein monitoring the overall behavior. In this sectionwe study the case of a ring of length 2n in two dimensions. The case of a circle is briefly discussed in Chapter8.
represented
154
Simple Autocatalytic
Models by
For the
= XBn, t);
= ~ Bn,t) ^{0,t)
^
=6
@, t)
~ Bn,
t)
G.104)
where 9 is the coordinatealong the ring. We now show that a new type of solution can bifurcate from the thermobranch, namely traveling wave solutions.To see this, we set
thermodynamic
\302\243
vt
G.105)
\302\243
where is a (constant) propagationvelocity,and look for solutionsX, Y of the reaction-diffusion equations G.13) that are functions of only. The = X' rate equationsbecome etc.]: [setting
t>
DXX\"
- (B + l)X +
D2Y\"
(dX/d\302\243,),
subjectto
X(\302\243)
= XBn + ^),
7E) =
YBn
\302\243)
for all 0
< ^ < 2n. We want to find those values of v for which there are nonconstant solutions of these equations.Alternatively, introducing the excess variables x and y around the thermodynamic branch we seek for nonzero 27i-periodicsolutions of the system [cf. Eq. G.83)]:
Dyx\"
+ (B
D2y\"
- l)x + + - Bx-A2yA2y
h{x, y)
G.106)
The only pointswhere new solutions may bifurcate from the trivial solution the linear of system equations
- l)x + - Bx )=
A2y A2y
= ~vx' = ~vy'
G.107)
has nontrivial 27r-periodic solutions. such solution must have the form Any
(\\ W
G.108)
7.14. Traveling
155
and there is such a solution if and only if the following characteristic equation alsoSection7.4): admits solutionswith m # 0 (see det
B
- 1 B
-B
D^m2 +
imv
-A2- D2m2 +
A2
imv
=0
G.109)
The new feature here is that this is a complex-valuedequation giving rise to One of them fixesthe valuesof B along the marginal stability two conditions. curve, in much the sameway as in Eq. G.33):
= Bm= 1 +
A2
+ m2(Dl + D2)
in
the form:
D\\m2
= vi =
\342\200\2242
+ A\\D,
- D2) -
vm
is real provided
<m
with
A 2(Dl
-D2)
In particular, there can only be a finite number, M, of possiblebifurcation where M is the largest integer compatible points for traveling wave solutions
ID2
J
if ll+\342\200\2242(i+Dl\\
\302\273\342\226\240]
G.113a)
does not hold with Eq. G.112)
1.
D2>\342\200\224\\-l+
G.113b)
Note that the expression function of m. Thus, the for vm is a decreasing G.11) most rapid modes are those having a long wavelength. In particular, the limit cycle (m = 0) corresponds to an infinite propagationvelocity. in a The actual construction of these traveling wave solutionsproceeds manner similar to that of the Hopf bifurcation. As is apparent from Eq. for each allowable Sm the eigenspace is two-dimensional, but for G.108), this type of bifurcation onealso has to find two unknowns, so in general, the equations are soluble. Throughout the calculation the velocity of the traveling wave plays a roleanalogousto the frequency Q of the periodic solution in the Hopf bifurcation. The resultsfeature the same dependence on the critical parameter (B Bm) and on the variable ^ asthosecorrespondto the Hopf bifurcation under zero flux conditions[cf. Eq. G.100)] and
\342\200\224
corresponding
'56
Simple Autocatalytic
Models
are not reproducedhere.Fordetails,the reader is referred to the paper by and NicolisA976a). Auchmuty in the case As in the analysis of Section7.12 of zero-flux boundary consolution corresponding the space-independent torn = 0 bifurcates conditions, for a value of B lower than any solution with finite m. Thus, the stability of The computer the traveling wave solutions cannot beascertained in general. of space-dependent simulations reveal,however, the existence time-periodic solutionsin rings, which subsistduring severalperiodswithout any tendency to go back to spatial homogeneity (Herschkowitz-Kaufman, personal communication).
7.15.THE BRUSSELATOR AS
CLOSED SYSTEM
Hitherto we have analyzed the rate equations for the trimolecular model by are maintained assuming that the concentrations of certain reactant species constant within the reaction space, or at leastare controlled at the boundaries. In many instancesan actual physicochemicalexperiment is performed, for If the initial composition conditions. practical reasons,under closed-system of the mixture is far enough from equilibrium, the concentrations of the intermediates may present,for a limited time interval, a behavior reminiscent of a dissipative structure, such as repeated oscillationsaround a quasisteady state. Eventually, this state evolves to equilibrium and all types of cooperative behavior collapse. Recently, Noyes A976a,b) has examined the conditionsunder which a two-intermediate model such as the trimolecular schemecan provide a satisfactory descriptionof these transient cooperative phenomena when of repeatedoscillaoperating as a closedsystem. He studiedthe possibility and pointed out that a necessary condition for this to be possibleis that the \"initial products\"A and B are depletedby only a small fraction each during cycle. in a well-stirred system, that is, in the Considerthe rate equationsG.11) absenceof diffusion terms. The steady-state concentrations for the interintermediates X and Ybecome:
oscillations
ik3
G.U4)
the
of sustainedoscillations the condition for the emergence Moreover, beyond of this steady state becomes[seeEq. G.33) with m = 0 and instability
S. 7.1
with
The Brusselator
as a Closed System
157
+ k2B>k4
\"initial\"
^fk2k A2
G.115)
If a closed system is to generate this steady state, onemust usually have the with respectto X, Y. If the oscillation productsA, B in large excess around is not Eq. amplitude very large, then the instantaneous values of X, Y can be approximatedby Xo, Yo. Thus, the following inequalities
G.114)
must
be satisfied:
4>
iB
J>
Yo
G.116a)
1
k3A k2
l-id
-id
G.116b)
1
-id -id
iA
c2
=P
iB
kA ky
=r
G.117)
p> r> 1
can be expressedin terms of p, q, r and the Moreover, inequality G.115) ratio B/A. One obtains the following form:
(q>\\)
\302\260ne
G.118)
The conditionsimposedby these inequalities become more stringent if in addition, that the periodT of the oscillation be of the orderof requires,
Simple Autocatalytic
Models
from
unity
the
period of
onethen finds that fc, cannot beless Taking A and B to be both about 0.1M, then r must be still larger sinceA than about 10\024 s\021. If p/r is about 100, and B are comparable. Thus, pqr can hardly be much less than 107. Now, accordingto G.117)
pqr
= k3AB
estimate:
third-orderreaction of small molecules without activation energy might well have rate constantslarger than this value. Thus, the requirement that the Brusselatorperforms well as a closedsystem is that the trimolecular step
take placewith a remarkably low activation energy. Theserestrictions can be further relieved if onepostulatestwo additional M and N, such that M P A, between A, B, and two species rapid equilibria
N
^ B:
This model would require four intermediates, although the rapid equilibria permit reduction of the rate equationsto only two differential equations. The conclusion seemsto be, therefore, that only under certain conditions can the Brusselator in a closedsystem. model repetitive oscillations Noyes that systems further shows three variables,such as the Field-Noyes involving model of the Belousov-Zhabotinski can model reaction (seeChapter 13), more naturally closed systems in which the major reactants are depleted only by small amounts.
7.16.CONCLUDING REMARKS
From the analysis of the simplestmodel capableof exhibiting instabilities of the thermodynamic branch we may concludethat open_physicochemical systemsfar from equilibrium and involving nonlinear feedbackprocesses These are endowedby the capacity to undergo self-organization processes. to an unusual rise structures flexibility processes give dissipative showing Such and variability, along with some remarkableregulatory properties.
7.16.Concluding
compartments,
Remarks
159
unexpected phenomena as the spontaneousformation of spatial compartthe generation of bursts of chemical activity, and the ability to store past information through somekind of primitive memory, appearto be mere of sometimesslight changesof either the physicochemical consequences of the It is, system, sizeof the domain, or boundary conditions. parameters to conclude that reaction more complex therefore, legitimate sequences real processes give rise a fortiori to a similar behavior. The representing
in the context objective in Parts IV and V is to substantiate this conjecture of various concrete and physicochemical biophysical problems.Before we in howeverwe discuss this, analyze Chapter8 somefurther models presenting we discuss a cooperative behavior. Finally, in Part III the onsetof instabilities order via a stochastictheory of fluctuations. leading to large-scale
Chapter 8
analysis.
8.2.CONSERVATIVE
The
by
OSCILLATIONS
was reported first theoretical model predicting sustainedoscillations Lotka A920)and may bedescribedas follows:
k,
>
ZA
(8.1)
160
8.2.
Conservative Oscillations
161
uniform
The concentration of substancesA and B are maintained constant and of the insidethe reaction volume. Thus, the system is open.Because X Y. The massthe reaction rates are quadratic in and two autocatalytic steps, balance equationsread:
\342\200\224
= kxAx-k2XY
(82)
^,
K2
y0
=M
*C2
(8.3a)
(8.3b)
and the
trivial
solution
Xo
= Yo = 0
The motion around thesestates can be investigated by means of a linear stability analysis, which follows the lines of Chapter 6 and of Section7.4. One finds (Glansdorff and Prigogine, 1971; that the trivial Nicolis,1971) state is a saddlepoint (and thus always unstable), whereas the nontrivial one is a center. Small perturbations around Eq.(8.3a) are, therefore,periodic, with a universal frequency co0depending on the parametersdescriptive of
the
system:
co0 =
\302\261i(kikiABI12
(8.4)
In orderto study large-amplitudemotions around Eq.(8.3a) weintroduce the new variables (Volterra, Kerner, 1957):
1936;
u
= log X,
= log 7
e\"
(8.5)
which
satisfy
the
equations:
j=kyA- k2
dv
Multiplying
=
(8.6)
(k2
e\"
kxA), respectively, and admits a constant of adding, we obtain the important result that Eq. (8.6) motion, which is additive over the different constituents:
both
sides by
(k2
e\"
- k3B), -
r= =
Y)
7 = const
(8.7)
162
Phenomena
defines an infinity of trajectoriesin phasespacecorClearly,relation (8.7) ForX and Y close to the steady corresponding to different initial conditions. state (caseof small perturbations) these trajectories become concentric around Xo, Yo and retaining terms to Indeed,expandingEq. (8.7) ellipses.
first nontrivial
(X
For finite X Y Yo, the trajectoriesare deformed but remain -f does not exceed somecritical value (Davis, 1962). closed, provided Thus,
- XoJ - Xo, (Y
order we obtain:
YoJ
(8.8)
finite perturbations around (Xo, Yo) are also periodic (seeFig. 8.1). The calculation of the period T of thesetrajectories has recently beenperformed analytically by Frame A974). One can show that each trajectory has a different perioddepending on the constant \"f~, that is, on initial conditions.
i.o0.5
0.5 2.5
0.2
Lotka-Volterra cycles obtained for successively higher values of constant of motion Figure V and for k3B/k2 denotes steady state. klA/k2
8.1.
= 1. S
8.2.
Conservative Oscillations
163
The Lotka-Volterramodel has, therefore, a continuous spectrum of frewith the existence of infinitely many periodictrajectories. frequencies associated This is a very important point, as it implies the lack of asymptotic orbital that is, the lack of decay of fluctuations. As a result of stability [cf. Eq. (8.4)], small perturbations the systemcontinuously switchesto orbitswith different of frequencies,and there will be no average, \"preferred\"orbit.Oscillations this type may only describenoisetype of effects rather than physically observable periodiceffectscharacterized by sharply defined amplitudes and of existenceof a constant of motion are seen by consequences and (8.9) and by observing that: combining Eqs.(8.6)
Further
j\\
periods.
dr
\342\200\224
dv
= dr
du
dr
dv
~dt~
with
di~~du
dt
(8.9)
dv du
d2r d2r , , , ,
du dv
(8-10)
a conservativesystem in the variables (u, v) the model represents first a The latter (regular) integral admitting plays the sameroleas does in as is from mechanics, energy Eq. (8.9),which assumes a apparent \" Hamiltonian \" form. it is clear that a conservative system cannot be structurally Intuitively, stablein the sensedefined in Section5.4(Andronov, Vit, and Khaikin, 1966). of this kind asmodels This givesonemore argument against the useof models for oscillations with the behavior in nature. This is to becontrasted observed of modelsgiving rise to oscillatory behavior past an instability. As discussed at length in the previous chapter, theseoscillations are endowedby both a and structural which ensure asymptotic sharply reproducible stability, behavior in time. It is instructive to point out that for certain exceptionalvalues of the parameters,a (nonconservative)system capableof undergoing a limit-cycle oscillation can reduce to a conservative system.To seethis, consider a system involving two variable intermediates near the threshold of an asymptotically orbitally stable periodicmotion. According to Chapter 6,
We
seethat
r.
164
Phenomena
the matrix of coefficientsof the linearized mass-balance equationsadmits a pair of purely imaginary roots. Thus, in the notation of Section
6.5:
= It aux + al2y
\342\200\224 \342\200\224
dx
dy
= a2lx
Setting
dx
dt
dr
dy
dy dt
dr
dx
(o.lz)
we verify
that
the
dx dy cy dx We conclude that a nonlinear system behaves as a conservativesystem in the vicinity of the point of marginal stability. The \"energy\" function -f can be computedup to an arbitrary constant, and the result is: x2 -r= -fl21 y+
fli2
(8.13a)
y + anxy
y2
(8.13b)
Note that this form is not necessarily definite unless al2 > 0, a2i < 0 < 0.The latter inequality is a necessary and a\\t + al2a2i condition for the reference steady state to behave like a center. From the point of view of thermodynamics the constant of motion (8.13b) does not have a specialsignificance, as it depends on the details of the chemical kineticsvia the linearizedcoefficientsau,a12, a22 In contrast, the is closely constant of motion in the Lotka-Volterramodel [seeEq. (8.8)] 32S state. related to the excess a round the reference [see Eq. D.30)] entropy, in an ideal the in mixture derivatives Indeed, thermodynamic appearing the
\342\226\240
dXj0
d/iY\\
Xo
= kB T =
^Yjo
~Y^
JyH (ixjo
8.3.
As
165
a result:
model is a The occurrence of sustained oscillations in the Lotka-Volterra On as in of a of irreversible set reactions Eq.(8.1). consequencehaving purely to equilibrium by the other hand, the same system can be analyzed close One finds (Lefeveret al., introducing a rate constant k of back reactions. is that if the overall less than a \"critical\" value, the steady state 1967) affinity is an asymptotically stable node.It is only beyond this critical value that can occur during the evolution to the steady state, which dampedoscillations now behaves likea stablefocus. Finally, in the limit where the affinity tends become to infinite (which can be achieved by taking k -* 0) the oscillations in this section. sustained and one recovers the resultsdeveloped
GIVING 8.3.SIMPLEMODELS Activation by
11.
We return
briefly
Chapter
the Product
situation is discussed in Chapter 14. HigginsA964) and Sel'kovA968) workedout mathematical modelsfor this type of process. Sel'kov's schemes appearin the form:
this
\302\243\342\200\224/<*.*>
In addition to simpleautocatalysis, whoseeffectsare analyzed in Chapter7, a reaction sequence activation (positive feedcan give rise to more complex whereby one of the reaction products stimulates its own processes, of A biochemical example synthesisor the synthesis of one of its precursors.
feedback)
^=
/
//[/(A\", Y)
- 07]
(8.15)
X, Y may represent, respectively,the substrateand product concentrations of one (or of a seriesof) enzymatic reactions, v is the rate of entry of X, /? the rate of Y consumption, and n is related to the enzymatic constants.Finally, is an increasing function of Y, at least within a certain range of values. Sel'kovfinds that sustainedoscillationsof the limit cycle type may arise This implies of product activation is higher than one. provided the degree that dependson Y through a powerlaw of the form f(X, Y1 with e > 0.
+\302\243)
166
Phenomena
End-productInhibition
is a very general processin nature and is a necessary prerequisite a number of important reaction chains.Nevertheless,it is fair to say that are even more common, especially in biology. negative feedbackprocesses One of the best-knownexamplesis that in which the product of a chain diminishes the rate of synthesis of somedistant precursorof the inhibitory substance.Morales and McKay A967) and Walter A969, 1970) studied modelsfor this type of feedback, which may be summarized as follows:
Activation
in
dXi
~~d7~~
dXi
(8.16)
k
where
Xn+
are the concentrations and f(Xn+l) is a decreasingfunction of the effectof inhibition. The most widely usedform for is: j describing
X{
f(Xn+i)=t
A
C
,
VD
(8-17)
more detailedanalysis showsthat the exponent p is related to the nature of the enzyme catalyzing the conversion of the inital product into X,. It can be shown that this type of system exhibits limit-cycle behavior provided 2 and p n In fact, by increasing the number of intermediate stepsone finds that the oscillatory behavior occurs for relatively small p. In contrast, if n = 2, the valuesof p necessary for periodicsolutionsare as high as p = 9.
>
> 2.
The existence of oscillatory solutionsin a large class of negative feedback control processes has recently beenestablished by Tyson A975b) using an m ethod. elegant topological An early model treating the effectof inhibition on the oscillatory behavior has beenproposedby Spangler and SnellA961,1967). End-productInhibition and/or SubstrateInhibition
and and Sel'kov,1971) Sel'kovand co-workers Samoilenko (Sel'kov,1967; role. have an substrate can studiedmodels where the inhibitory DegnA968) The most commonlyenvisagedmechanism is onewhere a reversiblereaction
J.
167
ES,forming an between a substrate,S, and the enzyme-substrate complex, is scheme: Michaelis-Menten inactive complex, ES2, addedto a classical
S+ E ES S + ES
\342\200\224\302\243i->
ES
E
>
\342\200\224^->
+P
(8.18)
k*
<
ES2
This system can be handled where P is the productof the enzymatic reaction. so-called which is illustrated in the quasisteady-state approximation, by that the model in Chapter 14. somedetail on a concrete Briefly, one assumes and adjust instantaneously, to the enzymatic forms vary on a fast scale substrateor productvariations. One then obtainsfor the sequence (8.18):
dt
1 +(ki/k2)S +
(k,
where the total enzyme concentration Eo = E + ES + ES2= const (8.20) remains constant in time. with additional terms expressing has to be supplemented Equation (8.19) the rates of substrateentry, substrateand productefflux, and influenceof the product on enzyme activity. Assuming a well-stirred medium with a firstorderdecay of the productand a convectivetransport of the substratefrom an outsidereservoir, oneobtains equationsof the form (for a single substrateproduct reaction):
= h(s0 s)
(8.21)
An
\342\200\224
where
that if of this function is provided by Eq.(8.19). dependence can o f is to then inhibition than or degree Eq.(8.21) exhibit higher equal two, a s well as states. oscillations limit-cycle multiple steady
Temperature Oscillations Hitherto we have neglected thermal effects in nonlinear kineticsby anticia very efficient energy transfer through heat conduction, or suitable \"homeostatic\"mechanisms ensuring a constant value of the temperature.
anticipating
168
Phenomena
Whenever theseconditionsare not satisfied, temperature can play a very if the system releases efficient roleas a generator of oscillations, especially The main reasonfor this heat locally through certain exothermic reactions. of rate constants on the temperature given is the highly nonlinear dependence by the Arrhenius law:
k(T) oc exp
\342\200\224
RT
(8.22)
where T is the temperature, R the gas constant, and E the activation energy. The fact that k(T) is an increasing function of T, together with the presence constitutes an obvious feedback of exothermic reactions, wherebya (random) increaseof T accelerates the reaction, which subsequently releases heat faster and further increases the temperature of the mixture. The first example of sustained oscillationsin temperature-dependent has beenencountered in chemicalreactor theory, particularly in the systems adiabatic stirred tank reactor (Gavalas, 1968). Let V be the volume so-called of a reaction vesselfed by a stream of volumerate q, in which the concentraof the reactant is Xo and the temperature To (seeFig.8.2). A reactant disappearsinside V by an irreversible first-order reaction at a rate k(T)X, where k(T) is given by Eq. (8.22). Adequate stirring maintains the contents uniform in X and T.Of course, X = X(t), T = T(t), although q is maintained constant.The mass-energy-balance equationsin the tank give:
concentration
dA=l(Xo-X)~k(T)X
AT1
(CP
= qCP(T0
(8.23)
(AH)Vk(T)X
where CP = heat capacity of reactant, C = heat capacity of the walls, and AH = heat of reaction. Theseequationshave beenstudiedin detail both analytically and numeriIt has been shown that, dependingon the values of the parameters
numerically.
1
x0, To
X,
Q
X,
8.2. An open reactor subject to a constant flux q. X0,T0: reactant concentration and temperature at the entry. X, T:reactant concentration and temperature inside reactor.
Figure
8.4.
oscillations
169
q, Xo, To, AH, C, CP,the system may exhibit multiple steady states,oscillaof the limit-cycle type, or even multiple limit cycles.More recently, Rosen A973) has considered the effectof temperature dependencies on the of trimolecular model analyzed in Chapter 7 and found also the possibility
temperature-induced limit cycles. The additional effect of spatial inhomogeneities has been analyzed by CohenA972),Keller A974),and Amundson A974),in the context of the tubular chemicalreactor problem. The main differencebetweenthis problem and thosebasedof the reaction-diffusion equationsstudiedin the preceding of convection terms in the balance equations, chapters is the presence reflecting the convective heat-mass transport along the tube. Turbulence sets up an axial dispensionthat is usually describedby an empirical law or Fourier's laws. This confers to the equationsof patterned after Fick's evolution a parabolic character similar to that of reaction-diffusion
equations.
Again
solutions with complexstability properties, including spatiotemporally dependent regimes similar to those found in the trimolecular model.
multiple
one finds
170
Phenomena
modelsalong this line. A972)and Dekkerand Speidel A972)have suggested Their main interest is that they provide mechanisms of amplification of small effects, which may have played an important roleduring chemical evolution (we discussthis aspectin Chapter 17). A still different classof modelsare those referring to regulatory processes at the genetic level(Cherniavskii,Grigorov, and Poliakova, 1967; Babloyantz Mostof thesemodelswere and Nicolis,1972; 1972). Babloyantz and Sanglier, scheme(Jacob and Monod, 1961) which is inspiredby the Jacob-Monod known to apply to bacterial regulatory processes. In this section we illustrate the main aspects of multiple steady-state transitions on a simpleclass of modelsinvolving a single chemical interSuchmodelswere analyzed by Schlogl intermediate. JanssenA974), A971,1972), McNeiland Walls A974),and Matheson,Walls, and GardinerA975).
A
SimpleAutocatalytic Model
+ 2X
X
*'
<
\302\253==\342\231\246
>
3X (8.24a)
B
is:
A
<
(8.24b)
and describesthe conversion of the initial reactant A into B via the interX which, in addition, can catalyze its own production. intermediate The system is opento interaction with infinite reservoirs of reactant A and B, so that the concentrations of A and B are kept constant in the system. Possible ways of this situation were in discussed realizing experimentally Chapter7. already The rate equation
is:
~k2X3+ ^= at
ktAX2
-k3X+ k4B
(8.25)
This equation admits an equilibrium solution, provided the conditions are fulfilled: ensuring a simultaneous equilibrium of both reactions(8.24a) LAY2
\342\200\224
b Y3
8.4.
Multiple
171
As the
=D
=t^
(8.26b)
is nonvanishing, Whenever R # Req, the affinity of the overallreaction (8.24b) The steady-state and the system operatesunder nonequilibrium conditions. solutions of Eq. (8.25) obey the equation
X30
-aX2+ kXo~b = 0
b
(8.27a)
where we set a
As is well known from (Abramowitz
= ^~,
k2
^,
k2
\\b
=~
k2
(8.27b)
elementary algebra,the nature of the roots of this cubic equation depends on the sign of the expressionq3 + r2, where
and Stegun, 1964):
(8-28)
+ r2 > 0, then the equation admits one real root and one pair of If q3 + r2 < 0 the equation admits three real roots. complex conjugate roots. Thesetwo regimesare separatedin the spaceof parameters(q, r) or (a, b, k)
the curve q3
+ r2 = 0
(8.29)
= XV
qI
JL
02 =
\342\200\224^
-1/3 i
'^
(SI
(o.JUaj
\"X(\\ct\\
whereas the
third
root is given
by
(8.30b)
From these relations one sees that the three roots become identical if one could have r = 0, that is, also q = 0.According to Eq. (8.28) this implies a
= C/cI/2
172
Phenomena
\302\243k3
If bt, b2 are the two rootsof this equation such that of three real solutions of Eq. (8.27a) requires bi
We
bt
< b2,then
<b<b2
note that
in
that this
condition can never be fulfilled as long as inequality this modelcan only arise
far from equilibrium. In the physicallyacceptable the part a > 0, b > 0) part of the (a,b)plane (i.e., relations (8.31) are representedgraphically in Fig.8.3a. At a0 = 2kl/2 the curve b = b(a) has one vanishing root bt = 0 and a secondpositive one, equal to b2 = Tfk312. The curve becomes meaninglessbelow a for which the discriminantof the quadratic (8.3la)vanishes.This corresponds to the case of three equal roots of Eq. (8.27a), In the namely, amin = CkI'2. as long neighborhood ofamin, b has the behavior indicated in the Fig.8.3a, as k remains finite. If k 0, then b becomes is, negative. This limiting case
\342\200\224amin,
-\302\273
b = b(a)
root
Figure
8.3a. Linear
stability
of parameters b and a, Eq. diagram for model (8.24)in space = b(a) (e.g.,ft, < b < b2 for a = a,) is region of multiple
gj. Multiple
173
therefore, unphysical and has to be discarded.The behavior of b in terms can never be satisfied of k is qualitatively similar. Again for a -> 0, Eq.(8.31a) valuesof b and k. Figure 8.3bdepictsthe dependence for physicallyacceptable of X at the steady state on the parameter b for fixed k and a such that
flmin
The analogy with the van der Waals theory of phasetransitions (Landau is striking. In fact, Fig.8.3 has exactly the same structure and Lifshitz, 1957) isotherms of a dense in the the coexistence as region, provided b is gase the as v. The critical and the volume\" \"pressure\" interpreted X, p \"specific in the to the regime of three equal roots, present problemcorresponds point XOi = ^02 = ^03-At this point the \"isotherm\" b = b(X) has a horizontal
inflexion
<a <a0.
states on branch P'Qcan evolve to the higher branch PQ'(and vice versa) even before states Q or P are reached,provided the perturbations acting on the referencestate exceed the values corresponding to the intermediate A system with multiple steady statesis, therefore, endowed branch QP. with an intrinsic excitability. We examine some biologicalimplications of this of abrupt transitions to a Moreover, the possibility property in Chapter 15. of the value for the modeling variable makes such suitable higher systems of explosivereactions (Gray, 1974).
point. One can show by linear stability analysis that the states on branchesOQ and PR are stable,whereasthe states on the branch PQ are unstable.It is also apparent from this result that a hystereris in X may occuras b varies, PP'.Moreover, as illustrated by the arrows along the lines P'Q,QQ\\ Q'P,
8.3b. Steady-state diagram representing concentration X versus the parameter b. Dotted part PQdenotes unstable branch. In region b, < b < b2 the system displays multiple steady-states and hysteresis. At Q or P there occur finite jumps of X, respectively, toward branches PR or QO.
Figure
174
Phenomena
ThermodynamicInterpretation of multiple we pointed out in the precedingsubsectionthe occurrence from thermoin the model a finite distance states (8.24)requires steady On the other in to what contrast hand, happensfor equilibrium. is often it and impossibleto symmetry-breaking transitions, limit-cycle the determine of solutions branch (Edelstein, thermodynamic unambiguously To see Glansdorffand Prigogine, 1971). this, considerthe steady-state 1970; in connection with Fig.8.3b. In addition to the parameter b, equation (8.27) the values of X are also determined by the ratio {ki/k2) = k and by a. It is quite conceivable,therefore, that different paths can be found in the paramand leading from a value of X on spacespannedby q and r (cf.Eq.(8.28)) the lower branch to a value of X on the higher branch.Among thesepaths, somecertainly cross the hysteresis this implies an instability of the region; which couldbe defined the branch of lower as values branch, thermodynamic of X. Other paths, however, could avoid this region and lead to the upper branch smoothly, that is,without an instability. From this point of view, there is an analogy with equilibrium phase transitions, where the branch of reflects This degeneracy equilibrium states is degenerate (Kobatake,1970). the fact that the steady statesdepicted on Fig.8.3bbelongto the samebranch, in the sensethat they can bejoined by a smooth curve OQPR. arisesas a The situation is different in systemswhere multistationarity result of coexistence of different branches of solutions,as illustrated in Forbmin < b < b0 the system presentsthree steady states,onelying Fig.8.3c. on branch (i) and two lying on branch (ii). At b = bu which is a bifurcation One point, an exchange of stability between branches(i) and (ii) may occur. can speakof a single-valuedthermodynamic branch (i) here and of a transito states of a new type belonging to the classof dissipative structures. Simplemodelsgiving rise to this type of steady-statebehavior have been within the context of prebiotic polymer worked out (Venieratos, 1976) also Chapter 17). synthesis and competition (see
As
thermodynamic
parameter
transition
is instructive to phrase the results of this section in the language of To this end,we first redefine catastrophetheory (introduced in Section6.4). the variable X in Eq. (8.25) in order to eliminate the quadratic term in X in the right-hand side.Setting the following:
It
Z=X-\\^A 3k2
(8.32)
Multiple
175
8.3c. Steady-state diagram representing bifurcation of multiple solutions at point ft,. Dotted lines show unstable branches. At ftmin < b < ft, the transition between the two stable branches requires a finite jump.
Figure
(8.33a)
where
u
= 3k3k2
\\\\
k\\A2
\342\200\224^
= u(a, b, k)
(8.33b)
k\\
27
k2
= k2t
The next point to realize is that a system involving a single variable always derives from a potential. Thus, Eq. (8.33a) can be written in the form
dZ
~dZ
(8.34)
= ?l + u^- +
4 2
vZ
(8.35)
176
3 sol.
Figure
parameters
singularity.
8.4a. Stability diagram of system described by cubic rate equation involving two [Eq.(8.33a)]according to catastrophe theory. Oc= line of conflict; 0 = cusp
u, v
to a single minimum of V from plane the region corresponding minima and one to two maximum are given by the corresponding of two roots of the cubicC.33 condition of coalescence a):
In the
that
4u3
+ 21v2 = 0
(8.36)
This equation, which is to be comparedwith Eq. (8.29), definesa semicubic in 8.4a. As or + parabola(a) (b) represented Fig. (a) (b) (Fig. 8.4a)are crossed from outside, two new steady-state solutions the domain Once inside emerge. limited by the curves (a) and (b\\ which corresponds to the multiple steadystate region of Fig.8.3b, the two minima of V generallyhave different heights, exceptalong a set of pointsdefining curve (c),where, say, V(Zol) = V(Z03), Z02 beingthe value of Z at the maximum of V. This curve, which emanates from the cusp O, correspondsto what is called in catastrophetheor.y a conflict,in the sensethat the two states Z0l and Zo3 are equally dominant attractors.* Therefore,the systemcan evolveto oneor to the other as x -* oo. This idea, which is motivated by Maxwell's rule familiar from first-order can be substantiated by a phase transitions (Landau and Lifshitz, 1957) stochasticanalysis of fluctuations (we discussthis point in Section12.6). It is interesting to investigate the behavior of Z along the curve (a) + (b) of Fig.8.4a. In this respect,we first note that in a three-dimensional space the projectionof that point O' spanned by Z, u and v, O is necessarily of the surface Z = Z(u, v) where the cubic (8.32a) admits three coalescent roots.Beyond (a) + (b) all vertical lines emanating from the (u, v) plane intersect the surface Z = v) at a single point. Inside (a) + (b), on the toward other hand, one has intersection at three points.Thus, as u decreases a point of bifurcation negativevalues,the image O'ofOon the surfacebecomes
Z(\302\253,
* As a matter of fact,
symmetrically
in the notation of this subsection, the conflict line with respect to branches (a) and (b).
Ocshould be situated
g.4.
177
plane)
bifurcation
of Riemann-Hugoniot cusp catastrophe (seeprojection on u-v = bifurcaof bifurcation of new branches of solutions Z (seesurface). point corresponding to cusp singularity. Dashed area on curve corresponds to region of multiple steady-state solutions of equation for Z.
Figure
8.4b. Visualization
as phenomenon
0'
of a new branch of steady state solutions(a')+ (b')as shown on Figure 8.4b The resemblance of curves O'b'a with (Thompson and Hunt, 1973, 1975). the bifurcation diagrams derived in Chapter7 is striking. Whenever point O' is accessible indeedthe to the system, one has on crossingthis entire curve O'c' a situation similar to the formation of a shockwave orto a first-order phasetransition in the region of coexisting phases.In particular, well-defined from a smooth characterized a starting velocity of by wave,, propagation, one would switch to a regime characterized by two distinct propagation velocities.This phenomenon has been analyzed by Riemann and Hugoniot and may, therefore,be appropriately calledthe Riemann-Hugoniot catastrophe(Thorn, 1972). In the space of the physicochemical parametersa,b,k the behavior is in the vicinity of Fig.8.4 occurs qualitatively similar. The cusp singularity
point\342\200\224and
178
Phenomena
ofamin in Fig.8.3a, which again is a bifurcation point in the usual senseof the term. Finally, as stressed repeatedly throughout this monograph, in chemical systems involving more than onevariableand operating far from equilibrium, to construct a potential generating the equations it is generally not possible with catastrophe the analogies drawn in this subsection of evolution. Hence, theory are specificto a particular classof systems.
8.5.TWO-DIMENSIONAL PROBLEMS
interest, one-dimensional problemsin nonlinear Despitetheir pedagogical This is particularly kineticsprovide rather unrealistic modelsof real systems. true in biology,where many crucial processes take placein (two-dimensional) The purposeof the presentsectionis to surfaces, such as cell membranes. outline some results obtained on two-dimensional dissipative structures.
We
the symmetry features of the spatial domain introduce a highly interesting interplay between the size of the system and the form of the patterns. Moreover,the variety of possiblepatterns is greatly enhanced. As in Chapter 7, we illustrate the main ideas on the trimolecular model,
seethat
Eq.G.13).
Let
be the eigenfunctions and eigenvalues of the Laplacian the spatial domain: ' V20,. = -kf<j>i (8.37)
These quantities are determined uniquely, once the size, geometry, and We may recall that in the one-dimensional are specified. boundary conditions case Section were (see 7.4) trigonometric functions, whereask( were equal to i2n2/l2.Fora given ku the stability propertiesof the uniform steady-state in the two-dimensional solution Xo = A, Yo = (B/A) [see Eq. G.16)] In particular: case are determined by the samerelations as in Section7.4.
<j>i
\342\200\242
The characteristic equation admits one non-negative and one negative root when
B
with
> B, =
+ /42
\342\200\224
+ ~^-j + Dikf
(8.38)
Bc = min Bt
$.5.
\342\200\242
Two-Dimensional Problems
179
The characteristic equation admits one pair of complexconjugate roots with a nonnegative real part when
B
with
> B, = 1 + A2
+ (Di + D2)kf
(8.39)
Bc
\342\200\224
min
Bt.
The new feature added by the higher dimensionality is that the eigenof the linearized problemare now different. Forinstance, for zero onewould have: flux boundary conditions
eigenfunctions
nxi,nyi
= 0, 1,
2,...
(8.40)
ly
(8.41)
n. of integer order
= 0, 1,
2,...
(8.40a)
for a circle of radius R, where Jn is the Besselfunction The permitted values of kt in the two cases are:
kf
n2(^+ ?g\\
and
A.I (k.r\\ dJ\"{kir)
dr
n An
= 0, 1, 2,
...;i 1,2,...
=
nk,R) = 0
(8.41a)
of degenerate additional feature of great importance is the occurrence the thermofrom T his even the first that at eigenfunctions. instability implies become could bifurcations dynamic branch, multiple (primary) possible. When n # 0 degeneracy which presentsfor occursalways for the circle, each value of kt (and, thus, also of a}t) two independent eigenfunctions: 0,-,i
(j>U2
similar situation
is found for the squarewhenever nx! # nyi. Degeneracy somerather stringent this requires
180
Phenomena
8.5. Bifurcation parameter versus the eigenvalue of Laplaceoperator. U denotes unstable uniform steady-state. (A) shows case of pure degeneracy; (B) shows case of \"accidental\" degeneracy.
Figure
Still higher degeneracies conditionson the lengths of the sides. become of a sphere(Hanson,1974b). possiblein the case It shouldbe pointedout that, even if the first bifurcation does not leadto a of the discussed it above, \"pure\" degeneracy type may happen that two different bifurcations become possiblefor identical values of the bifurcation parameter.This caseof \"accidental\"degeneracy is illustrated in Fig. 8.5 (seealso Boa, 1974).
Numerical Simulations of Steady-State Solutions The analytical computation of the bifurcating steady-state solutionsin the caseis straightforward. More interesting from the mathenondegenerate of point view is the situation of a doubleora higher ordereigenvalue the nature and since,accordingto the theorem mentioned in Section6.6, the of solutions are not known a stability bifurcating priori.This point was and McLeod on a A973) investigated by Sattinger general basis, and by Shiffmann A975)on the particular case of the trimolecular model.We do not describethe results here but, rather, report on the numerical simulations of two-dimensional patterns for the trimolecular model (Erneux and Herschkowitz-Kaufman, 1975). to 8.11 Figures8.6 representthe stationary structures, obtained for the intermediate X when the unstable steady state (Xo, Yo) is slightly perturbed (in somefigures the positionof the initial perturbation appliedto the uniform unstable solution is indicated by an arrow). In each of those figures the resulting pattern reflects the geometrical propertiesof one of the unstable The latter can be characterized by two integer numbers eigenfunctions and (8.41 that are definedfrom the linear stability analysis [see a)]: Eqs.(8.40a)
mathematical
<\302\243,(r).
8.5.
Two-Dimensional Problems
181
model in circular domain Figure 8.6. Polar steady-state dissipative structure for trimolecular with zero-flux boundary conditions. Broken dotted line: unstable uniform steady state. R x 1(T2. A = 2, B 4.6, D, 3.25x 1(T3, D2 1.62
=0.1,
The stationarydissipativestructure nx, ny for the rectangleand n, i for the circle. obtained can be related to thosemodeswhich have an appreciable positive real part of wi. More specifically,Fig.8.6 with no fluxes at the boundpresentsthe circle the structure the has clearly, propertiesof the unstable stationary i = 1 with its characteristic polarity. Noticethat in one eigenfunctionn = 1, dimension polarity correspondsto spontaneousonset of a macroscopic concentration gradient along the system, resulting from different values of X or Y at the boundaries r = 0 and r = I. The organizedpattern that appears in Figure 8.6 is not a trivial extension of onedimensional polar structures to the circle; in fact, we observethat the circular limits permit us to have, in the same structure, a region of space that is greatly organized (around 0^0) and another quasiuniform region (around 0 ~ tt/2). In Figure 8.7 we consideredthe circle for fixed concentrations at the boundaries;the structure is angle independent to the eigenfunction n = 0, and corresponds = 2.Figure 8.8 showsthe rectangle for the sameboundary conditionsand to the eigenfunctionnx = ny = This case was alsoconsidered corresponds for a higher value of B. The resulting pattern (Fig. doesno longer, as in 8.9) Fig. 8.8, totally reflect the symmetry properties of the eigenfunctions = 1) but undergoesa grooving in its central region which 4>(nx = 1, ny
boundaries;
'
1.
182
Phenomena
Figure
fixed
8.7. Steady-state dissipative structure for trimolecular model in circular domain with = 8 x 1CT3. concentrations at boundaries. R = 0.2, A = 2,B = 4.6, D, = 1.6x 10~3,D2
increaseswith B. This showsthe influence on the bifurcation solution of subharmonic terms (seealso Section7.6), which modify the geometrical = 1)for increasing values of aspectsof the first approximation 4>{nx = 1, ny
\342\200\224
and 8.11 Figures 8.10 present,for a degenerateeigenvalue, the square with no fluxes at the boundaries. Two different initial conditions are imposed. refers to the case where we slightly perturbedthe unstable steady Fig.8.10 state at onepoint. This leadsto the simplestructure represented on Fig.8.10
Bc.
8.8. Steady-state dissipative structure for trimolecular model in rectangle with fixed = 0.231. A = 2, B = 3.9,D, = 1.6x 10\023, D2 = concentrations at boundaries. /,. = 0.165. 8 x 10~3.
Figure
\\x
Figure
supercritical
8.9. Concentration
B = 4.1.
pattern
as Fig. 8.8except
for
a more super-
Stable steady-state dissipative Figure structure for trimolecular model in a square conditions. subject to zero-flux boundary
lx
8.10.
\302\243>,
8.11. Unstable
concentration
Fig.
same conditions as in
8.10. 183
pattern
184
which
Phenomena
can be characterized by nx = 0, ny = Fig.8.11 presentsa second case wherewe have perturbedat another point. The emergingstructure is the = 0). to <j>(nx = 0, ny = 1)+ (j)(nx = 1, solution corresponding degenerate ny But this structure is not stable,on a slight perturbation it tendseither to the to the shapeof eigenfunctionscj)(nx = 0, ny structure corresponding 1)or = 0). to the structure characterized by <j>(nx \\,ny studiesdescribedin Chapter 7 show that several The one-dimensional stable solutions can be obtained from different initial conditions.These solutionsare all related to oneof the unstable eigenfunctions,generallythose to an appreciable real part for coi.A fortiori, this is also the corresponding where the possibility of new bifurcations caseof two-dimensional systems, increasesrapidly with increasing values of the bifurcation parameter.For if we compare a one-dimensional and a rectangle example, systemof length 1, of sides 1 and 0.5, both with zero fluxes at the boundaries, we have, for the eigenvaluesk,:
1;
\342\200\224
\342\200\224
onedimension: kt
two
\342\200\224
nn,
n
An
= 0,
dimensions: kt = n(nx
?I/2,
1,... =
nx
ny
= 0,
0,
1,... 1,...
to:
allowed, for
which
Then oneobserves that only the eigenfunction4>(n = 2) satisfiesthis condition in one dimension,whereas in two dimensions, three different solutions
Comparison between the bifurcadiagrams for one-dimensional system (upper part) and two-dimensional system (lower part).
Figure
bifurcation
8.12.
8.5.
Two-Dimensional Problems
<j>(nx <j>(nx
185
= 2, ny = 1),are to be = 1, = 1),and ^nx = 0, ny = 1), ny The situation can be illustrated by the general bifurcation considered. for one At B*, only onebifurcation has appeared diagram shown in Fig.8.12.
namely,
Moreover,
On the contrary, in when one increases the value of B from zero. dimension, two-dimensional systems, several bifurcations may occurbefore B*.Moreas we have already shown, in two dimensions multiple solutionscan from the same bifurcation, as a consequence of degenerate also emerge eigenvalues in highly symmetrical systems.Computersimulations confirm entirely this striking multiplicity of dissipative structures in two dimensions. One can really speak here, following Hanson A974b), of a \"quantization\" of the statesof a macroscopic system.
Time-periodicand Wave-likeSolutions
biologicalinterest, solutions are apparently time-periodic seemto emerge and display,in addition, a nontrivial spacedependence. we may the most striking examples Among the in the of wave Belousovoccurrence quote rotating spiral fronts Zhabotinski of pulsesof chemical activity reaction, as well as the appearance on cell surfaces, which seemto bear someconnection with the subsequent deformation of those surfaces.Examplesare discussedin some detail in In the present sectionwe focus on the mathematical Chapters 13 and 16. of the aspects problemand discussthe feasibility of having spatiotemporal whose patterns symmetry is lesserthan the symmetry of the spatial domain. We deal exclusively with systems subject to zero flux conditions,as in systems with constant boundary conditionsthere may be an artificial space dependenceinduced by the boundaries.Similar considerationshold for wave-likesolutions in periodicgeometries, such as the surface of a sphere and Nicolis, 1976b). (Auchmuty We consider systems involving two chemical variables and, more of particularly, the trimolecular model.Let the reaction space be a circle for zero-flux radius R. According to the analysis of Sections7.4 and 7.12, boundary conditionsthe first bifurcation from the thermodynamic branch leads to a (uniform) limit cycle.Thus, any spatially dependent necessarily solution is the result of either a subsequentprimary bifurcation from the thermodynamic branch or a secondarybifurcation from the limit cycle.In both cases, it is extremely difficult to assessthe stability of these solutions. True, we know from the analysisof one-dimensional systemsthat, well within the supercriticalregion, multiple solutions of the rate equationsare possible, and this is corroboratedby the resultsof computer simulations reportedin Chapter7.Still, oneshould be aware of the fact that so far there is no rigorous proof of stability of those patterns.
In many situations of physicochemical and
that
186
Phenomena
one can construct the spatioof stability considerations, Independently temporal solutions using bifurcation theory or other methods. Let us of rotating waves.Let r, 0 be the polar illustrate the situation on the example Either one seeksfor special Two attitudes are possible. solutions coordinates. in 0 (see for a calculation Stanshine, 1975, X(r, 0, t), which are singly periodic on the Belousov-Zhabotinski reaction) and for which
X
= X(a)ot
<j>(r)
\302\261
0)
(8.42)
for r sufficiently large.One finds that such solutionsare not defined for r r0, where r0 is a certain critical length. When they are defined,the relation observed 0 = const is the equation for the involute of a circle, <j>(r) experimentallyby Winfree A972).Computersimulations by the latter author
<
\302\261
1974a)on a system undergoing discontinuouskinetics have producedqualitatively similar results. is to seek for bifurcating time-periodic solutions The secondpossibility without postulating any specificr or ^-dependencies (Auchmuty and Nicolis, This is more general than Erneux and HerschkowitzKaufman, 1976). 1976b; the previous method, as in a boundedsystem any stablewave-likesolution is necessarily (or at least almost periodic). Usingthe method time-periodic one for the first nonuniform outlined in Section finds 7.12, bifurcating solution
(Winfree, from the
thermodynamic branch:
X(r, 0, t)
= (B
+
r2 cos(<j>2+
GO
d^J^k^r)
am
+ (B + (B +
Bc) X
GC
m= 1
(am
cosBQf+
am2
i//J)Jo(kOmr)
<Am2)]cos 20
Bc) X
am2
{[\302\253m2
cosBfit +
[< +
cosBQf+ i/C2)]sin20}x
J2(k2mr)
<8-43)
for Y. The various coefficientsare determined by the and a similar expression and system'sparameters by the normalization conditions.kt, kOm and klm functions as follows: are related to zerosof derivativesof Bessel
J'o(kOmR) = kl
(8.44)
Expression (8.43) presents several interesting properties, the most remarkable of which is that it remains well-definedat the center of the circle. Thus the concentration front predicted although rotating, by this expression,
1.75
t =0
1.51
(A)
1.50
t = 0.14
1.75
2.50 1.51
2.72
concentration curves for X in trimolecular model in circle of radius R = to zero-flux boundary conditions. Full and broken lines refer, respectively, to concentrations larger or smaller than values on (unstable) steady state Xo = 2. A = 2,D, = 8 x 1O~3, D2 = 4 x 10~3, B = 5.4.(A) to (F) describe concentration pattern at various stages of periodic solution.
Figure
0.5861 subject
8.13. Equal
187
t = 0.36
1.50
1.67
1.44
(C)
t = 2.45
4.00
4.07
\342\231\246
*3.75
(D)
Figure
8.13. (Continued)
t = 3.36
4.00
4.25
3.75
3.65
14.45
(E)
1.75
t
2.25
2.50
= 3.70
2.75
3.00
1.5U
(F)
Figure
8.13. (Continued)
189
4.1 4.7
1.7
(A)
t = 0.93
1.7
(B)
model arising under Figure Rotating solution for trimolecular but for more supercritical value of bifurcation parameter, B Fig. 8.13
8.14.
= 5.8.
same conditions as in
190
= 2.525
1.7
4.1
4.1 4.7
2.0
(D)
Figure
8.14. (Continued)
191
192
Phenomena
can never be a true spiral. Moreover, the velocity of rotation is not a true constant as it dependson the position. solutions on a circle The resultsof computer simulations of time-periodic provide some very interesting clues for future theoretical developments Oneof the most striking aspects (Erneux and Herschkowitz-Kaufman,1976). As an example,consider revealed is,again, the multiplicity of stablesolutions. the trimolecular model. At the first bifurcation point Bo = A2 + 1,the A uniform limit cycle solution emerges, which situation is relatively simple. B The situation is remains stablefor values of significantly higher than Bo. entirely different beyond the secondbifurcation point Bj (cf. Section7.4). and space-dependent One finds a four-fold multiplicity of time-periodic moreover, patterns that subsistduring a very large number of periodsand are, rapidly restoredwhen subjectto a small perturbation. From the standpoint of bifurcation theoretical analysis, this would mean that: (a) the parameters rur2, appearingin Eq.(8.43)are multiple valued and (b) although the branchesemerging at B^ are unstable for B near Bu they are subsequently stabilized (e.g., by means of secondary bifurcating branches). One can further show that there exist two groupsof qualitatively different one displaying the same features as the time-periodic solutionsin solutions, as in one dimension Section shown and a second Fig.8.13, (cf. 7.13), groupof whenever the valueof the bifurcation solutions rotating appearing parameter B is sufficiently supercritical. describessome successive conFigure 8.14 of the in the course of one of isoconcentration curves configurations period the for one of the two solutions. W hich of the two types phenomenon rotating ofsolutiondominates depends on the initial conditions. one shows Moreover, that the concentrations remain well-defined, and presumablynonoscillatory, at the center. Thus, the reaction front is not a true spiral,which is in agreement with the general theoretical predictions basedon Eq. (8.43).
...,
8.6.SYSTEMS INVOLVING
In systems involving
three or more chemical intermediates some new of possibilities self-organization arise. Firstly, the Hanusse-Tyson-Light theorem no longer requiresa trimolecular step.Secondly, the first bifurcation from the thermodynamic branch can lead to time and space-dependent stablepatterns, even for zero-flux boundary conditions. On the other hand, the difficulty in analyzing such systemsincreases considerably, already at the m ethods and levelof linear stability analysis. (Clarke, Graphical topological in this to be useful context. 1974) might prove of three intermediates The situation remains relatively tractable in the case
8.6.
193
- To2+ So-
=0
(8.45)
and 8 is the sum where T and A have the same interpretation as in Eq. F.21) of principal minors of rank two of the coefficientmatrix of the linearized equations.Dependingon the signsof these three parametersone can have singular points behaving like saddlepoints, stable or unstable nodes,and stable or unstable foci. The latter is the most favorable situation for the of limit cycles.Regarding symmetry-breaking transitions leading existence to steady states, it has been theorized (Hanusse,1973) that for a system involving three intermediates undergoing uni- and bimolecular steps to exhibit a symmetry-breakingtransition, it is necessary that at least oneof the minors of rank 2 be Another negative. principal interesting result specificto is that the diagonal terms of the matrix of uni- and bimolecular processes linearized equations can only be negative or zero. The occurrence of various forms of self-organization has been demon1973): numerically on the model (Hanusse,
demonstrated
+Z +Z
4
<
'
ft-4
+B
(8.46)
with/c,-
Let us now lookmore closely on the nature of the first bifurcating solution in a system of three variables. for zero-fluxor periodicboundary conditions As in the case of two variables,the bifurcation 1976b). (Auchmuty and Nicolis, of a steady-state solution occurs a when the bifurcation parameter X crosses to the equality critical value kc corresponding
A(AC)
=0
(8.47)
is the eigenvalue of the Laplaceoperator,then Eq.(8.47) is a cubic equation for kf. Therefore, it generallygives a nontrivial spacedependence to a k\\ # 0, in much the same way as in the analysis of Section corresponding If
\342\200\224kf
7.4.
194
Phenomena
roots:
\302\261iy
and equating real and imaginary parts, Inserting cou2 and W3 into Eq.(8.45) we find:
(8.49)
Moreover,
ll/c9
= A(lc,/c9
(8.50)
The point is that this equation is cubic for k'.As a result, at Xc the corcorresponding value k\\ need not be the lowest eigenvalue of the Laplacian, that is, zero for no-flux or for periodicconditions, but may correspondto of the one of the other eigenvalues.This is reflected by a spacedependence solution whose symmetry properties can now belessthan thoseof the spatial domain.In particular, a rotating solutioncan now appearas a first bifurcating solution, a property that would automatically guarantee its stability. One may comparethe Xc computed from Eq. (8.50) and the critical value to the onset of oscillations i n the of diffusion: absence corresponding
X\302\260
T(X\302\260,
Q)d(X\302\260,
0) =
A(lc\302\260,
0)
(8.51)
neither S nor A are monotonic functions of kt, this relation can well correspondto a value of that is higher than Xc. Thus, a system which is conditionscan exhibit time-periodic nonoscillatory under homogeneous in the solution of diffusion. (and space-dependent) presence Even for systems with two chemical variables, one might still have these results when thermal or electrical effects introduce a third (nonchemical) variable.Forinstance,for the thermal effectsone must supplement the second with the conduction term, XV2 T.The resulting equation would have Eq.(8.23) the same character as the mass-balance equations,to which it would be the term and concentration of the heat-source coupledthrough dependence the temperature dependence of the rate constants. Further examplesof systemsinvolving several variables are given in reaction and in Chapter 14 Chapter 13on the Belousov-Zhabotinski devoted to enzyme-catalyzedreactions.
As
X\302\260
8.7.
Coupled Oscillators
195
8.7. COUPLEDOSCILLATORS
wementioned that a number of self-organizationphenomena In Section 7.13, notably the formation of spatiotemporal dissipative structures\342\200\224can be viewed as the result of coupling between nonlinear oscillators. Under certain conditionsthis coupling, which is due to diffusion, can synchronize the various oscillatorsand maintain fixed phase relations between them, even if the intrinsic periodsof the individual oscillators are different. Populationsof coupledbiochemical oscillatorshave often been used to
\342\200\224most
model physiological rhythms (Winfree, 1967, Pavlidis, 1973), 1975; spatiocell division, contact temporal control of various developmental processes, and other phenomena in living organisms. inhibition, (We discusssome of these phenomena in detail in Part IV). The purposeof the presentsectionis to one provide a brief introductory reviewon the subject.Generally speaking, can distinguish betweenthree broadly different types of coupling:
\342\200\242
\342\200\242
\342\200\242
other passive forms of exchange of diffusion or through matter. Chemical coupling. Couplingbetween individual oscillatorsand an external time-dependent field.
Coupling through
In the first class,in addition to the couplingsdiscussed in Section7.13, one may cite Van der Pol oscillatorscoupled through Fickian diffusion or oscillators coupled via a mass (Polyakova and Romanovski, 1971) The rate of this processis usually taken to of at least one chemical. exchange be of the form D(X2 X{),where X,(i = 1,2) representsthe chemical Landahl variableexchanged betweenone coupleof oscillators (Lefever,1968; A and beautiful and Licko, 1973; Kaufman, Torre,1975; 1975). Tyson experimental setup realizing, by simple means,the couplingbetween two chemical oscillatorsof the Belousov-Zhabotinski type has been reported on the relative values by Marek and Stuchl A975). In each case, depending of the parameters one can have synchronization and the coupling coefficients, by entrainment at the highest frequency or at a multiple of this frequency, irregular synchronization at multiples of the driving frequency,enhancement of the amplitude of the oscillators, or quenching of the o scillatory behavior in someor all of the oscillators. When conditions for synchronization are not fulfilled, one can observe the phenomenon of rhythm splitting where, owing to the interaction, the periodof the slower(driven) oscillator is split into two In some cases, the lifetime of parts by the action of the faster oscillator.
\342\200\224
196
Phenomena
strongly on the initial phasedifferencesbetween oscillatory behavior depends oscillators. In others, synchronization may never be achieved, and a oscillationscan result. Finally, it is regime similar to almost-periodic possiblesometimesto initiate sustainedoscillationsin systems for which are dampedor inexistent when uncoupled. oscillations described above as \"chemical\" In the secondclassof couplings, couplings, between two identical oscillators, one may quote the coupling in \"series\" where the initial productof the chemicalmechanism involved in the second One finds, oscillatoris a decay product of the first oscillator(Tyson, 1973). of as the well as that of again, possibility synchronization, almost-periodic solutionsand subharmonic resonance. Another situation, (Pavlidis, 1971) is that of a coupling through a common pool for one of the substances involved. For instance, in a population of cellsone of the productsof the reactionsinside each cell many be returned to the interstitial fluid. The amounts returned from eachcellare mixed,and their aggregateconcentration can affectthe various cells. This modelexhibits both entrainment and rhythm Richie and Woomack A966) report a study of Rayleigh slitting. Finally, via oscillators a coupled linearly dependentterm. A general classof couplings has been analyzed by between two oscillators Ruelle A973). He finds that oscillations with the periodsmTi and nT2 can where m and n arise(Ti, T2 being the intrinsic periodsof the two oscillators), are small integers such that n/m ^ TJT2. A particularly important question, in view of its physiologicalimplications concerns the order of magnitude of the overall period comparedto the individual periods.The answer dependsmost certainly on the intensity of the coupling.It is possiblethat for varying coupling parameters one can have both a decrease of the period through entrainment (as mentioned earlier in this section)or an increase of the period if the coupling is can alsoplay somerole. \"small\" enough. Moreover, the number of oscillators diffusion simulations of trimolecular oscillators through Computer coupled no work these but c onfirm analytic (Herschkowitz-Kaufman, 1973) points, has beenreportedthus far. The final point concernsthe influenceof external fields on a population A systematic analytic and numerical study of the of nonlinear oscillators. external field has been in a periodic behavior ofa singleVan der Pol oscillator on the and Protonotarios G alanos, Depending Nicolis, A973). reportedby and intrinsic field and between of the on the difference driving intensity (a)frequency periods,a number of interestingphenomena are found such as: entrainment, (b) phase locking,(c) a bounded phase difference between oscillatorand driving field, (d) an oscillation with a free-running phase difference,or (e)quenching of the oscillatory behavior. A different approachinvolvesstudy ofa population of otherwiseuncoupled
8.8- Heterogeneous
197
by a It is found that, under certain single external frequency (Kreifeldt, 1970). the distribution of entrained frequencieshas a high central peak conditions, the around driving frequency and a dip on either side.This result may have some implications on the interpretation of electroencephalographic data, Hz. particularly of that part of the spectrum around 10 A most remarkable feature ofnonlinear oscillators is the way in which they external in with stimuli the form of pulses(Pavlidis, 1973; Winfree, couple on the time, r0, the stimulus is administrated and on its 1975). Depending D, the oscillatorrespondsby resetting its phase (e.g., strength, by attaining its maximum) with a variable delay 6 = 9(t0, D).Fora critical combination 9 becomes indeterminate. (t*, D*), the oscillation is almost switched This singularity is reflected by the fact that the rhythm's amplitude after perturbation is strongly affectedand subsequently can be restarted,but with an arbitrary phase.An analytic treatment of this fascinatingphenomenon is still lacking, but numerical analyses of simplemodelshave now reproduced in the phase singularity originally postulated by Winfree A970, 1975) connection with biological rhythms.
off\342\200\224
8.8.HETEROGENEOUS CATALYSIS
rium
AND
TRANSITIONS LOCALIZED
coefficients, F, the reaction rates in the bulk, and the reaction rates that are taken to be well localized at the sites{rx}(which may lie,e.g., on a catalytic surface). The mass-balance equations take the following form (Ortoleva
Gj\302\260\302\260
interest, nonequilibbiological reactionsare localized in a particular region within a bulk medium that itself is undergoing reactions Let D, be the diffusion and transport processes.
and
Ross,1972):
+ D, V2Pi +
-n I G?\\{pj})S{r
(g
52)
Let {p*(r)} be the steady state of the reaction system in the bulk the boundary conditions:
satisfying
+ D,.V2pf = 0 F,{{pf})
(8.53)
If the medium between localized sites contains no essentialnonlinearity, then this state will be asymptotically stable.In order to study the effectof
198
the
matrix
Phenomena
this
A first
is:
= pf + nt
y2ni
with
ir = I Lunj + Di
\342\200\224
+ TG^({pJ}K(r -r\")
<8-54)
This set of equations is supplemented by the following physicallyreasonable conditions.Firstly, in an infinite medium we want nt reducedto a spaceas \\r ra\\ -> oo, if pf itself is space-independent in independent expression this limit. Secondly, over an infinitesimal region about integrating Eq.(8.54) each site ra we find (sincethe concentration must remain bounded):
G\302\253({p?})
=0
(8.55)
flux
points.
with
constitute a set of inhomogeneous differential equations Equation (8.54) It can betransformed coefficientsLi}that are generallyspace-dependent. to an equivalent integral equation by introducing the matrix propagator T(r, r', t) (the Green's function), which satisfiesthe relations:
= lt + d v2r 4dt
T(r, r', t where / is the
unit
= 0) = Id(r r')
coefficients.One
matrix
obtains:
nir', t) = p?(r*) +
11 f dtT,y,
r^ t
- f')Gj[{ptV, f')}]
(8.56)
can be studied, and in of Eq.(8.56) The steady state or the oscillatory solutions structures solutionsas in the case of one general dissipative expectsmultiple in bulk media studiedin previous sections. Let us illustrate more specifically state pj(r) = pj. the situation for the case of a homogeneous zero-order Then, the be can inverted eigenvectors, um, Eq. (8.54) directly by introducing
8.8- Heterogeneous
199
of the operator L + DV2.Forsteady-state solutions and a single catalytic site at r\" = 0 in a one-dimensional medium, one has:
\302\273.\342\226\240
=Z
m
<m)wmexp(-/cm|x|)
with
det|L+
D
fc\302\243D|
1Lum
=0 = -Kum
The expansion coefficientscj^ and the spectrum of km are found by solving into Eqs. the linear algebraicequationsarising by substituting Eq. (8.57) has a solution, one Assuming the eigenvalueproblem(8.57) (8.54)and (8.55). can formally write the solution of the rate equations in terms of Fourier transforms as:
\302\273<(*)
=T
zn j
I j_ \\dk
pj
eikxlL
- k2D\\
G/{pf})
(8.58)
to investigate the nature of these solutions,assuming that the (homogeneous) steady state of the bulk is stable.Now, this impliesthat the eigenvalues,zm of the matrix L have negative real parts. As a result, if a spatial structure is to appear,it will bedue specificallyto the diffusion terms.
We want
> 0,
Imkm
#0
(8.59)
Re zm
Observations of spatial patterns in chemical systemsmay well correspond to either dissipative structures or to local, structures.The latter undulatory may emanate from glass surfaces, dust particles,or other heterogeneities
exist in experimental situations, in a manner similar to nucleation in phase transitions. A careful analysis, involving the size depenor other qualitative propertiesof the pattern can show whether a symmetry-breaking transition or a simpledamped spatial oscillation has taken place.
that
< 0.
equilibrium
dependence
200
Phenomena
8.9.SYSTEMS INVOLVING
STEPS PHOTOCHEMICAL
of interesting The illumination of chemical systemsprovides the possibility feedback mechanisms and hence a great variety of phenomena.* Consider reaction (Nitzan and Ross,1973; and first the simple Nitzan, Ortoleva, Ross,
1974):
A
hv
> <
A*
<\342\226\240
+ heat
assumethe molecule A to be of sufficient complexity such that after the absorptionof a photon, it undergoesa rapid radiationlesstransition to a This vibrationally excitedstate, A*, followed by rapid thermal deexcitation. results in a net heating of the reacting mixture proportionalto the conconcentration of A. Consider now a reacting mixture (A, B) in a closed vessel(at chemical equilibrium) where a steady illumination is imposed.A new nonequilibrium state is achievedafter sometime, which will satisfy the equations:
We
A
A
\342\200\224
d^
external temperature, and AH is related to the enthalpy change arising from reaction A B. These equations are coupled nonlinearly becauseof the Forendoof the rate coefficients[seeEq. (8.22)]. temperature dependence thermic reactions one finds a singlesteady state that is stable.No limit cycle behavior is observedfor the system. Forexothermic reactionsone finds the of three of which two are stableand one is unstable, steady states, possibility as in the modelsdiscussed in Section 8.4. Couplingwith transport (diffusion and heat conduction)allowsfor the formation of spatialdissipativestructures. The very interesting feature of these phenomena is that they may arise in closed This has potential implicasystems,as only an energyflux is required. in the theory of evolution of prebioticpolymers. Photochemical reactionsalso play a very important role in atmospheric phenomena at and above the stratospheric level. For a pure oxygen atmospherethese reactions are parts of the so-calledChapman sequence the oxygen photodissociation: (Nicolet, 1964). They comprise
implication
O2 +
\342\200\242
hv
-^-\302\273
2OFujita and
(8.61)
Baba A976).
For a recent
experimental
observation,
seeYamazaki,
8.9.
201
O- + O2
O3 + M + 24 kcal
(8.62) (8.63)
(8.64) introduces
O-+ O2 + M O-+ O3
kAT)
>
2O2 + 94 kcal
The rate of the latter reactionsdependson temperature, and this an interesting feedbackbetween thermal and chemicalvariables. Additional feedbacksarise from solar heating and infrared cooling, which affect the temperature and at the same time depend strongly on the chemical
composition. In practice, a pure oxygen atmosphere operating as a closed system is not a soundassumption. On the one side,the extremelyreactiveforms O and O3 combine with other gaseouscomponentsof the atmosphereor with the lithosphere.And on the other side, oxygen is produced by plant photoThis coupling betweenatmosphere, and lithosphere was biosphere, photosynthesis. a nd Kress Sanglier, A976)in the context recentlyanalyzed by Kozak,Nicolis, of the evolution of the earth's atmosphere. the following simple Assuming
\342\200\242
O-and O3 con(8.65)
\342\200\224*\342\200\224
O2
O-+(reactants)
O3 + (reactants)
\342\200\224^\342\200\224>
(products) (products)
3\342\200\224>
c\342\200\224
- J2X + J3Z - k2(T)MXY+ 2k3(T)YZ - k3(T)YZ -f- = 2J2X + J3Z - k2(T)MXY - k3{T)YZ- d3Z = -J3Z+ k2{T)XYM dT = - T) + AH2k2{T)MXY + AH3k3(T)YZ+ (radiativeterms)
dt
d^Y
dZ
\342\200\224
tx{T0
(8.66)
202
Phenomena
Z = [O3], c is the specificheat of the fluid, a. is Here X = [O2], Y = [O], Newton'sthermal coefficient,To is the surface temperature, and AH, are the and (8.64). heats of reactions(8.63) have been studied both analytically and by computer Equations (8.66) simulation. Experimental values have beenusedfor J2,J3,k2(T), k3(T),To, Initial and c,whereas v, du d3 and a have beentreated as variable parameters. conditionssimulating those prevailing in an early biotic atmospherewere used. It has been found that the O2 concentration tends to a steady-state level after exhibiting a pronouncedovershoot to a value exceeding apprethe steady-state one.The time scaleof evolution is very slow,of the order of thousands of years. This behavior can be comparedto one of the premisesof the Berkner-Marshalltheory of atmosphericevolution and Marshall,1964; the occurrence which postulates Broda,1975), (Berkner of two \"quantum jumps\" in the O2 level corresponding, respectively,to be of the Period and of the Cambrian Devonian Period,which saw beginning the development of the first forests. The development of such modelsof the atmosphereshouldalso be of
appreciably
interest
large-scale phenomena in contemporary To this end a more refined treatment is necessary, atmosphericdynamics. influenceof diffusion and of convection. both the molecular incorporating Perturbations of the earth's atmosphere\342\200\224that is, the pollution problemcouldalsobe studiedfrom the same standpoint.
in
the understanding of
Methods
of Analysis of Reaction-Diffusion
Equations
203
mitosis one is confronted with phenomena involving two time or space slow one associationwith the bulk phenomenon and a fast one bulk phenomena.In terms of the differential separating two successive the system, this situation is characteristic of the highly equations describing supercriticalregion beyond the point of the first bifurcation. New methods are obviously neededin order to tackle these situations. They are usually with respectto an appropriateparameter; basedon asymptotic expansions hence, they are referredto as asymptotic methods. A different type of problemariseswhen the number of chemicalvariables presentcannot be reduceddrastically to, say, within one to three.In this caseit becomes increasinglydifficult and awkward to rely entirely on analytic (and especiallyon perturbative) methods. Combinatorial or topological be of help, and later we comment briefly on some methods can sometimes on thesemethods. based recent approaches
scales\342\200\224a
Asymptotic
on the simple behavior of nonlinear oscillators supercritical of the model and trimolecular Herschkowitz(Lavenda, Nicolis, example Consider the rate equations Kaufman, 1971; Turner, 1974;Boa, 1974). i n the absence of diffusion. According to Section7.4,the condition G.13) for the formation of a homogeneous Conlimit cycle is B > Bo = A2 + the is in the limit behavior to be found Consequently, strongly supercritical
We illustrate the
1.
A It
-> co,
= finite fiit
(8.67)
=X +
~dt~ +
dZ
\342\200\224
Z == f(Y, Z) I)
(8.68a)
The salient point to observe of the smallness is that, because in these equations of \\/B,dY/dt will be very large [formally (dY/dt) oo as B oo]everywhere except on the curve
-\302\273 -\302\273
g(Y,Z)= 0
(8.68b)
204
Phenomena
Similarly, the
1 f(Y,Z)
will be practically horizontal everywhere in the (Z, Y) plane exceptin the curve (8.68b). Figure 8.15 representsthe curve g = 0 in the phasespaceof the original variables (X, Y). From Eq. (8.68a) it may be seenthat this curve consistsof
two
^0
(path
D'E)
and
XY =* B (path
G'H'E)
(8.68c)
The corrected phase-space trajectory for finite values of B which is also in the same be can found as follows.We first observe that as the plotted figure,
xg
(B+
Figure relaxation
44
1JY
-\302\273
8.15. Motion in X- Y plane for limit-cycle solution of trimolecular model in regime of oscillations. Dotted lines represent asymptotic curve (g(X, Y) = 0)corresponding to x.Corrected phase trajectory for finite values of B is represented by full lines.
Methods
of Analysis of Reaction-Diffusion
Equations
205
to be system is traveling along part DE of the limit cycle, which is expected X ~ 0(B~J), near the line DE'[see and dX/dt almost vanishes: Eq. (8.68c)],
(A
\302\243
= fl + i,f = 0A))
(8.69)
Introducing the variable in the trajectory equation and seeking for asymptotic solutionsof this equation as X -* oo givesan analytic representaof the trajectory along DE, which breaks down for I, = 2, that is, for = 7 X2/4A. Presumably, what happensis that in the regime along EF, Y and ceases to be of 0A). reachesits maximum value, X beginsto increase, the natural variables are to of the In order study this part motion,
representation
\302\243
X
By solving the
= 2A
\342\200\224{\\+u),
X2
\342\200\224(\\+p)
(8.70a)
X2
\342\200\224
4A
CA113 +
o(l)
\342\200\224
(8.70b)
where is the first positive zero of the Airy function Ai( z). This path is close to the The next stage of evolution is along the path FG.
\302\243
line X
+ y = const =
ymax
(8.71)
set:
of 0(A2), while
X=y+ ?a*y*
It turns
(8J2)
out
that this
point
form
H on the trajectory. A partial resummation yields a solution of the [cf. secondEq. (8.68c)]:
= B1'2, to corresponding
X-f-j^...
,,73,
206
which
Phenomena
Thereafter, the representative point of the system travels along path HD, is close to the line X + Y = const = 2B1/2 (8.74)
curve dX/dt = 0 is crossed again and the cycle is completed. the period of the oscillations In analogy to the solution just described, = TEF,and(c)T3= TGH, can alsobe split into three parts: (a) 7; = TDE,(b)T2 as it is easy to seethat when B -> oo,the jumpsfrom F to G and from H to D
until
occurinstantaneously.
\342\226\240o
(A
_ye~ - \\)X-X2Y~
dY
A
YD
and
_ ~
Cx\"
\342\200\224
dX d_
XX
(8.75)
YF, YE,
and the values of Thus, taking into account Eq. (8.70) find for the periodof the limit cycle the expression:
and
YD,
we
_
A
A2
j_
_2A^
deeper analysis would be requiredto ascertain the exact value of the contribution of o(l). An important new phenomenon that may arisein the supercritical region of time-periodicsolutions is that of secondarybifurcation, analyzed in Section7.9for the steady-state solutions.To extend this analysis to timeperiodicsolutions,it is necessaryto investigate the stability propertiesof thesesolutions. Such a theory is available for ordinary differential equations and is due to Floquet (Minorski, An extensionof this theory to partial1962). differential equations has beenobtained by Sattinger and Joseph(Joseph, 1972)in the context of fluid-dynamic stability problems. By applying these techniques one finds that the limit cycle for the trimolecular model cannot undergo a secondary bifurcation,neither in the spatially homogeneous nor in the presenceof diffusion (Erneux case(Lefever and Nicolis,1971) and Herschkowitz-Kaufman,1976).
Methods
of Analysis of Reaction-Diffusion
Equations
207
/=0 f<0
Assumed shape of level curve f(X, Y) Figure h0 and h, correspond to stable solutions.
8.16.
= 0.Branch
= h2(X) is unstable,
whereas
Considera finite reactor with two variable reactants, whose diffusion coeffiare very different.Moreover, assumethat the chemical kinetics Dl,D2 and scaling definesa bistableprocess, as in Section8.4. Setting e2 = (/>1/D2) the spaceand time variables by the diffusion coefficientD2 we can write the rate equations(Fife, 1976; seealso Ortoleva and Ross,1975):
~
8Y
\342\200\224
= f(X, Y)
(8.77)
-V2Y = g{X, Y)
with
c <^ Owing to the bistablecharacter of the kinetics,one of the level curves = 0 or g = 0 has a sigmoidal shape.Supposing this to be the case for the curve f(X, Y) = 0, we obtain the form shown in Figure 8.16. A simple model giving this type of bistablebehavior
1.
is:
+Y
X
\342\200\224
\342\200\224>
X Y
\342\200\224*
+Y +B
3X D + 2X
with
\342\200\224\302\273
\342\200\224*
C 3X + E
(8.78a)
D, <g D2(Di = Dx, D2 = DY). We want to describethe time evolution of the system under the following boundary and initial conditions:
X(r, 0) = Y(t, 0) = <ftr)
</\302\273(r)
n-VX = ai(X0
X),
(8.78b)
208
Phenomena
where n is the normal to the boundary surfaceand are smooth functions of space. of e, the evolution can be decomposed into Owing to the smallness
the following two
STAGE
stages.
OF LARGE GRADIENTS
DEVELOPMENT
We
^
dt
2Y
'
(879)
We first
= Y(r) = tfr(r)
We lookat the trajectories in the {X, Y) space(Fig. for a fixed r.As Y is 8.17) time independent, these trajectoriesare obviously horizontal. Imagine now a line segment (a') within the spatial domain. This line has an \"image\" moreover that steady statesalong (Y, X) on the initial phaseplane.Suppose the curve = 0 have different stability properties,as in the example of Section In particular, let the states on the part of = 0 having a negative slopebe unstable and all others be stable.Owing to these different stability moves propertiesof the stateson the levelcurve = 0, each segment of {a') in a different fashion in the trajectory space (X, Y). Thus, the part of (a') above the horizontal line Y, is attracted to the segment MN of the curve
8.4.
Figure
different
8.17.Evolution
(a') in
reaction
spacetoward
Methods
of Analysis of
Reaction\342\200\224Diffusion
Equations
209
As branch HPKis f = 0, whereas the part below Y3 tends to the segmentOF. unstable, the part between Yl and Y2 tendsto GH,and that between Y2 and y3 tends to KL. an asymptotic If this simplified model were to remain valid as t -* state would be reachedwhereby X would suffer a seriesof discontinuities along ML, KH,and GF. However, the gradient V Y would remain bounded. within the domain V we would have surfacesof discontinuity, Alternatively, F, separating two different states. The situation is describedon Fig. 8.18, where the line (a')is also drawn. It is reminescent of Thorn's catastrophe theory (see Section6.4),although the type of equation dealt with in this in Thorn's theory. Some section is different from thoseencountered analogies with first-order phasetransitions shouldalsobe pointedout. Obviously, the picture we just drew is valid until
x,
(8.80)
Theseextremely high gradients act acrossthe surfaces F,. generally Y is time dependent, the trajectoriesin the phase plane will no longer be horizontal. They may go to infinity, to negativevalues, or become this does not apply.Still, periodic,although for the particular model(8.78) the general picture of the evolution describedabove remains valid and the final result is the development of large gradients acrossFf.
If\342\200\224as
happens\342\200\224
STAGE As | \\X
2:SLOWMIGRATION
OF THE CARRIERS
carrier begins the corresponding | beginsto build to the value (8.80), to migrate. Supposethat the discontinuity at F leadsfrom Xo to Xx. One
8.18.
F,.
270
can then do a standard match asymptotic analysis (Fife, 1972), whereby a stretchedvariable n alongthe normal x to F is defined (see Fig.8.18):
(8.81)
write the equation for X
that
^-^
X -* Xx
= /(*>\302\253
(8.82)
This providesus with a single nonlinear diffusion equation describing the are: evolution of the front surface.The boundary conditions
x^Xo
_oo as,-. -*
as n + oo
This equation admits solutionsof the form shown on Fig.8.19 a describing smooth transition between the two states. However, the front surface, in general, moves with time:
X(ri, t)
= U(n
- ct)
(8.84)
Thesesolutionsmay or may not be unique. Note that in the initial variables the velocity would be ec. Its value dependson spacethrough Y = Y(r). Onecan show that if the rate function/changes sign only oncein the course
of the transition, then the velocityof propagation c and the form of the wave are unique and stable.Moreover, if the transition takesplacebetween GH and MN),then c could be zero. two attractive branchesof/ (e.g., Oncethe surface F beginsto migrate it can either go up to the boundary of the reaction spaceand merge into a boundary layer, collide with another surfaceand annihilate, or someof its parts can approachto somestationary The velocityc on each point of Fo is zero. It can be shown configurations Fo. that the that this two states (Fife, 1976) implies Xo, X^ are \"equally
front
\302\243
Figure
8.19. Solutions
of nonlinear
evolution
diffusion
equation surface.
(8.82)describing
of front
Methods
of Analysis of Reaction-Diffusion
Equations
211
that is, that a Maxwell rule familiar from first-order phase transitions is verified (see Fig.8.17):
1
formation
GHPKL
fdX = 0
(8.85)
The configuration Fo can be found directly by requiring specialtypes of Fortwo or more variables, explicit stability criteria solution of Eq. (8.82). Note that the formahave been obtained for systemsin onespacedimension. of Fo is a typically far-from-equilibrium phenomenon, although no with respectto diffusion needsto be involved, as in the formation instability of a dissipative structure. Combinatorialand TopologicalMethods Chemical
the context of biologicalcontrol bear strong similarities to discrete networks (Sugita, 1963; Glass and Kauffman, Kauffman, 1969, switching The reason Thomas and Van Ham, 1974; 1973; Thomas, 1973, Glass,1975). is that the rates of synthesis of enzymes, fE, depend usually on the conconcentration of various effectors, X, in a highly nonlinear fashion (seealso
networks\342\200\224especially
within
level\342\200\224often
Chapter 15):
h=
^^
XX\"
(8-86)
where X is a production constant, 6 is a \"threshold,\" and n is a parameter Forn 2, Eq. (8.86) measuring the cooperativity of the process. represents a sigmoidal function of X. For some purposesit can be substituted by a variable X, such that: Boolean function B = B(X) of a discontinuous
>
B=l
b =o
ifl-9
xx<e
(887) (8-87)
dX at
(8.88)
As
For n variables there are 2\" Boolean\"state vectors\" (X = Xn). a Boolean a value of 1 or 0 to each of thesevectors,there function assigns is a choiceof 22\"\"' values for the componentsB, of the \"rate vector\"
Xu...,
B=(B1,...,flI1)inEq. (8.88).
212
for
Phenomena
Graphical,stochastic,and other types of analysis have been developed Phenomena qualitatively similar to thosedescribed Eq. (8.88). studying in previous sectionshave been found, such as multiple steady states and sustained oscillations. However,theseresults give no detailedinformation on and practically no information on the quantithe stability of the solutions, aspectsof evolution, such as relaxation times or periodsof oscillation. Morework is neededto elucidate the relation betweendiscrete(i.e., Boolean) to exceptthat the dynamics and continuous formalism.It appearsresonable be better represented of isolatedcellscan in somecases by a discontinuous as far as geneticregulatory processes formalism, especially involving a limited In contrast, the collective number of effector moleculesare concerned. behavior of large assemblies of cellsis to bedescribed by the usual continuous formalism of chemical kineticsusedthroughout this monograph.
quantitative
8.11. THERMODYNAMIC
The phenomenon of bifurcation accompanyingthe transition to a dissipative structure is analyzed in Chapter4 in respectto irreversiblethermodynamics. It is shown that the instability of a steady-state solution on the thermothe branch dynamic implies appearanceof a negative excess entropy proproduction around the referencestate.The vanishing of this quantity determines the \"thermodynamic threshold\" separating the unstable regime from the stableone. Theseresults have been extendedrecently to the analysis of the propertiesof time-dependent statesas well (Nazarea and Nicolis, stability
that a structure has we set thermobeen would like to find a of formed, dissipative propertiescharacterizing this structure as uniquely as possible. are indicativeof the Alternatively, we seeka state function whoseproperties itself. of the structure dissipative properties A general solution to this important problemis not yet available. Instead, we considerin this sectionthe \"inverse\" question,namely, given a certain state function such as entropy or entropy production,how this function behaves on a dissipative structure. We considerthis question successively for spatial structures, uniform systems, and systems involving multiple time
1975;deSobrino, 1975).
In
this
thermodynamic
scales.
Entropy
and
Entropy
Production on a SpatialDissipativeStructure
We begin by deriving an expressionfor the total entropy production difference, AP, between an arbitrary state and the reference state on the
8.11. Thermodynamic
Aspects
of Dissipative
Structures
213
fdVZ(JkXk-J\302\260X\302\260k)
k
= UvY.xksjk+(
As
(8.89a)
seen in Chapter 4, the last term vanishes if we assumethat for each the initial and final products of the constituent\342\200\224including concentration is kept fixed at the boundaries or the flux acrossthe boundary surface is vanishing. Thus, we obtain:
reactions\342\200\224the
1J
(8.89b)
Hi
where /i, is the chemicalpotential of species i given by the expression adopted this monograph [see throughout Eq. C.10)]:
= n? + kT log Pi
In the secondterm we perform a partial integration. The surface term is, in in terms general, nonvanishing, and the remaining terms can be expressed balanceequationsD.2). of the excess Finally
--
1 f
dL n X Hi Si,
\342\200\242
f kT
\302\243
log Pi
-f1
(8.90)
Considernow the case in which a steady-state dissipative space-dependent structure has been formed. By definition, <5p, = p{ pf is time independent inside the system, both for the variable intermediates and for the initial is: and the final products.Thus, the only surviving term in Eq. (8.90)
\342\200\224
(APH=
-I
f dY. n X 1 Jz i
\342\200\242
Hi
Sh
(8.91)
where the subscript o indicatesthat AP is evaluated for a steady-state structure formed around the thermodynamic branch. It is instructive to
214
evaluate this expression for the one-dimensional modelsanalyzed in Chapter 7.One has, for a reaction line of length /: T(APH =
X
i
j\"i(Q\302\2535/i@
+
i
j = -D-8^
and
Thus
(8.92)
We see that the entropy-production differenceis entirely determined by the differences of the slopes of the concentration profiles between the two Forzero-fluxboundary conditions theseslopesvanish.Similarly, boundaries. in the case of localized dissipative structures onehas pt(l) = p-0)(/); p,@) = = = 0. t he and thus In both cases, entropy-production piO)@), <5j,@) <5/,(/) difference vanishes (Herschkowitz-Kaufman, 1973). In contrast, for fixed the slopesof conditions and for delocalized structures boundary dissipative the concentrations at the boundaries are generally different (see Section7.6).
In
this
case:
(APH
#0
(8.93)
The valueand the sign of this differencedepends on the detailsof the chemical kinetics.Under certain conditionson A and B it has been shown that in the trimolecular model AP can be a positive decreasingfunction of the wavelength of the structure (Auchmuty and Nicolis,1975). Forthe entropy differencewe have, from Eq. C.5)(seealso Schlogl,1974; Ishidaand Matsumoto, 1975):
AS
= =
=
>
t \\
\342\200\224
... v/ ,
*\342\226\240
idV J | J
\302\243
L,. dpt
c nf opj +
. \\ kT log p: dpt J
._,(\342\200\242,
8.11Thermodynamic
AS
Aspects
of Dissipative
Structures
215
state:
(8.94)
jdV X Pi log
^AS
p? jdV 6p{\\og
\302\243
+
\302\2430
Considernow the entropy difference AS on a time-independent spatial dissipative structure. Becauseof the convexity property of entropy as a we have: function of the concentrations,
(8.95)
where
~p~y
is the
^\\dV Pi(r)
In some cases p~y can be related to the values of concentrations on the thermodynamic branch. In the trimolecular model, for fixed boundary conditions and for an even value of the critical wave number (seeSections that 7.6and 7.8), onehas from Eq. G.56)
Xv
Yv
= Xo + 0[(fl = Yo + 0[(fl
\342\200\224
- flc)]
BC)]
\"
'
On the other hand, becauseof the nonlinear dependence on pt, AS contains the effectof the terms of order (B BcI12 the dominant contridetermining to X and Y. In the vicinity of the transition to the dissipativestructure
contribution
this
yields:
S < S(X0,y0) = So
(8.97)
This result reflects the idea that symmetry breaking engendersorder, and thereforediminishes the entropy of the system. Maintained Uniform Systems
A in
Space
spatially uniform system can undergo dissipative instabilities leading to the In the secondcase, multiple steady states or to chemical oscillations. instantaneous-value of AP has no specialsignificance,but oneexpectsthat the average APT over a periodof the oscillationhas a macroscopic meaning. From Eq. (8.91) one sees that the contributions coming from the volume integral vanish, as (dSpi/dt)T vanishes by definition of a periodictrajectory. Similarly, the volume integral does not contribute in a transition between
216
conclude that
multiple steady
(APH
-(8.98)
or
(APf
=-1f^n-X^I7
In general, these quantities are nonvanishing, even though in a homosystem onewould tend at first sight to cancel all terms related to fluxes.In reality, an openuniform systemis alwayssubjectto such fluxes from the outside world, with the additional requirement that onceinside the system,the different constituents must be distributed almost instantaneously in a uniform fashion. This can be achieved either by extremely high values of the diffusion coefficientsof the initial and final productsor by adequate stirring. As an example, considerthe trimolecular modelin the homogeneous limit and suppose that A,B are such that the systemperforms sustained oscillations. We assume that the system is bound by walls that are impermeable to X and Y but permit diffusion of A and B from the outsideworld.Onceinsidethe A and B and for this attain instantaneously uniform compositions, system -* to bethe case we assume oo. first the distribution Consider DA ooand\302\243>B->
homogeneous
vi dt
with
<r < 1
(8.99a)
A((
A(\\)
= An
(8.99b)
and the
diffusion
(899c)
In the
limit DA
equal to
y,
JaQ)
=~~
(8-lOOa)
8.U. Thermodynamk
Moreover, the
Aspects
of Dissipative
in
Structures
217
diffusion
term
DA
lim
DA^oc
~ = =^=
drz
Ao dt
(8.100b)
reads:
*A=-A+*iAdt dt
oo:
(8.101a)
dl
dt
BX +
d^
dt
(8.101b)
periodof
Coming now to the entropy-production difference,APT, over a the oscillation, we obtain: T APT
/iB(l) SjB(l)
A0)(djJQ^
djA(l)T) SjB(\\)T)
(8.102)
the flux of A at each boundary is constant and equal Accordingto Eq.(8.100a) to Thus, ^(O) = SjA(\\) = 0.However, the situation for B is slightly different. From Eq. (8.101b) we obtain, at the steady state for B:
\302\261A0/2.
~=
dt
BXT
(8.103)
model,that* XT =
Now one can easily see from the rate equationsfor the Xo = A. It sufficesto add the equations for X and Y: d(X
+
dt
~j
Y)
=A
= BA = const
and
* Note
Yo
218
We
Phenomena
=0
(8.104)
The above derivation showsclearly that this result can be extendedto all are the sameat the systems where the average fluxes of the input chemicals referencestate and along the new trajectory. In the case of transition between and the entropy production multiple steady states this is not generally so, one cannot deduceany general trends varies, although from relation (8.98) accompanying this variation (we discussthis point in the next subsection). Considerthe behavior of the entropy differenceAS. From the convexity we have, in the case of limitsubsection, property invoked in the preceding cycle formation:
AST
< AS(fcT})
(8.105)
In general, ptT dependson the detailsof the kinetics; it is not possible hence, to deduce In trends. some one can draw interesting however, cases, any general As an example, conclusions. considerfirst the Lotka-Volterramodel (8.2). Dividing through by X and Y and integrating the rate equations over a periodwe obtain:
= kiA-k2Y
jt\\ogY)T
or
YT
= k2XT-k3B
ZT
-^=
y0,
= -~?= Xo
(8.106) (8.107)
of Thus, the passageto a periodicmotion is accompanied by a decrease this that it erroneous t o conclude from result would be However, entropy. the Lotka-Volterramodel exhibits temporal ordering. Indeed,as we saw in Section to a well-definedtrajectory a physicalstate cannot be assigned 8.2, becauseof the densenetwork of trajectoriesaround the steady-state point. It is curiousto observethat in the trimolecular model,inequality (8.107) is not generally verified.As we pointed out already, XT = Xo for this model, is not equivalent to Eq. (8.107). but YT # y0. As a result, inequality (8.105) Theseresultsshow the inadequacy of entropy and, to someextent, also of
8.11. Thermodynamic
Still,
in
Aspects
of Dissipative
in
Structures
219
the coherent behavior
of the transition to a limit cycle onecan seen in Chapter 7, for zero flux boundary obtain more to the thermoconditions in the trimolecular model,one has corrections branch of the order (B BcI/2. If we integrate over a periodthese corrections vanish, and one obtains a result similar to Eq. (8.96):
the immediate vicinity
characterizing uniquely
sharp results.As
\342\200\224
thermodynamic
y=
X\302\260
y0
+ + o((B bc))
\302\260
(8 108 (8-108
= S0 ST <S(X0,Y0)
(8.109)
Finally, the entropy differenceseemsto obeyno general rules in the case of multiple steady-state transitions, although in some specific examplesa and Walls, 1974). systematic variation has been found (McNeil
of Section8.10. (ii) The initial system undergoesa structural instability (cf. Section 5.4), which qualitatively alter its nature. Examples of this secondtype of instability are discussed in Chapters17and 18. positiveaffinity
that a reaction step becomes fast when, for a given one expects to the production ofa certain intermediate dM corresponding substance A simple M, the rate wM becomes positive and large. inspection of and (8.89b) showsthat, as long as such a fast step is switchedon, Eq. (8.89a) Intuitively,
The correspondingdissipative structure belongs to the highly superof the models analyzed in the first two subsections region,as in the case
220
Phenomena
the entropy production differenceAP is bound to be positive and large.If, after a certain period of time, this step becomesextinguished or attains a rate comparableto the others, one might expect the entropy production AP to again follow the properties outlined in the two previous subsections. considerthe evolution of the entropy production per unit As an example, volume, A<7, of the relaxation oscillation for the trimolecular model (see One has, accordingto path FG in Fig. beginning of Section the condition X + Y = C = constalong FG and the resultsof the Eq.(8.90),
8.10,
8.15).
subsection: preceeding
~ AaF^G = kB
dt
\302\243
IX log X + (C
= ^-l-X log X
oX
- (C -
X)\\og(C
-X)]+-^-5^kBT
X)\\og(C
-^
dt
dt
kB T
\302\243
0 and X starts to evolve Now, C ^ Xmax. Moreover, along FG, dX/dt from a small value of 0(/l)corresponding to the vicinity of point F. Thus, along the first stagesof the fast build up of X, C X, X A, and
>
>
>
A<7f^G>0 (8.111) until X reachesa value of the order of the amplitude of the oscillation, C. Similar conclusions can be drawn from modelsinvolving multiple steady states (Goldbeterand Nicolis, 1972; Nicolis,and Babloyantz, Prigogine, H iernaux and This 1972; Babloyantz, 1976). point is expandedin more detail in Chapter 17devoted to prebioticevolution.
Part III
Stochastic Methods
Chapter 9
GeneralComments
9.1.INTRODUCTION
The analysis outlined in the preceding chaptersis basedon a determinictic causal description, However, provided by the equationsof chemical kinetics. there exist a number of instanceswhere such a description may not be adeThe main reasonis that the very existence of many degrees of freedom adequate. in macroscopic systemsimpliesautomatically the appearance offluctuations. Let N be the number of degrees of freedom. In a typical probleminvolving a On the other hand, system in a not-too-dilute phase,N is of the orderof 1023. the macroscopic descriptionof the same system is based on a restricted number ofvariables {a^ instance,chemicalpotentials an}a.ndn <^ or concentrations, temperature, pressure,and so on. A given macroscopic state is always associatedwith rapid transitions between different atomic states.As a result, the macroscopic variablesare subject to deviationsaround certain \"reference\"values correspondingto the results observed in an devices. Thesedeviations appear to the experiment involving macroscopic the fluctuations. Oncea macobserver as random events and are precisely to definite is produced,the system respondsaccording macroscopic fluctuation phenomenologicallaws. should remain One could expectthat fluctuations, although measurable, this can small comparedto the macroscopic values. In statistical mechanics, be shown explicitlyfor systems in thermodynamic equilibrium, exceptat the points of phasetransitions such as the liquid-vaportransition (Landau and In these cases small fluctuations (in the presence of a critical Lifshitz, 1957). or the case first-order transitions finite fluctuations of point) (in involving nucleation and metastability) are amplified, attain a macroscopic level, and drive the systemto a new phase. to a macroscopic evolution This corresponds of certain involving abrupt changes thermodynamic quantities. Moreover, the initial \"reference\" unstable.In the critical region around phasebecomes the instability the system exhibits a marked coherent behavior, frequently accompanied by long-range fluctuations and the breakingof spatial symsymmetries (Brout, 1965).
...,
N\342\200\224for
223
224
General Comments
essentialto construct a theory of fluctuations around far-from-equilibrium of the macroscopic statesto supplement the predictions description, especially of instabilities.The purposeof the presentchapter and in the neighborhood the precise role of fluctuations in the spontaneous is to assess Chapters10-12 of patterns of the dissipative structure type. We deal exclusively emergence with the internal fluctuations generated by the system itself.The influenceof bifurcation phenomena external noiseon the instabilitiesand the associated and Malek-Mansour has been analyzed recently by Horsthemke A976).
As seenrepeatedly in the previous chapters,nonlinear systems driven far It is, therefore, from equilibrium can alsoundergo transitions and instabilities.
9.2.STOCHASTIC FORMULATION
Let p({rj, Fluctuation theory is a branch of statistical mechanics. {p,}, r) be the N-particle probability distribution function of the system (r,,p, are Oncep is known, the microscopic positionsand momenta of the N particles). Considernow the ensembleof variables state of the system is determined. state of the same system. In general, {a,}determining the macroscopic = The that the system be at a a,{Pj}). probability P({a,}){(/a,} a,-({i;}, state such that all values take and {a,+ da{) is between a, macroscopic {a,} in of the relation: terms given p by
{a,-, a( + da{]
If P
{a\302\260},
'
'
can provide the is expandedaround somereferencestate Eq. (9.1) probability of a fluctuation around this referencestate. Fora system at thermodynamic equilibrium the distribution function p is can serve as the starting point of the theory of fluctuaknown, and Eq. (9.1) Forsystemsaway from equilibrium, however,relation (seeSection9.4). is not very useful in view of the difficulties encountered in determining the (9.1) form of p. Forthis reason,we follow here a method \"intermediate\" between the macroscopic descriptionand the completestatistical mechanical treatThe basicideaof this theory, known as stochastictheory, is to consider that the variation of a, values due to a fluctuation is a random, or stochastic that is, a phenomenon where these values do not depend on the process, independent variable (time) in a well-definedmanner. Thus, an observationof the different members of a representative ensemble of systems yieldsdifferent
fluctuations
treatment.
9.2.
Stochastic Formulation
225
= probability of finding {a} t){da} Pi({a}, within {a}, {a + da}at time t. = probability of finding {a} P2(iai}ti' W2}t2){dai}{da2] within {flj},{a, + da^}at time rt then {a} within {a2}, {a2 + da2}
at with
time
t2
{aji
lP/{fli}r,:---{flj}rJ-)=l P, > 0
U= 1.2,...)
(9.3)
It is often useful to describeprobability distributions by a few \"typical or \"average value\" is by far the values.\" Among these,the \"expectation,\" most important. Its definition followsthe customary notion of an arithmetic
average:
= Y.akPMa},t)
(a!
(9.4)
By construction, <ak> doesnot dependexplicitlyon the fluctuations.In order to analyze the relative importance of the latter in respectto the averages,one introduces expectations of quadratic or higher order combinations of the
stochastic variables:
<aka,yt
= Y.aliaiPiUa},t) (etc.)
la!
(9.5)
to the On expanding ak around the mean <a^> one can switch from Eq. (9.5) variances,namely:
(ah\302\273(a,
<a,\302\273>
(etc.)
(aky2 <aky(aty
(etc.)
(9.6)
and from the The notion of probability distribution is familiar from statistics It is a very remarkable fact that there exista few distributions theory of games. that occurin a surprisingly great variety of problems,from geneticsand with ramifications econometryto gambling.The three principal distributions, throughout probability theory, are the (a) binomial, (b) Poissonian,and (c)the normal, or Gaussiandistributions (Feller, 1957).
226
General Comments
Distributions (a) and (b) arise,typically, in problemsinvolving Bernoulli trials, that is, repeatedindependent events (or trials) with only two possible outcomes the trials.It for each trial having the same probabilities throughout is usual to denotethe two probabilities by p and q and to usethe time-honored \" \" terminology of the theory of gamesreferring, respectively,to p as success = > > and q as \"failure.\" Clearly, p 0, q 0, and p + q In problemsinvolving the binomial distribution oneis interested only in the total number of successes of n Bernouilli trials, producedin a succession One then shows(Feller, but not in their order. that the probability that 1957) and n k failures @ < k < n) n trials result in k successes
1.
\342\200\224
is:
\\p(\\Pr
The average and variance of this distribution are, respectively:
(9.7a)
= np <<5/c2> = np(\\
p)
(9.7b)
Supposewe fix an arbitrary (time) interval of length t and divide it into subintervals of length l/n.If a particular subinterval contains at least oneof our random events, we agree to call this possibility a \"success.\" Considera succession of Bernoulli trials with the same probability pn of success. The total number of such trials is the integer nearest to nt. We assumethat, as
n
\342\200\224>
oo:
h
that as n -* Then, one shows(Feller, 1957)
exactly
=h <<5/c2> = Xt = </c>
<*>
this
The status of the Gaussiandistribution is somewhat different. Typically, arisesas a limiting case after the laws of large numbers are applied.In particular, onehas (Feller, 1957):
9.2.
Stochastic Formulation
227
random Lawof of mutually independent large numbers. If {ak}is a sequence = <a> value variableswith a common distribution and if the expectation {ak} -* c > 0 as n oo. exists,then for every
+
the probability that the nonweightedaverage (av + In other words, e tends to one. differs from the mean by lessthan a prescribed
\342\200\242\342\200\242\342\200\242
(9.9)
+
an)/n
in addition,that the variance <(<5akJ> Central limit theorem. Suppose, exists.Then, for every fixed fl and for n -* oo:
= a2
j
where O(/?)is the normal distribution
(9.10a)
(9-iob)
is calledthe Gaussiandensity function. The integrand in Eq. (9.10b)
Note that the validity of the central limit theorem imposesautomatically an order of magnitude for the variance of the fluctuations relative to the variable: mean value. Indeed,let A be an extensive stochastic
\342\200\242 \342\200\242\342\200\242
an
the where n is now related to the sizeof the system. According to Eq. (9.10a) is bound to be of order a2n, that is, variance {SA2} the
Alternatively,
SA
oc </l>1/2 oc n1'2
increases:
SA
SA
Indeed,this is
what
section.
228
General Comments
Imagine now a situation whereby dA/(A}tendsto zero more slowly than as n -* oc. Then, the scales infinity of macroscopic and of fluctuations are not averages clearly separated.This means that the average value <a> or {A}is not representative of the system or,alternatively, that the \"sampling\" procedureallowed by the law of large of identifying, for all practical purposes,the arithnumbers and consisting mean to the stochasticaverage is not entirely meaningful. Hence, we case wehave a see this breakdown the laws numbers. We in that of of large say shortly that this situation is characteristicof phasetransitions at equilibrium, as well as of nonequilibrium instabilities leading to dissipative structures. case the Finally, it is important to point out that, while in the Poissonian in the case of a process average and the varianceare linked through Eq.(9.8b), described distribution there appeartwo independent by a Gaussian quantities, the mean and the variance. We discuss this point in the following chapters, as it appears that in stochasticproblems involving chemical reactions the Poissoniandistribution plays a privilegedrole.
arithmetic
9.3.MARKOVIAN
PROCESSES
Section9.2 is concerned mostly with independent trials such that the joint probability of a sequenceof events satisfies the multiplicative property. The theory of Markov processes provides a generalization that consists of permitting the outcome of any trial to depend on the outcome of pretrials. To this end one introduces the conditional probabilities, preceding and others, related to the P, values in Eq. (9.2) W2(Wi}t11 {a2}t2) by:
W2({al}tl {a2}t2)x P,({<ii},'i) (9.11) P2({al}tl:{a2}t2)= [cf. Eq. (9.3)]:
\\
(etc),with
(9.12)
set of numbers satisfying /property (9.12) defines a stochastic matrix. a is if the conditional probability W2 By definition, process Markovian contains all necessaryinformation on the process. Stated differently, the of the to of the is \"memory\" past history system limited one(more generally are widely spreadin to a small number of steps)backwards. Such processes One of the probability theory. simplest illustrations is the problem of random walk. At time 0 a \"particle\" is at its initial positionz and at times where At = ti+i 1,2, (or At, 2At, r,) it moves a unit step in the
A
3,....
\342\200\224
9.3.
Markovian
Processes
229
q, respectively,dep and positive or negative direction,with probabilities \" \" \" on whether the corresponding trial resulted in successor failure.\" The random walk can be either unrestricted or terminate when the particle for the first time reaches points0 or a, which act as absorbingbarriers.In the the matrix of conditional probabilities latter case
depending
W-,
0 0 q 0 p 0 q 0 p 0 0
1
is:
o 0 0 o 0 0 o 0 0 q 0 p o 0 1
(9.13)
for each of the interior states(i.e., for points different from 0 or a) Alternatively, transitions are possibleto the right and the left neighbors:
W2(i, t
1) = p 1) =
<?
from either 0 or a to any other point; once However,no transition is possible these states,the system stays fixed there forever. Despiteits simplicity, in a quite realistic way the motion of a heavy particle in this model describes Section10.3). a fluid of light particles, known as Brownian motion (see a the same In the more picturesque of problemconsiders language betting, and wins of or loses one unit with who q, probabilities gambler p money respectively.If his initial capital is z and he plays against an adversary with initial capital a z, the game continues until the gambler's capital is either reducedto zero or has increasedto a, that is, until one of the two \"ruin problem\" is equivalent to someprobplayers is ruined.This classical in a mutant or of a species extinction of in population genetics involving a set of competing populations. Similar problemsarisein chemical reactions and Nicolis,1975). involving autocatalytic steps (Malek-Mansour is provided by the A second illustration of the notion of Markovian process N balls)bedistributed Let N objects(e.g., Ehrenfest urn model (Kac,1959). = At = At time t = n a ball is in two containers A and B. Take t2 tx chosenat random and transferred from one container to the other. Let the state of the system be determined by the number of ballsin container A. and that at t = n there are exactlyk ballsin A {k < N).Then the probabilsuppose for reaching at t = n + 1 the next state, which will be {k 1)or (k + 1) balls in container A, dependsonly on the number of balls in A at t = n. On the other Thus, the sequenceof events defines a Markovian process. hand, the transition k -> k 1 implies that a ball has been removed from
on
\342\200\224
problems
\342\200\224
1.
\342\200\224
probability
250
-\302\273
General Comments
k + 1 implies that the ball is removed from B. A, whereas the transition k The corresponding conditional probabilities are, clearly: W2(k,t
W2(fc, t W2
= n\\k
- l,r=
+ 1)= -J
\\
= n\\k +
l,t = n + \\)=
=0otherwise
\342\200\224
(9.14)
illustrationswehave considered classof a special Actually, in the preceding Markovian processes on f i and t2 having transition probabilities depending are known as fj. Such processes only through the difference Af = r2 stationary Markovian processes. Usingthe definitionsof this sectionone can write for such a process an equation of evolution for P2,which is referred to as the Chapman-Kolmogorov equation (Feller, 1957):
are discrete. In this case one remaining of this sectionthat the variables {a} In the of of a Markov chain. case continuous variables because speaks (e.g., of spacedependencies) the sum has to be substituted by an integral. Note also of W2, Eq. (9.15) It can is nonlinear in that, owing to the definition also be transformed into an equivalent form displaying W2 as an unknown function. In Eq. (9.15), let Af representthe duration of an elementary event. Then, the is W2(At) probability that a systemwill make a singletransition from state
= X W2({a}\\{a2),At) x P2({ax}t P2({ai};{a2},r) Af) {a}, (9.15) for any Af such that 0 < At < t. Forsimplicity, we assumehere and in the
(a)
(9.11)
P2.
Af. As
we deal with
it
that are continuous in processes to work with transition probpurposes end we set k = {a}, I = {a2} and define:
\"
At
= (probability/time)for a transition
_ *kk~
Clearly
between two
different
states(k
\302\245=
I)
' ~ W2(k\\k,At)
a7
from state k a transition occurs
(k
(9.16) (9.17)
(9 ]8j
A,imo
= (probability/time) that
wkl
/)
9.3.
Markovian
Processes
231
=0 5>H i
(9.19)
Assuming now that the wkl valuesexistand are finite, one can easily derive an equation of evolution for the probabilities t) = P(k, f) by summing Px({a}, over {ax} and by expanding P(k, t Af) in Taylor seriesaround Eq. (9.15) P(k, t). One finds straightforwardly:
dP(k,f)
dt
,
\\
see that the time terms, associatedwith the transitions / k, and the \"loss\" terms \"gain\" associated with the transitions k /. Hereafterwe referto this relation as the
We
-\302\273 -\302\273
the Ehrenfest model. one has, summing over all From (9.14) transitions changing the population k of the spheresin one of the containers:
fork
- 1, 1,...,N
P@, t +
P(k,
Af)
^\342\200\224-i
)P(k
+ ^ir~ -1,0
1
\342\200\224
pC<
!'f) (9-21a)
Af)
P(l,f)
P(N,t+
At)
= ~P(N
- l,f)
(9.22)
In the original model Af is taken to be the unity. If the limit Af ^ 0 is taken and the left-hand side of Eq. (9.21) is expandedin powersof Af, we observe that in order to convert this equation into the master equation (9.20) it is as to such to Af a divide and necessary by give quantities meaning This is not possibleunless (Aty1(k + \\/N) and so on in the limit Af additional prescriptionsare made on the transition probabilities(9.14). This problem isdiscussed in Section using the random walk as illustrative
-\302\273
0.
10.3
example.
to the general equation (9.20) we concludethat, within the Returning framework of Markovian processes, the problemof fluctuations amounts to constructing and solving an equation of this form adaptedeach time to the As we see later, the structure of the solution depends problemconsidered.
232
General Comments
referencestate critically on two factors. The first factor is the macroscopic In particular, the constraints maintainaround which fluctuations are studied. the system in a state away from equilibrium are shown to deeplyinfluence the behavior of fluctuations. The secondcrucial factor is the form of the In the examplesof random walk and of the urn transition probabilities. model discussedearlier in this section the transition probabilitieswere either constant or linear functions of the random variables. Some of the in Chapter 10 sharethese properties. As a rule, \"chemicalgames\"discussed however, they are much more complicatedas they are determined by that are nonlinearfunctionsof the stochastic transition probabilities variables. This nonlinearity leads to new important features absent in the standard such as Brownian motion. In either case, the stochastic treatment examples gives additional information with respectto the macroscopic description. the latter is recoveredunder certain conditionsas the behavior of Although the expectation valueof the stochastic variable, one has,in addition, a means for calculating variances and other related quantities reflectingexplicitlythe effect of fluctuations. Interesting examplesof gamesdefined by chemical reactionsmay be found in Eigen and Winkler A975). Hitherto we have assumedthat in the stochastic the process variables {a,} is Markovian. Actually, this dependson the choice of these variablesand on the nature of the processes describedby the macroscopic equations of considerthe processof diffusion of a distribution evolution. As an example, of N colloidal in a volume Keach one of which performs a Brownian particles motion. The local density p satisfiesFick's law of diffusion. Suppose that one as variables in the correspondingstochastictreatment, the now chooses positionand the momentum of a representative Brownian particle, or the in a small volume AV having momenta number XAV(i) of Brownian particles results of probability theory is, between p, and p, + dp;.One of the classical that the stochastic i s a Gaussian-Markovian then, process process.*The situation is entirely different if one considersas stochasticvariable the of particlesin AK whatever their velocities (Kac,1959). number One is stochastic finds that the corresponding non-Markovian. Moreover, process it does not seempossible to derive a closedequation for t) owing to the very complicated of this function on the probability distribudependence A similar situation of positionsand velocitiesof the individual particles.
maintaining X\302\261v
P(X\302\261V,
distribution
is encountered in
Chapter 12.
Beforewe begin our analysis of nonequilibrium systemswe briefly discussin sectionthe propertiesof fluctuations in equilibrium systems away from
arealsoknown processes
in the mathematical literature
* Such
as diffusion
processes.
9.4.
form,
233
points of phase transition. This problemcan be solved in its most general Onereasonfor this and one can say that it is currently a closedsubject. is that the equilibrium state is characterized (seeChapters 1 and 2) by a number of thermodynamic potentials that attain at that point their extremal values, namely, entropy for an isolated system, free energy at constant temperature and volume, and so on. In order to see how the thermodynamic potentials are related to the of a singlecomposition probability of a fluctuation, we first considerthe case variable denotedby X. We assumethat this variable is extensive*and that the system that is maintained isothermal communicates with a large external reservoir maintaining the corresponding \"chemicalpotential\" /< constant. According to statistical mechanics the equilibrium state is describedby the grand-canonical ensemble,which we write here in the following form (Landau and Lifshitz, 1957): where O is the [i is the reciprocal temperature (in units of Boltzmann's constant kB), and E such as is the internal energy, which dependson X as well as on parameters the positions, internal o f the momenta, and particles. energies From Eq. (9.23) one can deduce the probability distribution for X, by summing over the position,momenta, and internal statesof the particlesin
the volume V:
E(X))
(9.24) p, V) + fiX F(X, p, K)] Pep(X) = A exp Note that the free-energy function, F, appearing in thermodynamics is different from the quantity (Callen, F{X,p, V) introduced in Eq.(9.24) Tisza and Quay, 1963). The former is related to the thermodynamic potential O by the relation:
0[0(/I,
1965;
1960,
O=F
fiX number
(9.25)
of particles of a reacting
* For a reaction-diffusion system X denotes, typically, the within the system of volume V and temperature T. species
234
General Comments
= F(X).
Applying
formally
(AF)TV
= n AX = n(X
X)
T(AS)EV
where AS is evaluated at constant energy and volume rather than at constant T and V. is to remove from AF Thus, the roleof the term ji{X X) in Eq. (9.26) (or from AS) the first-order terms of the expansionof F (or S) around the state. Calling A;S this \"internal\" entropy difference. We macroscopic concludethat:
(9.27)
The reasonwhy A; S refersto the part of AS due to an internal fluctuation, that a systematic external disturbance modifying X only affects the firstin Section3.5, order terms.According to the conditionsdeveloped one has
that
is the celebrated Relation (9.27) Einstein formula for fluctuations (Einstein, here we have been concernedwith fluctuations of 1903, 1910). Although evaluated under more general compositionvariables, the same expression conditionscan also generate the fluctuations of other extensive thermoan quantities. We may also point out that instead of considering opensystem in contact with a reservoir,we may equally well apply the results to evaluate the fluctuations within a small volume AV of a large isolated AV the subsystem in the volume V system of volume V. In the latter case, a AV actsas heat-and-matter reservoir. surrounding Forsmall fluctuations around equilibrium, one can expandEq.(9.27) and retain the first nontrivial terms only. One obviously finds
thermodynamic
\342\200\224
AjS
<0.
^sJ
(9.28)
is the second-order where %S2S)e excess entropy familiar from Part I.In this the to several function can be extended form, probability straightforwardly <52S one finds: variables. for fluctuating D.29b) Recallingexpression
(929)
9.4.
235
where X, denote now the numbers of particlesof constituents 1 to n and Xj eq. As we saw repeatedly in Chapters3 and 4, the quadratic bXi = Xt from appearingin the exponential is positivedefinite. Thus, the distribution of fluctuations at equilibrium is Gaussian.The maximum value of this distribution related to the most probablestate of the system, X1?, as well as its average are both identical to the mascroscopic (equilibrium) values X,!-eq:
\342\200\224
<*\302\273>\302\253,
= XT = XLeq Leq
(9.30)
Moreover, a direct calculation where <5X, are treated as continuous variables shows that the mean-squaredeviation or variance of the fluctuations is (Landau and Lifshitz, 1957):
<SX,5X^ =
where (d/i/dX)
^7@)
\\
(9.31)
expressionC.10)
dfj
(9.32)
a Poissonianvariance. We conludethat the fluctuations exhibit in this case in the limit of a and (9.24) This can also be shown directly from Eqs. (9.23) In this case, dilute solution. E(X) = YJ= i e, and (Landau and Lifshitz, 1957):
Pep(X) ex
e\342\200\224\\
\302\243,
where the factor X!accountsfor the indistinguishability definition of the chemical potential:
J and
of the particles. By
- e,) =
F^X) = /I
^^
(9.33)
The normalization condition gives A = e~<x>;therefore, Eq. (9.23) is a Poissonian distribution [cf. Eq.9.8)], with a mean value <X>which, accordto Eq.(9.20), to the is equal to the macroscopic value of X corresponding state of equilibrium. Relations (9.29) to (9.33) can be interpreted in an alternative way as follows. We first see,from Eq. (9.32), that the quantity
according
236
which
General Comments
as:
In a
Ai.eq
vi/2
(9-J4)
quantity.
fluctuations around this value lead the with the size system to configurations that becomeincreasinglyimprobable of the fluctuation. All ofthesestatements are, in fact,equivalent to the stability of the state of equilibrium whenever the matrix of the coefficients(duJdXj)^ definesa positive definite quadratic form, that is, to the condition A(S <0. This property fails only when the system is in the vicinity of a transition leading to a separationbetween different phases(Landau and Lifshitz, 1957). The theory of fluctuations outlined in this sectionwas basedentirely on In principle,one equilibrium thermodynamics and statistical mechanics. theseresults in the most general case of a system shouldbeableto reproduce at equilibrium from the master equation (9.20) provided the stochastic variables are chosenadequately, and the transition probabilitieswk, are in such a way that they reflectcorrectly the conditions constructed prevailing at equilibrium. Among the latter, the condition of detailed balance plays a crucial role (DeGroot and Mazur, 1962). It statesthat each elementary step in a sequence like a chemical reaction can occurwith the same probability as its \"inverse,\" that is, as the step obtained from the \"direct\" one on time reversal.*
becomesa very small X, ^ -> oo, and Eq. (9.34) a clearcut distinction between words,there is in this case macroscopic descriptionand fluctuations. This is also reflected in the fact is situated at the that the maximum of the probability distribution (9.29)
macroscopic system
In other
9.5.FLUCTUATIONS IN
AN
SYSTEMS: NONEQUILIBRIUM
HISTORICAL SURVEY
The success of Einstein's theory of fluctuations around equilibrium suggests that the extensionto nonequilibrium situations couldbe based on similar
ideas,that
\342\200\242
is:
\342\200\242
The use of some suitable \"potential\" extending the notion of thermodynamic potentials to far-from-equilibriumsituations. The useof extensivestochastic variables referring to the system as a whole.
recall that this condition
\342\200\242
We may
reciprocity relations
of the Onsager
9.5.
Fluctuations
in Nonequilibrium
Systems: An Historical
Survey
237
to (9.32) This would bejustified from the fact that the basicrelations (9.30) dependon the volume of the system in a universal fashion: <(<5XJ>=aK, a = const and suggest in this way a remarkable property of similarity between variancesand volumesof different sizes.
We started these investigations with the study of simple examples Nicolisand Babloyantz, 1969) (Prigogine, 1954; Prigogine and Mayer, 1955; that confirmed at first the possibility of a theory of nonequilibrium fluctuabased on the excess entropy, S2S.However, the study of nonlinear situations led to the quite unexpected conclusionthat these ideascan only situations. Consider first the possibility of denning a potential apply to special that would determine the probability of a fluctuation. As we saw repeatedly to find such a potential in the first parts of this monograph, one cannot expect of of systems involving a single variable and in the case except in the case For such systems operating in the linear range of irreversible processes. systemsone can, indeed,show that the probability function takesthe form: P oc exp(A7r) (9.35)
fluctuations
where Axe is a generalized excess free-energy function, also referred to as kinetic potential (Prigogine and Mayer, 1955; Graham and Haken, 1969; In the o f instabilities An has some remarkable Haken, 1975a,b). presence similar to the properties Landau-Ginzburgexpressiondetermining the free energy in the critical region of equilibrium second-order phase transithan one variable and In more (Stanley, 1971). systemsinvolving far from all of these resultsbreak down; moreover, operating equilibrium, no obvious way of extending them appearsto exist. Let us come of stochasticvariables. At now to the problemof the choice a nd the most for equilibrium (McQuarrie,1967) general sequenceof unimolecular reactionsaway from equilibrium (Nicolisand Babloyantz, 1969) it has been shown that fluctuations can be correctly described by extensive variables referring to the system as a whole. In contrast, for nonlinear reactions operating far from equilibrium a most striking result has been variance of fluctuations changes qualitatively as their scale increases. Small-scale fluctuations, affecting only the region of dimension of the order of the mean free path, can be describedby a straightforward extension of Einstein'stheory. The only differencewith equilibrium is that the parameters appearingin the probability distribution [see are Eq. (9.29)] evaluated at the nonequilibrium reference state. This is quite similar to the ideas underlying the notion of local equilibrium in kinetic theory of gases This distribution function representsa (Chapman and Cowling, 1952).
transitions
shown\342\200\224the
238
General Comments
nonequilibrium situation, yet its functional form is the same as in equilibrium. The differenceliessimply in the fact that the state variablescan evolvein time in space, as a result of the nonequilibrium and can be inhomogeneous
constraints.
volumes large-scale fluctuations affecting macroscopic the size to of the in a behave system distinctly nonequilibrium comparable fashion. In the presenceof instabilities they can be amplified and drive the and system to a new regime different from the initial referencestate (Nicolis 1971; 1 974a; N icolis,Malek-Mansour, Nicolis, Kitahara, 1972, Prigogine, Van Nypelseer, and and Van Nypelseer,1974; Nicolis,Malek-Mansour, We are far from the simple \"universal\" laws of fluctuations Kitahara, 1976). as described distribution. by a Poissonian-type A correct in nonequilibrium systemsmust of fluctuations description be a local description of necessarily capable differentiating between fluctuaof variable ranges and coherence lengths (Nicolis,Malek-Mansour, Malek-Mansour and Nicolis,1975; Kitahara, and Van Nypelseer,1974; Lemarchand and Nicolis, Gardiner,McNeil,Walls and Matheson,1976;
In contrast,
fluctuations
is to describe thesenew developments Our principalgoal in Chapters10-12 detail and to substantiate them on representative, if simple,examples. We first describe, in Chapter 10, the basicideasof the formulation basedon the use of extensivevariables. Chapters 11 are devoted to the local and 12
in
1976).
theory of fluctuations and to the analysis of the critical behavior of the macrovariables in the presence of instabilities.
Chapter 10
we emphasizedin Chapter 9, in the master equation descriptionof fluctuations one has to assignto the system a set of transition probabilities in the spaceof someappropriatestochastic the process variables. describing Considerfirst the intuitively appealing which consists of introducing choice, in the master equation the variables that describe the system as a wholeon the rate equations.In a sequence levelof the macroscopic of chemical reactions these variables correspondto the numbers {X,}, n of particlesof i = the n chemical speciespresent.A particular step of the sequenceproduces
1,...,
p:
additional particlesof a certain set of componentsand consumes particles of other components.We thus obtain a \"birth-and-death\"processin the values.The transition probabilities wk, as dennedin Eq. (9.16) spaceof {X,} then dependon a set of integers rip (rip may be positive, negative, or zero) the change of the number X, due to reaction describing = W(rip) = w({X,- rip\\ -> {X,}) A0.1) wkl
-r }t)
(io.2)
-^w({Xj->
{X,. +
r) r,.,,})P({X,.},
This equation describesthe time evolution of the probability function However, we have still P({Xt}, t) in terms of the various chemical processes. to express in X terms of the values. Obviously, the w values are related to w the frequencies of reactive collisionsbetween chemical species. Consider first a simpleexample involving three species X, Y, Z interacting through
X
+ Y -^ 2Z
239
240
Birth-and-Death
\342\200\224
Description
-\302\273
of Fluctuations
The transition probability w = w(X + \\,Y + 1, Z 2 X, Y, Z) is proporto the number of binary collision between X and Y before the reaction takesplace. Thus
proportional
w
fc
= k(X + i)(y+ l)
\342\200\224
where is the rate constant. Note that the term ( + 1)added to X and Y on where the right-hand side of this expression is, in fact, equal to vx, In our vx,vY are the stoichiometric coefficientsof X, Y in the reaction. particular examplethese coefficientsare equal to the jumps, rx and rY undergone by X and Y during the reaction. This result can be extendedto For autocatalytic reactions,where the reactant may appear on both sides. instance for the reaction
\342\200\224vY,
\342\200\224 \342\200\224
+X
\302\261>
2X
\342\200\224
1,X
-1
-> X, and w
1
- 1)
1) added to X is equal to vx, sincethe stoichiometric coefficientof X in the reaction is now equal to + The jump, rx is alsoequal to + Hereafter, therefore, the jump appearingin expression can be A0.1) in i reaction the stoichiometriccoefficientof identified with p. can be easilygeneralizedto all cases where the stoichioTheseexpressions coefficientvip (or the jump rip of Xt) is 0, 1 or + 1,provided the stoichiometric coefficientsof all reactants appearingon the left-hand side of the reaction are themselves0, 1, or + We obtain:
Again, the term
(\342\200\224
1.
1.
\342\200\224
stoichiometric
\342\200\224
1.
mechanThe product is taken over all species that participate in the collision that in some of the the stoichiometric considered. now Suppose steps coefficientsvip of the reactantson the left-hand sideof the reactionare different or + If the jump sufferedby this reactant is rip, then one has to from 0, 1, can be selectedout of the expressthe number of ways that vip molecules molecules i that are This Xj gives: present. rip
mechanism
1.
\342\200\224
MX,
As an
= k,,(X,
rip,
--
(X,
- rip
vip
\\)/vip
(vip
> 0)
A0.3b)
w(X
2,E-
-\302\273
1)
Limitations 10.2.
of Birth-and-Death
Formalism
241
+X
expression +
\\,E-
-> X,E) =
^(X + l)X
can be shown (Malek-Mansour that Eqs.A0.3)are the and Nicolis,1975) forms of w compatiblewith the requirement of having a Poissonian only distribution at equilibrium. As pointed out in Section 9.4,a system described by the Poissoniandistribution gives rise to statistical averages identical to values. Thus, the equilibrium laws of chemical kinetics the macroscopic of the master equation A0.2).We have ample becomeexact consequences to further relations A0.3)in the sequel. illustrate opportunity
FORMALISM
Becauseof its simplicity and intuitive appeal, birth-and-death formalism It is only has been widely used (Barucha-Reid, 1960, McQuarrie,1967). were the fact that the that its limitations clearly recognized. Firstly, recently transition probabilitiesare computed in terms of \"collective\"variables that only very exceptional implies Eq.A0.3)] referring to the entire system [see fluctuations are retained in the description. Moreover, by treating the system as a whole one discards important aspectsof fluctuations associatedwith such propertiesas the size, range over which they extend, and correlation length over which two parts of the that theseproperties shouldplay an system can feel eachother. One expects important role in the vicinity of critical phenomena,exactly as in equilibrium As is well known in this case statistical mechanics. (Landau and Lifshitz, the fluctuations even in a system that is macroscopically 1957), homogeneous, breaklocallythis homogeneity and generate in this way additional stochastic in the description. variables that must be incorporated Finally, becauseof the global character of the birth-and-death method, there is no way to express satisfactorily the nature of the macroscopic (nonequilibrium) state around which fluctuations are evaluated in Eq.A0.2). In particular, the question of relative closeness of this state to a local equiequilibrium is a crucialelement in the validity of the local descripof irreversible processes this monograph\342\200\224is adopted throughout
regime\342\200\224which
description
left
remedy of this is to apply the birth-and-death formalism to a subvolume AK of the entire system that is sufficiently small to permit a
A natural
open.
242
Birth-and-Death
Description
of Fluctuations
of the processes birth-and-death-like description therein and yet sufficiently to local equilibrium. Sucha volume would be coupled large to remain close automatically to the remainder of the system by the transport of matter and the surface separating AV and V AV. energy across is to develop in detail such a local The purposeof Chapters 11 and 12 theory of fluctuations. Before we attempt this, however, we devote the reremaining of this chapter to the birth-and-death formalism.The reasonfor this and substantial;most of the methodsof analysis develis both pedagogical for the solution of the birth-and-death master equationsare applicable to the more complicated local theory as well. Moreover, even in this, more refined treatment of fluctuations the contribution of chemical reactions within the subvolume AV are described by a modifiedbirth-and-death proThe latter is therefore,a basiccomponent of the dynamics of fluctuations
\342\200\224
developed
process.
in
nonequilibrium systems. It is remarkablethat near equilibrium or in systemsof unimolecular reactionsthe necessityof a local description of fluctuations is not apparent. In a sense,the entire system or different small components of it behave in an identical fashion and are both described(if the mixture is ideal) by a Poissoniandistribution at the steady state. As soon as the system deviates the nonlinearity and the nonequilibrium confrom these limiting regimes,
introduce a coupling between neighboring spatial elements.As a of fluctuations becomes a result, global description inadequate. the of this chapter and in Chapters 11 remainder we and 12 Throughout limit ourselvesto reactionsunder conditionsof ideal mixtures. Thus, we neglect the explicit influenceof intermolecularforces into the rate equations' and the transition probabilities.
constraints
OF BIRTH-AND-DEATH
EQUATIONS
in solutionsof the master equation A0.2)| are asymptotic in one of two ways:(a) either the limit of long timeS|| oo is taken and/or (b) the volume V and the total number of particles f fl| This is usually expressedby assignedto the system are macroscopic.
which
tjMfij
thermodynamic
limit:
F-oo,
AT
'\342\200\242$
oo,
AT
\342\200\224=
:'\\
finite
A0.4|
where the evolution of the system the situations encounteredin Part element. involved always somelarge-scale macroscopic
II,
Master Equations
243
We now compilesome methods for analyzing the asymptotic solutions of the birth-and-death master equations.The presentation is rather brief, as most of these methods are illustrated later on by simple examples.
Fokker-Planck Equation
In a number of problemsinvolving Markov chains the \"spacing\" between is Brownian motion (Wax, statesis small. One of the best known examples a t hat the motion of of 1954), is, heavy particle massM in a fluid of light of M. In the mass m limit as m/M <| 0, the momentum transfer particles the from collisions between Brownian arising particle and the particlesof the medium is small with respectto the instantaneous momentum of the Brownian particle.In a system involving chemical reactions,a somewhat analogous situation can arise in that the step appearingin the birth-andto be small comparedto the instandeath master equation A0.2)is expected values of the numbers of particles. To handle this type of situation we considera smooth function Q({X^), oo and is otherwise arbiwhich goes with sufficient rapidity to zero as X( We multiply both sidesof Eq.A0.2)by Q and integrate over {Xt} con-\302\273
instantaneous
-\302\273
arbitrary.
considering
P and
them as continuous variables. Notice that this implies that both We obtain: have to be interpreted as probability densities.
8t
i
~ rip\\ },f)
A0.5a)
-f
\342\200\224
We now expandin the first term on the right-hand side,Q({Xt}) in a Taylor seriesaround Q({Xt rip}).Usingcondition (9.11) we obtain, after switching
= Xt
\342\200\224
rip:
A0.5b)
244
Birth-and-Death
Description
of Fluctuations
This expressionis known as the Kramers-Moyalexpansion.In order to understand better this structure, we define the transition moments
by ai.ixh~in-
the
relation:
= a,:il i,({X,})
M{Xi]
{Xt
rip})
f|
rikP
A0.6)
different
from
zero.A Gaussian-Markovian
=0
Equation A0.5) now
for /
>2
A0.7)
becomes:
in the right-hand side and taking into account is an Q({Xt}) arbitrary function, we concludethat:
Integrating partially
that
ij
Mi Mj
,0
A0.8)
This equation is known as the Fokker-Planck equation (Wax, 1954). Before going further, it is interesting to comment on the meaning of this in Sections 9.2 Let us and 9.3. equation in the light of the ideasdeveloped of the transition considerthe problemof random walk. Usingthe form (9.13) and taking the time-space probabilities stepsto be Af and Ax, respectively, in rather than unity, we write the Chapman-Kolmogorov equation (9.15) the form:
Ax, f)
+ qP(x +
Ax, f)
A0.9)
consider the limit of a fast jump, Af -> 0, between neighboring points,Ax -> 0.Equation A0.9) can then be expandedin powersof Af and Ax. The first few terms yield:
At
ct
ex
\342\200\224-\342\200\2243
ex
^\342\200\224-
j-j ox
If we divide through by Af and take the limit Af -> 0, we must give a meaning such as (Af)\" x(q p) Ax and Ax2/2 Af. This problem,which to expressions for the Ehrenfest was already mentioned within the context of Eq. (9.21)
Master Equations
245
model, can be solved in simple situations such as Brownian motion (Wax, one showsthat: Indeed,in this case 1954).
q
=0
(asq = p = %)
-\302\273 -\302\273
and that Ax2/2 Af existsfor all Ax and Af (in particular for Ax 0, Af 0) and defines the diffusion coefficientof the Brownian particle.It is, therefore, natural to admit that we couldset
Ax2
\342\200\224-
- = -p ot
2Af
= D = finite
Ax, C
= finite.
than
two
in cancel
the limit
ox
ox
\302\243
A0.10)
is of the form A0.8)with a constant \"drift coefficient\" related to the differencebetween the two transition probabilities p and q, and with a conD. Thus, random walk provides a model for a \"diffusion coefficient\" Gaussian Markovian process. In this The situation is different when chemical reactions are considered. caseone deals,typically, with processes that are continuous in time (Af -> 0) but discretein the space of the stochasticvariables {X,}. Moreover, the transition probabilitiesper unit time w are perfectly well defined at the outset in the limit Af 0 [seeEq. A0.3)]. Thus, one can write a master as in equation directly for dP/dt without making additional prescriptions the case of the random walk. As a result, even for the simplest reactions condition A0.7)can never be satisfiedexactly.*Forinstance, for the reaction
which
constant
-\302\273
-\302\273
- 1)=
can never be set exactly equal to zero. At best, Obviously, this expression an to the exact solution of the master is therefore, Eq. A0.8) approximation
at In this respect we may mention a theorem (Pawula, 0 for some even /, we are actually assuming a, to
be zero
1967)according to
for all
which if we assume
/ > 3.
246
Birtk-and-Death
Description
of Fluctuations
so,van Kampen A961, 1969) pointed out that in a nonsystem,by retaining the fully nonlinear contributions in the transition probabilities ax and a2 one keepsterms of the same order of magnitude as he suggested a method for the higher transition moments. Subsequently, expandingsystematically the master equation, which leads to a FokkerPlanckequation whosecoefficientsare this time linearizedaround the values to the macroscopic evolution. corresponding The main point of van Kampen'smethod is to assumethat relations extend to nonequilibrium situations, in the sensethat: to (9.22) (9.19)
equation.Even
nonlinear
\342\200\242
t) is Gaussianin P({X},
\342\200\242
the limit of a macroscopic system, that is V oo. are distributed around their most {Xt} probable values,* {X\"(t)} with a variance of order V:
-\302\273
,
with
- XT(t)J},oc
X?(t)oc V
Thus, any deviation from XJ\" is of the order V1/z. We introduce a new variable, ^, which is independent of V by setting (for simplicity we consider hereafter and until the end of Section10.3 a single stochastic variable):
X
= Xm(t) +
V1/2\302\243
A0.11a)
or,in
terms of scaledvariables
mUb)
P(lt)= P(y(t)
_SP
dt
P: + V-1'2t;,t)
A0.12)
The time derivative dP/dt of P contains a contribution reflectingan explicit time dependence, as well as the fact that y(t) dependsgenerally on t:
ll28Pdy
<3\302\243
d dt
dt
As
before, the right-hand-side of the master equation is expanded in a series[see Moreover, the transition Eqs.A0.5b)and A0.8)]. Kramers-Moyal
* Note that, in general, <A\",> # Xf. The most probable value is expected to correspond to the results of macroscopicobservations. In general, <A\"> provides a good approximation to this,
unless
P is a multihumped
distribution.
JO
Master Equations
247
moments are expandedin powers of F~1/2<i;.Equating equal powers of V\021/2 on both sideswe find: To order V1'2:
dy
Tt~y
and to
order
V\302\260:
where the transition moments are evaluated at the most probable value, which, as we see y(t). The latter evolves in time accordingto Eq. A0.13) has the the same structure as shortly, macroscopic equationsof evolution. Fora single stochasticvariable Eq.A0.14)gives a Gaussiandistribution as a steady-state solution, contrary to the equation A0.8) with nonlinear coefficients. In general, therefore, van Kampen's method cannot handle situations involving instabilities that, as we see later, straightforwardly involve deviations from the Gaussian behavior. Moreover,the method becomesawkward to apply around time-dependent states. In this case, the reducedstochasticvariable should accordingto definition A0.11), itself be time dependent to secure the time independency of the initial stochastic variable X. constitutes a powerful Despitethese limitations, van Kampen'sexpansion tool of analysis that permits sorting out of somegeneral features of fluctuain nonlinear systems. Gaussian-Markovianprocesses equation leading to a Fokker-Planck with nonlinear coefficients as in Eq. A0.8) can also be representedby a The ideais to extend the macroscopic equation Langevin equation (Wax, 1954). of evolution for the macrovariable y(t) to a stochasticdifferential equation In physical applicationsthe stochasticcharacter is usually (Arnold, 1973). a random force term, F(t): expressed through
\302\243
fluctuations
^ = fll(M) +
<F(f)>
absence
F{t)
A0.15)
in
The validity of the macroscopic can now be ascertained only description an average senseand this requires,according to the classical theory:
=0
A0.16a)
Moreover, the Gaussian-Markovian assumption is equivalent to the abof any correlation betweenvaluesof F at two different times: <F(fl)F(f2)>= 2BS(t,
t2)
A0.16b)
248 In
Birth-and-Death
Description
of Fluctuations
the bracketsdenotea statistical average over the distribution Eq. A0.16) of F values. The use of Langevin's method in nonlinear systems far from equilibrium can be criticizedon the same groundsas that of the Fokker-Planck equation and 12). also Chapters11 A0.8)(see
X:
= Vx x. To
this
introduces:
\342\200\242
end, one
= P(X,t)
A0.17a)
\342\200\242
new transition
probability:
Vw{x,
r)
= w(X-^X + r)
A0.17b)
\342\200\242
A \"Hamiltonian,\"
H, defined by:
H(x,p)=
Then, the
\302\243A
e\"'\"p)w(x,r,,)
A0.17c)
finite displacement operation involved in the master equation can be expressedin terms of an operator form of H, whereby p is substituted by the derivative d/dx.One obtains,instead of Eq. A0.2):
8t
\\
V8x
This is analogousto Schrodinger's equation of quantum mechanics, but to be small in a instead of h/i one now has the factor \\/V, which is expected o ne can seekfor In with mechanics, quantum macroscopic system. analogy
Master Equations
249
of Eq. A0.18) using WKB-type methods(Courant and Thesesolutionsare of the form: Hilbert, 1962).
P oc
exp(F<\302\243(x,
t))
A0.19)
has beenestablished Their existence by Kubo,Matsuo,and Kitahara A973) and by Kitahara A974) using Feynman's path integral method.Substituting one obtains,to the dominant order in V: into Eq. A0.18) Eq.A0.19)
dt
'dx
A0.20)
This equation has the sameform as the Hamilton-Jacobi equation (Courant It can be solved by the well-established and Hilbert, 1962). method of The topological structure of the trajectories characteristicequations. of these equations in the corresponding phase space gives information about the as well as about the shapeof the uniquenessand stability of their solutions, T he distribution. method becomes probability increasinglydifficult to apply for two or more stochastic variables. Forsystems involving a single variable, some remarkable results have in the case been however, obtained,especially of transitions between multiple steady states.The probability distribution becomesthen double-humped (or multiple-humped), and the phenomena the can be expressedin a language similar to accompanying instability first-order transitions. equilibrium phase Method and Cumulant Expansion Generating-function
A still different method, usedwidely in the sequel of the presentmonograph, the master consistsin expressing equation A0.2) in the generating function
1967;Barucha-Reid, 1960):
F({s,},t)= Y\\s?'P({Xilt)
It
d\302\260-21)
is easy to see that F is related in a simpleway to the average values of various powersof Xt. Thus, taking Eq. (9.3) into account and defining
(etc.) X1XJP({Xk},t)
A0.22)
250
Birth-and-Death
Description
of Fluctuations
we find:
P({X{}, t) = 1
{Si}=11}
= <*;> = <(SXjJ>
'^^ ^
\302\245
\302\253
=<\302\253,\302\253.>
A0.23)
In order to construct the equation of evolution for F we multiply both We obtain: sidesof the master equation A0.2)by YJs?'and sum over {Xt}.
ti'MW,}-11U
{Xi\\
{x>+
t) njmx,},
A0.24)
In the first term we switch to the new variables X\\ = Xt rip. We also take and notice into account the explicit form A0.3)of the transition probabilities that the product
1
-\342\200\224-
.
s|'\+r\")")
d^'\"
\342\200\224j-
Vjp
CSj'''
sf' x
We recall that rip refersto the jump sufferedby constituent j in the reaction p, and vip to the stoichiometriccoefficientof the reactants i on the left-hand side of the reaction (vip > 0).On the other hand, the secondterm in Eq. A0.24) introduces contributions of the form:
{Xt
rip\\)
which
sf' x
10.3\342\226\240
Master Equations
251
and
nsH^};{vv)rwj
Substituting
A0-25>
{
one has:
Va
(n *-
00.26)
= 1,
vx
= 0,
r.4 =
- 1,
rx
= +1,
= L4
and
Equation A0.26) is a linear partial differential equation with variable coefIn general, its solution is an arduoustask. Still, in somesituations one can envisage systematic expansionproceduresin a way similar to the Thus, in the limit where the volume consideredis of previous subsection. dimensions and Nicolis,1971): we set (Prigogine macroscopic
coefficients.
F = exp Ni//({Si},t)
\\j/
A0.27)
where, accordingto definitions A0.23), is expectedto be of order unity. backinto Eq.A0.26)and retaining dominant terms in N one can Substituting convert the equation into a nonlinear differential equation of the first order that is somewhat similar to the Hamilton-Jacobi We seek equation A0.20). for solutions of this equation in the form
\342\200\242A
= ax(t)^ +
+
b12(t)\302\2431\302\2432
\342\200\242\342\200\242\342\200\242
an(tKn
ftn@^ +
+
...
+
Mf)y
A0.28) A0.29)
b13(t)\302\243i\302\2433
---
= s,-
252
Birth-and-Death
Description
of Fluctuations
of oneobtains into Eq.A0.26)and identifying equal powers for the expansion a set ofnonlinear ordinary differential equations coefficients a,-,bjj, and so on. Theseequationsconstitute an infinite hierarchy and can Exusually be solved only if a truncation to some finite order is possible. are given in the sequel. Examples A final remark concerns the physical interpretation of the expansion coefficients.From Eq. A0.23)and the definition A0.27)of we find:
On substituting
\302\243,\342\200\242
i/>
bu
(SX,5Xj) =
1[<X;^.>-
semiinvariants
This showsthat the expansioncoefficientsare related to the cumulants, or of the probability distribution (seeKubo, 1962). Another interesting feature is that bit and bu are related directly to the deviation of the are idendistribution from the Poissonianform, for which relations (9.32) satisfied.
identically
=s XT
A0.31)
Both <X,>and XT can then be expected to describecorrectly the evolution of macroscopic The is situation different when multiple humped quantities. distributions are involved; in this caseone expectsthat the results of a observation are related to the most probablevalues XT and to macroscopic the dispersion around those values, rather than to <X,>,<<5A\",2> and so on. Unfortunately, thesequantities are difficult to identify on the master equation. It is much more natural to obtain, from the latter, results referring to the evolution of the moments of the probability distribution.
Equations
253
In this sectionwe derive the exact equationsof evolution for the first few moments, starting from the master equation A0.2) and discussconditions under which theseequations can be truncated to provide direct information on the behavior of the first and secondmoments. An equivalent method consistingof working in the generating function representation is illustrated on the examplesanalyzed in the subsequentsections. We first considerthe equation for <X,>.We multiply both sidesof Eq. A0.2)by X{ and sum over all values of Xt. Moreover, in the first term of the right-hand side we perform the samechange of variable as in the transforWe obtain in this way: following Eq.A0.24).
transformations
^T at
j},t)
{Xj)
Accordingto relations A0.6)and A0.22)the right-hand sideis the statistical average of the first transition moment alti:
The main feature of this equation is that it is not a closedequation;owing onehas, in general,
is identical to the right-hand side of the macroscopic Now, aUl{{(Xj)}y We see, of evolution.* therefore, that the average laws differ from equations the phenomenological ones obeyedby the macroscopic variables by terms of the relatedto the variancesor to higher ordermoments. A close inspection in connection with definition explicitform A0.3)of the transition probabilities A0.6)of the transition moments revealsone further interesting feature,which we first illustrate in the two simpleexamples:
X
\342\200\224-^\342\200\224\342\226\272
and
We
first
example:
- k^SXSY)
* In fact, the equations of chemical kinetics refer to local quantities such as densities and mole fractions. The moment equations reduce to such local expressions if one takes into account Properly the volume dependence of the rate constants.
254 Similarly,
in
Birth-and-Death
Description
of Fluctuations
the
secondcase:
\342\200\242)
A0.34)
law is words,the differencebetween (alt,)and the macroscopic related to the differencebetween actual values of variances and Poissonian variances. For a Poissoniandistribution this differencevanishes and one recoversexactly the macroscopic and Nicolis, equations(Malek-Mansour is in of as shown the the Moreover, 1975). examples subsequentsections, even when it is nonvanishing, this difference is weighted by a factor l/N with respectto the macroscopic contributions, where AT is a suitable size in This turn in fluctuation introduces parameter. theory the problem of size this which can chosingappropriately parameter, only be solved satisa local Such to fluctuations. an approach by satisfactorily approachis developed in Chapters11 and 12. The results obtained so far on the first moment equation are exact, as they account for the influence of the higher moments on the evolution of the to introduce someapproximations average. Quite frequently it is necessary in order to obtain information on the evolution of those higher moments that will directly influencethe averages. Let us focus on the secondmoment <A\"jX,->. We multiply Eq. A0.2) by XjXj, sum over X{ and Xj, and perform the same transformations as for We obtain in this way: Eq. A0.32). In other
Tt<Xi*j> dt
IE
P
{Xk)
(*\302\253\302\273\342\200\242;,
+ xJ'iP+ r'Pr]P)
On the left-hand sidewe switch from {X,Xj}to the variances <8Xt8Xj>= <XtXj>
<
again the definition A0.6)of the transition moments Taking into account once as we as well Eq. A0.32) obtain:
Equations
255
The terms of the type {Xialjy can be expandedaround the averages <X,>, (flij) as follows:
8X,) x UaiJ>+
* \\CAk/<.xy
ife)
SX
= YJ yExisxjy at
k
fe)
A still
khx>
<SXk
A0.35)
matrices:
= O2.u>
=Kij\302\253X\302\273
(^
<6X 8A\">
We
A0.36a)
<\302\247X
bXyu
= <8X,5Xj}
and are,therefore, note that they all depend on the averages of {X,} the of fluctuations. independent Denoting by KT the transposeof the matrix K we may finally write Eq. A0.33)in the following form (Lax,1960):
j($\\hxy=
transform
(K-<^X8A-\302\273T
K-<\302\247X8A->
+ <*2y+ty.(&XidXkSXly)
A0.36b)
By invoking the
samearguments asthoseleading to Eq.A0.34)wecan further into a form displayingthe deviationof the higher order Eq.A0.36b) variances from the Poissonian form:
<5X 8X> = (K ^ at
\342\226\240
<,5X
8X\302\273T
\342\200\242
<<5X
8X>
3<\302\2535X,2>
\342\200\242 \342\200\242
<*,\302\273;
\342\200\242)
A0.37)
256
Again, this is not
Birth-and-Death
Description
of Fluctuations
higher
matrix
a closedequation.However,insofar as the terms containing one has the closedset of equations order variancescan be neglected,
which
could be evaluated. Whenever the system has a single steady state, this truncation procedure asymptotically stable macroscopic is legitimate.The solution of the moment equations then represents a stationform. probability distribution, which may or may not have a Poissonian of asymptoticstability. Formarginally The situation is different in the absence the Lotka-Volterramodel) we expectthe solution to stable systems (e.g., For systems underalways remain time dependent(seealso Section10.6). bifurcation, on the other hand, after a transient periodof evolution we that is representative of expecta new asymptotic solution to be established the new regime beyond instability. One can really speakin this secondcase of \"orderthrough fluctuations.\" states,the Clearly, in the absenceof asymptotically stable macroscopic higher order moments becomeincreasinglyimportant. Thus, the results of the calculation basedon the truncation of the hierarchy of the moment equacould only be regardedas short-time approximationsof the system's behavior, starting from an initial distribution of the Poissonianform. This is sufficient to provide a rudimentary idea of the behavior of the system in the vicinity of the macroscopic steady state. Oneof the featuresof the local theory of fluctuations developed in Chapters 11 is to introduce a new parameter in the moment equations, and 12 related
stationary
undergoing
equations
to the ratio between the diffusion coefficientand a suitable combination of the rate constants.This parameter weights the relative contribution of the Poissonian and non-Poissonian terms in the moment equations and thus proa means for systematicexpansion f or these procedures solving equations. Finally, Eqs. A0.34) and A0.37) illustrate in a striking way the roleof fluctuations in the onset of instabilities. Supposefor a moment that the truncated forms of these equations are valid to a good approximation. Let be a steady-state solution. By varying slowly the bifurcation denoted parameter by A in Part IIwedrive the system to the threshold for an instability. Obviously, if the descriptionbased on the truncated equations remains valid, the system is not going to evolve spontaneously to a new state, but is going to remain on the unstable branch of solutions.According to the completeform of Eq. A0.34),however,we see is going to that d(Xj}/dt build up to a finite value\342\200\224meaning that the system will be able to evolve spontaneouslyfrom the unstable solution\342\200\224provided the fluctuations may values. increasein time and take appreciably non-Poissonian Theseconsiderations shed some light on the very meaning of stability, the purpose which is one of the central notions of Parts I and II.In essense, the test these to out in was of the macroscopic carried response parts analysis
provides
{X\302\260j}
257
of the system to an external disturbance,which, although weak, was assumed be present initially in the system with a macroscopically observable amplitude. The view adoptedin fluctuation theory, on the other hand, is that the system has to generate spontaneously this deviation from the average regime,which could then trigger further evolution to a dissipative structure a \"perturcontribution. In essence, provided it contains a non-Poissonian is identified here to the non-Poissonian (see part of a fluctuation
\"perturbation\"
Chapter11.)
UnimolecularReactions
We
*21
*32
A0.38) A0.39a)
has an affinity
c
with
A0.39b)
= kl2k23
k2lk32
A0.39c)
258
Birth-and-Death
Description
of Fluctuations
The system {X}is supposedly in contact with two large reservoirsof matter containing A and E, such that the content of the reaction volume in A and E is renewed instantaneously, thus maintaining a fixed concentration of A and E therein. Standardchemicalkinetics would describethe system by
A,
= const
dX
\342\200\224
= (k12A + k32E)
(k21 +
k2i)X
A0.40)
value of X where the bar indicatesthat we deal with a \"phenomenological\" determined by the macroscopic equations of evolution. Equation A0.40) predictsthat the system tends,as t -> oo, to a unique asymptotically stable steady state
In the standard description In order to study their fluctuations are neglected. effectwe introduce the probability distribution P(A, X, E, t) and assumethat the reaction under considerationdefines a Markovian birth-and-death process. Equation A0.2)now takesthe following form:
\342\200\224
dP =
kl2(A
+ l)P(A +
\\,X-\\,E,t)~k12AP
A0.42) This is a finite-difference The finite-difference equation with linearcoefficients. is a the the result of discreteness of stochastic property the linearity of the coefficientsis a consequence numbers of of the unimolecularcharacter of the reactions A0.38). The study of this equation is performedmost convenientlyin the generating function representation. Defining [see Eq. A0.21)]
variables\342\200\224the particles\342\200\224while
+ k21(X+ \\)P(A \\,X + \\,E,t) k21XP E + k23(X + \\)P(A, X + 1, 1, f) k23XP E + 1, + k32(E + \\)P(A, X 1, f) k32 EP.
- -
F(sA,sx,sE,t)=
dF =
A,X,E=0
sis$s%P(A,X,E,t)
A0.43)
dF
k12(sx-sA)\342\200\224
dF + k21(sA-sx)
\342\200\224
dF
k23(sE
-S]C)\342\200\224
dF + k32(sx sE)^-
A0.44)
259
If onesolves this equation subjectto the normalization condition, onefinds as f -> oo the only steady-statesolution is given by the equilibrium This is natural, as the system {A + X + E} has distribution of Section been treated thus far as a closedsystem. Eventually, such a system is bound to reach a singleequilibrium state.However, our problemis to study the evoluof an opensystem {X} in contact with large external reservoirs {A} and To this end we introduce the reducedprobability distribution {E}.
9.3.
evolution
P(X,t)=
and
\302\243
A,E=0
P(A,X,E,t)
A0.45)
'2
*
vh n
EP
A,E=0 A,E=0
A0.46)
This equation for/is closedonly when Y,a,e=o EP 1S expressed AP, Y,a.e=o in terms of/ To achieve such a closure we appeal to physical assumptions that are expectedto be quite realistic for the type of system considered What we want to describehere is a non(Nicolisand Babloyantz, 1969). equilibrium steady state; under theseconditionswe have to ensurethat the state of the reservoirs {A} and {E} varies in a much slowerscalethan the state of the system {X}. This scaleseparationnow permits the assumption that AP (etc.), which are conditional averages,do not dependon the state of {X}. In other terms, the statistical correlation between {A} and and the \"small\" system {X} is negligible:
\302\243\",\302\243=0 {\302\243}
A,E=0
A,E=0
P=(A}P(X,t)
A0.47)
Suppressingthe average value symbol for the initial and final product particle numbers, which appear now as simpleparameters,we may reduce Eq. A0.46)to:
^= A
s)\\(k23
)^ - (k12A + k32E)f
A0.48)
260
Birth-and-Death
Description
of Fluctuations
This equation can be solved straightforwardly at the steady state. Taking conditions A0.23) into account we find a unique, properly normalized
solution:
^ ^1
+
A0.49a)
Thus
A0.49c) This identity between statistical average and macroscopic value is a conthe the of of scheme. It can alsobe from the first inferred consequence linearity moment equation A0.32),where a^X) is now a linear function of X obeying
the
- 1)<*>]
(k21
property:
<\302\253,(*)>
+ /c23)<X> A0.50) to physicalvariablesand using Eq.A0.45)weobtain a Poissonian Returning distribution for P(X)(Nicolis and Babloyantz, 1969):
\302\253,\302\253*\302\273
= (ki2A + k32E)
fluctuations
that 1957)
in
Xo
ao
ZAoJ
A0.52)
On the other hand, from Eqs. D.29) is and (8.14) we see that ~5X2/2XO the to second-order the excess around equal entropy steady nonequilibrium state Xo. Equation A0.52),therefore, reducesto
P oc
We
(S2SH\\ expQ-
A0.53)
obtain a formula of the same structure as the Einstein formula (9.27). The difference is that here the excess entropy is computed around a non-
261
Eq.A0.41)
gives
^0 = ^eq = -,
and the nonequilibrium
probability function becomes identical to the formula. Einstein Nevertheless, even far from equilibrium the effect of fluctuations remains small and doesnot influencethe macroscopic behavior, which extends to the nonequilibrium situation. by virtue of relation (9.34), The conclusionthat the theory of fluctuations around nonequilibrium least for our simpleunimolecular states can be terms of thermodynamic functions, is intuitively very appealing.Indeed, the local equilibrium assumption, which has been the starting point for the extension of thermodynamics to nonequilibrium situations, suggeststhat such a reduction shouldbe possible,at least within a certain well-defined range of phenomena.
formulated\342\200\224at model\342\200\224in
Nonlinear
Model
We now
1971;Nicolis, 1972):
*'
\302\273
+M
A0.5*)
The system {X} to be opento large reservoirsof A, M, E, D. is again assumed This time, however, inverse reaction rates are neglected,and the system operatesautomatically far from thermodynamic equilibrium. One can show that by taking back reactions into account in the vicinity of equilibrium, the master equation admits the Poissoniandistribution as long-time solution. In this subsection,however, we are interested exclusively in the nonof the model. equilibrium properties The overall reaction
is:
2A and the
>
+D
-r=klAM-k2X2 at
A,
AY
A0.55a)
= const
262
Birth-and-Death
Description
of Fluctuations
A0.55b)
is asymptotically stablewith respectto arbitrary perturbations. In order to study the effect of fluctuations we introduce a probability distribution P(A, M, X, D, E, t) and assume that Eq. A0.54) defines a in the spaceof thesestochastic Markovian birth-and-death process variables. to the discussion in Section this assumption We recall that, according might well be unrealistic. Nevertheless,we pursuehere our analysis with the the basicideasand techniques of the stochastic primary aim of illustrating
which
10.2,
method.
The next stepis to reducethe master equation A0.2)for P(A, M, X, D, E, t) to a closed equation for the reduced probability distribution P(X, t) by invoking the same physical assumptionsas in the precedingsubsection. We obtain in this way the following equation, which now definesa birth-anddeath processin the subspace of the single stochastic variable X:
at
= kxAMP(X
-l,f)\\)XP(X,t)
kxAMP(X,
t)
y (X + l)(X + 2)P(X+ 2, f)
- y(X We switch
A0.56)
the equation
also [see
A0.57)
Eq.A0.26)]
\342\200\224
= kxAM{s
\342\200\224
\342\200\224
\342\200\224
s2)-r-j
The nonlinearity of the coefficients,as well as the fact that we have a secondorder of the bimolecular partial differential equation for/is a consequence (i.e., nonlinear) character of the reaction. Equation A0.57)can be solved exactlyat the steady state as follows(Mazo, 1975). Dividing through by A s) and taking Eq. A0.55b) into account we
\342\200\224
obtain:
=0 {l+s)dl-2X2f ds2
\302\260'
A0.58)
This is a second-order equation and requires two boundary conditions. of generatingfunctions,|s(| must not exceed Accordingto the definition A0.21)
263
for F({s,}, unity, in order to ensureconvergence of the seriesexpression f). One Thus, we seek here for boundary conditionsat s = 1 and at s = of these is obvious and follows from the first relation A0.23): /(I)= condition we considerthe quantity In order to find the second
1.
1.
I P(X)- I P(X)
^s +
1) and
write
On the other hand, one can seeby writing the master equation A0.56) for that there are equal probabilities dP(\\)/dt (etc.) successivelyfor dP(O)/dt, having an even or odd number of X particlesin the system as X -> oo. We
that conclude
We may
the
with
=1
Feshbach,1953)
LM
where Ix is the Bessel function of Bessel f unctions property
(ia60)
= <*>
7,DX0)
In a macroscopic system Xo is a very large number. Thus, we may usein the above relation the asymptotic expansions This yields: of 70 and
/,.
A0.61)
264
Birth-and-Death
Description
of Fluctuations
This result showsthat the macroscopic descriptionleading to Eq. A0.55) is valid up to terms of order one. In order to compute the variance of the fluctuations one may evaluate the second derivative of from the exact solution A0.60).However, it is just as well to considerthe first moment equation A0.32)for the model.At the steady state one has:
<aiW> = o
or
k,AM
- k2(X(X - 1)>= 0
A0.62)
Usingagain Eq. A0.55b),we find: <X2>-X20= (Xy on substitution of Eq. A0.61) in Eq. A0.62): Hence,
EX2) = {X2}
^\302\260
0A)
^
4
+ 0A)
A0.63)
Clearly, Eq. A0.63) is incompatible with a Poissoniandistribution and, form A0.53). The factor f in front of <X> therefore,alsowith the Einstein-like is model-dependent. The fluctuations in many other nonlinear models involving a single stochastic variable have been tested (Nicolis, 1972; Van Kampen, 1976). The Gardiner,McNeil,Walls and Matheson,1976; answer is a non-Poissonian distribution with mean quadratic fluctuations on the individual kinetic steps.Thus, no general statement comdepending to to be possible for nonlinear systemsoperating far comparable Eq.A0.53)seems from equilibrium, provided a description basedon the birth-and-death master equationsis adopted.We discussthis most important point further in the
sequel.
The next type of example we analyze refers to systems involving more than one variable. The main difficulty here is that the master equations can no longer be solved exactly.Thus, in order to analyze the effectof fluctuations we must appealto the asymptotic methods reviewedin Section10.3. The model we choose for illustration of these techniques is the LotkaVolterra model,discussedfrom the macroscopic viewpoint in Section8.2. The motivation for this choice is twofold.Firstly, the importance of this model
265
in problems involving interacting populations is considerable(see also And secondly, as we saw in Section8.2, the steady state and the Chapter18). solutionsof the rate equations for this model lackthe property time-periodic of asymptotic stability. In this respectthe Lotka-Volterrasystem may be as prototype of any systemin the vicinity of an unstabletransition. considered As in the preceding we assumethat the chemical steps section, A
*' '
2X
A0.64)
In the define a birth-and-death processin the number of particlesspace. reducedform wherea summation over the initial and final productvariables {A, B, E} is performed, the master equation A0.2)becomes*:
dP(X
,' at
t)
= A(X
\\)P(X
t)
f)
Y,
t)
f)
Y,
t)
A0.65)
representation
dF =
Ct
( (n
+ l)fa
f)
d2F
r
CQCt]
dF dF +^+\\)Ar]B +^+\\)AB CQ
Or]
A0.66)
= Sx ~ = sY l
A0.67)
An important point to bestressed at the outset is that Eqs.A0.65)or A0.66) cannot admit factorizable solutions. Even if one starts initially with a factorized probability distribution, the term containing (X + 1) (or the
\\)(Y\342\200\224
* We here formulate the analysis of fluctuations for the chemical analog of the Lotka-Volterra model.The results can be applied straightforwardly to the population dynamical version of the
model, which is discussed in Chapter
18.
266
\302\243,
Birth-and-Death
Description
of Fluctuations
secondderivative in and in the generating function representation) introcorrelations between X and Y. This point is at first sight reasonable in Y coupling appearing in the chemicalscheme view of the X itself.Neverthethis is surprisingin terms of both kinetic and thermodynamic theory of nonequilibrium phenomena.The very basis of the local formulation ofirreversiblephenomena adoptedthroughout this monograph is the concept of local Maxwellian equilibrium, which is assumedto prevail within small volume elements of the system.Now, a Maxwellian equilibrium in an ideal the factorization of the probability distributions system implies necessarily
r\\
introduces
\342\200\224
Nevertheless
of the individual particles! The resolution of this difficulty amounts to realizing that the birth-anddeath descriptionneglectsthe local aspects of a phenomenon and deals of this, the individual exclusivelywith fluctuations in large volumes. Because are lumped degreesof freedom, which locally are statistically independent, at the benefit of the macrovariables such as X and Y that refer to the entire system and, therefore, neednot yield factorizable distributions. Bearing this point in mind we now investigate the asymptotic solution of Eq. A0.66)by introducing the auxiliary variable i/>, Eq. A0.27),and the limit N -* oo.The equation for the generating function becomes:
1 d2i N
d\302\243
<
We
have set:
A
= olN B = $N t = Nt
A0.69)
Clearly a, /? = 0A). In Eq. A0.68)the secondderivative term is multiplied by as a small quantity for N large. We seek \\/N and, thus, may be considered solutions of this equation in the form A0.28): A0.70) where the expansion coefficientsare related to the momentsof the probability distribution by Eq.A0.30).
267
into Eq. A0.68) and identifying equal powers of I, and rj Substituting we obtain a nonlinear system of differential equationsfor the expansion coefficients: da^ = b12
d^bf
-2a!
aal-a1a2--Y
A0.71)
\\2ala2j
/2(<x.-a2)
A0.72) Hadweneglected the term containing l/N in Eq.A0.68),the first two relations would be a closedsetof equations Moreover, independent of the variance bi2.
the matrix
multiplying
I b12 I
in
hand, higher orderterms in the expansion A0.70)of would have introduced new contributions in the equationsfor the variance, reflecting the influence of triple or higher moments. Thesecontributions would all be multiplied by l/N in the equationsand would, therefore, be negligiblein the limit N oc. Let us carry out further the consequences of the limit N -> oo by then first two droppingall terms proportionalto l/N.The equationsbecome identical to the macroscopic rate equationsfor the model [seeEq. (8.2)]. They admit the steady-state solution
i/>
\342\200\224\342\226\272
W/
simplify.
On the other
ax Substituting
= p,
0 a 0
a2 = a
A0.73)
into the
-2^
0 2a
0\\/ftnN
-\302\243)
0/U,
U12I
A0.74)
268
Birth-and-Death
Description
of Fluctuations
The important point is now that these equations do not admit a timeindependentsolution.To seethis, we add the equations for bn and b22.
We
obtain:
jt
On the other hand, we obtain:
(\302\253ft,,
+ pb22)= 2ajS(a+ p)
A0.75a)
the equation for bl2
by differentiating
oncemore
P dx
db22
d2b12_
dx2
~adb^ dx
By eliminating the derivativesof bl x,b22from the first and the third equations A0.74)weobtain a singleclosedequation for b12:
ft
A0.75b)
equationswe must specify the initial conditions. Assume that at f = 0 the system was described by a factorizable Poissonian distribution for X and Y. This means that:
(SX SY),= o = 0
According to Eq. A0.30)theseconditions imply for the
bu{t bu
= 0) = 0
these initial conditions is
2a\302\243(a
o*u+ Pb22=
=
P)x
A0.77a)
a^ [1-
Poissoniandistribution and the fact that, the speaking, system is at a steady state, the variances macroscopically in time, deviate immediately from the Poissonian <<5A\022> and <<5V2>increase regime, and cannot reach a new steady state. Stochastically, therefore, the even in the limit of small fluctuations steady state A0.73) is meaningless, earlier to the truncation performed on the moment equations corresponding in this sectionby neglecting the 1/JV terms. The system exhibits abnormal fluctuations that increaselinearly in time with a periodic\"background
initial
seethat, despitethe
269
noise\"whose frequency2(a/?I/2 is the doubleof the frequency of the macromotion. Eventually, thesefluctuations alter the order of magnitude of As in the moment equations. the \\/N terms that couldno more be neglected a to a result, the average values are driven by the fluctuations time-dependent This is also regime far from the steady state (Nicolisand Prigogine, 1971). confirmed by a numerical analysis of the completemaster equation A0.65) The and Walker, 1976). 1973; (Malek-Mansour, Langlois,Van Nypelseer, that leave latter suggests (seeFig. 10.1) the trajectories systematically the and after few tend, spirals,either to comsteady-state solution performing,a extinction or to a state where Y is absent(seehowever Turner, 1977). that the master equation canalso,onecan show (Reddy, 1975) Analytically admit a steady-state solution centeredaround nontrivial values of X
complete cannot
andK
phenomenon
This \"chaotic\"behavior is strongly reminiscent of the well-known pheof turbulence in fluid dynamics, where the fluctuations also play a
55 54 53 52 51 50 49 48
47
I
\\
\342\200\2420.0192
Time
0.0640^
0.0704 0.0768
o
_Deterministic_ steady state
46 45 44 43
0.0832
\342\200\242-*
0.0912 0.0960
I
42 44 45 46
Figure
47
48 49 50 51 52 53 54 55
for stochastic averages of X and Y in Lotka-Volterra deterministic steady state. Arrows indicate values of time corresponding to different points along trajectory.
270
Birth-and-Death
Description
of Fluctuations
decisiveroleby altering qualitatively the predictionof the macroscopic analysis.We refer to this situation as generalized turbulence (Nicolisand
1971). Prigogine,
fluctuations
of spontaneous deviations from the regime of Poissonian The possibility provides a striking illustration of breakdown of the laws in Section 9.2. we return to this point of large numbers discussed Although and 12, we may already point out that this entirely new in Chapters 11 of the coupling inducedby the chemical reactions, situation is a consequence variablesare as a result of which the transitions undergone by the stochastic not statistically independent events, even in the limit of a large system N oo. These results may well be comparedwith the analysis of the moment Indeed,the structure of the system of equationsperformed in Section10.4. for is equations A0.72) bti identicalto the structure of the generalsystemA0.37) in this equation for the variances.On the other hand, the matrix K appearing to the matrix of the linearized coefficientsof is, in fact, identical system of the Let equations[cf. Eq. F.6)]. A^, u^ be eigenvaluesand the macroscopic K: of (orthogonalized)eigenvectors
-\302\273
where the superscript j in the definition of the scalarproduct refers to the chemical species We expand5X and <5X 5X> in Eq. A0.37) in terms of
u^. We obtain:
j.
and
<5X 5X>
=
\302\243
<a/iav>u/iuv
\302\243
(T^u^u,.
Note that the indices i,jidentifying [i, v are not to be confusedwith the indices chemical speciesin the equationsof Section 10.4. Performing the matrix product K <8X 5X> and utilizing the orthogonality of um we obtain, at the steady state, the following form for Eq.A0.37):
\342\226\240
271
and
<5X 5X>
X <fl2.,v>u,uv
y-^j
A0.78)
real part. Let the eigenvaluesbe real, and supposek^ is the critical eigenvalue with Eq. A0.78)we vanishing at the point of marginal stability. Comparing that the variancematrix contains at least one conclude diverging contribution, to the term \\i = v in the sum. This reflects namely, the onecorresponding the fact found earlier in this section,that the evolution equationsfor the The variances admit no physically reasonablesteady state (Mazo, 1970). can be if the is analysis repeated eigenvalue complex. If the referencestate is an equilibrium or a near-equilibrium steady state, then for a suitable choice of variables, the matrix K is symmetric and any macroscopic perturbation decays monotonously to this state. However, in a general nonequilibrium situation the symmetry of K is not guaranteed. The regression to the referencestate can then either be oscillatory or not occur at all. The argument just developed showsthat at the same time the behavior of the variance matrix tendsto be pathological. whenever the macroscopic rate equationshave an oscillatory Actually, mode, the fluctuations are themselves rotating, as one can see by a closer analysis of the equation for the variances. Tomita and Tomita A974) (see alsoTomita, Ohta, and Tomita 1974) that the rotation of fluctuasuggested can be characterized by the angular momentum-like quantity
fluctuations
As we saw repeatedly in Chapters6 and 7, at a state of marginal stability the matrix K has onezero eigenvalueor a pair of eigenvalueswith vanishing
Mi} =
A0.79)
where the averages are evaluated at the reference state, and SX is formally defined by the right-hand sidesof the macroscopic rate equationsexpanded around the referencestate. They show that M is related to the variance matrix
by
= (K
\342\200\242
<r)r
(K
\342\200\242
<t)
A0.80)
The physical meaning of these relations can be seenbetter by switching to new sets of variables displaying the \"radial\" and the \"angular\" parts of the fluctuations (Kitahara, 1974).
272
Binh-and-Death
Description
of Fluctuations
10.7.CONCLUDING REMARKS
a system in the vicinity of an instability in Section 10.6, structure behaves in much the same way as the to a leading dissipative Lotka-Volterramodel.Firstly, the linearizedrate equationsacquire a mode with a vanishing real part of the corresponding eigenvalue of the coefficient matrix K. This results in an increasein the life time of this mode,which reminds strongly the phenomenon of \"criticalslowing down\" familiar from the evolution of the equilibrium phasetransitions (Stanley, 1971). Secondly, This results in variance matrix is also dominated by this long-living mode. abnormal fluctuations that increasein time and systematically drive the regime. probability distribution away from the Poissonian These conjecturescan be verified explicitly on examplesinvolving ininstabilities leading to spatial patterns or to limit cycles(Nicolis,MalekMansour, Kitahara, and Van Nypelseer,1974;Nicolis,Malek-Mansour, and to multiple steady Van Nypelseer, and Kitahara, 1976; Nicolis,1974a) states (McNeiland Walls, 1974;Matheson, Walls, and Gardiner, 1975; J.S.Turner, 1975). Janssen,1974; Nevertheless,as we pointed out repeatedly, the analysis of instabilities basedon the birth-and-death master equations is subjectto seriouslimitations; hence we discussthe problemof instabilitiesin further detail in Chapters11 and 12, after having developed a basisfor a local of fluctuations in nonequilibrium systems. description
As
pointed out
Chapter 11
To understand the onset of a chemicalinstability* we analyze the behavior of fluctuations in macroscopic systemsinvolving a large number of particles, N -* oo in a macroscopic volume, V oo (N/V finite) and subject to constraints.We want, moreover, to be able to handle small macroscopic and intermediate fluctuations, which are expectedto be the most efficient ones in driving the system away from the unstable state. Supposefor a moment that, in spite of the fluctuations, the system remains homogeneous in space. Below the critical point of instability, the probability distribution a takes Gaussianform:
\342\200\224 -\302\273
where x is the intensivevariable x = (X/V) corresponding to the number of X a The of variance certain constituent. particles dependson the of is of From x and of the size the average Eq. A1.1) independent system.
cr\302\253x\302\273
we see that
dxaz V~m
we concludethat dimensions, macroscopic
* The same arguments should hold for fluctuations systems subject to macroscopicconstraints.
A1.2)
Realizing that
stands here for the size of the entire system, which is of a fluctuation obeying Eq. A1.2)
in fluid dynamics
273
274
Effect
and Multivariate
Master Equation
system.
Conversely,if a fluctuation
ExocO(l)
A1.3)
is to occurwith a finite probability, it is necessarily local, in other words, refersto a small part of the big systemhaving a volume A V, such that (A V)~112 is of 0A). But oneshouldhave to account for the coupling between this small subvolumeand the remaining part of the big system,arising from, for instance the exchange of matter (through diffusion) and energy (through heat conacrossthe surface separating AV and V AV. In different terms, conduction) becauseof the density fluctuations, the system becomeslocally inhomoand the description basedon the birth-and-death master equation geneous A0.2)breaksdown. This argument alsoshowsthat if one wants to maintain the picture of a in a coherent way, one homogeneous large system fluctuating appreciably must introduce large-scale fluctuations of small probability. In linear close to equilibrium both ways of treating fluctuations systemsor in systems are equivalent. This remarkable\"similarity\" property, by virtue of which thus of homogeneity\342\200\224do not matter, is a direct questionsof of the absence of correlations between the individual stochastic consequence variables.*Thesefeatures are no longer found in nonlinear, nonequilibrium
\342\200\224
size\342\200\224and
systems.
volume\" sectionwith a single variable intermediate) in a phase-space the around state a. This state the coordinate includes r, the: AFj, position momentum p and all the internal degreesof freedom {e,} that may play a i rolein the problem.For simplicity, we first argue as if a could only take discretevalues, although the passageto the continuum presentsno special'jj difficulty. In terms of the velocity-distribution function fa of kinetic theory Xx can be given by: (Chapman and Cowling, 1952), ]
in this
\\
!j
the necessityof a local descriptionof fluctuations far Having recognized from equilibrium we first adopt a phase-space descriptionwhere this local character is manifestly preserved. as stochastic* In other words,we choose variables the number of particles,Xa, of speciesX (for simplicity, we deal;!
||
Xx
= /.Ar
Ap{A\302\243i}
* We recall
interactions
(H.4)j '
do
275
Figure
11.1. Instantaneous
velocity distribution
f{v).
space(seeFig.11.1).
A
random fluctuation
3X =
A1.5)
compact form:
state These fluctuations perturb continuously the reference macroscopic variables X,,. The latter obey a kinetic equation of the Boltzmann type Ross and Mazur, 1961; which we write in the Eu, 1974), (Prigogine, 1949a;
dt
A1.6)
term the effectof reactive collisions. The elasticcollision Here,Jr describes from be set to minus the contribution arising (dXJdt)el may approximately the free motion of the particles, {dXJdt)now, if onedealswith systems near a
We assumenow that in the spaceof the variables {Xx} the fluctuations define a Markovian stochasticprocess of the birth-and-death type. The of this for the Boltzmann validity equation has been justified conjecture and Kac this by Siegert A952) A959).Intuitively, appearsto be quite reasonas one now dealswith small coupledsystems for which the objection raisedin Sections10.2 and do not apply. The corresponding generalized master equation has the form
reasonable,
11.1
dpgxj, t)
dt
A({Xfi}
},t)
A1.7)
276
Effect
Master Equation
where the transition probabilitiesper unit time In particular, relations as in Eqs.(9.8) to (9.11).
A must satisfy
the
same
=0 l->{Xa})
A1.8a)
A1.8b)
A({Xf}
-\302\273
>0 {Xx})
* {Xa}) ({X,,}
->{Xa})\302\2430
over Xa one should obtain, by making Moreover, on averaging Eq. A1.7) the Boltzmann-like equation assumptionssimilar to those in Section10.4, as a first approximation: A1.6)
+ terms containing ((SXX SXpy (etc.) A1.9) A final averaging over a has to producethe macroscopic rate equationsof chemical kinetics.
A SIMPLE MODEL 11.3. this sectionwe analyze the solution of the phase-space master equations on a simple but representative model and comparewith the results basedon the birth-and-death description of fluctuations. We again considerthe nonlinear model A0.54). Contrary to the birthand-death analysis, where the only stochastic variable was the total number of particles,within the framework of phase spacedescriptionwe have to derive a master equation for the probability function P({XX},t). There are two basically different processes present. Firstly, there are elastic collisions,which do not change the total number of particlesof constituent X but tend to redistribute the initial Xx values (seeFig. to the Maxwell-Boltzmann law (seeFig.11.2). there are according Secondly, reactive collisions, which change the number of particlesof X presentand modify the velocity distribution. A central problemis, therefore, to account for the combined effectsof thesetwo processes. Severalcases are conceivable, on the of the elastic and reactive effects. depending comparative strengths We can delineate three different limiting regions.
In
11.1)
This correspondsto such problemsas strongly exothermic reactions,or reactions in a rarefied mixture. The relevant equation is that of a stochastic processin phaseand number space,but onewhere the velocity distribution
277
Figure velocity
11.2. Maxwellian
space.
X,,
of
centeredon a Maxwelliandistribution. Essentially,the various velocity regions,and hence also the populationsin the various internal states and positions,are coupledvery loosely.We are not interestedin this regime, as it is remote from the range of validity of the local description
is in no way
adoptedthroughout
this
monograph.
is:
UA*
_y
S^klXaXj +
A1.10)
with
j, Mk = const
are the transition probabilities for scattering between two T,j_kl and Su-,k, molecules in states (i,j) into two molecules in states (k, /) for the reactions to the two stepsin the sequence The systemis assumed corresponding A0.54).
278
Effect
Master Equation
to be macroscopically and to behave as a dilute mixture. In homogeneous the sequelit is convenient to define the following coefficients;
kl
conditions:
*;,\342\226\240.\342\200\236
We may
also note
that
in
= o;
=o sH.u
(]U2)
+x
-^
'
ll\\\"-jl
\"^
f +n
AU3)
Using the form of the birth-and-death transition probabilitiesfor the variables {X^} we have
, t)
dt
^
\342\226\240<?\"
W{X _ u {xrf) _
^
i
i
r.
\"-'a/fLV'1*
1)* (^i
dt
) Jei
+()
\\
dt
A1.14)
yrlow
where the prime indicatesthose particleswhosestate has not been affected and the factor 1/2accountsfor the indistinguishby the reactive collisions, the of X-molecules. ability colliding In principle onehas to solvethis equation by taking into account explicitly We the effectof elasticcollisions. Here we adopt an alternative procedure. first recall that elasticeffectsserve essentially to establish,approximately, a Maxwell distribution;therefore, we neglect their explicit influenceon the master equation (Nicolisand Prigogine, 1971; Also, the flow Nicolis,1972).
279
i
^
i
- XlX'fiP(Xl,
X%,
e denotesthat the variousmolecular populations The superscript are centered around a Maxwellian(seeFig.11.2). Noticethat small fluctuations around the Maxwellian are taking place continuously, and are in fact essentialto keep all of the stochastic variables {X}independent.This equation is in detail in Section11.4. discussed
exp(-mv2/2kBT)
Z~o
to (X
\\)v2
exp(-mv2/2kBT) __
where Zo is a normalization constant.Thus, the whole processis insensitive to which velocitystate in fact receivedthe particle. As a result, the stochastic to a process processin phasespacedegenerates involving a single variable, the number of particles of constituent X (Kuramoto, 1973; Nitzan and Ross, The master equation 1974;Nicolis, Allen, and Van Nypelseer, 1974).
becomes:
u
u
dt
'= I UP({x
\\XU(X
+ i}M, t)
- P({xM}, 0]
2}M,r)
\\f(X + 2)MP({X+
\\)MP({X}M, f)]
A1.16)
280
Effect
and Multivariate
Master Equation
(X
We now
+ 1)
Av2,--->
J
A1.17a)
= ^Ta =
a/i
becomesidentical to the birth-and-death master equation Then, Eq. A1.16) A0.56).This implies* the validity of the non-Poissonianmean-square deviation A0.63). that the birth-and-death result is obtained We see by \"freezing\" the velocity distribution to Maxwellian equilibrium. We expectthis type of behavior to be representative of large-scale fluctuations,which evolvemuch more slowly than the processes related to the relaxation of the velocity distribution. In contrast, local fluctuations evolvetoo rapidly for this type of behavior to be In a sense, is not therefore, the usual birth-and-death description applicable. representativeof the dynamicsof a chemical system,but only of the evolution of the large-scale fluctuations. The latter are expectedto be exceptional events, as long as the system is far from an instability.
4 S., ^0
vl\302\273l
exP
- ^f
ZKB
{v\302\260
+ vfU Ay* J
Avp
U7b)
11.4. APPROXIMATE
We now
(where elastic place ourselves in the secondcaseof Section 11.3 to correspond collisions are significant), which is expected to the behavior of small local fluctuations.Our purposeis to analyze the solutions of the master in a certain well-definedlimit consistent with the premises equation A1.15) involved in the phase-space description. The difficulty in solving the phase-Space master equations arisesfrom the infinite number of coupledterms contained in the sums over states on the right-hand side.On the other hand, this very complexityenablesus to expand the limit systematically such equationsfor small fluctuations; in this case of small deviations from the macroscopic distribution function Xa makes
constant Zo. Thesefactors ensure the correct form on averaging over the microscopic states. obtained
normalization
implicitly in
281
individual
degreesof freedom.
= Xk + 3Xk = Xk + Exk,E< 1
A1.18)
following the expand both P and the coefficients in Eq. A1.15) terms dominant methods outlined in the first part of Section10.3. Keeping and Prigogine, 1971; in we obtain (Nicolis Nicolis,1972): we may
\302\243
8P({x},;
dt
xkP + Xk-~x,P
dP
wherewe have taken into account the fact that Xk satisfies,to this order,the Boltzmann-likeequation A1.10). This simplified equation is now integrated over all x values but one. Defining the reducedprobability functions
A1.20)
t) [V 82Pi(xa, y
Fy
d2PAxx,
Ql
A1.21)
We
seethat Eq. A1.19) gives rise to a hierarchy of equations relating dPJdt an to Pi23 (etc.). 3P12/dt Supposenow that we choose initial condition corresponding to factorized reducedprobability functions:
Pi S({XJ, 0) =
i= 1
[]pi(xh 0)
s = finite
A1.22a)
282
Effect
Master Equation
Because of the dominance of the flow terms over the reactive collision terms, we exceptthe factorization condition to be maintained to a goodapproxiapproximation,
as long as we deal with small fluctuations. This is also supported have the same structure as the that the operatorsin Eq. A1.21) Boltzmann operator in that they connect two states without spatial corcorrelations between particles.We conclude, therefore, that within terms of order e:
by the fact
Pi...J{X.},t)= f[P,(*,,r) ;=
i
A1.22b)
of the fluctuations, implies that the This, together with definition A1.18) last term in A1.21) vanishes. The coefficients of the second derivative of this equation may be further simplifiedby taking into account d2Pl/dxl One finally again that Xx satisfies the Boltzmann-like equation A1.10).
obtains:
+ V (?sx) xp*xl)
sxx)
This equation has the same structure as the linearized At the steady state it reduces to the form equation A0.14).
^-
L23)
Fokker-Planck
we obtain
\022
expf-^pj
A1.24a)
This gives rise to a variance compatible with a Poissonian distribution (see also Klimontovich, 1958):
<xl> = Xa
Similarly, for the higher
A1.24b)
orderdistribution function:
to the expansion of entropy carriedout repeatedlyin Chapter Now, according 4 and also in Sections10.5 and 9.3, the exponent is just the second-order excess entropy evaluated around the reference state.Thus
P.
oc s({*})
exp(^)
A1.25)
Studies
of Fluctuations
283
seethat in the nonlinear, nonequilibrium model discussed in this section, small fluctuations behave in agreement with the generalizedEinstein formula provided the system remains near a local equilibrium regime and can be treated as a dilute mixture. Moreover, the correlationsbetween fluctuations in different regionsof spaceand for different velocitiesvanish. This is quite different from the result based on the birth-and-death master variance of the fluctuations in equations,which predict a non-Poissonian large volumes (seeSection11.6).
We
STUDIES OF FLUCTUATIONS
computer simulation of the dynamics of a reacting mixture is, per force, a It should,therefore, be able to illustrate local descriptionof the reactions. the difference between phase-spaceand birth-and-death type theories. Moreover, in a machine calculation, the fluctuations are predominantly small in extent, and hencethe results of the calculation decide directly on the behavior. question of Poissonian for the reaction Portnow A974, 1975) conductedcomputer \"experiments\" with as chemical hard schemeA1.13), speciesrepresented spheres (with carried out at T = Ar mass and radius) and the experiments and with the walls are specular at a density of p = 0.001 7837 g/cm3. Collisions to the chemical reflections.The particlesare given identities corresponding t heir identitiesare modified two Whenever involved. collide, particles species in accordance collisions b etween with the reaction scheme. all Thus, reacting there is no activation energy for any of the speciesare reactive collisions; reactions,and all rate constantsare equal. Sincemany reactionsproceed without an activation energy (e.g., ion-molecule reactions),the model is not without reality. As the reaction proceeds the number of particlesof X is determined at different times. Sufficient time is allowed to elapsebetween measurements for memory effects to be unimportant. Moreover,it is verified that the to the Maxwellian distribution. The velocity distribution remains close mean and the variance of X are deducedand a test for goodnessof fit to a Poissoniandistribution is made on the observedparticle number distri273\302\260K
distributions.
For model A1.13), 25 M particles,and 25 A particleswere 25 X particles, x 10 The ran for 3.146 ~8s, and there were initially. experiment 1941reactive and 4067 unreactive collisions. After 30 observations the mean and the variance were,respectively,25.2 values The expected and 23.3. for both quantities, if the distribution were to be Poissonian,were 24.5, whereas if the birth-and-death descriptionwere valid, the variance should
taken
284
Effect
and Multivariate
Master Equation
= 18.3. have been f x B4.5) Thus, the molecular dynamics results are and they underscorethe compelling evidence for a Poissoniandescription, of fluctuations in nonlinear, nonequilibrium importance ofa local description
of fluctuations
been reportedby
in progress to investigate the growth of instabilities. Someresults have already Ortoleva and RossA974b).
the
vicinity
11.6. DISCUSSION
From the procedurefollowedin Section11.4 it shouldalready be clear that Einstein-like result A1.25) concerning the behavior of small local fluctuais quite general and is, in fact, independent of the chemicalmechanism. This can be verified explicitly,even for systemslacking asymptotic stability such as the Lotka-Volterra* or trimolecular models(Nicolisand Prigogine, We conclude, Nicolis,1972). 1971; therefore, that a system in the vicinity of a point of marginal stability cannot evolve by a mechanism of small local fluctuations. On the other hand, experiment showsthat there exist systemsthat present Forsuch systems spontaneously instabilitiesleading to dissipativestructures. fluctuations of a certain type should,therefore,presentan abnormal behavior as summarizedin similar to that predicted by the birth-and-death description, Section 10.6. The results of Section this should be the suggestthat caseof large-scale fluctuations\342\200\224in a sensebetter defined can t he state of \"see\" the and be can, therefore, amplified if only average system of the macroscopic evolution equations predicta point of marginal stability. that the onset of a self-organization processes We conclude implies that there existsa volume element within the system of dimensions much larger than the characteristicmolecular dimensions but smaller than the total volumeof the system,within which fluctuations behave coherently, and that they add up to a sizableresult and subsequently modify the macroscopic behavior.
the
fluctuations
11.3
below\342\200\224that
that in the Lotka-Volterra model (&2SH is may recall, from the analysis in Section 8.2, related to the constant of motion or, more precisely, to its expansion for small deviations around the steady state. Thus, relation A0.25) becomes:
* We
Pacexpffii')
where A957,
fl
A1.25a)
is a parameter. In this limit our result agrees with the statistical analysis of Kernpr based on the derivation of a \" Liouville-like\" equation for conservative systems 1959) a but even number of variables. For finite fluctuations Kerner's results differ large involving
qualitatively from the predictions based on the stochastic master equations. surveys of Kerner's approach, we refer to Nicolis A972) and May A973).
For recent
critical
Reduction 11.7.
to
a Multivariate
Space
285
The passagethrough thermal fluctuations to this macroscopic coherence as a specifically volume may bedescribed nonequilibriumnucleation phenommaster equations of a new kind. In principle, by solvingthe phase-space for finite fluctuations one should be able to display this phenomenon
phenomenon
explicitly. The molecular dynamics methods shouldalso provide a means volume. for calculating the critical dimensions of the coherence We now adopt a different strategy. Because of the complexityof the phasewe try to define conditionsunder which the phase-space spacedescription, equations can reduce to simpler ones,by retaining only those variables measurement.This enablesus to estimate directly accessible by macroscopic of the coherence the dimensions volume and to relate it to the system's
parameters.
MASTER
IN EQUATION
macroscopic system can always be viewedas a set of cellscommunicating between themselves via a transport of energy and matter. Let X be the characteristic length of each cell, and for simplicity let us assumethat we We want to set up a deal with transport along a single spatial dimension. stochasticdescriptionwherein the variables are the numbers of particles within the various cells,independently of their momenta or their internal states.This will constitute an \"intermediate\" level between the birth and death description, where all cellsare lumped into one,and the phase-space where the cellsare of microscopic dimensions. We imposeon X description
the following
conditions:
In each cell the average number of particles is significantly larger than one. This implies that X is at least of order of ctr = lr, where c is the thermal speed and tr is the relaxation time of the system. Hereafter, the length lr = ctr is referred to as mean freepath. The individual cellsare not experiencing the macroscopic inhomogeneities that may appearin the system. This implies that X <? tchc, where fch is the time betweentwo successive us to go,in the reactivecollisions. This enables sense,even sequel,to the limit of a continuous system in a macroscopic
X cannot be strictly though that the descriptionwe attempt
is the
here breaks down unlessrch > tr. This can be treated by the mac-
macroscopic
monograph.
286
Effect
and Multivariate
Master Equation
In orderto advance from the phase-spacedescriptionto the reduced descriptionin terms of cells,we may start from an equation of the type within the and sum over all values of the occupationnumbers {X,} A1.15)
individual
cells. We
probability
= X p{X1,...,Xn,t)
jX,J:(Ecell
PHX,},t)
A1.26)
where Xt now denote the numbers of particleswithin the cells 1, n, irrespectiveof their velocities,and the operationincluded in the sum has the
following
{.Yj}:
2,...,
meaning:
=
{X{r,
\342\226\240
tecell
-x < px.
py, px
cell
,....n
words,we sum over all occupationnumbers in velocity spaceand over those occupation numbers in ordinary space whose Cartesian cocoordinates rx, ry, rz are included within oneof the cells1 to n. The generalizato an arbitrary number of reacting chemicalsis straightforward. By master on the phase-space performing the operation indicated in Eq. A1.26) to a term the side left-hand rise dp/dt. equation, gives straightforwardly In the righ-hand side we analyze, successively, the structure of the flow and reactive terms.
In other
generalization
Flow Terms
between the effectof the free flight of particles Originally,theseterms describe elasticcollisionson the probability function P. In a dilute mixture, and provided ?.satisfies the two conditionsenunciated at the beginning of this an additive contrisection,this term gives, on summation over X(r, p,...), over cells. Fora given cell, this contribution expresses the frequency of change of the cell's content in X due to freemotion. It is well known (Wax, that this motion has all the characteristics of a random 1954; Kac, 1959) from walk, provided the state of the system does not deviate significantly the Maxwellian. Hence, we may write:
contribution
Ft
=
{Xi}:
Yj
fl\302\260w
term
Ic cell,.
w(X(
-\302\273
Xi
\\)p(Xu
Reduction 11.7.
to
a Multhariate
X X
Space
287
X stands for Particle transport between adjacent cells,i, in configuration Figure space. characteristic length of the cells, and dotted line indicates axis along which transport takes
11.3.
i-
;+ 1
place. In
that:
time,
w,
we recall
-> Xt
v, t)
A1.28a)
momentum
where Zx is the boundary surfacebetween two distribution function in the ith cell, such that
cells,and is the
fx\\i,-v,r) =
-iX,
A1.28b)
f*(i) to be nearly Maxwellian, but allow for the number of particlesX to In a sense,contrary to the birth-andfluctuate and vary from cell to cell.* death description,we assume that fluctuations remain in Maxwellian equilibrium in velocity space but allow for spontaneousspatial inhomogeneities caused by the random thermal motion of the particles.Relation
v is the component of the velocity along the direction of transport (see Fig.11.3). imposedon the dimension k we take Invoking onceagain the conditions
becomes A1.28a)
J\\dJ.xv~ Jo where has beennormalized within each cell,which is taken to be a cubeof sideX. Finally, invoking homogeneity within each cellwe obtain:
w(Xt
t Xi<My,
1) = 2 f
dv
t)
*\342\226\240
-\\) = 2dXt
dv vo
A1.29a) A1.29b)
where
d=
* In
Tosimplify
general, the internal energy and the momentum of the center of mass ofcelli alsofluctuate. the analysis we consider here exclusively the problem offluctuations ofcomposition.
288
Effect
and Multivariate
Master Equation
By construction, d is independent of the labelof the cell. Moreover,because 4> is nearly Maxwellian,the kinetic theory of gasesprovides us with the relation*
Jo
a a. avvcp =*
D
\342\200\224
lr
Now, k itself is of the order of a few mean free paths. Moreover, k = (l/n), where / is the total length of the system and n the number of cells. Thus D= d ^--2
finite
A1.30)
Eq. A1.27).
ReactiveTerms Coming now to the reactive terms we obtain, on summation of a master an expression over X(r, that in the case equation of the type A1.15) of a bimolecular reaction is of the following form:
p,...),
*\342\226\240\342\226\240=
tXi}:l\302\243
celli xp
T.SafiXaXllP{Xa,Xfi,{X'},t)
A1.31)
The difficulty with this term is that the summation refers to a contribution that is nonlinear in the occupation-number distributions. Moreover,these distributions appear explicitly within the probability function P. Again, on the sizeof the cellswe expectthat however,by invoking our assumptions
* Kinetic
theory
ofgases isinvoked here on the basis of our assumption that the reacting mixture of the system's parameters if Z>, lr, and so on are very complicated functions a solvent. dense in place
Multhariate 11.8.
Master Equation in
a Model
System
289
can be approximated by a Maxwellianwith a fluctuating number of definition into account we then have: T aking A1.17b) particles.
Xa,
Xp Rt
= k2
IX,}:
r,.T2
I X(ri)X(r2)
x
IXi):
oc
P(Xa,Xfi,{X'},t)
A1-32)
where k2 is the
has been rate constant and the sum over {X,} macroscopic into two in to parts referring, respectively, occupations velocity and split and the restrictions ordinary space. Taking into account definition A1.26) on in we obtain: imposed tu r2 Eq. A1.32), finally
R,
= k2Xfp(Xu...,Xi,...,Xn,t)
A1.33)
and A1.33) and summing over cells, Combining now expressions A1.27) we obtain a multivariate master equation for the reduced probability function Xn,t). This equation can be written in a system that is macroor inhomogeneous, scopically homogeneous provided the dimension of the the beginning of this section. satisfies the discussed in cells requirements from this can calculate such quantities as the means one Starting equation The latter or variances within a cell as well as the variances betweencells. about in the information the correlations system.This provides spatial Our calculation is carriedout explicitly in Section for a model system. main purposeis to analyze the behavior of the fluctuations as the system is preparing to approachthe instability point from the pretransitional region.
p(Xi,...,
11.8
11.8. MULTIVARIATE
Here and
in
MASTER
IN EQUATION
MODELSYSTEM
we want to investigate closelythe Sections 11.9 and between fluctuations. and relationship stability Starting from an asympstable situation, we first obtain information about the origin of the non-Poissonian behavior of fluctuations. We next considerthe limit as the critical point of instability is approached. We show that in this limit the non-Poissonian behavior givesriseto somenew and unexpected phenomena, such as the building up of long-range correlations. The model we choose to illustrate these phenomena is the trimolecular model discussed the extensivelyin Chapter7. In the notation of Section11.7, solution on the thermodynamic branch readsfor this model: macroscopic
asymptotically
11.10
Xi,0 = A
YL0
=^
A1.34)
290
Effect
Master Equation
or no-flux boundary assuming fixed boundary conditionsof the type G.14) on we concentrate fixed conditions. conditions Hereafter only. Much of our analysis is devoted to the behavior of the solutionsof the multivariate master equation appropriatefor our model around the macroForreference however,we first compilethe results of a state A1.34). birth-and-death analysis of the trimolecular model,where it is assumedthat fluctuations remain uniform in space.
macroscopic
HomogeneousLimit Let p(X, Y, t) be the probability function for the two-variable intermediates. the master equation for p(X, Y, t) According to the results of Chapter 10,
reads:
l)(X 2)(Y +
\\)Yp{X,
Y,t)
t)
X t)
K t)
A1-35)
This equation can be handled by the cumulant expansion technique described in Section10.6 on the birth-and-death analysis of the Volterra-Lotkamodel. This gives us a set of equationsfor the average values of X and Y and a set of equations for the variances that will dependnonlinearly on <X> and <Y>. As long as the variancesremain of the same order of magnitude as the mean values (fluctuations not far from the Poissonianregime) and the latter are the equationsof evolution for the averages reduce large enough (X, Y > 1), to the macroscopic equations.*Becauseof this, the equations for the variances of the secondorderreduceto a linear set of equationsof the form the variances of the third and higher order are A0.35)provided, of course, if Furthermore, we want to describe the early stages of the neglected. spontaneousevolution of the variances starting from the homogeneous The steady state, we can fix (X), <Y> to the values given by Eq. A1.34). of with for the then reduces variances to a linear system equations system constant coefficientsof the form A0.74). seein subsequent sections, the system is bound to remain in the vicinity ofa Poissonian regime if the diffusion dominates over the chemical reactions. By neglecting the effects of difas one does in the birth-and-death treatment, one can no longer dispose ofa systematic diffusion, of from the Poissonian distribution. deviations measuring way
* As we
Multivariate 11.8.
Master Equation in
a Model System
291
I)
we obtain
in this way
AL36)
Nicolis,1976):
~=T+CM at
which
A1.37)
is reminiscentof Eqs.A0.35)or A0.74)derived previously in a different context. The meaning of the various symbolsis as follows:
\342\200\242
orderand
may
be
formally
as
C=
rx/ + /xF
(B
A1.39a)
~{-B
and / is the
unit matrix
-A
n\\
A2
/1
A1.39c)
in Eq. A1.39a) is calledthe exterior The-operation represented product (or tensor product) and converts a 2 x 2 matrix operatedon by C into another matrix. In an explicitrepresentation, C has four indices and its elements are given by:
2x2
A1.39d)
where 5*rq is the Kronecker delta.
292
Effect
and Muttivariate
Master Equation
a system of equationssuch as Eq. A1.37) However, as seenin Section10.6, deviations from the for the variances generally predicts macroscopic At the steady state these deviations are given by the Poissonianregime.
following
equation:
PI
or, taking
into account Eqs. A1.36) and A1.39) as well as the symmetry of the matrix Mpq:
(B - 2(B
1
\\)MXX
A2MXX
A2)MXX
+ (A2 + + (A2
B)MXY
+ (B
- 1
B)Mxy
is easilyseenthat this setof equations cannot admit Poissonian fluctuations Moreover,as the point of marginal stability B = A2 + 1 [Eq.A1.40)]. to the bifurcationof the limit cycleis approached (seeSection corresponding of t he matrix the coefficientsof becomes: 7.4), Eq. A1.41)
It
2A2
A2
_j
0
0
A2
_ J -2A2
This matrix is singular. In other words,the steady-state variances tend to diverge as the critical point is approachedfrom below.We return to this sections. important point in the subsequent Effectof Diffusion on MasterEquation
We now
adopt the more realistic picture of a birth-and-death processin the of the variables Xu Yu space Xn, Yn referring to the n number of cellsin which the system has beendivided. In order to express the constraint of fixed conditions we the consider t hat is boundary system interacting at its endswith and two cells, 0 and n + 1, where the concentrations of X and Yare imposed
...,
Multivariate 11.8.
|{ |
=
+
i =0 Z
Master Equation in
a Model System
293
The master equation for the probability function equal to Eq. A1.34). Yn + t) reads(Lemarchand and Nicolis,1976): p(X0, y0, Xu Yu...,Xn+u
i,
iV.
\342\200\224
\"!)-(\302\253+
2)p]
I ^^.-i)(A-,-2)(yf
O
n+1
i
-^
B\\\\
(X, Li=0 L
\302\243
+ 1)P(X, +
1,Yt
,=0
i=0
dJ(X0+
(Xo
\\)p(X0
+ (Xn +\\,Xl-\\)
i= 1
1+
\\)p(Xn
+ Xn+1)p +
(X,
i, y, - i) + (yn+1 + i)P(yn - 1,
yB+1
We havenoted explicitlyonly thosearguments of p whosevaluesare different from Xo, Xn+l, Yn+1. Similar multivariate equations have been
systems and for systems undergoing transitions between multiple steady states and by Kuramoto A974) for the bimolecular model A0.59)discussed extensivelyhere and in Chapter 10. can be handled in a manner similar to the homogeneous Equation A1.42) birth-and-death equation A1.35), in order to get a closedset of equations for the variances around the macroscopic The calculations state A1.34). leading to these equationsare long and are not reproducedin detail. We
Yo,...,
294
Effect
Master Equation
only outline the analysis of the terms arising from the transport of particles acrosscells. The complete final result is obtained by combining these Within each contributions and those arising from the chemical reactions. derived in the first subsection the latter are identical to the expressions cell,
Contribution of Flow terms to Averages the last two termsof Eq.(l 1.42) by Multiplying over cell occupations we obtain:
Xt(i
# 0, n + l)andsumming
flow
In the
first X'j
= Xj + 1,
1 is
X'J+l
= Xj+l
\342\200\224
1 the curly
If
j,j 1,or j +
\342\200\224
in
terms are:
/flow
X,
(Xt
-2XtXi+l -2XiX,._l}
A1.43)
On the right-hand sidewe multiply
cell, keepingin
mind that k
= l/n. We obtain:
->
>
dt \"r
I /flow
'
AL44)
The secondfactor on the right-hand sideis the well-knownfinite-difference The first approximation of the secondderivative operator (Krank, 1970). term is related, accordingto Eq. A1.30), to the Fick diffusion coefficient, Du of the productX provided X ^ lr. Thus, in the limit ofa continuous system the rate of the transport of secondlaw describing X/l -* 0, we recover Fick's matter in the vicinity of a point in space. This is in agreement with both the about models macroscopic analyzed in Part IIand the remarksin Section11.7 the passagefrom phasespaceto multivariate master equations.
Multivariate 11.8.
Master Equation in
a Model System
295
Contribution
The contribution of the flow terms to the variances is handled in a similar and sum over way. We multiply both sidesof Eq.A1.42) by XtXj, Xt We define [cf. Eq. A1.36)]: cell occupations.
Y,-,...,
MXlX}
= <(Xi
y y y
<Xi\302\273{Xj
<*,\302\273>
A1.45)
with i
MX.Y.
# j:
, J
dt
/flow
l(X,l k= 1
_!
(Xi(
- l,Xk + l) + p(Xk+
)
'flow \\
\\,Xk+i
- 1)]
A1.46)
k=i
Ul
/flow
we see that the first same arguments as in the previous subsection, or k + 1 is equal to i orto This yields, bracket vanishes unlessif k, k 1, remembering that i #
By the
\342\200\224
j:
j.
i
flow
- 1)- 2XfXj +
(Xt
\\)Xt+1Xj
XiXj
+ XtXi+iXj +
- 2XiXjXi+1- 2XiXi-1XJ+
\\ /flow \\
(Xi
+ VXt-iXj + XtXt-iXj
symmetric terms} at
yflow
flow
A1.47)
25*6
Effect
Master Equation
In the
to
reducesto a form similar of a continuous system this expression from the macroscopic law A1.44) by a factor of two. Note that this result involves no approximation related to higher order variances, which can only arisefrom the chemical terms.
limit
Equations for Variances Taking into account the explicit resultsderived in the previous subsections we may write the system of equationsfor the variances in the following compact form (for details,seeLemarchand and Nicolis,1976)
i
ax
Mu
= Eu + ZKijklMk,
u
i,j=l,...,n
My l
yJ
*
A1.48)
In
of M[Eq. A1.36)]:
A1-49)
The objectsEtJ and Kijkl are, respectively, matrices having the same structure as F, T, or S, and B x 2) x B x 2) tensors having the same structure as C.They differ from T and C defined in Eqs.A1.38) and A1.39) terms related to diffusion. More one finds for constant by explicitly, boundary conditionsthat (Lemarchand and Nicolis,1976):
(i)
2x2
;j
A)
A1.51)
Note that these propertiesof K confer to the contribution arising from the the familiar structure appearingin Fick's transport of matter in Eq.A1.48) for in diffusion, agreement with the remarksmade in the preceding equation subsection.
297
Relation A1.48)is a linear set of equationsthat can be solved straightTo this end, one must determine (seeChapter 7 for a similar the eigenfunctions and eigenvalues of the operator K which, discussion) as we just pointed out, has the structure of a diffusion operator in a finite differencerepresentation. Considerfirst an operatorL, such that
ISj = fJ+x+fj-x-2fj
Let
We
\342\200\224
A1.52) A1.53a)
kk,
Luf = -Xkuf uf = c sin into account: A1.52) + 1)+ sin /ik(j 1) 2 sin /ikj}
- -
sin nkj)
is satisfied. In order to satisfy the boundary conditions Thus, Eq. A1.53a) as well, we need to have /xk = (kn/n + 1).We concludethat
(*) uf 1 = c sin n +
\342\200\242
kn
\\
\342\226\240
= l(\\
- cos-kn-)> 0
A1.53b)
of the If instead of L we have an operatorhaving a matrix structure because the effect of more than one chemical, then the operatorexpressing presence of diffusion on the equations of evolution is of the form (see Section7.4 for a similar problem) 0 0
d,LY
A1.50b)]:
298
Effect
Master Equation
If, in addition, one has the contribution Y [see Eq. A1.40b)]coming from the linearized chemical kinetic equations, then the \"eigenvalue matrix\" of the operatorappearingon the right-hand sideof the differential equations is Ak
= Y-kkA
A1.54)
operatorK whose structure is that of a linearized chemicalkinetic operator plus a diffusion operator. To this end, we seekfor a linear operator P transforming Eq. A1.48) to
the form:
ivi iii
\342\200\224
<*kl
'
kl
kl
^^
\342\200\242-)-))
with
Mij
= Y.pUkiM'ki
A1.56)
Moreover,we require that P possessan inverse. Substituting Eq. A1.56) we deducethe following into Eq. A1.48)and comparing with Eq. A1.55),
relation between P and
i\302\243:
mn
/ . ^rsmn'mnpq
^rspq~&
pq
{ll.Jlf
Keepingin
JSfp,
mind the structure A1.51) of K we seekto determine P when has the following form:
i\302\243pq
=C
Xp
kql x
A1.58)
where kp is the eigenvalue [Eq. of the diffusion operator in finiteA1.53b)] now reads: differencerepresentation. Forfixed p and q relation A1.57)
{A
- 5r0)Pr_
!.,.\342\200\236,
+ + +
(kp
{A A
-2 +
\"
<5s.n
dr0
dr,n+1)Prspq
x A =0 1)Pr.s+1.M}/
(U 59)
The operation described insideeach bracketis identicalto the finite-difference This enables refers to the indicesr and s successively. a nd A1.52) operation us to seekfor solutionsof Eq. A1.59) in the following factorized form:
*\342\226\240
299
Thus, the equation satisfied by Prs has a structure similar to the eigenvalue We have, therefore, for fixed boundary conditionsthe problem A1.53a).
F:
Prspq
= c sin
-^ -^
rpn
\342\200\224J\342\200\224-sin\342\200\224\342\200\224-
+ 1
. sqn sin
n
+ 1
A1.60a)
l
where c is an arbitrary constant. The elements of the inverse operator P are easily found to be:
--1-
[2(n + l)]2c
-:-JHLs[nJVL w + 1 w + 1
in
i.6ob)
A1.61) + l)c + 1 G+ AS) b*/We are now in positionto solve Eq. A1.55) for M'kl. Knowing M'u we can next determine Mkl from Eqs.A1.56) and A1.60b). We are first interested in solutions. A fter a few steady-state straightforward computations we find:
\302\253
A1.62a)
The diagonal element of the operator <gu, and A1.40a)]: [cf. Eqs.A1.54) expression
5\302\243kk
is given by [Eq.A1.58)]
Ak
the
A1.62b) It has, therefore, the structure of a B x 2) x B x 2) tensor and represents the combinedinfluence of chemical reactionsand diffusion. The operator
kk
= Ak
I+ I x
S\\
s = r + rs + srT
i\302\243k~k
Bx
2) matrix:
(ii.62c)
Tr being the transposeof the matrix F.It dependssolely on chemicalkinetic contributions and is, therefore,independent of the labeling i of the cell. Note that the inverse operation in terms of Ak may be expressed and of its scalar eigenvaluesa>kl, a>k2 that correspondto the eigenvalues of the linearized problemdealt with in Section7.4. One finds (Lemarchand and
Nicolis,1976):
x {a)kla)k2I x + [Ak (Mi, x [A + (<utl <otl)/]}
+ co^)/]
A1.63)
300
Effect
Master Equation
Let us now discusssomequalitative propertiesof the steady state solution to a Mfp contains one contribution corresponding Poissonianvariance and one additional term expressing correlations spatial In order to analyze the relative importance of these two between cells. contributions we display explicitly the size of each cell and then go to the limit of a continuous system. Let / be the total length of the system. The size is obviously equal to l/n = A. Forthe chemical reaction of each subsystem occurring within each cell,this size appearsexplicitlyin the kinetic equations Forthe trimolecular model one has: for the numbers of particles.
We see that A1.62a).
jy\\
dt
dY\\
y2v
A2
oy
X
)ch
A1.64)
_BX
X2Y
The coefficientsI/A, and I/A2 do not change the structure of the equations for the variances, but the three matrices F, 7, and S defined in Section
must
11.8
Thus, these matrices are independent of the size of each cell.Then, the is obtained by writing AS and XT in placeof S and T solution of Eq.A1.48) in expression This implies that & [see definition A1.62c)] is to be A1.62a). the XS. now takes form: Relation A1.62a) replacedby following
be redefined as follows.The same expressions as before hold, but each now concentration instead of a number of particles. a symbol represents
x Dividing
{(F-
Xk
A)
/+/
X2
x (F
XkA)}-l\302\243
A1.65)
through
both sidesby
and introducing
<*,\342\226\240\302\273
= /(X,
(Xj
\\\342\200\224x
~~x-^~
A1.66)
<Xj-\302\273
<y8f; + -lGxiix
A1.67a)
301
{(F-^A)x /+ / x (r-^A)}\021^
A1.67b)
The function
when n
on n, but it may be shown that it remains convergent Gtj depends tends to infinity, that is, when the limit of a continuous system is taken, providedthe coefficients dx and d2 remain finite. It appears,therefore, that in this limit the system is dominated within each cell by Poissonian-type fluctuations, in completeagreement with the results of the phase-space of fluctuations. description One can obtain a more explicit form in the limit as n -* oo by taking into between the transport frequencies account the relation A1.30) diffusion coefficients Fick's D2.Introducing the matrix
\302\243>,,
d,,d2 and
I)
we may
write
the factor F
\342\200\224
Xk
appearingin Go as:
.
or
k\"(n+IJ
01.39)
^-ji^-p\342\200\224 ->\342\226\240
This expressionis to be compared with the eigenvalue of the secondderivative operatoranalyzed in Section7.4. The final transformation we need is that of the term n dff in expression In the limit n oo this tends to / d(rl A1.67a). r2), where 5 is the Dirac function. As a result, calling ru r2 the coordinatesof cells Uj as their size relative to the length / goesto zero:
r2) = <x}8(ri m**(n.
r2)
- Gxx(ri,r2)
l.70a)
302
Effect
Master Equation
where
\"u
ri)
\342\200\224
Z cos
~^~1\342\200\224~
kn
\342\200\224
cos
-^\342\200\224-\342\200\224-
kn
S A1.70b)
we have pointed out, the influenceof spatial correlationson a given is cell small compared to the effect of the Poissonian-like contribution, small.However, the situation can change if the size of the cell is sufficiently completelyif the diffusion rate can be neglectedas comparedto the chemical the expression for GtJ reducesto: term. In this case,
As
G,
= =
A >
cos(i-(-j)
kn
\342\200\224
cos(; j)
\342\200\224
kn
A1.71)
x
contains, then, two terms of the same orderof magnitude: Expression A1.70a) 8 8f?Ux>
[(F x / + /
D\"
Wxx}
A1-72)
This is the result obtained from the birth-and-death description, where the system is lumped into a single cell and diffusion is neglected. In the oppositelimit when the diffusion is very fast the spatial correlation term A1.70b) becomesstill smaller relative to the Poissoniancontribution, as it is inversely proportionalto the magnitude of the diffusion coefficients. It is striking to see from this discussionthat the birth-and-death and phase-spacedescriptionsappear to be two facets of the same problem, corresponding simply to different limiting situations.
BEHAVIOR 11.10. CRITICAL
We want
the state of marginal stability corresponding to the as the system approaches onset of a steady-state spatial dissipative structure or of a time-periodic solution. In both cases we assume that the critical point is approached values of the confrom below.This enablesus to pose the macroscopic
concentrations
Gxx(ru r2)
equal to the uniform steady-state solution A1.34). The transition to a dissipative structure in the trimolecular model is analyzed at length in Chapter7 from the standpoint of a purely macroscopic As in the beginning of Section11.9, we outline here briefly the description. in in a modifications description terms of discretecells. principal arising
303
Part that linear stability is determined by the sign of the the real of parts eigenvaluesof the operatorappearingin the linearized ofevolution. In the trimolecularmodeland for a continuous system equations is L and its propertiesare discussedin this operator, given by Eq. G.20), in In Section 7.4. the discrete detail representation the corresponding in is defined more or, Eq.A1.54) operatorAk explicitly:
Firstly, we recall from
II
) -A2-AkdJ
A1.73)
The eigenvaluesa)ki, cok2 of this matrix can where kk is given by Eq. A1.53b). similar to Eq. G.28). be constructed explicitly and are given by expressions of the quantity In view of the explicit form A1.63) appearingin the correlation function, we are only interested here in the product and the We find straightforwardly: sum of these roots. = trace of Ak = B 1 A2 kk(dx + d2) wkl + o)k2 = determinant of Ak = A + kk dt)(A + Xk d2) kkB d2 A1-74) cokiwk2 The macroscopicequations of evolution in the discrete representation n present an instability wheneverthe sum or the product involving cells1, of the two roots crosses the value zero. KeepingA, du d2 fixed,we seefrom the to t hat condition leading an instability is written in terms of B Eq.A1.74) as follows:
5\302\243lk
- - -
B> 1 + A2^
B
d2
Xk
dl
+~ =Bk
/* d2
A1.75a)
+ d2) = Bk A1.75b) for bifurcation of a time-periodic structure. Theserelations are represented which replacesFigs. 7.1and 7.2of the continuous graphically in Fig.11.4,
> 1 + A2
kk(dl
formalism. for an
that from Fig.11.4 more specificallyrelation A1.75a), we see Concerning it is that to lead to a stationary spatial structure necessary instability be curve.The the the valuesof minimum of Bk larger than marginal stability similar to K and Bk corresponding to this minimum are given by expressions
Eq.G.35):
L=(d,
A1.76)
d2)1/2
304
Effect
Master Equation
+A2
Figure
11.4. Marginal
in
stability
of oscillations
curves for trimolecular model corresponding to onset of a (Bk) in representation in terms of discrete cells.
Finally,
drawing
that
waslower than
holds:
we have supposedthat the minimum of Bk Fig. 11.4 of Bk. This is satisfiedwhen a relation similar to Eq.G.36)
A1.77)
the transition to a steady-state dissipative and implies that as B increases, structure occurs pattern. beforethe transition to a time-periodic Coming now to the behavior of the correlation function G*x we first on k of the coefficientykkl<$ in the trigonometric analyze the dependence of seriesrepresentation G*x.This quantity plays the role of a \"form factor\" and would be identical to the Fourier transform of the correlation function Subif the system were taken to be infinite (Landau and Lifshitz, 1957). of the i nto definitions the to Substituting explicit expressions A1.74) A1.77) and given in Section11.9 one finds for a discretesystem:
S\"
5\302\243kk
5\302\243kkl&
= 2AB{'Al 2
A2
~'
B
dl
(A2
+1
-A2dl-d2
B)d2
-A2dl
d2
Bd2
+
x
-d,d2
+ di d2
-dt
0
x [A2
d,
- (B
\\)d2)
X2
d,
305
\302\243\302\243^3
obvious that and from Eq. A1.75) it becomes From this expression sharperas B approachesBc.At B = Bc presentsa maximum that becomes the form factor diverges.This impliesaccording to expressionA1.67b) for Gtj that the range of correlationsis increasing as one approachesthe describes the shapeof the form factor for a system critical state.Figure 11.5 to the cellsand for various values of B up to the value corresponding of 100 state of marginal stability. The increaseof the range of correlationsin the critical region is also The numerical confirmedby a direct analysis of the correlation function G*x. of for 100 cellsgives the results displayedon Figs. evaluation Eq.A1.67b) B and 11.7. For well below are maximum for 1\\.6a,b critical, the correlations = and then decrease a i j sharply beyond small distance.As B increases an there appears undulatory pattern which, however, is damped quickly. in the immediate feature Finally, vicinity of the critical point the correlations an oscillatory distribution that is damped only linearly with distance,as
shown
in
The correlation function can also be computed analytically in the limit of a continuous system [see A1.70b), Eq. A1.70)]. According to expression
Fig.11.7.
50
B = 4.0
40
30
20
10
0
Figure
\342\226\2404
50
form
= 2,d, = \\,d, = 4.
factor
if^'S'on wave
304
Effect
Master Equation
+A2
Figure
11.4. Marginal
in
stability
of oscillations
curves for trimolecular model corresponding to onset of a (Bk) in representation in terms of discrete cells.
Finally,
drawing
that
holds:
we have supposedthat the minimum of Bk Fig. 11.4 of Bk. This is satisfiedwhen a relation similarto Eq.G.36)
A1.77)
the transition to a steady-state dissipative and implies that as B increases, structure occursbeforethe transition to a time-periodic pattern. Coming now to the behavior of the correlation function G*x we first on k of the coefficient in the trigonometric analyze the dependence G*x. T his the role of a \"form factor\" seriesrepresentation of plays quantity be the Fourier of and would transform the correlation function identical to Subif the system were taken to be infinite (Landau and Lifshitz, 1957). of i nto the definitions the to A1.74) A1.77) Substituting explicit expressions a & in o ne finds for discrete and Section 11.9 system: ykk given
!\302\243kk$
'\342\226\240kk
= 2AB
-A2' ,..,.!
A2
f (A1
\\2
d\\
-A2di-d2 i + dx d2 -dxd2
~dxd2
B)d2
-A2di
d2
Bd2
x x
IB- 1 - A2
\\_A2
-(B-
dx
A1.78)
305
\302\243\302\243kk$
and from Eq. A1.75) obvious that it becomes expression becomes B a maximum that sharperas approachesBc.At B = Bc presents This form factor the diverges. implies accordingto expressionA1.67b) for Gu that the range of correlationsis increasing as one approachesthe describes the shapeof the form factor for a system critical state.Figure for various to the 100 c ells and values of B up to the value corresponding of of state marginal stability. The increaseof the range of correlationsin the critical region is also confirmedby a direct analysisof the correlation function G?jX. The numerical for 100 cellsgives the resultsdisplayedon Figs. evaluation of Eq. A1.67b) For B and 11.7. well below are maximum for l\\.6a,b critical, the correlations a small As B increases i = j and then decrease distance. sharply beyond is there appears an undulatory pattern which, however, damped quickly. feature Finally, in the immediate vicinity of the critical point the correlations an oscillatory distribution that is damped only linearly with distance,as From
this
11.5
shown
in
The correlation function can also be computed analytically in the limit of a continuous system [seeEq. A1.70)]. A1.70b), According to expression
Fig.11.7.
B = 4.0
50
Rgure
\342\226\2404
K model for
= 2,</,
&
B=3
500
10
Distance dependence of spatial Figure correlation function G** well below critical point. Values of A, dt, d2 areas in Fig.
11.6a.
11.5.
B = 3.5
103
Figure
approaches
10 306
20
slightly
11.6a.
11.6b. As
307
'
XX
G1j
A
Critical
B=4
state
10\"
-\342\200\242
!\\ A
5.103
V
V V
0
Figure
50
G\342\204\242
100
as in
behavior of spatial correlation function for same values of parameters function displays both linear damping with distance and spatial oscillations with wavelength equal to that of macroscopicconcentration pattern.
Fig.
11.7. Critical
11.6a. Correlation
G(r1? r2) is a trigonometric serieswhose coefficientsare rational fractions of k2. Thesefractions can be split into simple elementsof the form H/k2 + K2, whereK is generally a complex number and each subseries may besummed. The calculations are straightforward, and one finally finds for the XX component of G(ru r2) (Lemarchand and Nicolis,1976):
i
r2)
A1.79)
and
where G*rx is a short-range part exhibiting exponential decay with distance, Gfrx a long-range term. This term has the form (keeping rx fixed and
308
Effect
and Multivariate
Master Equation
+ b(K)Kn(\\
- y\\x>s
Kn(\\
-j)
+ c(K) A1.80)
where the coefficientsa, b, c dependon K as well as on A, B and the diffusion coefficientsD,, D2.In the critical state the wave number K is given by the
expression
where/?, a are the concentrations of A, B related to the corresponding particle numbers by P = (B/Q),a = (A/Q), Q being the size of each cell [seeEq. for fic we A1.64)]. A1.76) Taking into account the approximate expression find:
with the macroscopic Comparing analysis of the trimolecular model carried out in Section7.4[see we conclude that the wavelength Eq.G.35)] especially
of the correlation pattern is identical to the wavelength of the macroscopic concentration pattern itself. If the system is slightly below the critical state then K will have an an exponential decay of the correlationswith a imaginary part describing small damping factor. One finds in this case:
==
K' +
iK\"
A1.83)
\342\200\224
the critical state, expressionA1.80) predicts a linear damping of the correlations the factor K(\\ expressed by (r2//)) in front of the cosineterm, in agreement with the numerical results reportedon Fig.11.7. to A1.83) can be regardedfrom a still The results given in Eqs. A1.80) different viewpoint, which is frequently adoptedin the analysis of equilibrium critical phenomena (Stanley, 1971; Wilson, 1973). Firstly, we see that in the vicinity of the critical point all spatial coordinatesappearingin the longrange part of the correlation function are scaled by the parameter K/L
At
//.//. Concluding
Remarks
309
as b approaches the threshold value bc,this ratio or, Accordingto Eq.A1.83), alternatively the equivalent lengths
r =K
-\302\273
i'
r = -L *| b
/C
i
\342\200\224
\\
bc\\
,171
A1.84)
are intrinsic parametersof the system, independent of the size /, the size of the cellsQ, the boundary conditions, or the microscopic parametersin the atomic scale. Forb bt. these lengths behave as follows:
and A\"-+oo
A1.85)
where A,, is the wavelength of the macroscopic concentration pattern. fixed ri the correlation function A1.80) can, therefore, be written as:
For
A1.86)
This relation is strongly reminiscent of the scaling hypothesis familiar from we have demonstratedhere for equilibrium phase transitions. In essence, our model a scaling law for the correlation of fluctuations around a nonequilibrium steady state. Moreover, we have identified two intrinsic lengths, which can be appropriately referred to as correlation lengths:
\342\200\242
\342\200\242
The length A', which takesa finite value A,,at the critical point and expresses This pattern is macrothe structure of the correlation pattern in space. as At. itself is a macroscopic length. the The length A\", which diverges at the critical point, thus expressing fact that the correlationsare not damped in space but attain, instead, a self-maintainedregime(we discuss ofthese lengths further the significance
macroscopic,
in
Section12.5).
U.ll.CONCLUDING REMARKS
state, chapter we show that in a system initially at a homogeneous correlationsbetween macroscopic fluctuations emerge in the and vicinity of and below the critical point of a nonequilibrium instability conferto the systema distinctly non-Poissonian behavior. We are witnessing, of the \"laws of large numbers\" of probability therefore,a striking breakdown
In this
\342\200\242ong-range
310
Effect
and Multivariate
Master Equation
to the fact that different macroscopic theory, corresponding regionsin the system do not evolve independently but instead,they becomecoupledvia theselong-range correlations. In contrast to this, if one evaluates the fluctuations within a small box whosesize A/ is much smaller than the characteristic length kc, one finds deviation is still described that the mean-square distribution by a Poissonian to a goodapproximation (Gardiner, To McNeil, Walls, and Matheson1976). for the cumulants in the continuous limit, seethis, we considerthe expression and A1.80), and compute the quantity: Eqs.A1.70)
dr^
dr2mxx{rur2)
= A/<x> +
in
J&i
drx
dr2Gxx(rur2)
weobtain only the longrange contribution of Gxx{rur2), Eq.A1.80), Keeping the vicinity of and below the critical point: <SX2)AI = (X\\,(\\ + 0(A/2)) A1.87) Thus, as long as the boxis sufficiently small, it doesnot \"feel\" the long-range correlationsand remains in a Poissonian-like regime,provided the steadystate expressions for M or G used throughout the last two sectionsremain meaningful. Inasmuch one is interestedin the pretransitional phenomena accompanying the instability, a steady-state approachis certainlyjustified. On the other hand, when the critical point for the macroscopic equations
in the function
cell representation [seerelation A1.75)] is crossed, the correlation behaves pathologically becauseof the divergenceof the form factor At this stage, therefore, time-dependent solutions of Eq.A1.55) A1.78)]. [Eq. have to be envisagedto describe the growth of the critical modein the vicinity of and above the instability. As this growth will continue, the deviation of Mu from the Poissoniandistribution value, S 5ff becomesincreasingly marked.Thus, a new nonnegligible contribution appearsin the equations of evolution for the average values of X and Y:
A V \\
\342\200\224-\342\200\224
the early stagesof growth, the influenceof this new term on <X>,< Y> remainssmall because of the factor + 1)(or 1//in the limit of continuous for the nonsystem) weighting the correlation function which is responsible time a Poissoniancontributions. the of after macroscopic lapse Eventually, interval, thesecontributions take over and drive the average to a new macroregime. The situation is somewhat reminiscent of nucleation theory
At
macroscopic
11.11.
point
Concluding
Remarks
311
liquid-vaportransition at equilibrium. We return to this where a simplified formalism to treat the effects of in Chapter diffusion is developed. A striking Monte-Carlosimulation of the kinetics of fluctuations in the
familiar from the
12,
A976).This author postcriticalregion has beenreportedrecently by Hanusse considers an autocatalytic model presenting multiple steady-state transitions and investigatesthe evolution of an initial probability (seealsoSection12.6) distribution peaked around one of the (macroscopically) stable branches.
(a)
100
Figure evolution
200
Time
300
(b)
in model system involving multiple steady states, (b) shows time of the mean, (a)shows time evolution of the variance. Latter begins to increase sharply as soon as sufficiently large \"germ\" appears in the system through fluctuations [points A, B on curve (b)].
11.8. Nucleation
312
Effect
and Multivariate
Master Equation
When the values of the diffusion coefficientsrelative to the chemical rates are small, one observes a rapidtransition to a secondstablebranch, provided to the Maxwell rule (see Sections8.4 the transition point corresponding and 12.6) has been exceeded. When, on the other hand, the values of the a finite life time. After diffusion coefficientsare large, the initial state displays a variable time interval one or several domains appear, where the conto that corresponding to the concentration of the chemicals has a value close these \"germs\" grow and entrain, by diffusion, other branch.Subsequently, the remaining of the system to the new branch of solutions. deviation representsthe time evolution of the mean-square Figure 11.8 and the average value in such a numerical \"experiment.\" At point A (on the plot for the average) a first germ emerges, and a secondone follows at point B. At point C the two germs attain almost simultaneously the of the system,whereupon two convergingwave fronts are formed boundaries that finally disappear when state D (corresponding to a value of the mean on the other branch) has been reached. Finally, when diffusion is very fast the initial state is maintained as long as desired.This correspondsto the property of metastability familiar from equilibrium phasetransitions.* We believethat it should be possible to test directly the resultsconcerning the emergence of long-range correlationsby experiment, in particular by appropriate scattering measurements involving volumes of variable sizes within the system. To our knowledge, no experiments of this type have been undertaken so far for physicochemicalor biochemical systems undergoing instabilitiessuch as those analyzed in Part IV.
desRecherches
Chapter 12
A
of
\"Mean-field\" Description
12.1. INTRODUCTION
The description basedon a multivariate master equation correctly represents the behavior of a macroscopic In this system if the number of cellsis large. the number of stochasticvariables is also very large, and the solution case, in terms of the master equationsgoverning the evolution of the probabilities of these variables is greatly complicated. we develop in this chapter, a simplified formalism by treating the Hence, system as a set of two interacting subsystems: (a) a small volume AV and (b) the rest of the system, V AV as illustrated in Fig. does This, of course, not imply that the particular AV chosenin such a decomposition plays a In fact, one can imagine that the entire spaceis filled with privileged role. such subvolumes AV, which undergo simultaneously fluctuations of various kinds.In subsequent however, we only analyze explicitlythe situasections, in of one these volumes by averaging over the rest of the prevailing In are interestedin a reduced rather than global other we words, system. of fluctuations. description An analysis based on this picture is especially adapted to the study of localized fluctuations having a well-defined range. The latter could be identified to the size of AV and be in this way incorporated explicitly in the that the range is, From the 11.7 t o werecall of Sections theory. analysis in fact, determined by the properties of the correlation function G(ru r2). In therefore, also particular, in the vicinity of an instability the o f the individual to become much than the dimensions expected larger cellsconsidered in the multivariate formalism of Chapter
\342\200\224
12.1.
situation
11.10
range\342\200\224and,
AV\342\200\224is
11.
5/5
314
A \"Mean-field\"
Description
of Fluctations:
Nonlinear
Master Equation
Transport of particles acrosssurface AE separating a small subvolume AV within a macroscopic system, n: outward normal to AI. v: velocity ofa particle directed toward A V. Dashed region indicates an area of width of order of mean path, lr, surrounding surface AZ.
Figure
12.1.
12.2. DERIVATION
We
OF NONLINEAR
MASTER
EQUATION
refer again to Fig. 12.1 and assumethat the system remains macrofluctuations scopically homogeneous, although the density and composition continuouslybreak this homogeneitylocally,within smallsubvolumessuch as AV. If the referencestate is inhomogeneous, then the analysis we outline in this sectionmust be modified by suitably redefining the various transition This extended formalism can then beusedto study fluctuations probabilities. in fluid-dynamic systemsas well (Malek-Mansour, Brenig and Horsthemke,
1977).
in
As A V
is finite, our treatment of fluctuations, although local, is formulated terms of discretevariables, namely, the number of particlesXin, Xout of
within AV and V intensivevariables are defined as:
\342\200\224
AV,
respectively. The
cor-
whereas
AV
A2.1)
A2.2)
We
expectthat
lim
AK->0
= finite
\342\200\224
the
fluctuation of AV.
Spx.n = pXtn
<pxin)
12.2. Derivation
of Nonlinear
Master Equation
315
Let P\\v(X{n, t) be the probability distribution* within AV and P(Xin, Xout, t) the probability within the entire system.We denote by R the contribution of the chemical reactionsto the evolution of P, and by F the contribution of the transport processes the surface AT.. As in across Chapter we take into account only the transport of matter by assuming a The extension fast thermal relaxation to a constant temperature distribution. to the nonisothermal case has beencarried out by FrancksonA975). The master equation takesthe following form:
11,
-rr
= ^Av(^in) + FAv.v-Av(Xin,
Xout)
A2.3)
In writing this relation we have introduced once again the Markovian assumption accordingto which the contribution of chemical reactionsin AV dependsonly on the stochastic variables insideAV. As a matter of fact, in what follows we assumethat the stochastic within AV is of the process birth-and-death type, although this is not generally the casefor the stostochastic process within the entire system V. The transport term F,which is responsible for the coupling betweenAV and V from the analysis of Eq.A1.27). We have: AV, can easily bededuced
\342\200\224
F&V.V-AV
\342\200\224
Z, {wout(^in
Xout
\342\200\224
Xout
+1
-\342\226\272
Xin, Xout)
- [w0JXin,X0J + -f
<f>
1,XBut
-l^Xin,
X0Ut)P(Xin
1,Xout
t)}
- 1,0
A2.4)
win(Xin, Xout)-]P(Xin,
XBut,
the frequency The transition probabilities per unit time wou, and win describe similar to of passageof X particlesacrossAS and are given by expressions here the of a to take into account We have Eq. A1.28a). simply possibility three-dimensionaltransport.We have (seeFig.12.1):
wout
= =
dS f
\\
dw n/oul(r, dw n/in(r,
v, f)
win
<f
dS f
v, f)
by X
A2.5)
the entire vector of all
chemical
Throughout this section we adopt a compact notation and denote constituents present: X = (Xx, . . . , Xn).
316
A \"Mean-field\"
Description
of Fluctations:
Nonlinear
Master Equation
The requirement of macroscopic with the arguments homogeneity,combined on the validity of the local equilibrium description in Section11.7, developed the form permits us to express/in
/out
= =
2\\y 0out(V, t)
A2.6)
0in(V, f)
./in
-^
with
1
x
I--77\342\200\224l^T
<P
ds
dvvn0out. 'vi<0
dS
V
P(Xin-\\,Xout+
+
l,
f)
r
\\
Jvi>0
dvv
n0in
x P(Xin
1,Xoul
- 1, - inverse terms
t)Pv^AV(X0Ut,
A2.8)
= PAV(Xin,
t)
G(Xln, Xout, f)
\342\200\224
A2.9)
where G is the correlation function between AV and V AK According to Section11.9, G is generally nonvanishing, but its importance relative to the contributions coming from the local processes inside AV dependson the sizeof the cell and the relative magnitude of diffusion and chemical rates. Following this analysis we assumehere as a first approximation that the contribution of G remains small,that is,that AV and V AV are statistically that this assumption can only hold if independent.It must be emphasized small and the is are sufficiently short-ranged. correlations (AVIV) sufficiently of In particular, in the limit (AV/V) 0 it would be a rigorousconsequence the phase-space master equations. On the other hand, assoonas A V becomes an appreciable part of V the assumption breaks down completely (seealso Gardiner,McNeil,Walls, and Matheson,1976).
\342\200\224 \342\200\224\342\231\246
12.3. Further
Bearing
transform
317
and
Eq. A2.3) into a closed-form equation (Malek-Mansourand Nicolis,1975; Prigogine, Nicolis,Herman and Lam, 1975):
utilizing
= Rav{X) + @<a:>[pak(xi,r)
\\)pAV(x
co-
= _L
AF JAE
dS
(* Jv.n>0
dvvn0(v,f)
A2.11)
This coefficient,which is to be comparedwith the coefficient introduced in Section11.7 [seeespecially Eq. A1.29b)], plays the roleof an \"effective diffusion frequency\" of passage of particles acrossAS.In this respectwe may note that the distribution /out used in the evaluation of the transition probdescribesthe motion of particlesdirectedtoward AV and coming from a layer of a width lr, that is, of the order of the mean free path of X This specieswithin the reaction medium (Chapman and Cowling, 1952). if is evaluated the Maxwellian becomes more obvious Eq. point A2.11) using form for 0.One then obtains [see relation A1.29c)]:
probabilities
this quantity
description
where / is a characteristicdimensionof A V. As we pointedout in Section12.1, reflectsthe range, or coherencelength of the fluctuations. Equation A2.10) provides a generalization of the birth-and-death descripthat displays the qualitative features of the more completetheory of the outlined in Chapter 11 and at the same time is free of the complexities multivariate master equation.
12.3. FURTHER
The most characteristic property of the master equation A2.10) is its nonThis is due the side. the factor on linearity, arising through <X> right-hand to the passagefrom a globaldescription to a local one.In this respect,it has the same origin as the nonlinear terms of the kinetic equationsof statistical mechanicssuch as the Boltzmann or the Vlassov equations(Balescu, 1963). For this reasonwe may refer to the description basedon the nonlinear master equation as a mean field descriptionof fluctuations.
318
A \"Mean-field\"
An alternative way to understand the nonlinearity is to point out that the external environment of AV has been taken into account in an average fashion and that the macroscopic homogeneity condition A2.7) has related this average to an average over the small system itself. As we see in the subsequentsectionsthis \"competition\" between subsystemand external for the propagation of fluctuations leading to an environment is responsible instability. The similarity between this description and the PrigogineHerman theory of vehicular traffic (Prigogine and Herman, 1971) shouldbe pointedout. of any physicalcontext, it would be of interest to characterIndependently more preciselythe type of stochasticprocessdescribedby the master It is likely that this equation belongs to the classofsituations equation A2.10). referred to by McKeanas \"nonlinearMarkov processes\" (McKean,1969). remains Markovian, it certainly looses its stationary Even if the process character. Indeed,one of the transition probabilitiesnow dependson the which is an explicit function of time. average value (X~), The final point we want to develop in this sectionconcerns the moment equationsgeneratedby the nonlinear master equation. Multiplying both sides by X and summing over all values of X we find, in the notation of
characterize
Section10.4:
^ = <a>+
+
\302\256<*>
t *C>V(X - 1,0-P(X,f)]
t)]
Performing the by now familiar change of variables within the sums over X we find:
d
it
in
XPAV(X, t)
other words,
A2.13)
Thus the first moment equation is independent of in agreement with the requirement of macroscopic homogeneity. To find the equation for the secondmoment we multiply both sidesof the master equation by X2 and sum over X. We find by a similar calculation:
AV
2,
at
= (a2x)AV +
(Xalx}AV
2\302\256[<SX2)AV
<X>AK]
A2.14)
Cycle
319
where (SX2}AV is the mean-square deviation. We see that diffusion contriexplicitly to the evolution of fluctuations through a term expressing the deviation of the probability distribution function from the Poissonian In the limit 9) -* oo the diffusion term dominates in Eq. A2.14). The regime. variance, system evolvesthen to a steady state characterized by a Poissonian since(SX2}AV = (X}AV. This is in qualitative agreement with the results of of fluctuations, Chapter Note,however,that in the multivariate description the evolution of variances Mu to the steady state is not, in general, Eq.A1.43), of the finite differencestructure given by a simpleexponential decay,because of the operatorKijk, on the right-hand sideof this equation.In contrast, the contribution of diffusion to the evolution of the mean-squaredeviations AV [see within Eq. A2.14)] always tends to induce an exponential decay in time (Gardiner, McNeil,Walls, and Matheson,1976).
11.
12.4. ONSETOF A
We now return
LIMITCYCLE
to the onset of instabilitiesand analyze the nonlinear master for a equation simple system giving rise to dissipative structures.We again work on the trimolecular model, whose critical behavior is analyzed in Section from the standpoint of the multivariate master equation.Our is now to discuss the emergence ofa limit-cyclebehavior, postponing purpose the case structures. until Section of steady-state space-dependent As we saw in Sections 7.4to 7.14, the nature of the solution that bifurcates the first from the thermodynamic branch depends on the diffusion coefficients and the on conditions. I n Du D2 boundary particular, for zero flux or for leadsto a limit first conditions the bifuraction periodicboundary necessarily = from D2, a is smaller if on the other hand, D\\ sufficiently cycle D, D2. If,
11.10
12.5
symmetry-breakinginstability becomes possible. In principle,some of these features could be altered by the stochastic treatment, which goes beyond the macroscopic analysis carried out in 7. we interested in are Hereafter, however, asymptotic solutions of Chapter the master equation which, as discussed are well adaptedto in Chapter 10, discuss the early stagesof instability. This enables us to truncate the hierarchy of moment equations of this, to thosefor the second-order variances. Because the equations for the variancesinvolve the sametime and length scales asthose for the averages.The latter reduceto the macroscopic solutions if average and most probablevalueare close is of all problems This enough. certainly the case of \"soft\" that the is, transitions, involving appearance patterns whose amplitude vanishes as one approachesthe bifurcation point from above. A where the varistriking confirmation of these ideasis found in Section10.6, in the Lotka-Volterra model vary at twice the frequency of the
variances
320
A \"Mean-field\"
Description
of Fluctations:
Nonlinear
Master Equation
where the range of the correlation motion, and in Section11.10, macroscopic function was determined by the parametersappearingin the macroscopic
equationsof evolution. We conclude that if we are interested in the early stagesof formation of a limit cycle in a small subvolume, AK of a large (infinite) system, we may take formalism by the equality D, = D2.This can be translated in the stochastic
where but they The equations for the varianceshave a form similar to Eq.A1.37), are now supplemented It by diffusion terms, in agreement with Eq. A2.14). is also convenient to switch to reducedvariables:
\302\243?,
2i = 92 = 9
A2.15)
X x = ~~~,
A2.16)
y
Y
\342\200\224
where No is of the orderof the total number of particles within AK. Moreover, we introduce instead of the variance vector M = {(SX2}, (SX SY}, the vector b = {biUb12, the deviations from the Poissonian b22)expressing regime, as in Eq. A0.30):
<<5Y2\302\273
A2.17)
We
write
obtain in
as
in
'2(P 1) 29
/?
- -
- a22a2 - - 29
1
-2/J
-2a2-29/
A2.18)
0 a2
Cycle
321
where t is a reducedtime variable. It shouldbe evident by now that the propof this system are determined by the eigenvalues of the matrix of the coefficients.Working out the characteristic equation, we find:
Wl
co\302\261
= =P
1
~~
\342\200\224
\342\200\236
a, a
l
1
~W
\342\200\224
\342\200\224
r^ 29 sjM
\302\261
A2A9)
where
M
= (P = (p
- a2 - - 29J- a2 - IJ - 4a2
0
4fj3>2
+ (a2 + 1
- P)9 + a2]
A2.20)
< 0,
Reco\302\261
<0.
(i)
< p < a2 +
\\ if
A2.21)
A2.22)
(ii)
For
9>
(iii)
\"
\342\200\224~
a2 +
< P < (a + IJ
it
For
9>
state
\342\200\224
p > (a + 1) A/./3)
<*>~a, (y)^a
remains unaffectedduring a macroscopic periodof time.
We may now
by
the
inn
\\
A2.25) where3icis given by Eqs.A2.22)and A2.23)when the equality sign is satisfied. the relation between lc and the chemical parameter p Figure 12.2 represents for 3>c. The curve Ic IC(P)has an asymptote at appearingin the expression
\342\200\224
322
A \"Mean-field\"
Description
of Fluctations:
Nonlinear
Master Equation
a+ 1
Figure trimolecular
<\302\253
1)
and L2 oc {/?
of fluctuation at critical point versus chemical parameter a2 model under macroscopically homogeneous conditions. HereL, oc (/I a2 1 + [(/? sr2 4a2]\022)-'.
- -
- - IJ'r
- -
fl in
I)\021
ft
= a2 +
by:
- a2
1+
2(D//r)
A2.26)
and
- a2
infinity.
2(D//r) a2
with
- - IJ - 4a2
the
right
A2.27)
derivativetending to
It is instructive to phrase these results in the language of equilibrium We first observe that the transition to critical phenomena (Stanley, 1971). is reflectedby the appearance of a limit cycle having a nonvanishinstability ing radius, r. Thus, it is natural to define r as the order parameter in the r varies in terms of /? as: to Section7.12, system.Now, according
rcc(p&I/2
r =0
for for
p > pc p < pc
occuring\342\200\224the
where pc is the point where the first instability is critical point of equilibrium phasetransitions:
pc = a2 + 1
Relation A2.26)becomes:
lc
x (p - pe)
Cycle
323
have, therefore, found a critical exponentof 1/2for the order parameter and of 1for the quantity lc that plays the role of the correlation length in the theory. The corresponding exponentsin any theory of equilibrium critical phenomena based on Landau ideas-knownas a self-consistenttheory of critical phenomena\342\200\224would be, respectively, 1/2 and Thus, despite there emerges the self-consistentfield character of the master equation A2.10), a \"nonclassical\" shows An inspection of Eq. A2.12) exponent,namely, that this nonclassical behavior stemsfrom the appearanceof the relaxation length in the equation relating 3) and /. This, in turn, is related to the noninto the theory equilibrium character of the phenomenon, which introduces the effectof excitations such as soundwaveswhose velocity is related to the mean free path lr and whose wavelengths are \"intermediate\" between the short wavelength scalerelated to atomic dimensions and the macroscopic scalerelated to the coherence length of the fluctuations. It is instructive to realize the analogy between this picture and the ideasunderlying Wilson's theory of equilibrium phase transitions (Wilson, 1973). Analogies between chemical instabilities and phase transitions have also been pointed out by Nitzan, Ortoleva, Deutch and RossA974) and by Kuramoto and Tsuzuki A975). Bearingthese points in mind one may now interpret the diagram of Fig.12.2 as follows. Supposea fluctuation appears at the vicinity of a point inside a AV. If the range of this fluctuation, that is,the length over which it preserves coherent character, is in the dashed region of the figure, then the decay of this local fluctuation (roughly measuredby S>~') take over the processes amplificationmechanisms,and the fluctuation diesout. Forp < a2 + 1 even
\342\200\2241/2.
\342\200\224
1.
whose range exceeds lc are amplified p > a2 + 1 those distrubances the system. The latter remain stable with respectto and spreadthroughout < lc. Thus, diffusion plays a stabilizing role for certain fluctuations with the supercritical region. Forp > (a + IJ the range of even in fluctuations, and fluctuations decreases rapidly finally, far in the unstable region decaying -> a2 0 and the evolution > + (P 1),lc away from the reference state is
But for
I
if
an
infinite
coherence length
is
imposedinitially, the
fluctuation
decays.
This picture is reminescent of the phenomenon of nucleation spontaneous. familiar from equilibrium phasetransitions (Zettlemoyer, 1969). We close this section fluctuations by a remark concerning the composition that the variances themselves within AV. We first observe from Eq. A2.18) of the critical point, as the eigenvalueco^ of the diverge in the neighborhood coefficientmatrix vanishes at this point.Thus
<<5A:2>oc\342\200\224
A2.31)
324
'\342\226\240'\342\226\240Mean-field'\"
Description
of Fluctations:
Nonlinear
Master Equation
and similarly for <<5Y2>(etc.). we seethat at the critical Now, from Fig.12.2 3> 0. Thus in other words, point
\342\200\224\342\226\272
\\c
x,
\342\200\224\342\226\272
A232)
is equal the divergenceof (SX2} seethat the critical exponent expressing the way the order to twice the value of the critical exponent expressing parameter varies in the supercritical region. Again, this relation is analogous to those prevailing in equilibrium phasetransitions.
We
12.5. ONSETOF A
We
in the trimolecular model are coefficients3>i and 3>2-As recalledin the the macroscopic Section12.4, in this case balance equationsadmit solutions a Here structure. we want to understand the onset displaying regular spatial of these patterns through fluctuations, starting from an initially uniform system at the steady state A2.24). and truncating the hierFollowing the sameprocedureas in Section12.4 to the levelof second-order variances,one obtains hierarchy of moment equations a differential system for mean quadratic fluctuations that has the same form as in Eq. A2.18), exceptthat the matrix of the coefficientsis now given by:
characterized by two
2@- 1)-2S
-0
0
0 -a2
-1-0, -20
(\302\251,
2a2
\342\200\224
0 a2 2' a2 -
A2.33)
=p =P
- a2 - 1 1 1
22) - a2 - - @, + + 92)
\302\261
^/M
A2.34)
= IP
- a2 - - @, + - /?0j +
2
\302\261,
\302\2562)]2
S>2 +
a2\302\256,
+ a2)
A2.35)
The secondmoment equation admits a nonoscillatory instability of the steady-state solution if one of the rootsco a>i vanishes.This happensunder
Dissipative
Structure
325
9, + 92
the relation A2.12):
A2.37)
A3.38)
we finally
obtain:
A2.39a)
+ A\302\253l+a!+^l
Figure
ri
/?\302\260
(,2.39b)
^\302\243>2/U-
of the referencestate involves fluctuations offinite coherence length. In this same region, the imposition of large-scale fluctuations (/ -> oo) stabilizes the steady state.Beyondp = p], however,that is, beyond the asymptote of the curve p = p~c, the behavior becomes similar to that outlined in Section12.4.
12.3 the critical curves lc = lc{P)corresponding to relations represents = in the (/, /?) plane for a = 2 and (D,//ri) A2.39a)and A2.39b) The important new point is that in the region < P < P] the instability
Unstable
e\302\260c
el
el-2
of fluctuation at critical point versus chemical parameter ji in model, a = 2, and ratio DJD2= is compatible with emergence of steady-state dissipative structures as deduced from deterministic analysis.
Figure trimolecular
326
A \"Mean-field\"
Description
of Fluctations:
Nonlinear
Master Equation
In contrast, the \"order parameter\"behaves in exactly the same way as in the 7.6and 7.7, the amplitude of the Indeed,as wesaw in Sections limit-cyclecase. varies as: emerging dissipative structure beyond the first instability at
A2.40) of a finite coherence At first sight, the occurrence length and continuous and difficult to fit in the framework of the orderparameter seems paradoxical A closer more familiar equilibrium critical phenomena. however, inspection, ofa second characteristiccoherence revealsthe existence length* that diverges as one moves to the critical point from the pretransition region. In this resembles closelythe crystallization way the problemunder consideration In the latter, in the ordered phase, there exists a problem (Brout, 1965). finite characteristic length (the lattice parameter), whereas in the disordered phase there appear long-range correlationsup to the solidification point. To seethe appearanceof the secondcoherence length in our problemwe as in the end of Section We considerthe marginal stability proceed equation A2.39a)in the equivalent form:
P\302\260V2
/?\302\260
||x|| ac.(p-
/?\302\260
11.10.
+
where
'ri
'r2
=0
A2.41)
From the results of Chapter 11 we expectthe quantity 1//to scalethe spatial r, appearingin the correlationfunction G(AVU AV2) between two spatial regionst:
coordinate r2
\342\200\224
U AV2)
g(\"-^A
A2.43)
If
function G then
describes a self-maintainedcorrelation of
the form of evanescentwaves emanating from The point is that Eq.A2.41) gives rise to complex/ values in the \"dis\" \"disordered region /? < Onefinds, in exactlythe same way asin Section
1//impliesspatial damping in
/?\302\260.
AK
alsothe work by Lekkerkerker and Boon A975). t Note the change in notation between this and Chapter / denotes Thus, in Section the length of the system, which in the present chapter is taken to be infinite. The coherence is now denoted by /. length denoted by ). in Section
11.10:
\302\2614
by Zaitsev
11.
11.10
11.10
12.6. Multiple
where
327
\\
1_
1
\342\200\224
_
1
I/J
/
\342\200\224
0,
\342\200\224
'
\342\200\224
#1
/?\302\260|1/2(/?
/?_I/2
A2.45b)
and
A2.46)
If p is slightly subcritical, then
P_ and
/\"
<P <
P\302\260c
A2.47)
p\302\260
length
is approached, the is,indeed,a real quantity. As the critical point and A1.81)]: /\" diverges as [see also Eqs.A1.80)
(P-p-)\"iir rc'
that
to a \" classical is,according exponent\"equal to \\, which is the same as the in the order Thus, the waves exponent appearing parameter equation A2.40). A a from Fare evanescent but no give rise,instead, to emanating region longer A a sustained characterized /'. calculationidentical the length regime by simple to the one reportedin Section11.10 showsthat /' is identicalto at the critical point (seeFig.12.3).
/\302\260
12.6. MULTIPLESTEADY-STATE
We illustrate the
basicideasdirectly on a simplemodel.Considera lattice surfaceelement with N binding sites.The systemis in contact with a reservoir of a constituent Xe whereconcentrations are held fixed.Xe may combine with a free site, and beadsorbedby the lattice. We shall call X the corresponding variable. On the other hand, X can undergo a desorptionprocomposition and again becomeXe.Thesephenomena can be represented as:
process
X X
\342\200\224\302\243*-\302\273
XP+F
A2.49)
328
A \"Mean-field\"
Description
of Fluctations:
Nonlinear
Master Equation
dK-kFX -kX--dF dt dt
observedvalue of X. where X denotesthe macroscopically Now, X + F = const = N
and dX__ ~
dt
iy
= k2/k1Xe,
A2.50a)
A Y^
\342\200\224
dt
= a[N
k)X~\\
is cooperFurthermore, we assumethat the adsorption-desorption process that is, that k is influenced by the number of X already adsorbed. We for illustrative purposethe relation choose
cooperative,
= k(X) = k exp
- ~-
A2.50b)
where K and n are constants.Note, however, that this expressionis not arbitrary. It can be attached to a mean-fieldtype of treatment of the lattice, as is frequently done in the context of equilibrium phase transitions (Brout,
1965).
that Lefever,1975) (Prigogine, Lefever,J. S.Turner, and J. W. Turner, 1975; when n > 4 there alwaysexistsan interval Kt < K < K2 where, for each K, the equation admits three equilibrium solutions(seecontinuous S curve in Fig.12.4). Two of them are stable,the third one(intermediate branch in Note that the instabilities found here do not require Fig.12.4) beingunstable. Thus, in this sectionwe deal with a necessarily nonequilibrium constraints. that is not to problem specific nonequilibrium situations, in contrast to the studied in Sections12.4 and 12.5. problems of this have been studied extensively from the stochastic Systems type the birth-and-death formalism (Landauer,1962; Janssen, viewpoint, using and Onefinds that at a certain value Matheson, 1974; Gardiner,1975). Walls, of the parameter determining the stability propertiesof the macroscopic the system displays a bimodal distribution with two equal heights equations,
12.6. Multiple
329
N= 200
In K, 2.55
2.75
In Kc 3.15 2.95
3.35 inK7
lnK Figure 12.4. Bottom: branch of macroscopic steady states calculated from Eq. A2.52) as function of In K for N = 100and i\\ = 6 (continuous curve); dashed line: branch of average In !2)c asfunction of K for N 50, values calculated from master equation without diffusion. Top: 200. Dashed areasindicate domains where value of <X}/N lies when 3) @c. 100,
>
For to a simultaneous occupation of the two stablebranches. corresponding the model of this sectionthis critical value is
A2.51)
The analogy with the van der Waals theory of first-order phasetransitions is striking and has been repeatedly emphasized. ForK # Kc (Brout, 1965) the distribution evolvesto a singlebranch, although the time of evolution gets
330
A \"Mean-field\"
Description
of Fluctations:
Nonlinear
Master Equation
longer with larger N. Although this is somewhat reminiscent of the phenoof metastability, the correspondence is difficult to establish. Prigogine, Lefever,J.S.Turner, and T. W. Turner A975)have investigated this phenomenon by a local approach to fluctuations based on a master it is clear that only by this treatment, equation of the type A2.10). Intuitively, the conceptof the range of a fluctuation, couldone tackle which introduces the problemof metastability. The master equation reads:
phenomenon
, t)
dt
,{N
x + 1)p(x l / (x + n\\
ri
t)
(N
_ X)P(X,t)
1,0
- XK
A2.52) we deal
-1,0P(X,t)]
\\)P{X with
XP{X,0] +1,0with
Here the expression for 3) has to be adaptedto the fact that A2.12)
a surface AS rather than
3*^
where AP is the perimeter of the surfaceelement AS. In dealing with Eq. A2.52) one must be aware of the fact that all of the used in the precedingsections techniquesbased on asymptotic expansions breakdown completely.This is due to the fact that the transitions associated \" with a multiple steady-stateproblemare hard,\" in the sense that the distance between final and reference states is finite. In other words,the stochastic average (X) (which appearsin the master equation) and the most probable value X (which appears in the macrosocopic rate equation) differ by a amount. one has to solve Thus, macroscopic Eq.A2.52)as a whole and avoid moment truncations. Fortunately, thanks to the validity of the detailed balancecondition, the master equation for this model can be solved exactly at the steady state by iteration. One finds (Prigogine, Lefever,J. S. Turner, and J. W. Turner, 1975):
\302\243
A2.54)
For3> = 0 one recovers the birth-and-death description, and in particular one showsthat the first moment <X> is always a single-valuedfunction of K dashedcurve). In contrast, if 3) is greater than somecritical value (Fig.12.4,
\302\256c,Eq.
A2.54)yieldstwo equilibrium solutions in the interval Ki K K2In addition to the distribution corresponding to the stablebranch found in
< <
12.7.Asymptotic
Solutions
of Nonlinear
Master Equation
331
the birth-and-death description, onefinds a new distribution with an average near the value of X on the other branch, which hence appearsas a metastable branch in the usual senseof the term. One can show that 3)cdependson K. On the other hand, according to Eq.A2.53)3> dependsalsoon the size N, as Thus, the value of 3) at the critical state where the new AP/AS oc N~112. branch appearsgives information about the size of the fluctuations beyond which the transition from the metastableto the stablebranch becomes possible. This corresponds to the critical nucleus of germination. Theseideascouldbe interesting to a broadclassof phenomena in which metastable statesare involved, such as the formation of fractures in metals or the ignition of explosive reactions.
MASTER
EQUATION
of the meanHaving now beenacquainted with the practiceand predictions field theory of fluctuations, we return to the nonlinear master equation and to analyze somegeneral features of its solutions.As we saw in Section an exactsolutionof this equation isgenerallyan arduoustask.Therefore, to develop approximate but systematic schemes it would be highly desirable for calculating thesesolutions. The resemblence of Eq. A2.10) to the equationsencounteredin kinetic couldseek for asymptotic solutions of a kind similar t hat one theory suggests to the Chapman-Enskog solution of the Boltzmann equation (Chapman and These,known also as normal solutions, are based on the Cowling, 1952). in the Boltzmann o f to two time scales presence processes evolving according the free of the one associated with motion equation: (a) particlesand (b) the other associatedwith collisions. Now, this is exactly what happensin the nonlinear master equation A2.10) and, indeed,in the multivariate master the role of the reactionand diffusion contributions as t hat well, equation except are somewhat the \"inverse\" of the collision and free particle contributions in the Boltzmann equation.Indeed,in our case the reactive collisions tend to in of local the distribution\342\200\224the Poissonian equilibrium analog destroy diffusion tendsto reestablish this distribution. Insokinetic theory\342\200\224whereas
12.6,
12.4
Insofar
as
RAV(X)
cc rjh1
and
fchS>
oc 'f- > 1
332
A \"Mean-field\"
Description
of Fluctations:
Nonlinear
Master Equation
where rch is the characteristic scaleof (macroscopic) evolutionof composition variables due to the chemical reactions,onecan introduce in Eq. A2.10) a dimensionless smallness parameter e=
-^\342\200\224
= t9 = {-^\\DtJ ly<\\
)
\302\253y[AV(X
\\)PAV(X
A2.55)
'
= (r/rch)]
^f
P
\\
+ (X +
- 1,0 - Pav(X, 01 + 1, r)
XPAV(X,
t)}
A2.56)
and we want to investigate the existenceof asymptotic expansionswith respectto this parameter:
\342\226\240\342\226\240\342\226\240
A2.57)
where we drop from now on the subscriptAV. A similar procedurecan be envisaged for the multivariate master equation. As is frequently the case with asymptotic expansions, it is very difficult to In particular, onewould like determine the range of validity of Eq.A2.57). solution in ehas a finite radiusof convergence, to know whether a power-series in or if not, whether an asymptotic (and generallynonconvergent)expansion ofe exists, orfinally, whethereis not a goodexpansion powers parameter at all. Hereafter, we regard Eq.A2.57)as a formal seriesand try to determine the into successivecoefficients PA) from the master equation. Substituting Eq.A2.56)and taking into account that R dependslinearly on P(X)and that and Hayez, Malek-Mansour it always remains finite, we have (Horsthemke,
1977):
To order e^1
-i,r)-p@)(x,r)]
+ (X +
\\)Pm(X
+l,f)-XP@)(X, 0 = 0
A2.58)
To order
e\302\260:
-^\342\200\224
at
= r(p{0)) + Kxyo)[p(i)(x
+ (X + \\)pA\\x + (Xyl)\\_P@\\X
A2.59) A2.60)
as:
+
\342\200\242\342\200\242\342\200\242
72.7.
Asymptotic
Solutions
of Nonlinear
Master Equation
333
The point is now that the equation at the dominant order, Eq. A2.58) admits a Poissonian distribution as the only solution, with an as yet undetermean <X>@):
undetermined
p@)
e-<x><\302\260>
_^A/
'
A2.61)
order to compute (X)*01 we go to the next order,Eq. A2.59),multiply both sidesby X, and sum over X. We find, in the notation of Section12.3:
In
sincethe effectof diffusion cancels. Moreover, as the average is taken over a Poissoniandistribution one can, accordingto the results of Section 10.4, to the macroscopickinetic law: identify the right-hand side (a1A-><0)
@)
A2.62)
Thus, <X>@) and P<0) are now entirely determined, thanks to the macroequationsof evolution.The situation is strongly reminiscentof kinetic theory of gases,where the parametersappearingin the local Maxwellian determined density,and convection distribution\342\200\224temperature, by the equationsof fluid dynamics. The next step is to determine PA) from Eq. A2.59),keepingin mind that both P@> and <X>@) are known. We have:
macroscopic velocity\342\200\224are
\\)P{l\\x
i,r) - xpv\\x, t)
dPi0)
\342\200\224r-
r)
P@)(X,
R(P{0))+
dt
A2.62a)
The finite-differenceoperator appearingon the right-hand side is always invertible. Forinstance, in the generating function representation it would give rise to the extremely simpleexpression
<X>@)FA1
where
Thus, FA1 can be computedstraightforwardly provided (X}A)can bedeterThis is achieved by working out the equation to order e, which yields
determined.
334
A \"Mean-field\"
Description
of Fluctations:
Nonlinear
Master Equation
a differential equation for (X>A). As PUI is,in general,different from Poissonfrom the macroscopic law: ian, the equation for <X>A1 contains corrections
at
+ corrections
A2.63a)
terms to This schemecan be continued to get as many correction and Pi0)(X,t) as desired.Having P onecan then compute the variances, for
instance:
= CX2)
\342\226\240\342\226\240\342\226\240
A2.64)
The remarkable point that appearshere is that the propertiesof fluctuations A V in a volume dependexplicitlyon the sizeof this volume. When the latter
goesto zero one recovers a Poissonianvariance. Otherwiseone obtains terms.This illustrates in a very transparent way the passagefrom correction
in
Section11.11 from the multivariate master equation by integrating the alsoGardiner,McNeil, function correlation G(rl,r2) over a finite volume (see This featureof and fluctuations in Matheson,1976). extremelystriking Walls, testable should be nonequilibrium systems directly by scattering experiments
from
limit of the phaseshort-range fluctuations, describable by the Fokker-Planck to large-scale master equations, fluctuations.A similar result is obtained space
a reacting fluid.
manifestsitself exclusivelythrough the equationsfor the successive approxito the average value <X}. The corresponding (X}@\\ p robability distributions PA) merely \" adjust\" to the evolution of the averages,although distribution. One they are at the same time deviating from the Poissonian can expect,however, that in the vicinity of the instability the successive become corrections increasinglyimportant, partly becausee itself would no be a small longer owing to the long-range character of the correlaquantity, the Eventually expansionbreaks down and the dependenceof the and not necessarily solution on / becomesmore complicated analytic.
approximations
correlations.
A final remark concerning systems giving Within the framework of the e-expansion,
...
12.8. Concluding
Remarks
335
Thesecorrelations even if macroscopically it remains homogeneous in space. are characterized by a coherence intrinsic is an that parameter of the length and that as critical one the point. Thirdly, the system diverges approaches onset of nonequilibrium instabilities in macroscopic systemsis due to the deviation of the fluctuations from the Poissonian distribution. Despitetheseadvances, oneshould be aware of the fact that many imporproblemsremain unsolved.The main reasonfor this is the difficulty to solve the completemaster equation without truncating the hierarchy of moments, save for a few particular cases involving a single variable. As a result, onecannot yet estimate satisfactorilythe a priori probability of having a fluctuation of a certain size and range appearingspontaneously in the system, nor the rate of growth of such a fluctuation beyond instability. Similarly, a number of quantitative predictionsbased on asymptotic solutionssuch as truncated moment expansions couldconceivablybe modiby a more refined treatment. We have in mind, in particular, the ococcurrence of \"classical\" exponentsarising in the analyses of Sections and 12.5. This couldwell be the consequence of having neglected 12.4, triple in the multivariate master-equation treatment of Section correlations and of having a mean field theory of fluctuations in the analysisof the present chapter.A more satisfactory treatment of correlationsmight well produce nonclassical exponentsin a way similar to Wilson's extension of Landau's mean field theory of equilibrium critical phenomena.
important modified
11.10, 11.10,
Part IV
Chapter 13
in Self-organization ChemicalReactions
13.1. INTRODUCTION
ourselvesto a discussionof reactions in homogeneous phase, of spatiowhere the breakingof spatial homogeneity and the emergence temporal order are most striking. The earliest reportedperiodicchemical of hydrogen reaction in homogeneous solution is the catalytic decomposition oxidation couple (Bray, 1921). Despitethe peroxideby the iodicacid-iodine mechanism of the many experimental studiesof this reaction, the detailed itself a of until remained matter oscillation recently (Nicolis controversy Sharma and Noyes,1976). and Portnow, 1973; Noyesand Field, 1974; of an oscillatory chemicalreaction BelousovA958)reporteda secondcase in homogeneous is the main solution, which subjectof the presentchapter, oxidation of t he citric acid by potassiumbromate catalyzed by specifically, the ceric-cerous ion couple. ZhabotinskiA964) pursuedthe study of the reaction and demonstrated that the cerium catalyst could be replacedby manganeseor ferroinand that the citric acid reducingagent couldbe replaced a methylene group either possessing by a variety of organic compounds, or easily forming such a group during oxidation (e.g., malonic or bromomalonic acid). Usual experimental studies involve a reaction mixture at about of potassiumbromate, malonic or bromomalonic acid, consisting and eerie in sulfuric acid. sulfate (or someequivalent compound) dissolved the the different on conditions on the phenomena Depending imposed system, observed are compiled in Section13.2.
We limit
25\302\260
FACTS
reaction occurs in a well-stirred medium, sustainedoscillations the chemicalconcentrations appear for certain rangesof initial composiof the mixture. Figure describesthe temporal evolution of the
13.1
339
340
10
Minutes
\302\273-
15 17.0
24
+ + of log[Br~] and log[Ce4 Potentiometric traces at /Ce3 ] versus time during = Belousov reaction: [malonic acid] = 0.032M. 0.063M, [KBrO3] [Ce(NH4J(NO3M]0 = = 0.8M,and [KBr]0= 1.5x 10\025M [from R. Field A972), Chem. 0.01M, [H2SO4] Educ. 49,308].
Figure
13.1.
25\302\260
J.
J.
of the minute, whereas the life time of the phenomenon is of the order Eventually the oscillationsdie out, as the system remains closed to
hour.
mass
transfer and the raw materials necessaryfor the reaction are exhausted. Thus, although the initial mixture may be removed very far from thermodynamic equilibrium, it finally tends to the state of equilibrium where oscillatory behavior is ruled out. Recently,however,Marekand Stuchl A975) and Marekand Svobodova( for this reactionunder 1975) reportedoscillations conditions. Note that with bromomalonic acid presentinitially, open-system oscillationsin the ceric-cerous concentration begin immediately, whereas with malonic acid there is an induction period. The sharpness, and stability, of the the oscillations a nd existence of a of threshold chemical reproducibility concentrations necessaryfor oscillatory behavior prove that the chemical oscillationsshown in Fig. 13.1 belongto the class of temporal dissipative structures.This is substantiated by the mathematical model of the reaction analyzed in Section13.4. Mixture in One Dimension Spatially Inhomogeneous reaction is carriedout in a thin, long vertical tube (Busse,1969; there appearhorizontal bandscorresponding Herschkowitz-Kaufman,1970) to alternatively high concentration regionsof the chemicals (seeFig.13.2). The analogy with the spatial dissipative structures displayed in Chapter7 is tempting. Recently,however,Kopelland HowardA973b)and Thoenes A973) pointed out that under usual experimental conditionsthese patterns are rather than likely to becausedby external temperature and density gradients and a induced diffusion also Beck Varadi, (see by symmetry breaking by that and Svobodova i t should mentioned Marek be Nevertheless, 1972). of steady-state, A975) have recently reportedresultsindicating the existence s olutions in flow a reactor space-dependent undergoing the BelousovWhen the
Zhabotinskireaction.
Horizontal bands in the BelousovFigure Zhabotinski reaction. Light strips correspond to regions where oxidation steps are predominant (after M. Herschkowitz-Kaufman, 1970).
13.2.
Mixture in Two and Three Dimensions Spatially Inhomogeneous reaction takesplacein an unstirred shallow layer (e.g., in a a usual container, various forms of wavelike activity are observed(Zaikin and Zhabotinski,1970; In the thin Winfree, 1972, 1974b). layer the most common ones are concentration waves with cylindrical showsthe successive consymmetry or rotating spiral waves. Figure 13.3 concentration patterns in the latter case. of It is noteworthy that the appearance
Finally, when the
petri dish) or
in
342
Figure
(after
On the thesewavesdoes not necessarily require a locallyoscillatingreaction. other hand, a leadingcenter area exceeding a critical dimension seemsto be the spiralstake the form of an always involved.In the three-dimensionalcase into itself.The reaction scroll. Sometimes the scrollaxiscan close unfolding It is generally remains oscillatoryeverywherein spaceexceptalong the axis. that the emergence of thesepatterns is likely to requirean instability accepted
Mechanism 13.3.
343
causedby diffusion. We have, therefore, a striking experimental illustration of a spatiotemporal dissipative structure. Equally striking is the resemblance of the patterns of Fig. 13.3 to the patterns deducedfrom the theoretical modelanalyzed in Chapter7 on the one hand, and on the other hand, to the with biological type of activity onetendsto associate systems.
13.3. MECHANISM
order to interpret these fascinating and extremely spectacularpheon a theoretical basis,it is necessary mechanism to have the detailed of the reaction. and co-workers Field,Koros, Noyesand Recently,Noyes, (see 1974 for a recent survey) completed an extensiveseriesof experiments Field, on the malonic acid-bromate reaction and proposed a detailed kinetic mechanism comprising not less than 11 steps.Fortunately, they were able in to simplify their more detailed mechanism and interpret the oscillations in solution terms of the of three substances: homogeneous key properties (a) HBrO2,which seemsto play the roleof a switch intermediate, (b) Br\", which seemsto play the role of a control intermediate, and (c) Ce4+,which can be regardedas a regenerationintermediate in the sensethat it is rapidly producedwhen the system is switchedin onedirection and permits thereafter Moreprecisely, the following the formation of the control intermediate Br~. to the abundanceof Br\" : reactionsseemto dominate, according
In
phenomena*
\342\200\242
With
enough Br
:
kl
\342\200\224^-> >
(i)
(ii)
\342\200\242
BrO3- + Br + 2H+
HBrO2+ HOBr
With
2HOBr HBrO2+ Br~ + H+ + small quantities of Br~ left, Ce3 is oxidized accordingto: k' 2BrO2-+ H2O BrO3 + HBrO2+ H+
>
The first
combining
with
a concentration
+ HBrO2+ Ce4 + 2HBrO2 BrO3\" + HOBr+ H step is rate limiting, whereas HOBr disappearsquickly by comstate is reachedwith malonic acid.From (i) and (ii), a quasisteady
BrO2- + Ce3++ H+
ki
>
\342\200\224^->
where kjk2 ~
\342\200\242
10\"9.
A nice feature of this reaction is that it can be carried out extremely easily. The interested reader is urged to try to apply oneofthe recipes given by Winfree or by Herschkowitz-Kaufman.
344
Step (iii) is rate limiting. Steps(iii) and (iv) taken together are equivalent to an autocatalyticgeneration of HBrO2 A new quasisteady state is reached
\342\200\242
with
where
r^ ^
It which processes
10\024,
k3
= l0*M~h~l.
is gratifying to see, in
this concrete system,the importance of autocatalytic was anticipated in the analysisof the mathematical model of
Chapter7.
Autocalytic
for Now from (ii) and (iii) it appearsthat Br~ and BrOjcompete as long as productionof the latter will be impossible
HBrO2.
A3.3)
A3.4)
the reaction switches from pathway (i)-(ii) to pathway (iii)-(v).As [HBrO2] then from (ii) Br\" is consumed, and [Br~] increases, dropsbelow the critical value A3.4). Br^ accordOn the other hand, the producedCe4+regenerates to the global reaction:
according
4Ce4++ BrCH(COOHJ + H2O + HOBr k\" 2Br\" +4Ce3+ + 3CO2 + 6H+ exceeds the threshold value A3.4)and [HBrO2] comes [Br\"] Subsequently, In this way the occurrence of oscillations backto the levelgiven by Eq.A3.1). is explainedqualitatively. A quantitative study of the model based on the mechanism just outlined confirms the existenceof oscillationssimilar to thoseshown on Fig.13.1, as shown in Section13.4. This successfulanalysis of the mechanism of the Belousov-Zhabotinski reaction has motivated a number of further investigations on nonbiological reactionsgiving rise to dissipative structures.Thus, recently Pacault, de have conducted experimentson the Kepper, and Hanusse A974, 1975) This Briggs-Rauscher oscillating reaction (Briggsand Rauscher, 1973). reaction involves hydrogen peroxide,malonic acid, KIO3, MnSO4, and In addition to and can be carriedout under open-system conditions. HC1O4 sustained oscillationsone observes abrupt transitions in the chemical
(vi)
>
13.4. The\"Oregonator\"
briefly in
345
Section13.7.
Stroot and Janjic, Janjic and colleagues (Janjic and Stroot,1974; a series of studies on oscillating reactionswhereby a number 1975) report of ketoniccompoundsgenerate oscillations in Belousov-Zhabotinski-type reactionsinvolving bromate as well as a catalytic agent.
Finally,
A975),and Othmer A975). The model discussedbelow has been introduced by Field and Noyes and is frequently referred to in the literature as the \"Oregonator.\" A974,1975) Let
X
Y
A3.5)
be the concentrations of the three key substanceswhose behavior was in Section13.3. described Moreover, we set A = B = [BrOj]
A3.6) the conversionof Y that reaction (i) describes from Section13.3 Then, we see to X, reaction (ii) the simultaneous inactivation of X and Y, reactions(iii) and (iv) the autocatalytic generation of X, reaction (v) the bimolecular of X, and the global reaction (vi) the transformation of Z decomposition into Y. Hence, we write the following steps:
A X
+ +
Y Y
\342\200\224^-\302\273
A3.7a)
346
rate constantskY to k 34 contain the effectof the concentration of H + , and k6 contains the effectof The overall reaction is a linear combination of (Noyes, bromomalonic acid.
/P + Q
A3.7b)
any/
(/ - 1)A + 2B
2B
B
\342\226\272
(/ + 1)P
2/P+ A
P
\302\273
- /)Q
\342\226\272
Note that all reactions are taken to be irreversible.The reversibleOregonator was recently studied by Field A975). A comparisonwith the detailed the following values for the rate constants: mechanism suggests
k1 k2
V Ic5=4x107M\"
The values of k6 and/areusedas parameters. Finally, in the region studied = = = = 0.8M. A B Herewhereas [BrO3~] 0.06M, experimentally [H+] thesevaluesare taken constant, and this amounts to treating the system as open.Because of this, of the (quadratic) nonlinearity of three of the steps and the large distance from equilibrium, the system has the necessary ingredients for presentingcooperative behavior. We also note that such a behavior would be perfectly compatiblewith the Hanusse-Tyson-Light three variable intermediates. theorem, as the model comprises first a spatially uniform mixture. The rate equations Consider are:
Hereafter
~
_
\342\200\224
at
\342\200\224
V ftjjii
V A
K2J\\.
W I
_l_
T\"
b BV K34.D-A
b Y2 1. 5
\"I
j\\
dt
= -kyAY
k2XY
+ fkbZ
A3.9)
~ = k3ABX-k(,Z at
one. See Faraday
* Actually, the regeneration step for Br^ described
Symposium on Oscillatory
by
Theseequationsdisplay widely different constantswith ordersranging from 1 to 109. to two time scales Thus, we expectthe system to evolve according
A3.7a) might not bethe most appropriate
Phenomena,
1974.
13.5. Oscillatory
Behavior
347
in a way similar to the and perform, in particular, relaxation oscillations To see of Section8.10. this, we cast the system treated in the first subsection in terms of the dimensionless variables x,y, z and t and differential equations the dimensionless parameters q, s, w defined asfollows:
A3.10)
and
rr4
\342\200\224
k2k34B
xy
+x
2^ qxA)
+ fz) dl=X-(-y-xy
dz
A3.12)
Jx
= w(x
z)
s = 77.27 and For the estimates given above, one has q = 8.375x 10~6, the indeed two w = 0.1610 We see that involves kb. system immediately time scales, sincethe evolutionof x is determined by the inversetime constant
or lessthan
unity.
Equations A3.12)admit a trivial solution x0 = j0 = z0 = 0 which is always unstable, and a single positive steady-statesolution.This solution can be evaluated explicitlyfrom Eq. A3.12): z0 = x0
y0
= t~~ i[U+
/) - <7*ol
A3.13a)
348
where of having chemical oscillations We want now to investigatethe possibility of such solutionsis if of the limit-cycletype. An indication of the existence A an unstable critical linear about this point can is point. analysis (x0,)>o>zo) in Chapter6 and applied becarriedout explicitly,by the methods developed of Chapter7. Setting on the example
x
= x0 + xeM (etc.)
one finds the characteristic equation (Fieldand Noyes,1974; Murray, 1974; Hastingsand Murray, 1975):
a>3
Ta>2 +
dot
=0
A3.14)
where T, S,A dependon x0,y0, z0 and on the parameters s, w,f, q of which w and/aretaken to vary whereas s and q are kept fixed. We want at least one of the necessary and sufficient conditionsfor the roots of Eq.A3.14) to have negative real parts be violated. Theseconditions are (Abramowitz and Stegun, 1964): A < 0, A T3 > 0 A3.15)
T<0,
One can seethat for all realistic values of the parametersthe first two conconditions are satisfied. After some algebra,the instability condition which is the inverseof the third inequality can be cast in the form
0 where the
stability
A3.16)
wc(/)=
-^
^
+
2
/d /(I
*\342\200\236)]
with
= sy0 + l~ + 2qs\\x0
Vs
if
the right-hand
requires:
2qx2 + xo(q
- 1)+ / < 0
A3.18)
J3.5.
With
Oscillatory
Behavior
349
for q, s and
x0 as a function
A
the last
gives:
fu
where
< f <fic
A3.19)
Coming now to the behavior of the systempast the instability, one should quote a general result due to Hastingsand Murray A975) who proved, using topologicalmethods,that the model equationspossessat least one finite-amplitude periodictrajectory. The periodicsolutionshave been conconstructed Tyson, 1976) analytically using bifurcation theory (Erneux, 1977; 480.0
@.9935, 450.05)
360.0
Stable
240.0
120.0
1=1
0.0 0.0
Figure
iv
1.0
diagram
2.0
for q
3.0
= 8.375 x 10~6,s = 77.27,
0.1610**.
13.4. Linear
stability
for Oregonator
350 7.0
6.0 5.0
6 4.0
3.0
\\\\
\342\200\224
\342\200\224
\\i
2.0 1.0
0.0
\342\226\2401.0
~l
1 1 1
35.8'
k\\
r
fv
\302\273
X
V> V\\
W3
N? *o 268
1 1
50
A
| -3 -2
1
-1
1
| 0
\\ny
|
1
| 2
| 3
(B)
of logarithmic (A) Projection of limit-cycle solution for Oregonator in space Figure variables X and Y. (B) Characteristic curve in the X-Y plane obtained by applying the quasisteady-state relation, Eq. A3.20).
13.5.
or asymptotic methods(Stanshine, 1975). One finds that in the vicinity of point behaves like a focus, unstable (if/lc < <f2c)or stable (if/</lcor/>/2c). Within the unstable region the asymptotic analysis yields a limit cycle of a finite amplitude, whereas for <fu one finds a small-amplitude unstable limit cycle surroundedby a stable one of It is large amplitude. A similar situation is encounteredin Chapter 15. possiblethat both limit cyclesin this region belongto subcritical branches bifurcating from/lc (for the unstable cycle)and from/2c (for the stablecycle). The results of computer simulations (Fieldand Noyes,1974) confirm the theoretical predictions and illustrate the almost discontinuous character of the oscillations the from occurrence of two time scales. arising Figure 13.5/4 the of the limit in the X-Y plane. This shape, represents projection cycle with a that reasonable together Eq.A3.12) suggests approximation would be to assumethat x adjusts instantaneously to the concentration of y. The validity of this \"quasisteady-state assumption\"is basedon the fact that the first equation A3.12) can be written as:
/ /
1 dx s ax
\342\200\224
xy
+x
\342\200\224
qx
351 5.0
\342\200\224
3.0
Inx
\342\200\224
\342\200\224
1.0
1
0.0
150.0
300.0
r
450.0 600.0
steady-state solution.
Figure
13.6. Logarithmic
Perturbation applied at t
= 153.
plot of In x following
s Since
in
^> 1 the left-hand sidecan be set equal to zero, and x can be expressed terms of y by the algebraic relation
x
which
= {A
y)
+ [(i
- yJ +
2<z
A3.20)
One can show numerically that the representedin Figure 13.5B. model and for of the limit cyclein the Y-Z plane for the complete projections similar. the model where assumption A3.20)has beenmadeare quite Finally, the numerical analysis showsthat perturbations around a stable steady state decay back to this state after displaying a flash of activity which can last a very limited periodof time, as shown on Fig.13.6.
is
13.6SPATIAL
PATTERNS
When diffusion is taken into account, the rate equations for the Oregonator to analyze. Stanshine A975) performed an asymptotic become more complex He obtains analysis of these equations,as describedbriefly in Section8.5. solutions in the form of spiral waves emanating from a \"leading center.\" It would be very desirableto completethese considerations with linear
stability-
analysis to determine the role of diffusion in the initiation of the This would settle the point raised in Section13.2. spatial patterns described Smoesand Dreitlein, 1973) by someauthors (e.g., Thones,1973; according
i52
to which all spatial patterns\342\200\224including be interpreted spiral in terms of the dependence of the frequencyoflocal oscillators on temperature and concentration. In this respect,however, we may note that the analysis of Chapter 7 and Section suggeststhat spatiotemporalpatterns can in chemical notably systems involving more than two systems, appear variables,as a result ofa symmetry-breakinginstability causedby diffusion. A general analysis of the equations governing the wave front in the Oregonatorhas recently been reportedby Murray A976).Wave solutions, to moving bandsof concentration, are shown to exist, and which correspond upper bounds for the wave speed are provided.Numerical results with parameter values obtained from experiment, compare favorably with the observations on the Belousov-Zhabotinski reagent.
8.6
13.7.BRIGGS-RAUSCHER REACTION
Pacault and co-workers de Kepper, (Pacault, de Kepper,and Hanusse,1975; have realizedan open homogeneous reactor for Pacault, and Rossi 1976) the study of the Briggs-Rauscher reactionmentioned at the end of Section13.3. In addition to parameterssuch as the rate of stirring, the temperature, and rate of influx within the reactor, they control the concentrations pressure, of a number of \"initial\" chemical species oncethe latter are injected within
Figure
13.7.Experimental
stability diagram
spaceof chemical
constraints.
13.7.
Briggs\342\200\224Rauscher
Reaction
353
10
irii
I-1,
T = 25-C.
13.8. Double
the reactor and are suitably homogenized. These \"chemicalconstraints\" are the concentrations of (H2O2J, The response and KIO3. CH2(CO2HJ, of the system to these constraints is determined by measuring the instanvalues of the temperature, redox potential, and concentration of iodine,which is formed during the reaction. on the values of the various constraints, one finds oscillatory Depending or nonoscillatory states.Figure 13.7 depictsthe state diagram of the systemin the space of the three chemical constraints referred to above. Inside the surfaceone has oscillatorybehavior, whereas outsidethe system evolvesto a steady state. A very interesting point concerns between states. On the transitions for crossingthe boundariesof the state diagram one can, certain additional switch between an oscillatory state and a slight variations of the parameters, a state different to steady corresponding (average)concentration level, and viceversa. Thesediscontinuous transitions may or may not be accompanied
instantaneous
by
A different
single jump to a new state, the system switches periodically between two Such \"double periodicities\" oscillatory steps having different periods. and arisefrequently in systems oscillators (cf. Section8.7) involving coupled for the models couldprovide useful indications in the elaboration of plausible
reaction.
Chapter 14
or (b) periodicity in enzyme activity due to regulation at the level of the enzyme itself; these so-calledmetabolic oscillationsare the main subject of the presentchapter. While the first type of oscillation, known also as epigeneticoscillations,have a period of the order of the hour, the periodof metabolic oscillations is of the order of the minute. Severalreviewsof biochemical oscillations are available in the literature Goldbeterand Caplan, 1976). In this chapter we (Hessand Boiteux, 1971; focus on a few representative examples of oscillatory enzymes giving rise to and related self-organization phenomena.We treat, metabolic oscillations the phosphofructokinase reaction in connection with the successively, the glycolytic oscillations, adenyl cyclase reaction, which catalyzes the of AMP in someorganisms, and reactions involving periodicsynthesis cyclic membrane-bound enzymes.
This may be due to one of two causes: sequence. (a) periodicity in enzyme synthesis due to control mechanisms at the genetic level (seeChapter 15)
they
10
354
Cycle
355
TPI
GAP
3-PG
PGM
2-PG
PPH
1L ii
PEP
.
I
-ADP
\342\204\242
Framed parts pathway. PFK and allosteric enzymes steps involving represent PYK. Figure
14.1. Glycolytic
yeast cells,yeast cell-freeextracts, beef-heart extracts,rat skeletal-muscle Finally, a reconstituted glycolyticsystem has been extracts,and tumor cells. studied in great detail and depth by Hess and co-workers(seeHess and for a survey). Boiteux, 1971, is a phenomenon of the greatest importance for the energetics Glycolysis of living cells. It consistsin the degradation of one moleculeof glucoseand of ATP, by meansofa linear sequence the overall production of two molecules The global of enzyme-catalyzed reactions summarized in Figure 14.1. reaction reads:
in
glucose+ 2 ADP +
2P,\342\226\240
+ 2NAD
2(pyruvate)
556
At
Regulatory
at the Processes
Subcellular
Level
severalpoints along the chain a number of branchings take place,coupling in the cell, such as the Krebs cycle glycolysis to other energetic processes and the respiratory chain. A coupling with the biosynthetic pathways also via the adenine nucleotides. occurs, Let us now summarize the principal experimental facts for the reconglycolytic system, which is the basis for the theoretical model
presentedin Section14.3.
reconstituted
of Oscillations Characteristics
Oscillationsin the concentrations of all metabolites of the chain are observedfor certain (weak)rates of glycolyticsubstrateinjection. (ii) The periodof the phenomenon is of the order of the minute and depends on the temperature. The concentrations of the metabolites vary periodically
(i)
a range between 10\025 and 10~3M. (iii) All glycolytic intermediates oscillatewith the same period but with different phases.They can be classified in two groupsdiffering by a phase angle Aa, which is an increasing function of the substrate injection rate.
in
395nm
Yeast extract
Glucose input
100 mM/hr
= = 5s 1-99
E7.4 mg/ml)
Figure
at
14.2. Experimental
Cycle
$57
each of the two groupsthe constituents oscillate in phase or with a the time variation of NADHduring phaselag of Figure 14.2 represents several periodsof the oscillation. (iv) The shape,amplitude, and period of oscillation depend on the rate of entry of the substrate.Belowa critical rate of injection the system presents or evolvesmonotonously to a steady state characterized dampedoscillations a certain critical by a high level of NADH.When the rate of entry exceeds value the oscillations are again damped,and one observesa steady state to a low levelof NADH.Thus, glycolyticoscillations arisein corresponding a bounded domain of rate of influx of the substrate.This fact, reminiscentof the stability diagram of Fig. 13.4 for the Belousov-Zhabotinski reaction, plays a crucial role in the construction of the theoretical model reportedin
Section14.3.
* We assume that the reader is familiar with the basic notions of allosteric proteins. A good review with illustrations on several regulatory enzymes is given by Bernhard A968).
358
Regulatory
at the Processes
Subcellular
Level
yeast.Finally, the substrate ATP plays an inhibitory role which disappears under the action of the secondsubstrate,F6P, which is an activator of the
enzyme. As a result of these regulations PFK presentsa periodic\"on-off\" perof oscillations, in the course performance passingfrom 1 % to 80% of its maxithat the enzyme conformation itself oscillates activity. This suggests between an \"inactive\" and an \"active\" form. The control by the various that as we saw gives rise to the periodicoperation of adenine nucleotides for the propagation of the periodicpulseof enzyme PFK,is alsoresponsible activity to the lower part of the pathway. Similar experimental observations have been made on intact cells and cell extracts.
maximum
The first theoretical model of the glycolytic pathway which predicted oscillatory behavior was worked out by HigginsA964). Shortly after the discovery of the privileged role of the PFK in the glycolytic chain, Sel'kov A968) proposed an elegant theoretical model for glycolytic oscillations The model involvesa phenombasedsolely on the PFKcatalyzed reaction. Ansatz the of PFK by its product, and activation enological concerning the Goldbeterand a first of observed behavior. Subsequently, gives picture Lefever A972) worked out a more elaborate model taking into account explicitly the allostericnature of PFK. The assumptions the Goldbeter-Lefever model may be sumunderlying summarized as follows (seeFig.14.3): hypotheses.We considera monosubstrateallostericenzyme of two The protomersexist under two conformations, consisting protomers. R and T, which may differ by their catalytic activity and by their affinity toward the substrate.The reversible transition between these two conforis fully concerted,in agreement with the allosteric model of Monod, The on and obtained binding of the Wyman, Changeux A965). complexes to substrateto the R and T forms decompose irreversibly yield the product. The latter is a positive effectorof the enzyme and bindsexclusivelyto the R conformation, which has a larger affinity toward the substrate and/or a larger turnover number than the T state. (ii) Environmental hypotheses.The system is open;the substrate is supplied at a constant rate, whereas the product is removed proportionally to its concentration.
(i) Structural
conformations
d
\" a
d ^\"
\"\"a
o+
o o
o o
\342\200\242
o
\342\200\242
o o
\342\200\242
o o
\342\200\242 \342\200\242
o o
\342\200\242
w
\302\253
is Figure 14.3. Allosteric dimer enzyme model activated by reaction product. Substrate to active R state of enzyme and is removed from system proportionally to its concentration enzymatic complexes;k, k' are irreversible decomposition rate constants of forms R and T
(#)
follow from the regulatory properties the preceding assumptions Although of phosphofructokinase outlined in Section 14.2, several simplifications have beenmade. A detailedmodel should take into account the two subAs discussed in Section substrates of PFK,namely ATP and F6P. 14.2, glycolytic the are controlled oscillations by coupleATP/ADP rather than by the couple a two-variable monosubstrateenzyme which strongly suggests F6P/FDP, the analytical treatment of This assumption simplifiesconsiderably model. the system.The two variables consideredare the substrate ATP and the product ADP. The fact that F6Pis the substrateutilized experimentally in as ATP is being producedby the glycolythe control of glycolyticoscillations, does not affect this itself, system hypothesis;the important point is that the combination of F6Pand ATP producesfinally the activator ADP, the causeof the instability leading to oscillations. We can neglect the second w hich has no control and Sel'kov,1969) and FDP, (Betz product, regulatory doesnot induce any phaseshift (Hessand Boiteux, 1968a) under oscillatory conditionsin yeast. Moreover, the accumulation of FDPhas no effecton (Hessand Boiteux, personalcommunication). glycolytic periodicities is often a tetramer (Mansour, 1972) as in E. coli Phosphofructokinase Association-dissociation (Blangy,Buc,and Monod,1968). phenomena may also play a role in the regulation of the enzyme (Mansour,1972). we Here, considera single molecular enzyme speciesand restrict our analysis to the of a dimer.It shouldbe stressedthat the main simplestand minimal case of allostericproteins,namely, cooperative interactions, are characteristics already presentwhen the enzyme consistsof two protomers.Extension of the model to n protomersshowsno major difference with the dimer case
glycolytic
(Plesser, 1975).
affinity
The model consideredis a mixed K-V system in the terminology of Monod and co-workersA965):Indeed,the substrate exhibits differential toward two enzyme conformations (K effect),while at the same time
statesR and T differ in their catalytic properties The reasonfor (V effect). the general case for of a K-V system is twofold.The expressions considering of the general perfect K or V systemsare easily derived as limiting cases On the other hand, the role of enzyme inhibition by the substrate equations. in the mechanismof instability can be readily analyzed in such a system.As A965),such an inhibition is observed pointedout by Monodand co-workers K-V system provided the substratebindswith the highest in the concerted to the less active state of the protein. In the initial publication affinity in which the T state is totally Goldbeterand LefeverA972) treated the case inactive. Herewe present,therefore, a generalization of theseresults(seealso The last hypothesis concernGoldbeter1973; Goldbeterand Nicolis,1976). the enzyme regardsthe catalytic step,which is treated as irreversible in agreement with the experimental observations (Hess,Boiteux, and Kruger,
the
concerning
PFKreaction.
Oscillations
j/j/
substrateis only an approximation in vivo. It corresponds, nevertheless,to the conditionsfor the experiments with yeast cellsand extracts.The effect of a periodicinput of substrateand the case of a random substrateinjection rate are consideredbriefly in Section14.4. The latter situation is likely to of the system in vivo. representa more realistic description The last hypothesis concernsthe sink of the product.We considera nonsaturated sink for the product,taking into account the large concentration of enzymes following PFK in the glycolytic sequence(Hess,Boiteux, and In such a way, the only nonlinearity in the system arisesfrom Kruger, 1969). the regulation and cooperativity of the allosteric enzyme considered.
From a thermodynamic point of view, the requirement that the limit cycle behavior only arises in open systems operating far from equilibrium is the sink of the product,and the certainly satisfied,as the sourceof substrate, catalytic stepsare purely irreversible. The model corresponding is represented in to the preceding assumptions We denote by a, a' the kinetic constants for the binding of the Fig. 14.3. substrateto the R and T states,respectively;the corresponding dissociation constantsare denotedd and d'.Similarly, binding of the product to the R state and dissociationof the resulting complexes correspondto constants We consider the simple case where a2 = a and d2 = d. The constants a2,d2. k,,k2 are related to the interconversionof Ro into To; k and k! are the catalytic constantsrelated to the irreversibledecomposition of the enzyme-substrate in the R and T states,respectively (usually k! will be zero). The complexes constant input rate of the substrateis denotedvx, whereas ^s is the kinetic constant related to the outflow of the product.
Kinetic Equations The effectof diffusion considerhere the limit of a homogeneous system. is briefly analyzed in Section Let S and P denote the concentration of the substrateand the product, the concentration of the enzyme species in the R respectively;Ri} represents S state with i molecules of and molecules of P bound. Ro and To are the concentrations of the two enzyme conformations free of ligands;Tt and T2 are the two enzyme-substrate in the T state.We set: complexes
We
14.5. j
^\342\226\2401
\302\2433
362
Regulatory
at the Processes
Subcellular
Level
dt
dR01 =
dt
dR\302\2602
- dR01 - aPR01 + - 2aSR01+ - 2aSRO2+ + = aPROi ' = 2aSR0 - + k)R10- aSR10+ + dRl0 p..= + 2aSR01 - + k)Ru - aSRu +
dt
2dRO2
k)Rl2
dt
(d
2(d
k)R20
dt
(d
2{d
k)R21
dR12 =
dt
2aSRO2
aSRl0 2(d +
A4.4)
\342\200\224
~ = 2a'ST0IT,
dt
(</' +
k')Ti
k')T2
- a'S^+ 2(d' +
2 3
k')T2
a'ST,
- 2(d' +
ab
dS
dt
12
+
rfi1\342\200\224
li + 2a 12
\342\200\224
= -2aFi?0 + (d
+
Jt'7\\
2rf/?O2
^2
Oscillations
363
=0
A4.5)
where
=
\302\243Ry
\302\243i+r2+\302\2433
A4.6)
if
ij
that in the one observes time scales. Thus, one separate can make the usual assumption of a quasistationary state for the enzymatic forms (Heineken, The evolution equationsfor Tsuchiya, and Aris, 1967). these forms then reduceto algebraicrelations that permit expression of the concentration of the various enzyme complexes in terms of the metabolite
concentrations.
It is convenient here to normalize the metabolite concentrations by division through the dissociationconstant of their complexeswith the enzyme in the R state (Monod,Wyman, and Changeux, 1965):
where
KR(S)
= KR(P) = -=KR a
A4.8)
is given by
KT(S)
KR(S)
A4.9)
_ *i
The allosteric constant, L, equal to the equilibrium ratio To/Ro,gives the relative amounts of protein in the T and R states in the absenceof ligands.
364
Regulatory
Processes at the
Subcellular
Level
The nonexclusive c,gives a measureof the relative affinity binding coefficient, of the substratefor both enzymeconformations.Both parameters L and care the of the to kinetics. related cooperativity closely enzyme
Finally writing k
k
<14\302\273
'
PoO + yJ
e+1
e' +
1/
\"
V
e+1
ac V
c' +
the
\\J
\\
\302\243+1
into the evolutionequations ofa and y, one obtains Inserting relation A4.12)
equations:
da
dy
r,
A4-13)
ft=f(a,y)-k,y
where
e' +
1/
7
V
\302\243+1.
A4.14)
Oscillations
365
states:
^<1
A4.13)\342\200\224A4.14)
A4.15)
We note that a perfect K system is defined by 9 = 1, c < 1, whereas both 9 and c are smaller than 1 in a K-V system. A perfect V system is dennedby 9 < 1, c = 1 (Monod,Wyman, and Changeux, 1965). is On the other hand, the term 2kD0 appearingin Eqs. the Let us write: to maximum rate the of equal enzyme reaction, vM.
With
form:
= a1
- /(a,
y)
A4.17)
f{*y)ky
with
e' +
All
1/
\"V
e+ 1.
A4.18)
except the quantities appearingin these equationsare dimensionless, an inverse of time. It is of whose dimension is that parametersa1, aM, ks, the values of allosteric to out in the limit of that, gratifying point very large constant L ^> (ct, + ksJ/k2,of e(e ^> 1), and for the parameter c = 0, the rate equations reduce to a form similar to the trimolecular model [seeEq. This limiting version of the allostericmodel has been analyzed G.13)]. recently by LefeverA975).
Stationary Statesand Stability Analysis
At
=~
A4.19)
366
Regulatory
Processes at the
Subcellular
Level
relation:
a0
Bax
aA
A4.20) + a,(L'+ 1)= 0 with L = L/(l + y0J. Oneseesimmediatelythat the systemcannot reach any physicalstationary state when the rate of entrance of the substrate,vu exceeds the maximum reaction rate vM. Otherwise, the system admits a singlestationary state, <x0, given by the largest of the roots of Eq.A4.20). The existence of multiple stationary statescannot be ruled out when the number of protomersconstituting the enzyme is larger than two. It has been that allostericsystems may admit three stationary shown (Wyman, 1969) states when the number of protomers tends to infinity as in membrane The coupling systems(seealso Blumenthal, Changeux, and Lefever, 1970). of cooperativity to positive feedbackin the model consideredcould bring about a similar effectwith a finite number of enzyme subunits.However,the of a single physical steady analysis of such modelsindicatesthe existence as in the case dimer state, (Plesser, 1975). The next step in the analysis is to determine the stability propertiesof the stationary state. These propertiesare closelyrelated to the dynamic bebehavior of the system, as shown in Chapters6 and 7. Let us investigatethe response of the system to infinitesimal perturbations da, dy from the singular point (<x0, y0) by means of a normal modeanalysis. The linearization of Eqs.A4.17) and A4.18) leadsto the following system:
pAC8*BC6y at
at
^ = AC da + (BC
form
A4.21)
ks)dy
da = aea\"
c
* o* =y emt
A4.22a)
B) +
kjco+ ksAC = 0
A4.22b)
14.3.Allosterk
We
367
have set:
e+ 1/
\302\243+1
Ve'+ l/\\
+e'+ 1,
2
e+ 1 A
e' +
1A
e' +
1/ Ve+ 1 A
e' +
e+l
A4.23)
+ (l + To)
A study of the characteristic equation enables us to determine the nature of the singular point (a0,y0) in the phase plane (a, y). Now, the quantity C is this is also true for of a perfect K system @ = 1), always positive. In the case A. In fact, the latter quantity is always positive for any value of 6, provided c and c are lessthan one, which is generally ensured.Thus, the steady state can only becomeunstable Re co 0) for
(i.e., >
C(A
B) + ks
<0
=0
A4.24a)
stability
is dennedby
A4.24b)
B) + ks
In the neighborhood of and above this critical situation, the singular point enters the unstable region as a focus.The steady state is then enclosed by a limit cycle (Fig.14.4)corresponding to sustainedoscillationsof the conconcentrations a and y in time. Far from the critical region the singular point becomes an unstable node,but remains enclosed by a limit cycle as shown by numerical integration. Insertion of the value
ks
= C(B
A)
368
Regulatory
at the Processes
Subcellular
Level
20
15
10
Figure
14.4. Evolution to limit-cycle solution in a-y phase plane obtained by integration of Eq. A4.17)on analog computer. Values of a, y at unstable steady state are a0 = 16,y0 = 2. = 103 s , ks = 0.1s Parameter values are a, = 0.2 mM, KR = Do = 5 x 10~4 5 x 10\022 mM, L = 7.5 x 106,c = 10~2, = e' = 6 = 0. Period of the oscillations:
\302\243
145s.
0.1,
s~',
to
at marginal
stability
'T
In
C[A(B
This relation is in good agreement with numerical resultswhen the system has just entered the unstable domain. As shown in Fig.14.4, the limit cycle is stablesinceit can be reachedfrom either inside Numerical (e.g., starting near the unstable steadystate) oroutside. a initial leads to with various conditions unique asympalways integration trajectory. Thus, transitions between multiple limit cyclesseemto be
asymptotic
in excluded
this
system.
14.4. Limit-Cycle
Oscillations
369
Thesediagrams describe the behavior of the system as a function of the main and ks. parametersa1,aM,L,9,c,
A direct examination of these diagrams allows a number of qualitative observations (Goldbeter and Lefever, 1972):
\342\200\242
\342\200\242
\342\200\242
Sustained are observed oscillations in K as well as in K-V systems. The unstabledomain generallycorresponds to large valuesof the allosteric constant, L, of the order of thoseobtained experimentallyfor a number of allosteric proteins. for limit cycle beSubstrateinhibition of the enzyme is not a prerequisite behavior sincethe system may oscillatefor c = 0, 9 = 0.
of the periodic In Section14.4 we analyze in somedetail the characteristics solution in the case of a constant inflow of substrate.Where possible,the theoretical predictionsare comparedto the experimental facts concerning glycolyticoscillations.
Note of the oscillations. substrateentry a^ on the characteristics together ks, are the principal parametersthat can be controlledin
with
experiments.
Particular attention was given to the effectof the variation of the rate of
that
au
experi-
the influenceof ax on the amplitude of the metabolite describes Figure 14.5 and on the of y period the oscillations.We observe that the amplitude a maximum and that the curve y = y(ox) is slightly asymmetric displays and extendsbetween two finite values of ax, which correspondto states of marginal stability. The period, on the other hand, displaysan inflexion point correspondingto the maximum of the amplitude and decreases within most of the interval between the two extreme values of ax. The numerical simulations show that the form of the oscillations can vary A nonsinusoidal. between almost sinusoidal and considerably distinctly periodicvariation of the enzymatic activity is alsoobservedas a function of
r(s)
10
12
14
Figure
14.5. Period
and amplitude
rate for
ff,. The activation factor is found to be higher for low valuesof the injection velocity,in agreement with experiment. The influence of other parametersrelated to environmental conditions are observedfor a restrictedinterval (e.g., Do and ks) is similar; oscillations of values of these parameters.On the other hand, the oscillatory behavior subsistsfor a wide range of variation of the structural parametersof the L, 9, c, and k). Finally, the value of the period seemsto be enzyme (e.g., remarkably insensitiveto the values of the parameters. The role of the cooperativity in the oscillationsis reflected by the fact, conthat limit cycles can only be observedfor large values of the allosteric The role of the activation by the product is equally important. Indeed, constant. the numerical study of the characteristic equation showsthat the steady state becomesan unstable focus only when the normalized concentration of the assoon product,y, is higher than unity. In other words,the instability occurs of the as the product of the reaction can induce an appreciable displacement enzymatic equilibrium toward the active forms.
371
ON LIMIT-CYCLE DISTURBANCES
in a given range is likely to representthe in fluctuating more realistically than a constant source consideredin the sections. the of the allostericenzyme oscillator previous Recently, response to a periodicand to a stochasticinput of substratewas investigated both and by numerical experimentally (Boiteux, Goldbeter, and Hess, 1975) simulations (Goldbeter and Nicolis,1976). Here the effectof we only discuss discontinuous additionsof ADP or ATP (Goldbeter,1976). Experimentally, one observesthat such pulsesof ATP or ADP phase shift the oscillations, whereas no such effect is observedwith F6Por FDP.This illustrates the important roleof adenylate control in the mechanism of glycolytic oscil-
substrateinflow
vivo situation
oscillations.
In a typical experiment(Pye, 1969), 0.7mM of ADP causesa delay of more one minute in a yeast extract oscillating with a periodof 5 min, when addedat the NADHminimum. The resultsof the corresponding simulation on the allosteric model for the PFK are shown in Fig. In Fig.14.6,4, H the unperturbed oscillations of the productand the substrate are represented, and the numerical values of the parametersare such that the period is of
than
14.6.
As indicated in Fig.14.6B, times over the period. C, F,G such an When addition of the reaction producthas no effectover most of the period. addedat an ADP minimum, an immediate responseis observedin the form of a small peak of the product as indicated in Fig. This phase shift results in a delay of more than one minute in the next peaks, which are identicalto those obtainedin Fig.\\4.6A. Earlier addition of ADP causesonly a minor phase shift, as shown in Fig.14.6D. The reason for this is that the substrate has to accumulate to a critical level before being consumedon of ADP).This condition is not satisfied addition of the positive effector(i.e.,
5 s isstudied
14.6\302\243.
in
The preceding results are in qualitative and quantitative agreement with experiment. They are also strongly reminiscent of the general behavior of nonlinear oscillators to external pulsesoutlined in Chapter8.This analogy can be pushed further by constructing the phase-shift curve 9 = 9(t0) rereferred to in Section 8.7. this curve, for a fixed duration Figure 14.7 represents of the stimulus and for variable intensities. The fact that the phaseshift is limited to a restrictedportion of the period provides a molecular basis for the refractory period observedin a number of biochemical oscillators,which is thought to play an important role in We supercellular phenomena related to development and morphogenesis. return to this point in Section14.7.
Fig.14.6D.
o g
J
I
i-
O -^
a;
o s
62
150
31
75
500
(G)
Figure
duration
1000
1500
500
1000
Time (s) (H)
Time (s)
of application
of oscillations on titration by reaction product. Arrows denote time = 8s s\" of pulse, 5 s).Curves established for <r, = 0.5 s\021,^ = 0.1 <xM
',
(S)
^r
3/47
i
3
i
40 30 20 10
+250
\342\200\224
+200
\342\200\224
+150
+ 100
\342\200\224
\342\200\224
-50
\342\200\224
-100
\342\200\224
-150
\342\200\224
curve for PFK model on titration by reaction product. Phase corresponding to delay (A0 > 0) or advance (A0 < 0) of oscillations, is given as over period T = 312 s.Phase 4> = 0 corresponds to maximum in function of addition time = 42.4. In upper inset, first maximum in y, denoted >'M, induced product concentration, 7 = value by product addition is given; phase shift is considered as phase advance when yM exceeds of 6 JyJJ,. The two curves correspond to addition of 14units of y within period of 2s @-00),and units of y within 2s Both curves are obtained by integration of Eq. A4.17)for a, = 0.1s-',(TM= = e' = lO\023, c = 1(T5, 0 = \\,L = 5 x 106. 0.5s-',fes
Figure
shift
Arj>,
<j> y\302\260M \342\200\224 (\342\200\242-\342\200\242-\342\200\242).
14.7. Phase-response
8s\"',c
374
14.6.Patterns of Spatiotemporal
Organization
375
IN
THE
In our preceding analysis the effectof diffusion has beenentirely neglected. The situation of spatial homogeneity certainly correspondsto the expericonditionsunder which the glycolyticsystem isolatedfrom yeast or muscle cellsis studiedin a continuously stirred medium. Analytically, the assumption of instantaneous homogenization allows the descriptionof the evolution of the model system by a set of ordinary differential equations. In vivo, or in the absenceof stirring in experiments with cell extracts, diffusion processes, as well as the influenceof the geometry of the system and of the boundary conditions, cease to be negligible. From the generalanalysis of Chapter 7 we know that diffusion processes of enlarge the possibilities structurization in open far-from-equilibriumsystemsby allowing the sponspontaneous formation of new patterns of spatiotemporal organization. The Belousov-Zhabotinski of reaction provides a striking example of existence such patterns, particularly in the form of propagating concentration waves. The study of models, such as the trimolecular scheme, leadsto similar results. In this section we intend to determine the conditionsunder which the allostericenzyme model consideredin the presentchapter exhibits periodin time and space. This can lead to a better understanding of the mechanisms prevailing in the generation of coherent behavior from cellular The effectof diffusion in the systemis studiedunder the following metabolism. diffusion of the substrateand simplifying assumptions: (a) one-dimensional the productand (b) spatially uniform distribution and negligiblediffusion of the enzymatic forms.* Under these conditions,adopting a quasistationary-state hypothesis for the enzyme as in the homogeneous the evolution of the metabolites case, in time and spaceis given by the partial differential equations, which are to be comparedwith Eqs.A4.13) and A4.14): da d2<x
periodicities
dt
dy
dr2
d2y
with
e+1/
* This condition is realized
enzymes.
experimentally in artificial
A4.26)
immobilized
membranes containing
376
Regulatory
at the Processes
Subcellular
Level
The spatial coordinateis denotedby r\\ Dx and D2 denote,respectively,the diffusion coefficientsof the substrateand the product.All other parameters have the same significanceas in Section14.3. We want to investigate the stability of the homogeneous stationary state (a0,y0) given by Eqs. A4.19)and A4.20) with respectto space-dependent Considerthe case of fixed concentrations at the boundaries, perturbations. values the steady-state (ao,yo).The linearized equationsA4.26) equal to state admit solutions of the form: this around
\302\243y
=y
e\302\260*
sin
\342\200\224\342\200\224
m=l,2,...,
A4.27)
no instability of the thermodynamic branch leading to a steady-state In contrast, spatiotemporal spatial dissipative structure is possible. patterns can appearbeyond instability (Goldbeter, on the dimension 1973). Depending of the system these patterns can be either standing! or propagating wavesor, the classificai n this oscillations finally, quasiuniform limit-cycle (see, respect, of time-periodic in structures dissipative developed Chapter 7). Figure a regime of propagating wave.The resemblence 14.8 describes with the beof the trimolecular described behavior in Chapter7 is striking. A particularly fascinatingphenomenon is that the regimes dominated by diffusion and by the oscillatory chemicalreaction are separatedby a critical length of the system, /*. This point has been analyzed recently by Nazarea A974), who showedthat for / < /* a reaction-diffusion system similar to Eq. A4.26)can only admit a unique solution on the thermodynamic branch, as briefly discussedin Section 7.13. An approximate expressionfor this
parameters classification
+ ksCA = 0 A4.28) The coefficientsA, B, C have the same interpretation as in Section14.3. A study of Eq.A4.28)shows that for realisticvalues of the various param-
t These\"standing spaceperiodicity,
conditions.
waves\" should not be confused'with the steady-state patterns showing a which may alsobe solutions of reaction-diffusion equations under certain
14.6.Patterns of Spatiotemporal
Organization
Model
Space (cm)
Space (cm)
0.3
of the product concentration during regime of propagating Figure 14.8. Spatial distribution s\" concentration wave in allosteric model. Length / = 0.3 cm, <t, = 5/<s = 0.5 aM = 102 s~ L = 5 x 106, c = \\02, e = e' = 6 = 0, = D2 = cm2 Period of phenomenon is T = 202.8 s.
0.1,
\302\243>,
10\"
s1.
',
'.
dct/dt
critical length is obtained easily as follows. Sincethe sign of the derivative term at in Eq. A4.26) is of the changeson the limit cycle, the source Sincethe order of the nonlinear contribution from the enzymatic reaction. kinetic term is of the order of au one is left with the approximate relation
\342\200\224
A4.29)
^=-w/ wxr
passesthrough a maximum
am
A430)
relation holds:
at r
\302\253m=
\342\200\224
j |
A4.31)
378
Regulatory
at the Processes
Subcellular
Level
The ratio
gives a measure of the relative importance of chemical reactionsand diffusion; the distribution oc(r) is uniform for infinite diffusion or for small /, and becomes If parabolicas the kinetic contribution increases. the critical length is dennedas that for which the two terms on the right-hand are of the same order,one obtains the expression sideof Eq.A4.31)
(xM/a0
/\342\200\242
^^
A4.32)
of the critical length on the square root of the ratio The dependence kinetic term) agreeswith dimensional analysisand with the simulation study. The influenceof the length of the system on the stability propertiesof the rate equations, which was alsopointed out in the analysis of the trimolecular of model (seeSection7.8), illustrates the role of diffusion or,more precisely, diffusion coefficient/(lengthJ as a coupling parameter between neighboring When this coupling is very strong, the system remains on the spatial regions. the chemicalkinetics takesoverand thermodynamic branch.When it is loose, can give rise to sustainedoscillations. Betweenthese two extremes one can have \"intermediate\" forms of organization in the form of concentration waves. What are the space scales for the various structures in the glycolytic The effectof diffusion has been studied with the same values of example? case parametersfor which the limit-cycle behavior in the homogeneous matches the oscillationsobservedin yeast and muscle with respectto the periodand amplitude. Inserting thesevalues in the model in the presenceof over which space-dependent strucdiffusion, one finds that the dimensions ariseare supracellular and vary between 10\"2 and 1 cm for the wavelike solutions.Although the equation derived for /* is a simple estimate, it yields good agreement with the simulation results.For the parametersused in relation A4.32)givesa critical length of the orderof 2.5x 10~2cm; Fig.14.8, a regime of propagating waves is achieved accordingly for / = 0.3 cm, as shown in Fig.14.8. the behavior manifestsitself Thus, clearly spatiotemporal at a supercellular level. On the basis of simulations, the behavior of the Dx = D2can be summarized in systemas a function of dimension / in the case the following way: <(///*) < 1 time-independentregime on the thermodynamic branch 0.1 <(///*) < 10: 1.0 standing waves / ^ 10/*: propagating waves
structures
/ ^>
and co-workers Recentexperiments (Hess, private communication) by Hess the existence of confirm spatiotemporalpatterns in glycolysis,with charcharacteristic lengths in the millimeter range and with periodscomparableto oscillation. thoseof the homogeneous
ofcAMP
379
14.7.PERIODICSYNTHESIS OF cAMP
most fascinating phenomena is the processof aggregation of the amoebaDictyostelium discoideum leading from isolatedcells to multicellular differentiated bodies This processinvolves an oriented responseof the cellsto a (Sussman, 1964). gradient of cyclic AMP in the extracellular medium, known as chemotaxis. It has long beenknown that amoebae of the abovementioned species aggrein a wavelike manner around a number of centers. Pulsesof cyclic AMP emitted by the centerswith a periodof severalminutes propagateoutward to other cells through a relay mechanism that allows the formation of large In connection with this phenomenon, aggregation territories (Gerisch, 1968). metabolic oscillations in suspension controlled by cAMP have beenobserved cultures of aggregation-competent D. discoideumcells (Gerischand Hess, 1974)and shown to arise independently of the glycolytic oscillations. In this sectionwe describea plausiblemechanism for the oscillations of cAMP,basedon the regulation of enzymesdirectly involved in the synthesis of this metabolite (Goldbeter, The two regulatory enzymesconsidered 1975). in the model, ATP pyrophosphohydrolase (EJ and adenyl cyclase(E2), transform ATP into 5'AMPand cAMP,respectively,as indicated in Fig.14.9. In D. discoideum,this system is positively controlled (Rossomandoand is activated by 5'AMP, whereasATP pyrophosSussman, 1973); adenylcyclase is cAMP. In cases activated both the interactions of the phorydrolase by
vital
aggregate
living
-ATP
14.9. Mechanism for oscillatory synof cAMP in slime mold Dictyostelium discoideum.
Figure
synthesis
380
Regulatory
at the Processes
Subcellular
Level
the allosteric enzymes with the effectorsare highly cooperative, suggesting nature of the enzymes. Finally, the two reaction products are coupledby which transforms cAMP into 5'AMP.The latter leaves phosphodiesterase, the system via another enzymatic step involving 5'nucleotidase.* for the modelcan be developed The rate equations in excatly the same way for the PFKreaction. as in Section14.3 The differenceis that one dealshere with three coupledvariables, namely, ATP, 5'AMP,and cAMP, and two and the nor2) the allosteric regulatory enzymes.Denoting by Lt, aMi (i = 1, maximum activity of enzyme normalized term by ax the normalized source of the substrate, by k x, k2 the rate constants for the sink of 5'AMPand cAMP, and by a, /J, y the normalizedconcentrations of ATP, 5'AMPand cAMP, one
\302\243,,
obtains:
^=
dt
_ f{a y) _
1
/\342\200\242
(a
j
where
~ k2y = f2(*J)
<tm1ocA
A4.33)
J1 Li + A + aJ(l + yJ
+ a)(l + yJ
h = zf+^T^lTTW
<R34)
the additional simplificationthat the nonexclusivebinding coefficientof the substratehas been set equal to zero for the two enzymes. The stability analysis around the steady-state solution of Eq.A4.33)shows an unstable focus. Within the unstable domain the that the latter can become system performs sustained oscillationsof the limit-cycle type shown on The periodof the phenomenon, which is well within the 3-5-min Fig. range observedexperimentally, is largely independentof the enzymatic constants and of the substrate injection rate. As in the PFKreaction, the role of enzymecooperativityin the onset of the oscillations is illustrated by the fact to that the oscillatory domain corresponds large values of the allosteric
14.10.
* A model for a circadian rhythm involving cAMP and based on negative feedback has been reported by Cummings A975).
14.7.Periodic Synthesis
21 18 8 15
ofcAMP
381
100 200 300 400 500 600 700 800 900 1000
Time (s)
Figure
14.10. Periodic
integration
kl
= k2 = 0.1 s\"\\ a,
of normalized cAMP concentration obtained from numerical values of parameters are <tm, = 0.4s\021, aM2 = 10s~l, = 0.5s\021, Z-! = L2 = 106.
variation
of the orderof 106. The pulsatory nature of the oscillations constants, displayed 14.10 and the well to the releaseof Fig. stability of the periodcorrespond pulses of cAMP by the aggregation centers as observedexperimentally has Morerecently,the oscillatorydynamicsof adenyl cyclase (Gerisch, 1968). of D. discoideumcells(Gerisch been directly demonstrated in suspensions
in
and Wick, 1975). and Segel, that Further simulationson this system(Goldbeter suggest 1977) the mechanism giving riseto the cAMP oscillations may alsobe responsible for the relay of the cAMP signal taking placeduring aggregation. The main point is that, outside the oscillatory domain, the system describedby Eq. A4.33) can amplify an external cAMP pulse if the latter activates adenyl Underthese conditions, via binding to the membranecAMP receptor. cyclase a new amount of cAMP is synthesized in the form of a pulse,thus relaying the chemotactic signal. Finally, thanks to the formation of 5'AMP from cAMP in the phosphodiesterasereaction, sustainedoscillations can still arise in the absenceof ATP In contrast, adenyl cyclase to be indispensable seems pyrophosphohydrolase. for oscillatory behavior (Goldbeter, 1975).
382
Regulatory
at the Processes
Subcellular
Level
MEMBRANE-BOUND ENZYMES
the majority of enzymes are attached to membrane the living cell, In recent years the binding of structures or contained in cell organelles. membraneswas into achieved,enabling study of the intersynthetic enzymes between diffusion and enzyme kinetics under biologically plausible Of particular interest is the possibility of achievinghomogeneous conditions. distribution of enzyme molecules (seeThomas, 1975 for a recent survey). i t that immobilization increases Moreover, appears drastically the life time of the active enzymatic forms. Generally speaking,the phenomena observedin such systemscan be classifiedinto two categories.
interaction
Effectof MembraneStructure on Enzyme Behavior The binding of enzymes into an insoluble phaseallows the creation of strucOne possibleconsequence modesthat include diffusion constraints. is an asymmetricaldistribution of active sitesin the structure. This can result in phenomena similar to active transport, in the sensethat a certain metabolite is transportedacross the membrane against gradient (Broun, Thomas, and
structural
Selegny, 1972).
Effectof LocalConcentrationDistribution of Reactants on Enzyme Behavior
The local environment within a membrane undergoing enzymatic reactions is the result of a balancebetween the flow of matter and the reactions. As a result, the substrateand product concentrations in the membrane may vary in time or differ from point to point acrossthe membrane as well as from the outer solution.For instance, sustainedoscillations have beenobservedby Caplan, Naparstek, and Zabusky A973) in the hydrolysis of benzoyl-Larginin ethyl ester by a membrane containing bound papain. Computer simulation of the model rate equationsreproducethis behavior. A striking exampleof spatial organization is reported in a study involving glucoseoxidaseand urease,in the presenceof their substrates.The glucose-oxidase reaction increases the pH, whereas the ureasereaction decreases the pH.As the enzyme activity dependsstrongly on the pH, the reaction sequenceis Finally effectively autocatalytic (Thomas, Goldbeter,and Lefever, 1977). have Chanu and Delmotte (Delmotte and Chanu, 1971; Delmotte, 1975) on the ionic transport propertiesof memconductedextensive experiments membranes containing immobilizedenzymesimmersed in an opensystem reactor
14.8. Reactions Involving Membrane-bound Enzymes and observedcooperative phenomena in the multiple regimes of transport.
383
form
of simultaneously stable
The mathematical analysis of these phenomena follows the lines adopted The main point to be retained at the outset is throughout this monograph. that the usual expressions of the activity of the various enzymes (whether allosteric or simply Michaelian)have to beunderstood in a local sense. Thus, the time evolution of, for example,a substrateconcentration S, takes the form (assuminga one-dimensional system with diffusion along the thickness of the membrane)
PC
-Ds^
/JC
A4.35)
where F(S)describesthe effect of the enzyme reaction. This equation is those for H+ the productsand for or OH\". generally coupledto The boundary conditions, for the substrate concentration, can be especially can be an impermeable symmetrical,fixed,or variable. Oneof the boundaries in such as case where an the is wall, enzymecoating attached to a sensitive
glasselectrode.
We
of the have already insisted, in Chapter7 and in the preceding sections in on of situations encountered the systemsobeypresentchapter, variability ofimmobilized To illustrate this for the case reaction-diffusion equations. membrane separating two compartenzymes,considerfirst a urate-oxidase a concentration So. a substrate solution at Supposethe containing shows an inhibition substrate excess. The rate kinetics by equation enzyme for S readsat the steady state (Duban,Kernevez, and Thomas, 1976) d2s
obeying compartments
with
= s0,
and
=0
(\302\243)
A4.36)
(R37)
The equationsare written in dimensionless variables.The length unit is the membrane thickness, the concentration unit is the Michaelis constant of the a are to the diffusion conand and k constants related enzyrfle, KM, positive thicknessof the membrane, and characteristics of the enzyme. constant, A study of Eq. A4.36) showsthat the system can admit multiple steady states and hysteresis phenomena similar to thosedescribedin Section8.4.
384
Regulatory
Subcellular
Level
diffusion
through the
ex-
So-S
where / is the thicknessof the membrane, which is now taken to be inactive and separating a reservoir from a compartment of thickness/ containing a enzyme solution. homogeneous When a cofactor is present and plays a rate-limiting role, the system is describedby the equations(Duban,Kernevez,and Thomas, 1976)
Jt~ <raF{s)
da
ds
- d2s dx2
1
aaF(s)-
d2a
\"\302\253d?
A4.38)
where a is the reducedcofactor concentration, and the boundary conditions as well as F(s) are given by similar expressions as before. Numerical and analytical studies show that this system of equations admits oscillatory solutions of the limit-cycletype in a range of parameter values. Again, this can be best seen by simplifying the partial differential for the diffusion flux, which equationsby meansof an approximate expression leadsto a system of ordinary differential equations.A more completetreattaking spatial derivatives into account predicts the possibilityof spatial patterns and/or time periodicities.
treatment
Significance
of Metabolic
Oscillations
385
phenomena where these oscillationsseem to play a prominent role:(a) modulation of the adenylic energy charge, (b) onset of developmental proand (c) problemof circadian rhythms. processes, Modulationof Adenylic Energy Charge wesaw in the first sections of this chapter, the PFKreaction takesplaceat upper part of the glycolyticcycle, whose primary role is to synthesize ATP. Thanks to the regulation via the oscillations, one can say whether the system is functioning accordingto whether the ATP level is low (high levels of ADP and AMP), or high (low levelsof ADP and AMP) or,equivalently, Atkinson A965) has quantified accordingto the energetic needsof the cell. this ideaby introducing the notion of adenylicenergycharge, which depends on the various adenylates as follows
As
the
(ATP) + j(ADP) 0 < AEC < 1 A4.39) (ATP) + (ADP) + (AMP) He suggested that this quantity controlscellular metabolism, in the sense that a high valueof AEC inhibits the sequences ofmetabolism that regenerate ATP and at the same time activates the sequences utilizing ATP. The allostericmodel of glycolytic oscillations enablesus to analyze the effectof oscillations on the adenylicenergycharge. the Figure 14.11 represents time evolution of this quantity, which is seento be periodic, as a result of the AEC =
1.0
0.8 0.6 0.4 0.2
>
,
/ /
,
I
f /
I I I
\342\200\224
150
300
450
600
from
750
,
con-
Time (s)
Figure
conjunction
definition
A4.39) in
A4.17).
386
\"entrainment\"
oscillations
Regulatory
Processes at the
Subcellular
Level
The point is that these oscillathe glycolyticoscillations. of level of energy charge during an aplead to a drastic lowering the that one of the rolesof the glycolytic appreciable periodof time. This suggests oscillatormight be to induce an alternative switch on and off of reactions
by utilizing
Circadian Rhythms
Many
of the period,phaseresetting, or entrainment by an external stimulus, enable the organism to adapt in a flexibleway to external conditions and to keep, suitable phase relations, an identical successionof various vital through
processes.
As suggested by Winfree A967) and PavlidisA973),a circadian rhythm may originate from a coupling of a number of biochemical oscillatorswhose periodis of the orderof the minute. The periodstability, phaseresetting, and for the PFK reaction in both model and experiments entrainment observed to this view (see also Winfree, 1975). add credence Nevertheless,the mechanby which the periodcan be lengthened remains a matter of speculation.
mechanisms
Chapter 15
at RegulatoryProcesses CellularLevel
15.1. INTRODUCTION
to the secondgeneral type of control mechanism in living cells, the control of the synthesis of proteins.We know that one of the namely, most important roles of proteins is catalysis of various reactions. Now, of are of the order several stable times molecules proteins (life generally Thus, it is not unusual to minutes), whereas catalysis is a very fast process. have a situation where the protein level in the cell tends to be too high. In the synthesisof to this, the organism usessomesubstances to repress response the macromolecules. In other circumstances it may happen that the organism to a violent change of the environment.New typesofmacromolecule is subject are neededto catalyze the reactionsinvolving the new substratesavailable. The ingenious trick employed by living cells is that a new substratecan itself induce the synthesis of these macromolecules.* In the first few sectionsof this chapter we show how these negative and and their combination may give riseto coherent positive feedback processes oscillations transitions or of sustained phenomena in the form of all-or-none of the limit-cycletype. The latter belongto the classof epigeneticoscillations, to the terminology of Section to the with periodscomparable according duration of the cellular cycle itself. These phenomena are illustrated in the coli); regulation of the lac operon in the bacterium Escherichiacoli sincethe pioneerbacterial regulatory mechanismsare now well established In contrast, regulation in eukaryotic work of Jacob and Monod A961). cells is, to a large extent, still an open problem(seehowever Britten and for someinteresting contributions in modellingthis phenomDavidson,
We now turn
14.1,
(\302\243.
pioneering
1969,
phenomenon).
* We assume
well
by
as with
that the reader is familiar with the main steps of the biosynthesis of proteins, as the basic concepts of the genetic code. An excellent survey is found in the monograph
Watson A965).
387
388
Regulatory
In the last sectionsof the present chapter we are concernedwith the After reviewing evidenceof the existence of a regulation of the cellular cycle. mitotic oscillator we briefly present the work of Kauffman, A974a,b; which provides a beautiful Kauffman and Wille, 1975), illustration of the in the regulation of vital activities. role of sustainedoscillations
LAC OPERON 15.2. We first analyze the utilization of a disaccharide, lactose,as a carbon and E.colicontains the enzymes by the bacterium E. coli. Although energy source for the metabolism of glucose under all conditions, cellsgrown in necessary the absenceof lactoseare unable to metabolize this substance immediately when they are suddenly exposedto a lactoseenvironment. After a certain lag, however,they begin to assimilatethis sugar at a high rate. Lactose-grown cells,on the other hand, can metabolize this sugar at almost the same rate as they metabolize glucose. A comparison of the enzymaticcontent of glucoseand lactose-grown cells showsthe presenceat high levelsof certain enzymes in lactose-grown cells, which are barely detectablein glucose-grown ones.These include: (a) fiwhich hydrolyzes lactoseto its constituent monosaccharides, galactosidase, and galactose, which mediates the entry glucose (b) galactosidepermease, of lactose into the cells,and (c) a sequence of enzymes not essentialfor the lactosemetabolism,such as thiogalactoside transacetylaseas well as enzymes in the to a glucose conversion derivative. participating galactose It is now established that the synthesis of these enzymes is regulated by a part of the bacterial genome, the lac operon (Beckwith and Zipser, 1970) which is shown in Figure A repressor, R, is synthesized by the gene i its it the I n active form combines with the operator,o, and along operon. inhibits the transcription of the structural genesz, y, a synthesizing, respec(M),and thiogalactoside /?-galactosidase (E), permease transacetylase An whose is facilitated by permease,liberates the inducer, I, (A). entry operator,and thus the synthesis of proteinscan begin.Allolactose,a lactose
15.1.
respectively,
'
i
1
\302\260
y
j
i i
I
1
y
\342\200\242!
8BR
Figure
|y
Q
i
j~ '
>
MA
I I
of
lac operon.
Mathematical 15.3.
of ji-galactosidase
389
isomerformed by a reaction converting the 1-4bond of lactoseinto a 1-6 bond, is the natural inducer of the lac operon in E. coli cellsgrown in a lactose-rich medium. However,in many experiments the enzymaticsynthesis is inducedby the so-called that cannot be decomposed gratuituous inducers such as TMG (methyl-/?-D-thiogalacto-pyranoside), by /?-galactosidase, TDG (/?-D-galacto-i-s-thio-/?-D-galactoside) or IPTG(isopropyl-/?-D-thiogalactoside). Thus far we have beenconcerned with the positive feedbackrelated to the action of the inducer.When lactose(or, more usually, a precursorof the lactosecatabolism)isusedinsteadof a gratuituous inducer, the control of the lac operon is subjectto two adverse processes. As before, the inducer dethe a thus represses operator, exerting positive feedbackaction.However, is a productof the galactose which, as we saw earlier in this section, glucose, is effective a of metabolism, highly repressor the lac operon and exerts, a feedback action. this action, known as catatherefore, negative Actually, bolite repression, takes placevia a lowering of intracellular concentration of cAMP,which normally stimulates protein synthesis (Pastan and Perlman, Sections15.3 we analyze the consequence of the induction and 15.4 Section the whereas in 15.5 we examine combined effect of the process, on the of the and feedbacks lac positive regulation negative operon.
In
1970; Zubay,
15.3. MATHEMATICAL
j3-GALACTOSIDASE
OF MODELFOR INDUCTION
The investigationsof Novickand Weiner A957,1959) and Cohnand Horibata in E. coli gives rise A959) have shown that the induction of /?-galactosidase to all-or-none Thus, in a genotypically homogeneous populaphenomena. one finds two distinct levels of induction, namely, noninduced and maximally induced.Theselevelscan be maintained during several generaMore precisely, below a certain critical concentration of the inducer the rate of synthesis of /?-galactosidase (or of permease)is almost zero, it its maximum value. Everything this attains whereas beyond value rapidly could an if the bacteria undergo abrupt transition between two happensas levelsof enzymesynthesis,in the vicinity of the critical concentration. The modelshown in Fig.15.2 incorporates (Babloyantzand Sanglier,1972) the most important experimental data on the inducer'saction and the subWe have simply added to the scheme in Fig.15.1 subsequent enzyme synthesis. the entry of external inducer, Ie,into the cell via the action of permease, and the subsequentinactivation of the active repressorR by the internal
population,
generations.
390
I
Regulatory
\302\260
R'
--
~>
Figure
15.2. Regulation
of
lacoperon circuit.
R'
.
<
*,'
A:,
>
+ O+ + + O+
\342\200\224
o
F,
M M F2
k3
k4 k5 t kb
M M E
kj
F3
A5.1)
the equilibrium between the active repressor R and the Step(i) describes inactive form R' synthesized by the regulatory gene i. R bounds to the operator O+ and blocksit by forming the complexRO = O~ in step (ii). In the presence of n, molecules of inducer Ij,part of the repressor forms Fi and, therefore, the operator is liberated in step (iii). Step (iv) describesthe the operatorO+ has beenliberated. transcription of the structural genesonce representsthe pool of amino acids. Entry of the inducer into the cell is represented by step (v), where it is understoodthat k5 $> k'$ to allow for an accumulation of I( into the cell. Steps(vi) and (vii) representthe dilution of the enzymeswithin the medium. It must be realized that in the model described several simpliby Eq.A5.1) have beenmade;the repressoris, in fact, an allostericprotein with four subunits. Thus, steps(i) and (iii) give only a global picture of its kinetics.
\\]
simplifications
15.4.AU-or-None Transitions
^gj
Moreover, the transport of inducer is a facilitated process involving many steps.Both aspectshave been analyzed in more detailed models(Sanglier, and no major qualitative change with respect to the results of the 1976), of enzyme simplified model A5.1)has been found. Finally, the process synthesis is also a complex phenomenon involving several steps. We are now in a positionto write the rate equationsdescribing the evoluof the various reactants in the scheme To this end, we consider that r\\, R', and F^ are in excess and hence may be treated as constants. we the of evolution influenceof diffusion in the equations Moreover, neglect on the basisof both the limited dimensions of bacterial cellsand the homoof the extracellular medium. The latter condition may be comproin the presence of attractants in the nutrient medium, resulting in a chemotactic (oriented) responseof the cells.
evolution
15.1.
homogeneity
compromised
^ = k,R'- k\\R
equations:
k'3Fx
k3RI^' +
- k2RO+ + k'2O~
^ dt
dE
~~
-k2RO++ k'2O
\342\200\224
Tt~ rjk^O*
k-i E
dt
~ k5IeM kslxM
A5.6)
the
cell:
O+ + O~ =
= const
A5.7)
15.4.ALL-OR-NONE TRANSITIONS
EquationsA5.2) to A5.6) have been solved numerically, both at the steady state and for the time-dependent behavior of the variables using Bairtow's method.Wherever possible,the values of the various constantshave been chosenin agreement with the experimental results(Sanglier, 1976; Sanglier and Nicolis,1976). This fixes the value n, 2 for the stoichiometric coin step (iii) of scheme15.1, as well as the values for R, Fj = [/?/], coefficient /,
\342\200\224
392
Regulatory
1.5
\342\200\224
y*
0.5
\342\200\224
-56
0.30
1.17
log
2.04
(le)
(A)
Figure 15.3. Theoretical curves of stationary-state solutions for E in 10. rate constants and k, 0.08, k\\ by using experimental
\342\200\224
/c4,k6, k-, have rj, k2, k'2, k3, k'3, k5, k'5. The remaining constants ku k\\, Ie, in the computer simulations and varied over a wide beenusedas parameters figures. range of values as seenin the captionsof the subsequent Let us first discussthe propertiesof the stationary states. Figure 15.3 the valuesof the enzymeconcentration as a function of the inducer represents concentration in the external medium. We see that the system displays The states on the multiple steady statesfor a limited range of values of /e. upper and lower branchesare stable,where as those of the intermediate This is in agreement with the experimentalresultson the branch are unstable. character of the induction phenomena. all-or-none Moreover, one finds both induced as well as noninduced bacteria for the same concentration of the external sugar. The numerical values compare also favorably with the one finds, for example,for E experimental results.Thus, from Figure 15.3 at the noninduced state, 2 x 10\023 fiM comparedto the experimental value of 3.3 x 1CT3 nM, whereas for E at the inducedstate the theoretical and experimental values are, respectively,2 /iM and 3.3 /iM.
A numerical This behavior is due specificallyto the action of the permease. simulation of the so-called gives a cryptic strain y~, which lackspermease, of the enzyme concentration on /e instead of multiple sigmoidal dependence
steady states. It is also of interest to simulate the kinetics of the induction processas measured by the temporal evolution of the enzyme concentration after fixing
393
100
Bacterial
50
X
100
mass (/ug
ml\"')
Figure
experimental
15.4. Kinetics
curves.
of /?-galactosidase induction
cells: experi-
to a certain inducer concentration initially. This behavior is easily accessible describes the concentration 15.4 experiment. Figure experimental enzyme relative to the increaseof bacterial mass (rather than in terms of time). In this way one can identify the differential velocity of synthesis:
dE/dt dB/dt
_ ~ dE
dB
A5.8)
where B
= bacterial mass.
for an intermediate Again, for bacteriacapableof synthesizing permease, concentration of the external inducer the responseof the population is in the sensethat one finds both inducedand noninduced \"inhomogeneous\" bacteria.This is reflected by an acceleration of the rate of synthesis before a constant value is attained, as shown in Fig.15.4. Thesequalitative featuresare accountedfor satisfactorilyin the numerical simulation of the time-dependent behavior of the theoretical model.Figure 15.5 the time variation of the enzyme concentration for a bacterial represents In addition to the general shape of the population synthesizing permease. the time to the duration of the lag phase critical curves, Tc corresponding is of the same orderof magnitude in the theoretical and experimental curves. Note,however,that by construction the model doesnot account for the lag itself. arising from the delay of the processof protein synthesis
394
Regulatory
7.2
7.15
7.1
7.05
Tc
20
t(min)
40
in normal-type
Figure
15.5. Theoretical
cells.
Finally, the model can easily be adapted to account for the peculiar behavior of the mutant X86 whoseinduction curve displaysa depression to a regime of noninduced bacteria) for intermediate values (corresponding of the inducer concentration in the external medium (Sanglier, 1976).
15.5. Catabolite
395
Figure
15.6. Regulation
addition to the seven steps already encountered one now in schemeA5.1), has the following processes: A5.9)
A5.10)
These reactionsdescribethe stimulating effect of G, the product of the This internal inducer's catabolism,in the formation of active repressor. activation stepis again taken to be cooperative,as in step(iii) of scheme A5.1) in order to account for the allostericcharacter of the repressor. Owing to the similarity between R and R' we subsequently take nG ^ nI = 2.Unthe rate constantsk8, k8, and kg are not known experimentally Unfortunately and are consideredas variable parameters in the computer simulations reportedin the sequel.* One may now write the rate equationsfor the variables R,0+,E,M, G, I{, As a matter of fact, we give under the conditionsdiscussed in Section15.3. here only the contracted form of these equationsobtained by invoking a for the allosteric quasisteady-state approximation similar to that discussed model of Chapter 14. More precisely, we take all genetic and enzymatic
variables to adjust instantaneously to the metabolite concentrations G and /j.The validity of this approximation rests on the usually small conof fast stepsin concentrations of macromolecules, as well as on the occurrence the decomposition of the intermediate enzymatic complexes.
G acts on the genome via the cAMP. Thus step A5.9) should pointed out in Section 15.2, representation of this complex phenomenon.
* As
be regarded as a global
396
Regulatory
Processes at Cellular
Level
Setting
k's
A5.11)
-2ksR'G22k'8(k8R'G2
(k8R'G2
where
2F:
D(G,1.)
(k9
A5.12)
+ t) + k'2(k3lf + n)} D(G,I,) = /c7{fc2(/c8/?'G2 A5.13) Theseequationshave been solved numerically on a CDC computer using The behavior in the vicinity and Nicolis,1976). Bairtow'smethod (Sanglier
Figure indicated
limit cycle is trajectory in phase plane spanned = 0.008 dotted lines. Numerical values: k, = 0.2 min~ min\021, R' = 10~2/(M, = 0.2min\" min\" \\xM 2, k's = min 2, k'3 = 60 min\" /iM ks = 0.03 \\ k'2 = 0.03min\021, r\\ki = 5 x 10 F, = 10\023 uM k2 = 4 x 105 min\" 1 min\021 \\iM~\\ k6 = k7 = k9 = 5 x 10\023 nM~\\ k5 = 0.6min\021 iiM'\\ k's = 0.006 3 x 10\026 min\" x 10\023 ixM. Cross 2.002 indicates position of (stable) steady state.
by
k\\
1
15.7. Periodic
8 6 by /, and G. Unstable
'.
15.5. Catabolite
8.24-
397
6.38
4.52-\\
2.66
1 \\1 1 1
366.
1
0.81-
t
1098.
stability\342\200\224has
732.
LU
1464.
as in
1830.
Fig.
G\302\260
15.7.
of the steady states\342\200\224including been studied via Merson's method. Experimental values have been used for the constants specified wide range of values of the different constantsand for k\\ > 0.1 a single stablesteady one finds for the system of equationsA5.12) and A5.13) state that behaves like a focus. Keepingall other constants fixed but taking < k\\ < 0.1, 0.000248 one finds a stable focus surrounded by two limit an unstable one,with a period around 110 min, and a cycles(Fig.15.7), stableone with a periodof 300 min. The time evolution of the concentrations is shown in Figs.15.8 and 15.9. We see that in the immediate vicinity of and inside the unstable cycle the system spires during several periods before being attracted to the stablesteady state.On the other hand, initial conditions close to but outside the unstable cycle are attracted to the outer (stable)
in
For a
Section15.4.
limit
particular:
one finds multiple steady states,and in partick\\ < 0.000248 (a) a stablefocus surroundedby an unstable limit cycle of a periodof about 110 min, (b) a saddlepoint, and (c) a stablenode. The most natural way to topologically accommodatethese types of behavior is shown in Figs.15.10 In addition to an unstable limit and
Finally, for
cycle.
15.11.
H 6.49
5.86-I 5.22
4.57
228. 457.
t
3.93
\\\\
685.
G\302\260
1
1
914.
1142.
as in
Fig.
= 16.2 pM.
15.7.
Figure Phase-space representation of evolution of concentrations /, and G using min~' y.M~l. Unstable limit cycle kinetic constants as in Fig. 15.7, 10~5 except k'8
15.10.
by
same
is in-
indicated
dotted lines.
398
15.5. Catabolite
399
SP
0.05
n
1-\302\253 1
0.05 15.10.
0.1
.-j
r*
1\342\200\224
0.15
0.2
0.25
15.11.
phase-space diagram
Owing to this cycle,the system now features a saddle-node separatrix loop. closed (but unstable) trajectory, for certain initial conditionsthe system evolves for quite a long time before being attracted by the stable node, as
*
indicated clearly in Fig.15.10. ~ The value k\\ ^ 0.00024792 min has beendetermined approximately as the threshold value where the saddlepoint and the node merge to give rise to a nonsimple singular point of the saddle-nodetype. This threshold separatesthe multiple limit-cycle from the multiple steady-state regime. For other sets of values of the parametersthe system features a single min surrounding asymptotically stablelimit cycle of a period of about 190 the paraman unstable focus.The various possibilities found on exploring in are Table ku k\\, k8, k9, Ie, Fy compiled Unstablelimit cyclescorresponding to subcritical branchesbifurcating from steady stateshave beenfound in chemicalreactor theory, as mentioned
parameters
15.1.
Table15.1
l
min\021
min
tiM
min
kg 1fiM
0.2
6x
10\023
0.03
91100
5000
0.2
6x
0.003
51100
500
0.02 0.002
6x 6x
10\024 10\025
0.0003 0.003
99100 99100 .
500 5000
N: node
F:
focus
S:
SP: saddlepoint
U:
75.5. Catabolite
401
in Section Their existence is due to the exponentialnonlinearity arising from the temperature dependence of the rate constants.The resultsof the sectionestablish the existence of unstable limit cyclesas well as of present
8.3.
interesting
of an oscillatory motion over a wide range of values. Of equal importance may be the overshoot behavior exhibited by the concentrations during the evolution depictedin Figure 15.10. Let us come now to the more specificproblemof the lac operonregulation. The periodicsynthesis of /?-galactosidase in E. coli has beenobservedby both Goodwin A969) in synchronous cultures and Knorre A968) in Mastersand Donachie A966)found that the periodic asynchronous cultures. of various in synthesis enzymes synchronous populationsof Bacillussubtilis arisesfrom variation in the repressorconcentration. Thus, it appearsthat the of DNA replication. oscillatoryenzymesynthesisis not a directconsequence Rather, it reflects the intrinsic regulatory mechanisms involved in the synto the generation synthesis. However, the periodof the oscillation is quite close time. This is in goodqualitative agreement with our model,which predictsa min on the (unique) min on the unstable limit cycle and of 190 periodof 110 stable limit cycle correspondingto the third set of parameter values in Table Another point of agreement is the increaseof the frequency of as the external lactoseconcentration increases. oscillations In spite of the endogenous character of the oscillations predictedby the that theseoscillations can be influencedby the cell model,it is quite possible cycle.This should be especiallyso in synchronous cultures, whereas in asynchronous ones damped oscillationsarising from destructive interof the individual control circuits shouldbe expected. Again, this is
ones in isothermal systemsundergoing mass-action kinetics,that to systems subject polynomial nonlinearities.* From a general standpoint, multiple limit-cyclebehavior has someinterimplications.Forinstance,a systemat a stable steady state surrounded two limit cycles is endowedby an intrinsic excitability,in the sensethat by from this state exceeding a certain threshold evolveto a stable perturbations instead of to the reference state. Excitability back periodicregime decaying and threshold phenomena are widely spreadin biology. It seems, therefore, to expectthat multiple limit cycles, reasonable which together with multiple steady states are the two alternatives for explaining this type of behavior, Next, multiple play an increasingly important role in biochemical kinetics. limit cycles provide an efficient regulatory mechanismfor varying the period
multiple
is, in
15.1.
interference
* Quite
Mathematics Department, A. Stanshine recently, in his doctoral dissertation, the existence of one unstable and one stable limit cycle in the Field-Noyes model for the Belousov-Zhabotinski reaction. See alsoBruns, Bailey and Luss A973).
J.
1975)points out
(M.I.T.,
402
in
Regulatory
agreement with simulations of a more detailedscheme taking into account 1976). explicitly growth and cell division (Sanglier,
oscillator.
Physarum polycephalum
characterized
of a cytoplasmic mass containing up to 108 nuclei. As the cytoplasmic the nucleiundergo division in virtually complete content increases, synchrony hr. every 10-12 Let us now review the most important data suggesting the existence of a continuous biochemical oscillator(Kauffman and Wille, 1975; Kauffman,
by the fact
that
growth
belongsto the group of mycetozoa and is characoccurs without cellular division. It consists
1974b).
Fusion Experiments
Plasmodiaat two different pointsin the life cycle (we shall say that they are at two different \"phases\") are fused.The nuclei and the cytoplasm mix well 2-6 the of the resulting pair is studied.The following and mitosis hr, during resultsare found:
(i)
Synchronization.Let the initial phases (j)A, (j)B of two fused plasmodia far from mitosis and (j>B (j>A <pA < (j)B.Then, if (j)B is sufficiently is sufficiently small, the resulting pair undergoesmitosis at a phase interintermediate between (j)A and (j)B and such that the mitosis of A is accelerated, whereas that of B is sloweddown.
be such that
\342\200\224
Division
403
This result suggests the existence of one or several cytoplasmicmitogenic substancescapable of initiating nuclear division when a critical value is these substancesare consumed,and their conexceeded. Subsequently, concentration drops and reaccumulates during the next cycle.Moreover, as synchronization is a ubiquitous property of nonlinear oscillators (see that the this type of experiment strongly suggests Chapter7 and Section8.7), mitogens shouldthemselvesundergo a periodicnonlinear oscillation. Mitotic block.If (j)B is close to mitosis and <pA is between \\\\ and 6 hr, there is no acceleration in the mitosis of A, but one observes, instead, a delay of 2-7hr. (iii) Abortive prophase.A almost arrives up to mitosis but then \"misses\" it and presentsan aberrant form of nucleolar reconstruction leading to an interphase morphology. Let the phases of A, B be plotted along the cir(iv) Arc discontinuity. circumference of a circle For reference, we consider a third (Fig. 15.12). plasmodium Cwhosephase(j)cis on the other sideof A on the circumference. We assumethat, oncefused, two plasmodiamix well and fairly rapidly. Let (j)AB be the phaseof the mixed pair after mixing. We expectthat, as <pB moves away from (j)A to (j)Bl, (j)B2,..., (j)AB moves as indicated in Figure 15.12. Beyond a phase (j)B* of B, however, synchronization leads the fused pair to a phase(j)AB\\ying on the samearc as C.Thus, at B* the phaseof the fused pair undergoesa discontinuity. Such a discontinuity is indeedfound experimentally. The ingenious idea of Kauffman has been that, by studying the behavior one can obtain direct information on the nature of under fusion experiments,
(ii)
\342\200\224
cj>B
B2
15.12.
404
Regulatory
the mitotic oscillatoritself. In fact, this ideashouldappearquite natural to the readerfamiliar with the analysis of Chapter7 of this monograph. Indeed, let us begin with the Ansatz, suggested by the synchronization experiments, that mitosisis directedby a nonlinear oscillator which, by its very stability, must undergo a limit cycle type of motion. In a fusion experiment, two such
cycle.
Heat-Shock Experiments
second group of experimentsone acts directly on the individual plasmodia by applying short (of the orderof 30 min) heat shocksat a higherthan-ambient temperature. One finds that the plasmodiamay missthe first, or even the secondmitosis, which would happen under normal conditions. however, they again undergo nuclear division in complete Subsequently, synchrony. Everything happens as if the \"chemical clock\"commanding
In a
mitosis can still measure the time correctly, but that under the effectof the perturbation generated by the shock it needs a certain interval to adjust before resetting its phase.
15.7.QUANTITATIVE
We want now to quantitative
MODEL
in Section15.6 on the basisof a interpret the data compiled stability requirement suggestsa limit cycle-type oscillator,and the simplestsuch oscillatorcan be constructedby coupling two biochemical variables. Let X be the bifurcation parameter.By varying X from Xc, where a small-amplitude limit cycle first bifurcates from the thermodynamic branch (cf. Section7.12) up to the limit X -> oo (cf. Section first subsection), one can account for various forms of oscillatory 8.10, to discontinuous. behavior, from sinusoidal By comparing with experiment one can have indications both on the reasonableness of a two-variablemodel and on how far within the relaxation oscillation regime one must look for the functioning of the limit cycle. Rather than remain general, let us consider a specificexample(Tyson and Kauffman, 1975). Let X representa stable protein and Y an active form of this protein. of enzymes,and The conversionof X to Y can alsobe catalyzed by a sequence Y2. Once Yexceeds let the overall rate of this conversion be proportionalto it a critical value Yc bounds with the chromosomes and initiates mitosis. Y Thus is not really consumedbut merely leaves the cytoplasmic medium.
The model.
15.7.Quantitative
We
Model this
405
obtain in
X X
\342\226\272
X Y Y
B
\342\226\272
cY2
>
Y in
a single plas-
= d4~ dt
dt
- BX -
XY2
Y
^- = BX + XY2 -
A5.14)
with Eq. G.13) in the absence of diffusion, we realize that the Comparing model has some striking similarities with the trimolecular model. In fact, the differenceis that the rolesof X and Y are inverted in the autocatalytic step and that the sink term for X is replacedhere by a sink term for Y. Except for this difference,the analysis of Eq.A5.14) along the same lines proceeds 7.3and 7.4. Onefinds that there is a singlesteady-state solution: as in Sections
*\302\260
irr^' +
D
A
Y\302\260
A5-15)
satisfied:
2A2
B
A limit
> B + A2
+ 1
A5.16)
from the steady state that becomes more and more cyclethen emerges of the relaxation type as B decreases to zero. on the basis of this model,we In order to discussfusion experiments assumethat the cytoplasmicand nucleartransfer within the pair is equivalent to a diffusion between two identical cells1 and 2, all of whose walls with the of the one separating them are impermeableto the flux of mitogens. exception The mitogen flux, Jx acrossa unit area of this separating surface is given by
406
Regulatory
at Cellular Processes
Level
where Ar is the
find from multiply
with a similar expression for Y. In order to length of the cell, the total rate of change of X within, say, cell 1,we Eq. A5.17)
obtain:
by
S and divide by
the volume
of the
cell. We
= S1(X2-X1) =1TtAX2-X1) w v
the evolution of X and
dt
Y in
A5.18)
cells:
XXY\\
-=
dX
=A
- BXl - BX2-
+ 6^X2 + d^Xi
Xt)
X2Y\\
-X2)
'^=
= BX2+
y2)
A5.19)
A two-celldiscrete version of the trimolecular model similar to Eq.A5.19) was analyzed by Prigogine and Lefever A968) well before the bifurcation theoretical analysis adoptedin this monograph was developed and has given rise, in fact, to the first unambiguous exampleof symmetry breakingin chemical kinetics. One may now study the behavior of the two diffusion-coupledoscillators describedby Eq. A5.19) and comparewith the resultsof the fusion experiAs it turns out, Eqs.A5.19) have many types of solution (Tyson and Kauffman, 1975). Here, however, we are interested only in the following
experiments.
two possibilities. are initially nearly identical, First, the phasesof two individual oscillators and then diffusion is switched on. One then finds by numerical simulation of Eq. A5.19) that the homogeneous limit cycle, which is still a solution of these equationsas long as inequality A5.16) is satisfied, becomes unstable. It splitsinto two local limit cycles prevailing in the two cells(seeFig. limit cycle is small. Thus However, their differencewith the homogeneous their amplitudes exceed both the critical value Yc and as a result mitosis
15.13).
takesplacein synchrony. the initial phase difference is appreciable.After switching on Second, diffusion one finds an inhomogeneous limit cycle oscillation leading to one limit limit cyclewith amplitude almost identicalto that of the homogeneous cycle, whereasthe amplitude of the second cycle is strongly reduced(see
15.7.Quantitative
Y
Model
407
IHLC
Figure Inhomogeneous limit-cycle solution (IHLC) arising initial phase difference between individual oscillators is small.
15.13.
in model
A5.19)when
this secondamplitude, there is Yc is higher than asymmetric inhibition of mitosisin one copy.This can be either a permanent or transient phenomenon.One copy, say A, may (such as in Fig. 15.14) miss the first mitosis but eventually synchronize with the secondcopy B an
We
appreciable delay. concludethat, despiteits simplicity, this model providesa qualitative explanation of most of the fusion experiments, including the phenomenon of mitotic block. the values of the parameters<5i, <52, numerical By adjusting B one can also a obtain A, semiquantitative agreement. As it turns out, the
with
Figure
15.14. Strongly
is appreciable.
408
Regulatory
most favorable range of the chemical parametersis that corresponding to a moderate relaxation oscillator, for example, A = \\, B = ^o, whereas for = 0.15, and for the diffusion coefficientsa good choiceis 52 = 0.10, qualitative failure of the moderelatesto the arc discontinuity. Experion of is given by a show that the dependence (seeFig.15.12) a region of negative slope,contrary to the model that gives curve comprising It has been argued (Kauffman, 1974b; solely curves with a positive slope. that this property of the arc discontinuity is Kauffman and Wille, 1975) related to the topology of the isochrones,that is,of thosecurveson the phase at equal time intervals. described planethat separateportionsof trajectories The notion of isochroneis also useful in interpreting the heat-shock
A
Experiments
</>B\302\253
threshold,Yc =
1.7.
<5X
<j>A
Chapter 16
CellularDifferentiationand PatternFormation
16.1. INTRODUCTORY REMARKS
this Chapter we are interested in large-scale phenomena involving of interacting cells. assemblies Our aim is to see how cellular communicacan generate regular spatial patterns at the supercellular level and
In
communications
at the same time control the timing and localizationof the various processes involved in the formation, as well as in the maintenance of these patterns. In biology oneof the most striking illustrations of this phenomenon occurs
of a number of differentiated cellsthat can be characterized by their function and form. The molecular basis of differentiation\342\200\224that is, the control of the transcription and translation of information\342\200\224is not consideredhere in detail (see Britten and genetic Davidson and Britten, 1973). 1969; Rather, wefocuson the followDavidson, or so A n such as a advanced vertebrate, contains 100 organism, problem. discretecellular types.Different organismsmanifest a variety of shapesand forms that is quantitatively certainly much greater than the differences in the constituting cells. The understanding of this variety, specifically,of the cellular types, is the problem of pattern of different spatial organization or formation, morphogenesis (Bonner, 1974; Wolpert, 1975). The complexityof the problemcan be appreciated if one realizes that even the most advanced organism issuesfrom a single cell, namely, the zygote. a therefore, Ontogenesisis, spatiotemporalprocess implying subcellular mechanisms that are finally reflected by morphological modifications at the level. Obviously, this passagerequiresa sharp regulation of a supercellular of such as: (a) cellular differentiation,growth, and mitosis, variety processes (b) cellular movements (chemotaxis, cell sorting), (c) formation of cellular level (e.g., junctions,and (d) the collective movements at the supercellular gastrulation).
following
409
410
A
Cellular Differentiation
detailed descriptionaccounting in a quantitative way for both the molecular and globalaspectsof the problemis certainly premature at the presenttime. It is,therefore, interesting to study morphogenesis by means of simplified but nevertheless representative models based on those exexperimentally establishedelements that continuously recur in embryonic development and are largely independent of the details of the subcellular the molecular and the phenomena.This analysis enablesus to correlate and to sort out the essential features macroscopic aspectsof morphogenesis determining pattern formation. The viewpoint we adopt is motivated by the considerations developed throughout this monograph.In other words, we consider that different macroscopic patterns correspondto different stable solutions of a set of nonlinear differential equations describingthe evolution of the chemical substancesinvolved. These equations are developedin Sections 16.4 to 16.6 and appliedto concrete Sections biologicalsituations in Section16.7. 16.2 are devoted to an account of the mechanisms determining and 16.3 cellular interactions during development.
411
Figure
16.1. \"French
flag problem\"
illustrating
positional differentiation.
cell positionis specified. This resultsin a spatial differentiation and is of, precedes, independent molecular differentiation at the subcellularlevel.The latter takesplacein a secondstage,during which positional information is interpreted by the individual cells. Wolpert postulatesthe this of mechanism. universality A very instructive illustration of Wolpert's ideasis provided by the so-called field. The positionof \"French flag problem.\" Considera one-dimensional cells can be defined with respectto one of the extremal points (unipolar system) or with respectto both (bipolarsystem).Supposethat the resulting positional information is such that in the first third of the field a blue pigment and in the final one is produced, in the secondone no pigment is produced, a red pigment is produced.This gives rise to a \" French flag,\" as shown on further that positional information is relatedto the gradient Fig. Suppose and a sink. of a substance M, the morphogeru which diffusesbetweena source law and that the morphogen is not by Fick's Assuming diffusion is described interacting with the cells,the evolution of the concentration M of M is given
within that which
16.1.
by: dM
'llr2' is:
d2M
A6.1)
M = M,-M2 r + M2
A6.2)
and at the sink and / where Mx, M2 are the concentrations of M at the source the length of the system,respectively. An important property related to the linear profile of M given by Eq.A6.2) is size in variance; supposethe length of the system is varied from / to /'. We say that there is size invariance, if the concentration of morphogen at
412
Cellular Differentiation
and Pattern
Formation
point r of the initial system is equal to the concentration at point modified system,where r and r' are connected by
r' of the
In a linear gradient this property is trivially satisfiedprovided the boundary in the modified and sink) are reestablished conditions (valuesof M at the source
field.
A
property known in embryology as morphallaxis.A different kind of pattern regeneration is known as epimorphosis;the positional information within the new field /' remains the same as in the initial one,and restoration of the pattern is achieved by growth (seeFig.16.2).
jw
Ft
(A)
Epimorphosis
(B)
Regeneration of French flag pattern. Intact system is as in {A) and comprises three Figure equal regions of blue (B),white (W), and red (R).Positional information is represented by linear gradient with boundary values M, and M2. If flag is cut at level X-X corresponding to /cth is removed, then morphallactic regeneration occurs as in (B).Value of cell and left-hand piece positional information at cut now becomes M, and new gradient is established (dashed line). In epimorphic regeneration, (C),positional information at cut remains same and restoration of pattern is achieved by growth.
16.2.
in Positional Information
413
of a sourceand a sink postulatedso According to Wolpert, the existence are justified in the sensethat an organizer has been shown to exist in a great variety of fields,which inducesdifferentiation in the neighboring cells. of hypostome in Hydra, of micromeres in sea urchin, or of This is the case for a survey). One of Hensen's nodein chick(seeRobertsonand Cohen,1972 the principal goals of this chapter (Section is to analyze the and 16.5) 16.4 origin of positional information, that is, the establishment and maintenance of the boundary conditionsgiving rise to a sourceand a sink within the morphogenetic field.
IN
INFORMATION POSITIONAL
The diffusion of a morphogen betweena source in the and a sink considered is only one of the numerous illustration of Wolpert's ideas (Section16.2), candidates potentially responsible for the establishment of positional information and for the subsequent pattern formation. As shown by Crick A970), the time necessaryfor a morphogen to diffuse through a field of typical dimensionsis compatiblewith experimental data. The diffusion ~6 cm2 s~1, x 10 coefficientappearsto be of the order of 0.8 which is about the value of the diffusion coefficient in solution of low-molecular-weight substances such as cyclic AMP. in Section16.4, most of the ideasof this chapter are Forreasonsexplained for positional illustrated by assuming that diffusion is, indeed,responsible in this sectionsome we information. Before this, however, compilebriefly influence other processes likely to pattern formation.
Active
A
Transport
morphogen can propagate along a field by either facilitated or active transport.This can be the result of an asymmetry in the cellular properties As a result, a gradient can build up giving rise to polarizedphenomena. along the field that is oppositeto the direction of the morphogen's transport no source and sink 1966; Although (Lawrence, Wilby and Webster, 1970). need to be considered explicitly,the cellson at least one of the boundaries play a privileged role.An alternative model involving nonpolarized cells and assuming the existenceof a sourceand a sink has been elaborated
by
a boundary-value
noticed by now that the assumption ofa source and a sink amounts problem whereby fixed concentrations are imposed on the boundaries.
Cellular Differentiation
and Pattern
Formation
Cell communication can be establishedwithout having necessarilythe a one-dimensional ofa substance along the field.Consider system propagation of N polarizedcellsand supposethat the state of differentiation of each cell is determined by the concentration ofa morphogen M.It may happen that the levelM of M in the ith cell is determined by cell i 1 via a seriesof activation and/or inhibition mechanisms involving membrane-bound enzymes and metabolites (MacMahon,1973; Babloyantz, 1977; Garay, 1977). Typically, this gives riseto a steady-state profile of M described by the following equa\342\200\224
equation:
Under certain conditions this expressioncan give rise to differentiated patterns.The latter dependsolely on the number of cellsand hence cannot displaysize invariance. The situation is different in the case of bipolarfields, where the state of a cell is determined by two morphogens and is influenced by the state of both Patterns displaying size invariance can be generated neighboring cells. There existsalsoa possibility ofbifurcationsleadingto multiple (Garay, 1977). one of which a uniform to distribution of the morsolutions, corresponds as as well of wavelikebehavior (Babloyantz, 1977). morphogens,
Role of Oscillations
Goodwinand CohenA969) suggested that positional information can arise from the formation of a phase gradient. They assumethat each cell in the field is potentially an autonomous oscillatorof period T. During this period the cell evolves through three states: (a) the (brief) emissionof a signal, say at times 0 + , T + , 2T + , (b) a long refractory period, TR, during which the cell is insensitive,and (c) a time interval T TR, during which the cell is sensitive,although it cannot emit. When a cellemits a signal S reaching a neighboring cell, the latter in turn emits, after a delay of Ats, provided it is sensitive.This gives rise to an organizing wave.Positional information can arise if there existsa gradient of frequencies of the autonomous oscillators along the field. Under certain conditionsthe oscillatorhaving the highest frequency can entrain the others, and this constitutes an organizer in the biologicalsense of the term. Note that this implies an initially polarized
\342\200\224
field.
Goodwinand Cohen A969) postulate that after signal S in released,a secondpulseP related to S is produced. The latter propagatesthrough the
16.4. Dissipative
of Polarity
415
a phasegradient giving riseto a more accurate positional field and establishes information. The incidenceof these phenomena in pattern formation is not wellestablished. Nevertheless,the aggregation of cellular slime moldsdiscussed in Chapter 14 provides a striking illustration showing the ubiquitous role of oscillationsin initiating the morphogenetic signal, in amplifying and relaying it along the field, and in regulating the size and other propertiesof
the resulting multicellular body. On the cellular level, the role of concentration waves propagating along membranes during the early stages of development has been emphasized
by
GoodwinA975), Kauffman A974a), and Blumenthal A975). Electrical in Acetabularia(Novak and Bentrup, 1972; signalshave alsobeendiscovered
and in Fucus (Nuccitelli and Jaffe, 1974). Novak, 1975)
CellSorting
The formation of a morphogeneticpattern can alsoarisefrom the occupation of specific positionsby differentiated cellsas a result of a \"cell sorting.\" This mechanismsupposes that cellscan respondto specificsignals by moving within the field. This movement can be oriented toward a autonomously specific attractant emitted by another cell of the same species(chemotaxis; seealsoSection14.7), or it can be the result of characteristicadhesiveproperBoth such phenomena appearto be presentin different stagesof developof the slime mold Dictyostelium discoideum(Keller and Segel, 1970;
properties. development
Garrod, 1974).
system of coupled cells capable of undergoing differentiation can also Firstly, a certain asymmetry displaypattern formation for various reasons. the the can be built into individual cells at outset (seefirst and third subin can be subjectto subsections Section16.3). the cellsat boundaries Secondly, rise to a source and a is, to a polarity specificconditionsgiving A final the Section field (seesecondsubsection in 16.3). possibilityis along and tissue of that a homogeneous identical unpolarized cellsbecomesinThis can only happen if a symmetry-breaking homogeneous spontaneously. is As mentioned involved. instability repeatedly throughout this monograph, diffusion is one of the very general mechanisms capableof inducing such an instability. More recently,the role of cellular contactsin symmetry-breaking Nevertheinstabilitieshas beenrecognized Babloyantz, 1977). (Garay, 1977; from now on we choosethe mechanism of cellular communication
sink\342\200\224that
Nevertheless,
416
through
first diffusion
Cellular Differentiation
and Pattern
Formation
to illustrate the ideas underlying pattern formation. We with the onsetof polarity in a previouslyunpolarized this section, field and with the stability of the resulting gradient. The role of this primary pattern in inducing a secondarypattern of differentiatedcellsis examined in
deal,in
Section16.6.
The fact
dissipative structure, We want, moreover, to ensureits stability with respect to small perturbations; otherwise,the pattern would not have a physiological 6.6 and of Chapter7 we then conclude meaning. From the analysis of Section that:
(i) Nonlinear interactions must be involved.
inducedby
via a supercriticalbifurcation from the (ii) It is sufficient that the pattern arises uniform steady state on the thermodynamic branch involving an eigenvalue
problemof odd multiplicity. (iii) The rate equationsmust admit positive and boundedsolutions. The first of these ideaswas introduced in the context of morphogenesis by Turing A952). The particular models he used to illustrate his ideas were on the groundsthat Cooke, 1975) recentlychallenged(Bardand Lauder,1974; A could not bifurcation they analysis carriedout yield regulative patterns. of on one models recently Turing's (Erneux, Hiernaux, and Nicolis 1977) revealed that this model displayspeculiarbehavior becauseproperties(ii) and (iii) are not satisfied.Aside from this, the ideasof Turing and the notion of dissipative structure remain perfectly compatiblewith the phenomenon of pattern formation in morphogenesis. Gierer and Meinhardt A972, 1974) have achieved further clarification of
the mechanismof pattern formation
by pointing out the role of the coupling betweena short-ranged activation phenomena and a long-ranged inhibition. of Hydra the head couldbe formed when the activaForinstance, in the case concentration exceeds a critical value. Onceformed, the head could exert an inhibition extending over a long distance,not permitting further formation of heads.Theseideas instigated them to suggest a number of is taken up and analyzed in models for pattern formation. Oneofthese models
activator
Section16.5.
16.5. A
We want
QUANTITATIVE
MODEL
to understand how two coupledmorphogens, say X and Y, can give rise to a spontaneousgradient along a field. Onceestablished, this gradient
A Quantitative 16.5.
Model
417
can provide the positional information necessary for the formation of patterns of differentiatedcells. The rate equations have the following general form
dt
= MX, Y) + Dt V2
Y)
-^ = f2(X,
dX
dY
+ D2V2Y
A6.4)
As we are interested in the spontaneous onset of the gradient, the boundary conditionsto be consideredare zero fluxes at the extremities of the field. Fora one-dimensional array of cellsthis gives:
dY
=0
A6.5)
where / is the length of the field. Let (Xo, y0) be the uniform steady-state solution of Eq.A6.4).We study the stability toward inhomogeneous perturbations (x, y) which to a first approximation satisfy the linearized equations(seeSection7.4):
dy dt
4h dX
1
A6.6)
cosmnr
= 0,
1,...
A6.7)
characteristic
D2,and the chemical parameters involved infi and/2 through the characterequation (seeSection7.4 for a similar analysis of the trimolecular
polar pattern,
model):
A
U - \"' T
A
dX
m2n2
A
dY
A
dY
=0
D
m2n2
I2
A6.8)
The latter must be regarded Let us evaluate Eq. A6.8)on a specificexample. rather than as a limitation as a minimal model usedfor illustrative purposes, on the validity of the general arguments advanced in this section.
418
X\342\200\224
Cellular Differentiation
activator\342\200\224is
the that morphogen Suppose producedat a constant rate as well as via an autocatalytic step involving a third molecule P. X Moreover, catalyzes the formation of Y from a precursorC at a rate k2CX2.
k^A
P transforms Y to X. Finally, either X and Y have a finite life time and yield In waste products F and G, or they bound with the genome of the cells. we assumethat they leave the reaction spacevia unimolecular either case, as follows (Babloyantz and Hiernaux, steps.Thesestepscan be represented
1975):
k2x2 ^
C
X Y Y
F
k* ,
G
X
+P ' +P
kh
k7
B+
P + 2X
A6.9)
straightforwardly
Using a quasisteady-state assumption for P one can derive straightthe form of the rate functions/! and f2 appearingin Eq.A6.4):
f f2
k
A
4. h
2 = k2CX2
k4Y
A6.10)
is:
k2k3k5C + ikik-jktAB +
k\\k5
k\\k2A2C
k4k26k2B2 k2k\\k\\C
A6.11)
\342\200\224,-
kAD,
A Quantitative 16.5.
Model
419
a. = k6k7B
with
A6.12b)
The study of A in terms of the length / for various m values permits one to determine the points of marginal stability for which relation A = 0 is satisfied,(seeFig.16.3). A vanishes at /},indicating a possibility Form = 1, for onset of instability. If the total length of the system is lessthan /} the homogeneous state of the for source and sink forsystem remains stable,and there is no possibility formation. If the length is increasedbeyond /},there is possibility for sponspontaneous pattern formation due to the instability of the homogeneous state of the system.Moreover, we see from Fig.16.3 to the that, up length l\\, one may only have a structure with one high and one low concentration point. If, on the other hand, we take a systemof length between l\\ and and lessthan arise,due to the overlapping of various m values for a /3, two possibilities of the structures with one high-concentrationregion and given length system; structures with two high-concentration regionsmay appear,Thus, the form
\\\\
0.7
\342\200\224
II
E co
\342\200\224
\\iE
V In
\342\200\224
4i
\342\200\224
0.1
0
'k^r
3^^\342\200\224
\342\200\224^.\342\200\224^\342\200\224^-^
\\-~-\342\200\224'
6
\342\200\224
0.1
\\
y\\
on A [seeEqs. A6.8) and A6.12a)] Figure 16.3. Dependence of characteristic determinant values of wave number m, showing wavelengths that can be fitted within length / for different given length.
420
Cellular Differentiation
and Pattern
Formation
49
\342\200\224
15
Cell position
16.4. Concentration profile of morphogen Y in model A6.9) for length / = 0.9and for = 5.ki = 0.1, = = 0.7,k5 = 1, kb = 1, k7 = 2, D, = 0.002, 0.0005. M B=\\,C=\\.k2 kA
Figure
of the final pattern is a function of the magnitude of the initial perturbations and their location in the system. As / increases the systemmay become unstable for higher valuesof m. Thus, a high number of wavelengthscan be fitted into the systemand more complex can be verified by computer simulapatterns may appear.Theseconjectures Considera homogeneous with system parameter values corresponding to an unstable steady state leading to spatial structure formation. At t = 0 a perturbation is introduced into the system. If the length / of the system is between l\\ and l\\, one obtains a structure with one peak as seenin Fig.16.4. This structure displays a gradient appearing spontaneouslyalong the system. The form of the gradient is unique, but there are two possiblebifurcating solutions that are symmetrical, as discussedin Sections 7.5-7.7. From the biological point of view, this multiplicity is immaterial; the notion of meaningful only after the first gradient has beenestabsymmetry becomes from an initially situation. Similar results are obtained homogeneous in two dimensions, in this although the patterns are much more spectacular trimolecular model discussedin Section8.5). In addition to the case, (e.g., numerical simulations, a bifurcation theoretical analysis of scheme A6.9)has beencarriedout along the lines of Sections 7.5-7.7. (Hiernaux, 1976). Using the length / as bifurcation parameter, the possibility of supercritical bifurcaat a simple eigenvalueleading to two spatially symmetric solutionshas This guarantees the stability of the patterns, in agreement beenestablished. with the results of the numerical calculations. The stability of the morphogeneticpatterns derived in this sectionimplies <l\\. ^.regulationwithin the field, at least for lengths within the interval/ In particular, we see that after removal of a part of the field, the remaining a stablepolar pattern as long as / remains larger than /}.This reestablishes
simulations.
established
bifurcation
\\
<l
421
property is less stringent than the size invariance invoked in Section16.2. Nevertheless,it can account for the maintenance of a certain characteristic structure, as observedin experiments involving Hydra regeneration. In the latter, one could relate the regeneration of the head to the attainment of a certain critical threshold, rather than to a very narrow interval of concenvalues as postulated by other investigators (Hicklin,Hornbruch, Wolpert, and Clarke,1973).
concentration
not specifiedhere, to a substanceS that can diffuse along the field betweena the primary source and a sink. The latter are specifiedin a unique fashion once pattern of the morphogenshas been establishedand may, therefore, be consideredto be \"imposed\" at the outset.This assumption can be relaxed but is maintained here for simplicity. (Babloyantz and Hiernaux, 1975) In each cell, it isassumed that Sacts at the genetic level*and regulates the synthesis of a protein E. We require that the E S relationship be sigmoidal In particular, or S-shaped, as in the modelsanalyzed in Sections 8.4and it is assumed that there exists a threshold value Scof Sfor which a considerable enhancement occursin the synthesis of E. This kind of \"all-or-none\"be\" in the analysis of the French flag problem'' behavior, which was tacitly assumed
cells. We want to analyze how this information is interpreted by the individual cellsand inducesa secondary pattern of differentiation. We assumethat one (or several) morphogen(s) give rise in a certain way,
15.4.
combination
of Section16.2, activation, or combinamay be achieved through repression, of these mechanisms known to operatein bacteria and probablyalso in and Monod,1961). Onecan construct quantitative models eukaryotes (Jacob behavior with elements proposed by Britten and exhibiting all-or-none Davidson A969) and Georgiev A969) for genetic regulation in higher orHowever, this would introduce unnecessary organisms (Hiernaux, 1976). and a great number of variables. Instead,we considera model, assumptions
while our model indicates how the morphogens may specify how they are produced genetically.
not does
* Thus,
be coupled
to the genome, it
does
422
Cellular Differentiation
and Pattern
Formation
based on the bacterial induction mechanisms of the Jacob-Monod type Babloyantz and Sanglier, (Babloyantz and Nicolis,1972; 1972).
R R
R
'
R k2
+ + +
o+ 21 ' o+
*3
k.
ks k6 k1
t
O\"
Ft E
+O
S+ E
E
'
ks k9
1+ E F
* 10
A6.13)
A repressor R is synthesizedfrom a precursor R' and can repressthe active the synthesisof the enzyme E. The latter operatorO+ into O\",thus blocking catalyzes a reaction whosesubstrateis the morphogen S and whose productI acts as an inducer by inactivating the repressorR. fcu are the rate the precursors constants,F is the decay productof the enzymeE, represents of enzyme E and F!represents the repressor-inducer complex. Forthe entire morphogenetic field of N cells,the variables associated with the model are Of,Of,Rh S,, and /, (for i = 1, N). As before, we take the variations of /?,-,Of,Of at the quasisteady state.Then, the time evolution of /j,and S, is given by (Babloyantz and Hiernaux, 1975):
/ct,...,
r\\
\302\243,,
= ~T~ fit
\342\200\224
-.\342\200\224]\342\200\224^r,
u u R -4- u u
]\342\200\224,\342\200\224r
-L- U
)\342\200\224;
-\\-
w u
;\342\200\224;\342\200\224ff
Kio-t; + Ku^
^= ^=
at
_fc
I^Rll+J^FJl+ k
+ kgEJi+
Ar
+k ES _ k EI
i
-/c8\302\243,S,.
2,...,N
A6.14)
We have assumed that only the morphogen S diffusesthroughout the field. Diffusion has beenapproximated law, which has beenwritten in a by Fick's D is the finite-differenceapproximation suitable for numerical calculations. of a cell. (constant) diffusion coefficientof S and Ar is the dimension
423
15
Cell position Figure
16.5. Gradient
of diffusion
of morphogen
S in
source-sink
field
of
30cells.
We assign to the boundary cells1 and N valuesof E,I,and Scorresponding to the pointson the lower and on the upperbranch of the E-S characteristic curve. This establishes a source field. and a sink in the morphogenetic The steady-state solutionsof the Eqs.A6.14)give the stationary spatial distribution of E, I,and S.Theseequationshave been solved numerically by the Runge-Kutta method on a CDCcomputer.Figure 16.5 presentsthe The S source and sink. of the between stationary gradient morphogen position of the sourcedetermines the polarity of the field. Figure 16.6 describesthe to the above mentioned spatial distribution of the enzyme E corresponding in the a variation It is seen that smooth gradient of morphogen gradient. E. This property is due curve for a discontinuous may generate response to the nonlinear character of the E-Srelationship and the existenceof a threshold concentration Sc for the synthesis of E. In a morphogenetic of diffusion, the concentration of S is not due to the process field of N cells, The cellsexposedto a concentration S > Scsynthesize identical in all cells. appreciablequantities of E and are differentiated, while those with S < Sc remain undifferentiated.Thus, the field is separatedinto two distinct regions of high and low concentrations of E.
15
Cell position Figure
16.6. Pattern
of celldifferentiation
16.5.
424
Cellular Differentiation
and Pattern
Formation
30
Cell position
Figure
16.7. Pattern
of cell differentiation
in source field of
60cells.
and at the sink and by the value of the concentration of S at the source of D. the diffusion coefficient by magnitude If the concentration of the substances suddenly changesin one or several the later returns to its original form. Thus, the patterns cells, perturbedpattern
determined
Fora given dimension of the field, the proportionof induced cellsis deter-
of Figs.16.5 and 16.6 are stable.Earlier analyses of mechanismssomewhat similar to Eq. A6.14)by EdelsteinA972) had producedunstable solutions with morphogenesis. and hence couldnot account for the patterns associated If one imposes of the morphothe value of the source at both boundaries This corone the of obtains differentiated genetic field, patterns Fig.16.7. 16.6 a nd to the of the of pattern Fig. displaysdiffercorresponds duplication of the field.Forgiven valuesof Sand D, cellsnear the two boundaries this property holds only if the dimension of the field is not smaller than a certain criticalvalue.Theseresultscan easilybeextended to two-dimensional and f ields Hiernaux, (Babloyantz 1975). morphogenetic In conclusion, the main interest of the modelspresentedthus far in this chapter liesin their relative simplicity and in the fact that the resultsobtained are largely independent of the detailsof the regulatory processes at the subcellular level.We may say,therefore, that we have a few \"generalprinciples\" is to illustrate the underlying pattern formation. The purposeof Section16.7 use of these principlesin concrete situations involving the development of
differentiated
simpleorganisms.
16.7. APPLICATIONS
We do not attempt to presenta quantitative analysis, which at this time is in view of the large number ofvariables involved in any biologicmeaningless
biologically
predictionthat
realistic situation. Rather, we focus on the general but quite concrete in the course of development a critical size must be exceeded beforepositional information\342\200\224and hencepattern formation\342\200\224can take place.
16.7.Applications
We
425
refer to two extremelydifferent organisms: (a)Hydra, which in the adult a is stage highly differentiatedanimal involving 17different cellular types and (b) Acetabularia, which is a unicellular organism capable of undergoing morphological changesgiving rise to the appearanceof a cap in the apical In both cases, one can becauseof the morphology of the organisms, region. of a one-dimensional speak morphogenetic field. Considerfirst the case of Hydra.Schallerand Gierer A973) have demonthe existence of the gradient of a substance extendingalong the animal that activates the formation of the head (Schaller, has This substance 1975). beenisolatedand is a peptideof low molecular weight. Moreover, Berking that is again distributed A974) has isolatedan inhibitory substance along the animal and inhibits the formation of the head region,consisting of hypostome and tentacles. Thesediscoveries add credence to modelsof the type discussed in Section16.5 nonlinear interactions between an activator and an involving inhibitor. In the analysisin Section16.5 wehave shown that the length of such a system must exceed a critical value beforea region of high concentration of the activator appears.If one acceptsto identify this with the head region of Hydra, then one obtains an interpretation of a fact well-knownto zoologists, a critical size before acquiring its morphonamely that Hydra must exceed
demonstrated
morphological
The situation is fairly analogous in the case ofAcetabularia.A gradient of an substance, I,producedby the nucleus(which is in the rhizoid region inhibitory Bonotto, oppositeto the cap) has been suggestedby certain authors (e.g., This substance blocksthe action of an Lurquin, Baugnet-Mahieu,et al., 1972). RNP. This agent, Do, can be a agent unmasking the ribonucleoproteins, Moreover, a gradient of RNP extending proteolytic enzyme(Brachet, 1975). from the apical to the basalregion has beenfound (Brachet, 1964; Wall, 1973), for the synthesis of enzymes initiating cap formation. which codes Taking only thosegradients into account a minimal model has beendevelwhich can besummarizedas follows: (Rommelaereand Hiernaux, 1975),
developed
characteristics.
(mRNA)M
r]
vDfl
>
mRNA (mRNA)'
4 M+
\342\226\240
vD,
mRNA
\342\226\272
+ sE + P
k6
\342\226\272
E*
A6.15)
426
Cellular Differentiation
and Pattern
Formation
D, denotesthe inactive form of the unmasking substanceDo, which is taken to be a cooperative enzyme as in the modelsanalyzed in Chapter 15. The active form Do unmasksthe messenger RNA, which in turn mediatesthe synthesis of the enzyme E relating to the cap formation. Both I and E are degradedto yield inactive forms I* and E*. The rate equationsdescribingthis model have been solved numerically under the following conditions:
linear gradient of (mRNA)M is supposedto exist at the outset, The inhibitor I diffusesalong the system and obeysmixed conditions at (ii) it is held constant in the region of the nucleus from which it the boundaries; emanates and cannot flow outward in the apical region.
(i) A
The numerical simulations yield a critical length, beyond which the synOne is tempted to concludefrom synthesis of enzyme E becomes appreciable. this that the cap formation cannot take placebefore a critical elongation is attained. This is in agreement with the experimental observations. of the presentchapter wehave sections Throughout this and the preceding in terms of nonlocalized reactions, argued typically with reactionsoccurring It is plausible within the cytoplasm. that membrane-bound substances play A striking illustration is provided by the an important role in morphogenesis. discoveryofelectricalsignals accompanyingthe regeneration ofAcetabularia and which are related to the existence 1972; Novak, (Novak 1975), Bentrup, of a transmembrane potential. A more completemodel of morphogenesis should, therefore, contain both cytoplasmic and membrane elements. Nevertheless,the general ideasoutlined in this chapter would still apply, as of the reaction sequences such as they rest only on the qualitative properties and symmetry breaking rather than on the quantitative details. stability
Chapter 17
Thermodynamicsof Evolution
17.1THE NOTIONOF COMPETITION
We have seenthat the formation and maintenance of self-organizingsystems are the results of nonequilibrium constraints and appropriate nonlinear at the molecular level. In this couplings characterizing regulatory processes final part of the monograph we want to analyze the influenceofa third element not explicitlypresentin our preceding considerations, namely, the competition between the entities constituting the system. whenever Competition is a very general phenomenon in nature. It occurs the resources or raw materials necessary for synthesis, growth or survival, are limited or become The interactions between the elements present scarce. take then the form of a struggle,whoseoutcome may be twofold.Either some of the entities are eliminated from the system, or a sort of \"dynamical equiof widely different entities. In equilibrium\" is realized, enabling the coexistence this chapter we discussprimarily the influenceof the first type of process, which is usedas the basisof a theory of prebioticevolution of matter. The is discussed in Chapter18. of competing populations problemof coexistence In both cases we insist on those general aspectsof the phenomena that are at the molelargely independent of the mechanistic detailsof the processes level.
molecular
17.2.PREBIOTICEVOLUTION: GENERAL
accumulated
PRESENTATION
theory ofevolution is a subtlecombination of the resultsaccumuPresent-day and of Darwin's original ideas. in molecular biology since 1952 to be the result of random mutations arising from Evolution is considered \"errors\" in the replication of the genetic material. The errors are inevitable, and of the of the complexity of the various biochemical processes of further in the absence of the external Obviously, diversity perturbations. constraints there is no competition, and the errors propagateindefinitely. Darwin'sfundamental discovery was to realize that natural selectiondirects
in view
429
which an organism can survive and increasein comThis mechanism complexity. operatesassoonas the environment cannot support a population exceeding a critical size. It selects thosespecies orgenotypes that number of descendants the external under the existing highest produce conditions.In this way, natural selectionprevents the accumulation of mistakesand at the same time allows improvements (through mutations) to take place. This picture of selection through \"survival of the fittest,\" which is strongly reminiscent of the gambler'sruin problemor the related phenomenon of extinction (seeChapter 9), already implies the existence of self-maintaining and self-reproducingsystems. it is not a theory t herefore, Strictly speaking, of prebioticevolution. This latter problemmay be formulated in successive stepsas follows.
the mechanism by
Under primitive earth conditions (probably prevailing three or four billion years ago), small organic compounds such as acids,bases,and sugars, could be synthesized at an appreciablerate. This view is widely accepted since Miller's historical experiment (Miller, 1953; seeFox and Harada, 1971 for a recent survey). must join into polymers having a new type of (ii) Next, these molecules would have been very low activity. The concentration of these molecules under prebioticconditions;therefore, somemechanism must have operated in orderto concentrate this dilute mixture in preferential places. These are discussed in Section 17.3. points to conceive crucial, namely, it is possible (iii) The following step is especially of a type of selectionpressure, with the interactions between these compatible active polymers, that would direct the system to increasingcomplexity and organization ? At a certain stagealong this road,the systemmust have become in sometype of capableof accumulating information from past experience, What are the rules that have prevailed in the formation primitive geneticcode. of this code, whoseexistence is now a well-established fact in biology?We discussthis problemin somelength in Section17.4 and 17.5 starting from an account of Eigen'simportant contribution.
(i)
proteins\342\200\224is
17.3.Prebiotk
Polymer Formation
431
describing the synthesis of low-molecular-weight homopolymer units, such as poly-U(polyuridylic acid) or poly-A (polyadenylicacid).Our main
motivation for introducing this simplification is to allow for an explicit kinetic and thermodynamicanalysis of the rate equations. The pricewe have to pay is that the characteristic properties of certain polymer chains to act as templatesfor their own synthesisor for the synthesis of other polymers is not built in the models. This difficulty is resolved by introducing reaction mechmechanisms involving suitable autocatalytic stepsgiving rise to the sametype of kinetic equations as the template processes. A much more sophisticated model into has account data on been known taking polynucleotide interactions analyzed by Babloyantz A972). The general picture is as follows. A precursorI of an active monomer X enters into the system. Onceformed, X gives rise to a dimeric molecule and Nicolis,1972): X2 in either of the following three ways (Goldbeter
A7.1a)
The overall reaction
is:
A7.1b) (ModelT)
X
\342\226\240
X2
condensation
template
2X,
A7.2a)
432
Thermodynamics
of Evolution
41
X2
2F
an
Additional
A7.2b)
Autocatalytic Effect
(ModelTC)
condensation
template + autocatalysis
A7.3a)
A7.3b)
the rate equations for the three models.At the steady state, one can seethat theseequations reduceto algebraicequations for X2 that are, (model TC),third degree (modelT), and respectively,of the fourth degree These second degree have been solved (model C). equations numerically and the results are as follows(Goldbeter and Nicolis,1972). vanishes (system maintained at equiFirstly, when the overall affinity the three models equilibrium), yield exactly the sameresult:
straightforwardly
Assuming
A7.4) This correspondsto a low-yield polymer synthesis,wherein the autoautocatalytic or template stepsare completely switched off. Let us now come to the nonequilibrium behavior. It turns out that the latter depends critically on the magnitude of the parameter a2, which determinesthe relative importance of direct polymer synthesis and autoFora2 large, schemesT and TC operate on the same autocatalytic processes.
17.3.Prebiotic
Polymer Formation
433
Thisbranch corresponds branch as C. to a maximum utilization of monomers by C and is referred to hereafter as the \"optimal\" branch. Fora2 relatively small the competition between the two types of mechanbecomesapparent.The synthesis on the \"template\" becomespredomiand the mechanismsT and TC give riseto far-from-equilibriumabrupt transitions of the sigmoidaltype (modelT) or to transitions between multiple is illustrated in steady states (model TC).The situation for this latter case where / is used as parameter measuring the deviation from equiFig.17.1, in Section8.4 is The resemblance equilibrium. with the simplemodel discussed striking. The systemevolvesfrom a state of low polymer concentration, which to direct synthesis(C)at low valuesof a2 and may be referredto corresponds
mechanism predominant,
3 2
i
-1 -2 -3
-4
-5
-6-
-7
-8 -10-9 -8 -7 -6 -5 -4 -3 -2 -1
log/
Multiple steady states as function of / for model TC.Solid lines refer to steady = 2,F = 5 x 10\"9, = a5 = 104,a,= 102,a3= 10~2,a6 states of system TCfor a2 = l(T4,a4 Kt = 102, K2 = 2 x 106, Ky = 1,Kt = K5 = 103, Kb = 2, K being equilibrium constants of reactions. +) and (O, x) refer to minimal and optimal branches, respectively; latter and for a2 = 106, respectively. corresponds to steady-state operation of model C for a2 = 10~4 Figure
I I I I I
17.1.
(#,
434
Thermodynamics
of Evolution
as minimal branch, to an optimal branch characterized by a polymer concentrathat may be higher by several ordersof magnitude. At the sametime the Both low and upper (polymer/monomer) ratio in the system is enhanced. branchesare shown to be stable, whereas the states on the intermediate branch are unstable. ModelsT and TC provide alsoa very instructive illustration of the thermoThe numerical evaluation of dynamic arguments advanced in Section8.11. the total entropy production,P as well as of the molar entropy production, correP/n, showsthat the transition to the optimal branchesin both systems to a jump in thesequantities. A close corresponds analysisof the rates and affinities of the various reactionsshowsthat this jump results in from a manifold increaseof the rate of the template and/or catalytic reactions,whereas the rate of direct condensation diminishesstill further. In other words,the system to a fast reaction pathway and at the same time it enhancesits rate switches of dissipation.This is in completeagreement with the considerations dein the third of Section 8.11. developed part
concentration
with / beyond the transition region, Finally, while P continues to increase the molar entropy production P/n beginsto decrease. This occurssimulwith a decrease of rates affinities for the and simultaneously template and catalytic to that the the fact inverse processes, owing stepsbegin to build up along the
reaction sequence. This behavior of the dissipation function per unit massis strikingly similar to the existing thermal data on specificoxygenconsumption during embryIt appearsthat during a fraction development (Zotin and Zotina, 1967). of early embryonic life this quantity (which is expectedto be an increasing function of entropy production per unit mass)is sharply increasing,whereas This latter tendency continues during subsequentlyit steadily decreases. with such phenomena as adult life, with a few notable exceptions associated tissueregeneration or malignant growth. One is tempted to argue that only after synthesis of the key substances for its survival (which implies an increase in dissipation) does an necessary a its low value tend to to compatible organism adjust entropy production with the external constraints. At this point, contact can probably bemade with Darwin'sideaof the \" survival of the fittest,\" because a low rate of dissipation is likely to give to an organism a selectiveadvantage.
embryonic
are now concerned with the next stageof evolution, namely, the behavior The problem is of interacting populationsof biopolymers(Eigen,1971). the oneoutlined formulated by first assuming that by somemechanism (e.g.,
We
17.4.Biopolymer
in
435
properties:
related Under the maintenance of a finite energy and matter flow (e.g., to the entry of monomers in the system as in the previous section)these substances can metabolizein the sense that they may undergo transformations from energy-rich to energy-deficientcompounds. (ii) The substances have certain autocatalytic properties arising from template action. In particular, the overall rate of productionof constituent i is a least proportionalto its concentration. This is to be comparedwith for the Lotka-Volterramodel,where autocatalysis gives rise to a Eq. (8.2)
similar
This implies that there is a (iii) The replication of i is subject to errors. for a from i set of other possibility producing substances; A/7= n). general form of rate equationssatisfying again a spatially homogeneous mixture):
A
property.
1,...,
A7.5)
theseconditionsis (assuming
i
= (AtQ, -^ at
At
Dt)Xt
</>OiX,
1,...,
n
and D, represent,respectively, the rate of formation of substancei as of i. Qt measures directedby the template i and the rate of decomposition i faithfully. its to the \"quality\" of the template action, that is, ability reproduce < of the < reflects the rate of i and dilution <pOi represents Clearly, 0 Qx within the reaction relative content the fact that as the systemgrows, polymer the rates of spontaneous volume is constantly modified.Finally, represent A given productionof i arising from errors in the replication of j species. at a rate either substance k at k replication process template produces 1 We conclude that: a rate k at total Ak( Qk)Xk. AkQkXk>or substances)
1.
<\302\243,7
\342\200\224
In addition to We must now specifythe constraints acting on the system. the nonequilibrium conditions related to the monomer (or the energy) flow into the system, onehas to imposea constraint implying somesort of selection. One of the conditionsproposedby Eigen for this purposeis the
conservation relation:
\302\243X,-
= const
A7.7)
436
Thermodynamics
of Evolution
this condition may lead to selection is obvious from the fact that any increase in the concentration of oneof the i constituents necessarily impliesa decrease in the concentration of the other substances. Summing over i in Eq. A7.5) and taking relations A7.6) and A7.7) into account we find that the Ah D,,and (poi must satisfy the following condition:
That
Xi
A7.8)
Thiscondition implieseither a recyclingof the waste productsinto the system, or a suitable adjustment of the dilution rate. Forinstance, taking all (f)Oi to be identical we find:
as
\302\243,
= Ai
- D,
=
<t>0
A7.10a)
A7.10b)
as
E
^^
\"
\302\243
we may now transform Eq. A7.5)into a form with conditions A7.6)to A7.9) built in. Substituting from we find A7.9) 4>Oi Eq.
\342\200\224i
dX at
= (Wf
\342\200\224
E)X, +
j-!frjXj
i=l,...,\302\253
A7.11)
= A,Qt
- D,
A7.12)
The nature of the competition described is bestillustrated on by Eq.A7.11) example of \"self-reproductivecatalytic hypercycles\" (Eigen, 1971), reflect the fact that nucleic acids(denoted depictedin Fig.17.2. Hypercycles for self-organization because are a necessary by I,- in Fig.17.2) prerequisite the ability to act as templates. However,they require a catalytic they possess This fact is provided factor that couplesthe different template mechanisms. The whole by the presenceof protein chains, denoted by E, in Fig. 17.2. that is, the final protein En feeds back on hypercycleis assumedclosed, the hypercyclegives rise to side Supposenow that, as a result of errors, of the conservation condition A7.7) these new branches.As a consequence hypercycles competewith the original one.Under certain conditionsthis of the nonlinearities,selection and, because competition may lead to selection
the
I,.
17.4. Biopolymer
437
17.2. An n-membered self-reproductive hypercycle of the type developed by Eigen. Polynucleotides I, are information carriers capable of self-reproduction. In addition, polyeptides E, serve as catalysts for the production of polynucleotides (Ef_, catalyzes production that is, of I,) and, moreover, I, provide information for synthesis of E,. Hypercycle is closed, Such autocatalytic En catalyzes the production of systems may be advantageous during evolution.
Figure
I,.
is very sharp.Thus, among many competing systemsonly onecan survive in an appreciable In the examplestreated in Eigen'spaper (Eigen, quantity. the survivor is characterized by the Jones, Enns,and Rangnekar, 1976), definition A7.12)]. highest value function [see Now, a system respondsto an errorand evolves further only if it is not oneis tempted to think that the ultimate stableinitially. Hence, sufficiently evolution would be to direct the system to a state of optimal goal of prebiotic stability toward its own errors (or fluctuations, as errors may be thought of as a new kind of fluctuation). This searchfor optimal stability shouldthen give a more precise meaning to the Darwinian \"survival of the fittest\" T he a means for minimizing state will be a system possessing principle. final This devicecouldbe thought of as the precursorof the genetic code. errors.
1971;
438
Thermodynamics
of Evolution
In the considerations it is developedin this sectionand in Section17.3 assumedthat the polymers couldbe presentin macroscopically appreciable Mechanquantities, otherwisethe variousinteractions would not be effective. able to localize thesereactionswithin specificcompartments should, in prebiotic evolution. In this respect therefore,have played an important role we may point out that the possibilityof creating, in a limited region of space, mixture concentrations that may be much higher than in the homogeneous is built into the very conceptof spatial dissipative structure. In particular, treated in Chapters7 and 8illustrate how a systemcan reach and the examples maintain new configurations where the probability for certain reactionsis enhancedand thereby triggers further evolution. The problemof compartformation in the context of prebioticevolution has beenconsidered along theselines by Tyson A975a) and Hiernaux and BabloyantzA976).
Mechanisms compartment
VIEWED 17.5.EVOLUTION
AS A
OF STABILITY PROBLEM
to derive somegeneral thermodynamic and kineticcriteria for and evolution. stability Supposethat we have initially a set of interacting = polymer speciesX, (i n) that all exist in relatively abundant quanis described The time evolution of the set {X{} by the following rate
We want now
1,...,
quantities.
equations:
\342\200\224^
= F? + F^Xj}) = O.-dXj})
i=l
A7.13)
HereFet is a supply term related to the exchanges of monomers)with the (e.g., external environment, and F, describesthe chemical processes inside the system.It is assumedthat the system is maintained uniform and that there exists at least one asymptotically stable steady-state (or time-periodic) solution of Eq. A7.13). This means that all compositionfluctuations dXj regressin time, that is, that all n roots w{ of the characteristic equation (see Section6.5) have negative real parts. In addition to compositionfluctuations the system may be subject to fluctuations tending to alter the average (deterministic) laws of evolution. For instance, a hitherto absent \"mutant\" or \"error copy\" of a polymer new reaction pathways may suddenly appear in the system. Subsequently, may be opened even if the new copy is present in very small quantities; small parameters that would normally play no rolein the macroscopic evolution become, as a result of these fluctuations. therefore, essential How are we to introduce the influenceof such structural fluctuations into the description? error or mutation cannot initially a spontaneous Naturally,
17.5.Evolution
figure in
Viewed
439
our deterministic Eq. A7.13), which is a statistical average over a it constitutes a stochasticprocessthat could be studiedindependently of Eq. A7.13) by the methods outlined in 10-12 of this also Allen, 1975; Chapters Eigen and Winkler, monograph (see now that the of conditionsfor spreading the errorover a 1975). Suppose sufficient volume or surfacearea are fulfilled. Then, the new copyconstitutes a macroscopicfluctuation of the previously prevailing equations.Calling = we obtain a perturbed set of differential m) the new copies, Yj (j whoseorder has increased equations by m comparedto the order of A7.13). larger number of elements. Rather,
1,...,
dY, dt
Theseequationsread:
= G,({Xj},{Yk},c)i = 1
-\302\273
/=l,...,w
A7.14)
This and such that in the limit c 0 the original equationsare recovered.* means that there existsa value Yk({Xj}) given by
j0)
=0
A7.15a)
A7.15b)
such that
)},0)= Fi
Naturally, we expect Yk given
from
Forc to be practically zero. by Eq. A7.15a) be zero of will determined different but small, the stability Eq.A7.14) n + m. This equation will have n + m by a characteristic equation of degree to thoseof the initial characteristic rootsand n of thesemust have valuesclose in have equation and, negative real parts. The stability of the particular, referencestate of the initial system or,alternatively, the stability of the state can only be threatened by the new {Xf}, {Yk} of the enlarged system A7.14), roots a>n+k @ < k < m). To illustrate this, take m = The only way to recover the characteristic equation of the initial system in the limit e 0 is either the (n + l)st term of order multiplying then to have a correction of of the or the term the characteristic characteristic root, equation that power is independent of the characteristic root:
1.
-\302\273
\302\243
cco\"+'+
an(c)co\"
\342\226\240\342\226\240\342\226\240
+ a,(fi)co + ao(c)= 0
A7.16a)
* Note that in the equations for Y, there is no flow of mass term included. This reflects the fact that {Y} is produced systematically solely via autocatalysis and is, therefore, essentially a closed
system.
440 or
co\"+1
Thermodynamics
of Evolution
an{r)co\"
\342\226\240\342\226\240\342\226\240
+ a{(E)co+ mo(c)= 0
A7.16b)
Forc small the new root con+ , dependson c in oneof two ways:
\342\226\240l--~
A7-17a)
if
we are in
case or A7.16a),
A7.17b)
case on the valuesof the parametersand on A7.16b). Depending the coefficientin the right-hand sideof either Eq. A7.17) kinetics, may be Thus wereach the important conclusion that by taking into account positive. a small and, at first sight, \"spurious\" parameter, the stability propertiesmay In other words, one deals here with a problem of the structural change. Section with respect to perturbastability (see 5.4)of the reduced systemE.13) that introduce side reactionsincreasing the order of the differential the departurefrom the unstable regime is system.Note that in case A7.17a) the unstable modeevolvesvery very fast for e 0, whereas for case A7.17b) to a new state of high Y conslowly.This evolution may lead,for example, which can even be dominated by the new substances. concentration, One can derive a somewhat explicit kinetic criterion for evolution by around the referencestate {Xj}, linearizing the secondequation A7.14) {%} = c to 0. We obtain, setting Y, = Y, + SY,: corresponding
if
we are in
the
perturbations
-\302\273
'=\342\226\240
\302\273
The condition for evolving away from the values % of characteristic determinant of this m x m system: det
is, then,
that
the
=0
A7.19)
shouldlead to at least oneroot having a positive real part. The remarkable feature of this criterion is that it doesnot dependexplicitlyon the properties of the original system.For a single additional copy (m = 1)the criterion
17.6.Evolutionary
yields simply
Feedback
44j
>0
in
A7.20)
of Y should enhance the rate of its synthesis. other words,that the presence This statement is equivalent to that of an autocatalytic action of Y. for systems Theseconsiderations have beenillustratedon evolution models in which the new substances introduce a drastic change in the functional and Babloyantz, 1972). Nicolis, properties(Prigogine, Typically,c.is then the inverseof somerate constant k characterizing the new function and the new time scale imposedon the system. The essentialproperty that instability occursfor e 0, that is, for k j> 1,means that the new copieslead to an increasein the interactions within the system and/or between the system and environment.
-\302\273
17.6.EVOLUTIONARY
When inequality
FEEDBACK
A7.20) or its generalization to several new substancesis the systemof Y valuesswitchesfrom the referencestate {Yk] to a Section regime characterized by new reactions having a positivevelocity [see were absent Sincethesereactions Eq. (8.89b)]. initially, their especially is first to bealso the bound affinity stagesof evolution positive. Thus, during rate of dissipationas from the referencestate the increases its away system measuredby the entropy production.If the instability correspondsto Eq. this increaseis very sharp, as discussed in Section (third subA7.17a) This has result been illustrated on models and Nicolis, (Prigogine, subsection). satisfied,then
8.11,
8.11
Hiernaux and Babloyantz, Goldbeterand Nicolis,1972; Babloyantz, 1972; which also indicatea similar behavior for the 1976) specificrate of dissipation, that is,for the entropy production per unit mass(or per mole). The point is that the instability, which is triggered by nonequilibrium 0 and large in Eq. A7.13)] maintainenvironmental conditions by Fcthe levelof dissipation a continuous energy dissipation, further increases of new instabilities. and thereby createsconditions favorableto the appearance In other words, someirreversibleprocesses taking placeinsidethe system are their departure more intensely and have, accordingly, increased functioning the probability that there existsa classof from the equilibrium state.Hence, are in turn unstable, has fluctuations, with respectto which theseprocesses become higher. On the contrary, if the result of the instability wereto decrease the levelof dissipation, to the propertiesof an isolated one would get closer to a regime in which all fluctuations are system at equilibrium, that is, closer
[i.e.,
maintaining
442
Thermodynamics
of Evolution
of transitions has damped.This mechanismofevolution through a succession been calledthe evolutionary feedbackand can be visualized as follows:
Nonequilibrium
Threshold
(Eq. 17.20)
Increased dissipation
(Eq. 8.89) We
<
are led, therefore, to regard energy dissipationas the driving force of evolution. In this respectit is pertinent to point out (de Duve, 1974) that, there despitethe increasein organization and complexity of living systems, has been an acceleration of biologicalevolution in the courseof time. It seemsas though each new step increasing functional organization has in itself the germs for further evolution. The purposeof Section17.7 is to relate the level of dissipationwith the functional organization of simplereaction networks.
IN SIMPLE REACTION NETWORKS 17.7. ENERGY DISSIPATION
SimpleLinear Networks
Let us first considerthe transformation of someinitial substrateA to a final product E through JV intermediate productsX, (i = JV). We want to behavior of the the study steady-state entropy productionper unit mass(or as a function of the topology of the reaction scheme, that is,as a per mole) <rm, We function of the reaction \"connections\"between the chemical species. assumethe reactions follow linear kinetics and that all forward and backward rate constants are equal to k. We have:
1,...,
^
z\\ 2 '
'
\"^N
A7.21)
17.7.Energy
44s
+ iE (N+1-QA
N+\\
A7-22)
and the total entropy productionis, assuming a uniform system and taking definitions C.14) and C.9)into account: P
= k(A- X,)ln
~+
k{Xx
X2)\\n
^
\342\200\242 \342\200\242 \342\200\242
k(XN
- ^
E)ln
A7.23) where A, E, and Xt denotethe total mass(or number of moles)of the corresponding constituents within the reaction volume. Taking Eq. A7.22)into account we find that, at the steady state
A
cor-
A\"?
X\302\260i
X\302\2602
= X%
A7.24)
Thus, Po = M
- Xi)ln 4
AZ25)
-\"TiTT\"!
Dividing
through
by the total
m
=A +E +
1=1
Y^Xi
<r\302\260
for and taking again Eq. A7.22)into account we arrive at an expression of solely in terms of the ratio A/E-that is, in terms the overall affinity of the reaction- and of the number of intermediates:
k
(N
\\)(N
2)[_(A/E)
1]
its specificentropy Thus, for a given overall affinity, the reaction chain sees its decrease w hen when more intert hat increases, is, length production E is intermediate intervenebefore steps produced. as a polymerization reaction. Each step i of Let us now regard Eq. A7.21) the chain describes the addition of a monomer A, to the intermediate X,-_ , in such a way that k = ltAj = const, where /, is the rate constant for the ith addition. The final polymer E is produced at a rate proportional to the steadystate value of XN, that is, from Eq.A7.22):
fc^o
kA
+ NE
A7 27)
444
Thermodynamics
of Evolution
This is an increasing function of N as long as E/A > 1, otherwise the rate of with the length. In particular, this is the case when synthesis of E decreases the overall affinity is triggered to infinity, that is,if A/E -* oo at constant A. At the sametime, the rate of depletionof monomers A becomes:
dt that
A7.28)
length of the chain. we for a large and positive overall affinity the find that conclusion, of specificrate of dissipation with the length of the chain is associated decrease with a poor functional performance as measuredby the yield in polymers. This result (Prigogine and Lefever, 1975) as follows. can also be expressed From Eq. A7.22)onecan seethat for
In
A/E-* co,
Alternatively,
A>
X{>X2>
>
\342\200\242\342\200\242\342\200\242
\342\226\240\342\226\240\342\226\240>
XN> E.
>
J\"x,
A7.29)
For N -* oo the
individual differencesfix. jUXj+1 tend to zero, and as a result the overall rate of transformation of A into E is very slow. The situation is different when the initial and final productsA and E can be connectedby more than onepathway. Forinstance, considera seriesof \"parallel\" connections involving each a single intermediate product:
A7.30)
--\342\226\240\342\226\240\342\226\240
Following the same procedureas before one finds that when /c, = k, is given by (Prigogine and Lefever,1975):
<r\302\260
= k~
A7.31)
(N
+ 2MA/E)+1] E
N[tjA/E)-l-\\
17.7.Energy
445
In contrast to Eq.A7.26),this value increases with the number of loopsin the tends a network and toward finite constant value for N oo. At the same of the network is enhanced as E is produced time, the functional \"efficiency\" at a higher rate. An alternative interpretation of this result is as follows. Starting with a linear chain such as Eq. A7.21), an evolutionary processtransforming it into the in both the form A7.30) is associatedwith increase progressively rate of a and the functional efficiency.For given value of specific dissipation the constraint A/E onemay say that the system has managed to interact more strongly with the external world in such a way that it is traversed by a higher
\342\200\224>
flux
of matter.
SimpleCatalytic Networks
which
The next step is to considernonlinear reactions involving catalytic steps, are more realistic from the biochemicalpoint of view. A typical scheme is the following:
A7.32) where the catalyst M is formed due to the action of the end constituent of the The comchain and, subsequently, catalyzes some(or all) of the reactions. -> the of the oo and show t hat if strength 1965) (Prigogine, A/E computations is enhanced is effect the rate of catalytic sufficiently large, entropy production
enormously. Significantly,
but
onefinds
that
at the
sametime
Pe
In other
without
A7.33)
degradation along the chain and to sustain between XN and the final productE a very large affinity of reaction. We find here oneof the key ideas behind the notion of evolutionary feedback;it is by keepingsome of the reactionsvery far from equilibrium that a system becomesmore efficient.
446
Thermodynamics
oj Evolution
17.8.A
BIOCHEMICAL ILLUSTRATION
When, by addition of a suitable substrate,a chemical potential is appliedto an enzymatic processsuch as the glycolyticpathway (see Chapter14),fluxes are generated and the variouscomponent processes into pass anonequilibrium state.Consider,for instance, the case of a steady-state functioning. One can compute the minimum energy requiredto maintain a steady-state flux for a reaction within a nonequilibrium chain (Hess, as follows.Consider the following reaction:
1963,1975)
'
>
k2
A7.34)
If 01is the
affinity
a=kBT\\nk^
then the amount of energy per unit time
is:
Experimental values for the ratio (Ao/Eo) have been reported by Hess of the glycolytic reactions in tumor cells. On the basis of A963) in the case thesevalues, glycolytic reactions can be classifiedinto two groupsshowing different steady-state behavior.
for instance, Reactions with near-equilibrium enzymes. In these reactions, the reversible isomerization of i somerase catalyzing glucosephosphate is flux into t he net low fructose glucose compared 6-phosphate 6-phosphate, to the maximal activity of the enzyme. with a reverseflux (ii) Reactions with enzymes operating quasi-irreversibly, small to the net compared negligibly flux, and having regulatory functions. In this case, the free energy of the reaction is mostly usedfor control. Examples For of this secondclassinclude pyruvate kinaseand phosphofructokinase. from in one the kinase finds that deviation instance, pyruvate equilibrium in the glycolyticsystem as indicated by Ct is about 5 kcal mole\"'.
(i)
the
Usingthesedata one can concludethat along the glycolyticpathway the chemical potential differenceis practically concentrated in the vicinity of the and pyruvate kinase, two principal regulatoryenzymes,phosphofructokinase
17.8.A Biochemical
Illustration
\"
447
whereasin the part of the chainbetweenthesetwo enzymesthere is a plateau \" of chemical potential. The situation is strikingly similar to that encountered in the model of the secondsubsection in Section17.7. It is tempting to point out the analogy between the evolutionary feedback and the conclusionthat the energy cost for control is associatedwith the to say, weare Needless complexityof the metabolic pathway to be controlled. of still at the very start in the understanding of the origin bioenergetic
pathways!
Chapter 18
Ecosystems
INTRODUCTION 18.1.
In Chapter 17 we have seenthat, starting from an initial chaotic situation, the competition between units endowedwith autocatalytic propertiescan of nonequilibrium give rise to a functional organization via a succession instabilities. the laws the Now, describing growth, decay,and interaction of
and socialsystems are very closely to those biological populations analogous of chemical kineticsin general and to those of competing biopolymers in
particular. The purposeof this chapter is to explore these analogiesand undertake an analysis of interacting populationsin an ecosystem using the methods and ideasunderlying the theory of dissipative structures.As in Chapter 17, we try here to sort out some general features and trends that are largely independent of the details of the phenomena at the level of the single
We first review,in Sections the basicequations 18.2 and 18.3, of population dynamics and illustrate the type of orderedbehavior that can be predicted from these equations. Sections 18.4 and 18.5 are devoted to ecological evolution. We first outline a general formulation of this problemand then of socialinsects.Section 18.6 is apply it on examplesinvolving colonies devoted to the question of stability of complexsystemsand to the timehonoredproblemof \"the limits of complexity.\"
individual.
448
449
Let us first discussthe dynamical processes inside the system. As a rule, of assembly populationsis subjectto the following kinds of processes.
Processes of genetic origin. As the entities constituting the populations are living beings,they reproducethemselves at a frequency /c, and die at a frequency dt. Moreover, they are subjectto \"mutations\" that from time to time may change the nature of the system in an unpredictable way, as in the case of prebioticevolution examined in Section17.5. (ii) Processes involving competition, intra- or inter-specific.Quite frequently, these processes arise from the fact that in a medium where the amount of resources is limited, the growth of an organism eventually takes place at the expense of the others. As it has long been known from early studieson human or animal populations, this resultsin a saturation in the growth. In other cases, involve direct interactions between individuals, competition may o r s uch as and castes, species, By definition, all kinds of predation aggression. rise to rate equations, contributions in the nonlinear competition give These processes ensure the coordination of the (iii) Regulatory processes. activities of the populationsin spaceand time. They give rise to feedbacks or that is, to nonlinear interactions, in the sensethat they growth of a certain part of the population which is necessary for the survival of the entire population. The formation of soldiersin social insectsis a characteristic example. The above three processes are local in the (iv) Communication processes. sensethat they take placein any small area or volumeelement in the system. In addition to theseprocesses communicate between neighboring populations or even distant areas.Spatial dispersion (Pielou,1969)or migration of means for communication. Sensing are examples (Maynard-Smith, 1974) devices and/or chemical agents such as pheromonesin socialinsectsmay alsobe involved.
favor\342\200\224directly indirectly\342\200\224the
Coming now to the constraints acting on the system we remark that an ecosystemcommunicates with the external world through a separating surface, Z. In general, the conditionsprevailing in the external world are not identical with thoseinsideE. In particular, the numbers of individuals of i insideand outsideare different: Xt # X]. Similarly for the energy species per unit volume or per unit area, ev # e\\. Thesedifferencesare felt by the system as constraints inducing a flow of matter and energy within L, in the describedin Chapter5. sameway as in the case of physicochemicalsystems is It is Thus, an ecosystem generallyan opensystem. easy to think of examples, a flux of solar energy or a such as the biosphere to as a whole being subject of energy an exchange thanks to relatively advanced societybeing sustained and information with the surroundings.
4S0
Ecosystems
We want now to write the explicit form of the rate equationsdescribing these processes. of a Let us first illustrate the procedurein the simplecase In the presenceof food, A, the individuals, X, multiply at a singlespecies. rate that to first approximation can be set equal to*:
(d\302\261\\
\\
at
= kAX
/birth
A8.1a)
is:
\342\200\224
dt /dealh
= -dX
A8.1b)
Note that Eqs.A8.1) are isomorphic to the rate of an autocatalytic production of a chemical X and to that of a dilution or an inactivation of X:
A
X X
\342\200\224*\342\200\224\302\273
2X
\342\200\224d-^
A8.2)
were unlimited, then Eq. A8.1) would predict a population explosion an exponential growth of X,f provided kA > d, and an exponential decay to zero provided kA < d. In fact, A is generally limited and as a result its rate of consumption must be taken into account explicitly.This rate is equal to
If
A through
A8.3a)
On the other hand, A is reproduced in the sameway as X or, if it is a simple of other living organisms. organic matter, it arisesfrom the decay processes is quite complexand involves the so-calleddecomposers. A This process the simple limiting caseis that where A is recycledentirely into system the death of X: through
= dX (d4) V dt /prod
system):
A
A8.3b)
there is a From Eqs.A8.1) and A8.3) we concludethat in this limiting case conversationcondition for the total amount of organic matter present(closed
+ X = N = const
A8.4)
an extension to several
* Expression A8.1a)implies the presence of a single phenotype. For phenotypes, we refer to Allen A976).
This is usually referred to
as Malthusian
growth.
A from this
for
X:
dt
= kX(N
- X)
\342\200\224
dX
A8.5)
This is the celebrated Verhulst equation for logistic growth, which has been Maitra, and Montroll, widely used in the study of population trends (Goel, As mentioned before, the term N X introducesa saturation of the 1971). population to a finite steady-state level:
X0
= N-~
k
A8.6)
It can be shown straightforwardly that this state is asymptotically stable wheneverit exists(i.e., > whereas the trivial state Xo = 0 correspondXo 0), to the extinction of the population is unstable.* In the case of several interacting populationsthe saturation term takes the form (May, 1973)
corresponding
A8.7)
(i) to processes
and the general equation of evolution taking into account (iv) cited above
is:
+ Fc({Xj}) + FR({Xj}) + FM({Xj}, A8.8) The nonlinear functions Fc, FR describe, respectively,the rate of competition other than that implied by Eq. A8.7) and the rate of regulation. FM stands for migration, movement, and so on, and dependson both internal and
{X\302\260}).
external values of Xt. As a secondexampleof Eq. A8.8), considera system involving a single prey, X and its predator, Y. We assumethat the prey has an unlimited reservoir of food (Nprey -> oo) and that the predator feeds entirely on the imply prey.The latter diesentirely becauseof predation.Theseassumptions = FM = 0, and dprey = 0 in Eq.A8.28). that Pij ->0,FR Moreover, we take for Fc the simplestpossibleform describingthe frequency of binary enencounters between X and Y:
\\Fc(X,Y)\\
= sXY
A8.9)
the assumption of a from the regime of
* Note that the existence of two steady states is not in contradiction with closedsystem, Eq. A8.4). Indeed, we deal here with a system displaced
detailed balance.
452
Again,
Ecosystems
it is instructive to point out that Eq. A8.9) has the sameform as the rate of the autocatalytic reaction: X
\342\200\224^\342\200\224\342\226\272
2Y
A8.10)
Keepingtheseremarksin simpleform:
mind
^= dt
sXY
at
sXYdY
A8.11)
Theseare identical to the equationsof the Lotka-Volterramodel analyzed in Section16.2 Maitra, and Montroll, 1971). (seealso Goel, Sofar Eq. A8.8) have beenregardedas deterministic, In fact, theseequadefine a stochasticprocess in the space of {X{} values for the same reasonsas chemical reactions. one Thus, following the methods of Part III, can derive master equations to complete the macroscopic predictions. Moreover,mutations introduce structural fluctuations that confer to the system an additional stochasticelement. Finally, an ecosystemis subject
equations
to environmental fluctuations that continuously influence the values of the coefficients kt, Nt (etc.)in Eq. A8.8).In this chapter we are concerned primarily with the effect of structural fluctuations. A detailed analysis of environmental fluctuations can be found in May'smonograph (May, 1973).
18.3. EXAMPLE
IN
The close of the rate equationsto those of chemical systems, resemblance and the existence of nonequilibrium constraints, promptsus to ask whether of biological at this levelof description dissipative structures occur populacausingpatterns of organization similar to thosefound on the chemical reactionsanalyzed throughout this monograph. In recent years, limit-cycle solutionsof model equationsof population The possibilityof spatial dynamics have been discovered(May, 1973). Herewe and Jackson,1972). ordering has also been pointed out (Segel develop a different examplereferring to the rapidly growing field of sociobiology.Although the type of behavior predictedby this model is probably quite general, in our formulation we refer specifically to social insects
populations,
(Deneubourg, 1976).
in Insect
Societies
maximum
453
insectssocialorganization attains a
the hymenoptera and termites (Wilson, 1971), and the survival of the individuis practically impossible outsidethe group.The regulation of castes,nest construction, formation of paths, and the transport of material or of prey are different examples of collectivebehavior extending beyond the scaleof the single individual. Considerthe problemof the early stagesof construction of a termite's in two phases nest.It seems that this occurs (Grasse, 1959). Firstly, there is an uncoordinated phase characterized by a random depositionof building
complexity with
assumption
material. However,when by chance oneof thesedepositsbecomes sufficiently in a second the termites deposit material on that that large phase begins, aggregation preferentially. A pillar or wall growsdependingon the initial compositionof the deposit.If these units are isolated,construction stops, otherwise an arch may result. The following simplemathematical model (Deneubourg, showshow 1976) such \"orderthrough fluctuations\" Let the of C be concentration appears. insectsdepositing the material, whoseconcentration is P.The basicassumpwe adopt is that a chemical substancethat termites mix with the difbuilding material is emitted. Let H be its concentration. The substance in diffuses its odor the and attracts termites toward freely space regionsof o f already that toward the where there is an excess is, H, high regions This in of orientation mechanism a odor material. gradient may deposited not be the only onepresent,but it is the only oneretained in the model. The main stepsin the process can be summarized as follows:
C
+
'
\302\273
'
+ P*
A8.12)
the indirect autocatalytic effectof H on P via the where the loop describes attraction of C P* representsthe \"inactive\" material, that is, the material can be emitted. at a state where no odoringsubstance The rate equationsare:
\342\200\242
\342\200\224
dP = _
*
ktC-k2P
D ]r * + DHV2H k2Pk4H is.2
<*4
dH = ]r
ct
~=
F*
08-13)
In the last equation Fe represents the flux of insectsbringing material into the spacewhere the work is performed,D the coefficientof random dispersion
4S4
Ecosystems
pattern of density P obtained by numerically solving Eq. A8.13)in region = 3,fc, = k2 = k4 = of uniform steady state. Numerical values of parameters: = 6.25x 10~4, x 10\022. D = 0.01, 0.8888, DH y = -0.4629
Figure
T8.T. Spatial
of instability
F'
of \"active insects\" in the sense the rate of disappearance not that oncethey deposit the material the termites do participate in the term the attraction work for a while. Finally, the last by the represents coefficient a attraction It has been set proportional to (constant) 0) y(y and to the divergenceofa \" field.\" The latter isproportional to the local density A similar term has been used in the of insectsand to the gradient of odor. the motion of cellular slime molds during the of chemotactic modeling
\342\200\224k{C
odor. <
1970). Chapter 15 and Keller and Segel, aggregation phase(see Under certain conditions,Eq. A8.13) may admit two steady states.The
first
is the
uniform
state:
-p
\342\200\224
\302\260~^7
Ho =
A
A8.14)
kA
linear stability analysis following the lines of Section7.4showsthat this unstable.The system then evolves to a structured constate may become This configuration featuresa regular pattern on Fig. depicted configuration of material depositionwhich is expectedto simulate the regularity of the observedin actual termite nests. pillar succession A detailed analysis of the characteristic equation showsthat only when the the uniform a certain value does density of the depositedmaterial* reaches
18.1.
density
of deposited
material
is directly
proportional to the
of insects.
455
agreement with
untenable solution of the rate equations.This is in the experimental observations. Moreover, it is seenthat the of the a function the is of coefficientsD and DH pattern wavelength dispersion and the sizeof the system.In particular, structuration becomes if impossible the dimensions are below some critical value. This is quite similar to the conclusionreached in Section devoted to the onset of polarity in a
become an
16.5
field. morphogenetic It is striking to see, on this simple example,that the performanceof complex tasks leading to regular structures does not necessarily require distance or devices. it to other similar R ather, measuring appears be an inevitable of the nonlinear interactions within the system and of the consequence constraints exertedby the external environment.
/o
cot
=0
A8.15)
shouldlead to at least oneroot having a positive real part. Here G, denote the rates of evolution of the mutants {Yk} (k, I = m):
1,...,
^=
G,({Yk},{Xj})
A8.16) k,l=l,...,m;j=l,...,n
and {Xj}denote the initially presentspeciesor phenotypes.Finally, the is evaluated around a reference state where the derivative in Eq. A8.15) \"mutants\" are absent:
A8.17) {Xj}= {XJ}; {Yk} = {0} Note that in the precedingargument the exact mechanism of structural fluctuations is left open.Darwinism supposes an origin of fluctuations
456
Ecosystems
basedon random genetic variations. This is certainly appropriatefor many aspects of biologicalevolution. Social and ethic evolution, on the other hand, includeslearning mechanisms, innovations, and inventions of the individuals trying to adapt to the environment. Note, however, that the mechanism would play an essentialroleif we wanted to calculate precise the time scaleof the evolution. in the simple Let us examine in detail how the evolutionary process occurs, The of a single speciesin a medium of limited resources case (Allen, 1976). behavior of the reference system is describedby Eqs. A8.5) and A8.6). Now, supposethat by some \"accident\"one of the individuals born at a certain moment is different. Let X2 be the number of individuals of this new type, and supposethat after some time there is a sufficient number of X2 present to enable descriptionof their evolution by an equation such as [see Eq. A8.8)]:
^
1,
unity.
kX(NX2-pXi)-d2X2
A8.18)
X2 may have different values of k, N, and d and in addition may exploit different food resources. This is expressed /? by the factor /?, where 0 If P = X2 usesexactly the sameresources as X u while for /? = 0 they have no common resources. Partial overlap is expressed by /? between zero and
< < 1.
The new equationsfor the whole system are, instead of Eq. A8.5):
AV
\302\261
fcX^JV -
pX)
2
\342\200\224
dX
\342\200\224
dX7
dt
A.
pA
i)
(X2 A.
\\\\o.\\y)
mutant
appearsis:
= JV,
- jp
if
X5
=0
A8.20)
of the initial system to a small quantity of mutant is determinThe response to establishthe condition for a and can be calculated using Eq. A8.15) root of the characteristic equation evaluated around state A8.20),to have a positive real part. This is, then, the condition for growth and for an evoludeterministic
evolutionary
457
Figure
T8.2. Niche
occupied successively
by
of increasing species
effectiveness.
then the mutant grows to some finite value and occupies a \"niche\" in the system.What will happen to X{ ? Severalcases are possible. If the species is a mutant then the as same niche X2 occupyingexactly Xu /? = 1 and we find that X2 grows if
N2-^>Nt-^
\342\200\224
A8.22)
and completelyreplaces Xt; the total system movesto the stablesteady state = 0, X2 = N2 d2/k2,and X{ has become extinct. Successive mutations less than the prewithin the sameniche are rejected for values of N (d/k) one and is We that if N conclude, larger. preexisting replace type (d/k) therefore, that evolution leadsto the steadily growing exploitation of each increases. niche and that the population carriedby each band of resources Thus, evolution appearsas in Fig.18.2. evolution is that the species Another possible X2 may differ from Xx in its In the case of the exploitation of an entirely different choice of resources. niche /? = 0, and the condition for the growth of X2 is
X\302\260
\342\200\224 \342\200\224
JV,
-^
-
A8.23)
Thus,
N2
\342\200\224
if X2 is viable in this niche it grows to a steady population X2 = with X\\ = N{ {d2jk2)and coexists djkx.Again evolution leadsto
458
Ecosystems
a fuller exploitation of the medium. If we considerthe intermediate range when there is an overlap of resources, we find two cases. In addition to
if
we have
then
oneNx
final
initial
conditions
*,-\302\243
,18.26)
are fulfilled. Then X2 grows but coexists with Xt. The final state
is:
08.27)
X\302\2602
IN2
population
1/
;i
+ p)
> N,
a -~ ^
A8.28)
there is a certain plasticity of the \"genetic\" greater exploitation of the environment. This increasing effectivenessof the exploitation of each resource providesa basisfor understanding the notion of \" survival of the fittest\" familiar from Darwin'stheory. In particular, our arguments show that a definition of the \"fittest\" can only be obtained through a suitable analysis of the evolution
Summarizing, then, we find matter, it can only result
that if in the
the ecosystem. equationsdescribing Usingthe above ideasonecan also study the evolution of a predator-prey One finds that the prey evolves so as to exploit the (Allen, 1975). ecosystem available resources more efficiently and to avoid capture by the predator. The predator,on the other hand, evolyes so as to increasethe frequency of its death rate. The result of this \"arms race\" capture of prey and to decrease is that the ratio of the biomassof predator to prey increasesslowly with evolution.
18.5. Structural
Instabilities
and Increase
of Complexity:
Division
of Labor
459
As
\"
cooperative groups.Within these may evolvedivisionsof labor,hierarchical relationshipsand castes,mechanisms of population regulation, and even altruism. Here we are interested more specificallyin the division of labor and Allen, 1976). (Deneubourg We start from the basic equationsA8.8) and let X{ correspondto the number of ants in a colony i, whereas /?0- correspondsto the fraction of i and).We take, for simplicity, overlap of the territories exploited by colonies
JVj
the sources of has been briefly discussed at the beginning of Section \" in behavior. innovation are not exclusively genetic,but can referto changes In this sectionwe analyze one modeof evolution, namely, the formation of
18.4,
= N = const,
Pu
= Pfi,
Pu
= 1, and
< pu < 1
are of the sametype and that the Supposethat initially all ant colonies individuals that make up this type of colony are all identical. Then ptj = In the case of two colonies Eq. A8.8)would read: Pij
\342\200\224
1.
-\342\200\224-
dX, = kX{(N X,
dt
dX2
= kX2(N
trivial
- - - - X2) X2) Xl
dXx
dX2
A8.29)
Theseequationsadmit the
solution
X, = a 2 = 0
to the extinction of oneof the colonies a solution corresponding
X\302\260{
(lo.JUaj
= 0,
X%
N--;
K
Xi = 0,
X\302\260i
=N
- - A8.30b)
K
by
+A2 = iV
(lo.JUCJ
This latter solution is degenerate, and this is translated by the fact that a linearized stability analysis around this state showsmarginal stability. In other words,in the competition describedby Eq. A8.29) the \"winner\" can be either X! or X2,depending on the initial state of the system.
460
Ecosystems
Supposenow that one of the two colonies, say X2, has \"invented\" the of identical individuals, it now division of labor.Insteadof being composed for the growth of the comprisesof: (a) \"Workers,\" Y, who are responsible Z, whose only role is to aggress colony and (b)\"soldiers,\" colony X t (hereafter a mechanism denotedby X). We assumethat the colony has also developed of Z and Y. for regulating the relative populations We want to seeunder what conditionsthe division of labor is imposed This problemis viewedhere as a problemof competition on the ecosystem. of evolution between colonies (X) and (Y + Z) or,alternatively, as a problem of two identical colonies (X), (Y) under the influence of small structural fluctuations (Z). The equationsbecome:
A *V
\342\200\224
at at
= kX(N
kY(N
^=
morphologically
- - - - dX-pXZ - - - Z)-dYX
Y
Z)
F(Y, Z)
= F(Y,Z)-dZ ~r at
'
A8.31)
where pXZ is the aggression to be morphologicterm; X and Y are assumed identical and are thus given the samevalues of k and d\\ finally,F(Y, Z) is the regulation function that is represented by a Verhulst-like form [see
Eq.A8.5)]:
F(Y,Z) = a}YZ-a2Z2
\342\200\224
A8.32)
properties
d > 0 the trivial One can establish straightforwardly that for kN solution Xo = Yo = Zo = 0 of Eq. A8.31)and the nonzero solution Xo Y0Z0 jL 0 are both unstable.Thus, we are interested solely in the propof the state A8.33a) Xo #0, Yo # 0, Zo = 0
or of the state
Xo
= 0,
Yo^0,
Zo#0
A8.33b)
As regardsthe first state, we already pointed out [see discussion following Eq.A8.29)]that for fluctuations in the (X, Y) plane oneobtains a property of marginal stability. In order to study the effectof structural fluctuationsof Z, it sufficesto apply the criterion, Eq. A8.15), for /= 1:
-k -?)\\ >0
A8.34)
18.5. Structural Instabilities and Increase of Complexity: Division of Labor 461 as well as expression or,introducing the last equation A8.31) A8.32)for F:
alYo-d>0
Now, from Eq. A8.30c)we know
that
A8.35)
with kx Substituting
ky
into
- (^+ l)d> 0
A8.36)
The conclusionto be drawn from this relation is that the spread of the structural fluctuation engendering division of labor is favored by N large, that is, by the wealth of the environment It is also favored by o^ exploited. that a the is, by regulation enhancing large, population of Z values within the colony, oncethey appearthrough a structural fluctuation. The propertiesof the steady state A8.33b)can bestudiedfollowing exactly the sameprocedure. This time, the colony (Y + Z) is assumedto have been established,and we are looking for its responseto the appearanceof a for the first (X). Working out condition A8.15) colony of nonspecialists one finds and A8.31) equation (Deneubourg Allen, 1976):
k(N
- - - - pZ0 > 0
Yo
Zo)
A8.37)
This condition is not satisfied if p or Yo + Zo are appreciable.In other it will not words, if the differentiated colony is wealthy and aggressive, of X. X it Even if can build up, however, can only permit the development to state lead the system A8.33a): colony (Y + Z) is not eliminated from the it modifies its structure to better adapt to the external conmilieu. Rather,
conditions.
seemto confirm the connumber of observations (Wilson, 1971, 1975) thoseconcerning reachedfrom the analysis of the model,especially the dimensions of the colony.Thus, it appears that polymorphism in ant than in tropical living in temperate climates is much lesspronounced species where is mean of a the dimension Similarly, in large colony larger. regions bee colonies the degree of polyethism of workers is highly developed. the morphological differencebetween \"queen,\" Finally, in small beecolonies and \"workers\" is lesspronouncedthan in large ones.
A
conclusions
462
Ecosystems
COMPLEXITY
have seenthat evolution toward increasingcomplexityand organization or innovations\342\200\224that can fluctuations\342\200\224mutations appear suddenly in a previouslystablesystem and drive it subsequently to a new regime. Obviously, there is no limit to the type of fluctuation that may and no ecological be considered, equationscan be claimedto be structurally stable to all possibleinnovations. It can, therefore, be legitimately asked whether there is a limit to complexity.The very existence of complex systems or a modern society illustrate well the such as a tropical forest (May, 1973) needfor answering such a question. In this sectionwe want to stressthat a complex system is subjectto two On the oneside,the more complex adverse tendencies. the is, the more variables there are in interaction\342\200\224the higher the degree of the characteristic equation [see Eq.A8.15)] determining its stability, the greater the chancesthere are, therefore, of having at least one positive root and hence instability of the referencestate (May, 1973). On the other hand, the argument basedon the characteristic equation is valid only after the fluctuation has occurredand extended up to the macroview of the stability versus Therefore, to have a more complete range. complexity problem,we must specify:
is the result of structural
system\342\200\224that macroscopic
(i) (ii)
fluctuation
in
a complex
system.
The probability that amplitude and range.
be tackled Both problemsbelongto stochastic theory and can, in principle, the The study of in Chapters 11 and 12. simple by the methodsdeveloped in thesechaptershas shown that the evolution chemical modelsconsidered of a fluctuation dependson the competition between growth and damping diffusion or, more generally, through surface effects. The latter, through are which in the nonlinear master equation formulation of Chapter 12 a of between describedby the coefficient3),measurethe degree coupling the system and its surroundings and are stronger the more complex system. the tendency to damp the fluctuations is accentuated.In Consequently, other words,steps (i) and (ii) referring to the purely stochasticstage of in that they require evolution are more difficult to realize in complex systems critical the nucleation of fluctuations exceeding some range (Prigogine, Nicolis,Herman, and Lam, 1975).
18.6. Stability
and Complexity
463
that a sufficiently Therefore, we reach the conclusion complexsystem is generally in a metastable state.The value of the threshold for metastability depends,in a complicatedfashion, on the system'sparameters and the The question of the stability of complexsystems external conditions. seems, therefore, to have a lessclearcut answer than thoseconsidered up to present. Obviously, it would be interesting to come up with quantitative measureof the factors that determine the growth of instabilities in ecosystems or It seemsfascinating to us that these difficult questionscan be societies. even approximately by means of mathematical modeling. considered
measurements
and Perspectives
ConcludingRemarks
1. INTRODUCTION
In this final chapter we want to reviewa few problemsof basicinterest that are still in an exploratory phase.This may give us an indication about the direction in which the methods studied in this monograph may find new applicationsin the near future. Section2 is devoted to the mathematical aspectsof self-organization.In Section2 we review someaspectsof fluctuaIn Section3 we theory when appliedto chain reactionsand explosions. In Section4 we review somerecent work on neural and immune networks. discussin somedetail a most interesting model of the immune surveillance This involves a transition from what can be appropriately against cancer. called microcancer to macrocancer.The Garay-Lefevermodel uses many of the tools describedin this monograph, such as a study of ecological and the theory here to the growth of cancer cells) equationsin Part V (applied of multiple steady-state transitions including fluctuations as discussedin It seems analogy facinating to observethat there may exista close Chapter12. of diseases and nonequilibrium transitions, in contrast between someclasses with the classicalteachings of Bernard,where one always considers diseaseas a continuous perturbation of the normal state (Cl. Bernard,
fluctuation
Cl.
and epistemoWe close this chapter with a few remarkson the sociological of our approach. logical consequences
1855,1856).
2. FLUCTUATION CHEMISTRY
One of the principal pointsof focus of the presentmonograph has been the is dictated by the behavior ideathat the onsetof a self-organizationprocess of the fluctuations. The main reason is that a self-organizingsystem is
464
2.
Fluctuation
Chemistry
**-
necessarilyundergoing instabilities, and hence is capable of amplifying certain disturbances including someof its own fluctuations. Despitethe generality of feedback phenomena giving rise to instabilities
and, subsequently,to dissipativestructures,onecan still argue that in everyday not the rule.In this laboratory chemistry self-organizationis the exception, sectionwe want to suggest that chain reactions,of the utmost importance in are likely to be influencedby fluctuations. We develop our chemicalkinetics, arguments primarily for explosivereactions. and assumethat thermal Let us first considera chain-branching explosion the simplest such As well known (Dainton, 1966) effectscan be neglected. can be decomposedinto an initiation step, producinga certain process population of free radicalsX, a chain-branching step leading to an (autocatalytic) amplification of this population, and a recombination and/or termination step,where the free radicalsare inactivated. Schematically
I{X)
>
initiation
2X
chain branching
P + M termination
X A, in
recombination
A)
P, M, are concentrations of precursorsand of final productssupposedly and are hencetaken to be constant. excess
The rate equation for X is
_ = I(X) + - T)X at (B
RX2
B)
where we set
= k2A T=k3AM R = kA
B
Ca)
term I(X)is, (in the absenceof external stimulus,) determined an equilibrium reaction and is hencea small contribution, especially when the concentration of X beginsto attain appreciable values. Fora first-order initiation for I(X)would reaction, a typical expression
The initiation
by
Cb) l(X) = Io XX Therefore,onecan easilyverify that Eq.B)admits a singlepositivesteady-state solution that remains asymptoticallystablefor all nonvanishing valuesof the
be:
466
the value B T, the steady-state parameters.As B increasesand crosses concentration Xo of X increasessharply, although it remains continuous.
~T
D)
defines the explosionlimit. Supposenow onestarts initially with a small population of free radicals. level Xo is reached,an induction time x is necessary. Before the steady-state of X for t <f t, the instantaneous values of Now, becauseof the smallness within various small volumes AVt is likely to be quite different composition from the (macroscopic) value X determined by solving Eq.B).In other words, the fluctuations ofcomposition to play a role, such as by modifying are expected the induction time necessary for explosion. This ideais alsosupportedby the observation that in the limit / -> 0 Eq. B) doesgive rise to an instability, leading to a transition between two steady-state levels Xol = 0 and Xo2 = (B T)/R. This transition, reminiscent of the problemstreated in Section has been analyzed by McNeiland Walls A974) in a somewhat different 12.6, context. They found that in the vicinity of B = T fluctuations are indeed for / finite and small one can expectsomeof theseresults important. Hence, to still apply. Further work is necessary to substantiate theseideas and to extend the to more realistic investigations explosionmodels.The inclusion of thermal effectsis certainly necessary. In the framework of a macroscopic treatment, Gray (seeGray, 1974for a recent survey) has workedout simplemodels for such thermal explosions which, typically, give riseto transitions between states. As in this stressed and 12, multiple steady repeatedly in Chapters11 case fluctuations are certainly of the utmost importance and, in fact, dictate the conditionsfor the stability or metastability of the various branches. the possibility of a spontaneous transition between This, in turn, determines
\342\200\224
different
states.
3. NEURAL
We
of coupledcellsmay give riseto \"coherentbehave seenthat populations These phenomena behavior,\" extending beyond the level of the single cell. exertedin the coordination reflect the numerous regulatory and processes \"network with the behavior\" this reasonthey are associated system,and for encountered in situations This is the of the system. to be contrasted with in in or molecular where traditional problems physical chemistry biology, small-and large-scale phenomena are linked in a simple manner. In this sectionwe want to comment briefly on two further instances where
3.
467
the network behavior of the system seemsto play a prominent role, namely, the activity of the central nervous system and the immune response.
Activity
of Central NervousSystem
Throughout this monograph we have seenthat the dynamics of a spatially distributed systemmay give riseto oscillations, traveling waves,and stationary structures.Now, rythmic activity has long been known to be a ubiquitous feature of the brain. The patterns of activity associatedwith EEG provide the best-known illustration. Moreover, it has been shown (Freeman, 1968) that the mammalian brain may respond to external excitations by either it is tempting to undertake a damped or sustainedoscillations.Hence, nets on of neural based the same kind of considerations as those modeling the of structure. underlying concept dissipative Wilson and Cowan (seeWilson, 1974for a recent survey) and Freeman for a recent survey) developed (seeFreeman, 1975 elegant modelsof neural based on the of a for the input-output use dynamics sigmoidal expression of a group of neurons, This procedureis justified as a necessary function of a statistical distribution of thresholdsamong individual consequence neurons.A limit-cycle solution generated by modelsof this type has been implicated in the handling of information in the olfactory bulb (Freeman, On the other hand, multiple stead-statesolutions have been invoked 1975). to simulate experiments in binocular vision. of hysteresis (Wilson, 1974) A different type of model has been developed by Kaczmarek A976) that considers explicitlythe patterns of activity oisingle neurons.Functions such as frequency of firing vs membrane potential and the ionic equilibrium potentials of the neuronal membranes are incorporatedinto the theory. In addition to \"normal\" patterns of activity, the model gives rise to cell firing patterns and membrane potential variations similar to thoseobserved of epileptic seizures also Kaczmarekand Babloy(see during the progression
antz,
Mostof the work carriedout so far in the modelingof the nervous systemis for example, with the concerned with the electrical activity of neural masses, rates of firing of populationsof excitatory and inhibitory neurons.Despite its intuitive appeal,this approachis not particularly convenientfor analyzing
the effectsof external (e.g., electric)fieldson the brain. Recently, Nazarea A977) developeda complementary approach to this latter problem. Instead of regarding the brain as an electrical network mediated by chemical neurotransmitters and the various ions presentin the neural membranes\342\200\224he focuseson the spatiotemporal properof the chemical effectors themselves. As most of these are charged the chemicalrates couplewith the electric field in a straightforward species,
effectors\342\200\224the
properties
1977).
of theoretical interpretation of such phecreates the possibility as the direct-current polarization of the cerebral cortex or the is changed. asymmetricfrequency shift when the polarity of the electrodes Needlessto say, numerous challenging problemsremain unresolved in this field. Among these,the study of modelssimulating the geometry of the neural array, its size, the boundary conditions,and the influence of apappropriate sensoryinputs during development on the neural configurations is of specialinterest. The Immune Response
A living organism has the ability to defend himself against the invasion of such as tissuesor microorganisms, foreign substances among others,which
\"Foreign\"
stimulus
Antigen
set
Epitope
Unspedific
parallel
Buffering
set
Figure globulin
sets
system contains a set /)( of combining sites (paratopes) on immunomolecules and on cellreceptors that recognize a given epitope (E) of an antigen. This recognizing set includes the potentially responding lymphocytes. The molecules of set p, also display a set i2 of idiotopes. Apart from recognizing the foreign epitope, the set />, likewise recognizes a set i2 of idiotopes which thus constitutes, within the immune system, a kind of internal image of the foreign epitope. This set i2 occurs in molecular association with a set p2 of paratopes. Likewise, the set i, is recognized, within the immune system, by a set p2 of paratopes that represent antiidiotypic antibodies. Besidethe recognizing set pli1, there is a parallel set of immunoglobulins and cellreceptors that display idiotopes of th set it in molecular association with combining sites that do not fit the foreign epitope. As a first approximation, the arrows indicate a stimulatory effect when idiotopes are recognized by paratopes on cell receptors and a suppressive effect when paratopes recognize idiotopes on cell receptors. Successive groups of ever larger sets encompass the entire network of the immune system (after Jerne, 1974).
1. The immune
pj,
4.
Immune Surveillance
Against
Cancer
469
are usually referred to as antigens. This is achieved by the immune system, is constituted by specialized the lymphocytes(which can undergo cells, of and many stages differentiation), produced by them. by the molecules these the an antibodies essential role, becauseof their ability Among play to combine with the antigens. This property is related to the particular structure of the antibodies,which dispose of specific binding paratopes\342\200\224recognizing specific types of antigens. On the other hand, antibodieshave sites presenting antigenic are hence susceptible of binding with the paratopesof other antibodies. Thisdual roleof antibodies, together with their very pronounced variability, led JerneA973, 1974) to postulate the existence of an immune network (see Fig.1) consideredresponsiblefor the observedbehavior of the immune system.In other words,the claim is that such phenomena as the immune the memory, the tolerance, and the immune surveillanceconstitute response, not the random superposition of events as the molecular level but, rather, reflect the collective behavior of large assemblies of coupledlymphocytes
which
sites\342\200\224the properties\342\200\224the idiotopes\342\200\224and
to substantiate theseideashave beendeveloped Elegant modelsdesigned Richter and Hoffman A975) by A975) in the context of the immune by The of immune networkshas recentlybeen analyzed response. stability simple Hiernaux A977). by It is the presentauthors'opinion that the modelingof immune networks will be an increasingly important subject of theoretical biology in the next
few
years.
IMMUNE SURVEILLANCE AGAINST CANCER
4.
The functioning of the immune system is also closelyrelated to certain a pathological states of living organisms,among which canceroccupies
unique
position. Our present understanding of the cancerproblem suggeststhat the cancerous transformation of a normal tissuecouldbe describedas follows for recent surveys): (seeCairns,1975and Calvin, 1975
normal tissuesthe pattern of supercellular organization is determined by a complex interplay between short- and long-range interactions between the cells. the mechanism Theseinteractions control, among other processes,
(i) In
disturbancein
this
mutations) or due to the action of environmentalfactors (pyhsical,chemical, or biological), couldyield cellswith an abnormal pattern of proteinscoded. thesecellsmay exhibit a different capacity of responseto the Subsequently, In the case of the malignant transformation, the interactions with normal cells. cellsare characterized by a high proliferativeadvantage, (iv) The normal mechanismsof defenseof the organism tend to destroythe abnormal cellsor to slowdown their rate of proliferation. It seemsthat one of the most important mechanismsof defenseinvolves the immune system. The immune cellsrecognizethe abnormal proteinsand destroythe cellsthat bear them. This means that the immune system exertssomesort of \"surveilon the very small population of transformed cells (\"microcancer
\"surveillance\"
population\.
The exact nature and propertiesof the processes mentioned in points is still because these (i)-(iii) largelyhypothetical,mainly processes correspond to molecular changestaking place at the level of the single cell. On the contrary, in respectto point (iv), even if the underlying molecular events are not known in detail, at least there existsexcellent data on the kineticsof tumoral growth and on the competition of this process with the immune surveillance.The purposeof the pesentsection is to show that this informacan beusedto formulate a mathematical modelfor the phenomenon of which may elucidate somevery general immune surveillanceagainst cancer, The model is based on the physicochemical aspects of carcinogenesis. with present-day following minimum set of data, all of which are compatible ideason the cancer problem. There existsa \"source\" Its intensity depends producingmalignant cells. strongly on environmental factors and is usually very small (in fact, hardly in normal tissues. There existsin the organism a population of detectable) and Hellstrom, cytotoxic cells(Hellstrom 1974), generallyformed by different cellular species, which are capableof recognizing and destroying the cancancerous cells. This impliesthat, in addition to the free cytotoxic cells, there also exist configurations where cancerous cellsare bound to the cytotoxic cell surface. Subsequently, cytotoxic cellslike T lymphocytesmay emit chemical signals called lymphokines, which further enhance the cytotoxic activity. it appearsthat lymphokines inhibit the diffusion of macrophages Moreover, and other cellular species. In other words, the motility of the cytotoxic cellsis reducedin the regionswhere malignant cellsare present. One may now construct a \"minimal\" model compatiblewith thesedata. Let AV be the volume of the tissue,B and X the density of normal and malignant cells therein, and Mo and M, the density of free and bound can be represented The interaction betweencellular species by cytotoxic cells.
information
4.
Immune Surveillance
Against
Cancer
the following
scheme:
B
Mo
\342\200\224g\342\200\224
M,
\342\200\224^
Mo +
E)
Here P standsfor the productsof degradationof X. The spontaneous conof B to X (in fact, B = N X, N being the total density of cells)is assumedto occurat a fixed rate a. Finally, the kinetic constants kx, k2
conversion
binding
of a uniform distribution of cytotoxic cells. Considerfirst the case Scheme then rise the to E) gives following kinetic equations(Garay and Lefever, Lefeverand Garay, 1977): 1977;
i
at
dt
(N
F)
G)
= -kxM0X+ k2Ml
XX addedto a accounts for cellular multiplication. EquationsF)-(8)have been solved using numerical values for N, a, X, ki, and k2, drawn from experimental data. The main result is that the system presents a transition between two simultaneously stable steady to a low value of X, which couldbe appropriately states,one corresponding referred to as a \"microcancer,\" and one where X is high and which correMoreover,one showsthat the transition therefore, to a \"cancer.\" corresponds, region is a region of metastability rather than of completestability of the microcancer state.This impliesthat there existsa critical \"nucleus,\" that is,a critical microtumor size that must be reachedbefore malignant growth can develop.This can happen either as the result of a spontaneousstatistical fluctuation or by an external agent (in much the same way as a seedprovokes of crystallization in a supercooled liquid). Experiment confirms the existence
Garay, 1977). The above considerations stressthe importance of stochasticelements in canceronset. This has been repeatedly recognizedin the literature (e.g., of Huebneret al.,1970) and can be attributed to the fact that the emergence
that
in
Garay and Lefever carriedout an extensive stochasticanalysis of model in Chapters 10 This analysis, and 12. E)basedon the considerations developed has provided which alsotakesinto account the mobility of the cytotoxic cells, for such as the width of estimates the metastable quantities quantitative of N the critical value volume element and (or AV) beyond which region The main point to be retained from this short account is that a theoretical descriptionof canceronset is possibleand that such a descriptionhas to incorporateexplicitly the usually neglectedeffectsof fluctuations. Similar ideasare likely to apply to a host of other problemsinvolving the developof pathological behavior in living organisms. As mentioned in Section1, a striking idea suggested these theoretical by developments is that pathobehavior is not a mere quantitative modificationof normal behavior Rather, it is separatedfrom the latter by a dis(Cl.Bernard,1855, 1856). discontinuity that can be bridgedonly if the system's parametersand the initial
development
malignant
growth
becomes possible.
pathological
conditionssatisfy someappropriaterelations.
5.
The various problems and applications discussed in this monograph illustrate the central importance of the problemsof self-organization. One of the of various levels of description. striking features emerging is the existence We observe around us a great variety of behavior. Onecouldeven state that we observe a basicdichotomy; on one sidewehave the basiclawsof classical and quantum dynamics, and on the other we have natural phenomena that may well be represented by \"games,\" in the terminology of Eigen and Winkler A975). Moreover, in a given system we may observevarious levels of beWe now begin to seehow we can switch from one type of description behavior. to another. As is well known, all interactions of interest, notably in biological
media, are of short range (e.g., valency and van der Waals's interactions). These interactions lead to the formation of \"conservative\"structures and determine also the values of characteristic rate and diffusion constants. Yet the theory of dissipative structures showsthat under someconditions (involving among others a sufficient distancefrom equilibrium) the equadescribingthe chemical kinetics together with diffusion may lead The coherence to a new long-rangeorder. introducedby dissipativestructures is always characterized, several times, by a supermolecular as emphasized in which scale that leads to a modification of the \"space-time structure\" the moleculesare embedded.Similarly, the equations of ecologystudied
equations
5. SocialSystems and
Epistemological Aspects
473
in Part V contain parametersthat may well be determined by the genetic material. Yet the statesdescribed refer to a \"supergenetic\" by theseequations between the structures and aspectof evolution. Again we obtain a feedback the units that form the system and the evolution of the system as a whole. and specially It is, of course, very tempting to apply these considerations structural stability theory to problemsof sociocultural evolution. The main difficulty is to determine the relevant variables. In somecases, such as problemsconcerning vehicular traffic flow, this is relatively simple In other problems, however,oneneedsto in(Prigogine and Herman, 1971). introduce such elusive variables as \"quality of life\" which are much more difficult to handle in a quantitative manner. Let us indicate briefly two inter-
The first refersto the progressive area. It is urbanization of a geographical in the or decrease generally acceptedthat, long run, local populationsgrow to employment opportunities, which in turn dependon the market according available for goods and services.This introduces a nonlinear feedback mechanism in the growth of population density corresponding to the so-
interesting
examples.
called\"urban multiplier.\" and Sanglier,1977) This problemwas recentlystudied(Allen, Deneubourg, a The from like carrying capacity of any starting logisticequation Eq. A8.5). beincreased if it is the of economic functions (e.g., can seat particular locality The model studiesthe the point of productionof some goods or services). innovations on an initially homogeneous population. impact of successive
various economic functions are launched, the nonlinear interaction mechanisms between population density and employment opportunities result in the formation of spatial structures, and an urban hierarchy evolves. into play. Oncemore, both stochasticand deterministic elements come We have a random element in the time and location of lauching of economic functions, whereas their survival and growth is governed by the deterministic constraints of the available market. economic Similar methodshave been appliedto the analysis of the remarkable social In this organization of the Katchin tribesof highland Burma (Leach,1961). society we find two forms of organization and a well-definedmechanism of that leads from one to another. Moreover,the mechanism of instability is related to the rules of parental relations studiedby L6vi-Strauss instability A958).In a sense,theserules play, in this anthropological context, the same roleas the catalytic reactionsin biochemical cycles. In the mathematical model of the organization change (Deneubourg and a stochastic element is introducedto simulate the diversity of Pahaut, 1977), human behavior. At each moment the structural stability of the deterministic model describing the \" average\" behavior is testedby injecting fluctuations, which eventually trigger the transition between the two forms of social organization.
When
474
It is worthwhile to notice with Leachthat \"changeis no longer something isdone to us by nature but something we can choose to do to and to ourselves.\" in o ne of the this major objectives of Clearly, perspective The methodsdescribed science is to elucidate the dynamics of change. in this
that
nature\342\200\224
monograph might be one step in this direction. much work remains to be done, it already clearly appearsthat Although (Jantsch, 1975) self-organizationisan emergingparadigm of science emphasizat many levels, in which nonlinear coordination processes macroscopic and nonequilibrium conditionsplay a significant role.* processes
emphasizing
one
of the
authors
(I. Prigogine)
and
I.Stengers.
in
a forthcoming
References
M. Abramowitz and
York.
Functions,
Dover, New
P. Allen A975), Bull. Math. Biol. 37, 389. Nat. Acad. Sci. 73, 665. (U.S.A.) A976), Proc. , J. L. Deneubourg and M. Sanglier A977), to be published. N. R. Amundson A974). In Proc.SIAM-AMS Symp. Vol. VIII,
American Mathematical Society, Providence, Rhode Island. A. A. Andronov, A. A. Vit, and C.E. Khaikin A966). Theory of Oscillators, Pergamon, Oxford. L.Arnold A973). Stochastische Differential-gleichungen, Oldenbourg, Miinchen. D. E. Atkinson A965), Science 150,851. A968), Biochem. 7, 4030. and G. Nicolis A975), Bull. Math. Biol. 37, 323. Bull. Math. Biol. 38,325. A976a), A976b), to be published. A972), Biopolymers
J.F. G.Auchmuty
A. Babloyantz
A977), J.Theor. Biology, submitted. and G. Nicolis A972), J.Theor. Biol. 34, 185.
and
2349. 11,
\342\226\240
J.
Nat. Acad. Sci. 71, 1530. (U.S.A.) A974), Proc. A975), Math. Biol. 37, 637. R. W. Baldwin A976), Transpl. Rev. 28,62. R. Balescu A963). Statistical Mechanics of Charged Particles, Wiley-Interscience, New York. Bard and Theor. Biol. 45,501. Lauder A974), A. T. Barucha-Reid A960), Elements of the Theory of Markov Processes and their Applications, McGraw-Hill, New York. L. Bauer, H. B. Keller, and E. L. Reiss A975), SIAM Review 17,
and
J.Hiernaux
I.
J.
101.
Nature
235,15.
E. F. Beckenbach and R. Bellman A965), Inequalities, Springer-Verlag, Berlin. J. R. Beckwith and D.Zipser A970), The lac operon. ColdSpring Harbor Laboratory. B.B. Belousov A958), Sb.Ref. Radiats. Med., Moscow. S.Berking A974), Ph.D. dissertation, University of Tubingen.
L.V. Berkner and L.C.Marshall A964). Discuss. Faraday Soc. 37, 122. Cl.Bernard A855-56). de Physiologie Experimental Appliquee a la Lecons
Medecine, Bailliere. Paris, J.-B. S.A. Bernhard A968). The Structure and Function of Enzymes, Benjamin, New York. L.von Bertalanffy A932), Theoretische Biologie, Vol. I, Borntraeger, Berlin.
2 vol.,
475
476
A. Betz and E. E. Sel'kov A969), FEBS Lett. 3, 5. A. Bierman A954), Bull. Math. Biophys. 16,203. D. Blangy, H. Buc, and Monod A968), Mol. Biol. 31,13. R. Blumenthal A975), Theor. Biol. 49,219. , J.-P.Changeux, and R. Lefever A970), Membrane Biol. 2, 371.
References
J. J.
J.
of Technology. SIAM Math. D. S.Cohen A976), 30, 123. Appl. A. Boiteux, A. Goldbeter, and B.HessA975), Proc.Nat. Acad. Sci. 72, 3829. (U.S.A.) J. T. Bonner A974), On Development, Harvard Cambridge. S. Bonotto, P. Lurquin, L. Baugnet-Mahieu, R. Contier, R. Kirchmann, and R. Maisin A972), Biology and Radiobiology of Anucleate Systems, Vol. 2,239,Academic, New York. Brachet A964), Adv. Morph. 3, 247.
California Institute and
J.
J.
UP.,
J.
J.
A974), Introduction a V Embryologie Moleculaire, Masson, Paris. 493. A975) in Biochemische Pflanzen Physiologie 168, W. C.Bray A921), Amer. Chem.Soc. 43, 1262. T. S.Briggs and W. C.Rauscher A973), Chem.Educ. 50,496. R. J. Britten and E. H. Davidson A969), Science 165,349. E. Broda A975), The Evolution of the Bioenergetic Processes, Pergamon, Oxford. G. Broun, D.Thomas, and E. Selegny A972), Membrane Biol. 8, 373. R. Brout A965), Phase Transitions, Benjamin, New York. D.D. Bruns, S.Bailey and D. Luss A973), Biotechnology and Bioeng. 15, H. G. Busse A969), Phys. Chem.73, 750. J. Cairns A975), Sci.Amer. 233,64. H. B. Callen A960), Thermodynamics, Wiley, New York. Thermodynamics, Variational Techniques and Stability, A965) in Nonequilibrium
J.
J.
J.
J.
J.
1131.
M. Calvin A975), Naturwiss. 62,405. S.R. Caplan, A. Naparstek, and N. J. Zabusky A973), C.Carnaud and R. Garay A977), to be published.
Chicago UP.
Nature
245,364.
S.Chapman
and T.G. Cowling, The Mathematical Gases, Theory of Non-uniform Cambridge U.P. in D. C. Cherniavskii, L. N. Grigorov, and M. G. Poliakova A967), Oscillatory Processes
E. A. Coddington
and N. LevinsonA955), Theory of Ordinary Differential Equations, McGrawProblems in the Physical and Sciences
Biology, Springer-Verlag,
D. Cohen A972),
Berlin.
M. Cohn and K. Horibata A959), J.Bacteriol. 78, 601. J. Cooke A975), Nature 254,196. D. Courant and D. Hilbert A962), Methods of Mathematical
London.
Physics, Wiley-Interscience,
References
^7_
F. Crick A970), Nature 225,420. F. W. Cummings A975), J. Theor. Biol. 55,455. R. L.Czaplewski A973), J.Theor. Biol. 40,429. F. S.Dainton A966), Chain reactions, Methuen Monographs London, New York. M. Darmon, P. Brachet.and L.H. Perira da SilvaA975), Proc.Nat. Acad. Sci.{U.S.A.O2,l\\61 E. H. Davidson and R. J.Britten A973), The Quart. Rev. Biol. 48, 565. H. T. Davis A962), Introduction to Nonlinear Differential and Integral Equations, Dover, New
York.
Th. DeDonder A936), VAffinite, Gauthier-Villars, Ch.de Duve A974), in Connaissance Scientifique et S.DeGroot and P. Mazur A962), Non Equilibrium
Amsterdam.
J.
Theor. Biol. 54,323. A975), R. Defay A929), Bull. Acad. Roy. Belg. Cl. Sci. 15,1. H. Degn A968), Nature 217,1047. P.de Kepper, A. Pacault, and A. Rossi A976), C.R. Acad. Sci.Ser.C 282,199. P. Dekker and A. Speidel A972), Zeits. Naturf. 276, 257. M. Delmotte A975), These d'Etat esSciences, Universite Paris VII. and Chanu A971), Electr. Ada 16,623. L. Deneubourg A976), Insectes Sociaux 23,329. Acad. Roy. Belg., in press. and P. Allen A976), Bull. Cl. Sci. and S.Pahaut A977), to be published. M. C.Duban, J. P. Kernevez, and D.Thomas A976), preprint, University of Compiegne. W. Ebeling A976), Strukturbildung bei lrreversiblen Prozessen, Teubner Verlagsgesellschaft. B. Edelstein A970), Theor. Biol. 29,57. Theor. Biol. 37, 221. A972),
L.de Sobrino
J.
J.
J.
J.
170. 11,
DasSpiel, Piper,
Miichen.
A910), Ann.
Phys.
33, 1275.
Bateman
1, McGraw-
A956), Asymptotic Expansions, Dover, New York. University of Brussels. and M. Herschkowitz-Kaufman A975), Biophys. Chem.3, 345. , Hiernaux and G. Nicolis, Bull. Math. Biology, submitted.
J.
B.C. Eu A974),
W. Feller A957),
York.
J.Chem.Phys.
An Introduction
63, 303.
to Probability Theory and its Applications, Vol.
I, Wiley,
New
R. Field A975), Chem.Phys. 63,2289. R. J. Field and R. M. Noyes A974). Chem. Phys. 60, 1877. P. Fife A972), in Nonlinear Problems in the Physical Sciences and Biology, Springer-Verlag,
J.
J.
Berlin.
478
References A976),
P. Fife
J.Chem.Phys.
64, 554.
Evolution and the Origin
A971), Chemical
of Life,
North Holland,
J. S.Frame A974), J.Theor. Biol. 43, 73. M. Franckson A975), Memoire de Licence, Universite
Libre
de Bruxelles.
New York.
W. J.Freeman A968), J.Neurophysiol. 31,337. A975), Mass Action in the Nervous System, Academic,
A977), to be published. and R. Lefever A977), to be published. C.W. Gardiner, K. McNeil, D.F. Walls, and D. Garrod A974), Arch. Biol. 85,7.
R. Garay R. Garay
J.
I.S.Matheson
A976),
J.Stat.
Phys.
14,309.
G.R. Gavalas
A968), Nonlinear Differential Equations ofChemically Reacting Systems, SpringerVerlag, Berlin. G.P. Georgiev, Theor. Biol. 25,473. G. Gerisch A968), Curr. Top. Devel. Biol. 3, 157. and B.HessA974), Proc. Nat. Acad. Sci. 71, (U.S.A.) and U. Wick A975), Biochem. Biophys. Res.Commun. 65,364. D. Malchow, A. Huesgen, V. Nanjundiah, W. Roos,and U. Wick A975) in Proc.1975ICNUCLA Symp. Dev. Biol., D. MacMahon and C. F. Fox (eds.), Benjamin, Menlo Park, California. A. Gierer and H. Meinhardt A972), Kybernet. 12,30. Math. Life Sci. 7, 163. A974) in Led. P. Glansdorff and Prigogine A954), Physica 20,773. A971), Thermodynamics of Structure, Stability, and Fluctuations, Wiley-Interscience, New York.
J.
2118.
I.
P. Glansdorff, G. Nicolis, and I.Prigogine A974), Proc. Nat. Acad. Sci. 71, 197. (U.S.A.) L.GlassA975), J.Chem.Phys. 63, 1325. and S.A. Kauffman A973), J. Theor. Biol. 39, 103. J. I. Gmitro and L.E. Scriven A966), in lntracellular Transport, K. B.Warren (ed), Academic,
New York. S.C. Maitra, and E. W. Montroll, Rev. Mod. Phys. N. S.Goel, A. Goldbeter A973), Proc. Nat. Acad. Sci. 70, 3255. (U.S.A.) A974), FEBS Lett. 43,327.
43,241.
A975), Nature 253,5492. A976), to be published. and R. Caplan A976), Ann. Rev. Biophys. Bioeng. 5, 449. and R. Lefever A972), Biophys. 12,1302. and G. Nicolis A972), Biophysik 8, 212. and G. Nicolis A976), Progr. Theor. Biol.,Vol. 4, p. 65.Academic, New York. and L.Segel A977), Proc. Nat. Acad. Sci. in press. (U.S.A.), B. Goodwin A969), Europ. Biochem. 10,515.
J.
J.
A975), Adv. Chem. Phys. 29,269. and M. H. Cohen A969), Theor. Biol. 25,49. R. Graham and H. Haken A971), Z. Physik 243,289.
J.
References
479
Society, London.
J.Chem.Phys.
61,2081.
I.
P. Hanusse A972), C.R. Acad. Sci.Ser.C 274, 1245. A973), C.R. Acad. Sci.Ser.C 277, 263. A976), Doctorat esSciences, University of Bordeaux S.P. Hastings and J. D. Murray A975), SIAMJ. Appl. Math. 28,678 A975). F. G. Heineken, H. M. Tsuchiya, and R. Aris A967), Math. Biosci.1, 95. Hellstrom and K. E. Hellstrom A974), Adv. Immunol. 18,209.
I.
M. Herschkowitz-Kaufman A970),
Dissertation, University of Brussels. A973), Ph.D. Bull. Math. Biol. 37, 585. A975), and J. Platten A971), Bull. Acad. Roy. Belg. Cl. Sci. 57, 26. and G. Nicolis A972), Chem.Phys. 56, 1890. B. HessA963), in Funktionelle und Morphologische Organisation der Zelle, Springer-Verlag,
J.
Berlin.
A975), Europ. Immunol. 5, 638. A942), Ber. Math. Phys. Akad. Wiss. Leipzig, XCIV, p. W. Horsthemke and M. Malek-Mansour A976), Z. Physik. B24, 307. W. Horsthemke, M. Malek-Mansour and B. Hayez A977), Stat. Phys. 16,201 L. Howard A974), in SIAM-AMS Symp. Appl. Math., Vol. VIII, American Mathematical Society, Providence, Rhode Island. R. Heubner et al. A970), Proc. Nat. Acad. Sci.U.S.A.67, 366. K. Ishida and S.Matsumoto A975), Theor. Biol. 52,343. F. Jacoband J. Monod A961), Mol. Biol. 3, 318. D.Janjic and P. Stroot A974), Helv. Chem.Ada 57, 266. H. K. Janssen A974), Z. Physik 270, 67. E. Jantsch A975), Neue-Zurcher Zeitung, 26 Nov. 1975,and 2 Dec.1975. N. K. Jerne A973), Sci. Amer. 229,52. 373. A974), Ann. Immunol. Inst. Pasteur 125C,
G. W. Hoffman
E. Hopf
A975), in Energy Transformation in Biological Systems, Elsevier, Amsterdam. and A. Boiteux A968), in Regulatory functions of biological membranes, American Elsevier, New York. A971), Ann. Rev. Biochem. 40,237. A. Boiteux and Kruger A969), Adv. Enz. Regul. 7, 149. J. Hicklin, A. Hornbruch, L.Wolpert, and M. Clarke A973), Embryol. Exp. Morph. 30,701. J. Hiernaux A976), Ph.D. Dissertation, University of Brussels. and A. Babloyantz A976a), 1, 33. Nonequil. Thermodynamics Chem.Phys. 64,554. A976), A976b), BiosystemsS, A977), Europ. Immunol., submitted. J. Higgins A964), Proc. Nat. Acad. Sci. 51,989. (U.S.A.)
J.
J.
J.
J.
J.
51. J.
1.
J.
J.
J.
J.
References
S.S.Rangnekar
D. Joseph A972), in
Berlin.
Nonlinear
A976), Bull. Math. Biol. 38, 15. Problems in the Physical Sciences and Biology, Springer-Verlag,
Physical
Interscience, Sciences,
New York.
L. Kaczmarek A976), Biol. Cybernet. 22,229. L. Kaczmarek and A. Babloyantz A977), Biol. Cybernet., in press. L. V. Kantorovich and V. I.Krylov A964), Approximate Methods of Higher
Analysis,
P.
Noordhoff, Groningen. S.Kauffman A969), Theor, Biol. 22,437. A974a), Exp. Cell.Res.86,217. A974b), Bull. Math. Biol. 36, and J. Wille A975), Theor. Biol. 55,47. H. B. Keller A974), in SIAM-AMS Symp. Appl. Math., Vol. VIII, American Mathematical Society, Providence, Rhode Island. E. F. Keller and L.A. Segel A970), Theor. Biol. 26,399. E. Kerner A957), Bull. Math. Biophys. 19, A959), Bull. Math. Biophys. 21,217. K. Kitahara A974), Ph.D. dissertation, University of Brussels.
J.
J.
J.
171.
J.
121.
A958), Sov. Phys. JETP 6, 753. W. A. Knorre A968), Biochem. Biophys. Res.Commun.
Yu. Klimontovich
31,812.
Y. Kobatake A970), Physica 48,301. N. Kopell and L.N. Howard A973a), Stud. Appl. Math. 52,291. A973b), Sci.180, submitted. J. Kozak, G. Nicolis, M. Sanglier, and Kres A976), Atm. Sci., J. Krank A970), The Mathematics of Diffusion, Clarendon, Oxford. M. A. Krasnosel'skii A964), Topological Methods in the Theory of Nonlinear Integral Equations, Macmillan, New York.
1171.
J.
J.
J. Kreifeldt A970), Math. Biosci.8, 425. R. Kubo A962), J.Phys. Soc. Jap. 17, 1100. , K. Matsuo, and K. Kitahara A973), J.Stat. Phys. 9, 51. Y. Kuramoto A974), Progr. Theor. Phys. 52,711. and T. Tsuzuki A974), Progr. Theor. Phys. 52, 1399. A975), Progr. Theor. Phys. 54,687. L.D. Landau and E. M. Lifshitz A957), Statistical Physics, Pergamon, Oxford. R. Landauer A962), J.Appl. Phys. 33,2209. H. D. Landahl and V. Licko A973), Int. J.Chronobiol. 245. W. Langlois, A. Van Nypelseer, and J. Walker, A976), Bull. Math. Biol. 38,535. P. A. Lawrence A966), J.Exp. Biol. 44,607. B. Lavenda, G. Nicolis, and M. Herschkowitz-Kaufman A971), J. Theor. Biol. 32,283. M. Lax A960), Rev. Mod. Phys. 32,25. E. R. LeachA961), Rethinking Anthropology, Athlone, London.
1,
R. LefeverA968),Bull.
A968), A Runaway World, BBC Publ., London. Acad. Roy. Belg. Cl. Sci. 54,712.
References
,\342\200\236.
dissertation, University of Brussels. A970), Ph.D. A975), in Fluctuations, Instabilities, and Phase Transitions, Plenum, New York. and G. Nicolis A971), Theor. Biol. 30,267. and R. Garay A977), in Theoretical Immunology, M. Dekker, New York. , G. Nicolis, and Prigogine A967), Chem.Phys., 47, 1045. , M. Herschkowitz-Kaufman and J. W. Turner A977). Phys. Lett., submitted. H. N. W. Lekkerkerker and J.-P.Boon A975), in Fluctuations, Instabilities, and Phase TransiPlenum, New York. H. Lemarchand and G. Nicolis A976), Physica, in press. J. Leray and Schauder A934), Ann. Sci.Ecole Norm. Sup. C)51,45. C. Levi-Strauss A958), Anthropologie structurale, Plon, Paris. B. Libet, H. Kobayashi, and T. Tanake A975), Nature 258,155. E. N. Lorenz A963), Atmos. Sci.20, 130.
J.
I.
J.
Transitions,
I.
J.
Nat. Acad. Sci. A. Lotka A920), Proc. 6, 420. (U.S.A.) Nat. Acad. Sci. D. MacMahon A973), Proc. 70, 2396. (U.S.A.) AM Appl. Math., in press. J. T. Mahar and B.T. Matkowski A976), SI M. Malek-Mansour A973), Memoire de Licence, University of Brussels. and G. Nicolis A975), Stat. Phys. 13,197. , L. Brenig and W. Horsthemke, A977). Physica submitted. T. E. Mansour A972), in Current Topics in CellRegulation, Vol. 5, 1,Academic, New York. M. Marek and Stuchl A975), Biophys. Chem.3, 241. and E. Svobodova A975), Biophys. Chem.3, 263. M. Masters and W. D. Donachie A966), Nature 209,476. S.Matheson, D.F. Walls, and C.W. Gardiner A975), Stat. Phys. 12,
J.
J.
I.
I.
R. Mazo A970), Chem.Phys. 52,3306. Chem. A975), Phys. 62,4244. R. May A973), Model Ecosystems, Princeton U.P. J. Maynard-Smith A974), Mathematical Ecology, Cambridge U.V. H. P. McKean A969), in Lectures Seriesin Differential Equations, Vol. Reinhold, New York. and D.Sattinger A973), Fund. Anal. 14,62. B.McLeod K. McNeil and D. F. Walls A974), Stat. Phys. 10,439.
J. J.
J.
21.
II, Van
Nostrand-
J.
J. J.
D. McQuarrie A967), in Suppl. Rev. Her.Appl. Prob.,Methuen, S.L. Miller A953), Science 117,528.
London.
J. Monod, J. Wyman and J.-P.Changeux A965), J.Mol. Biol. 12,88. M. F. Morales and D. McKay A967), Biophys. J.7, 621. P.M. Morseand H. FeshbachA953), Methods of Theoretical Physics, McGraw-Hill,
New York.
Princeton, U.P.,
Chem.Phys. 61,3610. A974), A976), J. Theor. Biol. 56,329. A. D.Nazarea A974), Proc.Nai. Acad. Sci. 71, 3751. (U.S.A.)
J.
482
Theor. Biol, in press. A976), to be A977) published. and G. Nicolis A975), Mol. Phys. 29, 1557. M. Nicolet A964), Discuss. Faraday Soc. 37, 7. A.
References
D. Nazarea
J.
J. J.
J.
I.
J.
J. S.Nicolis, G. Galanos,
A. Nitzan and
and
E. Protonotarios
\342\200\224,
J.Ross A973), J.Chem.Phys. 60,3134. J. A974), Stat. Phys. 10,379. , P. Ortoleva, and J. RossA974), J.Chem.Phys. 60,3134. P. Ortoleva, J. Deutch, and J. RossA974), J.Chem.Phys. 61,1056.
J.
A975), Adv. Chem. Phys. 29,281. 227. and F. W. Bentrup A972), Planta 108, A. Novick and M. Weiner A957), Proc.Nat. Acad. Sci. 43, 553. (U.S.A.)
B. Novak B. Novak
R. M. Noyes
Symp. Molec.Biology, Chicago U.P. A959), in Proc. Chem.Phys. 64, 1266. A976a), Chem.Phys. 65,848. A976b), and R. J. Field A974), Ann. Rev. Phys. Chem.25,95. R. Nuccitelli and L.F. Jaffe A974), Proc. Nat. Acad. Sci. 71,4855. (U.S.A.)
J.
J.
Rev.
J. Ross
Chem.Phys. A973), Chem.Phys. 60,5090. A974a), A974b), in Faraday Symp. No. 9, The Chemical Society, London. Chem.Phys. 63,3398. A975), H. G. Othmer A975), Math. Biol. 2, 133. A976); Chem.Phys., in press. and L.E. Scriven A969), Ind. Eng. Fund. 8, 302. A. Pacault, P. de Kepper, and P. Hanusse A974), in Proc. 25th Int. Meet. (Dijon), Elsevier, Amsterdam. Ser.C,280,197. A975), C.R. Acad. Sci. Pastan and R. Perlman A970), Science 169,339.
J. J. J.
A972),
J.
J.
Soc.Chim.
Phys
I.
References
fgj
A971), J. Theor. Biol. 33,319.
T. Pavlidis
A973), Biological Oscillators: Their Mathematical Analysis, Academic, New York A967), Phys. Rev. 162,186. Ecology, Wiley-Interscience, New A969), An Introduction to Mathematical York. G. H. Pimbley, Jr. A969). Eigenfunction Branches ofNonlinear Operators and their Bifurcations, Springer-Verlag, Berlin. 7th Int. Conf. Nonlin. Oscill. Akad. Wiss., Berlin (D.D.R.). T. Plesser A975), Proc. M. C. Polyakova and J. M. Romanovskii A971), Bull. Univ. Moscow, Sect.Phys. Astr.,
R. F. Pawula E. C. Pielou
No.4 J. Portnow
I.
I.
A974), in Faraday Symp. No. 9, The Chemical Society, London. A, 370. A975), Phys. Lett. 51 31,600. Prigogine A945), Bull. Acad. Roy. Belg. Cl. Sci. A947), Etude Thermodynamique desProcessus Irreversibles, Desoer, Liege. A949a), Nuovo Cimento Suppl. Vol. VI, Sect. IX, No. 2. A949b), Physica 15,272. 3rd Symp. Temperature, Washington, D.C. A954), Proc. A965), Physica 31,719. Liege. Prigogine and R. Defay A951), Thermodynamique Chimique, Desoer, and R. Herman A971). Kinetic Theory of Vehicular Traffic, Elsevier, New York. and R. Lefever A968), Chem.Phys. 48, 1695.
J.
A975), Adv. Chem.Phys. 29, and G. Mayer A955), Bull. Acad. Roy. Belg. Cl. Sci. 41,22. and G.Nicolis A971),in Proc. 3rdlnt. Conference, From Theoretical Physics to Biology, Versailles, France. , G. Nicolis, and A. Babloyantz A972), Physics Today 25,No. p. 23;No. 12,p. 38. , C.George,F. Henin, and L. Rosenfeld A973), Chem.Scripta 4, 5. , R. Lefever, J. S.Turner, and W. Turner A975), Phys. Lett. 51A, 317.
1.
11,
J.
T. Lam A975), Collect.Phen. 2, 103. E.K. Pye A969), Can. J.Bot. 47, 271. N. Rashevsky A938), Mathematical Biophysics, Chicago U.P. V. T. N. Reddy A975), J.Stat. Phys. 13,61. C.G. Richie and B.F. Woomack A966), Technical Report No. 28, Department of Electrical
, G. Nicolis, M. Herman,
and
J.Rommelaere
G. Rosen
Austin. Engineering, University of Texas, P. Richter A975), Europ J.Immunol. 5, 350. F. Riesz and B. Sz.Nagy A955), Functional Analysis, Frederick Unger, New A. Robertson and M. H. Cohen A972), Ann. Rev. Biophys. Bioeng. 1,409. A. Robertson, D. Drage, and M. H. Cohen A972), Science 175, 33.
and Hiernaux A975), Biosyst. 7, 250. A973), Phys. Lett. 43A, 349. J. Rossand P. Mazur A961), Chem.Phys. 35, 19. E. F. Rossomando and M. Sussman A973), Proc. Nat. Acad. D. Ruelle A973), Trans. N. Y. Acad. Sci.70, 66.
York.
J.
J.
484
V. A. Samoilenko and
References
Systems, Vol.
Oscillatory
Ph.D. dissertation, University of Brussels. and G. Nicolis A976), Biophys. Chem.4, R. Sansone and S.Conti A964), Nonlinear Differential Equations, Pergamon, Oxford. D. Sattinger A973), Topics in Stability and Bifurcation Theory, Springer-Verlag, Berlin.
M. Sanglier A976),
113.
in
press.
H. Schaller
J.
Y. Schiffmann
A975), unpublished
results, University
29,39. of Brussels.
J.Biochem. 4, 79. 98. K. R. Sharma and R. M. Noyes A976), J.Am. Chem.Soc. M. L.Smoes and J. Dreitlein A973), J.Chem.Phys. 59,6277. Sneddon A957), Elements of Partial Differential Equations, McGraw-Hill, New 457. R. A. Spangler and F. M. Snell A961), Nature 191, A967), J.Theor. Biol. 16,381. Stakgold A971), SIAM Review 13,289. H. E. Stanley A971), Introduction to Phase Transitions and Critical Phenomena,
I.
York.
I.
Clarendon, Oxford. Stanshine A975), Ph.D. dissertation, Massachusets Institute of Technology, Cambridge. P. Stroot and D.Janjic A975), Helv. Chem.Ada 58, M. Sugita A963), Theor. Biol.4, 179. M. Sussman A964), Growth and Development, Prentice-Hall, Englewood Cliffs, New Jersey. D.Thoenes A973), Nature 243,18. R. Thom A972), Stabilite Structurelle et Morphogenese, Benjamin, New York.
J.
J.
116.
D.Thomas
A975), Adv. Chem. Phys. 29, A. and R. Lefever A977), to be published. Goldbeter , R. Thomas A973), Theor. Biol.42,563. A973), A General Theory of Elastic Stability, Wiley, London.
113.
J.
and
P. Van
J.M. T.Thompson
Ham A974), Biochimie 56, 1529. and G. W. Hunt A975). Z. Any. Math. Phys.
Phys.
26,581.
25,48.
K. Tomita and K. Kitahara A975), Biophys. Chem.3, 125. K. Tomita and H. Tomita A974), Progr. Theor. Phys. 51,1731. K. Tomita, T. Ohta, and H. Tomita A974), Progr. Theor. Phys. 52, 1744. V. TorreA975), Biol. Cybernet. 17, 137.
References A. M. Turing A952), Phil. Trans. Roy. Sot:Lond. B237,37. S.Turner A975), Adv. Chem.Phys. 29,63. W. Turner A974), Trans. N. Y. Acad. Sci. 36,800. 61,293. A975), Bull. Acad. Roy. Belg. Cl. Sci. A977), to be published.
485
J. J.
J. Tyson
Chem.Phys. 58,3919. A973), Vol. 7, American Mathematical A975a), in Lectures in Mathematics in the Life Sciences, Society, Providence, Rhode Island. Math. Biol. 1, A975b), Chem.Phys., submitted. A976), and J. Light A973), Chem.Phys. 59,4164.
J.
J. J.
311.
J.
and S.Kauffman Math. Biol. 1, 289. A975), J. Urbain A976), Ann. Immunol. Inst. Pasteur 127C, 357. N. G. Van Kampen A961), Can. Phys. 39,551.
J.
J.
A969), Adv. Chem.Phys. 15,65. A976), Adv. Chem. Phys., 34,245. D. Venieratos A976), Thesede troisieme cycle, University of Paris VII. sur la Theorie Mathematique dela Luttepour la Vie, Gauthier-Villars, V. Volterra A936), Lecons Paris.
R. Wall A973), Adv. Morphogen. 10,41. Ch. Walter A969), J.Theor. Biology 23,23.
J.Watson
Theor. Biology 27, 259. A970), A965), Molecular Biology of the Gene, Benjamin, New York. N. Wax A954), Selected Dover, New Topics in the Theory of Noise and Stochastic Processes, York. O.K. Wilby and G. Webster A970), Embryol., Exp. Morphol. 24,583. H. Wilson A974), in Cooperative Effects, North Holland, Amsterdam. K. G. Wilson A973), Physica 73, E. O.Wilson A971), The Insect Societies, Harvard U.P., Cambridge. A975), Sociobiology, Harvard Cambridge. Theor. Biol. 16,15. A. T. Winfree A967), Theor. Biol. 28,327. A970),
J.
J.
119.
J.
J.
UP.,
175,634. A972), Science 137. 181, A973), Science in S IAM-AMS Proc. A974a), Symp. Appl. Math., Vol. VIII, American Mathematical Rhode Island. Providence, Society, Amer. 230F), 82. A974b), Sci. A975), Physics Today 28,34. L. Wolpert A969), Theor. Biol. 25, A971), Curr. Top. Dev. Biol. 6, 183.
J.
1.
J.Wyman
A975), Adv. Chem.Phys. 29,253. Mol. Biol. 39,523. A969), A. N. Zaikin and A. M. Zhabotinski A970), Nature
J.
225,525.
486
V. Zaitsev and
References
A.
A. M. Zhabotinski A964), Biofizika 9, 306. A974), Self-oscillating Concentrations, Nauka, Moscow. A. Zotin and R. S.Zotina A967), Theor. Biol. 17, 57. G. Zubay, D. Schwartz, and J. Beckwith A970), Proc. Nat. Acad. Sci. 66, 104. (U.S.A.) V. Zubov A961), Methods of A. M. Lyapounov and their Applications, U.S. Atomic Energy
I.
J.
I.
AddendumMathematical Problems
Throughout this monograph, most of the analytical results obtained on pattern formation were based on approximate solutions of reaction-diffuequations using suitable perturbative expansions. Clearly, exact results would be highly desirable,as they would enable us to tackle problems involving arbitrary deviations from the first bifurcation point. One of the most challenging questionsin this direction is the possibility to explore fully the bifurcation diagram of a reaction-diffusion system, including information on stability of the branchesand on secondaryand higher bifurcations. Recently, Lefever, Herschkowitz-Kaufmanand Turner of A977) were able to carry out this program in a particular limiting case the trimolecular model. Considerthe familiar schemeG.10) where both the entry term A and the X In of diffusion such a system is are deleted. the absence term decay closed to mass transfer with respect to X, Y. However, inclusion of diffusion can model appropriately an open system, if the boundary condiare compatiblewith nonvanishing fluxes of X and Y. The rate medium of length /= 1): equations become (we take a one-dimensional
reaction-diffusion
conditions
9/2
where
f(X,Y) = X2Y-BX
and
Y(O)=Y(l)=B/\302\243
B)
C)
487
488
Addendum
Mathematical
Problems
we may lump the equations at the steady state into the single relation:
K-F(W)
where K is an integration constant, and
D)
Solutionsof eq. D) can be constructedin terms of elliptic functions. They feature bifurcation properties and space dependenciessimilar to those described in Section 7.6.The novel point is, of course,that the amplitude and period of the solutions and the shape of the bifurcation diagram can be calculatedwithout using perturbation theory. Moreover, in
the particular caseDX = D2 the eigenvalues of the linearized equations around the space-dependent solutions of eq.D) can be computed exactly, as they are given by a Lame equation. An additional feature of the steady-state solutions is worth pointing out. We first write relations A) as
F)
In this form, the equations have a structure similar to those of classical dynamics, provided time is replacedby the spatial variable r. Such pheas the formation of spatial dissipative structures may, therefore, be phenomena viewed as the analogsof the formation of periodicorbits,which, as is well known, characterize the motion of certain classesof dynamical systems. Nitecki, 1971) Finally, it has been stressedrepeatedly(Lorenz, 1963; that in systemsof nonlinear differential equations involving three or more variables new types of bifurcations leadingto \"strange attractors\" become The resulting random, or \"chaotic,\" behavior might well prove to possible. be a generic property of complexreaction networks.In this respect the nonlinear laws that can lead to order far from equilibrium could refer to a of systems!The situation is small\342\200\224although extremely important\342\200\224class somewhat reminiscent of the status of integrable systems of classical mechanics(Moser 1973) which, although of the utmost importance, refer nevertheless to rather exceptional patterns of dynamical behavior.
Index
Acetabularia, 425 Activation, 165,357,418 Active transport, 413
Adenyl
379 cyclase,
379, 380
mechanism, 343 Bendixson negative criterion, 88 /3-galactosidase, seeInduction, of/3-galactosidase Bifurcation, 124 diagram, eigenvalue, at simple, 86 secondary, 120,192 of steady-state solutions, 106,109,
model, 345
339
Catastrophe theory, 74 and all-or-none transitions, 174 Cellsorting, 415 Cellular contacts, 414 Center, 82 Central limit theorem, 227 Chain reactions, 465 Chapman-Kolmogorov equation, 230 Chapman sequence, seeOzone Characteristic equation, 77 for Brusselator, 98 Chemical potential, 33 Chemical reactors, 168,382 Chemotaxis, 379 Circadian rhythms, 195,386 Competition, 429,449 Conflict, 176 Conservation equations, 27, 63 284 Constant of motion, Correlations, 297 .long range, 305,307 Critical exponents, 309,323,
161,
326
Curie symmetry Cusp, 176 Detailed balance,
Diffusion,
115,
71,83
principle,
40
120,180
113,
Boolean nets,
211
as closed system,
106,140,153 156 96
and Fick's law, 48 and positional information, 410, 415 Dissipative structures, 60 bifurcation analysis of, 106,140,153 localized, of, 127 multiplicity and polarity, onset of, 415 qualitative properties of, thermodynamic properties of, 212 in two dimensions, 178 Distribution, binomial, 226 Gaussian, 227, 235 Poisson, 226,235,
46
41,330
131
115
260
489
490
Ecosystems, evolution
Index spatio-temporal patterns, 375 Hamilton-Jacobi equation, Heat-shock, 404 Hopf bifurcation, 141 Hydra, 425 Hypercycles, 436 Immune networks,
Immune surveillance,
basicequations, 449 of, 455 Eigenvalue, 84 of Laplace operator, 98,178 multiple, 85,
functions, 465 414 Entrainment, 195, Entropy, 22,32,55,212 balance equation, 33
Elliptic
248
121
Enzyme, allosteric,
468 469
459
51 173,401
K-V system,
360
Floquet theory, 206 Fluctuations, 223 in Brusselator, 289,319 circulation of, 271 and Einstein formula, 234 around equilibrium, 232 in finite volumes, 310 in Lotka-Volterra model, 264 molecular dynamics study of, 283
in nonlinear model, 261 in unimolecular reactions,
Lacoperon, 388
Landau-Ginzburg potential, Langevin equation, 247 Large numbers, law of, 227
117
378
151
340
257
Fluxes, generalized,
35
Focus, 82
Fokker-Planck equation, 243 Forces, generalized, 35 Fredholm alternative, 108,143 Fusion, cellular, 403 Generating function, cumulant-, moment-, 249 Gibbs formula, 33
models of,
multiple,
Lotka-Volterra model, 160 Markov process, 229 Master equation, 231 for birth and death process, 239
multivariate,
165 350,401
320
251,266,
285
382 Glucose-oxidase,
Glycolysis, 354 and adenylic energy charge, 385 allosteric model of, 358 external disturbances, effect of, 371 oscillatory behavior, 356,369
nonlinear, 317 in phase space, 275 Maxwell rule, 176, Membrane-bound enzymes,
211
382 42
402
491
distribution Reaction-diffusion equations, 27, 64 Refractory period, 371,414 422 Repression, 388,394, catastrophe, 177 Riemann-Hugoniot Saddle point, 81 Separatrix, 82,88,399 Singular points, multiple, simple, 79
467
364
83
alterna-
Nucleation,
323,331,462 312,
Onsager reciprocity relations, 40 Opensystems, 24,26 Order parameter, 322,326 Oregonator, 345 Organizer, embryonic, 413 Oscillations, conservative, 160 epigenetic, 387 past an instability, 87 metabolic, 354 periodic, almost, 196 in trimolecular model, 140
116,
Stability,
46,55,63 462
orbital, 66 structural, 68
thermodynamic
79, 86
criterion of,
Oscillators, 195 asymptotic behavior of, 203 coupled through diffusion, 147
Steady states,
multiple,
201 Ozone,
Papain,
Stochastic differential equations, 247 Stoichiometric coefficient, 28,240 Symmetry-breaking, 402 Synchronization, 147,195,
169,391
41
59
115,415
382 seeMorphogenesis;
Symmetry-
Permease,388
Phase-singularity,
371,415
197
Phenomenological relations, 36,39,49 Phosphodiesterase, 381 Phosphofructokinase, 357, 446 mathematical model, of the reaction, 358 Photochemical reactions, 200 Physarum polycephalum, 402 Polymer, prebiotic, 430,434 421 Positional differentiation, Positional information, 75 Potential, kinetic, thermodynamic, 43,233,236 Probability distribution, 224 moments of, 225,252 Pyrophosphohydrolase, 379 Pyruvate kinase, 357,446
Polarity, 104 in morphogenesis,
Thermodynamic branch, 57 Transition probabilities, 228,230 240 for birth and death process, for diffusion, 287, 315 Trimolecular model, seeBrusselator Turning points, 134 Turnover numbers, 364 Urban growth, Urease, 382
Van
473
415
51,
410,413
351
in Brusselator,
149,153,185
and formation,
discontinuity,
of surfaces of discontinu-
207