Evolutionary stability and quasi-stationary strategy in stochastic evolutionary game dynamics

Stochastic evolutionary game dynamics for finite populations has recently been widely explored in the study of evolutionary game theory. It is known from the work of Traulsen et al. [2005. Phys. Rev. Lett. 95, 238701] that the stochastic evolutionary dynamics approaches the deterministic replicator dynamics in the limit of large population size. However, sometimes the limiting behavior predicted by the stochastic evolutionary dynamics is not quite in agreement with the steady-state behavior of the replicator dynamics. This paradox inspired us to give reasonable explanations of the traditional concept of evolutionarily stable strategy (ESS) in the context of finite populations. A quasi-stationary analysis of the stochastic evolutionary game dynamics is put forward in this study and we present a new concept of quasi-stationary strategy (QSS) for large but finite populations. It is shown that the consistency between the QSS and the ESS implies that the long-term behavior of the replicator dynamics can be predicted by the quasi-stationary behavior of the stochastic dynamics. We relate the paradox to the time scales and find that the contradiction occurs only when the fixation time scale is much longer than the quasi-stationary time scale. Our work may shed light on understanding the relationship between the deterministic and stochastic methods of modeling evolutionary game dynamics.     

Pairwise comparison and selection temperature in evolutionary game dynamics

Recently, the frequency-dependent Moran process has been introduced in order to describe evolutionary game dynamics in finite populations. Here, an alternative to this process is investigated that is based on pairwise comparison between two individuals. We follow a long tradition in the physics community and introduce a temperature (of selection) to account for stochastic effects. We calculate the fixation probabilities and fixation times for any symmetric 2 x 2 game, for any intensity of selection and any initial number of mutants. The temperature can be used to gauge continuously from neutral drift to the extreme selection intensity known as imitation dynamics. For some payoff matrices the distribution of fixation times can become so broad that the average value is no longer very meaningful.     

Evolutionary game dynamics in finite populations with strong selection and weak mutation

We study stochastic game dynamics in finite populations. To this end we extend the classical Moran process to incorporate frequency-dependent selection and mutation. For 2 x 2 games, we give a complete analysis of the long-run behavior when mutation rates are small. For 3 x 3 coordination games, we provide a simple rule to determine which strategy will be selected in large populations. The expected motion in our model resembles the standard replicator dynamics when the population is large, but is qualitatively different when the population is small. Our analysis shows that even in large finite populations the behavior of a replicator-like system can be different from that of the standard replicator dynamics. As an application, we consider selective language dynamics. We determine which language will be spoken in finite large populations. The results have an intuitive interpretation but would not be expected from an analysis of the replicator dynamics.     

Evolutionary game dynamics with non-uniform interaction rates

The classical setting of evolutionary game theory, the replicator equation, assumes uniform interaction rates. The rate at which individuals meet and interact is independent of their strategies. Here we extend this framework by allowing the interaction rates to depend on the strategies. This extension leads to non-linear fitness functions. We show that a strict Nash equilibrium remains uninvadable for non-uniform interaction rates, but the conditions for evolutionary stability need to be modified. We analyze all games between two strategies. If the two strategies coexist or exclude each other, then the evolutionary dynamics do not change qualitatively, only the location of the equilibrium point changes. If, however, one strategy dominates the other in the classical setting, then the introduction of non-uniform interaction rates can lead to a pair of interior equilibria. For the Prisoner's Dilemma, non-uniform interaction rates allow the coexistence between cooperators and defectors. For the snowdrift game, non-uniform interaction rates change the equilibrium frequency of cooperators.     

Fixation probabilities in evolutionary game dynamics with a two-strategy game in finite diploid populations

Fixation processes in evolutionary game dynamics in finite diploid populations are investigated. Traditionally, frequency dependent evolutionary dynamics is modeled as deterministic replicator dynamics. This implies that the infinite size of the population is assumed implicitly. In nature, however, population sizes are finite. Recently, stochastic processes in finite populations have been introduced in order to study finite size effects in evolutionary game dynamics. One of the most significant studies on evolutionary dynamics in finite populations was carried out by Nowak et al. which describes “one-third law” [Nowak, et al., 2004. Emergence of cooperation and evolutionary stability in finite populations. Nature 428, 646-650]. It states that under weak selection, if the fitness of strategy α is greater than that of strategy β when α has a frequency , strategy α fixates in a β-population with selective advantage. In their study, it is assumed that the inheritance of strategies is asexual, i.e. the population is haploid. In this study, we apply their framework to a diploid population that plays a two-strategy game with two ESSs (a bistable game). The fixation probability of a mutant allele in this diploid population is derived. A “three-tenth law” for a completely recessive mutant allele and a “two-fifth law” for a completely dominant mutant allele are found; other cases are also discussed.     

活跃连接下Wright-Fisher过程的演化动态

在活跃连接下讨论了2×2对称博弈中频率相依Wright-Fisher过程的演化动力学,得到弱选择下策略的固定概率.利用固定概率讨论囚徒困境与雪堆博弈的演化动态,给出促使合作行为的条件.最后对所得结果进行数值模拟,发现活跃连接可以有效地促进合作行为.     

Evolutionary stable strategies and game dynamics for n-person games

This note contains a generalization of the definition of an evolutionary stable strategy and of the corresponding game dynamics from 2-person to n-person games. This broader framework also allows modelling of several interacting populations or of populations containing different types of individuals, for example males and females.     

Strategy selection in structured populations

Evolutionary game theory studies frequency dependent selection. The fitness of a strategy is not constant, but depends on the relative frequencies of strategies in the population. This type of evolutionary dynamics occurs in many settings of ecology, infectious disease dynamics, animal behavior and social interactions of humans. Traditionally evolutionary game dynamics are studied in well-mixed populations, where the interaction between any two individuals is equally likely. There have also been several approaches to study evolutionary games in structured populations. In this paper we present a simple result that holds for a large variety of population structures. We consider the game between two strategies, A and B, described by the payoff matrix . We study a mutation and selection process. For weak selection strategy A is favored over B if and only if σa+b>c+σd. This means the effect of population structure on strategy selection can be described by a single parameter, σ. We present the values of σ for various examples including the well-mixed population, games on graphs, games in phenotype space and games on sets. We give a proof for the existence of such a σ, which holds for all population structures and update rules that have certain (natural) properties. We assume weak selection, but allow any mutation rate. We discuss the relationship between σ and the critical benefit to cost ratio for the evolution of cooperation. The single parameter, σ, allows us to quantify the ability of a population structure to promote the evolution of cooperation or to choose efficient equilibria in coordination games.     

Mutation-selection equilibrium in games with multiple strategies

In evolutionary games the fitness of individuals is not constant but depends on the relative abundance of the various strategies in the population. Here we study general games among n strategies in populations of large but finite size. We explore stochastic evolutionary dynamics under weak selection, but for any mutation rate. We analyze the frequency dependent Moran process in well-mixed populations, but almost identical results are found for the Wright-Fisher and Pairwise Comparison processes. Surprisingly simple conditions specify whether a strategy is more abundant on average than 1/n, or than another strategy, in the mutation-selection equilibrium. We find one condition that holds for low mutation rate and another condition that holds for high mutation rate. A linear combination of these two conditions holds for any mutation rate. Our results allow a complete characterization of n×n games in the limit of weak selection.     

Stochastic dynamics in exotic and native blowflies: an analysis combining laboratory experiments and a two-patch metapopulation model

In this study we explored the stochastic population dynamics of three exotic blowfly species, Chrysomya albiceps, Chrysomya megacephala and Chrysomya putoria, and two native species, Cochliomyia macellaria and Lucilia eximia, by combining a density-dependent growth model with a two-patch metapopulation model. Stochastic fecundity, survival and migration were investigated by permitting random variations between predetermined demographic boundary values based on experimental data. Lucilia eximia and Chrysomya albiceps were the species most susceptible to the risk of local extinction. Cochliomyia macellaria, C. megacephala and C. putoria exhibited lower risks of extinction when compared to the other species. The simultaneous analysis of stochastic fecundity and survival revealed an increase in the extinction risk for all species. When stochastic fecundity, survival and migration were simulated together, the coupled populations were synchronized in the five species. These results are discussed, emphasizing biological invasion and interspecific interaction dynamics.     

Mutation-selection equilibrium in games with mixed strategies

We develop a new method for studying stochastic evolutionary game dynamics of mixed strategies. We consider the general situation: there are n pure strategies whose interactions are described by an n×n payoff matrix. Players can use mixed strategies, which are given by the vector (p₁,…,p_n). Each entry specifies the probability to use the corresponding pure strategy. The sum over all entries is one. Therefore, a mixed strategy is a point in the simplex S_n. We study evolutionary dynamics in a well-mixed population of finite size. Individuals reproduce proportional to payoff. We consider the case of weak selection, which means the payoff from the game is only a small contribution to overall fitness. Reproduction can be subject to mutation; a mutant adopts a randomly chosen mixed strategy. We calculate the average abundance of every mixed strategy in the stationary distribution of the mutation-selection process. We find the crucial conditions that specify if a strategy is favored or opposed by selection. One condition holds for low mutation rate, another for high mutation rate. The result for any mutation rate is a linear combination of those two. As a specific example we study the Hawk-Dove game. We prove general statements about the relationship between games with pure and with mixed strategies.     

Evolutionary dynamics of continuous strategy games on graphs and social networks under weak selection

Understanding the emergence of cooperation among selfish individuals has been a long-standing puzzle, which has been studied by a variety of game models. Most previous studies presumed that interactions between individuals are discrete, but it seems unrealistic in real systems. Recently, there are increasing interests in studying game models with a continuous strategy space. Existing research work on continuous strategy games mainly focuses on well-mixed populations. Especially, little theoretical work has been conducted on their evolutionary dynamics in a structured population. In the previous work (Zhong et al., BioSystems, 2012), we showed that under strong selection, continuous and discrete strategies have significantly different equilibrium and game dynamics in spatially structured populations. In this paper, we further study evolutionary dynamics of continuous strategy games under weak selection in structured populations. By using the fixation probability based stochastic dynamics, we derive exact conditions of natural selection favoring cooperation for the death–birth updating scheme. We also present a network gain decomposition of the game equilibrium, which might provide a new view of the network reciprocity in a quantitative way. Finally, we make a detailed comparison between games using discrete and continuous strategies. As compared to the former, we find that for the latter (i) the same selection conditions are derived for the general 2 × 2 game; especially, the rule b/c > k in a simplified Prisoner's Dilemma is valid as well; however, (ii) for a coordination game, interestingly, the risk-dominant strategy is disfavored. Numerical simulations have also been conducted to validate our results.     

The rate of multi-step evolution in Moran and Wright-Fisher populations

Several groups have recently modeled evolutionary transitions from an ancestral allele to a beneficial allele separated by one or more intervening mutants. The beneficial allele can become fixed if a succession of intermediate mutants are fixed or alternatively if successive mutants arise while the previous intermediate mutant is still segregating. This latter process has been termed stochastic tunneling. Previous work has focused on the Moran model of population genetics. I use elementary methods of analyzing stochastic processes to derive the probability of tunneling in the limit of large population size for both Moran and Wright-Fisher populations. I also show how to efficiently obtain numerical results for finite populations. These results show that the probability of stochastic tunneling is twice as large under the Wright-Fisher model as it is under the Moran model.     

Stochastic evolutionary dynamics of bimatrix games

Evolutionary game dynamics of two-player asymmetric games in finite populations is studied. We consider two roles in the game, roles α and β. α-players and β-players interact and gain payoffs. The game is described by a pair of matrices, which is called bimatrix. One's payoff in the game is interpreted as its fecundity, thus strategies are subject to natural selection. In addition, strategies can randomly mutate to others. We formulate a stochastic evolutionary game dynamics of bimatrix games as a frequency-dependent Moran process with mutation. We analytically derive the stationary distribution of strategies under weak selection. Our result provides a criterion for equilibrium selection in general bimatrix games.     

Cross entropy minimization in uninvadable states of complex populations

Selection is often. viewed as a process that maximizes the average fitness of a population. However, there are often constraints even on the phenotypic level which may prevent fitness optimization. Consequently, in evolutionary game theory, models of frequency dependent selection are investigated, which focus on equilibrium states that are characterized by stability (or uninvadability) rather than by optimality. The aim of this article is to show that nevertheless there is a biologically meaningful quantity, namely cross (fitness) entropy, which is optimized during the course of evolution: a dynamical model adapted to evolutionary games is presented which has the property that relative entropy decreases monotonically, if the state of a (complex) population is close to an uninvadable state. This result may be interpreted as if evolution has an order stabilizing effect.     

Evolutionary game dynamics in a finite asymmetric two-deme population and emergence of cooperation

We consider evolutionary game dynamics in a finite population subdivided into two demes with both unequal deme sizes and different migration rates. Assuming viability differences in the population according to a linear game within each deme as a result of pairwise interactions, we specify conditions for weak selection favoring a mutant strategy to go to fixation, under the structured-coalescent assumptions, and their connections with evolutionary stability concepts. In the framework of the Iterated Prisoner's Dilemma with strategy ‘tit-for-tat’ as mutant strategy and ‘always defect’ as resident strategy, we deduce a condition under which the emergence of cooperation is favored by selection, when the game matrix is the same in both demes. We show how this condition extends the one-third law for a panmictic population and when an asymmetry in the spatial structure of a two-deme population facilitates the emergence of the cooperative tit-for-tat strategy in comparison with both its symmetric and panmictic population structure counterparts. We find that the condition is less stringent in the asymmetric scenario versus the symmetric scenario if both the fraction of the population in the deme where the mutant was initially introduced, and the expected proportion of migrant offspring in this deme among all migrant offspring after population regulation, are smaller than, or equal to, , provided they are not too small. On the other hand, the condition is less stringent than the one-third law, which holds in the panmictic case, if the latter proportion remains not too close to 1.     

Evolutionary dynamics and strong Allee effects

We describe the dynamics of an evolutionary model for a population subject to a strong Allee effect. The model assumes that the carrying capacity k(u), inherent growth rate r(u), and Allee threshold a(u) are functions of a mean phenotypic trait u subject to evolution. The model is a plane autonomous system that describes the coupled population and mean trait dynamics. We show bounded orbits equilibrate and that the Allee basin shrinks (and can even disappear) as a result of evolution. We also show that stable non-extinction equilibria occur at the local maxima of k(u) and that stable extinction equilibria occur at local minima of r(u). We give examples that illustrate these results and demonstrate other consequences of an Allee threshold in an evolutionary setting. These include the existence of multiple evolutionarily stable, non-extinction equilibria, and the possibility of evolving to a non-evolutionary stable strategy (ESS) trait from an initial trait near an ESS.     

Approach to equilibrium in age structured populations with an increasing recruitment process

This paper considers a model for the dynamics of an age structured population subject to a density dependent factor which regulates the recruitment. Certain properties of biological interest are obtained and the stability of the equilibrium age distributions is investigated. Finally some applications to known fishery models are considered.Work done under the contract 80.02333.01 of C.N.R.     

Evolutionary game dynamics in finite populations

We introduce a model of stochastic evolutionary game dynamics in finite populations which is similar to the familiar replicator dynamics for infinite populations. Our focus is on the conditions for selection favoring the invasion and/or fixation of new phenotypes. For infinite populations, there are three generic selection scenarios describing evolutionary game dynamics among two strategies. For finite populations, there are eight selection scenarios. For a fixed payoff matrix a number of these scenarios can occur for different population sizes. We discuss several examples with unexpected behavior.     

Evolutionary game dynamics in diploid populations

Selection that influences behaviour can be studied using game theory if individual behavioural success depends on the frequencies of various behavioural types in the population. The evolutionarily stable strategy of J. Maynard Smith and G. R. Price (1973. Nature (London) 246, 15–18) is an equilibrium concept like the solution of a game. The dynamic model of Taylor and Jonker, studied in detail by Zeeman, goes beyond game theory using fitness to cause evolution, perhaps towards an equilibrium. A diploid version of their haploid model is considered and it is found that diploid evolution can be quite different. For example “catastrophic” bifurcations can occur between stable internal polymorphisms when the game matrix entries are changed slowly. A slight drop in food supply may cause extinction. Totally unfit altruistic genotypes can be maintained if they help the rest of the population. The relation of haploid game models to constant selection in diploids is also discussed.