Equilibrium selection in evolutionary games with random matching of players

We discuss stochastic dynamics of populations of individuals playing games. Our models possess two evolutionarily stable strategies: an efficient one, where a population is in a state with the maximal payoff (fitness) and a risk-dominant one, where players are averse to risks. We assume that individuals play with randomly chosen opponents (they do not play against average strategies as in the standard replicator dynamics). We show that the long-run behavior of a population depends on its size and the mutation level.     

Feasibility of communication in binary signaling games

In signaling games the replicator dynamics does not almost always converge to states of perfect communication. A significant portion of the state space converges to components of Nash equilibria that characterize states of partial communication. Since these components consist of non-hyperbolic rest points, the significance of this result will depend on the dynamic behavior of specific perturbations of the replicator equations. In this paper we study selection-mutation dynamics of signaling games, which may be considered as one plausible perturbation of the replicator dynamics. We find that the long term behavior of the dynamics depends on the mutation rates of senders and receivers and on the relevance of communication.     

Local Replicator Dynamics: A Simple Link Between Deterministic and Stochastic Models of Evolutionary Game Theory

Classical replicator dynamics assumes that individuals play their games and adopt new strategies on a global level: Each player interacts with a representative sample of the population and if a strategy yields a payoff above the average, then it is expected to spread. In this article, we connect evolutionary models for infinite and finite populations: While the population itself is infinite, interactions and reproduction occurs in random groups of size N. Surprisingly, the resulting dynamics simplifies to the traditional replicator system with a slightly modified payoff matrix. The qualitative results, however, mirror the findings for finite populations, in which strategies are selected according to a probabilistic Moran process. In particular, we derive a one-third law that holds for any population size. In this way, we show that the deterministic replicator equation in an infinite population can be used to study the Moran process in a finite population and vice versa. We apply the results to three examples to shed light on the evolution of cooperation in the iterated prisoner’s dilemma, on risk aversion in coordination games and on the maintenance of dominated strategies.     

Unpredictability induced by unfocused games in evolutionary game dynamics

Evolutionary game theory is a basis of replicator systems and has applications ranging from animal behavior and human language to ecosystems and other hierarchical network systems. Most studies in evolutionary game dynamics have focused on a single game, but, in many situations, we see that many games are played simultaneously. We construct a replicator equation with plural games by assuming that a reward of a player is a simple summation of the reward of each game. Even if the numbers of the strategies of the games are different, its dynamics can be described in one replicator equation. We here show that when players play several games at the same time, the fate of a single game cannot be determined without knowing the structures of the whole other games. The most absorbing fact is that even if a single game has a ESS (evolutionary stable strategy), the relative frequencies of strategies in the game does not always converge to the ESS point when other games are played simultaneously.     

The replicator dynamics with n players and population structure

The well-known replicator dynamics is usually applied to 2-player games and random matching. Here we allow for games with n players, and for population structures other than random matching. This more general application leads to a version of the replicator dynamics of which the standard 2-player, well-mixed version is a special case, and which allows us to explore the dynamic implications of population structure. The replicator dynamics also allows for a reformulation of the central theorem in Van Veelen (2009), which claims that inclusive fitness gives the correct prediction for games with generalized equal gains from switching (or, in other words, when fitness effects are additive). If we furthermore also assume that relatedness is constant during selection - which is a reasonable assumption in a setting with kin recognition - then inclusive fitness even becomes a parameter that determines the speed as well as the direction of selection. For games with unequal gains from switching, inclusive fitness can give the wrong prediction. With equal gains however, not only the sign, but also even the value of inclusive fitness becomes meaningful.     

Fixation of Strategies for an Evolutionary Game in Finite Populations

A stochastic evolutionary dynamics of two strategies given by 2x 2 matrix games is studied in finite populations. We focus on stochastic properties of fixation: how a strategy represented by a single individual wins over the entire population. The process is discussed in the framework of a random walk with site dependent hopping rates. The time of fixation is found to be identical for both strategies in any particular game. The asymptotic behavior of the fixation time and fixation probabilities in the large population size limit is also discussed. We show that fixation is fast when there is at least one pure evolutionary stable strategy (ESS) in the infinite population size limit, while fixation is slow when the ESS is the coexistence of the two strategies.     

Evolutionary dynamics of finite populations in games with polymorphic fitness equilibria

The hawk-dove (HD) game, as defined by Maynard Smith [1982. Evolution and the Theory of Games. Cambridge University Press, Cambridge], allows for a polymorphic fitness equilibrium (PFE) to exist between its two pure strategies; this polymorphism is the attractor of the standard replicator dynamics [Taylor, P.D., Jonker, L., 1978. Evolutionarily stable strategies and game dynamics. Math. Biosci. 40, 145-156; Hofbauer, J., Sigmund, K., 1998. Evolutionary Games and Population Dynamics. Cambridge University Press, Cambridge] operating on an infinite population of pure-strategists. Here, we consider stochastic replicator dynamics, operating on a finite population of pure-strategists playing games similar to HD; in particular, we examine the transient behavior of the system, before it enters an absorbing state due to sampling error. Though stochastic replication prevents the population from fixing onto the PFE, selection always favors the under-represented strategy. Thus, we may naively expect that the mean population state (of the pre-absorption transient) will correspond to the PFE. The empirical results of Fogel et al. [1997. On the instability of evolutionary stable states. BioSystems 44, 135-152] show that the mean population state, in fact, deviates from the PFE with statistical significance. We provide theoretical results that explain their observations. We show that such deviation away from the PFE occurs when the selection pressures that surround the fitness-equilibrium point are asymmetric. Further, we analyze a Markov model to prove that a finite population will generate a distribution over population states that equilibrates selection-pressure asymmetry; the mean of this distribution is generally not the fitness-equilibrium state.     

Population dynamics with a stable efficient equilibrium

We propose a game-theoretic dynamics of a population of replicating individuals. It consists of two parts: the standard replicator one and a migration between two different habitats. We consider symmetric two-player games with two evolutionarily stable strategies: the efficient one in which the population is in a state with a maximal payoff and the risk-dominant one where players are averse to risk. We show that for a large range of parameters of our dynamics, even if the initial conditions in both habitats are in the basin of attraction of the risk-dominant equilibrium (with respect to the standard replication dynamics without migration), in the long run most individuals play the efficient strategy.     

Evolutionary stability and quasi-stationary strategy in stochastic evolutionary game dynamics

Stochastic evolutionary game dynamics for finite populations has recently been widely explored in the study of evolutionary game theory. It is known from the work of Traulsen et al. [2005. Phys. Rev. Lett. 95, 238701] that the stochastic evolutionary dynamics approaches the deterministic replicator dynamics in the limit of large population size. However, sometimes the limiting behavior predicted by the stochastic evolutionary dynamics is not quite in agreement with the steady-state behavior of the replicator dynamics. This paradox inspired us to give reasonable explanations of the traditional concept of evolutionarily stable strategy (ESS) in the context of finite populations. A quasi-stationary analysis of the stochastic evolutionary game dynamics is put forward in this study and we present a new concept of quasi-stationary strategy (QSS) for large but finite populations. It is shown that the consistency between the QSS and the ESS implies that the long-term behavior of the replicator dynamics can be predicted by the quasi-stationary behavior of the stochastic dynamics. We relate the paradox to the time scales and find that the contradiction occurs only when the fixation time scale is much longer than the quasi-stationary time scale. Our work may shed light on understanding the relationship between the deterministic and stochastic methods of modeling evolutionary game dynamics.     

Evolutionary games on networks and payoff invariance under replicator dynamics

The commonly used accumulated payoff scheme is not invariant with respect to shifts of payoff values when applied locally in degree-inhomogeneous population structures. We propose a suitably modified payoff scheme and we show both formally and by numerical simulation, that it leaves the replicator dynamics invariant with respect to affine transformations of the game payoff matrix. We then show empirically that, using the modified payoff scheme, an interesting amount of cooperation can be reached in three paradigmatic non-cooperative two-person games in populations that are structured according to graphs that have a marked degree inhomogeneity, similar to actual graphs found in society. The three games are the Prisoner’s Dilemma, the Hawks-Doves and the Stag-Hunt. This confirms previous important observations that, under certain conditions, cooperation may emerge in such network-structured populations, even though standard replicator dynamics for mixing populations prescribes equilibria in which cooperation is totally absent in the Prisoner’s Dilemma, and it is less widespread in the other two games.     

Natural selection and social preferences

A large number of individuals are randomly matched into groups, where each group plays a finite symmetric game. Individuals breed true. The expected number of surviving offspring depends on own material payoff, but may also, due to cooperative breeding and/or reproductive competition, depend on the material payoffs to other group members. The induced population dynamic is equivalent with the replicator dynamic for a game with payoffs derived from those in the original game. We apply this selection dynamic to a number of examples, including prisoners' dilemma games with and without a punishment option, coordination games, and hawk-dove games. For each of these, we compare the outcomes with those obtained under the standard replicator dynamic. By way of a revealed-preference argument, our selection dynamic can explain certain "altruistic" and "spiteful" behaviors that are consistent with individuals having social preferences.     

Stability of evolutionarily stable strategies in discrete replicator dynamics with time delay

We construct two models of discrete-time replicator dynamics with time delay. In the social-type model, players imitate opponents taking into account average payoffs of games played some units of time ago. In the biological-type model, new players are born from parents who played in the past. We consider two-player games with two strategies and a unique mixed evolutionarily stable strategy. We show that in the first type of dynamics, it is asymptotically stable for small time delays and becomes unstable for big ones when the population oscillates around its stationary state. In the second type of dynamics, however, evolutionarily stable strategy is asymptotically stable for any size of a time delay.     

Evolutionary game dynamics in finite populations

We introduce a model of stochastic evolutionary game dynamics in finite populations which is similar to the familiar replicator dynamics for infinite populations. Our focus is on the conditions for selection favoring the invasion and/or fixation of new phenotypes. For infinite populations, there are three generic selection scenarios describing evolutionary game dynamics among two strategies. For finite populations, there are eight selection scenarios. For a fixed payoff matrix a number of these scenarios can occur for different population sizes. We discuss several examples with unexpected behavior.     

Oscillatory dynamics in evolutionary games are suppressed by heterogeneous adaptation rates of players

Game dynamics in which three or more strategies are cyclically competitive, as represented by the rock-scissors-paper game, have attracted practical and theoretical interests. In evolutionary dynamics, cyclic competition results in oscillatory dynamics of densities of individual strategists. In finite-size populations, it is known that oscillations blow up until all but one strategies are eradicated if without mutation. In the present paper, we formalize replicator dynamics with players who have different adaptation rates. We show analytically and numerically that the heterogeneous adaptation rate suppresses the oscillation amplitude. In social dilemma games with cyclically competing strategies and homogeneous adaptation rates, altruistic strategies are often relatively weak and cannot survive in finite-size populations. In such situations, heterogeneous adaptation rates save coexistence of different strategies and hence promote altruism. When one strategy dominates the others without cyclic competition, fast adaptors earn more than slow adaptors. When not, mixture of fast and slow adaptors stabilizes population dynamics, and slow adaptation does not imply inefficiency for a player.     

Language dynamics in finite populations

Any mechanism of language acquisition can only learn a restricted set of grammars. The human brain contains a mechanism for language acquisition which can learn a restricted set of grammars. The theory of this restricted set is universal grammar (UG). UG has to be sufficiently specific to induce linguistic coherence in a population. This phenomenon is known as "coherence threshold". Previously, we have calculated the coherence threshold for deterministic dynamics and infinitely large populations. Here, we extend the framework to stochastic processes and finite populations. If there is selection for communicative function (selective language dynamics), then the analytic results for infinite populations are excellent approximations for finite populations; as expected, finite populations need a slightly higher accuracy of language acquisition to maintain coherence. If there is no selection for communicative function (neutral language dynamics), then linguistic coherence is only possible for finite populations.     

An explicit model for the inbreeding load in the evolutionary analysis of selfing

I present analytical predictions for the equilibrium inbreeding load expected in a population under mutation, selection, and a regular mating system for any population size and for any magnitude and recessivity of the deleterious effects. Using this prediction, I deduce the relative fitness of mutant alleles with small effect on selfing to explore the situations where selfing or outcrossing are expected to evolve. The results obtained are in agreement with previous literature, showing that natural selection is expected to lead to stable equilibria where populations show either complete outcrossing or complete selfing, and that selfing is promoted by large deleterious mutation rates. I find that the evolution of selfing is favored by a large recessivity of deleterious effects, while the magnitude of homozygous deleterious effects only becomes relevant in relatively small populations. This result contradicts the standard assumption that purging in large populations will only promote selfing when homozygous deleterious effects are large, and implies that previously published results obtained assuming lethal mutations in large populations can be extrapolated to nonlethal alleles of similar recessivity. This conclusion and the general approach used in this analysis can be useful in the study of the evolution of mating systems.     

The ideal free distribution: a review and synthesis of the game-theoretic perspective

The Ideal Free Distribution (IFD), introduced by Fretwell and Lucas in [Fretwell, D.S., Lucas, H.L., 1970. On territorial behavior and other factors influencing habitat distribution in birds. Acta Biotheoretica 19, 16-32] to predict how a single species will distribute itself among several patches, is often cited as an example of an evolutionarily stable strategy (ESS). By defining the strategies and payoffs for habitat selection, this article puts the IFD concept in a more general game-theoretic setting of the “habitat selection game”. Within this game-theoretic framework, the article focuses on recent progress in the following directions: (1) studying evolutionarily stable dispersal rates and corresponding dispersal dynamics; (2) extending the concept when population numbers are not fixed but undergo population dynamics; (3) generalizing the IFD to multiple species.For a single species, the article briefly reviews existing results. It also develops a new perspective for Parker’s matching principle, showing that this can be viewed as the IFD of the habitat selection game that models consumer behavior in several resource patches and analyzing complications involved when the model includes resource dynamics as well. For two species, the article first demonstrates that the connection between IFD and ESS is now more delicate by pointing out pitfalls that arise when applying several existing game-theoretic approaches to these habitat selection games. However, by providing a new detailed analysis of dispersal dynamics for predator-prey or competitive interactions in two habitats, it also pinpoints one approach that shows much promise in this general setting, the so-called “two-species ESS”. The consequences of this concept are shown to be related to recent studies of population dynamics combined with individual dispersal and are explored for more species or more patches.     

Cooperation driven by mutations in multi-person Prisoner's Dilemma

The n-person Prisoner's Dilemma is a widely used model for populations where individuals interact in groups. The evolutionary stability of populations has been analysed in the literature for the case where mutations in the population may be considered as isolated events. For this case, and assuming simple trigger strategies and many iterations per game, we analyse the rate of convergence to the evolutionarily stable populations. We find that for some values of the payoff parameters of the Prisoner's Dilemma this rate is so low that the assumption, that mutations in the population are infrequent on that time-scale, is unreasonable. Furthermore, the problem is compounded as the group size is increased. In order to address this issue, we derive a deterministic approximation of the evolutionary dynamics with explicit, stochastic mutation processes, valid when the population size is large. We then analyse how the evolutionary dynamics depends on the following factors: mutation rate, group size, the value of the payoff parameters, and the structure of the initial population. In order to carry out the simulations for groups of more than just a few individuals, we derive an efficient way of calculating the fitness values. We find that when the mutation rate per individual and generation is very low, the dynamics is characterized by populations which are evolutionarily stable. As the mutation rate is increased, other fixed points with a higher degree of cooperation become stable. For some values of the payoff parameters, the system is characterized by (apparently) stable limit cycles dominated by cooperative behaviour. The parameter regions corresponding to high degree of cooperation grow in size with the mutation rate, and in number with the group size. For some parameter values, we find more than one stable fixed point, corresponding to different structures of the initial population.     

Strategy selection in structured populations

Evolutionary game theory studies frequency dependent selection. The fitness of a strategy is not constant, but depends on the relative frequencies of strategies in the population. This type of evolutionary dynamics occurs in many settings of ecology, infectious disease dynamics, animal behavior and social interactions of humans. Traditionally evolutionary game dynamics are studied in well-mixed populations, where the interaction between any two individuals is equally likely. There have also been several approaches to study evolutionary games in structured populations. In this paper we present a simple result that holds for a large variety of population structures. We consider the game between two strategies, A and B, described by the payoff matrix . We study a mutation and selection process. For weak selection strategy A is favored over B if and only if σa+b>c+σd. This means the effect of population structure on strategy selection can be described by a single parameter, σ. We present the values of σ for various examples including the well-mixed population, games on graphs, games in phenotype space and games on sets. We give a proof for the existence of such a σ, which holds for all population structures and update rules that have certain (natural) properties. We assume weak selection, but allow any mutation rate. We discuss the relationship between σ and the critical benefit to cost ratio for the evolution of cooperation. The single parameter, σ, allows us to quantify the ability of a population structure to promote the evolution of cooperation or to choose efficient equilibria in coordination games.     

Evolutionary games and population dynamics: maintenance of cooperation in public goods games

The emergence and abundance of cooperation in nature poses a tenacious and challenging puzzle to evolutionary biology. Cooperative behaviour seems to contradict Darwinian evolution because altruistic individuals increase the fitness of other members of the population at a cost to themselves. Thus, in the absence of supporting mechanisms, cooperation should decrease and vanish, as predicted by classical models for cooperation in evolutionary game theory, such as the Prisoner's Dilemma and public goods games. Traditional approaches to studying the problem of cooperation assume constant population sizes and thus neglect the ecology of the interacting individuals. Here, we incorporate ecological dynamics into evolutionary games and reveal a new mechanism for maintaining cooperation. In public goods games, cooperation can gain a foothold if the population density depends on the average population payoff. Decreasing population densities, due to defection leading to small payoffs, results in smaller interaction group sizes in which cooperation can be favoured. This feedback between ecological dynamics and game dynamics can generate stable coexistence of cooperators and defectors in public goods games. However, this mechanism fails for pairwise Prisoner's Dilemma interactions and the population is driven to extinction. Our model represents natural extension of replicator dynamics to populations of varying densities.