Spatial invasion of cooperation

The evolutionary puzzle of cooperation describes situations where cooperators provide a fitness benefit to other individuals at some cost to themselves. Under Darwinian selection, the evolution of cooperation is a conundrum, whereas non-cooperation (or defection) is not. In the absence of supporting mechanisms, cooperators perform poorly and decrease in abundance. Evolutionary game theory provides a powerful mathematical framework to address the problem of cooperation using the prisoner's dilemma. One well-studied possibility to maintain cooperation is to consider structured populations, where each individual interacts only with a limited subset of the population. This enables cooperators to form clusters such that they are more likely to interact with other cooperators instead of being exploited by defectors. Here we present a detailed analysis of how a few cooperators invade and expand in a world of defectors. If the invasion succeeds, the expansion process takes place in two stages: first, cooperators and defectors quickly establish a local equilibrium and then they uniformly expand in space. The second stage provides good estimates for the global equilibrium frequencies of cooperators and defectors. Under hospitable conditions, cooperators typically form a single, ever growing cluster interspersed with specks of defectors, whereas under more hostile conditions, cooperators form isolated, compact clusters that minimize exploitation by defectors. We provide the first quantitative assessment of the way cooperators arrange in space during invasion and find that the macroscopic properties and the emerging spatial patterns reveal information about the characteristics of the underlying microscopic interactions.     

Spatial effects in social dilemmas

Social dilemmas and the evolutionary conundrum of cooperation are traditionally studied through various kinds of game theoretical models such as the prisoner's dilemma, public goods games, snowdrift games or by-product mutualism. All of them exemplify situations which are characterized by different degrees of conflicting interests between the individuals and the community. In groups of interacting individuals, cooperators produce a common good benefitting the entire group at some cost to themselves, whereas defectors attempt to exploit the resource by avoiding the costly contributions. Based on synergistic or discounted accumulation of cooperative benefits a unifying theoretical framework was recently introduced that encompasses all games that have traditionally been studied separately (Hauert, Michor, Nowak, Doebeli, 2005. Synergy and discounting of cooperation in social dilemmas. J. Theor. Biol., in press.). Within this framework we investigate the effects of spatial structure with limited local interactions on the evolutionary fate of cooperators and defectors. The quantitative effects of space turn out to be quite sensitive to the underlying microscopic update mechanisms but, more general, we demonstrate that in prisoner's dilemma type interactions spatial structure benefits cooperation-although the parameter range is quite limited-whereas in snowdrift type interactions spatial structure may be beneficial too, but often turns out to be detrimental to cooperation.     

The effect of dispersal and neighbourhood in games of cooperation

The prisoner's dilemma (PD) and the snowdrift (SD) games are paradigmatic tools to investigate the origin of cooperation. Whereas spatial structure (e.g. nonrandom spatial distribution of strategies) present in the spatially explicit models facilitates the emergence of cooperation in the PD game, recent investigations have suggested that spatial structure can be unfavourable for cooperation in the SD game. The frequency of cooperators in a spatially explicit SD game can be lower than it would be in an infinitely large well-mixed population. However, the source of this effect cannot be identified with certainty as spatially explicit games differ from well-mixed games in two aspects: (i) they introduce spatial correlations, (ii) and limited neighbourhood. Here we extend earlier investigations to identify the source of this effect, and thus accordingly we study a spatially explicit version of the PD and SD games with varying degrees of dispersal and neighbourhood size. It was found that dispersal favours selfish individuals in both games. We calculated the frequency of cooperators at strong dispersal limit, which in concordance with the numerical results shows that it is the short range of interactions (i.e. limited neighbourhood) and not spatial correlations that decreases the frequency of cooperators in spatially explicit models of populations. Our results demonstrate that spatial correlations are always beneficial to cooperators in both the PD and SD games. We explain the opposite effect of dispersal and neighbourhood structure, and discuss the relevance of distinguishing the two effects in general.     

The shared reward dilemma

One of the most direct human mechanisms of promoting cooperation is rewarding it. We study the effect of sharing a reward among cooperators in the most stringent form of social dilemma, namely the prisoner's dilemma (PD). Specifically, for a group of players that collect payoffs by playing a pairwise PD game with their partners, we consider an external entity that distributes a fixed reward equally among all cooperators. Thus, individuals confront a new dilemma: on the one hand, they may be inclined to choose the shared reward despite the possibility of being exploited by defectors; on the other hand, if too many players do that, cooperators will obtain a poor reward and defectors will outperform them. By appropriately tuning the amount to be shared a vast variety of scenarios arises, including the traditional ones in the study of cooperation as well as more complex situations where unexpected behavior can occur. We provide a complete classification of the equilibria of the n-player game as well as of its evolutionary dynamics.     

Effect of Initial Fraction of Cooperators on Cooperative Behavior in Evolutionary Prisoner's Dilemma Game

We investigate the influence of initial fraction of cooperators on the evolution of cooperation in spatial prisoner''s dilemma games. Compared with the results of heterogeneous networks, we find that there is a relatively low initial fraction of cooperators to guarantee higher equilibrium cooperative level. While this interesting phenomenon is contrary to the commonly shared knowledge that higher initial fraction of cooperators can provide better environment for the evolution of cooperation. To support our outcome, we explore the time courses of cooperation and find that the whole course can be divided into two sequent stages: enduring (END) and expanding (EXP) periods. At the end of END period, thought there is a limited number of cooperator clusters left for the case of low initial setup, these clusters can smoothly expand to hold the whole system in the EXP period. However, for high initial fraction of cooperators, superfluous cooperator clusters hinder their effective expansion, which induces many remaining defectors surrounding the cooperator clusters. Moreover, through intensive analysis, we also demonstrate that when the tendency of three cooperation cluster characteristics (cluster size, cluster number and cluster shape) are consistent within END and EXP periods, the state that maximizes cooperation can be favored.     

Emergence of cooperative linkages by random intensity of selection on a network

By assuming the random intensity of selection, the emergence of cooperation on a network is studied. We constructed an evolutionary model in which an individual plays the prisoner's dilemma game, and updates both its strategy and neighbor connections in response to its relative success in the game. The constant (strong or weak) and random intensities of selection are compared. The random intensities of selection are introduced to realize complex environmental effects on the fitness of each individual. Breaking the links on the network is realized according to fixed global parameters. We found that cooperative clusters emerged when cooperators unilaterally broke the link with defectors. The emergent networks under these conditions had a high clustering coefficient and shared some properties with a scale-free network. In addition, after a cooperator with high fitness emerged circumstantially under the random intensity of selection, we observed that the cooperative linkages emerged and spread rapidly through the network. This situation frequently occurred because of the stochastic effect on the fitness of cooperators. Thus, the origin of such phenomena is qualitatively different from the Lotka-Volterra system in which deterministic processes control the system. Cooperative linkages spread more when defectors maintained many links with cooperators.     

Evolution of cooperation under -person snowdrift games

In the animal world, performing a given task which is beneficial to an entire group requires the cooperation of several individuals of that group who often share the workload required to perform the task. The mathematical framework to study the dynamics of collective action is game theory. Here we study the evolutionary dynamics of cooperators and defectors in a population in which groups of individuals engage in N-person, non-excludable public goods games. We explore an N-person generalization of the well-known two-person snowdrift game. We discuss both the case of infinite and finite populations, taking explicitly into consideration the possible existence of a threshold above which collective action is materialized. Whereas in infinite populations, an N-person snowdrift game (NSG) leads to a stable coexistence between cooperators and defectors, the introduction of a threshold leads to the appearance of a new interior fixed point associated with a coordination threshold. The fingerprints of the stable and unstable interior fixed points still affect the evolutionary dynamics in finite populations, despite evolution leading the population inexorably to a monomorphic end-state. However, when the group size and population size become comparable, we find that spite sets in, rendering cooperation unfeasible.     

Co-evolution of behaviour and social network structure promotes human cooperation

The ubiquity of cooperation in nature is puzzling because cooperators can be exploited by defectors. Recent theoretical work shows that if dynamic networks define interactions between individuals, cooperation is favoured by natural selection. To address this, we compare cooperative behaviour in multiple but independent repeated games between participants in static and dynamic networks. In the latter, participants could break their links after each social interaction. As predicted, we find higher levels of cooperation in dynamic networks. Through biased link breaking (i.e. to defectors) participants affected their social environment. We show that this link-breaking behaviour leads to substantial network clustering and we find primarily cooperators within these clusters. This assortment is remarkable because it occurred on top of behavioural assortment through direct reciprocity and beyond the perception of participants, and represents a self-organized pattern. Our results highlight the importance of the interaction between ecological context and selective pressures on cooperation.     

Direct Sum Matrix Game with Prisoner's Dilemma and Snowdrift Game

A direct sum form is proposed for constructing a composite game from two games, prisoner''s dilemma and snowdrift game. This kind of direct sum form game is called a multiple roles game. The replicator dynamics of the multiple roles game with will-mixed populations is explored. The dynamical behaviors on square lattice are investigated by numerical simulation. It is found that the dynamical behaviors of population on square lattice depend on the mixing proportion of the two simple games. Mixing SD activities to pure PD population inhibits the proportion of cooperators in PD, and mixing PD activities to pure SD population stimulates the proportion of cooperators in SD. Besides spatial reciprocity, our results show that there are roles reciprocities between different types of individuals.     

On the dynamic persistence of cooperation: how lower individual fitness induces higher survivability

We study a model in which cooperation and defection coexist in a dynamical steady state. In our model, subpopulations of cooperators and defectors inhabit sites on a lattice. The interactions among the individuals at a site, in the form of a prisoner's dilemma (PD) game, determine their fitnesses. The chosen PD payoff allows cooperators, but not defectors, to maintain a homogeneous population. Individuals mutate between types and migrate to neighboring sites with low probabilities. We consider both density-dependent and density-independent versions of the model. The persistence of cooperation in this model can be explained in terms of the life cycle of a population at a site. This life cycle starts when one cooperator establishes a population. Then defectors invade and eventually take over, resulting finally in the death of the population. During this life cycle, single cooperators migrate to empty neighboring sites to found new cooperator populations. The system can reach a steady state where cooperation prevails if the global "birth" rate of populations is equal to their global "death" rate. The dynamic persistence of cooperation ranges over a large section of the model's parameter space. We compare these dynamics to those from other models for the persistence of altruism and to predator-prey models.     

Coveting thy neighbors fitness as a means to resolve social dilemmas

In spatial evolutionary games the fitness of each individual is traditionally determined by the payoffs it obtains upon playing the game with its neighbors. Since defection yields the highest individual benefits, the outlook for cooperators is gloomy. While network reciprocity promotes collaborative efforts, chances of averting the impending social decline are slim if the temptation to defect is strong. It is, therefore, of interest to identify viable mechanisms that provide additional support for the evolution of cooperation. Inspired by the fact that the environment may be just as important as inheritance for individual development, we introduce a simple switch that allows a player to either keep its original payoff or use the average payoff of all its neighbors. Depending on which payoff is higher, the influence of either option can be tuned by means of a single parameter. We show that, in general, taking into account the environment promotes cooperation. Yet coveting the fitness of one's neighbors too strongly is not optimal. In fact, cooperation thrives best only if the influence of payoffs obtained in the traditional way is equal to that of the average payoff of the neighborhood. We present results for the prisoner's dilemma and the snowdrift game, for different levels of uncertainty governing the strategy adoption process, and for different neighborhood sizes. Our approach outlines a viable route to increased levels of cooperative behavior in structured populations, but one that requires a thoughtful implementation.     

Spatial Patterns of Prisoner’s Dilemma Game in Metapopulations

Because to defect is the evolutionary stable strategy in the prisoner’s dilemma game (PDG), understanding the mechanism generating and maintaining cooperation in PDG, i.e. the paradox of cooperation, has intrinsic significance for understanding social altruism behaviors. Spatial structure serves as the key to this dilemma. Here, we build the model of spatial PDG under a metapopulation framework: the sub-populations of cooperators and defectors obey the rules in spatial PDG as well as the colonization–extinction process of metapopulations. Using the mean-field approximation and the pair approximation, we obtain the differential equations for the dynamics of occupancy and spatial correlation. Cellular automaton is also built to simulate the spatiotemporal dynamics of the spatial PDG in metapopulations. Join-count statistics are used to measure the spatial correlation as well as the spatial association of the metapopulation. Simulation results show that the distribution is self-organized and that it converges to a static boundary due to the boycotting of cooperators to defectors. Metapopulations can survive even when the colonization rate is lower than the extinction rate due to the compensation of cooperation rewards for extinction debt. With a change of parameters in the model, a metapopulation can consist of pure cooperators, pure defectors, or cooperator–defector coexistence. The necessary condition of cooperation evolution is the local colonization of a metapopulation. The spatial correlation between the cooperators tends to be weaker with the increase in the temptation to defect and the habitat connectivity; yet the spatial correlation between defectors becomes stronger. The relationship between spatial structure and the colonization rate is complicated, especially for cooperators. The metapopulation may undergo a temporary period of prosperity just before the extinction, even while the colonization rate is declining. An erratum to this article can be found at     

Collective Chasing Behavior between Cooperators and Defectors in the Spatial Prisoner’s Dilemma

Cooperation is one of the essential factors for all biological organisms in major evolutionary transitions. Recent studies have investigated the effect of migration for the evolution of cooperation. However, little is known about whether and how an individuals’ cooperativeness coevolves with mobility. One possibility is that mobility enhances cooperation by enabling cooperators to escape from defectors and form clusters; the other possibility is that mobility inhibits cooperation by helping the defectors to catch and exploit the groups of cooperators. In this study we investigate the coevolutionary dynamics by using the prisoner’s dilemma game model on a lattice structure. The computer simulations demonstrate that natural selection maintains cooperation in the form of evolutionary chasing between the cooperators and defectors. First, cooperative groups grow and collectively move in the same direction. Then, mutant defectors emerge and invade the cooperative groups, after which the defectors exploit the cooperators. Then other cooperative groups emerge due to mutation and the cycle is repeated. Here, it is worth noting that, as a result of natural selection, the mobility evolves towards directional migration, but not to random or completely fixed migration. Furthermore, with directional migration, the rate of global population extinction is lower when compared with other cases without the evolution of mobility (i.e., when mobility is preset to random or fixed). These findings illustrate the coevolutionary dynamics of cooperation and mobility through the directional chasing between cooperators and defectors.     

Group-size diversity in public goods games

Public goods games are models of social dilemmas where cooperators pay a cost for the production of a public good while defectors free ride on the contributions of cooperators. In the traditional framework of evolutionary game theory, the payoffs of cooperators and defectors result from interactions in groups formed by binomial sampling from an infinite population. Despite empirical evidence showing that group-size distributions in nature are highly heterogeneous, most models of social evolution assume that the group size is constant. In this article, I remove this assumption and explore the effects of having random group sizes on the evolutionary dynamics of public goods games. By a straightforward application of Jensen's inequality, I show that the outcome of general nonlinear public goods games depends not only on the average group size but also on the variance of the group-size distribution. This general result is illustrated with two nonlinear public goods games (the public goods game with discounting or synergy and the N-person volunteer's dilemma) and three different group-size distributions (Poisson, geometric, and Waring). The results suggest that failing to acknowledge the natural variation of group sizes can lead to an underestimation of the actual level of cooperation exhibited in evolving populations.     

Replicator dynamics of reward & reputation in public goods games

Public goods games have become the mathematical metaphor for game theoretical investigations of cooperative behavior in groups of interacting individuals. Cooperation is a conundrum because cooperators make a sacrifice to benefit others at some cost to themselves. Exploiters or defectors reap the benefits and forgo costs. Despite the fact that groups of cooperators outperform groups of defectors, Darwinian selection or utilitarian principles based on rational choice should favor defectors. In order to overcome this social dilemma, much effort has been expended for investigations pertaining to punishment and sanctioning measures against defectors. Interestingly, the complementary approach to create positive incentives and to reward cooperation has received considerably less attention—despite being heavily advocated in education and social sciences for increasing productivity or preventing conflicts. Here we show that rewards can indeed stimulate cooperation in interaction groups of arbitrary size but, in contrast to punishment, fail to stabilize it. In both cases, however, reputation is essential. The combination of reward and reputation result in complex dynamics dominated by unpredictable oscillations.     

Evolutionary game dynamics with non-uniform interaction rates

The classical setting of evolutionary game theory, the replicator equation, assumes uniform interaction rates. The rate at which individuals meet and interact is independent of their strategies. Here we extend this framework by allowing the interaction rates to depend on the strategies. This extension leads to non-linear fitness functions. We show that a strict Nash equilibrium remains uninvadable for non-uniform interaction rates, but the conditions for evolutionary stability need to be modified. We analyze all games between two strategies. If the two strategies coexist or exclude each other, then the evolutionary dynamics do not change qualitatively, only the location of the equilibrium point changes. If, however, one strategy dominates the other in the classical setting, then the introduction of non-uniform interaction rates can lead to a pair of interior equilibria. For the Prisoner's Dilemma, non-uniform interaction rates allow the coexistence between cooperators and defectors. For the snowdrift game, non-uniform interaction rates change the equilibrium frequency of cooperators.     

ASSORTMENT AND THE EVOLUTION OF GENERALIZED RECIPROCITY

Reciprocity is often invoked to explain cooperation. Reciprocity is cognitively demanding, and both direct and indirect reciprocity require that individuals store information about the propensity of their partners to cooperate. By contrast, generalized reciprocity, wherein individuals help on the condition that they received help previously, only relies on whether an individual received help in a previous encounter. Such anonymous information makes generalized reciprocity hard to evolve in a well‐mixed population, as the strategy will lose out to pure defectors. Here we analyze a model for the evolution of generalized reciprocity, incorporating assortment of encounters, to investigate the conditions under which it will evolve. We show that, in a well‐mixed population, generalized reciprocity cannot evolve. However, incorporating assortment of encounters can favor the evolution of generalized reciprocity in which indiscriminate cooperation and defection are both unstable. We show that generalized reciprocity can evolve under both the prisoner's dilemma and the snowdrift game.     

Public goods games with reward in finite populations

Public goods games paraphrase the problem of cooperation in game theoretical terms. Cooperators contribute to a public good and thereby increase the welfare of others at a cost to themselves. Defectors consume the public good but do not pay its cost and therefore outperform cooperators. Hence, according to genetic or cultural evolution, defectors should be favored and the public good disappear – despite the fact that groups of cooperators are better off than groups of defectors. The maximization of short term individual profits causes the demise of the common resource to the detriment of all. This outcome can be averted by introducing incentives to cooperate. Negative incentives based on the punishment of defectors efficiently stabilize cooperation once established but cannot initiate cooperation. Here we consider the complementary case of positive incentives created by allowing individuals to reward those that contribute to the public good. The finite-population stochastic dynamics of the public goods game with reward demonstrate that reward initiates cooperation by providing an escape hatch out of states of mutual defection. However, in contrast to punishment, reward is unable to stabilize cooperation but, instead, gives rise to a persistent minority of cooperators.     

Synergy and discounting of cooperation in social dilemmas

The emergence and maintenance of cooperation by natural selection is an enduring conundrum in evolutionary biology, which has been studied using a variety of game theoretical models inspired by different biological situations. The most widely studied games are the Prisoner's Dilemma, the Snowdrift game and by-product mutualism for pairwise interactions, as well as Public Goods games in larger groups of interacting individuals. Here, we present a general framework for cooperation in social dilemmas in which all the traditional scenarios can be recovered as special cases. In social dilemmas, cooperators provide a benefit to the group at some cost, while defectors exploit the group by reaping the benefits without bearing the costs of cooperation. Using the concepts of discounting and synergy for describing how benefits accumulate when more than one cooperator is present in a group of interacting individuals, we recover the four basic scenarios of evolutionary dynamics given by (i) dominating defection, (ii) coexistence of defectors and cooperators, (iii) dominating cooperation and (iv) bi-stability, in which cooperators and defectors cannot invade each other. Generically, for groups of three or more interacting individuals further, more complex, dynamics can occur. Our framework provides the first unifying approach to model cooperation in different kinds of social dilemmas.     

Effects of encounter in a population of spatial prisoner’s dilemma players

We study the evolution of cooperation in spatial prisoner’s dilemma games, whereby each player extends its interaction scope by trying to interact with a certain number of encounters randomly chosen from its non-neighbors, in addition to its permanently linked nearest neighbors. Furthermore, the non-neighbors treat the initiative interactions in two scenarios: definitely accepting that from the cooperators, whereas guardedly interacting with defectors with an acceptance probability which may take arbitrary value in [0,1]. Importantly, our results reveal that the proposed encounter mechanism is a potent extrinsic factor that is able to boost cooperation when appropriately adjusting the values of the encounter number and acceptance probability, though rational players would always defect in one-shot encounters, regardless of the action from the counterparts. We hope our studies may help understand that the proposed encounter mechanism is also an important ingredient of a flourishing cooperative society.