Group-size diversity in public goods games

Public goods games are models of social dilemmas where cooperators pay a cost for the production of a public good while defectors free ride on the contributions of cooperators. In the traditional framework of evolutionary game theory, the payoffs of cooperators and defectors result from interactions in groups formed by binomial sampling from an infinite population. Despite empirical evidence showing that group-size distributions in nature are highly heterogeneous, most models of social evolution assume that the group size is constant. In this article, I remove this assumption and explore the effects of having random group sizes on the evolutionary dynamics of public goods games. By a straightforward application of Jensen's inequality, I show that the outcome of general nonlinear public goods games depends not only on the average group size but also on the variance of the group-size distribution. This general result is illustrated with two nonlinear public goods games (the public goods game with discounting or synergy and the N-person volunteer's dilemma) and three different group-size distributions (Poisson, geometric, and Waring). The results suggest that failing to acknowledge the natural variation of group sizes can lead to an underestimation of the actual level of cooperation exhibited in evolving populations.     

The continuous Prisoner's dilemma: II. Linear reactive strategies with noise.

We present a general model for the Continuous Prisoner's Dilemma and study the effect of errors. We find that cooperative strategies that can resist invasion by defectors are optimistic (make high initial offers), generous (always offer more cooperation than the partner did in the previous round) and uncompromising (offer full cooperation only if the partner does). A necessary condition for the emergence of cooperation in the continuous Prisoner's Dilemma with noise is b (1-p)>c, where b and c denote, respectively, the benefit and cost of cooperation, while p is the error rate. This relation can be reformulated as an error threshold: cooperation can only emerge if the probability of making a mistake is below a critical value. We note, however, that cooperation in the continuous Prisoner's Dilemma with noise does not seem to be evolutionarily stable: while it is possible to find cooperative strategies that resist invasion by defectors, such cooperators are generally invaded by more cooperative strategies which eventually yield to defectors. Thus, the long-term evolution of the continuous Prisoner's Dilemma is either characterized by unending cycles or by stable polymorphisms of cooperators and defectors.     

The durability of public goods changes the dynamics and nature of social dilemmas

An implicit assumption underpins basic models of the evolution of cooperation, mutualism and altruism: The benefits (or pay-offs) of cooperation and defection are defined by the current frequency or distribution of cooperators. In social dilemmas involving durable public goods (group resources that can persist in the environment-ubiquitous from microbes to humans) this assumption is violated. Here, we examine the consequences of relaxing this assumption, allowing pay-offs to depend on both current and past numbers of cooperators. We explicitly trace the dynamic of a public good created by cooperators, and define pay-offs in terms of the current public good. By raising the importance of cooperative history in determining the current fate of cooperators, durable public goods cause novel dynamics (e.g., transient increases in cooperation in Prisoner's Dilemmas, oscillations in Snowdrift Games, or shifts in invasion thresholds in Stag-hunt Games), while changes in durability can transform one game into another, by moving invasion thresholds for cooperation or conditions for coexistence with defectors. This enlarged view challenges our understanding of social cheats. For instance, groups of cooperators can do worse than groups of defectors, if they inherit fewer public goods, while a rise in defectors no longer entails a loss of social benefits, at least not in the present moment (as highlighted by concerns over environmental lags). Wherever durable public goods have yet to reach a steady state (for instance due to external perturbations), the history of cooperation will define the ongoing dynamics of cooperators.     

Cooperation as a volunteer’s dilemma and the strategy of conflict in public goods games

Conflict and cooperation for the exploitation of public goods are usually modelled as an N‐person prisoner’s dilemma. Many social dilemmas, however, would be described more properly as a volunteer’s dilemma, in which a certain number of individuals are necessary to produce a public good. If volunteering is costly, but so is failure to produce the public good, cheaters can invade and form a stable mixed equilibrium with cooperators. The dilemma is that the benefit for the group decreases with group size because the larger the group is, the less likely it is that someone volunteers. This problem persists even in the presence of a high degree of relatedness between group members. This model provides precise, testable predictions for the stability of cooperation. It also suggests a counterintuitive but practical solution for this kind of social dilemmas: increasing the damage resulting from the failure to produce the public good increases the probability that the public good is actually produced. Adopting a strategy that entails a deliberate risk (brinkmanship), therefore, can lead to a benefit for the society without being detrimental for the individual.     

A new route to the evolution of cooperation

The Prisoner's Dilemma (PD) constitutes a widely used metaphor to investigate problems related to the evolution of cooperation. Whenever evolution takes place in well-mixed populations engaged in single rounds of the PD, cooperators cannot resist invasion by defectors, a feature, which is somewhat alleviated whenever populations are spatially distributed. In both cases the populations are characterized by a homogeneous pattern of connectivity, in which every individual is equivalent, sharing the same number of neighbours. Recently, compelling evidence has been accumulated on the strong heterogeneous nature of the network of contacts between individuals in populations. Here we describe the networks of contacts in terms of graphs and show that heterogeneity provides a new mechanism for cooperation to survive. Specifically, we show that cooperators are capable of exploring the heterogeneity of the population structure to become evolutionary competitive. As a result, cooperation becomes the dominating trait in scale-free networks of contacts in which the few highly connected individuals are directly inter-connected, in this way contributing to self-sustain cooperation.     

From local to global dilemmas in social networks

Social networks affect in such a fundamental way the dynamics of the population they support that the global, population-wide behavior that one observes often bears no relation to the individual processes it stems from. Up to now, linking the global networked dynamics to such individual mechanisms has remained elusive. Here we study the evolution of cooperation in networked populations and let individuals interact via a 2-person Prisoner's Dilemma--a characteristic defection dominant social dilemma of cooperation. We show how homogeneous networks transform a Prisoner's Dilemma into a population-wide evolutionary dynamics that promotes the coexistence between cooperators and defectors, while heterogeneous networks promote their coordination. To this end, we define a dynamic variable that allows us to track the self-organization of cooperators when co-evolving with defectors in networked populations. Using the same variable, we show how the global dynamics--and effective dilemma--co-evolves with the motifs of cooperators in the population, the overall emergence of cooperation depending sensitively on this co-evolution.     

Evolutionary games and population dynamics: maintenance of cooperation in public goods games

The emergence and abundance of cooperation in nature poses a tenacious and challenging puzzle to evolutionary biology. Cooperative behaviour seems to contradict Darwinian evolution because altruistic individuals increase the fitness of other members of the population at a cost to themselves. Thus, in the absence of supporting mechanisms, cooperation should decrease and vanish, as predicted by classical models for cooperation in evolutionary game theory, such as the Prisoner's Dilemma and public goods games. Traditional approaches to studying the problem of cooperation assume constant population sizes and thus neglect the ecology of the interacting individuals. Here, we incorporate ecological dynamics into evolutionary games and reveal a new mechanism for maintaining cooperation. In public goods games, cooperation can gain a foothold if the population density depends on the average population payoff. Decreasing population densities, due to defection leading to small payoffs, results in smaller interaction group sizes in which cooperation can be favoured. This feedback between ecological dynamics and game dynamics can generate stable coexistence of cooperators and defectors in public goods games. However, this mechanism fails for pairwise Prisoner's Dilemma interactions and the population is driven to extinction. Our model represents natural extension of replicator dynamics to populations of varying densities.     

Optimality under noise: higher memory strategies for the alternating prisoner's dilemma.

The Alternating Prisoner's Dilemma is a variant of the iterated Prisoner's Dilemma in which the players alternate in the roles of actor and recipient. We searched for strategies which are "optimal" in the Alternating Prisoner's Dilemma with noise (a non-zero probability that a player's decision will be transmitted incorrectly). In order to achieve success against a variety of other strategies, a strategy must be "self-cooperating" (able to achieve mutual cooperation with its clone), "C-exploiting" (able to exploit unconditional cooperators), and "D-unexploitable" (able to resist exploitation by defectors). It must also have high evolutionary "dominance", a general measure of evolutionary performance which considers both resistance to invasion and the ability to invade other strategies. A strategy which meets these optimality criteria can evolve cooperation by invading a population of defectors and establishing a stable cooperative society. Most of the strategies commonly discussed in the Alternating Prisoner's Dilemma literature are low-memory strategies such as Tit For Tat, Pavlov, and Firm But Fair, but none of these strategies can simultaneously meet all of the optimality criteria. However, we discovered a class of higher memory "Firm Pavlov" strategies, which not only meet our stringent optimality criteria, but also achieve remarkable success in round-robin tournaments and evolutionary interactions. These higher memory strategies are friendly enough to cooperate with their clone, pragmatic enough to exploit unconditional cooperators, and wary enough to resist exploitation by defectors: they are truly "optimal under noise" in the Alternating Prisoner's Dilemma.     

Spatial invasion of cooperation

The evolutionary puzzle of cooperation describes situations where cooperators provide a fitness benefit to other individuals at some cost to themselves. Under Darwinian selection, the evolution of cooperation is a conundrum, whereas non-cooperation (or defection) is not. In the absence of supporting mechanisms, cooperators perform poorly and decrease in abundance. Evolutionary game theory provides a powerful mathematical framework to address the problem of cooperation using the prisoner's dilemma. One well-studied possibility to maintain cooperation is to consider structured populations, where each individual interacts only with a limited subset of the population. This enables cooperators to form clusters such that they are more likely to interact with other cooperators instead of being exploited by defectors. Here we present a detailed analysis of how a few cooperators invade and expand in a world of defectors. If the invasion succeeds, the expansion process takes place in two stages: first, cooperators and defectors quickly establish a local equilibrium and then they uniformly expand in space. The second stage provides good estimates for the global equilibrium frequencies of cooperators and defectors. Under hospitable conditions, cooperators typically form a single, ever growing cluster interspersed with specks of defectors, whereas under more hostile conditions, cooperators form isolated, compact clusters that minimize exploitation by defectors. We provide the first quantitative assessment of the way cooperators arrange in space during invasion and find that the macroscopic properties and the emerging spatial patterns reveal information about the characteristics of the underlying microscopic interactions.     

Evolution in group-structured populations can resolve the tragedy of the commons

Public goods are the key features of all human societies and are also important in many animal societies. Collaborative hunting and collective defence are but two examples of public goods that have played a crucial role in the development of human societies and still play an important role in many animal societies. Public goods allow societies composed largely of cooperators to outperform societies composed mainly of non-cooperators. However, public goods also provide an incentive for individuals to be selfish by benefiting from the public good without contributing to it. This is the essential paradox of cooperation-known variously as the Tragedy of the Commons, Multi-person Prisoner's Dilemma or Social Dilemma. Here, we show that a new model for evolution in group-structured populations provides a simple and effective mechanism for the emergence and maintenance of cooperation in such a social dilemma. This model does not depend on kin selection, direct or indirect reciprocity, punishment, optional participation or trait-group selection. Since this mechanism depends only on population dynamics and requires no cognitive abilities on the part of the agents concerned, it potentially applies to organisms at all levels of complexity.     

Public goods games with reward in finite populations

Public goods games paraphrase the problem of cooperation in game theoretical terms. Cooperators contribute to a public good and thereby increase the welfare of others at a cost to themselves. Defectors consume the public good but do not pay its cost and therefore outperform cooperators. Hence, according to genetic or cultural evolution, defectors should be favored and the public good disappear – despite the fact that groups of cooperators are better off than groups of defectors. The maximization of short term individual profits causes the demise of the common resource to the detriment of all. This outcome can be averted by introducing incentives to cooperate. Negative incentives based on the punishment of defectors efficiently stabilize cooperation once established but cannot initiate cooperation. Here we consider the complementary case of positive incentives created by allowing individuals to reward those that contribute to the public good. The finite-population stochastic dynamics of the public goods game with reward demonstrate that reward initiates cooperation by providing an escape hatch out of states of mutual defection. However, in contrast to punishment, reward is unable to stabilize cooperation but, instead, gives rise to a persistent minority of cooperators.     

Synergy and discounting of cooperation in social dilemmas

The emergence and maintenance of cooperation by natural selection is an enduring conundrum in evolutionary biology, which has been studied using a variety of game theoretical models inspired by different biological situations. The most widely studied games are the Prisoner's Dilemma, the Snowdrift game and by-product mutualism for pairwise interactions, as well as Public Goods games in larger groups of interacting individuals. Here, we present a general framework for cooperation in social dilemmas in which all the traditional scenarios can be recovered as special cases. In social dilemmas, cooperators provide a benefit to the group at some cost, while defectors exploit the group by reaping the benefits without bearing the costs of cooperation. Using the concepts of discounting and synergy for describing how benefits accumulate when more than one cooperator is present in a group of interacting individuals, we recover the four basic scenarios of evolutionary dynamics given by (i) dominating defection, (ii) coexistence of defectors and cooperators, (iii) dominating cooperation and (iv) bi-stability, in which cooperators and defectors cannot invade each other. Generically, for groups of three or more interacting individuals further, more complex, dynamics can occur. Our framework provides the first unifying approach to model cooperation in different kinds of social dilemmas.     

Cooperation in two-person evolutionary games with complex personality profiles

We propose a theory of evolution of social systems which generalizes the standard proportional fitness rule of the evolutionary game theory. The formalism is applied to describe the dynamics of two-person one-shot population games. In particular it predicts the non-zero level of cooperation in the long run for the Prisoner's Dilemma games, the increase of the fraction of cooperators for general classes of the Snow-Drift game, and stable nonzero cooperation level for coordination games.     

Spatial effects in social dilemmas

Social dilemmas and the evolutionary conundrum of cooperation are traditionally studied through various kinds of game theoretical models such as the prisoner's dilemma, public goods games, snowdrift games or by-product mutualism. All of them exemplify situations which are characterized by different degrees of conflicting interests between the individuals and the community. In groups of interacting individuals, cooperators produce a common good benefitting the entire group at some cost to themselves, whereas defectors attempt to exploit the resource by avoiding the costly contributions. Based on synergistic or discounted accumulation of cooperative benefits a unifying theoretical framework was recently introduced that encompasses all games that have traditionally been studied separately (Hauert, Michor, Nowak, Doebeli, 2005. Synergy and discounting of cooperation in social dilemmas. J. Theor. Biol., in press.). Within this framework we investigate the effects of spatial structure with limited local interactions on the evolutionary fate of cooperators and defectors. The quantitative effects of space turn out to be quite sensitive to the underlying microscopic update mechanisms but, more general, we demonstrate that in prisoner's dilemma type interactions spatial structure benefits cooperation-although the parameter range is quite limited-whereas in snowdrift type interactions spatial structure may be beneficial too, but often turns out to be detrimental to cooperation.     

Evolutionary game dynamics with non-uniform interaction rates

The classical setting of evolutionary game theory, the replicator equation, assumes uniform interaction rates. The rate at which individuals meet and interact is independent of their strategies. Here we extend this framework by allowing the interaction rates to depend on the strategies. This extension leads to non-linear fitness functions. We show that a strict Nash equilibrium remains uninvadable for non-uniform interaction rates, but the conditions for evolutionary stability need to be modified. We analyze all games between two strategies. If the two strategies coexist or exclude each other, then the evolutionary dynamics do not change qualitatively, only the location of the equilibrium point changes. If, however, one strategy dominates the other in the classical setting, then the introduction of non-uniform interaction rates can lead to a pair of interior equilibria. For the Prisoner's Dilemma, non-uniform interaction rates allow the coexistence between cooperators and defectors. For the snowdrift game, non-uniform interaction rates change the equilibrium frequency of cooperators.     

The good, the bad, and the rare: memory for partners in social interactions

For cooperation to evolve via direct reciprocity, individuals must track their partners' behavior to avoid exploitation. With increasing size of the interaction group, however, memory becomes error prone. To decrease memory effort, people could categorize partners into types, distinguishing cooperators and cheaters. We explored two ways in which people might preferentially track one partner type: remember cheaters or remember the rare type in the population. We assigned participants to one of three interaction groups which differed in the proportion of computer partners' types (defectors rare, equal proportion, or cooperators rare). We extended research on both hypotheses in two ways. First, participants experienced their partners repeatedly by interacting in Prisoner's Dilemma games. Second, we tested categorization of partners as cooperators or defectors in memory tests after a short and long retention interval (10 min and 1 week). Participants remembered rare partner types better than they remembered common ones at both retention intervals. We propose that the flexibility of responding to the environment suggests an ecologically rational memory strategy in social interactions.     

Invasion of cooperators in lattice populations: Linear and non-linear public good games

A generalized version of the N-person volunteer's dilemma (NVD) Game has been suggested recently for illustrating the problem of N-person social dilemmas. Using standard replicator dynamics it can be shown that coexistence of cooperators and defectors is typical in this model. However, the question of how a rare mutant cooperator could invade a population of defectors is still open.     

Does mobility decrease cooperation?

We explore the minimal conditions for sustainable cooperation on a spatially distributed population of memoryless, unconditional strategies (cooperators and defectors) in presence of unbiased, non-contingent mobility in the context of the Prisoner's Dilemma game. We find that cooperative behavior is not only possible but may even be enhanced by such an "always-move" rule, when compared with the strongly viscous ("never-move") case. In addition, mobility also increases the capability of cooperation to emerge and invade a population of defectors, what may have a fundamental role in the problem of the onset of cooperation.     

Replicator dynamics of reward & reputation in public goods games

Public goods games have become the mathematical metaphor for game theoretical investigations of cooperative behavior in groups of interacting individuals. Cooperation is a conundrum because cooperators make a sacrifice to benefit others at some cost to themselves. Exploiters or defectors reap the benefits and forgo costs. Despite the fact that groups of cooperators outperform groups of defectors, Darwinian selection or utilitarian principles based on rational choice should favor defectors. In order to overcome this social dilemma, much effort has been expended for investigations pertaining to punishment and sanctioning measures against defectors. Interestingly, the complementary approach to create positive incentives and to reward cooperation has received considerably less attention—despite being heavily advocated in education and social sciences for increasing productivity or preventing conflicts. Here we show that rewards can indeed stimulate cooperation in interaction groups of arbitrary size but, in contrast to punishment, fail to stabilize it. In both cases, however, reputation is essential. The combination of reward and reputation result in complex dynamics dominated by unpredictable oscillations.     

Escape from Prisoner's Dilemma in RNA phage phi6

We previously examined competitive interactions among viruses by allowing the RNA phage phi6 to evolve at high and low multiplicities of infection (ratio of infecting viruses to bacterial cells). Derived high-multiplicity phages were competitively advantaged relative to their ancestors during coinfection, but their fixation caused population fitness to decline. These data conform to the evolution of lowered fitness in a population of defectors, as expected from the Prisoner's Dilemma of game theory. However, the generality of this result is unknown; the evolution of viruses at other multiplicities may alter the fitness payoffs associated with conflicting strategies of cooperation and defection. Here we examine the change in matrix variables by propagating the ancestor under strictly clonal conditions, allowing cooperation the chance to evolve. In competitions involving derived cooperators and their selfish counterparts, our data reveal a new outcome where the two strategies are predicted to coexist in a mixed polymorphism. Thus, we demonstrate that the payoff matrix is not a constant in phi6. Rather, clonal selection allows viruses the opportunity to escape the Prisoner's Dilemma. We discuss mechanisms that may afford selfish genotypes an advantage during intrahost competition and the relevance in our system for alternative ecological interactions among viruses.