Runaway selection for cooperation and strict-and-severe punishment

Punishing defectors is an important means of stabilizing cooperation. When levels of cooperation and punishment are continuous, individuals must employ suitable social standards for defining defectors and for determining punishment levels. Here we investigate the evolution of a social reaction norm, or psychological response function, for determining the punishment level meted out by individuals in dependence on the cooperation level exhibited by their neighbors in a lattice-structured population. We find that (1) cooperation and punishment can undergo runaway selection, with evolution towards enhanced cooperation and an ever more demanding punishment reaction norm mutually reinforcing each other; (2) this mechanism works best when punishment is strict, so that ambiguities in defining defectors are small; (3) when the strictness of punishment can adapt jointly with the threshold and severity of punishment, evolution favors the strict-and-severe punishment of individuals who offer slightly less than average cooperation levels; (4) strict-and-severe punishment naturally evolves and leads to much enhanced cooperation when cooperation without punishment would be weak and neither cooperation nor punishment are too costly; and (5) such evolutionary dynamics enable the bootstrapping of cooperation and punishment, through which defectors who never punish gradually and steadily evolve into cooperators who punish those they define as defectors.     

Anti-social punishment can prevent the co-evolution of punishment and cooperation

The evolution of cooperation is one of the great puzzles in evolutionary biology. Punishment has been suggested as one solution to this problem. Here punishment is generally defined as incurring a cost to inflict harm on a wrong-doer. In the presence of punishers, cooperators can gain higher payoffs than non-cooperators. Therefore cooperation may evolve as long as punishment is prevalent in the population. Theoretical models have revealed that spatial structure can favor the co-evolution of punishment and cooperation, by allowing individuals to only play and compete with those in their immediate neighborhood. However, those models have usually assumed that punishment is always targeted at non-cooperators. In light of recent empirical evidence of punishment targeted at cooperators, we relax this assumption and study the effect of so-called ‘anti-social punishment’. We find that evolution can favor anti-social punishment, and that when anti-social punishment is possible costly punishment no longer promotes cooperation. As there is no reason to assume that cooperators cannot be the target of punishment during evolution, our results demonstrate serious restrictions on the ability of costly punishment to allow the evolution of cooperation in spatially structured populations. Our results also help to make sense of the empirical observation that defectors will sometimes pay to punish cooperators.     

Understanding Recurrent Crime as System-Immanent Collective Behavior

Containing the spreading of crime is a major challenge for society. Yet, since thousands of years, no effective strategy has been found to overcome crime. To the contrary, empirical evidence shows that crime is recurrent, a fact that is not captured well by rational choice theories of crime. According to these, strong enough punishment should prevent crime from happening. To gain a better understanding of the relationship between crime and punishment, we consider that the latter requires prior discovery of illicit behavior and study a spatial version of the inspection game. Simulations reveal the spontaneous emergence of cyclic dominance between “criminals”, “inspectors”, and “ordinary people” as a consequence of spatial interactions. Such cycles dominate the evolutionary process, in particular when the temptation to commit crime or the cost of inspection are low or moderate. Yet, there are also critical parameter values beyond which cycles cease to exist and the population is dominated either by a stable mixture of criminals and inspectors or one of these two strategies alone. Both continuous and discontinuous phase transitions to different final states are possible, indicating that successful strategies to contain crime can be very much counter-intuitive and complex. Our results demonstrate that spatial interactions are crucial for the evolutionary outcome of the inspection game, and they also reveal why criminal behavior is likely to be recurrent rather than evolving towards an equilibrium with monotonous parameter dependencies.     

Defectors Can Create Conditions That Rescue Cooperation

Cooperation based on the production of costly common goods is observed throughout nature. This is puzzling, as cooperation is vulnerable to exploitation by defectors which enjoy a fitness advantage by consuming the common good without contributing fairly. Depletion of the common good can lead to population collapse and the destruction of cooperation. However, population collapse implies small population size, which, in a structured population, is known to favor cooperation. This happens because small population size increases variability in cooperator frequency across different locations. Since individuals in cooperator-dominated locations (which are most likely cooperators) will grow more than those in defector-dominated locations (which are most likely defectors), cooperators can outgrow defectors globally despite defectors outgrowing cooperators in each location. This raises the possibility that defectors can lead to conditions that sometimes rescue cooperation from defector-induced destruction. We demonstrate multiple mechanisms through which this can occur, using an individual-based approach to model stochastic birth, death, migration, and mutation events. First, during defector-induced population collapse, defectors occasionally go extinct before cooperators by chance, which allows cooperators to grow. Second, empty locations, either preexisting or created by defector-induced population extinction, can favor cooperation because they allow cooperator but not defector migrants to grow. These factors lead to the counterintuitive result that the initial presence of defectors sometimes allows better survival of cooperation compared to when defectors are initially absent. Finally, we find that resource limitation, inducible by defectors, can select for mutations adaptive to resource limitation. When these mutations are initially present at low levels or continuously generated at a moderate rate, they can favor cooperation by further reducing local population size. We predict that in a structured population, small population sizes precipitated by defectors provide a “built-in” mechanism for the persistence of cooperation.     

Defectors,not norm violators,are punished by third-parties

Punishment of defectors and cooperators is prevalent when their behaviour deviates from the social norm. Why atypical behaviour is more likely to be punished than typical behaviour remains unclear. One possible proximate explanation is that individuals simply dislike norm violators. However, an alternative possibility exists: individuals may be more likely to punish atypical behaviour, because the cost of punishment generally increases with the number of individuals that are punished. We used a public goods game with third-party punishment to test whether punishment of defectors was reduced when defecting was typical, as predicted if punishment is responsive to norm violation. The cost of punishment was fixed, regardless of the number of players punished, meaning that it was not more costly to punish typical, relative to atypical, behaviour. Under these conditions, atypical behaviour was not punished more often than typical behaviour. In fact, most punishment was targeted at defectors, irrespective of whether defecting was typical or atypical. We suggest that the reduced punishment of defectors when they are common might often be explained in terms of the costs to the punisher, rather than responses to norm violators.     

For whom is it more beneficial to stop interactions with defectors: Cooperators or defectors?

Cooperation is a mysterious evolutionary phenomenon and its mechanisms require elucidation. When cooperators can stop interactions with defectors, the evolution of cooperation becomes possible; this is one mechanism that facilitates the evolution of cooperation. Here, stopping interactions with defectors is beneficial not only for cooperators but also for defectors. The question then arises, for whom is stopping interactions with defectors more beneficial: cooperators or defectors? By utilizing evolutionary game theory, I addressed this question using a two-player game involving four strategies: (1) cooperators who stop the interaction if the current partner is a defector, (2) cooperators who attempt to maintain a relationship with anyone, (3) defectors who stop the interaction if the current partner is a defector, and (4) defectors who attempt to maintain a relationship with anyone. Our results show that, at equilibrium, the ratio of cooperators who stop the interaction if the current partner is a defector to cooperators who attempt to maintain a relationship with anyone is larger than the ratio of defectors who stop the interaction if the current partner is a defector to defectors who attempt to maintain a relationship with anyone. Thus, cooperators rather than defectors are more likely to stop interactions with defectors at equilibrium. This result is consistent with a previous experimental study in which a positive correlation was detected between the degree of individuals’ cooperativeness and how accurately the individuals recognize whether other individuals are cooperators or defectors. Thus, the theoretical work presented in this study provides relevant insights into the natural phenomena of cooperation and recognition.     

The Co-Evolution of Fairness Preferences and Costly Punishment

We study the co-evolutionary emergence of fairness preferences in the form of other-regarding behavior and its effect on the origination of costly punishment behavior in public good games. Our approach closely combines empirical results from three experiments with an evolutionary simulation model. In this way, we try to fill a gap between the evolutionary theoretical literature on cooperation and punishment on the one hand and the empirical findings from experimental economics on the other hand. As a principal result, we show that the evolution among interacting agents inevitably favors a sense for fairness in the form of “disadvantageous inequity aversion”. The evolutionary dominance and stability of disadvantageous inequity aversion is demonstrated by enabling agents to co-evolve with different self- and other-regarding preferences in a competitive environment with limited resources. Disadvantageous inequity aversion leads to the emergence of costly (“altruistic”) punishment behavior and quantitatively explains the level of punishment observed in contemporary lab experiments performed on subjects with a western culture. Our findings corroborate, complement, and interlink the experimental and theoretical literature that has shown the importance of other-regarding behavior in various decision settings.     

An economic experiment reveals that humans prefer pool punishment to maintain the commons

Punishment can stabilize costly cooperation and ensure the success of a common project that is threatened by free-riders. Punishment mechanisms can be classified into pool punishment, where the punishment act is carried out by a paid third party, (e.g. a police system or a sheriff), and peer punishment, where the punishment act is carried out by peers. Which punishment mechanism is preferred when both are concurrently available within a society? In an economic experiment, we show that the majority of subjects choose pool punishment, despite being costly even in the absence of defectors, when second-order free-riders, cooperators that do not punish, are also punished. Pool punishers are mutually enforcing their support for the punishment organization, stably trapping each other. Our experimental results show how organized punishment could have displaced individual punishment in human societies.     

Criminal Defectors Lead to the Emergence of Cooperation in an Experimental,Adversarial Game

While the evolution of cooperation has been widely studied, little attention has been devoted to adversarial settings wherein one actor can directly harm another. Recent theoretical work addresses this issue, introducing an adversarial game in which the emergence of cooperation is heavily reliant on the presence of “Informants,” actors who defect at first-order by harming others, but who cooperate at second-order by punishing other defectors. We experimentally study this adversarial environment in the laboratory with human subjects to test whether Informants are indeed critical for the emergence of cooperation. We find in these experiments that, even more so than predicted by theory, Informants are crucial for the emergence and sustenance of a high cooperation state. A key lesson is that successfully reaching and maintaining a low defection society may require the cultivation of criminals who will also aid in the punishment of others.     

Defectors Cannot Be Detected during“Small Talk” with Strangers

To account for the widespread human tendency to cooperate in one-shot social dilemmas, some theorists have proposed that cooperators can be reliably detected based on ethological displays that are difficult to fake. Experimental findings have supported the view that cooperators can be distinguished from defectors based on “thin slices” of behavior, but the relevant cues have remained elusive, and the role of the judge''s perspective remains unclear. In this study, we followed triadic conversations among unacquainted same-sex college students with unannounced dyadic one-shot prisoner''s dilemmas, and asked participants to guess the PD decisions made toward them and among the other two participants. Two other sets of participants guessed the PD decisions after viewing videotape of the conversations, either with foreknowledge (informed), or without foreknowledge (naïve), of the post-conversation PD. Only naïve video viewers approached better-than-chance prediction accuracy, and they were significantly accurate at predicting the PD decisions of only opposite-sexed conversation participants. Four ethological displays recently proposed to cue defection in one-shot social dilemmas (arms crossed, lean back, hand touch, and face touch) failed to predict either actual defection or guesses of defection by any category of observer. Our results cast doubt on the role of “greenbeard” signals in the evolution of human prosociality, although they suggest that eavesdropping may be more informative about others'' cooperative propensities than direct interaction.     

Replicator dynamics of reward & reputation in public goods games

Public goods games have become the mathematical metaphor for game theoretical investigations of cooperative behavior in groups of interacting individuals. Cooperation is a conundrum because cooperators make a sacrifice to benefit others at some cost to themselves. Exploiters or defectors reap the benefits and forgo costs. Despite the fact that groups of cooperators outperform groups of defectors, Darwinian selection or utilitarian principles based on rational choice should favor defectors. In order to overcome this social dilemma, much effort has been expended for investigations pertaining to punishment and sanctioning measures against defectors. Interestingly, the complementary approach to create positive incentives and to reward cooperation has received considerably less attention—despite being heavily advocated in education and social sciences for increasing productivity or preventing conflicts. Here we show that rewards can indeed stimulate cooperation in interaction groups of arbitrary size but, in contrast to punishment, fail to stabilize it. In both cases, however, reputation is essential. The combination of reward and reputation result in complex dynamics dominated by unpredictable oscillations.     

Cooperation prevails when individuals adjust their social ties

Conventional evolutionary game theory predicts that natural selection favours the selfish and strong even though cooperative interactions thrive at all levels of organization in living systems. Recent investigations demonstrated that a limiting factor for the evolution of cooperative interactions is the way in which they are organized, cooperators becoming evolutionarily competitive whenever individuals are constrained to interact with few others along the edges of networks with low average connectivity. Despite this insight, the conundrum of cooperation remains since recent empirical data shows that real networks exhibit typically high average connectivity and associated single-to-broad–scale heterogeneity. Here, a computational model is constructed in which individuals are able to self-organize both their strategy and their social ties throughout evolution, based exclusively on their self-interest. We show that the entangled evolution of individual strategy and network structure constitutes a key mechanism for the sustainability of cooperation in social networks. For a given average connectivity of the population, there is a critical value for the ratio W between the time scales associated with the evolution of strategy and of structure above which cooperators wipe out defectors. Moreover, the emerging social networks exhibit an overall heterogeneity that accounts very well for the diversity of patterns recently found in acquired data on social networks. Finally, heterogeneity is found to become maximal when W reaches its critical value. These results show that simple topological dynamics reflecting the individual capacity for self-organization of social ties can produce realistic networks of high average connectivity with associated single-to-broad–scale heterogeneity. On the other hand, they show that cooperation cannot evolve as a result of “social viscosity” alone in heterogeneous networks with high average connectivity, requiring the additional mechanism of topological co-evolution to ensure the survival of cooperative behaviour.     

Public goods games with reward in finite populations

Public goods games paraphrase the problem of cooperation in game theoretical terms. Cooperators contribute to a public good and thereby increase the welfare of others at a cost to themselves. Defectors consume the public good but do not pay its cost and therefore outperform cooperators. Hence, according to genetic or cultural evolution, defectors should be favored and the public good disappear – despite the fact that groups of cooperators are better off than groups of defectors. The maximization of short term individual profits causes the demise of the common resource to the detriment of all. This outcome can be averted by introducing incentives to cooperate. Negative incentives based on the punishment of defectors efficiently stabilize cooperation once established but cannot initiate cooperation. Here we consider the complementary case of positive incentives created by allowing individuals to reward those that contribute to the public good. The finite-population stochastic dynamics of the public goods game with reward demonstrate that reward initiates cooperation by providing an escape hatch out of states of mutual defection. However, in contrast to punishment, reward is unable to stabilize cooperation but, instead, gives rise to a persistent minority of cooperators.     

Human Quadrupeds,Primate Quadrupedalism,and Uner Tan Syndrome

Since 2005, an extensive literature documents individuals from several families afflicted with “Uner Tan Syndrome (UTS),” a condition that in its most extreme form is characterized by cerebellar hypoplasia, loss of balance and coordination, impaired cognitive abilities, and habitual quadrupedal gait on hands and feet. Some researchers have interpreted habitual use of quadrupedalism by these individuals from an evolutionary perspective, suggesting that it represents an atavistic expression of our quadrupedal primate ancestry or “devolution.” In support of this idea, individuals with “UTS” are said to use diagonal sequence quadrupedalism, a type of quadrupedal gait that distinguishes primates from most other mammals. Although the use of primate-like quadrupedal gait in humans would not be sufficient to support the conclusion of evolutionary “reversal,” no quantitative gait analyses were presented to support this claim. Using standard gait analysis of 518 quadrupedal strides from video sequences of individuals with “UTS”, we found that these humans almost exclusively used lateral sequence–not diagonal sequence–quadrupedal gaits. The quadrupedal gait of these individuals has therefore been erroneously described as primate-like, further weakening the “devolution” hypothesis. In fact, the quadrupedalism exhibited by individuals with UTS resembles that of healthy adult humans asked to walk quadrupedally in an experimental setting. We conclude that quadrupedalism in healthy adults or those with a physical disability can be explained using biomechanical principles rather than evolutionary assumptions.     

Altruistic Punishment and Between-Group Competition

Collective action, or the large-scale cooperation in the pursuit of public goods, has been suggested to have evolved through cultural group selection. Previous research suggests that the costly punishment of group members who do not contribute to public goods plays an important role in the resolution of collective action dilemmas. If large-scale cooperation sustained by the punishment of defectors has evolved through the mechanism of cultural group selection, two implications regarding costly punishment follow: (1) that people are more willing to punish defecting group members in a situation of intergroup competition than in a single-group social dilemma game and (2) that levels of "perverse" punishment of cooperators are not affected by intergroup competition. We find confirmation for these hypotheses. However, we find that the effect of intergroup competition on the punishment of defectors is fully explained by the stronger conditionality of punishment on expected punishment levels in the competition condition.     

Collective Chasing Behavior between Cooperators and Defectors in the Spatial Prisoner’s Dilemma

Cooperation is one of the essential factors for all biological organisms in major evolutionary transitions. Recent studies have investigated the effect of migration for the evolution of cooperation. However, little is known about whether and how an individuals’ cooperativeness coevolves with mobility. One possibility is that mobility enhances cooperation by enabling cooperators to escape from defectors and form clusters; the other possibility is that mobility inhibits cooperation by helping the defectors to catch and exploit the groups of cooperators. In this study we investigate the coevolutionary dynamics by using the prisoner’s dilemma game model on a lattice structure. The computer simulations demonstrate that natural selection maintains cooperation in the form of evolutionary chasing between the cooperators and defectors. First, cooperative groups grow and collectively move in the same direction. Then, mutant defectors emerge and invade the cooperative groups, after which the defectors exploit the cooperators. Then other cooperative groups emerge due to mutation and the cycle is repeated. Here, it is worth noting that, as a result of natural selection, the mobility evolves towards directional migration, but not to random or completely fixed migration. Furthermore, with directional migration, the rate of global population extinction is lower when compared with other cases without the evolution of mobility (i.e., when mobility is preset to random or fixed). These findings illustrate the coevolutionary dynamics of cooperation and mobility through the directional chasing between cooperators and defectors.     

An experimental study of strong reciprocity in bacteria

Strong reciprocity, whereby cooperators punish non-cooperators, may help to explain the evolutionary success of cooperative behaviours. However, theory suggests that selection for strong reciprocity can depend upon tight genetic linkage between cooperation and punishment, to avoid the strategy being outcompeted by non-punishing cooperators. We tested this hypothesis using experimental populations of the bacterium Pseudomonas aeruginosa, which cooperate by producing iron-scavenging siderophores and, in this context, punish non-cooperators with toxins. Consistent with theory, we show that cooperative punishers can indeed invade cheats, but only when the traits are tightly linked. These results emphasize that punishment is only likely to be favoured when the punishment itself leads to a direct or indirect fitness benefit to the actor.     

Morals Matter in Economic Games

Contrary to predictions from Expected Utility Theory and Game Theory, when making economic decisions in interpersonal situations, people take the interest of others into account and express various forms of solidarity, even in one-shot interactions with anonymous strangers. Research in other-regarding behavior is dominated by behavioral economical and evolutionary biological approaches. Psychological theory building, which addresses mental processes underlying other-regarding behavior, is rare. Based on Relational Models Theory (RMT, [1]) and Relationship Regulation Theory (RRT, [2]) it is proposed that moral motives influence individuals’ decision behavior in interpersonal situations via conscious and unconscious (automatic) processes. To test our propositions we developed the ‘Dyadic Solidarity Game’ and its solitary equivalent, the ‘Self-Insurance Game’. Four experiments, in which the moral motives “Unity” and “Proportionality” were manipulated, support the propositions made. First, it was shown that consciously activated moral motives (via framing of the overall goal of the experiment) and unconsciously activated moral motives (via subliminal priming) influence other-regarding behavior. Second, this influence was only found in interpersonal, not in solitary situations. Third, by combining the analyses of the two experimental games the extent to which participants apply the Golden Rule (“treat others how you wish to be treated”) could be established. Individuals with a “Unity” motive treated others like themselves, whereas individuals with a “Proportionality” motive gave others less then they gave themselves. The four experiments not only support the assumption that morals matter in economic games, they also deliver new insights in how morals matter in economic decision making.     

Social experiments in the mesoscale: humans playing a spatial prisoner's dilemma

Background

The evolutionary origin of cooperation among unrelated individuals remains a key unsolved issue across several disciplines. Prominent among the several mechanisms proposed to explain how cooperation can emerge is the existence of a population structure that determines the interactions among individuals. Many models have explored analytically and by simulation the effects of such a structure, particularly in the framework of the Prisoner''s Dilemma, but the results of these models largely depend on details such as the type of spatial structure or the evolutionary dynamics. Therefore, experimental work suitably designed to address this question is needed to probe these issues.

Methods and Findings

We have designed an experiment to test the emergence of cooperation when humans play Prisoner''s Dilemma on a network whose size is comparable to that of simulations. We find that the cooperation level declines to an asymptotic state with low but nonzero cooperation. Regarding players'' behavior, we observe that the population is heterogeneous, consisting of a high percentage of defectors, a smaller one of cooperators, and a large group that shares features of the conditional cooperators of public goods games. We propose an agent-based model based on the coexistence of these different strategies that is in good agreement with all the experimental observations.

Conclusions

In our large experimental setup, cooperation was not promoted by the existence of a lattice beyond a residual level (around 20%) typical of public goods experiments. Our findings also indicate that both heterogeneity and a “moody” conditional cooperation strategy, in which the probability of cooperating also depends on the player''s previous action, are required to understand the outcome of the experiment. These results could impact the way game theory on graphs is used to model human interactions in structured groups.     

Lattice Model for Influenza Spreading with Spontaneous Behavioral Changes

Individual behavioral response to the spreading of an epidemic plays a crucial role in the progression of the epidemic itself. The risk perception induces individuals to adopt a protective behavior, as for instance reducing their social contacts, adopting more restrictive hygienic measures or undergoing prophylaxis procedures. In this paper, starting with a previously developed lattice-gas SIR model, we construct a coupled behavior-disease model for influenza spreading with spontaneous behavioral changes. The focus is on self-initiated behavioral changes that alter the susceptibility to the disease, without altering the contact patterns among individuals. Three different mechanisms of awareness spreading are analyzed: the local spreading due to the presence in the neighborhood of infective individuals; the global spreading due to the news published by the mass media and to educational campaigns implemented at institutional level; the local spreading occurring through the “thought contagion” among aware and unaware individuals. The peculiarity of the present approach is that the awareness spreading model is calibrated on available data on awareness and concern of the population about the risk of contagion. In particular, the model is validated against the A(H1N1) epidemic outbreak in Italy during the season, by making use of the awareness data gathered by the behavioral risk factor surveillance system (PASSI). We find that, increasing the accordance between the simulated awareness spreading and the PASSI data on risk perception, the agreement between simulated and experimental epidemiological data improves as well. Furthermore, we show that, within our model, the primary mechanism to reproduce a realistic evolution of the awareness during an epidemic, is the one due to globally available information. This result highlights how crucial is the role of mass media and educational campaigns in influencing the epidemic spreading of infectious diseases.