High strength-of-ties and low mobility enable the evolution of third-party punishment

As punishment can be essential to cooperation and norm maintenance but costly to the punisher, many evolutionary game-theoretic studies have explored how direct punishment can evolve in populations. Compared to direct punishment, in which an agent acts to punish another for an interaction in which both parties were involved, the evolution of third-party punishment (3PP) is even more puzzling, because the punishing agent itself was not involved in the original interaction. Despite significant empirical studies of 3PP, little is known about the conditions under which it can evolve. We find that punishment reputation is not, by itself, sufficient for the evolution of 3PP. Drawing on research streams in sociology and psychology, we implement a structured population model and show that high strength-of-ties and low mobility are critical for the evolution of responsible 3PP. Only in such settings of high social-structural constraint are punishers able to induce self-interested agents toward cooperation, making responsible 3PP ultimately beneficial to individuals as well as the collective. Our results illuminate the conditions under which 3PP is evolutionarily adaptive in populations. Responsible 3PP can evolve and induce cooperation in cases where other mechanisms alone fail to do so.     

Rewards and the evolution of cooperation in public good games

Properly coordinating cooperation is relevant for resolving public good problems, such as clean energy and environmental protection. However, little is known about how individuals can coordinate themselves for a certain level of cooperation in large populations of strangers. In a typical situation, a consensus-building process rarely succeeds, owing to a lack of face and standing. The evolution of cooperation in this type of situation is studied here using threshold public good games, in which cooperation prevails when it is initially sufficient, or otherwise it perishes. While punishment is a powerful tool for shaping human behaviours, institutional punishment is often too costly to start with only a few contributors, which is another coordination problem. Here, we show that whatever the initial conditions, reward funds based on voluntary contribution can evolve. The voluntary reward paves the way for effectively overcoming the coordination problem and efficiently transforms freeloaders into cooperators with a perceived small risk of collective failure.     

The evolution of punishment through reputation

Punishment of non-cooperators has been observed to promote cooperation. Such punishment is an evolutionary puzzle because it is costly to the punisher while beneficial to others, for example, through increased social cohesion. Recent studies have concluded that punishing strategies usually pay less than some non-punishing strategies. These findings suggest that punishment could not have directly evolved to promote cooperation. However, while it is well established that reputation plays a key role in human cooperation, the simple threat from a reputation of being a punisher may not have been sufficiently explored yet in order to explain the evolution of costly punishment. Here, we first show analytically that punishment can lead to long-term benefits if it influences one''s reputation and thereby makes the punisher more likely to receive help in future interactions. Then, in computer simulations, we incorporate up to 40 more complex strategies that use different kinds of reputations (e.g. from generous actions), or strategies that not only include punitive behaviours directed towards defectors but also towards cooperators for example. Our findings demonstrate that punishment can directly evolve through a simple reputation system. We conclude that reputation is crucial for the evolution of punishment by making a punisher more likely to receive help in future interactions, and that experiments investigating the beneficial effects of punishment in humans should include reputation as an explicit feature.     

Conflict, sticks and carrots: war increases prosocial punishments and rewards

Unlike most species, humans cooperate extensively with group members who are not closely related to them, a pattern sustained in part by punishing non-cooperators and rewarding cooperators. Because internally cooperative groups prevail over less cooperative rival groups, it is thought that violent intergroup conflict played a key role in the evolution of human cooperation. Consequently, it is plausible that propensities to punish and reward will be elevated during intergroup conflict. Using experiments conducted before, during and after the 2006 Israel-Hezbollah war, we show that, during wartime, people are more willing to pay costs to punish non-cooperative group members and reward cooperative group members. Rather than simply increasing within-group solidarity, violent intergroup conflict thus elicits behaviours that, writ large, enhance cooperation within the group, thereby making victory more likely.     

Adaptive dynamics of cooperation may prevent the coexistence of defectors and cooperators and even cause extinction

It has recently been demonstrated that ecological feedback mechanisms can facilitate the emergence and maintenance of cooperation in public goods interactions: the replicator dynamics of defectors and cooperators can result, for example, in the ecological coexistence of cooperators and defectors. Here we show that these results change dramatically if cooperation strategy is not fixed but instead is a continuously varying trait under natural selection. For low values of the factor with which the value of resources is multiplied before they are shared among all participants, evolution will always favour lower cooperation strategies until the population falls below an Allee threshold and goes extinct, thus evolutionary suicide occurs. For higher values of the factor, there exists a unique evolutionarily singular strategy, which is convergence stable. Because the fitness function is linear with respect to the strategy of the mutant, this singular strategy is neutral against mutant invasions. This neutrality disappears if a nonlinear functional response in receiving benefits is assumed. For strictly concave functional responses, singular strategies become uninvadable. Evolutionary branching, which could result in the evolutionary emergence of cooperators and defectors, can occur only with locally convex functional responses, but we illustrate that it can also result in coevolutionary extinction.     

三方演化博弈下生态工程质量监管机制

生态工程的实施是实现可持续发展目标, 实现美丽中国建设目标的重要抓手与途径之一, 生态工程在生态系统修复、生态功能与质量提升、促进区域发展与改善人类福祉等方面发挥重要作用。生态工程质量是检验生态工程实施成效是否符合预期目标的试金石, 对改进生态工程质量相关主体管理办法, 高质量完成生态工程实施目标具有重要指导意义。将生态工程相关的三方主体划分为政府监管部门、生态工程企业和第三方检测机构, 构建生态工程质量监管机制理论分析框架, 建立三方非对称动态演化博弈模型, 对各参与方策略选择的演化稳定性和演化路径进行分析仿真, 探究在生态工程质量监管机制运行中各要素的作用和各参与方博弈演化规律。分析结果表明;(1)厘清生态工程质量监管主体的决策机制, 确保生态工程质量监管机制满足参与约束与奖惩相容原则, 必须综合考虑生态工程质量监管各参与主体的个人效益最大化与综合效益最大化的问题。(2)生态工程的奖惩制度对各参与方形成内生性集体驱动, 对生态工程质量监管具有积极催化作用, 能有效压实各参与方责任, 推动生态工程高质量落实落地, 提升生态工程生态效益。(3)生态工程质量监管三方主体的策略选择受多因素耦合驱动, 期望收益与付出成本是决定三方主体行为决策的关键经济性因素, 政府监管部门侧重将生态效益, 社会效益与管理风险管控放在优先位置, 生态工程企业和第三方检测机构通常将自身经济利益放在优先位置。(4)生态工程实施区位的生态战略价值与意义的重要程度与紧迫性, 对三方主体在生态工程质量监管, 生态工程质量保障、生态工程质量成效考核等方面的策略选择具有重要的影响。研究能够为生态工程高质量实施, 保障实现生态工程预期目标, 以及生态工程质量保障体系的相关政策研究提供一定的理论依据。     

False friends are worse than bitter enemies: “Altruistic” punishment of in-group members

One of the most critical features of human society is the pervasiveness of cooperation in social and economic exchanges. Moreover, social scientists have found overwhelming evidence that such cooperative behavior is likely to be directed toward in-group members. We propose that the group-based nature of cooperation includes punishment behavior. Punishment behavior is used to maintain cooperation within systems of social exchange and, thus, is directed towards members of an exchange system. Because social exchanges often take place within groups, we predict that punishment behavior is used to maintain cooperation in the punisher's group. Specifically, punishment behavior is directed toward in-group members who are found to be noncooperators. To examine this, we conducted a gift-giving game experiment with third-party punishment. The results of the experiment (N=90) support the following hypothesis: Participants who are cooperative in a gift-giving game punish noncooperative in-group members more severely than they punish noncooperative out-group members.     

A new route to the evolution of cooperation

The Prisoner's Dilemma (PD) constitutes a widely used metaphor to investigate problems related to the evolution of cooperation. Whenever evolution takes place in well-mixed populations engaged in single rounds of the PD, cooperators cannot resist invasion by defectors, a feature, which is somewhat alleviated whenever populations are spatially distributed. In both cases the populations are characterized by a homogeneous pattern of connectivity, in which every individual is equivalent, sharing the same number of neighbours. Recently, compelling evidence has been accumulated on the strong heterogeneous nature of the network of contacts between individuals in populations. Here we describe the networks of contacts in terms of graphs and show that heterogeneity provides a new mechanism for cooperation to survive. Specifically, we show that cooperators are capable of exploring the heterogeneity of the population structure to become evolutionary competitive. As a result, cooperation becomes the dominating trait in scale-free networks of contacts in which the few highly connected individuals are directly inter-connected, in this way contributing to self-sustain cooperation.     

Evolutionary dynamics in structured populations

Evolutionary dynamics shape the living world around us. At the centre of every evolutionary process is a population of reproducing individuals. The structure of that population affects evolutionary dynamics. The individuals can be molecules, cells, viruses, multicellular organisms or humans. Whenever the fitness of individuals depends on the relative abundance of phenotypes in the population, we are in the realm of evolutionary game theory. Evolutionary game theory is a general approach that can describe the competition of species in an ecosystem, the interaction between hosts and parasites, between viruses and cells, and also the spread of ideas and behaviours in the human population. In this perspective, we review the recent advances in evolutionary game dynamics with a particular emphasis on stochastic approaches in finite sized and structured populations. We give simple, fundamental laws that determine how natural selection chooses between competing strategies. We study the well-mixed population, evolutionary graph theory, games in phenotype space and evolutionary set theory. We apply these results to the evolution of cooperation. The mechanism that leads to the evolution of cooperation in these settings could be called ‘spatial selection’: cooperators prevail against defectors by clustering in physical or other spaces.     

An economic experiment reveals that humans prefer pool punishment to maintain the commons

Punishment can stabilize costly cooperation and ensure the success of a common project that is threatened by free-riders. Punishment mechanisms can be classified into pool punishment, where the punishment act is carried out by a paid third party, (e.g. a police system or a sheriff), and peer punishment, where the punishment act is carried out by peers. Which punishment mechanism is preferred when both are concurrently available within a society? In an economic experiment, we show that the majority of subjects choose pool punishment, despite being costly even in the absence of defectors, when second-order free-riders, cooperators that do not punish, are also punished. Pool punishers are mutually enforcing their support for the punishment organization, stably trapping each other. Our experimental results show how organized punishment could have displaced individual punishment in human societies.     

Outsourcing punishment to God: beliefs in divine control reduce earthly punishment

The sanctioning of norm-transgressors is a necessary--though often costly--task for maintaining a well-functioning society. Prior to effective and reliable secular institutions for punishment, large-scale societies depended on individuals engaging in 'altruistic punishment'--bearing the costs of punishment individually, for the benefit of society. Evolutionary approaches to religion suggest that beliefs in powerful, moralizing Gods, who can distribute rewards and punishments, emerged as a way to augment earthly punishment in large societies that could not effectively monitor norm violations. In five studies, we investigate whether such beliefs in God can replace people's motivation to engage in altruistic punishment, and their support for state-sponsored punishment. Results show that, although religiosity generally predicts higher levels of punishment, the specific belief in powerful, intervening Gods reduces altruistic punishment and support for state-sponsored punishment. Moreover, these effects are specifically owing to differences in people's perceptions that humans are responsible for punishing wrongdoers.     

Individual variation and the resolution of conflict over parental care in penduline tits

Eurasian penduline tits (Remiz pendulinus) have an unusually diverse breeding system consisting of frequent male and female polygamy, and uniparental care by the male or the female. Intriguingly, 30 to 40 per cent of all nests are deserted by both parents. To understand the evolution of this diverse breeding system and frequent clutch desertion, we use 6 years of field data to derive fitness expectations for males and females depending on whether or not they care for their offspring. The resulting payoff matrix corresponds to an asymmetric Snowdrift Game with two alternative evolutionarily stable strategies (ESSs): female-only and male-only care. This, however, does not explain the polymorphism in care strategies and frequent biparental desertion, because theory predicts that one of the two ESSs should have spread to fixation. Using a bootstrapping approach, we demonstrate that taking account of individual variation in payoffs explains the patterns of care better than a model based on the average population payoff matrix. In particular, a model incorporating differences in male attractiveness closely predicts the observed frequencies of male and female desertion. Our work highlights the need for a new generation of individual-based evolutionary game-theoretic models.     

Emergence and resilience of cooperation in the spatial prisoner's dilemma via a reward mechanism

We study the problem of the emergence of cooperation in the spatial Prisoner's Dilemma. The pioneering work by Nowak and May [1992. Evolutionary games and spatial chaos. Nature 415, 424-426] showed that large initial populations of cooperators can survive and sustain cooperation in a square lattice with imitate-the-best evolutionary dynamics. We revisit this problem in a cost-benefit formulation suitable for a number of biological applications. We show that if a fixed-amount reward is established for cooperators to share, a single cooperator can invade a population of defectors and form structures that are resilient to re-invasion even if the reward mechanism is turned off. We discuss analytically the case of the invasion by a single cooperator and present agent-based simulations for small initial fractions of cooperators. Large cooperation levels, in the sustainability range, are found. In the conclusions we discuss possible applications of this model as well as its connections with other mechanisms proposed to promote the emergence of cooperation.     

Mutualism and evolutionary multiplayer games: revisiting the Red King

Coevolution of two species is typically thought to favour the evolution of faster evolutionary rates helping a species keep ahead in the Red Queen race, where ‘it takes all the running you can do to stay where you are’. In contrast, if species are in a mutualistic relationship, it was proposed that the Red King effect may act, where it can be beneficial to evolve slower than the mutualistic species. The Red King hypothesis proposes that the species which evolves slower can gain a larger share of the benefits. However, the interactions between the two species may involve multiple individuals. To analyse such a situation, we resort to evolutionary multiplayer games. Even in situations where evolving slower is beneficial in a two-player setting, faster evolution may be favoured in a multiplayer setting. The underlying features of multiplayer games can be crucial for the distribution of benefits. They also suggest a link between the evolution of the rate of evolution and group size.     

从合作的进化探讨植物与传粉者的相互作用

合作的进化为研究植物–传粉者相互关系提供了新的视角。植物与传粉者通过"报酬换服务"建立种间合作关系。这一合作关系从建立、维持到解体面临着3个关键问题:(1)在植物和传粉者不了解对方质量信息时,双方如何选择出最适伙伴,进而建立合作关系;(2)合作方如何限制欺骗策略(比如,盗蜜和欺骗性传粉)的扩散以维持合作关系;(3)什么过程可导致传粉合作关系的解体。植物与传粉者间信号博弈或筛选博弈可促进二者合作关系的建立。面对欺骗策略,传粉者和植物分别采用伙伴选择机制和防御机制加以应对。合作者与欺骗者的稳定共存也有助于植物–传粉者合作的维持。从合作转向对抗、转向新的伙伴和合作放弃3个过程可导致植物–传粉者的合作关系的解体。植物与传粉者合作关系的理论预期已经得到了部分实验结果支持,深化了我们对植物与传粉者合作过程中关键机制的理解。在今后的研究中,需要进一步探讨以下问题:(1)传粉者对植物信号诚实性的选择作用和植物对传粉者的筛选作用;(2)植物与传粉者各自应对欺骗策略的可能机制及其相对重要性;(3)合作者与欺骗者稳定共存的机制;(4)植物与传粉者合作系统对全球变化的响应。     

Evolution of cooperation with shared costs and benefits

The quest to determine how cooperation evolves can be based on evolutionary game theory, in spite of the fact that evolutionarily stable strategies (ESS) for most non-zero-sum games are not cooperative. We analyse the evolution of cooperation for a family of evolutionary games involving shared costs and benefits with a continuum of strategies from non-cooperation to total cooperation. This cost-benefit game allows the cooperator to share in the benefit of a cooperative act, and the recipient to be burdened with a share of the cooperator's cost. The cost-benefit game encompasses the Prisoner's Dilemma, Snowdrift game and Partial Altruism. The models produce ESS solutions of total cooperation, partial cooperation, non-cooperation and coexistence between cooperation and non-cooperation. Cooperation emerges from an interplay between the nonlinearities in the cost and benefit functions. If benefits increase at a decelerating rate and costs increase at an accelerating rate with the degree of cooperation, then the ESS has an intermediate level of cooperation. The game also exhibits non-ESS points such as unstable minima, convergent-stable minima and unstable maxima. The emergence of cooperative behaviour in this game represents enlightened self-interest, whereas non-cooperative solutions illustrate the Tragedy of the Commons. Games having either a stable maximum or a stable minimum have the property that small changes in the incentive structure (model parameter values) or culture (starting frequencies of strategies) result in correspondingly small changes in the degree of cooperation. Conversely, with unstable maxima or unstable minima, small changes in the incentive structure or culture can result in a switch from non-cooperation to total cooperation (and vice versa). These solutions identify when human or animal societies have the potential for cooperation and whether cooperation is robust or fragile.     

Negotiation may lead selfish individuals to cooperate: the example of the collective vigilance game

Game-theoretical models have been highly influential in behavioural ecology. However, these models generally assume that animals choose their action before observing the behaviour of their opponents while, in many natural situations, individuals in fact continuously react to the actions of others. A negotiation process then takes place and this may fundamentally influence the individual attitudes and the tendency to cooperate. Here, I use the classical model system of vigilance behaviour to demonstrate the consequences of such behavioural negotiation among selfish individuals, by predicting patterns of vigilance in a pair of animals foraging under threat of predation. I show that the game played by the animals and the resulting vigilance strategies take radically different forms, according to the way predation risk is shared in the pair. In particular, if predators choose their target at random, the prey respond by displaying moderate vigilance and taking turns scanning. By contrast, if the individual that takes flight later in an attack endures a higher risk of being targeted, vigilance increases and there is always at least one sentinel in the pair. Finally, when lagging behind its companion in fleeing from an attacker becomes extremely risky, vigilance decreases again and the animals scan simultaneously.