Evolution of indirect reciprocity by social information: the role of trust and reputation in evolution of altruism

The complexity of human's cooperative behavior cannot be fully explained by theories of kin selection and group selection. If reciprocal altruism is to provide an explanation for altruistic behavior, it would have to depart from direct reciprocity, which requires dyads of individuals to interact repeatedly. For indirect reciprocity to rationalize cooperation among genetically unrelated or even culturally dissimilar individuals, information about the reputation of individuals must be assessed and propagated in a population. Here, we propose a new framework for the evolution of indirect reciprocity by social information: information selectively retrieved from and propagated through dynamically evolving networks of friends and acquaintances. We show that for indirect reciprocity to be evolutionarily stable, the differential probability of trusting and helping a reputable individual over a disreputable individual, at a point in time, must exceed the cost-to-benefit ratio of the altruistic act. In other words, the benefit received by the trustworthy must out-weigh the cost of helping the untrustworthy.     

Asymmetric interaction will facilitate the evolution of cooperation

Explaining the evolution of cooperation remains one of the greatest problems for both biology and social science. The classical theories of cooperation suggest that cooperation equilibrium or evolutionary stable strategy between partners can be maintained through genetic similarity or reciprocity relatedness. These classical theories are based on an assumption that partners interact symmetrically with equal payoffs in a game of cooperation interaction. However, the payoff between partners is usually not equal and therefore they often interact asymmetrically in real cooperative systems. With the Hawk-Dove model, we find that the probability of cooperation between cooperative partners will depend closely on the payoff ratio. The higher the payoff ratio between recipients and cooperative actors, the greater will be the probability of cooperation interaction between involved partners. The greatest probability of conflict between cooperative partners will occur when the payoff between partners is equal. The results show that this asymmetric relationship is one of the key dynamics of the evolution of cooperation, and that pure cooperation strategy (i.e., Nash equilibrium) does not exist in asymmetrical cooperation systems, which well explains the direct conflict observed in almost all of the well documented cooperation systems. The model developed here shows that the cost-to-benefit ratio of cooperation is also negatively correlated with the probability of cooperation interaction. A smaller cost-to-benefit ratio of cooperation might be created by the limited dispersal ability or exit cost of the partners involved, and it will make the punishment of the non-cooperative individuals by the recipient more credible, and therefore make it more possible to maintain stable cooperation interaction.     

Distinctions among reciprocal altruism,kin selection,and cooperation and a model for the initial evolution of beneficent behavior

Reciprocal altruism is usually regarded as distinct from kin selection. However, because reciprocators are likely to establish long-term relations and to deliver most of their aid to other individuals genetically predisposed to reciprocation, most acts of reciprocal altruism should involve indirect increments to inclusive fitness, at least as regards alleles for reciprocation. Thus, as usually defined, reciprocal altruism is not clearly distinct from kin selection because both involve indirect increments to inclusive fitness. We propose a new definition for reciprocal altruism that makes the phenomenon distinct from kin selection and allows for reciprocation between nonrelatives in which current costs exceed future benefits returned to the reciprocal altruist. Cooperation and reciprocal altruism are often considered synonymous or different only in the timing of donating and receiving aid. We show, however, that there are other critical differences between reciprocal altruism and other forms of cooperation, most importantly, the latter often involve no clearly identifiable aid. We propose a four-category system to encompass the range of cooperative and beneficent behaviors that occur in nature (reciprocal altruism, pseudoreciprocity, simultaneous cooperation and by-product beneficence). Reciprocal altruism must involve aid that is returned to an original donor as a result of behavior that has a net cost to an original recipient. Our simplest category of cooperative/beneficent behavior, “by-product beneficence,” occurs when a selfish act also benefits another individual and requires no prior or subsequent interactions between the individuals involved. By-product beneficence may be the primitive state from which more complicated types of cooperative/beneficent behavior evolved. We show via simple models that by-product beneficence can allow for the initial increase of helping behavior in a completely unstructured population although the individuals showing such behavior pay all the costs while sharing the benefits with other individuals. Previous models that attempted to explain the initial increase of cooperative/beneficent behavior were much more complex and were based on the prisoner's dilemma, which does not accurately reflect most forms of cooperation and beneficence that occur in nature.     

Reputation-based partner choice is an effective alternative to indirect reciprocity in solving social dilemmas

When group interests clash with individual ones, maintaining cooperation poses a problem. However, cooperation can be facilitated by introducing reputational incentives. Through indirect reciprocity, people who cooperate in a social dilemma are more likely to receive cooperative acts from others. Another mechanism that enhances group cooperation is reputation-based partner choice, or competitive altruism. According to this framework, cooperators benefit via increased access to cooperative partners. Our study compared the effectiveness of indirect reciprocity and competitive altruism in re-establishing cooperation after the typical decline found during repeated public goods games. Twenty groups of four participants first played a series of public goods games, which confirmed the expected decline. Subsequently, public goods games were alternated with either indirect reciprocity games (in which participants had an opportunity to give to another individual from whom they would never receive a direct return) or competitive altruism games (in which they could choose partners for directly reciprocal interactions). We found that public goods game contributions increased when interspersed with competitive altruism games; they were also higher than in public goods games interspersed with indirect reciprocity games. Investing in reputation by increasing contributions to public goods was a profitable strategy in that it increased returns in subsequent competitive altruism and indirect reciprocity games. There was also some evidence that these returns were greater under competitive altruism than indirect reciprocity. Our findings indicate that strategic reputation building through competitive altruism provides an effective alternative to indirect reciprocity as a means for restoring cooperation in social dilemmas.     

The evolution of reciprocity in sizable groups

Recently, several authors have investigated the evolution of reciprocal altruism using the repeated prisoner's dilemma game. These models suggest that natural selection is likely to favor behavioral strategies leading to reciprocal cooperation when pairs of individuals interact repeatedly in potentially cooperative situations. Using the repeated n-person prisoner's dilemma game, we consider whether reciprocal altruism is also likely to evolve when social interactions involve more individuals. We show that the conditions that allow the evolution of reciprocal cooperation become extremely restrictive as group size increases.     

Effects of information and group structure on evolution of altruism: analysis of two-score model by covariance and contextual analyses

An altruistic individual has to gamble on cooperation to a stranger because it does not know whether the stranger is trustworthy before direct interaction. Nowak and Sigmund (Nature 393 (1998a) 573; J. Theor. Biol. 194 (1998b) 561) presented a new theoretical framework of indirect reciprocal altruism by image scoring game where all individuals are informed about a partner's behavior from its image score without direct interaction. Interestingly, in a simplified version of the image scoring game, the evolutionarily stability condition for altruism became a similar form of Hamilton's rule, i.e. inequality that the probability of getting correct information is more than the ratio of cost to benefit. Since the Hamilton's rule was derived by evolutionarily stable analysis, the evolutionary meaning of the probability of getting correct information has not been clearly examined in terms of kin and group selection. In this study, we applied covariance analysis to the two-score model for deriving the Hamilton's rule. We confirmed that the probability of getting correct information was proportional to the bias of altruistic interactions caused by using information about a partner's image score. The Hamilton's rule was dependent on the number of game bouts even though the information reduced the risk of cooperation to selfish one at the first encounter. In addition, we incorporated group structure to the two-score model to examine whether the probability of getting correct information affect selection for altruism by group selection. We calculated a Hamilton's rule of group selection by contextual analysis. Group selection is very effective when either the probability of getting correct information or that of future interaction, or both are low. The two Hamilton's rules derived by covariance and contextual analyses demonstrated the effects of information and group structure on the evolution of altruism. We inferred that information about a partner's behavior and group structure can produce flexible pathways for the evolution of altruism.     

The evolution of helping and harming on graphs: the return of the inclusive fitness effect

Evolutionary graph theory has been proposed as providing new fundamental rules for the evolution of co‐operation and altruism. But how do these results relate to those of inclusive fitness theory? Here, we carry out a retrospective analysis of the models for the evolution of helping on graphs of Ohtsuki et al. [Nature (2006) 441, 502] and Ohtsuki & Nowak [Proc. R. Soc. Lond. Ser. B Biol. Sci (2006) 273, 2249]. We show that it is possible to translate evolutionary graph theory models into classical kin selection models without disturbing at all the mathematics describing the net effect of selection on helping. Model analysis further demonstrates that costly helping evolves on graphs through limited dispersal and overlapping generations. These two factors are well known to promote relatedness between interacting individuals in spatially structured populations. By allowing more than one individual to live at each node of the graph and by allowing interactions to vary with the distance between nodes, our inclusive fitness model allows us to consider a wider range of biological scenarios leading to the evolution of both helping and harming behaviours on graphs.     

Evolution of cooperative cross-feeding could be less challenging than originally thought

The act of cross-feeding whereby unrelated species exchange nutrients is a common feature of microbial interactions and could be considered a form of reciprocal altruism or reciprocal cooperation. Past theoretical work suggests that the evolution of cooperative cross-feeding in nature may be more challenging than for other types of cooperation. Here we re-evaluate a mathematical model used previously to study persistence of cross-feeding and conclude that the maintenance of cross-feeding interactions could be favoured for a larger parameter ranges than formerly observed. Strikingly, we also find that large populations of cross-feeders are not necessarily vulnerable to extinction from an initially small number of cheats who receive the benefit of cross-feeding but do not reciprocate in this cooperative interaction. This could explain the widespread cooperative cross-feeding observed in natural populations.     

Kin selection and coefficients of relatedness in family-structured populations with inbreeding

We consider family specific fitnesses that depend on mixed strategies of two basic phenotypes or behaviours. Pairwise interactions are assumed, but they are restricted to occur between sibs. To study the change in frequency of a rare mutant allele, we consider two different forms of weak selection, one applied through small differences in genotypic values determining individual mixed strategies, the other through small differences in viabilities according to the behaviours chosen by interacting sibs. Under these two specific forms of weak selection, we deduce conditions for initial increase in frequency of a rare mutant allele for autosomal genes in the partial selfing model as well as autosomal and sex-linked genes in the partial sib-mating model with selection before mating or selection after mating. With small differences in mixed strategies, we show that conditions for protection of a mutant allele are tantamount to conditions for initial increase in frequency obtained in additive kin selection models. With particular reference to altruism versus selfishness, we provide explicit ranges of values for the selfing or sib-mating rate based on a fixed cost-benefit ratio and the dominance scheme that allow the spreading of a rare mutant allele into the population. This study confirms that more inbreeding does not necessarily promote the evolution of altruism. Under the hypothesis of small differences in viabilities, the situation is much more intricate unless an additive model is assumed. In general however, conditions for initial increase in frequency of a mutant allele can be obtained in terms of fitness effects that depend on the genotypes of interacting individuals or their mates and generalized conditional coefficients of relatedness according to the inbreeding condition of the interacting individuals.     

具资源效应的非对称“鹰鸽博弈”进化稳定分析

解释合作行为的演化一直是生命科学及社会学研究的重要问题之一。经典理论研究大都关注于合作双方对等的情况。然而,在合作系统中的合作双方通常是不对等的,由此可带来博弈双方支付的非对称并影响合作双方的合作行为。该文基于经典的"鹰鸽博弈"模型,同时考虑非对称性相互关系和资源压力的影响,建立了具有强弱之分的四策略(实力强且合作、实力强且不合作、实力弱且合作和实力弱且不合作)非对称博弈模型。结合演化博弈理论及动力系统稳定性理论分析发现:在系统达到稳定状态时,四种策略的比例变化显著地依赖于博弈双方的强弱之比、资源压力及冲突的单位成本收益。对模型的进一步分析显示,当资源充足时,实力强且合作的比例与冲突的单位成本收益负相关;而实力强且不合作、实力弱且不合作的比例都与冲突的单位成本收益正相关,并且随着系统强弱对比增加,实力强且合作及实力强且不合作的比例均增加,而实力弱且不合作的比例将减小。当资源短缺时,模型得出一个有趣的结论,即随着博弈双方的强弱之比的变化,经典的"智猪博弈"与"鹰鸽博弈"可相互转化,该结论将能为不同均衡状态之间的相互转化给出一个动力学解释。     

The adaptive dynamics of altruism in spatially heterogeneous populations

Abstract.— We study the spatial adaptive dynamics of a continuous trait that measures individual investment in altruism. Our study is based on an ecological model of a spatially heterogeneous population from which we derive an appropriate measure of fitness. The analysis of this fitness measure uncovers three different selective processes controlling the evolution of altruism: the direct physiological cost, the indirect genetic benefits of cooperative interactions, and the indirect genetic costs of competition for space. In our model, habitat structure and a continuous life cycle makes the cost of competing for space with relatives negligible. Our study yields a classification of adaptive patterns of altruism according to the shape of the costs of altruism (with decelerating, linear, or accelerating dependence on the investment in altruism). The invasion of altruism occurs readily in species with accelerating costs, but large mutations are critical for altruism to evolve in selfish species with decelerating costs. Strict selfishness is maintained by natural selection only under very restricted conditions. In species with rapidly accelerating costs, adaptation leads to an evolutionarily stable rate of investment in altruism that decreases smoothly with the level of mobility. A rather different adaptive pattern emerges in species with slowly accelerating costs: high altruism evolves at low mobility, whereas a quasi-selfish state is promoted in more mobile species. The high adaptive level of altruism can be predicted solely from habitat connectedness and physiological parameters that characterize the pattern of cost. We also show that environmental changes that cause increased mobility in those highly altruistic species can beget selection-driven self-extinction, which may contribute to the rarity of social species.     

The concepts of asymmetric and symmetric power can help resolve the puzzle of altruistic and cooperative behaviour

Evolutionary theory predicts competition in nature yet altruistic and cooperative behaviour appears to reduce the ability to compete in order to help others compete better. This evolutionary puzzle is usually explained by kin selection where close relatives perform altruistic and cooperative acts to help each other and by reciprocity theory (i.e. direct, indirect and generalized reciprocity) among non‐kin. Here, it is proposed that the concepts of asymmetry and symmetry in power and dominance are critical if we are ever to resolve the puzzle of altruism and cooperation towards non‐kin. Asymmetry in power and dominance is likely to emerge under competition in nature as individuals strive to gain greater access to the scarce resources needed to survive and reproduce successfully. Yet asymmetric power presents serious problems for reciprocity theory in that a dominant individual faces a temptation to cheat in interactions with subordinates that is likely to far outweigh any individual selective benefits gained through reciprocal mechanisms. Furthermore, action taken by subordinates to deter non‐reciprocation by dominants is likely to prove prohibitively costly to their fitness, making successful enforcement of reciprocal mechanisms unlikely. It is also argued here that many apparently puzzling forms of cooperation observed in nature (e.g. cooperative breeding in which unrelated subordinates help dominants to breed) might be best explained by asymmetry in power and dominance. Once it is recognized that individuals in these cooperative interactions are subject to the constraints and opportunities imposed on them by asymmetric power then they can be seen as pursuing a ‘least bad’ strategy to promote individual fitness – one that is nevertheless consistent with evolutionary theory. The concept of symmetric power also provides important insights. It can inhibit reciprocal mechanisms in the sense that symmetric power makes it easier for a cheat to appropriate common resources while incurring fewer penalties. Nevertheless under certain restrictive conditions, symmetric power is seen as likely to promote direct reciprocity through ‘tit for tat’.     

Joint evolution of multiple social traits: a kin selection analysis

General models of the evolution of cooperation, altruism and other social behaviours have focused almost entirely on single traits, whereas it is clear that social traits commonly interact. We develop a general kin-selection framework for the evolution of social behaviours in multiple dimensions. We show that whenever there are interactions among social traits new behaviours can emerge that are not predicted by one-dimensional analyses. For example, a prohibitively costly cooperative trait can ultimately be favoured owing to initial evolution in other (cheaper) social traits that in turn change the cost–benefit ratio of the original trait. To understand these behaviours, we use a two-dimensional stability criterion that can be viewed as an extension of Hamilton''s rule. Our principal example is the social dilemma posed by, first, the construction and, second, the exploitation of a shared public good. We find that, contrary to the separate one-dimensional analyses, evolutionary feedback between the two traits can cause an increase in the equilibrium level of selfish exploitation with increasing relatedness, while both social (production plus exploitation) and asocial (neither) strategies can be locally stable. Our results demonstrate the importance of emergent stability properties of multidimensional social dilemmas, as one-dimensional stability in all component dimensions can conceal multidimensional instability.     

Integrating cooperative breeding into theoretical concepts of cooperation

In cooperative breeding systems, some individuals help to raise offspring that are not their own. While early explanations for such altruistic behaviour were predominantly based on kin selection, recent evidence suggests that direct benefits may be important in the maintenance of cooperation. To date, however, discussions of cooperative breeding have made little reference to more general theories of cooperation between unrelated individuals (while these theories rarely address cooperative breeding). Here, we attempt to integrate the two fields. We identify four key questions that can be used to categorise different mechanisms for the maintenance of cooperative behaviour: (1) whether or not individuals invest in others; (2) whether or not this initial investment elicits a return investment by the beneficiary; (3) whether the interaction is direct, i.e. between two partners, or indirect (involving third parties) and (4) whether only actions that increase the fitness of the partner or also fitness reducing actions (punishment) are involved in the interaction. Asking these questions with regards to concepts in the literature on cooperative breeding, we found that (a) it is often straightforward to relate these concepts to general mechanisms of cooperation, but that (b) a single term (such as 'pay-to-stay', 'group augmentation' or 'prestige') may sometimes subsume two or more distinct mechanisms, and that (c) at least some mechanisms that are thought to be important in cooperative breeding systems have remained largely unexplored in the theoretical literature on the evolution of cooperation. Future theoretical models should incorporate asymmetries in power and pay off structure caused for instance by dominance hierarchies or partner choice, and the use of N-player games. The key challenges for both theoreticians and empiricists will be to integrate the hitherto disparate fields and to disentangle the parallel effects of kin and non-kin based mechanisms of cooperation.     

From quorum to cooperation: lessons from bacterial sociality for evolutionary theory

The study of cooperation and altruism, almost since its inception, has been carried out without reference to the most numerous, diverse and very possibly most cooperative domain of life on the planet: bacteria. This is starting to change, for good reason. Far from being clonal loners, bacteria are highly social creatures capable of astonishingly complex collective behaviour that is mediated, as it is in colonial insects, by chemical communication. The article discusses recent experiments that explore different facets of current theories of the evolution and maintenance of cooperation using bacterial models. Not only do bacteria hold great promise as experimentally tractable, rapidly evolving systems for testing hypotheses, bacterial experiments have already raised interesting questions about the assumptions on which our current understanding of cooperation and altruism rests.     

Group selection in plant populations

Summary Several mechanisms have been proposed for group selection, to account for the evolution of altruistic traits. One type, Neighbourhood models, suggests that individuals react with those immediately around them, but with no recognition mechanism. The organization of plant populations seems especially favorable for this type of selection. The possibility of Neighbourhood selection was investigated by simulating a plant population. It was possible for an altruistic trait to evolve, though only under restricted conditions. The main requirement was gene flow only by very restricted pollen dispersal, and a high benefit : cost ratio in the altruistic relationship. Under conditions favourable for such evolution, the starting frequency of the allele, the initial pattern, and the population size, had little effect. Inbreeding tended to prevent the increase of the altruism allele, though this depended on the mechanism of selfing. Known ecological features of plants are discussed that could be considered altruistic and hence require some form of group selection for their evolution, and whether the benefit : cost requirements are likely to be met. Neighbourhood models of group selection are a possibility in plant populations, and we therefore cannot exclude the possibility of altruism in plants. However, Neighbourhood selection is weak force, unlikely to be effective in the face of opposing individual selection. It may be more important as reinforcement of individual selection.     

Ecological and demographic correlates of cooperation from individual to budding dispersal

Identifying the ecological and demographic factors that promote the evolution of cooperation is a major challenge for evolutionary biologists. Explanations for the adaptive evolution of cooperation seek to determine which factors make reproduction in cooperative groups more favourable than independent breeding or other selfish strategies. A vast majority of the hypotheses posit that cooperative groups emerge in the context of philopatry, high costs of dispersal, high population density and environmental stability. This route to cooperation, however, fails to explain a growing body of empirical evidence in which cooperation is not associated with one or more of these predictors. We propose an alternative evolutionary path towards the emergence of cooperation that accounts for the disparities observed in the current literature. We find that when dispersal is mediated by a group mode of dispersal, commonly termed budding dispersal, our mathematical model reveals an association between cooperation and immigration, lower costs of dispersal, low population density and environmental variability. Furthermore, by studying the continuum from the individual to the partial and full budding mode of dispersal, we can explicitly explain why the correlates of cooperation change under budding. This enables us to outline a general model for the evolution of cooperation that accounts for a substantial amount of empirical evidence. Our results suggest that natural selection may have favoured two major contrasting pathways for the evolution of cooperation depending on a set of key ecological and demographic factors.     

Population Dynamics Constrain the Cooperative Evolution of Cross-Feeding

Cross-feeding is the exchange of nutrients among species of microbes. It has two potential evolutionary origins, one as an exchange of metabolic wastes or byproducts among species, the other as a form of cooperation known as reciprocal altruism. This paper explores the conditions favoring the origin of cooperative cross-feeding between two species. There is an extensive literature on the evolution of cooperation, and some of the requirements for the evolution of cooperative cross-feeding follow from this prior work–specifically the requirement that interactions be limited to small groups of individuals, such as colonies in a spatially structured environment. Evolution of cooperative cross-feeding by a species also requires that cross-feeding from the partner species already exists, so that the cooperating mutant will automatically be reciprocated for its actions. Beyond these considerations, some unintuitive dynamical constraints apply. In particular, the benefit of cooperative cross-feeding applies only in the range of intermediate cell densities. At low density, resource concentrations are too low to offset the cost of cooperation. At high density, resources shared by both species become limiting, and the two species become competitors. These considerations suggest that the evolution of cooperative cross-feeding in nature may be more challenging than for other types of cooperation. However, the principles identified here may enable the experimental evolution of cross-feeding, as born out by a recent study.     

Limited food induces nepotism in drywood termites

The evolution of cooperation and altruistic behaviour where individuals forego their own reproduction to help others reproduce can be explained by kin selection. Depending on the costs and benefits provided, altruism can be evolutionarily favoured if it is directed at close relatives. A considerable body of data supports the role of relatedness as a key determinant of cooperation and conflict within societies. However, the role of ecological factors and, in particular, how these costs and benefits interact with relatedness remains poorly understood. By studying 16 colonies, here I show that in a drywood termite ecological factors determine the importance of relatedness. In colonies with limited food supply, nestmates restrict cooperative interactions mainly to close relatives, while non-discriminative cooperation occurs when food is abundant. This shows for the first time directly the interaction between ecological conditions and relatedness in shaping cooperation.     

The continuous prisoner's dilemma and the evolution of cooperation through reciprocal altruism with variable investment

Understanding the evolutionary origin and persistence of cooperative behavior is a fundamental biological problem. The standard "prisoner's dilemma," which is the most widely adopted framework for studying the evolution of cooperation through reciprocal altruism between unrelated individuals, does not allow for varying degrees of cooperation. Here we study the continuous iterated prisoner's dilemma, in which cooperative investments can vary continuously in each round. This game has been previously considered for a class of reactive strategies in which current investments are based on the partner's previous investment. In the standard iterated prisoner's dilemma, such strategies are inferior to strategies that take into account both players' previous moves, as is exemplified by the evolutionary dominance of "Pavlov" over "tit for tat." Consequently, we extend the analysis of the continuous prisoner's dilemma to a class of strategies in which current investments depend on previous payoffs and, hence, on both players' previous investments. We show, both analytically and by simulation, that payoff-based strategies, which embody the intuitively appealing idea that individuals invest more in cooperative interactions when they profit from these interactions, provide a natural explanation for the gradual evolution of cooperation from an initially noncooperative state and for the maintenance of cooperation thereafter.