The evolution of cooperation by negotiation in a noisy world

Cooperative interactions among individuals are ubiquitous despite the possibility of exploitation by selfish free riders. One mechanism that may promote cooperation is ‘negotiation’: individuals altering their behaviour in response to the behaviour of others. Negotiating individuals decide their actions through a recursive process of reciprocal observation, thereby reducing the possibility of free riding. Evolutionary games with response rules have shown that infinitely many forms of the rule can be evolutionarily stable simultaneously, unless there is variation in individual quality. This potentially restricts the conditions under which negotiation could maintain cooperation. Organisms interact with one another in a noisy world in which cooperative effort and the assessment of effort may be subject to error. Here, we show that such noise can make the number of evolutionarily stable rules finite, even without quality variation, and so noise could help maintain cooperative behaviour. We show that the curvature of the benefit function is the key factor determining whether individuals invest more or less as their partner's investment increases, investing less when the benefit to investment has diminishing returns. If the benefits of low investment are very small then behavioural flexibility tends to promote cooperation, because negotiation enables cooperators to reach large benefits. Under some conditions, this leads to a repeating cycle in which cooperative behaviour rises and falls over time, which may explain between‐population differences in cooperative behaviour. In other conditions, negotiation leads to extremely high levels of cooperative behaviour, suggesting that behavioural flexibility could facilitate the evolution of eusociality in the absence of high relatedness.     

Co‐evolutionary dynamics between public good producers and cheats in the bacterium Pseudomonas aeruginosa

The production of beneficial public goods is common in the microbial world, and so is cheating – the exploitation of public goods by nonproducing mutants. Here, we examine co‐evolutionary dynamics between cooperators and cheats and ask whether cooperators can evolve strategies to reduce the burden of exploitation, and whether cheats in turn can improve their exploitation abilities. We evolved cooperators of the bacterium Pseudomonas aeruginosa, producing the shareable iron‐scavenging siderophore pyoverdine, together with cheats, defective in pyoverdine production but proficient in uptake. We found that cooperators managed to co‐exist with cheats in 56% of all replicates over approximately 150 generations of experimental evolution. Growth and competition assays revealed that co‐existence was fostered by a combination of general adaptions to the media and specific adaptions to the co‐evolving opponent. Phenotypic screening and whole‐genome resequencing of evolved clones confirmed this pattern, and suggest that cooperators became less exploitable by cheats because they significantly reduced their pyoverdine investment. Cheats, meanwhile, improved exploitation efficiency through mutations blocking the costly pyoverdine‐signalling pathway. Moreover, cooperators and cheats evolved reduced motility, a pattern that likely represents adaptation to laboratory conditions, but at the same time also affects social interactions by reducing strain mixing and pyoverdine sharing. Overall, we observed parallel evolution, where co‐existence of cooperators and cheats was enabled by a combination of adaptations to the abiotic and social environment and their interactions.     

Repression of competition favours cooperation: experimental evidence from bacteria

Repression of competition (RC) within social groups has been suggested as a key mechanism driving the evolution of cooperation, because it aligns the individual’s proximate interest with the interest of the group. Despite its enormous potential for explaining cooperation across all levels of biological organization, ranging from fair meiosis, to policing in insect societies, to sanctions in mutualistic interactions between species, there has been no direct experimental test of whether RC favours the spread of cooperators in a well‐mixed population with cheats. To address this, we carried out an experimental evolution study to test the effect of RC upon a cooperative trait – the production of iron‐scavenging siderophore molecules – in the bacterium Pseudomonas aeruginosa. We found that cooperation was favoured when competition between siderophore producers and nonsiderophore‐producing cheats was repressed, but not in a treatment where competition between the two strains was permitted. We further show that RC altered the cost of cooperation, but did not affect the relatedness among interacting individuals. This confirms that RC per se, as opposed to increased relatedness, has driven the observed increase in bacterial cooperation.     

The social evolution of dispersal with public goods cooperation

Selection can favour the evolution of individually costly dispersal if this alleviates competition between relatives. However, conditions that favour altruistic dispersal also mediate selection for other social behaviours, such as public goods cooperation, which in turn is likely to mediate dispersal evolution. Here, we investigate – both experimentally (using bacteria) and theoretically – how social habitat heterogeneity (i.e. the distribution of public goods cooperators and cheats) affects the evolution of dispersal. In addition to recovering the well‐known theoretical result that the optimal level of dispersal increases with genetic relatedness of patch mates, we find both mathematically and experimentally that dispersal is always favoured when average patch occupancy is low, but when average patch occupancy is high, the presence of public goods cheats greatly alters selection for dispersal. Specifically, when public goods cheats are localized to the home patch, higher dispersal rates are favoured, but when cheats are present throughout available patches, lower dispersal rates are favoured. These results highlight the importance of other social traits in driving dispersal evolution.     

Evolution of altruistic cooperation among nascent multicellular organisms

Cooperation is a classic solution to hostile environments that limit individual survival. In extreme cases this may lead to the evolution of new types of biological individuals (e.g., eusocial super‐organisms). We examined the potential for interindividual cooperation to evolve via experimental evolution, challenging nascent multicellular “snowflake yeast” with an environment in which solitary multicellular clusters experienced low survival. In response, snowflake yeast evolved to form cooperative groups composed of thousands of multicellular clusters that typically survive selection. Group formation occurred through the creation of protein aggregates, only arising in strains with high (>2%) rates of cell death. Nonetheless, it was adaptive and repeatable, although ultimately evolutionarily unstable. Extracellular protein aggregates act as a common good, as they can be exploited by cheats that do not contribute to aggregate production. These results highlight the importance of group formation as a mechanism for surviving environmental stress, and underscore the remarkable ease with which even simple multicellular entities may evolve—and lose—novel social traits.     

Defence Cheats Can Degrade Protection of Chemically Defended Prey

Many species defend themselves against enemies using repellent chemicals. An important but unanswered question is why investment in chemical defence is often variable within prey populations. One explanation is that some prey benefit by cheating, paying no costs of defence, but gaining a reduced attack rate because of the presence of defended conspecifics. Two important assumptions about predator behaviour must be met to explain cheating as a stable strategy: first, predators increase attack rates as cheats increase in frequency; second, defended prey survive attacks better than non‐defended conspecifics. We lack data from wild predators that evaluate these hypotheses. Here, we examine how changes in the frequency of non‐defended ‘cheats’ affect predation by wild birds on a group of otherwise defended prey. We presented mealworm larvae that were either edible (‘cheats’) or unpalatable (bitter tasting), and varied the proportion of cheats from 0 to 1 by increments of 0.25. We found strong frequency‐dependent effects on the birds' foraging behaviour, with the proportion of prey attacked increasing nonlinearly with the frequency of cheats. We did not, however, observe that birds taste‐rejected defended prey at the site of capture. One explanation is that wild birds may not assess prey palatability at the site of capture, but do this elsewhere. If so, defended and undefended prey may pay high costs of initial attack and relocation away from ecologically favourable locations. Alternatively, defended prey may not be taste‐rejected because with acute time constraints, wild birds do not have time to make fine‐grained decisions during feeding. We discuss the data in relation to the evolutionary ecology of prey defences.     

Distributed cognition and social brains: reductions in mushroom body investment accompanied the origins of sociality in wasps (Hymenoptera: Vespidae)

The social brain hypothesis assumes the evolution of social behaviour changes animals'' ecological environments, and predicts evolutionary shifts in social structure will be associated with changes in brain investment. Most social brain models to date assume social behaviour imposes additional cognitive challenges to animals, favouring the evolution of increased brain investment. Here, we present a modification of social brain models, which we term the distributed cognition hypothesis. Distributed cognition models assume group members can rely on social communication instead of individual cognition; these models predict reduced brain investment in social species. To test this hypothesis, we compared brain investment among 29 species of wasps (Vespidae family), including solitary species and social species with a wide range of social attributes (i.e. differences in colony size, mode of colony founding and degree of queen/worker caste differentiation). We compared species means of relative size of mushroom body (MB) calyces and the antennal to optic lobe ratio, as measures of brain investment in central processing and peripheral sensory processing, respectively. In support of distributed cognition predictions, and in contrast to patterns seen among vertebrates, MB investment decreased from solitary to social species. Among social species, differences in colony founding, colony size and caste differentiation were not associated with brain investment differences. Peripheral lobe investment did not covary with social structure. These patterns suggest the strongest changes in brain investment—a reduction in central processing brain regions—accompanied the evolutionary origins of eusociality in Vespidae.     

Cooperation and conflict: field experiments in Northern Ireland

The idea that cohesive groups, in which individuals help each other, have a competitive advantage over groups composed of selfish individuals has been widely suggested as an explanation for the evolution of cooperation in humans. Recent theoretical models propose the coevolution of parochial altruism and intergroup conflict, when in-group altruism and out-group hostility contribute to the group''s success in these conflicts. However, the few empirical attempts to test this hypothesis do not use natural groups and conflate measures of in-group and unbiased cooperative behaviour. We conducted field experiments based on naturalistic measures of cooperation (school/charity donations and lost letters'' returns) with two religious groups with an on-going history of conflict—Catholics and Protestants in Northern Ireland. Conflict was associated with reduced donations to out-group schools and the return of out-group letters, but we found no evidence that it influences in-group cooperation. Rather, socio-economic status was the major determinant of cooperative behaviour. Our study presents a challenge to dominant perspectives on the origins of human cooperation, and has implications for initiatives aiming to promote conflict resolution and social cohesion.     

Investigating the eco-evolutionary response of microbiomes to environmental change

Microorganisms are the primary engines of biogeochemical processes and foundational to the provisioning of ecosystem services to human society. Free-living microbial communities (microbiomes) and their functioning are now known to be highly sensitive to environmental change. Given microorganisms' capacity for rapid evolution, evolutionary processes could play a role in this response. Currently, however, few models of biogeochemical processes explicitly consider how microbial evolution will affect biogeochemical responses to environmental change. Here, we propose a conceptual framework for explicitly integrating evolution into microbiome–functioning relationships. We consider how microbiomes respond simultaneously to environmental change via four interrelated processes that affect overall microbiome functioning (physiological acclimation, demography, dispersal and evolution). Recent evidence in both the laboratory and the field suggests that ecological and evolutionary dynamics occur simultaneously within microbiomes; however, the implications for biogeochemistry under environmental change will depend on the timescales over which these processes contribute to a microbiome's response. Over the long term, evolution may play an increasingly important role for microbially driven biogeochemical responses to environmental change, particularly to conditions without recent historical precedent.     

Phenotypic plasticity of a cooperative behaviour in bacteria

There is strong evidence that natural selection can favour phenotypic plasticity as a mechanism to maximize fitness in animals. Here, we aim to investigate phenotypic plasticity of a cooperative trait in bacteria – the production of an iron‐scavenging molecule (pyoverdin) by Pseudomonas aeruginosa. Pyoverdin production is metabolically costly to the individual cell, but provides a benefit to the local group and can potentially be exploited by nonpyoverdin‐producing cheats. Here, we subject bacteria to changes in the social environment in media with different iron availabilities and test whether cells can adjust pyoverdin production in response to these changes. We found that pyoverdin production per cell significantly decreased at higher cell densities and increased in the presence of cheats. This phenotypic plasticity significantly influenced the costs and benefits of cooperation. Specifically, the investment of resources into pyoverdin production was reduced in iron‐rich environments and at high cell densities, but increased under iron limitation, and when pyoverdin was exploited by cheats. Our study demonstrates that phenotypic plasticity in a cooperative trait as a response to changes in the environment occurs in even the simplest of organisms, a bacterium.     

The evolution of bacterial mutation rates under simultaneous selection by interspecific and social parasitism

Many bacterial populations harbour substantial numbers of hypermutable bacteria, in spite of hypermutation being associated with deleterious mutations. One reason for the persistence of hypermutators is the provision of novel mutations, enabling rapid adaptation to continually changing environments, for example coevolving virulent parasites. However, hypermutation also increases the rate at which intraspecific parasites (social cheats) are generated. Interspecific and intraspecific parasitism are therefore likely to impose conflicting selection pressure on mutation rate. Here, we combine theory and experiments to investigate how simultaneous selection from inter- and intraspecific parasitism affects the evolution of bacterial mutation rates in the plant-colonizing bacterium Pseudomonas fluorescens. Both our theoretical and experimental results suggest that phage presence increases and selection for public goods cooperation (the production of iron-scavenging siderophores) decreases selection for mutator bacteria. Moreover, phages imposed a much greater growth cost than social cheating, and when both selection pressures were imposed simultaneously, selection for cooperation did not affect mutation rate evolution. Given the ubiquity of infectious phages in the natural environment and clinical infections, our results suggest that phages are likely to be more important than social interactions in determining mutation rate evolution.     

Ecological succession,patch age and the evolution of social behaviour and terminal investment

Recent years have witnessed a growing interest in understanding the evolution of social behaviour in heterogeneous spatially structured populations. These studies, however, have neglected the impact of extinction–colonisation dynamics and ecological succession on the dynamical expression of social behaviour over time. Here, I present a kin‐selection model in which patches are structured into age‐classes. I show that ecological succession and patch age lead to highly plastic social phenotypes that vary dramatically as societies age since their initial establishment until their ultimate collapse. I find that the mode of colonisation following dispersal strongly influences the patch age‐dependent trajectories of social phenotypes. When patches are colonised by a random collection of immigrants, aggression is favoured during the build‐up of a society, but it slowly subsides until it eventually gives place to cooperation throughout the later stages of a society's lifespan. When newly established societies are formed by collectives of close relatives, cooperation is favoured during the build‐up of the society as well as when the society nears its eventual collapse. At intermediate societal ages, the genetic structure of the society is sufficiently resilient to the influx of immigrants such that cooperation remains relatively high. Moreover, I report a novel form of social terminal investment, whereby cooperative effort rises when patches approach their collapse. When dispersal is allowed to co‐evolve with cooperation, we observe a sudden rise in dispersal phenotypes before a patch's collapse, and the surprising result that clonal colonisation does not yield significantly higher levels of cooperation than the individual mode of colonisation. More generally, my results show that ecological succession strongly determines the dynamics of kin selection after colonisation, and therefore I expect that these findings will be valuable for understanding behavioural syndromes during range expansion or biological invasions.     

The effect of cheats on siderophore diversity in Pseudomonas aeruginosa

Cooperation can be maintained if cooperative behaviours are preferentially directed towards other cooperative individuals. Tag‐based cooperation (greenbeards) – where cooperation benefits individuals with the same tag as the actor – is one way to achieve this. Tag‐based cooperation can be exploited by individuals who maintain the specific tag but do not cooperate, and selection to escape this exploitation can result in the evolution of tag diversity. We tested key predictions crucial for the evolution of cheat‐mediated tag diversity using the production of iron‐scavenging pyoverdine by the opportunistic pathogen, Pseduomonas aeruginosa as a model system. Using two strains that produce different pyoverdine types and their respective cheats, we show that cheats outcompete their homologous pyoverdine producer, but are outcompeted by the heterologous producer in well‐mixed environments. As a consequence, co‐inoculating two types of pyoverdine producer and one type of pyoverdine cheat resulted in the pyoverdine type whose cheat was not present having a large fitness advantage. Theory suggests that in such interactions, cheats can maintain tag diversity in spatially structured environments, but that tag‐based cooperation will be lost in well‐mixed populations, regardless of tag diversity. We saw that when all pyoverdine producers and cheats were co‐inoculated in well‐mixed environments, both types of pyoverdine producers were outcompeted, whereas spatial structure (agar plates and compost microcosms), rather than maintaining diversity, resulted in the domination of one pyoverdine producer. These results suggest cheats may play a more limited role in the evolution of pyoverdine diversity than predicted.     

When is bigger better? The effects of group size on the evolution of helping behaviours

Understanding the evolution of sociality in humans and other species requires understanding how selection on social behaviour varies with group size. However, the effects of group size are frequently obscured in the theoretical literature, which often makes assumptions that are at odds with empirical findings. In particular, mechanisms are suggested as supporting large‐scale cooperation when they would in fact rapidly become ineffective with increasing group size. Here we review the literature on the evolution of helping behaviours (cooperation and altruism), and frame it using a simple synthetic model that allows us to delineate how the three main components of the selection pressure on helping must vary with increasing group size. The first component is the marginal benefit of helping to group members, which determines both direct fitness benefits to the actor and indirect fitness benefits to recipients. While this is often assumed to be independent of group size, marginal benefits are in practice likely to be maximal at intermediate group sizes for many types of collective action problems, and will eventually become very small in large groups due to the law of decreasing marginal returns. The second component is the response of social partners on the past play of an actor, which underlies conditional behaviour under repeated social interactions. We argue that under realistic conditions on the transmission of information in a population, this response on past play decreases rapidly with increasing group size so that reciprocity alone (whether direct, indirect, or generalised) cannot sustain cooperation in very large groups. The final component is the relatedness between actor and recipient, which, according to the rules of inheritance, again decreases rapidly with increasing group size. These results explain why helping behaviours in very large social groups are limited to cases where the number of reproducing individuals is small, as in social insects, or where there are social institutions that can promote (possibly through sanctioning) large‐scale cooperation, as in human societies. Finally, we discuss how individually devised institutions can foster the transition from small‐scale to large‐scale cooperative groups in human evolution.     

Siderophore-mediated cooperation and virulence in Pseudomonas aeruginosa

Why should organisms cooperate with each other? Helping close relatives that are likely to share the same genes (kin selection) is one important explanation that is likely to apply across taxa. The production of metabolically costly extracellular iron-scavenging molecules (siderophores) by microorganisms is a cooperative behaviour because it benefits nearby conspecifics. We review experiments focusing on the production of the primary siderophore (pyoverdin) of the opportunistic bacterial pathogen, Pseudomonas aeruginosa, which test kin selection theories that seek to explain the evolution of cooperation. First, cooperation is indeed favoured when individuals interact with their close relatives and when there is competition between groups of cooperators and noncooperators, such that the benefit of cooperation can be realized. Second, the relative success of cheats and cooperators is a function of their frequencies within populations. Third, elevated mutation rates can confer a selective disadvantage under conditions when cooperation is beneficial, because high mutation rates reduce how closely bacteria are related to each other. Fourth, cooperative pyoverdin production is also shown to be favoured by kin selection in vivo (caterpillars), and results in more virulent infections. Finally, we briefly outline ongoing and future work using this experimental system.     

The role of the microbiome in the neurobiology of social behaviour

Microbes colonise all multicellular life, and the gut microbiome has been shown to influence a range of host physiological and behavioural phenotypes. One of the most intriguing and least understood of these influences lies in the domain of the microbiome's interactions with host social behaviour, with new evidence revealing that the gut microbiome makes important contributions to animal sociality. However, little is known about the biological processes through which the microbiome might influence host social behaviour. Here, we synthesise evidence of the gut microbiome's interactions with various aspects of host sociality, including sociability, social cognition, social stress, and autism. We discuss evidence of microbial associations with the most likely physiological mediators of animal social interaction. These include the structure and function of regions of the ‘social' brain (the amygdala, the prefrontal cortex, and the hippocampus) and the regulation of ‘social’ signalling molecules (glucocorticoids including corticosterone and cortisol, sex hormones including testosterone, oestrogens, and progestogens, neuropeptide hormones such as oxytocin and arginine vasopressin, and monoamine neurotransmitters such as serotonin and dopamine). We also discuss microbiome‐associated host genetic and epigenetic processes relevant to social behaviour. We then review research on microbial interactions with olfaction in insects and mammals, which contribute to social signalling and communication. Following these discussions, we examine evidence of microbial associations with emotion and social behaviour in humans, focussing on psychobiotic studies, microbe–depression correlations, early human development, autism, and issues of statistical power, replication, and causality. We analyse how the putative physiological mediators of the microbiome–sociality connection may be investigated, and discuss issues relating to the interpretation of results. We also suggest that other candidate molecules should be studied, insofar as they exert effects on social behaviour and are known to interact with the microbiome. Finally, we consider different models of the sequence of microbial effects on host physiological development, and how these may contribute to host social behaviour.     

The genetics of a putative social trait in natural populations of yeast

The sharing of secreted invertase by yeast cells is a well‐established laboratory model for cooperation, but the only evidence that such cooperation occurs in nature is that the SUC loci, which encode invertase, vary in number and functionality. Genotypes that do not produce invertase can act as ‘cheats’ in laboratory experiments, growing on the glucose that is released when invertase producers, or ‘cooperators’, digest sucrose. However, genetic variation for invertase production might instead be explained by adaptation of different populations to different local availabilities of sucrose, the substrate for invertase. Here we find that 110 wild yeast strains isolated from natural habitats, and all contained a single SUC locus and produced invertase; none were ‘cheats’. The only genetic variants we found were three strains isolated instead from sucrose‐rich nectar, which produced higher levels of invertase from three additional SUC loci at their subtelomeres. We argue that the pattern of SUC gene variation is better explained by local adaptation than by social conflict.     

Nonadditive effects of group membership can lead to additive group phenotypes for anti-predator behaviour of guppies, Poecilia reticulata

Nonadditive effects of group membership are generated when individuals respond differently to the same social environment and may alter predictions about how behavioural evolution will occur. Despite this importance, the relationship between an individual's behaviour in two different social contexts and how reciprocal interactions among individuals within groups influence group behaviour are poorly understood. Guppy anti-predator behaviour can be used to explore how individuals behaviourally respond to changes in social context. Individuals from two strains were tested for response to a model predator alone and in groups to evaluate how individuals alter their behaviour in response to social context and how group phenotype relates to individual behaviour. Nonadditive effects of group membership were detected for a number of behaviours, revealing that the effect of being in a group differed among individuals. These nonadditive effects, however, yielded an additive group phenotype. That is, the average behaviour of the group was equal to the average of its parts, for all behaviours in both strains. Such an additive group phenotype may have resulted because all individuals within a group respond to the specific social environment provided by the other members of their group.     

Helping in cooperatively breeding long-tailed tits: a test of Hamilton's rule

Inclusive fitness theory provides the conceptual framework for our current understanding of social evolution, and empirical studies suggest that kin selection is a critical process in the evolution of animal sociality. A key prediction of inclusive fitness theory is that altruistic behaviour evolves when the costs incurred by an altruist (c) are outweighed by the benefit to the recipient (b), weighted by the relatedness of altruist to recipient (r), i.e. Hamilton''s rule rb > c. Despite its central importance in social evolution theory, there have been relatively few empirical tests of Hamilton''s rule, and hardly any among cooperatively breeding vertebrates, leading some authors to question its utility. Here, we use data from a long-term study of cooperatively breeding long-tailed tits Aegithalos caudatus to examine whether helping behaviour satisfies Hamilton''s condition for the evolution of altruism. We show that helpers are altruistic because they incur survival costs through the provision of alloparental care for offspring. However, they also accrue substantial benefits through increased survival of related breeders and offspring, and despite the low average relatedness of helpers to recipients, these benefits of helping outweigh the costs incurred. We conclude that Hamilton''s rule for the evolution of altruistic helping behaviour is satisfied in this species.     

The constant philopater hypothesis: a new life history invariant for dispersal evolution

Surprising invariance relationships have emerged from the study of social interaction, whereby a cancelling‐out of multiple partial effects of genetic, ecological or demographic parameters means that they have no net impact upon the evolution of a social behaviour. Such invariants play a pivotal role in the study of social adaptation: on the one hand, they provide theoretical hypotheses that can be empirically tested; and, on the other hand, they provide benchmark frameworks against which new theoretical developments can be understood. Here we derive a novel invariant for dispersal evolution: the ‘constant philopater hypothesis’ (CPH). Specifically, we find that, irrespective of variation in maternal fecundity, all mothers are favoured to produce exactly the same number of philopatric offspring, with high‐fecundity mothers investing proportionally more, and low‐fecundity mothers investing proportionally less, into dispersing offspring. This result holds for female and male dispersal, under haploid, diploid and haplodiploid modes of inheritance, irrespective of the sex ratio, local resource availability and whether mother or offspring controls the latter's dispersal propensity. We explore the implications of this result for evolutionary conflict of interests – and the exchange and withholding of contextual information – both within and between families, and we show that the CPH is the fundamental invariant that underpins and explains a wider family of invariance relationships that emerge from the study of social evolution.