Women Tend to Defect in a Social Dilemma Game in Southwest China

Cooperation theories assume that interacting individuals can change their strategies under different expected payoffs, depending on their social status or social situations. When looking at sex differences in cooperation, the existing studies have found that the genders cooperate at similar frequencies. However, the majority of the data originate within Western human societies. In this paper, we explore whether there are gender differences in cooperation in China. An Iterated Prisoner’s Dilemma game with a punishment option was used to gather data about Southwest Chinese subjects in a culture in which men have a hierarchical advantage over women. Results indicate that men invested into partners significantly more than women did (34% ♂ vs. 24% ♀) while women, in turn, were more likely to defect (65% ♀ vs. 50% ♂). In this region, women have customarily held less economic power and they are used to obtain a payoff typically lower than men. We suggest that the women’s willingness to invest in cooperation has decreased throughout evolutionary time, providing us with an illustration of a culturally-driven shift towards a disparity in gender cooperation interests.     

The Art of War: Beyond Memory-one Strategies in Population Games

We show that the history of play in a population game contains exploitable information that can be successfully used by sophisticated strategies to defeat memory-one opponents, including zero determinant strategies. The history allows a player to label opponents by their strategies, enabling a player to determine the population distribution and to act differentially based on the opponent’s strategy in each pairwise interaction. For the Prisoner’s Dilemma, these advantages lead to the natural formation of cooperative coalitions among similarly behaving players and eventually to unilateral defection against opposing player types. We show analytically and empirically that optimal play in population games depends strongly on the population distribution. For example, the optimal strategy for a minority player type against a resident TFT population is ALLC, while for a majority player type the optimal strategy versus TFT players is ALLD. Such behaviors are not accessible to memory-one strategies. Drawing inspiration from Sun Tzu’s the Art of War, we implemented a non-memory-one strategy for population games based on techniques from machine learning and statistical inference that can exploit the history of play in this manner. Via simulation we find that this strategy is essentially uninvadable and can successfully invade (significantly more likely than a neutral mutant) essentially all known memory-one strategies for the Prisoner’s Dilemma, including ALLC (always cooperate), ALLD (always defect), tit-for-tat (TFT), win-stay-lose-shift (WSLS), and zero determinant (ZD) strategies, including extortionate and generous strategies.     

Emergence of Super Cooperation of Prisoner’s Dilemma Games on Scale-Free Networks

Recently, the authors proposed a quantum prisoner’s dilemma game based on the spatial game of Nowak and May, and showed that the game can be played classically. By using this idea, we proposed three generalized prisoner’s dilemma (GPD, for short) games based on the weak Prisoner’s dilemma game, the full prisoner’s dilemma game and the normalized Prisoner’s dilemma game, written by GPD_W, GPD_F and GPD_N respectively. Our games consist of two players, each of which has three strategies: cooperator (C), defector (D) and super cooperator (denoted by Q), and have a parameter γ to measure the entangled relationship between the two players. We found that our generalised prisoner’s dilemma games have new Nash equilibrium principles, that entanglement is the principle of emergence and convergence (i.e., guaranteed emergence) of super cooperation in evolutions of our generalised prisoner’s dilemma games on scale-free networks, that entanglement provides a threshold for a phase transition of super cooperation in evolutions of our generalised prisoner’s dilemma games on scale-free networks, that the role of heterogeneity of the scale-free networks in cooperations and super cooperations is very limited, and that well-defined structures of scale-free networks allow coexistence of cooperators and super cooperators in the evolutions of the weak version of our generalised prisoner’s dilemma games.     

A Theoretical Analysis of Temporal Difference Learning in the Iterated Prisoner’s Dilemma Game

Direct reciprocity is a chief mechanism of mutual cooperation in social dilemma. Agents cooperate if future interactions with the same opponents are highly likely. Direct reciprocity has been explored mostly by evolutionary game theory based on natural selection. Our daily experience tells, however, that real social agents including humans learn to cooperate based on experience. In this paper, we analyze a reinforcement learning model called temporal difference learning and study its performance in the iterated Prisoner’s Dilemma game. Temporal difference learning is unique among a variety of learning models in that it inherently aims at increasing future payoffs, not immediate ones. It also has a neural basis. We analytically and numerically show that learners with only two internal states properly learn to cooperate with retaliatory players and to defect against unconditional cooperators and defectors. Four-state learners are more capable of achieving a high payoff against various opponents. Moreover, we numerically show that four-state learners can learn to establish mutual cooperation for sufficiently small learning rates.     

Evolutionary games on networks and payoff invariance under replicator dynamics

The commonly used accumulated payoff scheme is not invariant with respect to shifts of payoff values when applied locally in degree-inhomogeneous population structures. We propose a suitably modified payoff scheme and we show both formally and by numerical simulation, that it leaves the replicator dynamics invariant with respect to affine transformations of the game payoff matrix. We then show empirically that, using the modified payoff scheme, an interesting amount of cooperation can be reached in three paradigmatic non-cooperative two-person games in populations that are structured according to graphs that have a marked degree inhomogeneity, similar to actual graphs found in society. The three games are the Prisoner’s Dilemma, the Hawks-Doves and the Stag-Hunt. This confirms previous important observations that, under certain conditions, cooperation may emerge in such network-structured populations, even though standard replicator dynamics for mixing populations prescribes equilibria in which cooperation is totally absent in the Prisoner’s Dilemma, and it is less widespread in the other two games.     

Effects of Conformism on the Cultural Evolution of Social Behaviour

Models of cultural evolution study how the distribution of cultural traits changes over time. The dynamics of cultural evolution strongly depends on the way these traits are transmitted between individuals by social learning. Two prominent forms of social learning are payoff-based learning (imitating others that have higher payoffs) and conformist learning (imitating locally common behaviours). How payoff-based and conformist learning affect the cultural evolution of cooperation is currently a matter of lively debate, but few studies systematically analyse the interplay of these forms of social learning. Here we perform such a study by investigating how the interaction of payoff-based and conformist learning affects the outcome of cultural evolution in three social contexts. First, we develop a simple argument that provides insights into how the outcome of cultural evolution will change when more and more conformist learning is added to payoff-based learning. In a social dilemma (e.g. a Prisoner’s Dilemma), conformism can turn cooperation into a stable equilibrium; in an evasion game (e.g. a Hawk-Dove game or a Snowdrift game) conformism tends to destabilize the polymorphic equilibrium; and in a coordination game (e.g. a Stag Hunt game), conformism changes the basin of attraction of the two equilibria. Second, we analyse a stochastic event-based model, revealing that conformism increases the speed of cultural evolution towards pure equilibria. Individual-based simulations as well as the analysis of the diffusion approximation of the stochastic model by and large confirm our findings. Third, we investigate the effect of an increasing degree of conformism on cultural group selection in a group-structured population. We conclude that, in contrast to statements in the literature, conformism hinders rather than promotes the evolution of cooperation.     

Cooperative problem solving in a cooperatively breeding primate (Saguinus oedipus)

We investigated cooperative problem solving in unrelated pairs of the cooperatively breeding cottontop tamarin, Saguinus oedipus, to assess the cognitive basis of cooperative behaviour in this species and to compare abilities with other apes and monkeys. A transparent apparatus was used that required extension of two handles at opposite ends of the apparatus for access to rewards. Resistance was applied to both handles so that two tamarins had to act simultaneously in order to receive rewards. In contrast to several previous studies of cooperation, both tamarins received rewards as a result of simultaneous pulling. The results from two experiments indicated that the cottontop tamarins (1) had a much higher success rate and efficiency of pulling than many of the other species previously studied, (2) adjusted pulling behaviour to the presence or absence of a partner, and (3) spontaneously developed sustained pulling techniques to solve the task. These findings suggest that cottontop tamarins understand the role of the partner in this cooperative task, a cognitive ability widely ascribed only to great apes. The cooperative social system of tamarins, the intuitive design of the apparatus, and the provision of rewards to both participants may explain the performance of the tamarins.     

Iterated prisoner's dilemma in an asocial world dominated by loners, not by defectors

Cooperation among genetically unrelated individuals can arise when pairs of individuals interact repeatedly in the Prisoner’s Dilemma. However, the conditions allowing the evolution of reciprocal cooperation become extremely restrictive as the size of the cooperative group increases, because defectors can exploit cooperators more efficiently in larger groups. Here we consider three strategies: Tit for Tat, defector, and loner. Loner beats defector in a non-cooperative world. However, a cooperative strategy Tit for Tat (TFT₀) that stops cooperation after the first iteration when there is at least one defector in the group, can invade a world of loners, even in sizable groups, if both the TFT₀ and the defector strategies arise at the same frequency by mutation.     

Adaptive Dynamics of Extortion and Compliance

Direct reciprocity is a mechanism for the evolution of cooperation. For the iterated prisoner’s dilemma, a new class of strategies has recently been described, the so-called zero-determinant strategies. Using such a strategy, a player can unilaterally enforce a linear relationship between his own payoff and the co-player’s payoff. In particular the player may act in such a way that it becomes optimal for the co-player to cooperate unconditionally. In this way, a player can manipulate and extort his co-player, thereby ensuring that the own payoff never falls below the co-player’s payoff. However, using a compliant strategy instead, a player can also ensure that his own payoff never exceeds the co-player’s payoff. Here, we use adaptive dynamics to study when evolution leads to extortion and when it leads to compliance. We find a remarkable cyclic dynamics: in sufficiently large populations, extortioners play a transient role, helping the population to move from selfish strategies to compliance. Compliant strategies, however, can be subverted by altruists, which in turn give rise to selfish strategies. Whether cooperative strategies are favored in the long run critically depends on the size of the population; we show that cooperation is most abundant in large populations, in which case average payoffs approach the social optimum. Our results are not restricted to the case of the prisoners dilemma, but can be extended to other social dilemmas, such as the snowdrift game. Iterated social dilemmas in large populations do not lead to the evolution of strategies that aim to dominate their co-player. Instead, generosity succeeds.     

Nodes Having a Major Influence to Break Cooperation Define a Novel Centrality Measure: Game Centrality

Cooperation played a significant role in the self-organization and evolution of living organisms. Both network topology and the initial position of cooperators heavily affect the cooperation of social dilemma games. We developed a novel simulation program package, called ‘NetworGame’, which is able to simulate any type of social dilemma games on any model, or real world networks with any assignment of initial cooperation or defection strategies to network nodes. The ability of initially defecting single nodes to break overall cooperation was called as ‘game centrality’. The efficiency of this measure was verified on well-known social networks, and was extended to ‘protein games’, i.e. the simulation of cooperation between proteins, or their amino acids. Hubs and in particular, party hubs of yeast protein-protein interaction networks had a large influence to convert the cooperation of other nodes to defection. Simulations on methionyl-tRNA synthetase protein structure network indicated an increased influence of nodes belonging to intra-protein signaling pathways on breaking cooperation. The efficiency of single, initially defecting nodes to convert the cooperation of other nodes to defection in social dilemma games may be an important measure to predict the importance of nodes in the integration and regulation of complex systems. Game centrality may help to design more efficient interventions to cellular networks (in forms of drugs), to ecosystems and social networks.     

Chimpanzees coordinate in a negotiation game

A crucially important aspect of human cooperation is the ability to negotiate to cooperative outcomes when interests over resources conflict. Although chimpanzees and other social species may negotiate conflicting interests regarding travel direction or activity timing, very little is known about their ability to negotiate conflicting preferences over food. In the current study, we presented pairs of chimpanzees with a choice between two cooperative tasks—one with equal payoffs (e.g., 5-5) and one with unequal payoffs (higher and lower than in the equal option, e.g., 10-1). This created a conflict of interests between partners with failure to work together on the same cooperative task resulting in no payoff for either partner. The chimpanzee pairs cooperated successfully in as many as 78–94% of the trials across experiments. Even though dominant chimpanzees preferred the unequal option (as they would obtain the largest payoff), subordinate chimpanzees were able to get their way (the equal option) in 22–56% of trials across conditions. Various analyses showed that subjects were both strategic and also cognizant of the strategies used by their partners. These results demonstrate that one of our two closest primate relatives, the chimpanzee, can settle conflicts of interest over resources in mutually satisfying ways—even without the social norms of equity, planned strategies of reciprocity, and the complex communication characteristic of human negotiation.     

The face of another: anonymity and facial symmetry influence cooperation in social dilemmas

In the present paper, we study how the morphological features related to developmental physiology of other participants influence the decision to cooperate in a social dilemma. To that end, we let a large sample of men play a prisoner's dilemma game, both anonymously and against a series of counterparts whose photographs were shown. We focus on three characteristics already linked to cooperative behavior and with described effects on the adult facial shape: facial fluctuating asymmetry, a frequently employed but debated proxy for developmental instability; the degree of facial dimorphism, related to levels of testosterone during puberty; and the second to fourth digit ratio, related to relative prenatal testosterone exposure. We find significantly higher cooperation rates in anonymous interactions than in the non-anonymous round. We also find that individuals are more likely to cooperate with more asymmetric counterparts, and that more asymmetric participants were less likely to believe that their counterpart would cooperate. Variables related to exposure to testosterone during development do not display any effect. We conclude by discussing how out-of-the-game rewards can explain our results.     

The excuse principle can maintain cooperation through forgivable defection in the Prisoner's Dilemma game

Reciprocal altruism describes a situation in which an organism acts in a manner that temporarily reduces its fitness while increasing another organism''s fitness, but there is an ultimate fitness benefit based on an expectation that the other organism will act in a similar manner at a later time. It creates the obvious dilemma in which there is always a short-term benefit to cheating, therefore cooperating individuals must avoid being exploited by non-cooperating cheaters. This is achieved by following various decision rules, usually variants of the tit-for-tat (TFT) strategy. The strength of TFT, however, is also its weakness—mistakes in implementation or interpretation of moves, or the inability to cooperate, lead to a permanent breakdown in cooperation. We show that pied flycatchers (Ficedula hypoleuca) use a TFT with an embedded ‘excuse principle’ to forgive the neighbours that were perceived as unable to cooperate during mobbing of predators. The excuse principle dramatically increases the stability of TFT-like behavioural strategies within the Prisoner''s Dilemma game.     

Efficient social contracts and group selection

We consider the Stag Hunt in terms of Maynard Smith’s famous Haystack model. In the Stag Hunt, contrary to the Prisoner’s Dilemma, there is a cooperative equilibrium besides the equilibrium where every player defects. This implies that in the Haystack model, where a population is partitioned into groups, groups playing the cooperative equilibrium tend to grow faster than those at the non-cooperative equilibrium. We determine under what conditions this leads to the takeover of the population by cooperators. Moreover, we compare our results to the case of an unstructured population and to the case of the Prisoner’s Dilemma. Finally, we point to some implications our findings have for three distinct ideas: Ken Binmore’s group selection argument in favor of the evolution of efficient social contracts, Sewall Wright’s Shifting Balance theory, and the equilibrium selection problem of game theory.     

Asymmetric Evolutionary Games

Evolutionary game theory is a powerful framework for studying evolution in populations of interacting individuals. A common assumption in evolutionary game theory is that interactions are symmetric, which means that the players are distinguished by only their strategies. In nature, however, the microscopic interactions between players are nearly always asymmetric due to environmental effects, differing baseline characteristics, and other possible sources of heterogeneity. To model these phenomena, we introduce into evolutionary game theory two broad classes of asymmetric interactions: ecological and genotypic. Ecological asymmetry results from variation in the environments of the players, while genotypic asymmetry is a consequence of the players having differing baseline genotypes. We develop a theory of these forms of asymmetry for games in structured populations and use the classical social dilemmas, the Prisoner’s Dilemma and the Snowdrift Game, for illustrations. Interestingly, asymmetric games reveal essential differences between models of genetic evolution based on reproduction and models of cultural evolution based on imitation that are not apparent in symmetric games.     

Human cooperation in social dilemmas: comparing the Snowdrift game with the Prisoner's Dilemma

Explaining the evolution of cooperation among non-relatives is one of the major challenges for evolutionary biology. In this study, we experimentally examined human cooperation in the iterated Snowdrift game (ISD), which has received little attention so far, and compared it with human cooperation in the iterated Prisoner's Dilemma (IPD), which has become the paradigm for the evolution of cooperation. We show that iteration in the ISD leads to consistently higher levels of cooperation than in the IPD. We further demonstrate that the most successful strategies known for the IPD (generous Tit-for-Tat and Pavlov) were also successfully used in the ISD. Interestingly, we found that female players cooperated significantly more often than male players in the IPD but not in the ISD. Moreover, female players in the IPD applied Tit-for-Tat-like or Pavlovian strategies significantly more often than male players, thereby achieving significantly higher pay-offs than male players did. These data demonstrate that the willingness to cooperate does not only depend on the type of the social dilemma, but also on the class of individuals involved. Altogether, our study shows that the ISD can potentially explain high levels of cooperation among non-relatives in humans. In addition, the ISD seems to reflect the social dilemma more realistically than the IPD because individuals obtain immediate direct benefits from the cooperative acts they perform and costs of cooperation are shared between cooperators.     

Suppression of social conflict and evolutionary transitions to cooperation

Evolutionary conflict arises at all levels of biological organization and presents a barrier to the evolution of cooperation. This barrier can be overcome by mechanisms that reduce the disparity between the fitness optima of subunits, sometimes called the "battleground" of conflict. An alternative, unstudied possibility is that effort invested in conflict is unprofitable. This possibility has received little attention because most existing models of social conflict assume that fitness depends on the ratio of players' conflict efforts, so that "peaceful" outcomes featuring zero conflict effort are evolutionarily unstable. Here I show that peaceful outcomes are stable where success depends on the difference rather than the ratio of efforts invested in conflict. These difference form models are particularly appropriate to model strategies of suppression or policing. The model suggests that incomplete information and asymmetries in strength can act to eliminate costly conflict within groups, even among unrelated individuals, and thereby facilitate the evolution of cooperation.     

Evolution of Conformity in Social Dilemmas

People often deviate from their individual Nash equilibrium strategy in game experiments based on the prisoner’s dilemma (PD) game and the public goods game (PGG), whereas conditional cooperation, or conformity, is supported by the data from these experiments. In a complicated environment with no obvious “dominant” strategy, conformists who choose the average strategy of the other players in their group could be able to avoid risk by guaranteeing their income will be close to the group average. In this paper, we study the repeated PD game and the repeated m-person PGG, where individuals’ strategies are restricted to the set of conforming strategies. We define a conforming strategy by two parameters, initial action in the game and the influence of the other players’ choices in the previous round. We are particularly interested in the tit-for-tat (TFT) strategy, which is the well-known conforming strategy in theoretical and empirical studies. In both the PD game and the PGG, TFT can prevent the invasion of non-cooperative strategy if the expected number of rounds exceeds a critical value. The stability analysis of adaptive dynamics shows that conformity in general promotes the evolution of cooperation, and that a regime of cooperation can be established in an AllD population through TFT-like strategies. These results provide insight into the emergence of cooperation in social dilemma games.     

Long-term social bonds promote cooperation in the iterated Prisoner's Dilemma

Reciprocal altruism, one of the most probable explanations for cooperation among non-kin, has been modelled as a Prisoner''s Dilemma. According to this game, cooperation could evolve when individuals, who expect to play again, use conditional strategies like tit-for-tat or Pavlov. There is evidence that humans use such strategies to achieve mutual cooperation, but most controlled experiments with non-human animals have failed to find cooperation. One reason for this could be that subjects fail to cooperate because they behave as if they were to play only once. To assess this hypothesis, we conducted an experiment with monogamous zebra finches (Taeniopygia guttata) that were tested in a two-choice apparatus, with either their social partner or an experimental opponent of the opposite sex. We found that zebra finches maintained high levels of cooperation in an iterated Prisoner''s Dilemma game only when interacting with their social partner. Although other mechanisms may have contributed to the observed difference between the two treatments, our results support the hypothesis that animals do not systematically give in to the short-term temptation of cheating when long-term benefits exist. Thus, our findings contradict the commonly accepted idea that reciprocal altruism will be rare in non-human animals.     

Lack of Association between Human Plasma Oxytocin and Interpersonal Trust in a Prisoner’s Dilemma Paradigm

Expanding interest in oxytocin, particularly the role of endogenous oxytocin in human social behavior, has created a pressing need for replication of results and verification of assay methods. In this study, we sought to replicate and extend previous results correlating plasma oxytocin with trust and trustworthy behavior. As a necessary first step, the two most commonly used commercial assays were compared in human plasma via the addition of a known quantity of exogenous oxytocin, with and without sample extraction. Plasma sample extraction was found to be critical in obtaining repeatable concentrations of oxytocin. In the subsequent trust experiment, twelve samples in duplicate, from each of 82 participants, were collected over approximately six hours during the performance of a Prisoner’s Dilemma task paradigm that stressed human interpersonal trust. We found no significant relationship between plasma oxytocin concentrations and trusting or trustworthy behavior. In light of these findings, previous published work that used oxytocin immunoassays without sample extraction should be reexamined and future research exploring links between endogenous human oxytocin and trust or social behavior should proceed with careful consideration of methods and appropriate biofluids for analysis.