The evolution of social learning rules: Payoff-biased and frequency-dependent biased transmission

Humans and other animals do not use social learning indiscriminately, rather, natural selection has favoured the evolution of social learning rules that make selective use of social learning to acquire relevant information in a changing environment. We present a gene-culture coevolutionary analysis of a small selection of such rules (unbiased social learning, payoff-biased social learning and frequency-dependent biased social learning, including conformism and anti-conformism) in a population of asocial learners where the environment is subject to a constant probability of change to a novel state. We define conditions under which each rule evolves to a genetically polymorphic equilibrium. We find that payoff-biased social learning may evolve under high levels of environmental variation if the fitness benefit associated with the acquired behaviour is either high or low but not of intermediate value. In contrast, both conformist and anti-conformist biases can become fixed when environment variation is low, whereupon the mean fitness in the population is higher than for a population of asocial learners. Our examination of the population dynamics reveals stable limit cycles under conformist and anti-conformist biases and some highly complex dynamics including chaos. Anti-conformists can out-compete conformists when conditions favour a low equilibrium frequency of the learned behaviour. We conclude that evolution, punctuated by the repeated successful invasion of different social learning rules, should continuously favour a reduction in the equilibrium frequency of asocial learning, and propose that, among competing social learning rules, the dominant rule will be the one that can persist with the lowest frequency of asocial learning.     

Two success-biased social learning strategies

I compare the evolutionary dynamics of two success-biased social learning strategies, which, by definition, use the success of others to inform one’s social learning decisions. The first, “Compare Means”, causes a learner to adopt cultural variants with highest mean payoff in her sample. The second, “Imitate the Best”, causes a learner to imitate the single most successful individual in her sample. I summarize conditions under which each strategy performs well or poorly, and investigate their evolution via a gene-culture coevolutionary model. Despite the adaptive appeal of these strategies, both encounter conditions under which they systematically perform worse than simply imitating at random. Compare Means performs worst when the optimal cultural variant is usually at high frequency, while Imitate the Best performs worst when suboptimal variants sometimes produce high payoffs. The extent to which it is optimal to use success-biased social learning depends strongly on the payoff distributions and environmental conditions that human social learners face.     

Group level effects of social versus individual learning

We study the effects of learning by imitating others within the framework of an iterated game in which the members of two complementary populations interact via random pairing at each round. This allows us to compare both the fitness of different strategies within a population and the performance of populations in which members have access to different types of strategies. Previous studies reveal some emergent dynamics at the population level, when players learn individually. We here investigate a different mechanism in which players can choose between two different learning strategies, individual or social. Imitating behavior can spread within a mixed population, with the frequency of imitators varying over generation time. When compared to a pure population with solely individual learners, a mixed population with both individual and social learners can do better, independently of the precise learning scheme employed. We can then search for the best imitating strategy. Imitating the neighbor with the highest payoff turns out to be consistently superior. This is in agreement with findings in experimental and model studies that have been carried out in different settings.     

Individual differences in learning behaviours in humans: Asocial exploration tendency does not predict reliance on social learning

A number of empirical studies have suggested that individual differences in asocial exploration tendencies in animals may be related to those in social information use. However, because the ‘exploration tendency’ in most previous studies has been measured without considering the information-gathering processes, it is yet hard to conclude that the animal asocial exploration strategies may be tied to social information use. Here, we studied human learning behaviour in both asocial and social two-armed bandit tasks. By fitting reinforcement learning models including asocial and/or social decision processes, we measured each individual's (1) asocial exploration tendency and (2) social information use. We found consistent individual differences in the exploration tendency in the asocial tasks. We also found substantive heterogeneity in the adopted learning strategies in the social task: Nearly one-third of participants used predominantly the copy-when-uncertain strategy, while the remaining two-thirds were most likely to have relied only on asocial learning. However, we found no significant individual association between the exploration frequency in the asocial task and the use of the social information in the social task. Our results suggest that the social learning strategies may be independent from the asocial exploration strategies in humans.     

Higher frequency of social learning in China than in the West shows cultural variation in the dynamics of cultural evolution

Cultural evolutionary models have identified a range of conditions under which social learning (copying others) is predicted to be adaptive relative to asocial learning (learning on one''s own), particularly in humans where socially learned information can accumulate over successive generations. However, cultural evolution and behavioural economics experiments have consistently shown apparently maladaptive under-utilization of social information in Western populations. Here we provide experimental evidence of cultural variation in people''s use of social learning, potentially explaining this mismatch. People in mainland China showed significantly more social learning than British people in an artefact-design task designed to assess the adaptiveness of social information use. People in Hong Kong, and Chinese immigrants in the UK, resembled British people in their social information use, suggesting a recent shift in these groups from social to asocial learning due to exposure to Western culture. Finally, Chinese mainland participants responded less than other participants to increased environmental change within the task. Our results suggest that learning strategies in humans are culturally variable and not genetically fixed, necessitating the study of the ‘social learning of social learning strategies'' whereby the dynamics of cultural evolution are responsive to social processes, such as migration, education and globalization.     

The evolution of conformist social learning can cause population collapse in realistically variable environments

Why do societies collapse? We use an individual-based evolutionary model to show that, in environmental conditions dominated by low-frequency variation (“red noise”), extirpation may be an outcome of the evolution of cultural capacity. Previous analytical models predicted an equilibrium between individual learners and social learners, or a contingent strategy in which individuals learn socially or individually depending on the circumstances. However, in red noise environments, whose main signature is that variation is concentrated in relatively large, relatively rare excursions, individual learning may be selected from the population. If the social learning system comes to lack sufficient individual learning or cognitively costly adaptive biases, behavior ceases tracking environmental variation. Then, when the environment does change, fitness declines and the population may collapse or even be extirpated. The modeled scenario broadly fits some human population collapses and might also explain nonhuman extirpations. Varying model parameters showed that the fixation of social learning is less likely when individual learning is less costly, when the environment is less red or more variable, with larger population sizes, and when learning is not conformist or is from parents rather than from the general population. Once social learning is fixed, extirpation is likely except when social learning is biased towards successful models. Thus, the risk of population collapse may be reduced by promoting individual learning and innovation over cultural conformity, or by preferential selection of relatively fit individuals as models for social learning.     

Evolution of social versus individual learning in an infinite island model

We model the evolution of learning in a population composed of infinitely many, finite-sized islands connected by migration. We assume that there are two discrete strategies, social and individual learning, and that the environment is spatially homogeneous but varies temporally in a periodic or stochastic manner. Using a population-genetic approximation technique, we derive a mathematical condition for the two strategies to coexist stably and the equilibrium frequency of social learners under stable coexistence. Analytical and numerical results both reveal that social learners are favored when island size is large or migration rate between islands is high, suggesting that spatial subdivision disfavors social learners. We also show that the average fecundity of the population under stable coexistence of the two strategies is in general lower than that in the absence of social learners and is minimized at an intermediate migration rate.     

Beyond existence and aiming outside the laboratory: estimating frequency-dependent and pay-off-biased social learning strategies

The existence of social learning has been confirmed in diverse taxa, from apes to guppies. In order to advance our understanding of the consequences of social transmission and evolution of behaviour, however, we require statistical tools that can distinguish among diverse social learning strategies. In this paper, we advance two main ideas. First, social learning is diverse, in the sense that individuals can take advantage of different kinds of information and combine them in different ways. Examining learning strategies for different information conditions illuminates the more detailed design of social learning. We construct and analyse an evolutionary model of diverse social learning heuristics, in order to generate predictions and illustrate the impact of design differences on an organism's fitness. Second, in order to eventually escape the laboratory and apply social learning models to natural behaviour, we require statistical methods that do not depend upon tight experimental control. Therefore, we examine strategic social learning in an experimental setting in which the social information itself is endogenous to the experimental group, as it is in natural settings. We develop statistical models for distinguishing among different strategic uses of social information. The experimental data strongly suggest that most participants employ a hierarchical strategy that uses both average observed pay-offs of options as well as frequency information, the same model predicted by our evolutionary analysis to dominate a wide range of conditions.     

Social learning in cooperative dilemmas

Helping is a cornerstone of social organization and commonplace in human societies. A major challenge for the evolutionary sciences is to explain how cooperation is maintained in large populations with high levels of migration, conditions under which cooperators can be exploited by selfish individuals. Cultural group selection models posit that such large-scale cooperation evolves via selection acting on populations among which behavioural variation is maintained by the cultural transmission of cooperative norms. These models assume that individuals acquire cooperative strategies via social learning. This assumption remains empirically untested. Here, I test this by investigating whether individuals employ conformist or payoff-biased learning in public goods games conducted in 14 villages of a forager–horticulturist society, the Pahari Korwa of India. Individuals did not show a clear tendency to conform or to be payoff-biased and are highly variable in their use of social learning. This variation is partly explained by both individual and village characteristics. The tendency to conform decreases and to be payoff-biased increases as the value of the modal contribution increases. These findings suggest that the use of social learning in cooperative dilemmas is contingent on individuals'' circumstances and environments, and question the existence of stably transmitted cultural norms of cooperation.     

The evolutionary basis of human social learning

Humans are characterized by an extreme dependence on culturally transmitted information. Such dependence requires the complex integration of social and asocial information to generate effective learning and decision making. Recent formal theory predicts that natural selection should favour adaptive learning strategies, but relevant empirical work is scarce and rarely examines multiple strategies or tasks. We tested nine hypotheses derived from theoretical models, running a series of experiments investigating factors affecting when and how humans use social information, and whether such behaviour is adaptive, across several computer-based tasks. The number of demonstrators, consensus among demonstrators, confidence of subjects, task difficulty, number of sessions, cost of asocial learning, subject performance and demonstrator performance all influenced subjects' use of social information, and did so adaptively. Our analysis provides strong support for the hypothesis that human social learning is regulated by adaptive learning rules.     

Evolution of social learning: a mathematical analysis

Social learning is an important ability seen in a wide range of animals including humans. It has been argued that individual learning, social learning, and innate determination of behavior are favored by natural selection when environmental changes occur at short, intermediate, and long intervals, respectively. Only recently, however, has the hypothesis been examined by means of mathematical models. In this paper, we construct a simple model in which each organism uses one of three genetically determined strategies--it is an individual learner, a social learner or an "innate"--and the three types of organisms are in direct competition with each other. A reduced model, involving only the individual learners and innates, is effectively linear, and we show that by solving the eigenvalue problem of this reduced system we arrive at a good approximation to the global dynamics of the full model. We also study the effect of stochastic environmental changes and reversible mutations among the three strategies. Our results are consistent with the predictions of previous studies. In addition, we identify a critical level of environmental constancy below which only individual and social learners are present.     

Applying evolutionary models to the laboratory study of social learning

Cultural evolution is driven, in part, by the strategies that individuals employ to acquire behavior from others. These strategies themselves are partly products of natural selection, making the study of social learning an inherently Darwinian project. Formal models of the evolution of social learning suggest that reliance on social learning should increase with task difficulty and decrease with the probability of environmental change. These models also make predictions about how individuals integrate information from multiple peers. We present the results of microsociety experiments designed to evaluate these predictions. The first experiment measures baseline individual learning strategy in a two-armed bandit environment with variation in task difficulty and temporal fluctuation in the payoffs of the options. Our second experiment addresses how people in the same environment use minimal social information from a single peer. Our third experiment expands on the second by allowing access to the behavior of several other individuals, permitting frequency-dependent strategies like conformity. In each of these experiments, we vary task difficulty and environmental fluctuation. We present several candidate strategies and compute the expected payoffs to each in our experimental environment. We then fit to the data the different models of the use of social information and identify the best-fitting model via model comparison techniques. We find substantial evidence of both conformist and nonconformist social learning and compare our results to theoretical expectations.     

Success-biased social learning: Cultural and evolutionary dynamics

Success bias is a social learning strategy whereby learners tend to acquire the cultural variants of successful individuals. I develop a general model of success-biased social learning for discrete cultural traits with stochastic payoffs, and investigate its dynamics when only two variants are present. I find that success bias inherently favors rare variants, and consequently performs worse than unbiased imitation (i.e. random copying) when success payoffs are at least mildly stochastic and the optimal variant is common. Because of this weakness, success bias fails to replace unbiased imitation in an evolutionary model when selection is fairly weak or when the environment is relatively stable, and sometimes fails to invade at all. I briefly discuss the optimal strength of success bias, the complicated nature of defining success in social learning contexts, and the value of variant frequency as an important source of information to social learners. I conclude with predictions regarding the prevalence of success bias in different behavioral domains.     

ROGERS' PARADOX RECAST AND RESOLVED: POPULATION STRUCTURE AND THE EVOLUTION OF SOCIAL LEARNING STRATEGIES

We explore the evolution of reliance on social and asocial learning using a spatially explicit stochastic model. Our analysis considers the relative merits of four evolved strategies, two pure strategies (asocial and social learning) and two conditional strategies (the "critical social learner," which learns asocially only when copying fails, and the "conditional social learner," which copies only when asocial learning fails). We find that spatial structure generates outcomes that do not always conform to the finding of earlier theoretical analyses that social learning does not enhance average individual fitness at equilibrium (Rogers' paradox). Although we describe circumstances under which the strategy of pure social learning increases the average fitness of individuals, we find that spatial structure introduces a new paradox, which is that social learning can spread even when it decreases the average fitness of individuals below that of asocial learners. We also show that the critical social learner and conditional social learner both provide solutions to the aforementioned paradoxes, although we find some conditions in which pure (random) social learning out-competes both conditional strategies. Finally, we consider the relative merits of critical and conditional social learning under various conditions.     

SOCIAL LEARNERS REQUIRE PROCESS INFORMATION TO OUTPERFORM INDIVIDUAL LEARNERS

Humans exhibit a rich and complex material culture with no equivalent in animals. Also, social learning, a crucial requirement for culture, is particularly developed in humans and provides a means to accumulate knowledge over time and to develop advanced technologies. However, the type of social learning required for the evolution of this complex material culture is still debated. Here, using a complex and opaque virtual task, the efficiency of individual learning and two types of social learning (product‐copying and process‐copying) were compared. We found that (1) individuals from process‐copying groups outperformed individuals from product‐copying groups or individual learners, whereas access to product information was not a sufficient condition for providing an advantage to social learners compared to individual learners; (2) social learning did not seem to affect the exploration of the fitness landscape; (3) social learning led to strong within‐group convergence and also to between‐group convergence, and (4) individuals used widely variable social learning strategies. The implications of these results for cumulative culture evolution are discussed.     

Selectivity in social and asocial learning: investigating the prevalence,effect and development of young children's learning preferences

Culture evolution requires both modification and faithful replication of behaviour, thus it is essential to understand how individuals choose between social and asocial learning. In a quasi-experimental design, 3- and 5-year-olds (176), and adults (52) were presented individually with two novel artificial fruits, and told of the apparatus'' relative difficulty (easy versus hard). Participants were asked if they wanted to attempt the task themselves or watch an experimenter attempt it first; and then had their preference either met or violated. A significant proportion of children and adults (74%) chose to learn socially. For children, this request was efficient, as observing a demonstration made them significantly quicker at the task than learning asocially. However, for 5-year-olds, children who selected asocial learning were also found to be highly efficient at the task, showing that by 5 years children are selective in choosing a learning strategy that is effective for them. Adults further evidenced this trend, and also showed selectivity based on task difficulty. This is the first study to examine the rates, performance outcomes and developmental trajectory of preferences in asocial and social learning, ultimately informing our understanding of innovation.     

Critical Social Learning: A Solution to Rogers's Paradox of Nonadaptive Culture

Alan Rogers (1988) presented a game theory model of the evolution of social learning, yielding the paradoxical conclusion that social learning does not increase the fitness of a population. We expand on this model, allowing for imperfections in individual and social learning as well as incorporating a "critical social learning" strategy that tries to solve an adaptive problem first by social learning, and then by individual learning if socially acquired behavior proves unsatisfactory. This strategy always proves superior to pure social learning and typically has higher fitness than pure individual learning, providing a solution to Rogers's paradox of nonadaptive culture. Critical social learning is an evolutionarily stable strategy (ESS) unless cultural transmission is highly unfaithful, the environment is highly variable, or social learning is much more costly than individual learning. We compare the model to empirical data on social learning and on spatial variation in primate cultures and list three requirements for adaptive culture.     

Simulated Trust: A cheap social learning strategy

Animals use heuristic strategies to determine from which conspecifics to learn socially. This leads to directed social learning. Directed social learning protects them from copying non-adaptive information. So far, the strategies of animals, leading to directed social learning, are assumed to rely on (possibly indirect) inferences about the demonstrator’s success. As an alternative to this assumption, we propose a strategy that only uses self-established estimates of the pay-offs of behavior. We evaluate the strategy in a number of agent-based simulations. Critically, the strategy’s success is warranted by the inclusion of an incremental learning mechanism. Our findings point out new theoretical opportunities to regulate social learning for animals. More broadly, our simulations emphasize the need to include a realistic learning mechanism in game-theoretic studies of social learning strategies, and call for re-evaluation of previous findings.     

Sex and boldness explain individual differences in spatial learning in a lizard

Understanding individual differences in cognitive performance is a major challenge to animal behaviour and cognition studies. We used the Eastern water skink (Eulamprus quoyii) to examine associations between exploration, boldness and individual variability in spatial learning, a dimension of lizard cognition with important bearing on fitness. We show that males perform better than females in a biologically relevant spatial learning task. This is the first evidence for sex differences in learning in a reptile, and we argue that it is probably owing to sex-specific selective pressures that may be widespread in lizards. Across the sexes, we found a clear association between boldness after a simulated predatory attack and the probability of learning the spatial task. In contrast to previous studies, we found a nonlinear association between boldness and learning: both ‘bold’ and ‘shy’ behavioural types were more successful learners than intermediate males. Our results do not fit with recent predictions suggesting that individual differences in learning may be linked with behavioural types via high–low-risk/reward trade-offs. We suggest the possibility that differences in spatial cognitive performance may arise in lizards as a consequence of the distinct environmental variability and complexity experienced by individuals as a result of their sex and social tactics.     

A mixed strategy model for the emergence and intensification of social learning in a periodically changing natural environment

Based on a population genetic model of mixed strategies determined by alleles of small effect, we derive conditions for the evolution of social learning in an infinite-state environment that changes periodically over time. Each mixed strategy is defined by the probabilities that an organism will commit itself to individual learning, social learning, or innate behavior. We identify the convergent stable strategies (CSS) by a numerical adaptive dynamics method and then check the evolutionary stability (ESS) of these strategies. A strategy that is simultaneously a CSS and an ESS is called an attractive ESS (AESS). For certain parameter sets, a bifurcation diagram shows that the pure individual learning strategy is the unique AESS for short periods of environmental change, a mixed learning strategy is the unique AESS for intermediate periods, and a mixed learning strategy (with a relatively large social learning component) and the pure innate strategy are both AESS's for long periods. This result entails that, once social learning emerges during a transient era of intermediate environmental periodicity, a subsequent elongation of the period may result in the intensification of social learning, rather than a return to innate behavior.