Two success-biased social learning strategies

I compare the evolutionary dynamics of two success-biased social learning strategies, which, by definition, use the success of others to inform one’s social learning decisions. The first, “Compare Means”, causes a learner to adopt cultural variants with highest mean payoff in her sample. The second, “Imitate the Best”, causes a learner to imitate the single most successful individual in her sample. I summarize conditions under which each strategy performs well or poorly, and investigate their evolution via a gene-culture coevolutionary model. Despite the adaptive appeal of these strategies, both encounter conditions under which they systematically perform worse than simply imitating at random. Compare Means performs worst when the optimal cultural variant is usually at high frequency, while Imitate the Best performs worst when suboptimal variants sometimes produce high payoffs. The extent to which it is optimal to use success-biased social learning depends strongly on the payoff distributions and environmental conditions that human social learners face.     

Applying evolutionary models to the laboratory study of social learning

Cultural evolution is driven, in part, by the strategies that individuals employ to acquire behavior from others. These strategies themselves are partly products of natural selection, making the study of social learning an inherently Darwinian project. Formal models of the evolution of social learning suggest that reliance on social learning should increase with task difficulty and decrease with the probability of environmental change. These models also make predictions about how individuals integrate information from multiple peers. We present the results of microsociety experiments designed to evaluate these predictions. The first experiment measures baseline individual learning strategy in a two-armed bandit environment with variation in task difficulty and temporal fluctuation in the payoffs of the options. Our second experiment addresses how people in the same environment use minimal social information from a single peer. Our third experiment expands on the second by allowing access to the behavior of several other individuals, permitting frequency-dependent strategies like conformity. In each of these experiments, we vary task difficulty and environmental fluctuation. We present several candidate strategies and compute the expected payoffs to each in our experimental environment. We then fit to the data the different models of the use of social information and identify the best-fitting model via model comparison techniques. We find substantial evidence of both conformist and nonconformist social learning and compare our results to theoretical expectations.     

An experimental comparison of human social learning strategies: payoff-biased social learning is adaptive but underused

Analytical models have identified a set of social learning strategies that are predicted to be adaptive relative to individual (asocial) learning. In the present study, human participants engaged in an ecologically valid artifact-design task with the opportunity to engage in a range of social learning strategies: payoff bias, conformity, averaging and random copying. The artifact (an arrowhead) was composed of multiple continuous and discrete attributes which jointly generated a complex multimodal adaptive landscape that likely reflects actual cultural fitness environments. Participants exhibited a mix of individual learning and payoff-biased social learning, with negligible frequencies of the other social learning strategies. This preference for payoff-biased social learning was evident from the initial trials, suggesting that participants came into the study with an intrinsic preference for this strategy. There was also a small but significant increase in the frequency of payoff-biased social learning over sessions, suggesting that strategy choice may itself be subject to learning. Frequency of payoff-biased social learning predicted both absolute and relative success in the task, especially in a multimodal (rather than unimodal) fitness environment. This effect was driven by a minority of hardcore social learners who copied the best group member on more than half of trials. These hardcore social learners were also above-average individual learners, suggesting a link between individual and social learning ability. The lower-than-expected frequency of social learning may reflect the existence of information producer–scrounger dynamics in human populations.     

The evolution of social learning rules: Payoff-biased and frequency-dependent biased transmission

Humans and other animals do not use social learning indiscriminately, rather, natural selection has favoured the evolution of social learning rules that make selective use of social learning to acquire relevant information in a changing environment. We present a gene-culture coevolutionary analysis of a small selection of such rules (unbiased social learning, payoff-biased social learning and frequency-dependent biased social learning, including conformism and anti-conformism) in a population of asocial learners where the environment is subject to a constant probability of change to a novel state. We define conditions under which each rule evolves to a genetically polymorphic equilibrium. We find that payoff-biased social learning may evolve under high levels of environmental variation if the fitness benefit associated with the acquired behaviour is either high or low but not of intermediate value. In contrast, both conformist and anti-conformist biases can become fixed when environment variation is low, whereupon the mean fitness in the population is higher than for a population of asocial learners. Our examination of the population dynamics reveals stable limit cycles under conformist and anti-conformist biases and some highly complex dynamics including chaos. Anti-conformists can out-compete conformists when conditions favour a low equilibrium frequency of the learned behaviour. We conclude that evolution, punctuated by the repeated successful invasion of different social learning rules, should continuously favour a reduction in the equilibrium frequency of asocial learning, and propose that, among competing social learning rules, the dominant rule will be the one that can persist with the lowest frequency of asocial learning.     

Evolution of social learning does not explain the origin of human cumulative culture

Because culture requires transmission of information between individuals, thinking about the origin of culture has mainly focused on the genetic evolution of abilities for social learning. Current theory considers how social learning affects the adaptiveness of a single cultural trait, yet human culture consists of the accumulation of very many traits. Here we introduce a new modeling strategy that tracks the adaptive value of many cultural traits, showing that genetic evolution favors only limited social learning owing to the accumulation of maladaptive as well as adaptive culture. We further show that culture can be adaptive, and refined social learning can evolve, if individuals can identify and discard maladaptive culture. This suggests that the evolution of such "adaptive filtering" mechanisms may have been crucial for the birth of human culture.     

The evolutionary basis of human social learning

Humans are characterized by an extreme dependence on culturally transmitted information. Such dependence requires the complex integration of social and asocial information to generate effective learning and decision making. Recent formal theory predicts that natural selection should favour adaptive learning strategies, but relevant empirical work is scarce and rarely examines multiple strategies or tasks. We tested nine hypotheses derived from theoretical models, running a series of experiments investigating factors affecting when and how humans use social information, and whether such behaviour is adaptive, across several computer-based tasks. The number of demonstrators, consensus among demonstrators, confidence of subjects, task difficulty, number of sessions, cost of asocial learning, subject performance and demonstrator performance all influenced subjects' use of social information, and did so adaptively. Our analysis provides strong support for the hypothesis that human social learning is regulated by adaptive learning rules.     

Simulated Trust: A cheap social learning strategy

Animals use heuristic strategies to determine from which conspecifics to learn socially. This leads to directed social learning. Directed social learning protects them from copying non-adaptive information. So far, the strategies of animals, leading to directed social learning, are assumed to rely on (possibly indirect) inferences about the demonstrator’s success. As an alternative to this assumption, we propose a strategy that only uses self-established estimates of the pay-offs of behavior. We evaluate the strategy in a number of agent-based simulations. Critically, the strategy’s success is warranted by the inclusion of an incremental learning mechanism. Our findings point out new theoretical opportunities to regulate social learning for animals. More broadly, our simulations emphasize the need to include a realistic learning mechanism in game-theoretic studies of social learning strategies, and call for re-evaluation of previous findings.     

Beyond existence and aiming outside the laboratory: estimating frequency-dependent and pay-off-biased social learning strategies

The existence of social learning has been confirmed in diverse taxa, from apes to guppies. In order to advance our understanding of the consequences of social transmission and evolution of behaviour, however, we require statistical tools that can distinguish among diverse social learning strategies. In this paper, we advance two main ideas. First, social learning is diverse, in the sense that individuals can take advantage of different kinds of information and combine them in different ways. Examining learning strategies for different information conditions illuminates the more detailed design of social learning. We construct and analyse an evolutionary model of diverse social learning heuristics, in order to generate predictions and illustrate the impact of design differences on an organism's fitness. Second, in order to eventually escape the laboratory and apply social learning models to natural behaviour, we require statistical methods that do not depend upon tight experimental control. Therefore, we examine strategic social learning in an experimental setting in which the social information itself is endogenous to the experimental group, as it is in natural settings. We develop statistical models for distinguishing among different strategic uses of social information. The experimental data strongly suggest that most participants employ a hierarchical strategy that uses both average observed pay-offs of options as well as frequency information, the same model predicted by our evolutionary analysis to dominate a wide range of conditions.     

Not-so-social learning strategies

Social learning strategies (SLSs) are rules specifying the conditions in which it would be adaptive for animals to copy the behaviour of others rather than to persist with a previously established behaviour or to acquire a new behaviour through asocial learning. In behavioural ecology, cultural evolutionary theory and economics, SLSs are studied using a ‘phenotypic gambit’—from a purely functional perspective, without reference to their underlying psychological mechanisms. However, SLSs are described in these fields as if they were implemented by complex, domain-specific, genetically inherited mechanisms of decision-making. In this article, we suggest that it is time to begin investigating the psychology of SLSs, and we initiate this process by examining recent experimental work relating to three groups of strategies: copy when alternative unsuccessful, copy when model successful and copy the majority. In each case, we argue that the reported behaviour could have been mediated by domain-general and taxonomically general psychological mechanisms; specifically, by mechanisms, identified through conditioning experiments, that make associative learning selective. We also suggest experimental manipulations that could be used in future research to resolve more fully the question whether, in non-human animals, SLSs are mediated by domain-general or domain-specific psychological mechanisms.     

Spread of costly prestige-seeking behavior by social learning

Mathematical and simulation models of cultural transmission in a population where individuals may differ in their social status are developed. High-status individuals are assumed to be more influential to others but no more fertile or viable than low-status individuals. Analysis of the models suggests that culturally transmitted values, beliefs, and preferences that cause individuals to engage in prestige-seeking behavior can sometimes invade the population, even if that behavior reduces the net reproductive success of the prestige seekers. It is argued that some of the seemingly maladaptive behaviors observed in human societies may be a result of cultural evolution based on the human capacity for social learning, rather than a product of the "time lag" before the evolutionary modification of the human predisposition in response to the recent drastic changes in the environment.     

Higher frequency of social learning in China than in the West shows cultural variation in the dynamics of cultural evolution

Cultural evolutionary models have identified a range of conditions under which social learning (copying others) is predicted to be adaptive relative to asocial learning (learning on one''s own), particularly in humans where socially learned information can accumulate over successive generations. However, cultural evolution and behavioural economics experiments have consistently shown apparently maladaptive under-utilization of social information in Western populations. Here we provide experimental evidence of cultural variation in people''s use of social learning, potentially explaining this mismatch. People in mainland China showed significantly more social learning than British people in an artefact-design task designed to assess the adaptiveness of social information use. People in Hong Kong, and Chinese immigrants in the UK, resembled British people in their social information use, suggesting a recent shift in these groups from social to asocial learning due to exposure to Western culture. Finally, Chinese mainland participants responded less than other participants to increased environmental change within the task. Our results suggest that learning strategies in humans are culturally variable and not genetically fixed, necessitating the study of the ‘social learning of social learning strategies'' whereby the dynamics of cultural evolution are responsive to social processes, such as migration, education and globalization.     

Rapid evolution of social learning

Culture is widely thought to be beneficial when social learning is less costly than individual learning and thus may explain the enormous ecological success of humans. Rogers (1988. Does biology constrain culture. Am. Anthropol.  90 : 819–831) contradicted this common view by showing that the evolution of social learning does not necessarily increase the net benefits of learned behaviours in a variable environment. Using simulation experiments, we re‐analysed extensions of Rogers’ model after relaxing the assumption that genetic evolution is much slower than cultural evolution. Our results show that this assumption is crucial for Rogers’ finding. For many parameter settings, genetic and cultural evolution occur on the same time scale, and feedback effects between genetic and cultural dynamics increase the net benefits. Thus, by avoiding the costs of individual learning, social learning can increase ecological success. Furthermore, we found that rapid evolution can limit the evolution of complex social learning strategies, which have been proposed to be widespread in animals.     

How copying affects the amount, evenness and persistence of cultural knowledge: insights from the social learning strategies tournament

Darwinian processes should favour those individuals that deploy the most effective strategies for acquiring information about their environment. We organized a computer-based tournament to investigate which learning strategies would perform well in a changing environment. The most successful strategies relied almost exclusively on social learning (here, learning a behaviour performed by another individual) rather than asocial learning, even when environments were changing rapidly; moreover, successful strategies focused learning effort on periods of environmental change. Here, we use data from tournament simulations to examine how these strategies might affect cultural evolution, as reflected in the amount of culture (i.e. number of cultural traits) in the population, the distribution of cultural traits across individuals, and their persistence through time. We found that high levels of social learning are associated with a larger amount of more persistent knowledge, but a smaller amount of less persistent expressed behaviour, as well as more uneven distributions of behaviour, as individuals concentrated on exploiting a smaller subset of behaviour patterns. Increased rates of environmental change generated increases in the amount and evenness of behaviour. These observations suggest that copying confers on cultural populations an adaptive plasticity, allowing them to respond to changing environments rapidly by drawing on a wider knowledge base.     

Evolution of social learning: a mathematical analysis

Social learning is an important ability seen in a wide range of animals including humans. It has been argued that individual learning, social learning, and innate determination of behavior are favored by natural selection when environmental changes occur at short, intermediate, and long intervals, respectively. Only recently, however, has the hypothesis been examined by means of mathematical models. In this paper, we construct a simple model in which each organism uses one of three genetically determined strategies--it is an individual learner, a social learner or an "innate"--and the three types of organisms are in direct competition with each other. A reduced model, involving only the individual learners and innates, is effectively linear, and we show that by solving the eigenvalue problem of this reduced system we arrive at a good approximation to the global dynamics of the full model. We also study the effect of stochastic environmental changes and reversible mutations among the three strategies. Our results are consistent with the predictions of previous studies. In addition, we identify a critical level of environmental constancy below which only individual and social learners are present.     

The evolutionary dynamics of haplodiploidy: Genome architecture and haploid viability

Haplodiploid reproduction, in which males are haploid and females are diploid, is widespread among animals, yet we understand little about the forces responsible for its evolution. The current theory is that haplodiploidy has evolved through genetic conflicts, as it provides a transmission advantage to mothers. Male viability is thought to be a major limiting factor; diploid individuals tend to harbor many recessive lethal mutations. This theory predicts that the evolution of haplodiploidy is more likely in male heterogametic lineages with few chromosomes, as genes on the X chromosome are often expressed in a haploid environment, and the fewer the chromosome number, the greater the proportion of the total genome that is X‐linked. We test this prediction with comparative phylogenetic analyses of mites, among which haplodiploidy has evolved repeatedly. We recover a negative correlation between chromosome number and haplodiploidy, find evidence that low chromosome number evolved prior to haplodiploidy, and that it is unlikely that diplodiploidy has reevolved from haplodiploid lineages of mites. These results are consistent with the predicted importance of haploid male viability.     

Social structure modulates the evolutionary consequences of social plasticity: A social network perspective on interacting phenotypes

Organisms express phenotypic plasticity during social interactions. Interacting phenotype theory has explored the consequences of social plasticity for evolution, but it is unclear how this theory applies to complex social structures. We adapt interacting phenotype models to general social structures to explore how the number of social connections between individuals and preference for phenotypically similar social partners affect phenotypic variation and evolution. We derive an analytical model that ignores phenotypic feedback and use simulations to test the predictions of this model. We find that adapting previous models to more general social structures does not alter their general conclusions but generates insights into the effect of social plasticity and social structure on the maintenance of phenotypic variation and evolution. Contribution of indirect genetic effects to phenotypic variance is highest when interactions occur at intermediate densities and decrease at higher densities, when individuals approach interacting with all group members, homogenizing the social environment across individuals. However, evolutionary response to selection tends to increase at greater network densities as the effects of an individual's genes are amplified through increasing effects on other group members. Preferential associations among similar individuals (homophily) increase both phenotypic variance within groups and evolutionary response to selection. Our results represent a first step in relating social network structure to the expression of social plasticity and evolutionary responses to selection.     

Convergent transformation and selection in cultural evolution

In biology, natural selection is the main explanation of adaptations and it is an attractive idea to think that an analogous force could have the same role in cultural evolution. In support of this idea, all the main ingredients for natural selection have been documented in the cultural domain. However, the changes that occur during cultural transmission typically result in convergent transformation, non-random cultural modifications, casting some doubts on the importance of natural selection in the cultural domain. To progress on this issue more empirical research is needed. Here, using nearly half a million experimental trials performed by a group of baboons (Papio papio), we simulate cultural evolution under various conditions of natural selection and do an additional experiment to tease apart the role of convergent transformation and selection. Our results confirm that transformation strongly constrain the variation available to selection and therefore strongly limit its impact on cultural evolution. Surprisingly, in our study, transformation also enhances the effect of selection by stabilising cultural variation. We conclude that, in culture, selection can change the evolutionary trajectory substantially in some cases, but can only act on the variation provided by (typically biased) transformation.     

Culturally-transmitted feeding behaviour in primates: Evidence for accelerating learning rates

Cultural transmission implies the rapid spread of behavioural innovations when initially naïve individuals copy more informed ones. Mathematical models of transmission feature accelerating (and in most cases, logistic) rates of learning as animals that acquire an innovation provide ever increasing numbers of informers for potential learners. Conversely, non-accelerating rates have been proposed as a null hypothesis for apparent cases of cultural transmission that can best be explained by simpler mechanisms such as trial-and-error learning. Using the AIC technique for comparing models with different numbers of parameters, this paper examines the 21 cases in the primate literature where quantifiable data are available on learning rates for presumed culturally-transmitted feeding innovations. In each case, cumulative distributions over time of the frequency or proportion of individuals that acquire an innovation are compared with three accelerating functions (logistic, positive exponential, and hyperbolic sine) and two non-accelerating ones (linear and logarithmic). In 16 cases, the best fit is given by an accelerating function: nine of these support the logistic, four support the positive exponential and three, the reverse S-shaped hyperbolic sine. Individual cases often show small differences between alternative functions, but overall trends support the cultural assumption of accelerating learning rates.