Individual differences in learning behaviours in humans: Asocial exploration tendency does not predict reliance on social learning

A number of empirical studies have suggested that individual differences in asocial exploration tendencies in animals may be related to those in social information use. However, because the ‘exploration tendency’ in most previous studies has been measured without considering the information-gathering processes, it is yet hard to conclude that the animal asocial exploration strategies may be tied to social information use. Here, we studied human learning behaviour in both asocial and social two-armed bandit tasks. By fitting reinforcement learning models including asocial and/or social decision processes, we measured each individual's (1) asocial exploration tendency and (2) social information use. We found consistent individual differences in the exploration tendency in the asocial tasks. We also found substantive heterogeneity in the adopted learning strategies in the social task: Nearly one-third of participants used predominantly the copy-when-uncertain strategy, while the remaining two-thirds were most likely to have relied only on asocial learning. However, we found no significant individual association between the exploration frequency in the asocial task and the use of the social information in the social task. Our results suggest that the social learning strategies may be independent from the asocial exploration strategies in humans.     

Two success-biased social learning strategies

I compare the evolutionary dynamics of two success-biased social learning strategies, which, by definition, use the success of others to inform one’s social learning decisions. The first, “Compare Means”, causes a learner to adopt cultural variants with highest mean payoff in her sample. The second, “Imitate the Best”, causes a learner to imitate the single most successful individual in her sample. I summarize conditions under which each strategy performs well or poorly, and investigate their evolution via a gene-culture coevolutionary model. Despite the adaptive appeal of these strategies, both encounter conditions under which they systematically perform worse than simply imitating at random. Compare Means performs worst when the optimal cultural variant is usually at high frequency, while Imitate the Best performs worst when suboptimal variants sometimes produce high payoffs. The extent to which it is optimal to use success-biased social learning depends strongly on the payoff distributions and environmental conditions that human social learners face.     

The evolution of conformist transmission in social learning when the environment changes periodically

Conformity is often observed in human social learning. Social learners preferentially imitate the majority or most common behavior in many situations, though the strength of conformity varies with the situation. Why has such a psychological tendency evolved? I investigate this problem by extending a standard model of social learning evolution with infinite environmental states (Feldman, M.W., Aoki, K., Kumm, J., 1996. Individual versus social learning: evolutionary analysis in a fluctuating environment. Anthropol. Sci. 104, 209-231) to include conformity bias. I mainly focus on the relationship between the strength of conformity bias that evolves and environmental stability, which is one of the most important factors in the evolution of social learning. Using the evolutionarily stable strategy (ESS) approach, I show that conformity always evolves when environmental stability and the cost of adopting a wrong behavior are small, though environmental stability and the cost of individual learning both negatively affect the strength of conformity.     

Evolution of social learning does not explain the origin of human cumulative culture

Because culture requires transmission of information between individuals, thinking about the origin of culture has mainly focused on the genetic evolution of abilities for social learning. Current theory considers how social learning affects the adaptiveness of a single cultural trait, yet human culture consists of the accumulation of very many traits. Here we introduce a new modeling strategy that tracks the adaptive value of many cultural traits, showing that genetic evolution favors only limited social learning owing to the accumulation of maladaptive as well as adaptive culture. We further show that culture can be adaptive, and refined social learning can evolve, if individuals can identify and discard maladaptive culture. This suggests that the evolution of such "adaptive filtering" mechanisms may have been crucial for the birth of human culture.     

Simulated Trust: A cheap social learning strategy

Animals use heuristic strategies to determine from which conspecifics to learn socially. This leads to directed social learning. Directed social learning protects them from copying non-adaptive information. So far, the strategies of animals, leading to directed social learning, are assumed to rely on (possibly indirect) inferences about the demonstrator’s success. As an alternative to this assumption, we propose a strategy that only uses self-established estimates of the pay-offs of behavior. We evaluate the strategy in a number of agent-based simulations. Critically, the strategy’s success is warranted by the inclusion of an incremental learning mechanism. Our findings point out new theoretical opportunities to regulate social learning for animals. More broadly, our simulations emphasize the need to include a realistic learning mechanism in game-theoretic studies of social learning strategies, and call for re-evaluation of previous findings.     

The effect of trauma on Neanderthal culture: A mathematical analysis

Traumatic lesions are often observed in ancient skeletal remains. Since ancient medical technology was immature, severely traumatized individuals may have frequently lost the physical ability for cultural skills that demand complex body movements. I develop a mathematical model to analyze the effect of trauma on cultural transmission and apply it to Neanderthal culture using Neanderthal fossil data. I estimate from the data that the proportion of adult individuals who suffered traumatic injuries before death was approximately 0.79–0.94, in which 0.37–0.52 were injured severely and 0.13–0.19 were injured before adulthood. Assuming that every severely traumatized individual and a quarter to a half of the other traumatized individuals lost the capacity for a cultural skill that demands complex control of the traumatized body part, I estimate that if an upper limb is associated with a cultural skill, each individual had to communicate closely with at least 1.5–2.6 individuals during adulthood to maintain the skill in Neanderthal society, and if a whole body is associated, at least 3.1–11.5 individuals were necessary. If cultural transmissions between experts and novices were inaccurate, or if low frequency skills easily disappeared from the population due to random drift, more communicable individuals were necessary. Since the community size of Neanderthals was very small, their high risk of injury may have inhibited the spread of technically difficult cultural skills in their society. It may be important to take this inhibition into consideration when we study Neanderthal culture and the replacement of Neanderthals by modern humans.     

Success-biased social learning: Cultural and evolutionary dynamics

Success bias is a social learning strategy whereby learners tend to acquire the cultural variants of successful individuals. I develop a general model of success-biased social learning for discrete cultural traits with stochastic payoffs, and investigate its dynamics when only two variants are present. I find that success bias inherently favors rare variants, and consequently performs worse than unbiased imitation (i.e. random copying) when success payoffs are at least mildly stochastic and the optimal variant is common. Because of this weakness, success bias fails to replace unbiased imitation in an evolutionary model when selection is fairly weak or when the environment is relatively stable, and sometimes fails to invade at all. I briefly discuss the optimal strength of success bias, the complicated nature of defining success in social learning contexts, and the value of variant frequency as an important source of information to social learners. I conclude with predictions regarding the prevalence of success bias in different behavioral domains.     

An experimental comparison of human social learning strategies: payoff-biased social learning is adaptive but underused

Analytical models have identified a set of social learning strategies that are predicted to be adaptive relative to individual (asocial) learning. In the present study, human participants engaged in an ecologically valid artifact-design task with the opportunity to engage in a range of social learning strategies: payoff bias, conformity, averaging and random copying. The artifact (an arrowhead) was composed of multiple continuous and discrete attributes which jointly generated a complex multimodal adaptive landscape that likely reflects actual cultural fitness environments. Participants exhibited a mix of individual learning and payoff-biased social learning, with negligible frequencies of the other social learning strategies. This preference for payoff-biased social learning was evident from the initial trials, suggesting that participants came into the study with an intrinsic preference for this strategy. There was also a small but significant increase in the frequency of payoff-biased social learning over sessions, suggesting that strategy choice may itself be subject to learning. Frequency of payoff-biased social learning predicted both absolute and relative success in the task, especially in a multimodal (rather than unimodal) fitness environment. This effect was driven by a minority of hardcore social learners who copied the best group member on more than half of trials. These hardcore social learners were also above-average individual learners, suggesting a link between individual and social learning ability. The lower-than-expected frequency of social learning may reflect the existence of information producer–scrounger dynamics in human populations.     

The evolution of social learning rules: Payoff-biased and frequency-dependent biased transmission

Humans and other animals do not use social learning indiscriminately, rather, natural selection has favoured the evolution of social learning rules that make selective use of social learning to acquire relevant information in a changing environment. We present a gene-culture coevolutionary analysis of a small selection of such rules (unbiased social learning, payoff-biased social learning and frequency-dependent biased social learning, including conformism and anti-conformism) in a population of asocial learners where the environment is subject to a constant probability of change to a novel state. We define conditions under which each rule evolves to a genetically polymorphic equilibrium. We find that payoff-biased social learning may evolve under high levels of environmental variation if the fitness benefit associated with the acquired behaviour is either high or low but not of intermediate value. In contrast, both conformist and anti-conformist biases can become fixed when environment variation is low, whereupon the mean fitness in the population is higher than for a population of asocial learners. Our examination of the population dynamics reveals stable limit cycles under conformist and anti-conformist biases and some highly complex dynamics including chaos. Anti-conformists can out-compete conformists when conditions favour a low equilibrium frequency of the learned behaviour. We conclude that evolution, punctuated by the repeated successful invasion of different social learning rules, should continuously favour a reduction in the equilibrium frequency of asocial learning, and propose that, among competing social learning rules, the dominant rule will be the one that can persist with the lowest frequency of asocial learning.     

Individual differences in responses of Norway rats to social induction of food preferences

Each of 36 observer rats was: (1) exposed to a demonstrator rat that had eaten an unpalatable, cayenne-pepper-flavored diet (Diet Cay), then tested to determine its willingness to eat Diet Cay and (2) exposed to a demonstrator rat that had eaten a palatable diet (Diet NPT) to which the observer had previously learned an aversion, then tested to determine its willingness to eat Diet NPT. In both instances, some observers ate substantial amounts of the diet that their respective demonstrators had eaten, while other observers did not. No consistency was found across the two situations in the relative susceptibility of individual observer rats to social influences on their food choices. In a second experiment, observer rats interacted, at 3 day intervals, with demonstrator rats that had each eaten different diets. After each interaction, all observers were given a choice test to determine their preferences for the diet that their demonstrators had eaten. Again, there was no consistency in the relative strength of individual observer rats' socially induced preferences for diets fed to demonstrators. Stable individual differences in magnitude of susceptibility to social influence on food preference did not account for a detectable proportion of observed variance in diet selection.     

Spread of two linked social norms on complex interaction networks

In this paper, we study the spread of social norms, such as rules and customs that are components of human cultures. We consider the spread of two social norms, which are linked through individual behaviors. Spreading social norms depend not only on the social network structure, but also on the learning system. We consider four social network structures: (1) complete mixing, in which each individual interacts with the others at random, (2) lattice, in which each individual interacts with its neighbors with some probability and with the others at random, (3) power-law network, in which a few influential people have more social contacts than the others, and (4) random graph network, in which the number of contacts follows a Poisson distribution. Using the lattice model, we also investigate the effect of the small-world phenomenon on the dynamics of social norms. In our models, each individual learns a social norm by trial and error (individual learning) and also imitates the other's social norm (social learning). We investigate how social network structure and learning systems affect the spread of two linked social norms. Our main results are: (1) Social learning does not lead to coexistence of social norms. Individual learning produces coexistence, and the dynamics of coexistence depend on which social norms are learned individually. (2) Social norms spread fastest in the power-law network model, followed by the random graph model, the complete mixing model, the two-dimensional lattice model and the one-dimensional lattice. (3) We see a "small world effect" in the one-dimensional model, but not in two dimensions.     

Applying evolutionary models to the laboratory study of social learning

Cultural evolution is driven, in part, by the strategies that individuals employ to acquire behavior from others. These strategies themselves are partly products of natural selection, making the study of social learning an inherently Darwinian project. Formal models of the evolution of social learning suggest that reliance on social learning should increase with task difficulty and decrease with the probability of environmental change. These models also make predictions about how individuals integrate information from multiple peers. We present the results of microsociety experiments designed to evaluate these predictions. The first experiment measures baseline individual learning strategy in a two-armed bandit environment with variation in task difficulty and temporal fluctuation in the payoffs of the options. Our second experiment addresses how people in the same environment use minimal social information from a single peer. Our third experiment expands on the second by allowing access to the behavior of several other individuals, permitting frequency-dependent strategies like conformity. In each of these experiments, we vary task difficulty and environmental fluctuation. We present several candidate strategies and compute the expected payoffs to each in our experimental environment. We then fit to the data the different models of the use of social information and identify the best-fitting model via model comparison techniques. We find substantial evidence of both conformist and nonconformist social learning and compare our results to theoretical expectations.     

Cooperative coordination as a social behavior

Coordinating behavior is widespread in contexts that include courtship, aggression, and cooperation for shared outcomes. The social significance of cooperative coordination (CC) is usually downplayed by learning theorists, evolutionary biologists, and game theorists in favor of an individual behavior → outcome perspective predicated on maximizing payoffs for all participants. To more closely model CC as it occurs under free-ranging conditions, pairs of rats were rewarded for coordinated shuttling within a shared chamber with unrestricted social interaction. Results show that animals learned to work together with sensitivity to the task and type of partner. Moreover, social interaction and coordination influenced both consumption of the reward solution immediately following a session and preference for cooperation, suggesting that affective states and incentives related to cooperation extend beyond the outcomes obtained. These results support field studies by showing not only how cooperation is performed but also the importance of considering how the behavior of cooperating affects outcomes and preference for cooperating. This article and some of the research described here were supported in part by Grant 96-00293 from the United States-Israel Binational Science Foundation to the author and Peter R. Killeen of Arizona State University. Richard Schuster (Ph.D. in Psychology, Harvard University 1968) has been a Lecturer in Psychology at the University of Zambia (1971–1977), with field research on antelopes, and a Lecturer at the Department of Psychology, University of Haifa, Israel (1977-present). His main research focus is on laboratory models of social behavior.     

Evolution of learning capacities and learning levels

Humans strongly depend on individual and social learning, both of which are highly effective and accurate. I study the effects of environmental change on the evolution of the effectiveness and accuracy of individual and social learning (individual and social learning levels) and the number of pieces of information learned individually and socially (individual and social learning capacities) by analyzing a mathematical model. I show that individual learning capacity decreases and social learning capacity increases when the environment becomes more stable; both decrease when the environment becomes milder. I also show that individual learning capacity increases when individual learning level increases or social learning level decreases, while social learning capacity increases when individual or social learning level increases. The evolution of high learning levels can be triggered when the environment becomes severe, but a high social learning level can evolve only when a high individual learning level can simultaneously evolve with it.     

Network-based diffusion analysis: a new method for detecting social learning

Social learning has been documented in a wide diversity of animals. In free-living animals, however, it has been difficult to discern whether animals learn socially by observing other group members or asocially by acquiring a new behaviour independently. We addressed this challenge by developing network-based diffusion analysis (NBDA), which analyses the spread of traits through animal groups and takes into account that social network structure directs social learning opportunities. NBDA fits agent-based models of social and asocial learning to the observed data using maximum-likelihood estimation. The underlying learning mechanism can then be identified using model selection based on the Akaike information criterion. We tested our method with artificially created learning data that are based on a real-world co-feeding network of macaques. NBDA is better able to discriminate between social and asocial learning in comparison with diffusion curve analysis, the main method that was previously applied in this context. NBDA thus offers a new, more reliable statistical test of learning mechanisms. In addition, it can be used to address a wide range of questions related to social learning, such as identifying behavioural strategies used by animals when deciding whom to copy.     

Evolution of learning in fluctuating environments: when selection favors both social and exploratory individual learning

Cumulative cultural change requires organisms that are capable of both exploratory individual learning and faithful social learning. In our model, an organism's phenotype is initially determined innately (by its genotypic value) or by social learning (copying a phenotype from the parental generation), and then may or may not be modified by individual learning (exploration around the initial phenotype). The environment alternates periodically between two states, each defined as a certain range of phenotypes that can survive. These states may overlap, in which case the same phenotype can survive in both states, or they may not. We find that a joint social and exploratory individual learning strategy-the strategy that supports cumulative culture-is likely to spread when the environmental states do not overlap. In particular, when the environmental states are contiguous and mutation is allowed among the genotypic values, this strategy will spread in either moderately or highly stable environments, depending on the exact nature of the individual learning applied. On the other hand, natural selection often favors a social learning strategy without exploration when the environmental states overlap. We find only partial support for the "consensus" view, which holds that individual learning, social learning, and innate determination of behavior will evolve at short, intermediate, and long environmental periodicities, respectively.     

Spread of costly prestige-seeking behavior by social learning

Mathematical and simulation models of cultural transmission in a population where individuals may differ in their social status are developed. High-status individuals are assumed to be more influential to others but no more fertile or viable than low-status individuals. Analysis of the models suggests that culturally transmitted values, beliefs, and preferences that cause individuals to engage in prestige-seeking behavior can sometimes invade the population, even if that behavior reduces the net reproductive success of the prestige seekers. It is argued that some of the seemingly maladaptive behaviors observed in human societies may be a result of cultural evolution based on the human capacity for social learning, rather than a product of the "time lag" before the evolutionary modification of the human predisposition in response to the recent drastic changes in the environment.     

Age-dependent social learning in a lizard

Evidence of social learning, whereby the actions of an animal facilitate the acquisition of new information by another, is taxonomically biased towards mammals, especially primates, and birds. However, social learning need not be limited to group-living animals because species with less interaction can still benefit from learning about potential predators, food sources, rivals and mates. We trained male skinks (Eulamprus quoyii), a mostly solitary lizard from eastern Australia, in a two-step foraging task. Lizards belonging to ‘young’ and ‘old’ age classes were presented with a novel instrumental task (displacing a lid) and an association task (reward under blue lid). We did not find evidence for age-dependent learning of the instrumental task; however, young males in the presence of a demonstrator learnt the association task faster than young males without a demonstrator, whereas old males in both treatments had similar success rates. We present the first evidence of age-dependent social learning in a lizard and suggest that the use of social information for learning may be more widespread than previously believed.     

The neural basis of human female mate copying: An empathy-based social learning process

We used functional magnetic resonance imaging (fMRI) to investigate the neural basis of human female mate copying. Consistent with previous mate copying effects, women's attractiveness ratings for target males increased significantly greater after the males were observed paired with romantic partners versus ordinary friends, and this was mainly accounted for by males being paired with attractive romantic partners. Attractiveness ratings for male targets were lower when they were paired with an attractive opposite-sex friend. The fMRI data showed that the observational learning process in mate copying recruited brain regions including the putamen, the inferior frontal gyrus, the middle cingulate, the SMA, the insula, and the thalamus – areas overlapped with brain regions involved in empathy. The blood-oxygen-level-dependent (BOLD) signals in higher cognitive functions including the parieto-frontal network, as well as visual areas, were significantly more activated when women evaluated males in the friend versus romantic-partner context, whereas brain regions were not more active in the reverse comparison, suggesting that less cognitive functions or as least no more functions were involved in evaluating the quality of target males in the romantic-partner context than in the friend context. Further analysis indicated that specific brain regions related to the evaluation process of mate copying were associated with bilateral fusiform gyrus (FFA). Thus, results are consistent with a view that mate copying is a domain-specific adaptation involving an empathy-based social-learning process that is also associated with reduced cognition.     

社群学习对植食性鸟类和哺乳动物觅食行为的作用

社群学习是动物的一种可塑性行为表现型式。综述了社群学习对植食性鸟类和哺乳动物觅食行为的作用,并述评了其学习机制。社群同伴对动物个体觅食地点、时间和取食方式均有影响,母体摄食的食物信息可通过胎盘和乳汁显著影响幼体的食物选择。动物通过观察学习、嗅闻学习以及味觉厌恶学习,不仅能更快找到食物资源,提高觅食效率,而且能有效降低中毒与被捕食的风险,从而提高其适合度。