Reinforcement and learning

Evidence has been accumulating to support the process of reinforcement as a potential mechanism in speciation. In many species, mate choice decisions are influenced by cultural factors, including learned mating preferences (sexual imprinting) or learned mate attraction signals (e.g., bird song). It has been postulated that learning can have a strong impact on the likelihood of speciation and perhaps on the process of reinforcement, but no models have explicitly considered learning in a reinforcement context. We review the evidence that suggests that learning may be involved in speciation and reinforcement, and present a model of reinforcement via learned preferences. We show that not only can reinforcement occur when preferences are learned by imprinting, but that such preferences can maintain species differences easily in comparison with both autosomal and sex-linked genetically inherited preferences. We highlight the need for more explicit study of the connection between the behavioral process of learning and the evolutionary process of reinforcement in natural systems.     

Learning to speciate: The biased learning of mate preferences promotes adaptive radiation

Bursts of rapid repeated speciation called adaptive radiations have generated much of Earth's biodiversity and fascinated biologists since Darwin, but we still do not know why some lineages radiate and others do not. Understanding what causes assortative mating to evolve rapidly and repeatedly in the same lineage is key to understanding adaptive radiation. Many species that have undergone adaptive radiations exhibit mate preference learning, where individuals acquire mate preferences by observing the phenotypes of other members of their populations. Mate preference learning can be biased if individuals also learn phenotypes to avoid in mates, and shift their preferences away from these avoided phenotypes. We used individual‐based computational simulations to study whether biased and unbiased mate preference learning promotes ecological speciation and adaptive radiation. We found that ecological speciation can be rapid and repeated when mate preferences are biased, but is inhibited when mate preferences are learned without bias. Our results suggest that biased mate preference learning may play an important role in generating animal biodiversity through adaptive radiation.     

Opposites attract? Mate choice for parasite evasion and the evolutionary stability of sex

If sex is naturally selected as a way to combat parasites, then sexual selection for disease resistance might increase the overall strength of selection for outcrossing. In the present study, we compared how two forms of mate choice affect the evolutionary stability of outcrossing in simultaneous hermaphrodites. In the first form, individuals preferred to mate with uninfected individuals (condition-dependent choice). In the second form, individuals preferred to mate with individuals that shared the least number of alleles in common at disease-resistance loci. The comparisons were made using individual-based computer simulations in which we varied parasite virulence, parasite transmission rate, and the rate of deleterious mutation at 500 viability loci. We found that alleles controlling both forms of mate choice spread when rare, but their effects on the evolutionary stability of sex were markedly different. Surprisingly, condition-dependent choice for uninfected mates had little effect on the evolutionary stability of sexual reproduction. In contrast, active choice for mates having different alleles at disease-resistance loci had a pronounced positive effect, especially under low rates of deleterious mutation. Based on these results, we suggest that mate choice that increases the genetic diversity of offspring can spread when rare in a randomly mating population, and, as an indirect consequence, increase the range of conditions under which sexual reproduction is evolutionarily stable.     

The effect of learning on experimental evolution of resource preference in Drosophila melanogaster

Abstract Learning is thought to be adaptive in variable environments, whereas constant, predictable environments are supposed to favor unconditional, genetically fixed responses. A dichotomous view of behavior as either learned or innate ignores a potential evolutionary interaction between the learned and innate components of a behavioral response. We addressed this interaction in the context of oviposition substrate choice in Drosophila melanogaster, asking two main questions. First, will learning also evolve in a constant environment in which it always pays to show the same choice? Second, how does an opportunity to learn affect the evolution of the innate (genetic) component of oviposition substrate choice? We exposed experimental populations to four selection regimes, involving selection on oviposition substrate preference (an orange versus a pineapple medium). In two selection regimes the flies were selected for preference either for the orange medium, or for the pineapple medium. In the remaining two selection regimes the flies were also selected for preference for either orange or pineapple, but additionally could use past experience (aversion learning) to decide which medium it paid to avoid. Lines exposed to the latter selection regimes evolved improved learning ability, indicating that learning may be advantageous even if the same behavioral response is favored every generation. Furthermore, of the two selection regimes that favored oviposition on the pineapple medium, the regime that allowed for learning led to the evolution of a stronger innate preference for pineapple, than the regime that did not allow for learning. In contrast, of the two regimes that selected for oviposition on the orange medium, the one that allowed for learning led to a smaller evolutionary change of the innate preference. Thus, an opportunity to learn facilitated the evolution of innate preference under selection for preference for pineapple, but hindered it under selection for preference for orange. We discuss possible mechanisms for this effect.     

ASSORTATIVE MATE CHOICE AND DOMINANCE MODIFICATION: ALTERNATIVE WAYS OF REMOVING HETEROZYGOTE DISADVANTAGE

In genetic polymorphisms of two alleles, heterozygous individuals may contribute to the next generation on average more or fewer descendants than the homozygotes. Two different evolutionary responses that remove a disadvantageous heterozygote phenotype from the population are the evolution of strictly assortative mate choice, and that of a modifier making one of the two alleles completely dominant. We derive invasion fitness of mutants introducing dominance or assortative mate choice in a randomly mating population with a genetic polymorphism for an ecological trait. Mutations with small effects as well as mutants introducing complete dominance or perfect assorting are considered. Using adaptive dynamics techniques, we are able to calculate the ratio of fitness gradients for the effects of a dominance modifier and a mate choice locus, near evolutionary branching points. With equal resident allele frequencies, selection for mate choice is always stronger. Dominance is more strongly selected than assortative mating when the resident (common) alleles have very unequal frequencies at equilibrium. With female mate choice the difference in frequencies where dominance is more strongly selected is smaller than when mutants of both sexes can choose without costs. A symmetric resource-competition model illustrates the results.     

The role of maternal and paternal effects in the evolution of parental quality by sexual selection

Genetic models of maternal effects and models of mate choice have focused on the evolutionary effects of variation in parental quality. There have been, however, few attempts to combine these into a single model for the evolution of sexually selected traits. We present a quantitative genetic model that considers how male and female parental quality (together or separately) affect the expression of a sexually selected offspring trait. We allow female choice of males based on this parentally affected trait and examine the evolution of mate choice, parental quality and the indicator trait. Our model reveals a number of consequences of maternal and paternal effects. (1) The force of sexual selection owing to adaptive mate choice can displace parental quality from its natural selection optimum. (2) The force of sexual selection can displace female parental quality from its natural selection optimum even when nonadaptive mate choice occurs (e.g. runaway sexual selection), because females of higher parental quality produce more attractive sons and these sons counterbalance the loss in fitness owing to over-investment in each offspring. (3) Maternal and paternal effects can provide a source of genetic variation for offspring traits, allowing evolution by sexual selection even when those traits do not show direct genetic variation (i.e. are not heritable). (4) The correlation between paternal investment and the offspring trait influenced by the parental effects can result in adaptive mate choice and lead to the elaboration of both female preference and the male sexually selected trait. When parental effects exist, sexual selection can drive the evolution of parental quality when investment increases the attractiveness of offspring, leading to the elaboration of indicator traits and higher than expected levels of parental investment.     

Evolution of learned strategy choice in a frequency-dependent game

In frequency-dependent games, strategy choice may be innate or learned. While experimental evidence in the producer-scrounger game suggests that learned strategy choice may be common, a recent theoretical analysis demonstrated that learning by only some individuals prevents learning from evolving in others. Here, however, we model learning explicitly, and demonstrate that learning can easily evolve in the whole population. We used an agent-based evolutionary simulation of the producer-scrounger game to test the success of two general learning rules for strategy choice. We found that learning was eventually acquired by all individuals under a sufficient degree of environmental fluctuation, and when players were phenotypically asymmetric. In the absence of sufficient environmental change or phenotypic asymmetries, the correct target for learning seems to be confounded by game dynamics, and innate strategy choice is likely to be fixed in the population. The results demonstrate that under biologically plausible conditions, learning can easily evolve in the whole population and that phenotypic asymmetry is important for the evolution of learned strategy choice, especially in a stable or mildly changing environment.     

Evidence of social effects on mate choice in vertebrates

Study of determinants of mate selection by animals has a long history in evolutionary biology and behavioural ecology. However, only during the past decade have investigators begun to conduct experiments exploring the various ways in which observation of the behaviour of others might influence mate selection. Here, we review both field and laboratory studies of behavioural processes that underlie non-independence in mate choice, discussing both direct and indirect social influences on mate selection. We focus on laboratory studies in which guppies and Japanese quail, species that have received greatest attention from investigators, have served as subjects. Although much is now known about how public information can affect mate selection in controlled environments, there are still significant gaps in our knowledge of whether and how such information contributes to mate selections by members of free-living populations.     

Sex differences in developmental plasticity and canalization shape population divergence in mate preferences

Sexual selection of high-quality mates can conflict with species recognition if traits that govern intraspecific mate preferences also influence interspecific recognition. This conflict might be resolved by developmental plasticity and learned mate preferences, which could drive preference divergence in populations that differ in local species composition. We integrate field and laboratory experiments on two calopterygid damselfly species with population genetic data to investigate how sex differences in developmental plasticity affect population divergence in the face of gene flow. Whereas male species recognition is fixed at emergence, females instead learn to recognize heterospecifics. Females are therefore more plastic in their mate preferences than males. We suggest that this results from sex differences in the balance between sexual selection for high-quality mates and selection for species recognition. As a result of these sex differences, females develop more pronounced population divergence in their mate preferences compared with males. Local ecological community context and presence of heterospecifics in combination with sex differences in plasticity and canalization therefore shape population divergence in mate preferences. As ongoing environmental change and habitat fragmentation bring formerly allopatric species into secondary contact, developmental plasticity of mate preferences in either or both sexes might facilitate coexistence and prevent local species extinction.     

Synergistic selection between ecological niche and mate preference primes diversification

The ecological niche and mate preferences have independently been shown to be important for the process of speciation. Here, we articulate a novel mechanism by which ecological niche use and mate preference can be linked to promote speciation. The degree to which individual niches are narrow and clustered affects the strength of divergent natural selection and population splitting. Similarly, the degree to which individual mate preferences are narrow and clustered affects the strength of divergent sexual selection and assortative mating between diverging forms. This novel perspective is inspired by the literature on ecological niches; it also explores mate preferences and how they may contribute to speciation. Unlike much comparative work, we do not search for evolutionary patterns using proxies for adaptation and sexual selection, but rather we elucidate how ideas from niche theory relate to mate preference, and how this relationship can foster speciation. Recognizing that individual and population niches are conceptually and ecologically linked to individual and population mate preference functions will significantly increase our understanding of rapid evolutionary diversification in nature. It has potential to help solve the difficult challenge of testing the role of sexual selection in the speciation process. We also identify ecological factors that are likely to affect individual niche and individual mate preference in synergistic ways and as a consequence to promote speciation. The ecological niche an individual occupies can directly affect its mate preference. Clusters of individuals with narrow, differentiated niches are likely to have narrow, differentiated mate preference functions. Our approach integrates ecological and sexual selection research to further our understanding of diversification processes. Such integration may be necessary for progress because these processes seem inextricably linked in the natural world.     

Pairing dynamics and the origin of species

Whether sexual selection alone can drive the evolution of assortative mating in the presence of gene flow is a long-standing question in evolutionary biology. Here, we report a role for pairing dynamics of individuals when mate choice is mutual, which is sufficient for the evolution of assortative mating by sexual selection alone in the presence of gene flow. Through behavioural observation, individual-based simulation and population genetic analysis, we evaluate the pairing dynamics of coral reef fish in the genus Hypoplectrus (Serranidae), and the role these dynamics can play for the evolution of assortative mating. When mate choice is mutual and the stability of mating pairs is critical for reproductive success, the evolution of assortative mating in the presence of gene flow is not only possible, but is also a robust evolutionary outcome.     

Interaction between natural and sexual selection during the evolution of mate recognition

The interaction between natural and sexual selection is central to many theories of how mate choice and reproductive isolation evolve, but their joint effect on the evolution of mate recognition has not, to my knowledge, been investigated in an evolutionary experiment. Natural and sexual selection were manipulated in interspecific hybrid populations of Drosophila to determine their effects on the evolution of a mate recognition system comprised of cuticular hydrocarbons (CHCs). The effect of natural selection in isolation indicated that CHCs were costly for males and females to produce. The effect of sexual selection in isolation indicated that females preferred males with a particular CHC composition. However, the interaction between natural and sexual selection had a greater effect on the evolution of the mate recognition system than either process in isolation. When natural and sexual selection were permitted to operate in combination, male CHCs became exaggerated to a greater extent than in the presence of sexual selection alone, and female CHCs evolved against the direction of natural selection. This experiment demonstrated that the interaction between natural and sexual selection is critical in determining the direction and magnitude of the evolutionary response of the mate recognition system.     

Differential allocation: tests, mechanisms and implications

Differential allocation occurs when reproductive investment is influenced by mate attractiveness. Recently, wide-ranging empirical support for differential allocation has been obtained. These data suggest that mates can affect the payoffs from reproduction, thus making sacrifices of reproductive value worthwhile when breeding with an attractive mate. As an example of an adaptive parental effect, the existence of differential allocation has some interesting implications for empirical studies of sexual selection and for predicting evolutionary responses to selection.     

A Cost of Sexual Attractiveness to High-Fitness Females

Adaptive mate choice by females is an important component of sexual selection in many species. The evolutionary consequences of male mate preferences, however, have received relatively little study, especially in the context of sexual conflict, where males often harm their mates. Here, we describe a new and counterintuitive cost of sexual selection in species with both male mate preference and sexual conflict via antagonistic male persistence: male mate choice for high-fecundity females leads to a diminished rate of adaptive evolution by reducing the advantage to females of expressing beneficial genetic variation. We then use a Drosophila melanogaster model system to experimentally test the key prediction of this theoretical cost: that antagonistic male persistence is directed toward, and harms, intrinsically higher-fitness females more than it does intrinsically lower-fitness females. This asymmetry in male persistence causes the tails of the population''s fitness distribution to regress towards the mean, thereby reducing the efficacy of natural selection. We conclude that adaptive male mate choice can lead to an important, yet unappreciated, cost of sex and sexual selection.     

Mate choice for neutral and MHC genetic characteristics in Alpine marmots: different targets in different contexts?

Sexual selection through female mate choice for genetic characteristics has been suggested to be an important evolutionary force maintaining genetic variation in animal populations. However, the genetic targets of female mate choice are not clearly identified and whether female mate choice is based on neutral genetic characteristics or on particular functional loci remains an open question. Here, we investigated the genetic targets of female mate choice in Alpine marmots (Marmota marmota), a socially monogamous mammal where extra‐pair paternity (EPP) occurs. We used 16 microsatellites to describe neutral genetic characteristics and two MHC loci belonging to MHC class I and II as functional genetic characteristics. Our results reveal that (1) neutral and MHC genetic characteristics convey different information in this species, (2) social pairs show a higher MHC class II dissimilarity than expected under random mate choice, and (3) the occurrence of EPP increases when social pairs present a high neutral genetic similarity or dissimilarity but also when they present low MHC class II dissimilarity. Thus, female mate choice is based on both neutral and MHC genetic characteristics, and the genetic characteristics targeted seem to be context dependent (i.e., the genes involved in social mate choice and genetic mate choice differ). We emphasize the need for empirical studies of mate choice in the wild using both neutral and MHC genetic characteristics because whether neutral and functional genetic characteristics convey similar information is not universal.     

Turbidity Hampers Mate Choice in a Pipefish

European coastal waters have in recent years become more turbid as algal growth has increased, probably due to eutrophication, global warming and changes in fish communities. Turbidity reduces visibility, and such changes may in turn affect animal behaviour as well as evolutionary processes that are dependent on visual stimuli. In this study we experimentally manipulated water visibility and olfactory cues to investigate mate choice using the sex role‐reversed broad‐nosed pipefish Syngnathus typhle as our study organism. We show that males spent significantly longer time assessing females when they had access to full visual cues, compared to when visibility was reduced. Presence or absence of olfactory cues from females did not affect mate choice, suggesting that the possible use of smell could not make up for a reduction in visibility. This implies that mate choice is environmentally dependent and that an increased turbidity may affect processes of sexual selection through an impaired possibility for visually based mate choice.     

Looking for sexual selection in the female brain

Female mate choice behaviour has significant evolutionary consequences, yet its mechanistic origins are not fully understood. Recent studies of female sensory systems have made great strides in identifying internal mechanisms governing female preferences. Only recently, however, have we begun to identify the dynamic genomic response associated with mate choice behaviour. Poeciliids provide a powerful comparative system to examine genomic responses governing mate choice and female preference behaviour, given the great range of mating systems: from female mate choice taxa with ornamental courting males to species lacking male ornamentation and exhibiting only male coercion. Furthermore, they exhibit laboratory-tractable preference responses without sexual contact that are decoupled from reproductive state, allowing investigators to isolate mechanisms in the brain without physiological confounds. Early investigations with poeciliid species (Xiphophorus nigrensis and Gambusia affinis) have identified putative candidate genes associated with female preference response and highlight a possible genomic pathway underlying female social interactions with males linked functionally with synaptic plasticity and learning processes. This network is positively correlated with female preference behaviour in the female mate choice species, but appears inhibited in the male coercive species. This behavioural genomics approach provides opportunity to elucidate the fundamental building blocks, and evolutionary dynamics, of sexual selection.     

Experimental evaluation of the relationship between lethal or non-lethal virulence and transmission success in malaria parasite infections

Background

Theoretical studies suggest that direct and indirect selection have the potential to cause substantial evolutionary change in female mate choice. Similarly, sexual selection is considered a strong force in the evolution of male attractiveness and the exaggeration of secondary sexual traits. Few studies have, however, directly tested how female mate choice and male attractiveness respond to selection. Here we report the results of a selection experiment in which we selected directly on female mating preference for attractive males and, independently, on male attractiveness in the guppy, Poecilia reticulata. We measured the direct and correlated responses of female mate choice and male attractiveness to selection and the correlated responses of male ornamental traits, female fecundity and adult male and female survival.

Results

Surprisingly, neither female mate choice nor male attractiveness responded significantly to direct or to indirect selection. Fecundity did differ significantly among lines in a way that suggests a possible sexually-antagonistic cost to male attractiveness.

Conclusions

The opportunity for evolutionary change in female mate choice and male attractiveness may be much smaller than predicted by current theory, and may thus have important consequences for how we understand the evolution of female mate choice and male attractiveness. We discuss a number of factors that may have constrained the response of female choice and male attractiveness to selection, including low heritabilities, low levels of genetic (co)variation in the multivariate direction of selection, sexually-antagonistic constraint on sexual selection and the "environmental covariance hypothesis".

     

The evolution and significance of male mate choice

The distinct reproductive roles of males and females, which for many years were characterised in terms of competitive males and choosy females, have remained a central focus of sexual selection since Darwin's time. Increasing evidence now shows that males can be choosy too, even in apparently unexpected situations, such as under polygyny or in the absence of male parental care. Here, we provide a synthesis of the theory on male mate choice and examine the factors that promote or constrain its evolution. We also discuss the evolutionary significance of male mate choice and the contrasts in male versus female mate choice. We conclude that mate choice by males is potentially widespread and has a distinct role in how mating systems evolve.     

Covariation and repeatability of male mating effort and mating preferences in a promiscuous fish

Although mate choice by males does occur in nature, our understanding of its importance in driving evolutionary change remains limited compared with that for female mate choice. Recent theoretical models have shown that the evolution of male mate choice is more likely when individual variation in male mating effort and mating preferences exist and positively covary within populations. However, relatively little is known about the nature of such variation and its maintenance within natural populations. Here, using the Trinidadian guppy (Poecilia reticulata) as a model study system, we report that mating effort and mating preferences in males, based on female body length (a strong correlate of fecundity), positively covary and are significantly variable among subjects. Individual males are thus consistent, but not unanimous, in their mate choice. Both individual mating effort (including courtship effort) and mating preference were significantly repeatable. These novel findings support the assumptions and predictions of recent evolutionary models of male mate choice, and are consistent with the presence of additive genetic variation for male mate choice based on female size in our study population and thus with the opportunity for selection and further evolution of large female body size through male mate choice.