Optimizing foraging behaviour through learning

Manifestation of life-history strategy is through the allocation of resources acquired by foraging. Foraging efficiency can be improved by learning, as fishes adjust their behaviour to changing circumstances. We briefly review the influence of learning on the foraging behaviour of fishes and make recommendations for further research. We stress the importance of quantifying learning and memory in relation to ontogeny and life history.     

Model-based hierarchical reinforcement learning and human action control

Recent work has reawakened interest in goal-directed or ‘model-based’ choice, where decisions are based on prospective evaluation of potential action outcomes. Concurrently, there has been growing attention to the role of hierarchy in decision-making and action control. We focus here on the intersection between these two areas of interest, considering the topic of hierarchical model-based control. To characterize this form of action control, we draw on the computational framework of hierarchical reinforcement learning, using this to interpret recent empirical findings. The resulting picture reveals how hierarchical model-based mechanisms might play a special and pivotal role in human decision-making, dramatically extending the scope and complexity of human behaviour.     

Social learning of novel route preferences in adult humans

Non-human animals can acquire novel route preferences by following knowledgeable individuals. Such socially learned route preferences can be stably maintained over multiple transmission episodes, sometimes forming long-lived traditions. In humans, preferences for familiar routes or heavily used worn trails over unfamiliar ones have been described in various contexts. However, social learning of route preferences has not been experimentally demonstrated in humans. Here, we demonstrate that social learning and tradition influence route choice. We led adult male and female participants into a room by one of two routes. Participants followed the demonstrated route choices, and later remembered and preferred this choice even when determinably suboptimal (i.e. longer and not preferred by control participants) or when the choice was indicated as arbitrary (the demonstrator took one route to retrieve a poster that had ostensibly fallen). Moreover, route preferences were stably maintained over multiple transmission episodes. We suggest that simple social learning processes, often neglected in human and primate research, can result in long-lived route preferences that may influence a range of additional behaviour patterns.     

Individual-learning ability predicts social-foraging strategy in house sparrows

Social foragers can use either a ‘producer’ strategy, which involves searching for food, or a ‘scrounger’ strategy, which involves joining others'' food discoveries. While producers rely on personal information and past experience, we may ask whether the tendency to forage as a producer is related to being a better learner. To answer this question, we hand-raised house sparrow (Passer domesticus) nestlings that upon independence were given an individual-learning task that required them to associate colour signal and food presence. Following the testing phase, all fledglings were released into a shared aviary, and their social-foraging tendencies were measured. We found a significant positive correlation between individual''s performance in the individual-learning task and subsequent tendency to use searching (producing) behaviour. Individual-learning score was negatively correlated with initial fear of the test apparatus and with body weight. However, the correlation between individual learning and searching remained significant after controlling for these variables. Since it was measured before the birds entered a social group, individual-learning ability could not be the outcome of being a producer. However, the two traits may be initially associated, or individual learning could facilitate producing behaviour. To our knowledge, this is the first evidence that associates individual-learning abilities with social-foraging strategies in animal groups.     

The importance of location and visual cues during foraging in the German wasp (Vespula germanica F.) (Hymenoptera: Vespidae)

Abstract

The way in which foraging wasps use cues for prey location and choice appears to depend on both the context and on the type of prey. Vespula germanica is an opportunistic, generalist prey forager, and individual wasp foragers often return to hunt at sites of previous hunting success. In this paper, we studied which cues are used by this wasp when relocating a food source. Particularly we analysed the response to a displaced visual cue versus a foraging location at which either honey or cat food had been previously presented. We conclude that location is used over a displaced visual cue for directing wasp hovering, although the landing response is directed differently according to bait type. When wasps are exploiting cat food, location also elicits landing, but if they are exploiting honey, a displaced visual cue elicits landing more frequently than location.     

Flight-initiation response reflects short- and long-term human visits to remote islets

The increasing use of, and visits to, isolated territories by people (especially tourists) enables the investigation of how biodiversity reacts to evolutionarily novel pressures. We explored the behavioural reaction of a breeding seabird species, the Brown Noddy Anous stolidus, to our repeated visits at two study sites in the Chesterfield Islands, a newly classified reserve in the Coral Sea Natural Park. Repeated measures of flight-initiation distances (FIDs) at three sites and over time suggest that human visitations induced both a spatial phenotypical sorting or learning of individuals and a temporal habituation. In light of the novel ‘Sit and Defend’ mode of avian nest defence, the study finally provides the first dataset of FIDs for this species, and highlights management opportunities that could arise from the replication of such an approach to other breeding seabirds and therefore the conservation of remote island ecosystems.     

Eye contact enhances mimicry of intransitive hand movements

When two people meet in a bar, a subtle interplay of social behaviours, including eye contact and unconscious mimicry of actions play an important role in how much the individuals like each other by the end of the evening. However, it is not known how these different social signals interact. Here, we adopt a rapid mimicry paradigm, to test if eye contact can modulate mimicry on a second by second time scale. Our results show that direct eye contact rapidly and specifically enhances mimicry of hand actions. These findings have implications for understanding the role of eye contact as a controlling signal in human non-verbal social behaviour.     

Inhibitory control in zebrafish,Danio rerio

We assessed whether zebrafish, Danio rerio, display inhibitory control using a simple and rapid behavioural test. Zebrafish were exposed to a prey stimulus placed inside a transparent tube, which initially elicited attack behaviour. However, zebrafish showed a rapid reduction in the number of attacks towards the prey, which indicated the ability to inhibit their foraging behaviour. Zebrafish also exhibited mnemonic retention of foraging inhibition, as indicated by a reduced number of attacks in a subsequent exposure to the unreachable prey. The ability to inhibit the foraging behaviour varied across three genetically separated wild-type strains and across different individuals within strains, suggesting that zebrafish show heritable within-species differences in inhibitory control. Our behavioural test might be suitable for screening large zebrafish populations in mutational studies and assessing the effects of pharmacologically active substances on inhibitory control.     

Differential response of Trichogramma wasps to extreme sex pheromone types of the noctuid moth Heliothis virescens

1. Chemical espionage in nature may occur when predators or parasitoids home in on animal or plant communication signals. Parasitoid wasps are known to use pheromones emitted by adults hosts to locate host eggs, larvae or pupae. The response of Trichogramma egg parasitoids to a synthetic sex pheromone blend of moths has been shown in a number of studies over the past 40 years. 2. Trichogramma pretiosum (Hymenoptera, Trichogrammatidae) is a tiny parasitic wasp, attacking the eggs of the noctuid moth Heliothis virescens (Lepidoptera, Noctuidae). This study investigated whether T. pretiosum homes in on the sex pheromone of H. virescens at close range. The arrestment response of the wasps to sex pheromone gland extracts of two types of female moths, so‐called high and low females, was also tested, referring to two selected extreme pheromone types of H. virescens. The study also investigated whether the wasps would mount females, possibly to hitchhike with them. 3. The wasps were arrested by the common, ‘low’ pheromone, but not by the rare, ‘high’ pheromone or by extracts from male hairpencils. The wasps did not show a preference for separate sex pheromone compounds, but when pre‐exposed to the major sex pheromone component of H. virescens before the tests together with H. virescens eggs, they did show a preference, indicating learning behaviour. In the mounting experiments, mated females were mounted significantly more than virgin females or males, suggesting that hitchhiking is a strategy used by these wasps to locate moth eggs. 4. This represents the first study to show a differential response of parasitoid wasps to two different sex pheromone types in a single host species. The results warrant further investigations into the potential role of parasitic wasps in the evolution of sexual communication in moths.     

Learning and signal copying facilitate communication among bird species

Signals relevant to different sets of receivers in different contexts create a conflict for signal design. A classic example is vocal alarm signals, often used both during intraspecific and interspecific interactions. How can signals alert individuals from a variety of other species in some contexts, while also maintaining efficient communication among conspecifics? We studied heterospecific responses to avian alarm signals that drive the formation of anti-predator groups but are also used during intraspecific interactions. In three species-rich communities in the western Himalayas, alarm signals vary drastically across species. We show that, independently of differences in their calls, birds respond strongly to the alarm signals of other species with which they co-occur and much more weakly to those of species with which they do not co-occur. These results suggest that previous exposure and learning maintain heterospecific responses in the face of widespread signal divergence. At an area where only two species regularly interact, one species'' calls incorporate the call of the other. We demonstrate experimentally that signal copying allows strong responses even without previous exposure and suggest that such hybrid calls may be especially favoured when pairwise interactions between species are strong.     

Relative abilities of young sheep and goats to self-medicate with tannin-rich sainfoin when infected with gastrointestinal nematodes

Plant secondary metabolites (PSM) are one of the promising options to control gastrointestinal nematodes in sheep and goats. The objective of this study was to assess the abilities of sheep and goats to self-medicate with tannin-rich sainfoin (Onobrychis viciifolia) (SF) when infected with gastrointestinal nematodes, using a cafeteria and an operant conditioning trial. Hypotheses were that parasitized (P) lambs and goat kids would show greater intake and preference for SF than their non-parasitized (NP) counterparts, that kids would eat more SF than lambs (due to their lower resistance against parasites and their greater ability to consume PSM), and that SF intake would increase over time for P animals. We used 20 female kids and 20 ewe lambs aged 3 months. Half of the animals per species (n = 10) were experimentally infected with 170 L₃ larvae of Haemonchus contortus/kg of BW (P). The other half were free from parasites throughout the study (NP). Five weeks after infection, animals were exposed to a 24-day cafeteria trial (three 8-day periods) offering a free choice between two legume pellets: SF (3.8% condensed tannins) and alfalfa (ALF, Medicago sativa; no tannin). Subsequently, animals were involved in an operant conditioning trial of two 4-day long sessions, to assess in short-term tests their motivation to walk for a SF reward when offered in choice with freely available ALF. In the cafeteria trial, SF preference was greater in kids than in lambs, particularly in the first two periods. We did not observe a greater preference for SF in P animals, which was even greater in NP animals for periods 1 and 2. Sainfoin intake increased through periods for P animals, which led to similar SF preferences for all groups during period 3. In the operant-conditioning trial, motivation to get the SF reward was similar between P and NP animals. These results support the hypotheses that goats are more willing to consume tanniferous feeds than sheep, and that P animals increased SF intake through time. However, the emergence of a curative self-medicative behaviour was not supported, as P individuals did not show greater SF intake, preference, nor a greater motivation to get SF than NP animals, regardless of animal species. These findings are discussed with previous results and some explanations are presented.     

The correlation of learning speed and natural foraging success in bumble-bees

Despite the widespread assumption that the learning abilities of animals are adapted to the particular environments in which they operate, the quantitative effects of learning performance on fitness remain virtually unknown. Here, we evaluate the learning performance of bumble-bees (Bombus terrestris) from multiple colonies in an ecologically relevant associative learning task under laboratory conditions, before testing the foraging performance of the same colonies under the field conditions. We demonstrate that variation in learning speed among bumble-bee colonies is directly correlated with the foraging performance, a robust fitness measure, under natural conditions. Colonies vary in learning speed by a factor of nearly five, with the slowest learning colonies collecting 40% less nectar than the fastest learning colonies. Such a steep fitness function is suggestive of strong selection for higher learning speed. Partial correlation analysis reveals that other factors such as forager body size or colour preference appear to be negligible in our study. Although our study does not directly prove causality of learning on foraging success, our approach of correlating natural within-species variation in these two factors represents a major advance over traditional between-species correlative analyses where comparability can be compromised by the fact that species vary along multiple dimensions.     

What can we teach Drosophila? What can they teach us?

A number of single gene mutations dramatically reduce the ability of fruit flies to learn or to remember. Cloning of the affected genes implicated the adenylyl cyclase second-messenger system as key in learning and memory. The expression patterns of these genes, in combination with other data, indicates that brain structures called mushroom bodies are crucial for olfactory learning. However, the mushroom bodies are not dedicated solely to olfactory processing; they also mediate higher cognitive functions in the fly, such as visual context generalization. Molecular genetic manipulations, coupled with behavioral studies of the fly, will identify rudimentary neural circuits that underly multisensory learning and perhaps also the circuits that mediate more-complex brain functions, such as attention.     

What can we teach Drosophila? What can they teach us?

A number of single gene mutations dramatically reduce the ability of fruit flies to learn or to remember. Cloning of the affected genes implicated the adenylyl cyclase second-messenger system as key in learning and memory. The expression patterns of these genes, in combination with other data, indicates that brain structures called mushroom bodies are crucial for olfactory learning. However, the mushroom bodies are not dedicated solely to olfactory processing; they also mediate higher cognitive functions in the fly, such as visual context generalization. Molecular genetic manipulations, coupled with behavioral studies of the fly, will identify rudimentary neural circuits that underly multisensory learning and perhaps also the circuits that mediate more-complex brain functions, such as attention.     

Why do bees turn back and look?

The timing of learning of colour and shape of the food source, as well as of near-by landmarks, was examined exploiting a behaviour described recently, the Turn Back and Look behaviour (TBL): Bees departing from a novel food source after feeding turn around to view it at a short distance (Figs. 2, 3) before departing for the hive. They repeat this behaviour on several successive visits, termed the TBL phase (Fig. 5). To examine the function of the TBL, I trained individual bees in 4 different modes. In the first 3 they could view a food source or a landmark of a particular colour or shape during (i) arrival as well as departure, (ii) only arrival, and (iii) only departure; in the final mode (iv) the bees viewed one colour (or shape) on arrival, and another on departure. At the end of the TBL phase, the bees were tested by offering them a choice between the visual stimulus to which they were trained (modes i–iii) and a different (novel) one, or between the stimulus viewed on arrival and that viewed on departure (mode iv). The test results show that learning after feeding (while performing the TBL), i.e. backward conditioning, occurs regardless of whether the colour (Fig. 6, Fig. 10a) or shape (Fig. 7) of the food source, or the colour (Fig. 10b), shape (Fig. 11), and position (Fig. 12) of a near-by landmark is considered. Bees trained in mode (iv) preferred the stimulus learned on arrival over that learned on departure in almost all cases. However, a stimulus viewed exclusively on departure (mode iii) was often learned as well as when it was viewed exclusively on arrival (mode ii) (Figs. 10a, 11, 12), or both on arrival and departure (mode i) (Fig. 6). The finding that the timing of learning can be manipulated suggests that it is not based on hard wired predispositions to learn particular visual cues on arrival, and others on departure.     

Food preferences and aversions in human health and nutrition: how can pigs help the biomedical research?

The establishment of food preferences and aversions determines the modulation of eating behaviour and the optimization of food intake. These phenomena rely on the learning and memory abilities of the organism and depend on different psychobiological mechanisms such as associative conditionings and sociocultural influences. After summarizing the various behavioural and environmental determinants of the establishment of food preferences and aversions, this paper describes several issues encountered in human nutrition when preferences and aversions become detrimental to health: development of eating disorders and obesity, aversions and anorexia in chemotherapy-treated or elderly patients and poor palatability of medical substances and drugs. Most of the relevant biomedical research has been performed in rodent models, although this approach has severe limitations, especially in the nutritional field. Consequently, the final aim of this paper is to discuss the use of the pig model to investigate the behavioural and neurophysiological mechanisms underlying the establishment of food preferences and aversions by reviewing the literature supporting analogies at multiple levels (general physiology and anatomy, sensory sensitivity, digestive function, cognitive abilities, brain features) between pigs and humans.     

Possible aversion learning in the Pacific Coast wireworm

The effects of carbon dioxide and the induction of morbidity on aversion learning in larvae of the Pacific Coast wireworm Limonius canus LeConte (Coleoptera: Elateridae) are discussed. Wireworms preconditioned by exposing them one or four times to odour of Tefluthrin 20SC and Dividend XLRTA [Syngenta Crop Protection (Canada), Inc., Canada] during the induction of temporary morbidity subsequently contact tefluthrin‐treated wheat seeds in soil bioassays for as long as naïve (i.e. not preconditioned) larvae but are repelled four to five‐fold more frequently by Dividend‐treated seeds in soil bioassays than naïve wireworms, suggesting that wireworms are capable of associating a novel odour (i.e. Dividend) with morbidity but require a minimum of 10–15 min subsequent contact time with treated seeds before being repelled. Wireworms preconditioned by exposure to peppermint odour during the induction of morbidity are not subsequently repelled by peppermint odour in soil bioassays, suggesting that wireworms are either not capable of aversion learning or that the presence of a CO₂ source and/or a suitable host plant may override a negative cue (i.e. peppermint odour). In studies conducted in the absence of soil, a host plant and CO₂ production, wireworms are repelled slightly by droplets of 1.0% but not 0.1% peppermint oil. Previous exposure to peppermint odour or contact with peppermint oil‐treated filter paper during one induction of morbidity does not increase the repellency of wireworms to 1.0% peppermint oil significantly. Repellency to 1.0% peppermint oil is almost eliminated when morbidity is induced five times in the absence of peppermint odour but is restored when peppermint odour is present during preconditioning. These findings suggest that wireworm sensitivity to repellent compounds decreases when repeatedly made moribund, although the results are not sufficient to conclude that wireworms are capable of associative learning.     

Foraging for intermittently refuged prey: theory and field observations of a parasitoid

Many insect herbivores feed in concealed locations but become accessible intermittently, creating windows of greater vulnerability to attack, and generating a proportion of the prey population that is readily accessible to foraging natural enemies. We incorporated accessible prey into an extant optimal foraging model, and found that this addition allowed opportunistic exploitation of prey that have already emerged from refugia (the leaving strategy) as a viable strategy, in addition to waiting at refugia for prey to emerge (the waiting strategy). We parameterized the model empirically for the parasitoid Macrocentrus grandii and its host, Ostrinia nubilalis, under field conditions. The model predicted that M. grandii should adopt a leaving strategy when host patch density is high (travel time between patches is short), but a waiting strategy when host patch density is low (travel time between patches is long). Field observations of M. grandii patch tenure were consistent with model predictions, indicating that M. grandii exhibited flexible behaviour based on experience within a foraging bout, and that these behavioural shifts improved foraging efficiency. Behaviour of M. grandii was responsive to heterogeneity in host emergence rates, and appeared to be driven by the relatively small proportion of the host population that became accessible at a fast rate. Therefore understanding forager responses to intermittently refuged prey may require characterization of the behaviour of a subset of the prey population, rather than the average prey individual. The model can potentially be used as a framework for comparative studies across forager taxa, to understand when foragers on intermittently accessible prey should adopt fixed waiting or leaving strategies vs. a flexible strategy that is responsive to the current environment.