Optimal foraging when predation risk increases with patch resources: an analysis of pollinators and ambush predators

Pollinators and their predators share innate and learned preferences for high quality flowers. Consequently, pollinators are more likely to encounter predators when visiting the most rewarding flowers. I present a model of how different pollinator species can maximize lifetime resource gains depending on the density and distribution of predators, as well as their vulnerability to capture by predators. For pollinator species that are difficult for predators to capture, the optimal strategy is to visit the most rewarding flowers as long as predator density is low. At higher predator densities and for pollinators that are more vulnerable to predator capture, the lifetime resource gain from the most rewarding flowers declines and the optimal strategy depends on the predator distribution. In some cases, a wide range of floral rewards provides near‐maximum lifetime resource gains, which may favor generalization if searching for flowers is costly. In other cases, a low flower reward level provides the maximum lifetime resource gain and so pollinators should specialize on less rewarding flowers. Thus, the model suggests that predators can have qualitatively different top‐down effects on plant reproductive success depending on the pollinator species, the density of predators, and the distribution of predators across flower reward levels.     

Chimpanzees (Pan troglodytes) tolerate some degree of inequity while cooperating but refuse to donate effort for nothing

In cooperative hunting, a carcass cannot be divided equally, and hunts may be unsuccessful. We studied how chimpanzees respond to these two variables, working for unequal rewards and no rewards, which have been rarely included in experimental cooperative tasks. We presented chimpanzees with a task requiring three chimpanzees to work together and varied the reward structure in two separate experiments. In Experiment 1, two individuals received more rewards than the third, making the outcome unequal. We wanted to know if cooperation would continue or break down, and what mechanisms might maintain performance. Experiment 2 used equal rewards, but this time one or more locations were left unbaited on a proportion of trials. Thus, there was a chance of individuals working to receive nothing. In Experiment 1, the chimpanzees worked at a high rate, tolerating the unequal outcomes, with rank appearing to determine who got access to the higher-value locations. However, equal outcomes (used as a control) enhanced cooperative performance, most likely through motivational processes rather than the absence of inequity aversion. In Experiment 2, performance dropped off dramatically when the chimpanzees were not rewarded on every trial. Their strategy was irrational as donating effort would have led to more rewards in the long run for each individual. Our results lead to a hierarchy of performances by condition with equity > inequity > donating effort. Chimpanzees therefore tolerate mild inequity, but cannot tolerate receiving nothing when others are rewarded.     

The subjective value of delayed and probabilistic outcomes: Outcome size matters for gains but not for losses

The subjective value of a reward (gain) is related to factors such as its size, the delay to its receipt and the probability of its receipt. We examined whether the subjective value of losses was similarly affected by these factors in 128 adults. Participants chose between immediate/certain gains or losses and larger delayed/probabilistic gains or losses. Rewards of $100 were devalued as a function of their delay (“discounted”) relatively less than $10 gains while probabilistic $100 rewards were discounted relatively more than $10 rewards. However, there was no effect of outcome size on discounting of delayed or probabilistic losses. For delayed outcomes of each size, the degree to which gains were discounted was positively correlated with the degree to which losses were discounted, whereas for probabilistic outcomes, no such correlation was observed. These results suggest that the processes underlying the subjective valuation of losses are different from those underlying the subjective valuation of gains.     

A two-pollinator model for the evolution of floral complexity

For a new, more complex floral form to become established in a population it must overcome the problem of frequency-dependent constancy to successfully attract pollinators. This may be achieved by complex floral forms offering absolute greater rewards than the simpler forms, or by complex flowers offering a higher probability of being rewarding because fewer pollinators are able to visit them. In this paper we examine the effect of three pollinator foraging strategies on the ratio of flights within and between floral morphs and hence on the probability of a new morph establishing in a population without offering a greater reward. We incorporate pollinator behaviour based around observations of two pollinator species systems into three models of competition for pollinators. In the first model the constancy of the pollinator of the new floral morph is a function only of the foraging strategy of the existing pollinator of the original floral morph. In the next model the constancy of the second pollinator is determined by the number of rewarding flowers of each floral morph left by the original pollinator and in the third model it is determined by the ratio of rewarding flowers of each morph left by the original pollinator. The results demonstrate that under conditions of intense competition for pollinators, new, more complex floral forms are indeed able to attract high levels of constant pollinators without offering intrinsically higher rewards. However, for this to occur constancy in one of the pollinators must be a function of the ratio of rewarding to non-rewarding flowers of both floral forms. One prediction from our results is that sympatric speciation of floral complexity based on a higher probability of reward is more likely to occur in flowers offering rewards of pollen rather than nectar. This is because the cost of visiting non-rewarding flowers is usually higher where the reward is pollen rather than nectar. We also predict that complex flowers occurring at low frequency, which offer rewards of nectar, may need intrinsically greater rewards if they are to successfully attract pollinators.     

Reward context determines risky choice in pigeons and humans

Whereas humans are risk averse for monetary gains, other animals can be risk seeking for food rewards, especially when faced with variable delays or under significant deprivation. A key difference between these findings is that humans are often explicitly told about the risky options, whereas non-human animals must learn about them from their own experience. We tested pigeons (Columba livia) and humans in formally identical choice tasks where all outcomes were learned from experience. Both species were more risk seeking for larger rewards than for smaller ones. The data suggest that the largest and smallest rewards experienced are overweighted in risky choice. This observed bias towards extreme outcomes represents a key step towards a consilience of these two disparate literatures, identifying common features that drive risky choice across phyla.     

The value of success: acquiring gains, avoiding losses, and simply being successful

A large network of spatially contiguous, yet anatomically distinct regions in medial frontal cortex is involved in reward processing. Although it is clear these regions play a role in critical aspects of reward-related learning and decision-making, the individual contributions of each component remains unclear. We explored dissociations in reward processing throughout several key regions in the reward system and aimed to clarify the nature of previously observed outcome-related activity in a portion of anterior medial orbitofrontal cortex (mOFC). Specifically, we tested whether activity in anterior mOFC was related to processing successful actions, such that this region would respond similarly to rewards with and without tangible benefits, or whether this region instead encoded only quantifiable outcome values (e.g., money). Participants performed a task where they encountered monetary gains and losses (and non-gains and non-losses) during fMRI scanning. Critically, in addition to the outcomes with monetary consequences, the task included trials that provided outcomes without tangible benefits (participants were simply told that they were correct or incorrect). We found that anterior mOFC responded to all successful outcomes regardless of whether they carried tangible benefits (monetary gains and non-losses) or not (controls). These results support the hypothesis that anterior mOFC processes rewards in terms of a common currency and is capable of providing reward-based signals for everything we value, whether it be primary or secondary rewards or simply a successful experience without objectively quantifiable benefits.     

The neural basis of following advice

Learning by following explicit advice is fundamental for human cultural evolution, yet the neurobiology of adaptive social learning is largely unknown. Here, we used simulations to analyze the adaptive value of social learning mechanisms, computational modeling of behavioral data to describe cognitive mechanisms involved in social learning, and model-based functional magnetic resonance imaging (fMRI) to identify the neurobiological basis of following advice. One-time advice received before learning had a sustained influence on people's learning processes. This was best explained by social learning mechanisms implementing a more positive evaluation of the outcomes from recommended options. Computer simulations showed that this "outcome-bonus" accumulates more rewards than an alternative mechanism implementing higher initial reward expectation for recommended options. fMRI results revealed a neural outcome-bonus signal in the septal area and the left caudate. This neural signal coded rewards in the absence of advice, and crucially, it signaled greater positive rewards for positive and negative feedback after recommended rather than after non-recommended choices. Hence, our results indicate that following advice is intrinsically rewarding. A positive correlation between the model's outcome-bonus parameter and amygdala activity after positive feedback directly relates the computational model to brain activity. These results advance the understanding of social learning by providing a neurobiological account for adaptive learning from advice.     

The Effect of Motivation on Movement: A Study of Bradykinesia in Parkinson’s Disease

Background

Bradykinesia is a cardinal feature of Parkinson’s disease (PD). Despite its disabling impact, the precise cause of this symptom remains elusive. Recent thinking suggests that bradykinesia may be more than simply a manifestation of motor slowness, and may in part reflect a specific deficit in the operation of motivational vigour in the striatum. In this paper we test the hypothesis that movement time in PD can be modulated by the specific nature of the motivational salience of possible action-outcomes.

Methodology/Principal Findings

We developed a novel movement time paradigm involving winnable rewards and avoidable painful electrical stimuli. The faster the subjects performed an action the more likely they were to win money (in appetitive blocks) or to avoid a painful shock (in aversive blocks). We compared PD patients when OFF dopaminergic medication with controls. Our key finding is that PD patients OFF dopaminergic medication move faster to avoid aversive outcomes (painful electric shocks) than to reap rewarding outcomes (winning money) and, unlike controls, do not speed up in the current trial having failed to win money in the previous one. We also demonstrate that sensitivity to distracting stimuli is valence specific.

Conclusions/Significance

We suggest this pattern of results can be explained in terms of low dopamine levels in the Parkinsonian state leading to an insensitivity to appetitive outcomes, and thus an inability to modulate movement speed in the face of rewards. By comparison, sensitivity to aversive stimuli is relatively spared. Our findings point to a rarely described property of bradykinesia in PD, namely its selective regulation by everyday outcomes.     

Are deception-pollinated species more variable than those offering a reward?

In most pollination systems, animals transfer pollen among plants of a given species. Pollinator visitations do not come without cost, so plants usually offer a reward. However, the flowers of some plant species, mostly orchids, lack rewards and deceive animals into visiting their flowers. Deceptive species are thought to have high levels of variation in traits associated with advertisement and pollinator attraction, which have been attributed to genetic drift, or disruptive selection due to pollinator behavior. Rewarding species are assumed to have less variation due to stabilizing selection. We compared variability in floral morphology and fragrance composition between deceptive and rewarding species. Because both suites of traits are often linked with floral advertisement and pollinator attraction, we expected variation to be greater in species with deceptive pollination systems than in those offering rewards. We obtained floral morphology metrics for 20 deceptive species and 41 rewarding species native or naturalized in Puerto Rico, Venezuela, and Ecuador. Floral fragrances were sampled from eight deceptive species and four rewarding species. We found that the amplitude of variation in floral morphology and fragrance composition covaries significantly. Comparison of coefficients of variation for morphology indicated that, overall, deceptive species show significantly higher variation than rewarding species, and this pattern was also found among just orchids or just nonorchids. There were no statistical differences in morphological variation between orchids and nonorchids within a functional pollination group. Fragrance variation, measured by Jaccard distance, tended to be greater for deceptive species than for rewarding species. Although overlap in measures of variation occurs between the two groups, the data support the hypothesis that populations of deception-pollinated species are more variable than rewarding species in traits associated with pollinator attraction.     

Children’s exposure to sustainability practices during the transition from preschool into school and their learning and socioemotional development

Evidence that the learning gains of preschool fade as children transition into elementary school has led to increased efforts to sustain preschool advantages during this key transitional period. This study explores whether the observed benefits of sustainability practices for a range of child outcomes are explained and/or moderated by family and school mechanisms selecting children into experiencing these practices. Analyses of the Early Childhood Longitudinal Study-Birth Cohort revealed that both family and school factors predicted children’s exposure to several PK-3 sustainability practices. PK-3 sustainability practices were associated with reading (but not math) gains and better interpersonal skills (but not fewer externalizing behaviors) following the transition into kindergarten. These links were not conditioned by the selection mechanisms. The findings highlight who is more likely to seek out (at the family level) or offer (at the school level) sustainability practices and how relevant they are to fighting preschool fadeout.     

Carry-over effects of bumblebee associative learning in changing plant communities leads to increased costs of foraging

Flower visitors learn to avoid food-deceptive plants and to prefer rewarding ones by associating floral cues to rewards. As co-occurring plant species have different phenologies, cue-reward associations vary over time. It is not known how these variations affect flower visitors’ foraging costs and learning. We trained bumblebees of two colonies to forage in a community of deceptive and rewarding artificial inflorescences whose flower colours were either similar or dissimilar. We then modified the community composition by turning the rewarding inflorescences into unrewarding and adding rewarding inflorescences of a novel flower colour. In the short term, bees trained to similar rather than dissimilar inflorescences experienced higher costs of foraging (decreased foraging speed and accuracy) in the novel community. The colonies differed in their speed-accuracy trade-off. In the longer term, bees adapted their foraging behaviour to the novel community composition by increasingly visiting the novel rewarding inflorescences.     

The neural basis of cultural differences in delay discounting

People generally prefer to receive rewarding outcomes sooner rather than later. Such preferences result from delay discounting, or the process by which outcomes are devalued for the expected delay until their receipt. We investigated cultural differences in delay discounting by contrasting behaviour and brain activity in separate cohorts of Western (American) and Eastern (Korean) subjects. Consistent with previous reports, we find a dramatic difference in discounting behaviour, with Americans displaying much greater present bias and elevated discount rates. Recent neuroimaging findings suggest that differences in discounting may arise from differential involvement of either brain reward areas or regions in the prefrontal and parietal cortices associated with cognitive control. We find that the ventral striatum is more greatly recruited in Americans relative to Koreans when discounting future rewards, but there is no difference in prefrontal or parietal activity. This suggests that a cultural difference in emotional responsivity underlies the observed behavioural effect. We discuss the implications of this research for strategic interrelations between Easterners and Westerners.     

Always Gamble on an Empty Stomach: Hunger Is Associated with Advantageous Decision Making

Three experimental studies examined the counterintuitive hypothesis that hunger improves strategic decision making, arguing that people in a hot state are better able to make favorable decisions involving uncertain outcomes. Studies 1 and 2 demonstrated that participants with more hunger or greater appetite made more advantageous choices in the Iowa Gambling Task compared to sated participants or participants with a smaller appetite. Study 3 revealed that hungry participants were better able to appreciate future big rewards in a delay discounting task; and that, in spite of their perception of increased rewarding value of both food and monetary objects, hungry participants were not more inclined to take risks to get the object of their desire. Together, these studies for the first time provide evidence that hot states improve decision making under uncertain conditions, challenging the conventional conception of the detrimental role of impulsivity in decision making.     

Functional imaging of neural responses to expectancy and experience of monetary gains and losses

Neural responses accompanying anticipation and experience of monetary gains and losses were monitored by functional magnetic resonance imaging. Trials comprised an initial "prospect" (expectancy) phase, when a set of three monetary amounts was displayed, and a subsequent "outcome" phase, when one of these amounts was awarded. Hemodynamic responses in the sublenticular extended amygdala (SLEA) and orbital gyrus tracked the expected values of the prospects, and responses to the highest value set of outcomes increased monotonically with monetary value in the nucleus accumbens, SLEA, and hypothalamus. Responses to prospects and outcomes were generally, but not always, seen in the same regions. The overlap of the observed activations with those seen previously in response to tactile stimuli, gustatory stimuli, and euphoria-inducing drugs is consistent with a contribution of common circuitry to the processing of diverse rewards.     

Modulation by dopamine of human basal ganglia involvement in feedback control of movement

We learn new motor tasks by trial and error, repeating what works best and avoiding past mistakes. To repeat what works best we must register a satisfactory outcome, and in a study [1] we showed the existence of an evoked activity in the basal ganglia that correlates with accuracy of task performance and is associated with reiteration of successful motor parameters in subsequent movements. Here we report evidence that the signaling of positive trial outcome relies on dopaminergic input to the basal ganglia, by recording from the subthalamic nucleus (STN) in patients with nigrostriatal denervation due to Parkinson's Disease (PD) who have undergone functional neurosurgery. Correlations between subthalamic evoked activities and trial accuracy were weak and behavioral performance remained poor while patients were untreated; however, both improved after the dopamine prodrug levodopa was re-introduced. The results suggest that the midbrain dopaminergic system may be important, not only in signaling explicit positive outcomes or rewards in tasks requiring choices between options [2,3], but also in trial-to-trial learning and in reinforcing the selection of optimal parameters in more automatic motor control.     

Promising high monetary rewards for future task performance increases intermediate task performance

In everyday life contexts and work settings, monetary rewards are often contingent on future performance. Based on research showing that the anticipation of rewards causes improved task performance through enhanced task preparation, the present study tested the hypothesis that the promise of monetary rewards for future performance would not only increase future performance, but also performance on an unrewarded intermediate task. Participants performed an auditory Simon task in which they responded to two consecutive tones. While participants could earn high vs. low monetary rewards for fast responses to every second tone, their responses to the first tone were not rewarded. Moreover, we compared performance under conditions in which reward information could prompt strategic performance adjustments (i.e., when reward information was presented for a relatively long duration) to conditions preventing strategic performance adjustments (i.e., when reward information was presented very briefly). Results showed that high (vs. low) rewards sped up both rewarded and intermediate, unrewarded responses, and the effect was independent of the duration of reward presentation. Moreover, long presentation led to a speed-accuracy trade-off for both rewarded and unrewarded tones, whereas short presentation sped up responses to rewarded and unrewarded tones without this trade-off. These results suggest that high rewards for future performance boost intermediate performance due to enhanced task preparation, and they do so regardless whether people respond to rewards in a strategic or non-strategic manner.     

FLORAL COLOR CHANGE IN LUPINUS ARGENTEUS (FABACEAE): WHY SHOULD PLANTS ADVERTISE THE LOCATION OF UNREWARDING FLOWERS TO POLLINATORS?

I examined the adaptive significance of two floral traits in the perennial herb, Lupinus argenteus: 1) the retention of corollas on “spent” flowers, i.e., flowers containing inviable pollen, unreceptive stigmas, and negligible pollinator rewards and 2) a change in corolla color of retained “spent” flowers, which is restricted to a spot on the banner petal. At anthesis, this spot is yellow, and approximately four days later, it changes to purple. After the change, purple flowers remain on plants an additional 5–7 days before corolla abscission occurs; purple flowers were avoided by pollinators, presumably because they contained less pollen (rewards) than yellow ones. I experimentally tested the hypothesis that purple flowers contribute to the floral display of the plant by removing varying numbers of spent flowers and assessing the effect on pollination visitation. Pollinators preferentially approached and foraged on plants with greater numbers of flowers per inflorescence; they did not discriminate between yellow (rewarding) and purple (nonrewarding) flowers at interplant distances greater than 0.4 meters but would preferentially forage on plants with more total flowers, even if these individuals contained fewer rewarding flowers. Thus, spent flowers increased the overall attractiveness of plants to pollinators. In theory, color change may benefit plants in two ways. First, by directing pollinators to rewarding flowers, the change may increase pollinator foraging efficiency, with the result that pollinators visit more flowers before leaving plants (pollinator-tenure mechanism). Second, by directing pollinators to receptive flowers, the color change may prevent incoming pollen from being wasted on unreceptive stigmas and may prevent collection of inviable pollen (pollination-efficiency mechanism). I tested the pollinator-tenure mechanism experimentally by removing pollen from yellow flowers, thereby reducing the reliability of the color-reward signal. Pollinators visited fewer total flowers on experimental plants than on controls, resulting in reduced seed production in one year.     

Color and Shape Discrimination in the Stingless Bee Scaptotrigona mexicana Guérin (Hymenoptera, Apidae)

To increase our understanding in bee vision ecology, we investigated the color and shape discrimination performance of the stingless bee Scaptotrigona mexicana Guérin. Our main goal was to describe the choice behavior of experienced foragers over time, trying to understand to what extent color and shape stimuli (separately tested) aid them to choose the rewarding option, in the presence of distracting, unrewarding stimuli. Single foragers were trained to collect sucrose solution from a target plate. Afterwards, one distracting, unrewarding plate was placed besides the target plate and eight choices were recorded. Our results showed that both color and shape stimuli assisted efficiently the trained foragers in locating the target plate. However, foragers chose significantly more often the target plate in the color experiments than in the shape experiments. In conclusion, in our experimental setup, color was of better assistance to the foragers of S. mexicana than shape to choose their rewards. This is the first study in which it is demonstrated that the choice performance over time in a stingless bee depends upon the characteristics of the resource, such as shape and color.     

The potential for floral mimicry in rewardless orchids: an experimental study

More than one-third of orchid species do not provide their pollinators with either pollen or nectar rewards. Floral mimicry could explain the maintenance of these rewardless orchid species, but most rewardless orchids do not appear to have a rewarding plant that they mimic specifically. We tested the hypothesis that floral mimicry can occur through similarity based on corolla colour alone, using naive bumble-bees foraging on arrays of plants with one rewarding model species, and one rewardless putative mimic species (Dactylorhiza sambucina) which had two colour morphs. We found that when bees were inexperienced, they visited both rewardless morphs randomly. However, after bees had gained experience with the rewarding model, and it was removed from the experiment, bees resampled preferentially the rewardless morph most similar to it in corolla colour. This is the first clear evidence, to our knowledge, that pollinators could select for floral mimicry. We suggest that floral mimicry can be a selective force acting on rewardless orchids, but only under some ecological conditions. In particular, we argue that selection on early-flowering rewardless orchids that receive visits from a large pool of naive pollinators will be weakly influenced by mimicry.     

草乌花蜜产量的梯度分布及熊蜂自下而上的访花行为

收益降低假说(declining reward hypothesis)认为熊蜂自下而上的访花顺序是对花蜜产量的直接响应,先访问下部花蜜产量高的花可以获得更多的收益;花开口方向假说认为自下而上访花是因为熊蜂更容易看见其上部的花朵。为了验证上述两个假说,我们于2008年8月在北京小龙门国家森林公园调查了红光熊蜂(Bombus ignitus)访问草乌(Aconitum kusnezoffii)直立和倒立顶生花序的访问顺序,测量了直立花序下部雌性阶段花和上部雄性阶段花花蜜的糖浓度、体积,计算了花蜜中的糖含量。结果表明,红光熊蜂在直立花序和倒立花序内均以向上运动为主,分别占总运动次数的62.77%和68.35%;直立花序下部雌性阶段花花蜜糖浓度比上部雄性阶段花低1.44%,但是花蜜体积和花蜜中的糖含量都显著高于雄性阶段的花。由于熊蜂访问倒立花序时先访问的是下部的低回报雄性阶段的花,然后再访问上部高回报的雌性阶段的花,这与收益降低假说矛盾,表明红光熊蜂自下而上访问草乌直立花序可能不是受到花蜜产量的调节。