Complementary roles of basal ganglia and cerebellum in learning and motor control

The classical notion that the basal ganglia and the cerebellum are dedicated to motor control has been challenged by the accumulation of evidence revealing their involvement in non-motor, cognitive functions. From a computational viewpoint, it has been suggested that the cerebellum, the basal ganglia, and the cerebral cortex are specialized for different types of learning: namely, supervised learning, reinforcement learning and unsupervised learning, respectively. This idea of learning-oriented specialization is helpful in understanding the complementary roles of the basal ganglia and the cerebellum in motor control and cognitive functions.     

Dopaminergic innervation of the amygdala is highly responsive to stress

The amygdala has been implicated in the neuronal sequelae of stress, although little is known about the neurochemical mechanisms underlying amygdala transmission. In vivo microdialysis was employed to measure extracellular levels of dopamine in the basolateral nucleus of the amygdala in awake rats. Once it was established that impulse-dependent release of dopamine could be measured reliably in the amygdala, the effect of stress, induced by mild handling, on amygdala dopamine release was compared with that in three other dopamine-innervated regions, the medial prefrontal cortex, nucleus accumbens, and caudate nucleus. The magnitude of increase in dopamine in response to the handling stimulus was significantly greater in the amygdala than in the nucleus accumbens and prefrontal cortex. This increase was maximal during the application of stress and diminished after the cessation of stress. In contrast, the increases in extracellular dopamine levels in other regions, in particular the nucleus accumbens, were prolonged, reaching maximal values after the cessation of stress. These results suggest that dopaminergic innervation of the amygdala may be more responsive to stress than that of other dopamine-innervated regions of the limbic system, including the prefrontal cortex, and implicate amygdalar dopamine in normal and pathophysiological processes subserving an organism's response to stress.     

Tactile learning and the individual evaluation of the reward in honey bees (Apis mellifera L.)

Using the proboscis extension response we conditioned pollen and nectar foragers of the honey bee (Apis mellifera L.) to tactile patterns under laboratory conditions. Pollen foragers demonstrated better acquisition, extinction, and reversal learning than nectar foragers. We tested whether the known differences in response thresholds to sucrose between pollen and nectar foragers could explain the observed differences in learning and found that nectar foragers with low response thresholds performed better during acquisition and extinction than ones with higher thresholds. Conditioning pollen and nectar foragers with similar response thresholds did not yield differences in their learning performance. These results suggest that differences in the learning performance of pollen and nectar foragers are a consequence of differences in their perception of sucrose. Furthermore, we analysed the effect which the perception of sucrose reward has on associative learning. Nectar foragers with uniform low response thresholds were conditioned using varying concentrations of sucrose. We found significant positive correlations between the concentrations of the sucrose rewards and the performance during acquisition and extinction. The results are summarised in a model which describes the relationships between learning performance, response threshold to sucrose, concentration of sucrose and the number of rewards. Accepted: 14 April 1999     

Extended paced mating tests induces conditioned place preference without affecting sexual arousal

One way to evaluate sexual arousal is by measuring approach behavior to sexual incentive stimuli. In our case we measure approach behavior to an originally non-preferred compartment which is associated with the physiological state induced by mating. This change of preference indicative of a positive affective (reward) state can be evaluated by conditioned place preference (CPP). We have shown that the CPP induced by paced mating is mediated by opioids. The administration of opioids also induces a reward state. The present study was designed to compare the rewarding properties of paced mating and a morphine injection. One group of females was allowed to pace the sexual interaction before being placed in the non-preferred compartment. In alternate sessions they received a morphine injection before being placed in the preferred compartment. In another group of females, the treatments were reversed. Only the females placed in the originally non-preferred compartment after paced mating changed their original preference, suggesting that paced mating induces a positive affective, reward, state of higher intensity than a morphine injection of 1 mg/kg. In a second experiment we determined if females allowed to pace the sexual interaction for 1 h would still developed CPP. No change in preference was observed in the females that mated for 1 h without pacing the sexual interaction. On the other hand, females that received between 10 and 15 paced intromissions as well as females that paced the sexual interaction for 1 h developed a clear CPP. The second experiment demonstrated that pacing is rewarding even in an extended mating session in which the females received around 25 intromissions and several ejaculations. These results further demonstrate the biological relevance associated with the ability of the female to space coital stimulation received during mating. This positive affective state will contribute to increase sexual arousal the next time a rat finds an appropriate mate.     

The effects of reward quality on risk-sensitivity in Rattus norvegicus

Risk-sensitive foraging theory (RSFT) was developed to explain a choice between a variable (risk-prone) or constant (risk-averse) option. In the RSFT literature, qualitative shifts in risk-sensitivity have been explained by fluctuations in daily caloric energy budget (DEB). The DEB rule describes foragers’ choices as being based on fitness and rate of gain. If the DEB rule is correct, rewards that differ in caloric returns should cause differences in foragers’ sensitivity to risk. However, few studies have explored the influence of reward quality on risk-sensitivity in mammals. The present study was designed to examine the effects of reward quality on risk-sensitivity when reward magnitude, delay to reward, body mass, and response effort were controlled. Results from the current study demonstrated that subjects rewarded with a high calorie reward (i.e., sugar) made significantly fewer choices for a variable option than subjects rewarded with a lower calorie reward (i.e., grain). These results are consistent with the predictions of the DEB rule, and add to the RSFT literature where reward quality was manipulated by describing difference in risk-sensitivity in mammals. Suggestions for future research include an examination of risk-sensitivity where flavor and caloric return are manipulated.     

Can flower constancy in nectaring butterflies be explained by Darwin’s interference hypothesis?

 When foraging for nectar many insects exhibit flower constancy (a preference for flower species which they have previously visited) and frequently ignore rewarding flowers of other species. Darwin proposed the favoured explanation for this behaviour, hypothesizing that learning of handling skills for one flower species interferes with the ability to recall handling skills for previously learned species. A crucial element of this hypothesis is that savings in handling time resulting from constancy must exceed increases in travelling time necessitated by ignoring other suitable species. A convincing quantification of this trade-off has not been achieved and tests to date on bumblebees indicate that savings in handling time are too small to offset an increase in travelling time. To assess further the validity of Darwin’s hypothesis, handling and flight times of the butterfly, Thymelicus flavus, were measured under natural conditions, and the abundance and reward provided by the available flower species quantified to enable estimation of foraging efficiency. Butterflies exhibited a mean increase in handling time of 0.85 s per flower associated with switching between flower species, although the magnitude of this difference varied greatly among flower species. Switching was not associated with a decrease in travelling time, contrary to expectation. Switching was more frequent following a lower than average reward from the last flower visited. In butterflies, flights serve functions other than movement between nectar sources, such as mate location (unlike worker bees). Hence constancy may be a viable strategy to reduce time spent in handling flowers and increase time available for other activities. Although savings in handling time may be small, Darwin’s interference hypothesis remains a valid explanation for flower constancy in foraging butterflies. Received: 27 January 1997 / Accepted: 5 June 1997     

Aggressive behavior and change in salivary testosterone concentrations predict willingness to engage in a competitive task

The current study investigated relationships among aggressive behavior, change in salivary testosterone concentrations, and willingness to engage in a competitive task. Thirty-eight male participants provided saliva samples before and after performing the Point Subtraction Aggression Paradigm (a laboratory measure that provides opportunity for aggressive and defensive behavior while working for reward; all three involve pressing specific response keys). Baseline testosterone concentrations were not associated with aggressive responding. However, aggressive responding (but not point reward or point protection responding) predicted the pre- to post-PSAP change in testosterone: Those with the highest aggressive responding had the largest percent increase in testosterone concentrations. Together, aggressive responding and change in testosterone predicted willingness to compete following the PSAP. Controlling for aggression, men who showed a rise in testosterone were more likely to choose to compete again (p = 0.03) and controlling for testosterone change, men who showed the highest level of aggressive responding were more likely to choose the non-competitive task (p = 0.02). These results indicate that situation-specific aggressive behavior and testosterone responsiveness are functionally relevant predictors of future social behavior.     

Endogenous opiates: 1999

This paper is the twenty-second installment of the annual review of research concerning the opiate system. It summarizes papers published during 1999 that studied the behavioral effects of the opiate peptides and antagonists, excluding the purely analgesic effects, although stress-induced analgesia is included. The specific topics covered this year include stress; tolerance and dependence; learning, memory, and reward; eating and drinking; alcohol and other drugs of abuse; sexual activity, pregnancy, and development; mental illness and mood; seizures and other neurologic disorders; electrical-related activity; general activity and locomotion; gastrointestinal, renal, and hepatic function; cardiovascular responses; respiration and thermoregulation; and immunologic responses.     

The medial prefrontal cortex as a part of the brain reward system

Summary. This review will briefly summarize experimental evidence for an involvement of the medial prefrontal cortex (mPFC) in reward-related mechanisms in the rat brain. The mPFC is part of the mesocorticolimbic dopaminergic system. It receives prominent dopaminergic input from the ventral tegmental area (VTA) and, via the mediodorsal thalamus, inputs from other subcortical basal ganglia structures. In turn it projects back to the VTA and the nucleus accumbens septi (NAS), which are generally considered as main components of the brain reward system. Evidence for the involvement of the mPFC in reward-related mechanisms comes mainly from three types of studies, conditioned place preference (CPP), intracranial self-stimulation (ICSS), and self-administration. Work will be summarized that has shown that certain drugs injected into the mPFC can produce CPP or that lesions of the mPFC can disrupt the development of CPP, that ICSS is obtained with the stimulating electrode placed in the mPFC, and that certain drugs are self-administered into the mPFC or that lesions of the mPFC disrupt the peripheral self-administration of certain drugs. However, it has also been shown that the role of the mPFC in reward is not uniform. For example, the mPFC appears to be particularly important for the rewarding actions of cocaine, while it appears not to be important for the rewarding actions of amphetamine. Also, different subareas of the mPFC appear to be differentially involved in the rewarding actions of different drugs. Taken together, the available evidence shows that some drugs can produce reward directly within the mPFC, and that some drugs, even though not having direct rewarding effects within the mPFC, depend on the function of the mPFC for the mediation of their rewarding effects. Received August 31, 1999 Accepted September 20, 1999     

Functional aspects of the ventral pallidum

Summary. The ventral pallidum is part of the corticoaccumbo-thalamocortical loop of the basal ganglia. In the past the function of this structure was discussed as a pure relay station in the process of limbic-motor integration. Some recent studies, however, underline that on the level of the ventral pallidum motor behavior can be modulated. The stimulation and inhibition of the different transmitter systems that converge in the ventral pallidum (dopamine, glutamate, GABA, neuropeptides) have implications in repetitive-, disinhibited-, learning- and reinforced behavior. The present review summarizes available data of these parameter related to this behavior, i.e. locomotion, reward-related behavior, prepulse inhibition, memory and neurochemistry. Received August 31, 1999 Accepted September 20, 1999