Lesions of the Fasciculus Retroflexus Alter Footshock-Induced cFos Expression in the Mesopontine Rostromedial Tegmental Area of Rats

Midbrain dopamine neurons are an essential part of the circuitry underlying motivation and reinforcement. They are activated by rewards or reward-predicting cues and inhibited by reward omission. The lateral habenula (lHb), an epithalamic structure that forms reciprocal connections with midbrain dopamine neurons, shows the opposite response being activated by reward omission or aversive stimuli and inhibited by reward-predicting cues. It has been hypothesized that habenular input to midbrain dopamine neurons is conveyed via a feedforward inhibitory pathway involving the GABAergic mesopontine rostromedial tegmental area. Here, we show that exposing rats to low-intensity footshock (four, 0.5 mA shocks over 20 min) induces cFos expression in the rostromedial tegmental area and that this effect is prevented by lesions of the fasciculus retroflexus, the principal output pathway of the habenula. cFos expression is also observed in the medial portion of the lateral habenula, an area that receives dense DA innervation via the fr and the paraventricular nucleus of the thalamus, a stress sensitive area that also receives dopaminergic input. High-intensity footshock (120, 0.8 mA shocks over 40 min) also elevates cFos expression in the rostromedial tegmental area, medial and lateral aspects of the lateral habenula and the paraventricular thalamus. In contrast to low-intensity footshock, increases in cFos expression within the rostromedial tegmental area are not altered by fr lesions suggesting a role for non-habenular inputs during exposure to highly aversive stimuli. These data confirm the involvement of the lateral habenula in modulating the activity of rostromedial tegmental area neurons in response to mild aversive stimuli and suggest that dopamine input may contribute to footshock- induced activation of cFos expression in the lateral habenula.     

Electrical Stimulation of Lateral Habenula during Learning: Frequency-Dependent Effects on Acquisition but Not Retrieval of a Two-Way Active Avoidance Response

The lateral habenula (LHb) is an epithalamic structure involved in signaling reward omission and aversive stimuli, and it inhibits dopaminergic neurons during motivated behavior. Less is known about LHb involvement in the acquisition and retrieval of avoidance learning. Our previous studies indicated that brief electrical stimulation of the LHb, time-locked to the avoidance of aversive footshock (presumably during the positive affective “relief” state that occurs when an aversive outcome is averted), inhibited the acquisition of avoidance learning. In the present study, we used the same paradigm to investigate different frequencies of LHb stimulation. The effect of 20 Hz vs. 50 Hz vs. 100 Hz stimulation was investigated during two phases, either during acquisition or retrieval in Mongolian gerbils. The results indicated that 50 Hz, but not 20 Hz, was sufficient to produce a long-term impairment in avoidance learning, and was somewhat more effective than 100 Hz in this regard. None of the stimulation parameters led to any effects on retrieval of avoidance learning, nor did they affect general motor activity. This suggests that, at frequencies in excess of the observed tonic firing rates of LHb neurons (>1–20 Hz), LHb stimulation may serve to interrupt the consolidation of new avoidance memories. However, these stimulation parameters are not capable of modifying avoidance memories that have already undergone extensive consolidation.     

Electrical stimulation of the primate lateral habenula suppresses saccadic eye movement through a learning mechanism

The lateral habenula (LHb) is a brain structure which represents negative motivational value. Neurons in the LHb are excited by unpleasant events such as reward omission and aversive stimuli, and transmit these signals to midbrain dopamine neurons which are involved in learning and motivation. However, it remains unclear whether these phasic changes in LHb neuronal activity actually influence animal behavior. To answer this question, we artificially activated the LHb by electrical stimulation while monkeys were performing a visually guided saccade task. In one block of trials, saccades to one fixed direction (e.g., right direction) were followed by electrical stimulation of the LHb while saccades to the other direction (e.g., left direction) were not. The direction-stimulation contingency was reversed in the next block. We found that the post-saccadic stimulation of the LHb increased the latencies of saccades in subsequent trials. Notably, the increase of the latency occurred gradually as the saccade was repeatedly followed by the stimulation, suggesting that the effect of the post-saccadic stimulation was accumulated across trials. LHb stimulation starting before saccades, on the other hand, had no effect on saccade latency. Together with previous studies showing LHb activation by reward omission and aversive stimuli, the present stimulation experiment suggests that LHb activity contributes to learning to suppress actions which lead to unpleasant events.     

Stimulation of midbrain dopaminergic structures modifies firing rates of rat lateral habenula neurons

Ventral tegmental area (VTA) and substantia nigra pars compacta (SNpc) are midbrain structures known to be involved in mediating reward in rodents. Lateral habenula (LHb) is considered as a negative reward source and it is reported that stimulation of the LHb rapidly induces inhibition of firing in midbrain dopamine neurons. Interestingly, the phasic fall in LHb neuronal activity may follow the excitation of dopamine neurons in response to reward-predicting stimuli. The VTA and SNpc give rise to dopaminergic projections that innervate the LHb, which is also known to be involved in processing painful stimuli. But it's unclear what physiological effects these inputs have on habenular function. In this study we distinguished the LHb pain-activated neurons of the Wistar rats and assessed their electrophysiological responsiveness to the stimulation of the VTA and SNpc with either single-pulse stimulation (300 μA, 0.5 Hz) or tetanic stimulation (80 μA, 25 Hz). Single-pulse stimulation that was delivered to either midbrain structure triggered transient inhibition of firing of ～90% of the LHb pain-activated neurons. However, tetanic stimulation of the VTA tended to evoke an elevation in neuronal firing rate. We conclude that LHb pain-activated neurons can receive diverse reward-related signals originating from midbrain dopaminergic structures, and thus participate in the regulation of the brain reward system via both positive and negative feedback mechanisms.     

Behavioral effects and benzodiazepine antagonist activity of Ro 15-1788 (flumazepil) in pigeons

The selective benzodiazepine receptor antagonist, Ro 15-1788, produced behavioral effects in pigeons at doses at least 100 times lower than those previously reported to possess intrinsic pharmacological activity in mammals. In contrast to its effects in mammalian species, in pigeons, Ro 15-1788 does not exhibit partial agonist activity. Key-peck responses of pigeons were studied under a multiple fixed-interval 3-min, fixed-interval 3-min schedule in which the first response after 3-min produced food in the presence of red or white keylights. In addition, every 30th response during the red keylight produced a brief electric shock (punishment). Under control conditions, punished responding was suppressed to 30% of unpunished response levels. Ro 15-1788 (0.01 mg/kg, i.m.) increased unpunished response rates by 33% without affecting rates of punished responding. Doses of 0.1 to 1.0 mg/kg Ro 15-1788 produced dose-related decreases in both punished and unpunished responding. As is characteristic of other benzodiazepines, midazolam (0.1 and 0.3 mg/kg, i.m.) markedly increased punished responding but had little effect on rates of unpunished responding. Ro 15-1788 antagonized the increases in punished responding and also reversed the rate-decreasing effects of higher doses of midazolam. However, the effectiveness of Ro 15-1788 as a benzodiazepine antagonist was limited by its intrinsic activity: rate-decreasing doses of Ro 15-1788 were unable to completely reverse behavioral effects of midazolam. Midazolam was an effective antagonist of the behavioral effects of Ro 15-1788 (up to 0.1 mg/kg) but midazolam did not influence the rate-decreasing effects of 1.0 mg/kg Ro 15-1788 across a 100-fold dose range. In the pigeon, the behavioral effects of relatively low doses of Ro 15-1788 (0.01-0.1 mg/kg) appear to be related to benzodiazepine receptor mechanisms, whereas other systems appear to be involved in the effects of higher doses.     

Lesions of the Lateral Habenula Increase Voluntary Ethanol Consumption and Operant Self-Administration,Block Yohimbine-Induced Reinstatement of Ethanol Seeking,and Attenuate Ethanol-Induced Conditioned Taste Aversion

The lateral habenula (LHb) plays an important role in learning driven by negative outcomes. Many drugs of abuse, including ethanol, have dose-dependent aversive effects that act to limit intake of the drug. However, the role of the LHb in regulating ethanol intake is unknown. In the present study, we compared voluntary ethanol consumption and self-administration, yohimbine-induced reinstatement of ethanol seeking, and ethanol-induced conditioned taste aversion in rats with sham or LHb lesions. In rats given home cage access to 20% ethanol in an intermittent access two bottle choice paradigm, lesioned animals escalated their voluntary ethanol consumption more rapidly than sham-lesioned control animals and maintained higher stable rates of voluntary ethanol intake. Similarly, lesioned animals exhibited higher rates of responding for ethanol in operant self-administration sessions. In addition, LHb lesion blocked yohimbine-induced reinstatement of ethanol seeking after extinction. Finally, LHb lesion significantly attenuated an ethanol-induced conditioned taste aversion. Our results demonstrate an important role for the LHb in multiple facets of ethanol-directed behavior, and further suggest that the LHb may contribute to ethanol-directed behaviors by mediating learning driven by the aversive effects of the drug.     

Anxiolytic-like effect of neuropeptide Y (NPY), but not other peptides in an operant conflict test.

The peptide messengers neuropeptide Y (NPY), growth hormone-releasing hormone (GHRH), atrial natriuretic peptide (ANP) and beta-endorphin (BEND) were tested in an animal model of anxiety, the Geller-Seifter conflict test. Rats were subjected to a multiple schedule consisting of three components: in the first component, lever-pressing produced food-reward ('unpunished responding'). The second component was a time-out period, during which lever-pressing had no consequences. During the third component, lever-pressing produced food-reward, but was also punished by an incremental foot-shock ('punished responding'). After establishing a stable baseline of both unpunished and punished responding, animals were injected with various doses of NPY, GHRH, ANP, BEND, or with saline into the lateral cerebral ventricle, and testing was repeated. While changes in unpunished responding can reflect alterations in performance factors or motivational strength, increases in punished responding have previously been shown to be highly specific for anxiety-reducing drugs, such as the benzodiazepines. NPY markedly and dose-dependently increased punished responding. A smaller increase of unpunished responding was also seen. These results add further support to the hypothesis that NPY may be an endogenous anxiolytic. GHRH, ANP and END did not affect punished responding.     

Levels of arginine-vasopressin in cerebrospinal fluid during passive avoidance behavior in rats

The concentration of immunoreactive arginine-vasopressin (IR-AVP) was measured in the cerebrospinal fluid (CSF) during acquisition and retention of passive avoidance behavior. IR-AVP level in CSF of male Wistar rats immediately after the learning trial was increased; the rate of which was related to the intensity of the electric footshock during the learning trial and the avoidance latency as measured 1 day after the learning trial. Immediately after the 24 h retention test IR-AVP levels were significantly increased in rats subjected to the low (0.25 mA) shock intensity during the learning trial, but IR-AVP levels of rats exposed to the high shock (1.0 mA) were under the limit of detection. If the retention test was postponed till 5 days after the learning trial, the increase of IR-AVP level in the CSF was related to avoidance latencies which reflect the intensity of aversive stimulation (electric footshock). The results suggest an association between central AVP release and passive avoidance behavior and may be indicative of the role of this peptide in neuronal mechanisms underlying learning and memory processes.     

Input to the lateral habenula from the basal ganglia is excitatory, aversive, and suppressed by serotonin

The lateral habenula (LHb) has recently been identified as a key regulator of the reward system by driving inhibition onto dopaminergic neurons. However, the nature and potential modulation of the major input to the LHb originating from the basal ganglia are poorly understood. Although the output of the basal ganglia is thought to be primarily inhibitory, here we show that transmission from the basal ganglia to the LHb is excitatory, glutamatergic, and suppressed by serotonin. Behaviorally, activation of this pathway is aversive, consistent with its role as an "antireward" signal. Our demonstration of an excitatory projection from the basal ganglia to the LHb explains how LHb-projecting basal ganglia neurons can have similar encoding properties as LHb neurons themselves. Our results also provide a link between antireward excitatory synapses and serotonin,?a neuromodulator implicated in depression.     

The economics of altruistic punishment and the maintenance of cooperation

Explaining the evolution and maintenance of cooperation among unrelated individuals is one of the fundamental problems in biology and the social sciences. Recent findings suggest that altruistic punishment is an important mechanism maintaining cooperation among humans. We experimentally explore the boundaries of altruistic punishment to maintain cooperation by varying both the cost and the impact of punishment, using an exceptionally extensive subject pool. Our results show that cooperation is only maintained if conditions for altruistic punishment are relatively favourable: low cost for the punisher and high impact on the punished. Our results indicate that punishment is strongly governed by its cost-to-impact ratio and that its effect on cooperation can be pinned down to one single variable: the threshold level of free-riding that goes unpunished. Additionally, actual pay-offs are the lowest when altruistic punishment maintains cooperation, because the pay-off destroyed through punishment exceeds the gains from increased cooperation. Our results are consistent with the interpretation that punishment decisions come from an amalgam of emotional response and cognitive cost-impact analysis and suggest that altruistic punishment alone can hardly maintain cooperation under multi-level natural selection. Uncovering the workings of altruistic punishment as has been done here is important because it helps predicting under which conditions altruistic punishment is expected to maintain cooperation.     

Developmental characteristics of AMPA receptors in chick lumbar motoneurons

Ca2+ fluxes through ionotropic glutamate receptors regulate a variety of developmental processes, including neurite outgrowth and naturally occurring cell death. In the CNS, NMDA receptors were originally thought to be the sole source of Ca2+ influx through glutamate receptors; however, AMPA receptors also allow a significant influx of Ca2+ ions. The Ca2+ permeability of AMPA receptors is regulated by the insertion of one or more edited GluR2 subunits. In this study, we tested the possibility that changes in GluR2 expression regulate the Ca2+ permeability of AMPA receptors during a critical period of neuronal development in chick lumbar motoneurons. GluR2 expression is absent between embryonic day (E) 5 and E7, but increases significantly by E8 in the chick ventral spinal cord. Increased GluR2 protein expression is correlated with parallel changes in GluR2 mRNA in the motoneuron pool. Electrophysiological recordings of kainate-evoked currents indicate a significant reduction in the Ca2(+)-permeability of AMPA receptors between E6 and E11. Kainate-evoked currents were sensitive to the AMPA receptor blocker GYKI 52466. Application of AMPA or kainate generates a significant increase in the intracellular Ca2+ concentration in E6 spinal motoneurons, but generates a small response in older neurons. Changes in the Ca(2+)-permeability of AMPA receptors are not mediated by age-dependent changes in the editing pattern of GluR2 subunits. These findings raise the possibility that Ca2+ influx through Ca(2+)-permeable AMPA receptors plays an important role during early embryonic development in chick spinal motoneurons.     

Dopamine and octopamine influence avoidance learning of honey bees in a place preference assay

Biogenic amines are widely characterized in pathways evaluating reward and punishment, resulting in appropriate aversive or appetitive responses of vertebrates and invertebrates. We utilized the honey bee model and a newly developed spatial avoidance conditioning assay to probe effects of biogenic amines octopamine (OA) and dopamine (DA) on avoidance learning. In this new protocol non-harnessed bees associate a spatial color cue with mild electric shock punishment. After a number of experiences with color and shock the bees no longer enter the compartment associated with punishment. Intrinsic aspects of avoidance conditioning are associated with natural behavior of bees such as punishment (lack of food, explosive pollination mechanisms, danger of predation, heat, etc.) and their association to floral traits or other spatial cues during foraging. The results show that DA reduces the punishment received whereas octopamine OA increases the punishment received. These effects are dose-dependent and specific to the acquisition phase of training. The effects during acquisition are specific as shown in experiments using the antagonists Pimozide and Mianserin for DA and OA receptors, respectively. This study demonstrates the integrative role of biogenic amines in aversive learning in the honey bee as modeled in a novel non-appetitive avoidance learning assay.     

beta-Carboline-3-carboxylate-t-butyl ester: a selective BZ1 benzodiazepine receptor antagonist

The effectiveness of beta-carboline-3-carboxylate-t-butyl ester (beta CCtB) in antagonizing the anticonvulsant, ataxic and antipunishment effects of diazepam were evaluated. In mice, beta CCtB at doses of 3 and 10 mg/kg produced a dose-related antagonism of the anticonvulsant effects of diazepam against pentylenetetrazole (80 mg/kg). A dose of 30 mg/kg of beta CCtB did not produce a further shift in the diazepam dose-effect curve, apparently because beta CCtB failed to block the muscle-relaxant effects of diazepam. Further, beta CCtB (30 mg/kg) failed to antagonize the ataxic effects of diazepam in an inverted screen test. Rats responded under a multiple schedule where in one component every twentieth response (FR20) resulted in water presentation (unpunished component) and in another component every twentieth response (FR20) resulted in both shock and water presentation (punished component). Diazepam p.o. (0.1 to 10 mg/kg) first increased and then decreased rates in the punished component but only decreased rates in the unpunished component. beta CCtB had no effect on response rates when administered alone, but antagonized the rate-increasing effects of diazepam in the punished component. beta CCtB did not alter the rate-decreasing effects of diazepam in either component. Thus, beta CCtB selectively antagonized the effects of diazepam on punished behavior as well as the anticonvulsant effects of diazepam, but beta CCtB failed to antagonize the rate-decreasing and ataxic effects of diazepam. These results are consistent with the interpretation that beta CCtB is a selective BZ1 benzodiazepine receptor antagonist.     

Effects of prenatal stress on lever-press acquisition with delayed reinforcement in male and female rats

The prenatally stressed (PS) rat shows enhanced conditioned fear and increased behavioral inhibition in response to footshock compared to control (CON) rats. It is unclear whether this facilitated learning will occur only with aversive stimulation, or if it will also be observed in the context of positive reinforcement. There are limited and inconsistent data regarding sex differences and the impact of prenatal stress on learning. The present study was designed to examine lever-press acquisition with a 10-s delay to food reinforcement in male and female PS and CON rats. Overall, twice as many PS male rats acquired the lever-press response than the PS female rats, CON male rats, and CON female rats. PS male rats also earned significantly more reinforcers and responded on the operative lever at a significantly greater rate than the other three rat groups. These findings suggest that PS rats exhibit altered learning with a task involving positive reinforcement, and this effect of PS is sex specific for male rats.     

腹侧被盖区多巴胺能神经元对奖赏/厌恶刺激反应的异质性

中脑多巴胺奖赏系统,由腹侧被盖区及其投射靶区组成,参与药物依赖、精神疾病等病理过程的调控.奖赏和厌恶刺激是衡量上述病理过程的重要手段.一直以来,不同研究在该系统对奖赏和厌恶刺激的反应上存在分歧,越来越多的研究倾向于认为该系统,特别是腹侧被盖区多巴胺能神经元存在较大的异质性.本文从腹侧被盖区多巴胺能神经元判定标准、解剖定位和投射特异性等角度对其在奖赏和厌恶刺激中的功能异质性进行综述,并对未来研究方向进行展望.     

Alcohol reverses the proconflict effect of corticotropin-releasing factor

Alcohol has tension reducing properties in man that are reflected in a release of punished responding in a rat operant conflict test. In contrast, corticotropin releasing factor (CRF), injected centrally produces a suppression of punished and non-punished responding in the conflict test consistent with its hypothesized role in mediating behavioral responses to stress. Alcohol in a dose of 0.75 g/kg reversed the suppressive effects of 0.5 microgram CRF injected intracerebroventricularly on punished responding but augmented the suppression of unpunished responding by CRF. Results suggest that one mechanism for the tension reducing properties of acute alcohol intoxication may involve a suppression of brain CRF systems.     

SERT and uncertainty: serotonin transporter expression influences information processing biases for ambiguous aversive cues in mice

The long allele variant of the serotonin transporter (SERT, 5‐HTT) gene‐linked polymorphic region (5‐HTTLPR) is associated with higher levels of 5‐HTT expression and reduced risk of developing affective disorders. However, little is known about the mechanisms underlying this protective effect. One hypothesis is that 5‐HTT expression influences aversive information processing, with reduced negative cognitive bias present in those with higher 5‐HTT expression. Here we investigated this hypothesis using genetically‐modified mice and a novel aversive learning paradigm. Mice with high levels of 5‐HTT expression (5‐HTT over‐expressing, 5‐HTTOE mice) and wild‐type mice were trained to discriminate between three distinct auditory cues: one cue predicted footshock on all trials (CS+); a second cue predicted the absence of footshock (CS?); and a third cue predicted footshock on 20% of trials (CS20%), and was therefore ambiguous. Wild‐type mice exhibited equivalently high levels of fear to the CS+ and CS20% and minimal fear to the CS?. In contrast, 5‐HTTOE mice exhibited high levels of fear to the CS+ but minimal fear to the CS? and the CS20%. This selective reduction in fear to ambiguous aversive cues suggests that increased 5‐HTT expression reduces negative cognitive bias for stimuli with uncertain outcomes.     

GABA neurons of the VTA drive conditioned place aversion

Salient but aversive stimuli inhibit the majority of dopamine (DA) neurons in the ventral tegmental area (VTA) and cause conditioned place aversion (CPA). The cellular mechanism underlying DA neuron inhibition has not been investigated and the causal link to behavior remains elusive. Here, we show that GABA neurons of the VTA inhibit DA neurons through neurotransmission at GABA(A) receptors. We also observe that GABA neurons increase their firing in response to a footshock and provide evidence that driving GABA neurons with optogenetic effectors is sufficient to affect behavior. Taken together, our data demonstrate that synaptic inhibition of DA neurons drives place aversion.     

Selective effect on punished versus unpunished responding in a conflict test as the criterion for anxiogenic activity

The punished drinking test has been used successfully for identifying and studying anxiolytic agents. By reducing the level of punishment (i.e., decreasing the intensity of shock), it has also been used as a method for measuring anxiogenic activity. Because anxiogenic behavior is a novel and important concept that is not yet fully established, we have reinvestigated the effects of two putative inverse benzodiazepine agonists and pentylenetetrazol in this conflict test. In a series of experiments, using both our version of the procedure and a replication of a previously published method, we were unable to demonstrate a selective reduction in punished responding over unpunished responding caused by CGS 8216 (3 to 40 mg/kg), FG 7142 (2 to 6 mg/kg), and pentylenetetrazol (10 to 20 mg/kg) as reported previously. A careful comparison of the details of our method and the published procedure failed to reveal the source of this discrepancy. If anxiogenic behavior is to be defined as a selective effect of a drug on punished response, the value of this test will depend on identification of its critical variables.