Stimulation of midbrain dopaminergic structures modifies firing rates of rat lateral habenula neurons

Ventral tegmental area (VTA) and substantia nigra pars compacta (SNpc) are midbrain structures known to be involved in mediating reward in rodents. Lateral habenula (LHb) is considered as a negative reward source and it is reported that stimulation of the LHb rapidly induces inhibition of firing in midbrain dopamine neurons. Interestingly, the phasic fall in LHb neuronal activity may follow the excitation of dopamine neurons in response to reward-predicting stimuli. The VTA and SNpc give rise to dopaminergic projections that innervate the LHb, which is also known to be involved in processing painful stimuli. But it's unclear what physiological effects these inputs have on habenular function. In this study we distinguished the LHb pain-activated neurons of the Wistar rats and assessed their electrophysiological responsiveness to the stimulation of the VTA and SNpc with either single-pulse stimulation (300 μA, 0.5 Hz) or tetanic stimulation (80 μA, 25 Hz). Single-pulse stimulation that was delivered to either midbrain structure triggered transient inhibition of firing of ～90% of the LHb pain-activated neurons. However, tetanic stimulation of the VTA tended to evoke an elevation in neuronal firing rate. We conclude that LHb pain-activated neurons can receive diverse reward-related signals originating from midbrain dopaminergic structures, and thus participate in the regulation of the brain reward system via both positive and negative feedback mechanisms.     

Sources contributing to the average extracellular concentration of dopamine in the nucleus accumbens

Mesolimbic dopamine neurons fire in both tonic and phasic modes resulting in detectable extracellular levels of dopamine in the nucleus accumbens (NAc). In the past, different techniques have targeted dopamine levels in the NAc to establish a basal concentration. In this study, we used in vivo fast scan cyclic voltammetry (FSCV) in the NAc of awake, freely moving rats. The experiments were primarily designed to capture changes in dopamine caused by phasic firing - that is, the measurement of dopamine 'transients'. These FSCV measurements revealed for the first time that spontaneous dopamine transients constitute a major component of extracellular dopamine levels in the NAc. A series of experiments were designed to probe regulation of extracellular dopamine. Lidocaine was infused into the ventral tegmental area, the site of dopamine cell bodies, to arrest neuronal firing. While there was virtually no instantaneous change in dopamine concentration, longer sampling revealed a decrease in dopamine transients and a time-averaged decrease in the extracellular level. Dopamine transporter inhibition using intravenous GBR12909 injections increased extracellular dopamine levels changing both frequency and size of dopamine transients in the NAc. To further unmask the mechanics governing extracellular dopamine levels we used intravenous injection of the vesicular monoamine transporter (VMAT2) inhibitor, tetrabenazine, to deplete dopamine storage and increase cytoplasmic dopamine in the nerve terminals. Tetrabenazine almost abolished phasic dopamine release but increased extracellular dopamine to ～500?nM, presumably by inducing reverse transport by dopamine transporter (DAT). Taken together, data presented here show that average extracellular dopamine in the NAc is low (20-30?nM) and largely arises from phasic dopamine transients.     

Real-time decoding of dopamine concentration changes in the caudate-putamen during tonic and phasic firing

The fundamental process that underlies volume transmission in the brain is the extracellular diffusion of neurotransmitters from release sites to distal target cells. Dopaminergic neurons display a range of activity states, from low-frequency tonic firing to bursts of high-frequency action potentials (phasic firing). However, it is not clear how this activity affects volume transmission on a subsecond time scale. To evaluate this, we developed a finite-difference model that predicts the lifetime and diffusion of dopamine in brain tissue. We first used this model to decode in vivo amperometric measurements of electrically evoked dopamine, and obtained rate constants for release and uptake as well as the extent of diffusion. Accurate predictions were made under a variety of conditions including different regions, different stimulation parameters and with uptake inhibited. Second, we used the decoded rate constants to predict how heterogeneity of dopamine release and uptake sites would affect dopamine concentration fluctuations during different activity states in the absence of an electrode. These simulations show that synchronous phasic firing can produce spatially and temporally heterogeneous concentration profiles whereas asynchronous tonic firing elicits uniform, steady-state dopamine concentrations.     

Homeostatic regulation mechanism of spontaneous firing determines glutamate responsiveness in the midbrain dopamine neurons

Autonomous tonic firing of the midbrain dopamine neuron is essential for maintenance of ambient dopamine level in the brain, in which intracellular Ca²⁺ concentration ([Ca²⁺]c) plays a complex but pivotal role. However, little is known about Ca²⁺ signals by which dopamine neurons maintain an optimum spontaneous firing rate. In the midbrain dopamine neurons, we here show that spontaneous firing evoked [Ca²⁺]c changes in a phasic manner in the dendritic region but a tonic manner in the soma. Tonic levels of somatic [Ca²⁺]c strictly tallied with spontaneous firing rates. However, manipulatory raising or lowering of [Ca²⁺]c with caged compounds from the resting firing state proportionally suppressed or raised spontaneous firing rate, respectively, suggesting presence of the homeostatic regulation mechanism for spontaneous firing rate via tonic [Ca²⁺]c changes of the soma. More importantly, abolition of this homeostatic regulation mechanism significantly exaggerated the responses of tonic firings and high-frequency phasic discharges to glutamate. Therefore, we conclude that this Ca²⁺-dependent homeostatic regulation mechanism is responsible for not only maintaining optimum rate of spontaneous firing, but also proper responses to glutamate. Perturbation of this mechanism could cause dopamine neurons to be more vulnerable to glutamate and Ca²⁺ toxicities.     

The short-latency dopamine signal: a role in discovering novel actions?

An influential concept in contemporary computational neuroscience is the reward prediction error hypothesis of phasic dopaminergic function. It maintains that midbrain dopaminergic neurons signal the occurrence of unpredicted reward, which is used in appetitive learning to reinforce existing actions that most often lead to reward. However, the availability of limited afferent sensory processing and the precise timing of dopaminergic signals suggest that they might instead have a central role in identifying which aspects of context and behavioural output are crucial in causing unpredicted events.     

Elimination of the vesicular acetylcholine transporter in the striatum reveals regulation of behaviour by cholinergic-glutamatergic co-transmission

Cholinergic neurons in the striatum are thought to play major regulatory functions in motor behaviour and reward. These neurons express two vesicular transporters that can load either acetylcholine or glutamate into synaptic vesicles. Consequently cholinergic neurons can release both neurotransmitters, making it difficult to discern their individual contributions for the regulation of striatal functions. Here we have dissected the specific roles of acetylcholine release for striatal-dependent behaviour in mice by selective elimination of the vesicular acetylcholine transporter (VAChT) from striatal cholinergic neurons. Analysis of several behavioural parameters indicates that elimination of VAChT had only marginal consequences in striatum-related tasks and did not affect spontaneous locomotion, cocaine-induced hyperactivity, or its reward properties. However, dopaminergic sensitivity of medium spiny neurons (MSN) and the behavioural outputs in response to direct dopaminergic agonists were enhanced, likely due to increased expression/function of dopamine receptors in the striatum. These observations indicate that previous functions attributed to striatal cholinergic neurons in spontaneous locomotor activity and in the rewarding responses to cocaine are mediated by glutamate and not by acetylcholine release. Our experiments demonstrate how one population of neurons can use two distinct neurotransmitters to differentially regulate a given circuitry. The data also raise the possibility of using VAChT as a target to boost dopaminergic function and decrease high striatal cholinergic activity, common neurochemical alterations in individuals affected with Parkinson's disease.     

Dopaminergic Control of the Globus Pallidus through Activation of D2 Receptors and Its Impact on the Electrical Activity of Subthalamic Nucleus and Substantia Nigra Reticulata Neurons

The globus pallidus (GP) receives dopaminergic afferents from the pars compacta of substantia nigra and several studies suggested that dopamine exerts its action in the GP through presynaptic D2 receptors (D2Rs). However, the impact of dopamine in GP on the pallido-subthalamic and pallido-nigral neurotransmission is not known. Here, we investigated the role of dopamine, through activation of D2Rs, in the modulation of GP neuronal activity and its impact on the electrical activity of subthalamic nucleus (STN) and substantia nigra reticulata (SNr) neurons. Extracellular recordings combined with local intracerebral microinjection of drugs were done in male Sprague-Dawley rats under urethane anesthesia. We showed that dopamine, when injected locally, increased the firing rate of the majority of neurons in the GP. This increase of the firing rate was mimicked by quinpirole, a D2R agonist, and prevented by sulpiride, a D2R antagonist. In parallel, the injection of dopamine, as well as quinpirole, in the GP reduced the firing rate of majority of STN and SNr neurons. However, neither dopamine nor quinpirole changed the tonic discharge pattern of GP, STN and SNr neurons. Our results are the first to demonstrate that dopamine through activation of D2Rs located in the GP plays an important role in the modulation of GP-STN and GP-SNr neurotransmission and consequently controls STN and SNr neuronal firing. Moreover, we provide evidence that dopamine modulate the firing rate but not the pattern of GP neurons, which in turn control the firing rate, but not the pattern of STN and SNr neurons.     

Getting formal with dopamine and reward

Recent neurophysiological studies reveal that neurons in certain brain structures carry specific signals about past and future rewards. Dopamine neurons display a short-latency, phasic reward signal indicating the difference between actual and predicted rewards. The signal is useful for enhancing neuronal processing and learning behavioral reactions. It is distinctly different from dopamine's tonic enabling of numerous behavioral processes. Neurons in the striatum, frontal cortex, and amygdala also process reward information but provide more differentiated information for identifying and anticipating rewards and organizing goal-directed behavior. The different reward signals have complementary functions, and the optimal use of rewards in voluntary behavior would benefit from interactions between the signals. Addictive psychostimulant drugs may exert their action by amplifying the dopamine reward signal.     

Dopamine scales performance in the absence of new learning

Learning and motivation are integral in shaping an organism's adaptive behavior. The dopamine system has been implicated in both processes; however, dissociating the two, both experimentally and conceptually, has posed significant challenges. We have developed an animal model that dissociates expression or scaling of a learned behavior from learning itself. An inducible dopamine transporter (DAT) knockdown mouse line has been generated, which exhibits significantly slower reuptake of released dopamine and increased tonic firing of dopamine neurons without altering phasic burst firing. Mice were trained in experimental tasks prior to inducing a hyperdopaminergic tone and then retested. Elevated dopamine enhanced performance in goal-directed operant responses. These data demonstrate that alterations in dopaminergic tone can scale the performance of a previously learned behavior in the absence of new learning.     

Bidirectional Modulation of Substantia Nigra Activity by Motivational State

A major output nucleus of the basal ganglia is the substantia nigra pars reticulata, which sends GABAergic projections to brainstem and thalamic nuclei. The GABAergic (GABA) neurons are reciprocally connected with nearby dopaminergic neurons, which project mainly to the basal ganglia, a set of subcortical nuclei critical for goal-directed behaviors. Here we examined the impact of motivational states on the activity of GABA neurons in the substantia nigra pars reticulata and the neighboring dopaminergic (DA) neurons in the pars compacta. Both types of neurons show short-latency bursts to a cue predicting a food reward. As mice became sated by repeated consumption of food pellets, one class of neurons reduced cue-elicited firing, whereas another class of neurons progressively increased firing. Extinction or pre-feeding just before the test session dramatically reduced the phasic responses and their motivational modulation. These results suggest that signals related to the current motivational state bidirectionally modulate behavior and the magnitude of phasic response of both DA and GABA neurons in the substantia nigra.     

Methamphetamine neurotoxicity decreases phasic, but not tonic, dopaminergic signaling in the rat striatum

Neurotoxic doses of methamphetamine (METH) are known to cause depletions in striatal dopamine (DA) tissue content. However, the effects of METH-induced insults on dopaminergic neurotransmission are not fully understood. Here, we employed fast-scan cyclic voltammetry at a carbon-fiber microelectrode in the anesthetized rat striatum to assess the effects of a neurotoxic regimen of METH on phasic and tonic modes of dopaminergic signaling and underlying mechanisms of DA release and uptake. Extracellular DA was electrically evoked by stimulation of the medial forebrain bundle mimicking tonic and phasic firing patterns for dopaminergic cells and was monitored simultaneously in both the dorsomedial and dorsolateral striatum. Kinetic analysis of evoked recordings determined parameters describing DA release and uptake. Striatal DA tissue content was quantified by high performance liquid chromatography with electrochemical detection. METH-pretreatment (four doses of 7.5 or 10.0 mg/kg s.c.) induced DA depletions of ～ 40% on average, which are reported in both striatal subregions. METH pre-treatment significantly decreased the amplitude of signals evoked by phasic, but not tonic, stimulation. Parameters for DA release and uptake were also similarly reduced by ～ 40%, consistent with effects on evoked phasic-like responses and DA tissue content. Taken together, these results suggest that METH-pretreatment selectively diminishes phasic, but not tonic, dopaminergic signaling in the dorsal striatum.     

Medullary circuits for nociceptive modulation

Neurons in the medullary raphe are critical to opioid analgesia through descending projections to the dorsal horn. Work in anesthetized rats led to the postulate that nociceptive suppression results from tonic activation of nociceptive-inhibiting neurons and tonic inhibition of nociceptive-facilitating neurons. However, morphine does not cause tonic changes in raphe neuronal firing in unanesthetized rodents. Recent work suggests that a drop in activity of nociceptive-inhibiting neurons synchronizes nociceptive circuits and a burst of activity in nociceptive-facilitating neurons facilitates withdrawal magnitude. After morphine, the phasic responses of raphe cells are suppressed along with nociceptive withdrawals. The results suggest a new model of brainstem modulation of nociception in which the medullary raphe facilitates nociceptive reactions when noxious input occurs and may modulate other functions between injurious events.     

An imperfect dopaminergic error signal can drive temporal-difference learning

An open problem in the field of computational neuroscience is how to link synaptic plasticity to system-level learning. A promising framework in this context is temporal-difference (TD) learning. Experimental evidence that supports the hypothesis that the mammalian brain performs temporal-difference learning includes the resemblance of the phasic activity of the midbrain dopaminergic neurons to the TD error and the discovery that cortico-striatal synaptic plasticity is modulated by dopamine. However, as the phasic dopaminergic signal does not reproduce all the properties of the theoretical TD error, it is unclear whether it is capable of driving behavior adaptation in complex tasks. Here, we present a spiking temporal-difference learning model based on the actor-critic architecture. The model dynamically generates a dopaminergic signal with realistic firing rates and exploits this signal to modulate the plasticity of synapses as a third factor. The predictions of our proposed plasticity dynamics are in good agreement with experimental results with respect to dopamine, pre- and post-synaptic activity. An analytical mapping from the parameters of our proposed plasticity dynamics to those of the classical discrete-time TD algorithm reveals that the biological constraints of the dopaminergic signal entail a modified TD algorithm with self-adapting learning parameters and an adapting offset. We show that the neuronal network is able to learn a task with sparse positive rewards as fast as the corresponding classical discrete-time TD algorithm. However, the performance of the neuronal network is impaired with respect to the traditional algorithm on a task with both positive and negative rewards and breaks down entirely on a task with purely negative rewards. Our model demonstrates that the asymmetry of a realistic dopaminergic signal enables TD learning when learning is driven by positive rewards but not when driven by negative rewards.     

Intracellular Methamphetamine Prevents the Dopamine-induced Enhancement of Neuronal Firing

The dysregulation of the dopaminergic system is implicated in multiple neurological and neuropsychiatric disorders such as Parkinson disease and drug addiction. The primary target of psychostimulants such as amphetamine and methamphetamine is the dopamine transporter (DAT), the major regulator of extracellular dopamine levels in the brain. However, the behavioral and neurophysiological correlates of methamphetamine and amphetamine administration are unique from one another, thereby suggesting these two compounds impact dopaminergic neurotransmission differentially. We further examined the unique mechanisms by which amphetamine and methamphetamine regulate DAT function and dopamine neurotransmission; in the present study we examined the impact of extracellular and intracellular amphetamine and methamphetamine on the spontaneous firing of cultured midbrain dopaminergic neurons and isolated DAT-mediated current. In dopaminergic neurons the spontaneous firing rate was enhanced by extracellular application of amphetamine > dopamine > methamphetamine and was DAT-dependent. Amphetamine > methamphetamine similarly enhanced DAT-mediated inward current, which was sensitive to isosmotic substitution of Na⁺ or Cl⁻ ion. Although isosmotic substitution of extracellular Na⁺ ions blocked amphetamine and methamphetamine-induced DAT-mediated inward current similarly, the removal of extracellular Cl⁻ ions preferentially blocked amphetamine-induced inward current. The intracellular application of methamphetamine, but not amphetamine, prevented the dopamine-induced increase in the spontaneous firing of dopaminergic neurons and the corresponding DAT-mediated inward current. The results reveal a new mechanism for methamphetamine-induced dysregulation of dopaminergic neurons.     

Dopamine in motivational control: rewarding, aversive, and alerting

Midbrain dopamine neurons are well known for their strong responses to rewards and their critical role in?positive motivation. It has become increasingly clear, however, that dopamine neurons also transmit signals related to salient but nonrewarding experiences such as aversive and alerting events. Here we review recent advances in understanding the reward and nonreward functions of dopamine. Based on this data, we propose that dopamine neurons come in multiple types that are connected with distinct brain networks and have distinct roles in motivational control. Some dopamine neurons encode motivational value, supporting brain networks for seeking, evaluation, and value learning. Others encode motivational salience, supporting brain networks for orienting, cognition, and general motivation. Both types of dopamine neurons are augmented by an alerting signal involved in rapid detection of potentially important sensory cues. We hypothesize that these dopaminergic pathways for value, salience, and alerting cooperate to support adaptive behavior.     

L-谷氨酸和卡巴胆碱对中脑腹侧被盖区多巴胺能神经元簇放电的影响

中脑腹侧被盖区(ventral tegmental area,VTA)多巴胺能神经元的簇放电会导致其突触末梢多巴胺释放量瞬时大量增加,已被公认是编码奖赏效应的功能相关信号,但诱发多巴胺能神经元产生簇放电的神经调节的具体机制尚不完全清楚。为深入理解诱发VTA多巴胺能神经元产生簇放电介导奖赏信号的递质机制和不同脑区间的协同作用,本实验利用大鼠离体脑片,研究了胆碱能受体激动剂卡巴胆碱单独灌流,兴奋性谷氨酸能受体激动剂L-谷氨酸单独脉冲式给药及二者同时作用时VTA多巴胺能神经元簇放电的产生。结果显示,在离体脑片,卡巴胆碱(10μmol/L)持续灌流或L-谷氨酸(3mmol/L)脉冲式给药均能够诱发多巴胺能神经元产生簇放电。在二者单独作用不能诱发簇放电的神经元,卡巴胆碱和谷氨酸联合用药则可以诱发出簇放电。这些结果提示,卡巴胆碱和L-谷氨酸在诱发多巴胺能神经元簇放电的过程中具有协同作用。     

Coordinated accumbal dopamine release and neural activity drive goal-directed behavior

Intracranial self-stimulation (ICSS) activates the neural pathways that mediate reward, including dopaminergic terminal areas such as the nucleus accumbens (NAc). However, a direct role of dopamine in ICSS-mediated reward has been questioned. Here, simultaneous voltammetric and electrophysiological recordings from the same electrode reveal that, at certain sites, the onset of anticipatory dopamine surges and changes in neuronal firing patterns during ICSS are coincident, whereas sites lacking dopamine changes also lack patterned firing. Intrashell microinfusion of a D1, but not a D2 receptor antagonist, blocks ICSS. An iontophoresis approach was implemented to explore the effect of dopamine antagonists on firing patterns without altering behavior. Similar to the microinfusion experiments, ICSS-related firing is selectively attenuated following D1 receptor blockade. This work establishes a temporal link between anticipatory rises of dopamine and firing patterns in the NAc shell during ICSS and suggests that they may play a similar role with natural rewards and during drug self-administration.     

Axiomatic methods, dopamine and reward prediction error

The phasic firing rate of midbrain dopamine neurons has been shown to respond both to the receipt of rewarding stimuli, and the degree to which such stimuli are anticipated by the recipient. This has led to the hypothesis that these neurons encode reward prediction error (RPE)-the difference between how rewarding an event is, and how rewarding it was expected to be. However, the RPE model is one of a number of competing explanations for dopamine activity that have proved hard to disentangle, mainly because they are couched in terms of latent, or unobservable, variables. This article describes techniques for dealing with latent variables common in economics and decision theory, and reviews work that uses these techniques to provide simple, non-parametric tests of the RPE hypothesis, allowing clear differentiation between competing explanations.     

Differential organization of excitatory and inhibitory synapses within the rat dorsal vagal complex

The dorsal motor nucleus of the vagus (DMV) is pivotal in the regulation of upper gastrointestinal functions, including motility and both gastric and pancreatic secretion. DMV neurons receive robust GABA- and glutamatergic inputs. Microinjection of the GABA(A) antagonist bicuculline (BIC) into the DMV increases pancreatic secretion and gastric motility, whereas the glutamatergic antagonist kynurenic acid (KYN) is ineffective unless preceded by microinjection of BIC. We used whole cell patch-clamp recordings with the aim of unveiling the brain stem neurocircuitry that uses tonic GABA- and glutamatergic synapses to control the activity of DMV neurons in a brain stem slice preparation. Perfusion with BIC altered the firing frequency of 71% of DMV neurons, increasing firing frequency in 80% of the responsive neurons and decreasing firing frequency in 20%. Addition of KYN to the perfusate either decreased (52%) or increased (25%) the firing frequency of BIC-sensitive neurons. When KYN was applied first, the firing rate was decreased in 43% and increased in 21% of the neurons; further perfusion with BIC had no additional effect in the majority of neurons. Our results indicate that there are several permutations in the arrangements of GABA- and glutamatergic inputs controlling the activity of DMV neurons. Our data support the concept of brain stem neuronal circuitry that may be wired in a finely tuned organ- or function-specific manner that permits precise and discrete modulation of the vagal motor output to the gastrointestinal tract.     

Processing of behaviorally relevant temporal parameters of acoustic stimuli by single neurons in the superior olivary nucleus of the leopard frog

Summary Response characteristics of 130 single neurons in the superior olivary nucleus of the northern leopard frog (Rana pipiens pipiens) were examined to determine their selectivity to various behaviorally relevant temporal parameters [rise-fall time, duration, and amplitude modulation (AM) rate of acoustic signals. Response functions were constructed with respect to each of these variables. Neurons with different temporal firing patterns such as tonic, phasic or phasic-burst firing patterns, participated in time domain analysis in specific manners. Phasic neurons manifested preferences for signals with short rise-fall times, thus possessing low-pass response functions with respect to this stimulus parameter; conversely, tonic and phasic-burst units were non-selective and possessed all-pass response functions. A distinction between temporal firing patterns was also observed for duration coding. Whereas phasic units showed no change in the mean spike count with a change in stimulus duration (i.e., all-pass duration response functions), tonic and phasic-burst units gave higher mean spike counts with an increase in stimulus duration (i.e., primary-like high-pass response functions). Phasic units manifested greater response selectivity for AM rate than did tonic or phasic-burst units, and many phasic units were tuned to a narrow range of modulation rates (i.e., band-pass). The results suggest that SON neurons play an important role in the processing of complex acoustic patterns; they perform extensive computations on AM rate as well as other temporal parameters of complex sounds. Moreover, the response selectivities for rise-fall time, duration, and AM rate could often be shown to contribute to the differential responses to complex synthetic and natural sounds.Abbreviations SON superior olivary nucleus - DMN dorsal medullary nucleus - TS torus semicircularis - FTC frequency threshold curve - BF best excitatory frequency - PAM pulsatile amplitude modulation - SAM sinusoidal amplitude modulation - SQAM square-wave amplitude modulation - MTF modulation transfer function - PSTH peri-stimulus time histogram