Getting formal with dopamine and reward

Recent neurophysiological studies reveal that neurons in certain brain structures carry specific signals about past and future rewards. Dopamine neurons display a short-latency, phasic reward signal indicating the difference between actual and predicted rewards. The signal is useful for enhancing neuronal processing and learning behavioral reactions. It is distinctly different from dopamine's tonic enabling of numerous behavioral processes. Neurons in the striatum, frontal cortex, and amygdala also process reward information but provide more differentiated information for identifying and anticipating rewards and organizing goal-directed behavior. The different reward signals have complementary functions, and the optimal use of rewards in voluntary behavior would benefit from interactions between the signals. Addictive psychostimulant drugs may exert their action by amplifying the dopamine reward signal.     

Timing in reward and decision processes

Sensitivity to time, including the time of reward, guides the behaviour of all organisms. Recent research suggests that all major reward structures of the brain process the time of reward occurrence, including midbrain dopamine neurons, striatum, frontal cortex and amygdala. Neuronal reward responses in dopamine neurons, striatum and frontal cortex show temporal discounting of reward value. The prediction error signal of dopamine neurons includes the predicted time of rewards. Neurons in the striatum, frontal cortex and amygdala show responses to reward delivery and activities anticipating rewards that are sensitive to the predicted time of reward and the instantaneous reward probability. Together these data suggest that internal timing processes have several well characterized effects on neuronal reward processing.     

Drug-driven AMPA receptor redistribution mimicked by selective dopamine neuron stimulation

Background

Addictive drugs have in common that they cause surges in dopamine (DA) concentration in the mesolimbic reward system and elicit synaptic plasticity in DA neurons of the ventral tegmental area (VTA). Cocaine for example drives insertion of GluA2-lacking AMPA receptors (AMPARs) at glutamatergic synapes in DA neurons. However it remains elusive which molecular target of cocaine drives such AMPAR redistribution and whether other addictive drugs (morphine and nicotine) cause similar changes through their effects on the mesolimbic DA system.

Methodology / Principal Findings

We used in vitro electrophysiological techniques in wild-type and transgenic mice to observe the modulation of excitatory inputs onto DA neurons by addictive drugs. To observe AMPAR redistribution, post-embedding immunohistochemistry for GluA2 AMPAR subunit was combined with electron microscopy. We also used a double-floxed AAV virus expressing channelrhodopsin together with a DAT Cre mouse line to selectively express ChR2 in VTA DA neurons. We find that in mice where the effect of cocaine on the dopamine transporter (DAT) is specifically blocked, AMPAR redistribution was absent following administration of the drug. Furthermore, addictive drugs known to increase dopamine levels cause a similar AMPAR redistribution. Finally, activating DA VTA neurons optogenetically is sufficient to drive insertion of GluA2-lacking AMPARs, mimicking the changes observed after a single injection of morphine, nicotine or cocaine.

Conclusions / Significance

We propose the mesolimbic dopamine system as a point of convergence at which addictive drugs can alter neural circuits. We also show that direct activation of DA neurons is sufficient to drive AMPAR redistribution, which may be a mechanism associated with early steps of non-substance related addictions.     

The Glucagon-Like Peptide 1 Analogue,Exendin-4, Attenuates the Rewarding Properties of Psychostimulant Drugs in Mice

Glucagon-like peptide 1 (GLP-1) is an incretine hormone that controls consummatory behavior and glucose homeostasis. It is released in response to nutrient ingestion from the intestine and production in the brain has also been identified. Given that GLP-1 receptors are expressed in reward areas, such as the nucleus accumbens and ventral tegmental area, and that common mechanisms regulate food and drug-induced reward we hypothesize that GLP-1 receptors are involved in reward regulation. Herein the effect of the GLP-1 receptor agonist Exendin-4 (Ex4), on amphetamine- and cocaine-induced activation of the mesolimbic dopamine system was investigated in mice. In a series of experiments we show that treatment with Ex4, at a dose with no effect per se, reduce amphetamine- as well as cocaine-induced locomotor stimulation, accumbal dopamine release as well as conditioned place preference in mice. Collectively these data propose a role for GLP-1 receptors in regulating drug reward. Moreover, the GLP-1 signaling system may be involved in the development of drug dependence since the rewarding effects of addictive drugs involves interferences with the mesolimbic dopamine system. Given that GLP-1 analogues, such as exenatide and liraglutide, are clinically available for treatment of type II diabetes, we propose that these should be elucidated as treatments of drug dependence.     

Drug-evoked synaptic plasticity in addiction: from molecular changes to circuit remodeling

Addictive drugs have in common that they target the mesocorticolimbic dopamine (DA) system. This system originates in the ventral tegmental area (VTA) and projects mainly to the nucleus accumbens (NAc) and prefrontal cortex (PFC). Here, we review the effects that such drugs leave on glutamatergic and GABAergic synaptic transmission in these three brain areas. We refer to these changes as drug-evoked synaptic plasticity, which outlasts the presence of the drug in the brain and contributes to the reorganization of neural circuits. While in most cases these early changes are not sufficient to induce the disease, with repetitive drug exposure, they may add up and contribute to addictive behavior.     

Addiction: Decreased reward sensitivity and increased expectation sensitivity conspire to overwhelm the brain's control circuit

Based on brain imaging findings, we present a model according to which addiction emerges as an imbalance in the information processing and integration among various brain circuits and functions. The dysfunctions reflect (a) decreased sensitivity of reward circuits, (b) enhanced sensitivity of memory circuits to conditioned expectations to drugs and drug cues, stress reactivity, and (c) negative mood, and a weakened control circuit. Although initial experimentation with a drug of abuse is largely a voluntary behavior, continued drug use can eventually impair neuronal circuits in the brain that are involved in free will, turning drug use into an automatic compulsive behavior. The ability of addictive drugs to co‐opt neurotransmitter signals between neurons (including dopamine, glutamate, and GABA) modifies the function of different neuronal circuits, which begin to falter at different stages of an addiction trajectory. Upon exposure to the drug, drug cues or stress this results in unrestrained hyperactivation of the motivation/drive circuit that results in the compulsive drug intake that characterizes addiction.     

Common cellular and molecular mechanisms in obesity and drug addiction

The hedonic properties of food can stimulate feeding behaviour even when energy requirements have been met, contributing to weight gain and obesity. Similarly, the hedonic effects of drugs of abuse can motivate their excessive intake, culminating in addiction. Common brain substrates regulate the hedonic properties of palatable food and addictive drugs, and recent reports suggest that excessive consumption of food or drugs of abuse induces similar neuroadaptive responses in brain reward circuitries. Here, we review evidence suggesting that obesity and drug addiction may share common molecular, cellular and systems-level mechanisms.     

Coordinated accumbal dopamine release and neural activity drive goal-directed behavior

Intracranial self-stimulation (ICSS) activates the neural pathways that mediate reward, including dopaminergic terminal areas such as the nucleus accumbens (NAc). However, a direct role of dopamine in ICSS-mediated reward has been questioned. Here, simultaneous voltammetric and electrophysiological recordings from the same electrode reveal that, at certain sites, the onset of anticipatory dopamine surges and changes in neuronal firing patterns during ICSS are coincident, whereas sites lacking dopamine changes also lack patterned firing. Intrashell microinfusion of a D1, but not a D2 receptor antagonist, blocks ICSS. An iontophoresis approach was implemented to explore the effect of dopamine antagonists on firing patterns without altering behavior. Similar to the microinfusion experiments, ICSS-related firing is selectively attenuated following D1 receptor blockade. This work establishes a temporal link between anticipatory rises of dopamine and firing patterns in the NAc shell during ICSS and suggests that they may play a similar role with natural rewards and during drug self-administration.     

The Impact of Selective Dopamine D2, D3 and D4 Ligands on the Rat Gambling Task

Gambling is an addictive disorder with serious societal and personal costs. To-date, there are no approved pharmacological treatments for gambling disorder. Evidence suggests a role for dopamine in gambling disorder and thus may provide a therapeutic target. The present study therefore aimed to investigate the effects of selective antagonists and agonists of D2, D3 and D4 receptors in a rodent analogue of the Iowa gambling task used clinically. In this rat gambling task (rGT), animals are trained to associate different response holes with different magnitudes and probabilities of food pellet rewards and punishing time-out periods. As in the Iowa gambling task, the optimal strategy is to avoid the tempting high-risk high-reward options, and instead favor those linked to smaller per-trial rewards but also lower punishments, thereby maximizing the amount of reward earned over time. Administration of those selective ligands did not affect decision making under the rGT. Only the D4 drug had modest effects on latency measures suggesting that D4 may contribute in some ways to decision making under this task.     

Dissociation of food and opiate preference by a genetic mutation in zebrafish

Both natural rewards and addictive substances have the ability to reinforce behaviors. It has been unclear whether identical neural pathways mediate the actions of both. In addition, little is known about these behaviors and the underlying neural mechanisms in a genetically tractable vertebrate, the zebrafish Danio rerio. Using a conditioned place preference paradigm, we demonstrate that wildtype zebrafish exhibit a robust preference for food as well as the opiate drug morphine that can be blocked by the opioid receptor antagonist naloxone. Moreover, we show that the too few mutant, which disrupts a conserved zinc finger-containing gene and exhibits a reduction of selective groups of dopaminergic and serotonergic neurons in the basal diencephalon, displays normal food preference but shows no preference for morphine. Pretreatment with dopamine receptor antagonists abolishes morphine preference in the wildtype. These studies demonstrate that zebrafish display measurable preference behavior for reward and show that the preference for natural reward and addictive drug is dissociable by a single-gene mutation that alters subregions of brain monoamine neurotransmitter systems. Future genetic analysis in zebrafish shall uncover further molecular and cellular mechanisms underlying the formation and function of neural circuitry that regulate opiate and food preference behavior.     

New perspectives on cocaine addiction: recent findings from animal research

Research with laboratory animals has provided several insights into the nature of cocaine abuse and addiction. First, the nature of drug addiction has been reevaluated and the emphasis has shifted from physical dependence to compulsive drug-taking behavior. Second, animal studies suggest that cocaine is at least as addictive as heroin and possibly even more addictive. Third, cocaine is potentially more dangerous than heroin as evidenced by the higher fatality rate seen in laboratory animals given unlimited access to these drugs. Fourth, the neural basis of cocaine reinforcement has been identified and involves an enhancement of dopaminergic neurotransmission in the ventral tegmental dopamine system. Other addictive drugs (e.g., opiates) may also derive at least part of their reinforcing impact by pharmacologically activating this reward system. Fifth, although the biological consequences of repeated cocaine self-administration on central nervous system functioning are poorly understood, preliminary findings suggest that intravenous cocaine self-administration may decrease neural functioning in this brain reward system. This has important clinical implications because diminished functioning of an important brain reward system may significantly contribute to relapse into cocaine addiction. These and other findings from experimentation with laboratory animals suggest new considerations for the etiology and treatment of drug addiction.     

食欲素信号系统在成瘾中的作用

成瘾是对成瘾物质的强迫性、持续性需求并缺乏控制能力的行为,它会导致大脑中枢奖赏回路的改变。下丘脑是调控自然奖赏的重要脑区,它能特异性地表达一种被称为食欲素(orexins/hypocretins)的神经肽。食欲素通过作用于食欲素受体调控睡眠、觉醒状态,同时,食欲素受体在药物成瘾和奖赏相关的行为中也有重要作用,投射到不同脑区的食欲素对不同药物导致的成瘾调节作用也不同,调控食欲素信号系统,将可能成为治疗成瘾的重要方法。本文重点总结了食欲素信号系统在不同药物成瘾过程中的作用的最新研究进展。     

Heterogeneity of Reward Mechanisms

The finding that many drugs that have abuse potential and other natural stimuli such as food or sexual activity cause similar chemical changes in the brain, an increase in extracellular dopamine (DA) in the shell of the nucleus accumbens (NAccS), indicated some time ago that the reward mechanism is at least very similar for all stimuli and that the mechanism is relatively simple. The presently available information shows that the mechanisms involved are more complex and have multiple elements. Multiple brain regions, multiple receptors, multiple distinct neurons, multiple transmitters, multiple transporters, circuits, peptides, proteins, metabolism of transmitters, and phosphorylation, all participate in reward mechanisms. The system is variable, is changed during development, is sex-dependent, and is influenced by genetic differences. Not all of the elements participate in the reward of all stimuli. Different set of mechanisms are involved in the reward of different drugs of abuse, yet different mechanisms in the reward of natural stimuli such as food or sexual activity; thus there are different systems that distinguish different stimuli. Separate functions of the reward system such as anticipation, evaluation, consummation and identification; all contain function-specific elements. The level of the stimulus also influences the participation of the elements of the reward system, there are possible reactions to even below threshold stimuli, and excessive stimuli can change reward to aversion involving parts of the system. Learning and memory of past reward is an important integral element of reward and addictive behavior. Many of the reward elements are altered by repeated or chronic stimuli, and chronic exposure to one drug is likely to alter the response to another stimulus. To evaluate and identify the reward stimulus thus requires heterogeneity of the reward components in the brain.     

Ventromedial prefrontal cortex activation is associated with memory formation for predictable rewards

During reinforcement learning, dopamine release shifts from the moment of reward consumption to the time point when the reward can be predicted. Previous studies provide consistent evidence that reward-predicting cues enhance long-term memory (LTM) formation of these items via dopaminergic projections to the ventral striatum. However, it is less clear whether memory for items that do not precede a reward but are directly associated with reward consumption is also facilitated. Here, we investigated this question in an fMRI paradigm in which LTM for reward-predicting and neutral cues was compared to LTM for items presented during consumption of reliably predictable as compared to less predictable rewards. We observed activation of the ventral striatum and enhanced memory formation during reward anticipation. During processing of less predictable as compared to reliably predictable rewards, the ventral striatum was activated as well, but items associated with less predictable outcomes were remembered worse than items associated with reliably predictable outcomes. Processing of reliably predictable rewards activated the ventromedial prefrontal cortex (vmPFC), and vmPFC BOLD responses were associated with successful memory formation of these items. Taken together, these findings show that consumption of reliably predictable rewards facilitates LTM formation and is associated with activation of the vmPFC.     

Dopamine modulates acute responses to cocaine, nicotine and ethanol in Drosophila

BACKGROUND: Drugs of abuse have a common property in mammals, which is their ability to facilitate the release of the neurotransmitter and neuromodulator dopamine in specific brain regions involved in reward and motivation. This increase in synaptic dopamine levels is believed to act as a positive reinforcer and to mediate some of the acute responses to drugs. The mechanisms by which dopamine regulates acute drug responses and addiction remain unknown. RESULTS: We present evidence that dopamine plays a role in the responses of Drosophila to cocaine, nicotine or ethanol. We used a startle-induced negative geotaxis assay and a locomotor tracking system to measure the effect of psychostimulants on fly behavior. Using these assays, we show that acute responses to cocaine and nicotine are blunted by pharmacologically induced reductions in dopamine levels. Cocaine and nicotine showed a high degree of synergy in their effects, which is consistent with an action through convergent pathways. In addition, we found that dopamine is involved in the acute locomotor-activating effect, but not the sedating effect, of ethanol. CONCLUSIONS: We show that in Drosophila, as in mammals, dopaminergic pathways play a role in modulating specific behavioral responses to cocaine, nicotine or ethanol. We therefore suggest that Drosophila can be used as a genetically tractable model system in which to study the mechanisms underlying behavioral responses to multiple drugs of abuse.     

Dopamine receptors in the learning,memory and drug reward circuitry

As primary targets of a variety of abused drugs G-protein-coupled dopamine receptors in the brain play an important role in mediating the various drug-induced alterations in neural and psychological processes thought to underlie the transition from voluntary drug use to habitual and progressively compulsive drug-taking. This review considers the functional involvement of the five major dopamine receptor subtypes in drug reinforcement and reward and discusses the development of addiction as a series of learning transitions from initial goal-directed behaviour to pathological stimulus–response habits in which drug-seeking behaviours are automatically elicited and maintained by cues and stimuli associated with drug rewards.     

Multiple reward signals in the brain

The fundamental biological importance of rewards has created an increasing interest in the neuronal processing of reward information. The suggestion that the mechanisms underlying drug addiction might involve natural reward systems has also stimulated interest. This article focuses on recent neurophysiological studies in primates that have revealed that neurons in a limited number of brain structures carry specific signals about past and future rewards. This research provides the first step towards an understanding of how rewards influence behaviour before they are received and how the brain might use reward information to control learning and goal-directed behaviour.     

Integrating synaptic plasticity and striatal circuit function in addiction

Exposure to addictive drugs causes changes in synaptic function within the striatal complex, which can either mimic or interfere with the induction of synaptic plasticity. These synaptic adaptations include changes in the nucleus accumbens (NAc), a ventral striatal subregion important for drug reward and reinforcement, as well as the dorsal striatum, which may promote habitual drug use. As the behavioral effects of drugs of abuse are long-lasting, identifying persistent changes in striatal circuits induced by in vivo drug experience is of considerable importance. Within the striatum, drugs of abuse have been shown to induce modifications in dendritic morphology, ionotropic glutamate receptors (iGluR) and the induction of synaptic plasticity. Understanding the detailed molecular mechanisms underlying these changes in striatal circuit function will provide insight into how drugs of abuse usurp normal learning mechanisms to produce pathological behavior.     

Chronic morphine treatment decreases acoustic startle response and prepulse inhibition in rats

The reward-related effects of addictive drugs primarily act via the dopamine system, which also plays an important role in sensorimotor gating. The mesolimbic dopamine system is the common pathway of drug addiction and sensorimotor gating. However, the way in which addictive drugs affect sensorimotor gating is currently unclear. In previous studies, we examined the effects of morphine treatment on sensory gating in the hippocampus. The present study investigated the effects of morphine on sensorimotor gating in rats during chronic morphine treatment and withdrawal. Rats were examined during treatment with morphine for 10 successive days, followed by a withdrawal period. Acoustic startle responses to a single startle stimulus (115 dB SPL) and prepulse inhibition responses were recorded. The results showed that acoustic startle responses were attenuated during morphine treatment, but not during withdrawal. PPI was impaired in the last 2 morphine treatment days, but returned to a normal level during withdrawal.     

网络游戏成瘾的奖赏加工缺陷及其神经机制

奖赏加工异常是网络游戏成瘾（internet gaming disorder，IGD）核心特征之一，近期研究结合认知神经科学技术对IGD的神经机制进行探讨发现，IGD与药物成瘾存在相似的神经基础，但仍然存在较多争议。本文从奖赏类型、奖赏加工阶段梳理了IGD人群奖赏加工的研究进展。IGD人群在游戏相关线索下，奖赏预期（reward anticipation）阶段的奖赏系统激活可能与注意偏向、情绪体验和渴求感增加有关。同时，IGD人群对自然奖赏表现出较为一致的低敏感性，该特征主要出现在结果评估（outcome evaluation）阶段。未来研究可以排除共病因素、结合生动的游戏奖赏刺激，进一步探究奖赏预期和结果评估异常如何推动IGD的发展。