Explicit neural signals reflecting reward uncertainty

The acknowledged importance of uncertainty in economic decision making has stimulated the search for neural signals that could influence learning and inform decision mechanisms. Current views distinguish two forms of uncertainty, namely risk and ambiguity, depending on whether the probability distributions of outcomes are known or unknown. Behavioural neurophysiological studies on dopamine neurons revealed a risk signal, which covaried with the standard deviation or variance of the magnitude of juice rewards and occurred separately from reward value coding. Human imaging studies identified similarly distinct risk signals for monetary rewards in the striatum and orbitofrontal cortex (OFC), thus fulfilling a requirement for the mean variance approach of economic decision theory. The orbitofrontal risk signal covaried with individual risk attitudes, possibly explaining individual differences in risk perception and risky decision making. Ambiguous gambles with incomplete probabilistic information induced stronger brain signals than risky gambles in OFC and amygdala, suggesting that the brain's reward system signals the partial lack of information. The brain can use the uncertainty signals to assess the uncertainty of rewards, influence learning, modulate the value of uncertain rewards and make appropriate behavioural choices between only partly known options.     

Neuroethology of reward and decision making

Ethology, the evolutionary science of behaviour, assumes that natural selection shapes behaviour and its neural substrates in humans and other animals. In this view, the nervous system of any animal comprises a suite of morphological and behavioural adaptations for solving specific information processing problems posed by the physical or social environment. Since the allocation of behaviour often reflects economic optimization of evolutionary fitness subject to physical and cognitive constraints, neurobiological studies of reward, punishment, motivation and decision making will profit from an appreciation of the information processing problems confronted by animals in their natural physical and social environments.     

Release of [3H]Dopamine from Striatal and Cerebral Cortical Slices from Rats with Thioacetamide-Induced Hepatic Encephalopathy: Different Responses to Stimulation by Potassium Ions and Agonists of Ionotropic Glutamate Receptors

The effects of depolarizing stimuli; high (50 mM) potassium ions and the glutamate receptor agonists N-methyl-D-aspartate, kainate and 2-amino-3-hydroxy-5-methyl-4-isoxazolepropionate (AMPA) on the release of newly-loaded [³H]dopamine were studied in frontal cortical and striatal slices from control rats and from rats with acute hepatic encephalopathy induced with a hepatotoxin, thioacetamide. Hepatic encephalopathy enhanced the stimulatory effect of potassium ions by 20% in striatal slices and by 34% in frontal cortical slices. In striatal slices the stimulatory effects of N-methyl-D-aspartate and kainate were depressed in hepatic encephalopathy by 46% and 21%, respectively, which may be taken to reflect impaired modulation of striatal dopamine release by glutamate acting at N-methyl-D-aspartate or kainate receptors. In frontal cortical slices, the stimulatory effect of kainate was enhanced by 35% in hepatic encephalopathy but N-methyl-D-aspartate-stimulated release was not affected. The release evoked by 2-amino-3-hydroxy-5-methyl-4-isoxazolepropionate was not affected in hepatic encephalopathy in either brain region. Stimulation of dopamine release in the frontal cortex by depolarization or glutamate acting at kainate receptors could inhibit the activity of descending corticostriatal glutamatergic pathways, further impairing regulation of dopamine release by glutamate in the stratum.     

Stimulated D(1) dopamine receptors couple to multiple Galpha proteins in different brain regions

Previous studies have revealed that activation of rat striatal D(1) dopamine receptors stimulates both adenylyl cyclase and phospholipase C via G(s) and G(q), respectively. The differential distribution of these systems in brain supports the existence of distinct receptor systems. The present communication extends the study by examining other brain regions: hippocampus, amygdala, and frontal cortex. In membrane preparations of these brain regions, selective stimulation of D(1) dopamine receptors increases the hydrolysis of phosphatidylinositol/phosphatidylinositol 4,5-biphosphate. In these brain regions, D(1) dopamine receptors couple differentially to multiple Galpha protein subunits. Antisera against Galpha(q) blocks dopamine-stimulated PIP(2) hydrolysis in hippocampal and in striatal membranes. The binding of [(35)S]GTPgammaS or [alpha-(32)P]GTP to Galpha(i) was enhanced in all brain regions. Dopamine also increased the binding of [(35)S]GTPgammaS or [alpha-(32)P]GTP to Galpha(q) in these brain regions: hippocampus = amygdala > frontal cortex. However, dopamine-stimulated binding of [(35)S]GTPgammaS to Galphas only in the frontal cortex and striatum. This differential coupling profile in the brain regions was not related to a differential regional distribution of the Galpha proteins. Dopamine induced increases in GTPgammaS binding to Galpha(s) and Galpha(q) was blocked by the D(1) antagonist SCH23390 but not by D(2) receptor antagonist l-sulpiride, suggesting that D(1) dopamine receptors couple to both Galpha(s) and Galpha(q) proteins. Co-immunoprecipitation of Galpha proteins with receptor-binding sites indicate that in the frontal cortex, D(1) dopamine-binding sites are associated with both Galpha(s) and Galpha(q) and, in hippocampus or amygdala, D(1) dopamine receptors couple solely to Galpha(q). The results indicate that in addition to the D(1)/G(s)/adenylyl cyclase system, brain D(1)-like dopamine receptor sites activate phospholipase C through Galpha(q) protein.     

SKF83959 selectively regulates phosphatidylinositol-linked D1 dopamine receptors in rat brain

Previously a distinct D1-like dopamine receptor (DAR) that selectively couples to phospholipase C/phosphatidylinositol (PLC/PI) was proposed. However, lack of a selective agonist has limited efforts aimed at characterizing this receptor. We characterized the in vitro and in vivo effects of SKF83959 in regulating PI metabolism. SKF83959 stimulates (EC50, 8 micro m) phosphatidylinositol 4,5-biphosphate hydrolysis in membranes of frontal cortex (FC) but not in membranes from PC12 cells expressing classical D1A DARs. Stimulation of FC PI metabolism was attenuated by the D1 antagonist, SCH23390, indicating that SKF83959 activates a D1-like DAR. The PI-linked DAR is located in hippocampus, cerebellum, striatum and FC. Most significantly, administration of SKF83959 induced accumulations of IP3 in striatum and hippocampus. In contrast to other D1 DAR agonists, SKF83959 did not increase cAMP production in brain or in D1A DAR-expressing PC12 cell membranes. However, SKF83959 inhibited cAMP elevation elicited by the D1A DAR agonist, SKF81297, indicating that the compound is an antagonist of the classical D1A DAR. Lastly, we demonstrated that SKF83959 enhances [35S]guanosine 5'-O-(3-thiotriphosphate) binding to membrane Galphaq and Galphai proteins, suggesting that PI stimulation is mediated by activation of these guanine nucleotide-binding regulatory proteins. Results indicate that SKF83959 is a selective agonist for the PI-linked D1-like DAR, providing a unique tool for investigating the functions of this brain D1 DAR subtype.     

Long-lasting up-regulation of orexin receptor type 2 protein levels in the rat nucleus accumbens after chronic cocaine administration

Hypothalamic orexin (hypocretin) neurons project to the key structures of the limbic system and orexin receptors, both orexin receptor type 1 (OXR1) and type 2 (OXR2), are expressed in most limbic regions. Emerging evidence suggests that orexin is among important neurotransmitters that regulate addictive properties of drugs of abuse. In this study, we examined the effect of psychostimulant cocaine on orexin receptor protein abundance in the rat limbic system in vivo. Intermittent administration of cocaine (20 mg/kg, i.p., once daily for 5 days) caused a typical behavioral sensitization response to a challenge cocaine injection at a 14-day withdrawal period. Repeated cocaine administration at the same withdrawal time also increased OXR2 protein levels in the nucleus accumbens while repeated cocaine had no effect on OXR1 and orexin neuropeptide (both orexin-A and orexin-B) levels in this region. In contrast to the nucleus accumbens, OXR2 levels in the frontal cortex, the ventral tegmental area, the hippocampus, and the dorsal striatum (caudate putamen) were not altered by cocaine. Remarkably, the up-regulated OXR2 levels in the nucleus accumbens showed a long-lasting nature as it persisted up to 60 days after the discontinuation of repeated cocaine treatments. In contrast to chronic cocaine administration, an acute cocaine injection was insufficient to modify levels of any orexin receptor and peptide. Our data identify the up-regulation of OXR2 in the nucleus accumbens as an enduring molecular event that is correlated well with behavioral plasticity in response to chronic psychostimulant administration. This OXR2 up-regulation may reflect a key adaptation of limbic orexinergic transmission to chronic drug exposure and may thus be critical for the expression of motor plasticity.     

Presynaptic Modulation of K+-Evoked [3H]Dopamine Release in Striatal and Frontal Cortical Synaptosomes of Normotensive and Spontaneous-Hypertensive Rats

Regional differences in presynaptic [³H]dopamine ([³H]DA) release and its modulation by D₂ DA-receptors between the frontal cortex and striatum obtained from Wystar-Kyoto (WKY) and spontaneous-hypertensive rats (SHR) have been evaluated using superfused synaptosomes. Synaptosomal tritium content was significantly lower in the frontal cortex than in the striatum in both SHR and WKY (45% and 48%, respectively), but no differences in tritium content were obtained between strains. However, the 15 mM K⁺-evoked [³H]DA overflow was lower in the SHR as compared to WKY rats in both brain regions (striatum 23%, frontal cortex 21). Concentration-response curves for quinpirole (1nM-10 M)-mediated inhibition of 15mM K⁺-evoked [³H]DA release showed no differences between SHR and WKY. These results suggest that SHR has less ability to release [³H]DA as compared to WKY rats, but SHR did not show differences in the autoregulation of such release in both the frontal cortex and striatum.     

Contemporary approaches to neural circuit manipulation and mapping: focus on reward and addiction

Tying complex psychological processes to precisely defined neural circuits is a major goal of systems and behavioural neuroscience. This is critical for understanding adaptive behaviour, and also how neural systems are altered in states of psychopathology, such as addiction. Efforts to relate psychological processes relevant to addiction to activity within defined neural circuits have been complicated by neural heterogeneity. Recent advances in technology allow for manipulation and mapping of genetically and anatomically defined neurons, which when used in concert with sophisticated behavioural models, have the potential to provide great insight into neural circuit bases of behaviour. Here we discuss contemporary approaches for understanding reward and addiction, with a focus on midbrain dopamine and cortico-striato-pallidal circuits.     

The human amygdala and orbital prefrontal cortex in behavioural regulation

Survival in complex environments depends on an ability to optimize future behaviour based on past experience. Learning from experience enables an organism to generate predictive expectancies regarding probable future states of the world, enabling deployment of flexible behavioural strategies. However, behavioural flexibility cannot rely on predictive expectancies alone and options for action need to be deployed in a manner that is responsive to a changing environment. Important moderators on learning-based predictions include those provided by context and inputs regarding an organism's current state, including its physiological state. In this paper, I consider human experimental approaches using functional magnetic resonance imaging that have addressed the role of the amygdala and prefrontal cortex (PFC), in particular the orbital PFC, in acquiring predictive information regarding the probable value of future events, updating this information, and shaping behaviour and decision processes on the basis of these value representations.     

雌激素在大鼠杏仁核与纹状体多巴胺代谢中作用的差异

为探讨雌激素对大鼠杏仁核（amygdala,Amy）与纹状体（striatum,Str）多巴胺（dopamine,DA）代谢的作用,本实验采用离体电化学检测技术--高效液相色谱法（high performance liquid chromatography,HPLC）测定正常雌鼠及经雌激素处理的去卵巢（ovariectomy,OVX）雌鼠Amy和Sr的DA及其代谢产物的组织含量。实验结果显示,OVX雌鼠经雌激素处理后,可引起Amy的DA及其代谢产物含量减少,而Str的DA及其代谢产物含量不受其影响。OVX雌鼠Amy的DA更新率低于正常及雌激素处理的OVX鼠,Amy组织的DA含量约是Str组织的1/6,而更新率是Str的2倍左右。以上结果提示,雌性大鼠血清雄激素浓度可影响其Amy组织的DA代谢及组织含量,而Str的DA组织含量不因雌激素浓度的改变而变化。     

Deletion of Maged1 in mice abolishes locomotor and reinforcing effects of cocaine

Melanoma antigen genes (Mage) were first described as tumour markers. However, some of Mage are also expressed in healthy cells where their functions remain poorly understood. Here, we describe an unexpected role for one of these genes, Maged1, in the control of behaviours related to drug addiction. Mice lacking Maged1 are insensitive to the behavioural effects of cocaine as assessed by locomotor sensitization, conditioned place preference (CPP) and drug self‐administration. Electrophysiological experiments in brain slices and conditional knockout mice demonstrate that Maged1 is critical for cortico‐accumbal neurotransmission. Further, expression of Maged1 in the prefrontal cortex (PFC) and the amygdala, but not in dopaminergic or striatal and other GABAergic neurons, is necessary for cocaine‐mediated behavioural sensitization, and its expression in the PFC is also required for cocaine‐induced extracellular dopamine (DA) release in the nucleus accumbens (NAc). This work identifies Maged1 as a critical molecule involved in cellular processes and behaviours related to addiction.     

Phencyclidine-Induced Dysregulation of Dopamine Response to Amphetamine in Prefrontal Cortex and Striatum

Phencyclidine (PCP) administration in rodents has been used to model aspects of schizophrenia. One aspect of such treatment has been the enhancement of amphetamine-induced increase of dopamine in the prefrontal cortex and striatum. To further characterize this mechanism rats were treated for 2 weeks with continuous PCP (15 mg/kg per day via Alzet minipump). Rats were implanted with a microdialysis probe into the prefrontal cortex (PFC) or striatum. Amphetamine was administered locally via the dialysis probe during one collection period and changes in extracellular dopamine were monitored. The effect of local administration of the dopamine uptake blocker nomifensine was also measured. Amphetamine (10 M) and nomifensine (10 M) increased the level of dopamine in both the PFC and striatum. PCP administration did not alter the response to amphetamine or nomifensine in the PFC, but reduced this response about 2-fold in striatum. To examine effects of continuous PCP administration on dopamine autoreceptor function, release of [³H]dopamine in response to electrical stimulation and in the presence of a dopamine agonist or antagonist was tested in striatal and prefrontal cortical tissue. Autoreceptor responses were similar in control and PCP-treated tissues. We conclude that the brain region-specific enhancement of dopamine release by peripheral amphetamine administration in rats after PCP is not likely mediated by alterations in the dopamine autoreceptors or changes in the dopamine transporter. The selective local responses of amphetamine indicates heterogeneous regional effects of continuous PCP on NMDA receptor function; effects that influence both regional excitatory responses and the overall dynamics of tonic excitatory/inhibitory inputs to the PFC and striatum.     

Selective blockade of dopamine D(3) versus D(2) receptors enhances frontocortical cholinergic transmission and social memory in rats: a parallel neurochemical and behavioural analysis

Though dopaminergic mechanisms modulate cholinergic transmission and cognitive function, the significance of specific receptor subtypes remains uncertain. Here, we examined the roles of dopamine D(3) versus D(2) receptors. By analogy with tacrine (0.16-2.5 mg/kg, s.c.), the selective D(3) receptor antagonists, S33084 (0.01-0.63) and SB277,011 (0.63-40.0), elicited dose-dependent, pronounced and sustained elevations in dialysis levels of acetylcholine (ACh) in the frontal cortex, but not the hippocampus, of freely-moving rats. The actions of these antagonists were stereospecifically mimicked by (+)S14297 (1.25), whereas its inactive distomer, (-)S17777, was ineffective. The preferential D(2) receptor antagonist, L741,626 (10.0), failed to modify levels of ACh. S33084 (0.01-0.63) and SB277,011 (0.16-2.5) also mimicked tacrine (0.04-0.63) by dose-dependently attenuating the deleterious influence of scopolamine (1.25) upon social memory (recognition by an adult rat of a juvenile conspecific). Further, (+)S14297 (1.25) versus (-)S17777 stereospecifically blocked the action of scopolamine. Using an intersession interval of 120 min (spontaneous loss of recognition), S33084 (0.04-0.63), SB277,011 (0.16-10.0) and (+)S14297 (0.63-10.0) likewise mimicked tacrine (0.16-2.5) in enhancing social memory. In contrast, L741,626 (0.16-10.0) displayed amnesic properties. In conclusion, selective blockade of D(3) receptors facilitates frontocortical cholinergic transmission and improves social memory in rats. These data support the pertinence of D(3) receptors as a target for treatment of disorders in which cognitive function is compromised.     

Chronic administration of valproic acid induces a decrease in rat striatal glutamate and taurine levels

Summary The effect of acute and chronic (10 days) administration of 200 mg/kg (i.p.) of valproic acid (VPA) on endogenous levels of aspartate, glutamate, alanine, glycine and taurine in the cerebral frontal cortex and corpus striatum of rats was studied. Quantification of the amino acid levels was performed by HPLC.Valproic acid (VPA) did not either induce changes on these neurotransmitters contents in corpus striatum after acute treatment. After chronic administration we found a decrease on the endogenous levels of glutamic acid (24%, p < 0.05) which was related to an increase (250%, p < 0.02) of the in vitro KCl evoked release of glutamate. We found decrements in taurine endogenous levels (22%, p < 0.05) which was not associated with an increase of its release.In cerebral frontal cortex there was not found any change neither under the acute nor under the chronic condition.Thus, it may be conclude that chronic treatment with VPA produces decreases on the endogenous levels of glutamate and taurine. However the relevance of this effect concerning it therapeutic action remains unclear.