Neural encoding in ventral striatum during olfactory discrimination learning

A growing body of evidence implicates the ventral striatum in using information acquired through associative learning. The present study examined the activity of ventral striatal neurons in awake, behaving rats during go/no-go odor discrimination learning and reversal. Many neurons fired selectively to odor cues predictive of either appetitive (sucrose) or aversive (quinine) outcomes. Few neurons were selective when first exposed to the odors, but many acquired this differential activity as rats learned the significance of the cues. A substantial proportion of these neurons encoded the cues' learned motivational significance, and these neurons tended to reverse their firing selectivity after reversal of odor-outcome contingencies. Other neurons that became selectively activated during learning did not reverse, but instead appeared to encode specific combinations of cues and associated motor responses. The results support a role for ventral striatum in using the learned significance, both appetitive and aversive, of predictive cues to guide behavior.     

Cocaine seeking habits depend upon dopamine-dependent serial connectivity linking the ventral with the dorsal striatum

A neuroanatomical principle of striatal organization has been established through which ventral domains, including the nucleus accumbens, exert control over dorsal striatal processes mediated by so-called "spiraling," striato-nigro-striatal, circuitry. We have investigated the functional significance of this circuitry in the control over a cocaine-seeking habit by using an intrastriatal disconnection procedure that combined a selective, unilateral lesion of the nucleus accumbens core and infusion of a dopamine receptor antagonist into the contralateral dorsolateral striatum, thereby disrupting striato-midbrain-striatal serial connectivity bilaterally. We show that this disconnection selectively decreased drug-seeking behavior in rats extensively trained under a second-order schedule of cocaine reinforcement. These data thereby define the importance of interactions between ventral and dorsal domains of the striatum, mediated by dopaminergic transmission, in the neural mechanisms underlying the development and performance of cocaine-seeking habits that are a key characteristic of drug addiction.     

EphB receptor tyrosine kinases control morphological development of the ventral midbrain

EphB receptor tyrosine kinases and ephrin-B ligands regulate several types of cell-cell interactions during brain development, generally by modulating the cytoskeleton. EphB/ephrinB genes are expressed in the developing neural tube of early mouse embryos with distinct overlapping expression in the ventral midbrain. To test EphB function in midbrain development, mouse embryos compound homozygous for mutations in the EphB2 and EphB3 receptor genes were examined for early brain phenotypes. These mutants displayed a morphological defect in the ventral midbrain, specifically an expanded ventral midline evident by embryonic day E9.5-10.5, which formed an abnormal protrusion into the cephalic flexure. The affected area was comprised of cells that normally express EphB2 and ephrin-B3. A truncated EphB2 receptor caused a more severe phenotype than a null mutation, implying a dominant negative effect through interference with EphB forward (intracellular) signaling. In mutant embryos, the overall number, size, and identity of the ventral midbrain cells were unaltered. Therefore, the defect in ventral midline morphology in the EphB2;EphB3 compound mutant embryos appears to be caused by cellular changes that thin the tissue, forcing a protrusion of the ventral midline into the cephalic space. Our data suggests a role for EphB signaling in morphological organization of specific regions of the developing neural tube.     

DCC plays a role in navigation of forebrain axons across the ventral midbrain commissure in embryonic xenopus

In the developing vertebrate brain, growing axons establish a scaffold of axon tracts connected across the midline via commissures. We have previously identified a population of telencephalic neurons that express NOC-2, a novel glycoform of the neural cell adhesion molecule N-CAM that is involved in axon guidance in the forebrain. These axons arise from the presumptive telencephalic nucleus, course caudally along the principal longitudinal tract of the forebrain, cross the ventral midline in the midbrain, and then project to the contralateral side of the brain. In the present study we have investigated mechanisms controlling the growth of these axons across the ventral midline of the midbrain. The axon guidance receptor DCC is expressed by the NOC-2 population of axons both within the longitudinal tract and within the ventral midbrain commissure. Disruption of DCC-dependent interactions, both in vitro and in vivo, inhibited the NOC-2 axons from crossing the ventral midbrain. Instead, these axons grew along aberrant trajectories away from the midline, suggesting that DCC-dependent interactions are important for overcoming inhibitory mechanisms within the midbrain of the embryonic vertebrate brain. Thus, coordinated responsiveness of forebrain axons to both chemostimulatory and chemorepulsive cues appears to determine whether they cross the ventral midline in the midbrain.     

Neural integration of reward, arousal, and feeding: Recruitment of VTA, lateral hypothalamus, and ventral striatal neurons

The ability to control neuronal activity using light pulses and optogenetic tools has revealed new properties of neural circuits and established causal relationships between activation of a single genetically defined population of neurons and complex behaviors. Here, we briefly review the causal effect of activity of six genetically defined neural circuits on behavior, including the dopaminergic neurons DA in the ventral tegmental area (VTA); the two main populations of medium-sized spiny neurons (D1- and D2-positive) in the striatum; the giant Cholinergic interneurons in the ventral striatum; and the hypocretin- and MCH- expressing neurons in the lateral hypothalamus. We argue that selective spatiotemporal recruitment and coordinated spiking activity among these cell type-specific neural circuits may underlie the neural integration of reward, learning, arousal and feeding.     

Dissociable reward and timing signals in human midbrain and ventral striatum

Reward prediction error (RPE) signals are central to current models of reward-learning. Temporal difference (TD) learning models posit that these signals should be modulated by predictions, not only of magnitude but also timing of reward. Here we show that BOLD activity in the VTA conforms to such TD predictions: responses to unexpected rewards are modulated by a temporal hazard function and activity between a predictive stimulus and reward is depressed in proportion to predicted reward. By contrast, BOLD activity in ventral striatum (VS) does not reflect a TD RPE, but instead encodes a signal on the variable relevant for behavior, here timing but not magnitude of reward. The results have important implications for dopaminergic models of cortico-striatal learning and suggest a modification of the conventional view that VS BOLD necessarily reflects inputs from dopaminergic VTA neurons signaling an RPE.     

Synaptic neurotransmission depression in ventral tegmental dopamine neurons and cannabinoid-associated addictive learning

Drug addiction is an association of compulsive drug use with long-term associative learning/memory. Multiple forms of learning/memory are primarily subserved by activity- or experience-dependent synaptic long-term potentiation (LTP) and long-term depression (LTD). Recent studies suggest LTP expression in locally activated glutamate synapses onto dopamine neurons (local Glu-DA synapses) of the midbrain ventral tegmental area (VTA) following a single or chronic exposure to many drugs of abuse, whereas a single exposure to cannabinoid did not significantly affect synaptic plasticity at these synapses. It is unknown whether chronic exposure of cannabis (marijuana or cannabinoids), the most commonly used illicit drug worldwide, induce LTP or LTD at these synapses. More importantly, whether such alterations in VTA synaptic plasticity causatively contribute to drug addictive behavior has not previously been addressed. Here we show in rats that chronic cannabinoid exposure activates VTA cannabinoid CB1 receptors to induce transient neurotransmission depression at VTA local Glu-DA synapses through activation of NMDA receptors and subsequent endocytosis of AMPA receptor GluR2 subunits. A GluR2-derived peptide blocks cannabinoid-induced VTA synaptic depression and conditioned place preference, i.e., learning to associate drug exposure with environmental cues. These data not only provide the first evidence, to our knowledge, that NMDA receptor-dependent synaptic depression at VTA dopamine circuitry requires GluR2 endocytosis, but also suggest an essential contribution of such synaptic depression to cannabinoid-associated addictive learning, in addition to pointing to novel pharmacological strategies for the treatment of cannabis addiction.     

The effects of antipsychotics on beta-catenin, glycogen synthase kinase-3 and dishevelled in the ventral midbrain of rats

Protein kinase B and glycogen synthase kinase-3 have been identified as susceptibility genes for schizophrenia and altered protein and mRNA levels have been detected in the brains of schizophrenics post-mortem. Recently, we reported that haloperidol, clozapine and risperidone alter glycogen synthase kinase-3 and beta-catenin protein expression and glycogen synthase kinase-3 phosphorylation levels in the rat prefrontal cortex and striatum. In the current study, beta-catenin, adenomatous polyposis coli, Wnt1, dishevelled and glycogen synthase kinase-3 were examined in the ventral midbrain and hippocampus using western blotting. In addition, beta-catenin and GSK-3 were examined in the substantia nigra and ventral tegmental area using confocal and fluorescence microscopy. The results indicate that repeated antipsychotic administration results in significant elevations in glycogen synthase kinase-3, beta-catenin and dishevelled-3 protein levels in the ventral midbrain and hippocampus. Raclopride causes similar changes in beta-catenin and GSK-3 in the ventral midbrain, suggesting that D2 dopamine receptor antagonism mediated the changes observed following antipsychotic administration. In contrast, amphetamine, a drug capable of inducing psychotic episodes, had the opposite effect on beta-catenin and GSK-3 in the ventral midbrain. Collectively, the results suggest that antipsychotics may exert their beneficial effects through modifications to proteins that are associated with the canonical Wnt pathway.     

Model-based influences on humans' choices and striatal prediction errors

The mesostriatal dopamine system is prominently implicated in model-free reinforcement learning, with fMRI BOLD signals in ventral striatum notably covarying with model-free prediction errors. However, latent learning and devaluation studies show that behavior also shows hallmarks of model-based planning, and the interaction between model-based and model-free values, prediction errors, and preferences is underexplored. We designed a multistep decision task in which model-based and model-free influences on human choice behavior could be distinguished. By showing that choices reflected both influences we could then test the purity of the ventral striatal BOLD signal as a model-free report. Contrary to expectations, the signal reflected both model-free and model-based predictions in proportions matching those that best explained choice behavior. These results challenge the notion of a separate model-free learner and suggest a more integrated computational architecture for high-level human decision-making.     

Oxytocin shapes the neural circuitry of trust and trust adaptation in humans

Trust and betrayal of trust are ubiquitous in human societies. Recent behavioral evidence shows that the neuropeptide oxytocin increases trust among humans, thus offering a unique chance of gaining a deeper understanding of the neural mechanisms underlying trust and the adaptation to breach of trust. We examined the neural circuitry of trusting behavior by combining the intranasal, double-blind, administration of oxytocin with fMRI. We find that subjects in the oxytocin group show no change in their trusting behavior after they learned that their trust had been breached several times while subjects receiving placebo decrease their trust. This difference in trust adaptation is associated with a specific reduction in activation in the amygdala, the midbrain regions, and the dorsal striatum in subjects receiving oxytocin, suggesting that neural systems mediating fear processing (amygdala and midbrain regions) and behavioral adaptations to feedback information (dorsal striatum) modulate oxytocin's effect on trust. These findings may help to develop deeper insights into mental disorders such as social phobia and autism, which are characterized by persistent fear or avoidance of social interactions.     

Dissociation of food and opiate preference by a genetic mutation in zebrafish

Both natural rewards and addictive substances have the ability to reinforce behaviors. It has been unclear whether identical neural pathways mediate the actions of both. In addition, little is known about these behaviors and the underlying neural mechanisms in a genetically tractable vertebrate, the zebrafish Danio rerio. Using a conditioned place preference paradigm, we demonstrate that wildtype zebrafish exhibit a robust preference for food as well as the opiate drug morphine that can be blocked by the opioid receptor antagonist naloxone. Moreover, we show that the too few mutant, which disrupts a conserved zinc finger-containing gene and exhibits a reduction of selective groups of dopaminergic and serotonergic neurons in the basal diencephalon, displays normal food preference but shows no preference for morphine. Pretreatment with dopamine receptor antagonists abolishes morphine preference in the wildtype. These studies demonstrate that zebrafish display measurable preference behavior for reward and show that the preference for natural reward and addictive drug is dissociable by a single-gene mutation that alters subregions of brain monoamine neurotransmitter systems. Future genetic analysis in zebrafish shall uncover further molecular and cellular mechanisms underlying the formation and function of neural circuitry that regulate opiate and food preference behavior.     

Food reward in the absence of taste receptor signaling

Food palatability and hedonic value play central roles in nutrient intake. However, postingestive effects can influence food preferences independently of palatability, although the neurobiological bases of such mechanisms remain poorly understood. Of central interest is whether the same brain reward circuitry that is responsive to palatable rewards also encodes metabolic value independently of taste signaling. Here we show that trpm5-/- mice, which lack the cellular machinery required for sweet taste transduction, can develop a robust preference for sucrose solutions based solely on caloric content. Sucrose intake induced dopamine release in the ventral striatum of these sweet-blind mice, a pattern usually associated with receipt of palatable rewards. Furthermore, single neurons in this same ventral striatal region showed increased sensitivity to caloric intake even in the absence of gustatory inputs. Our findings suggest that calorie-rich nutrients can directly influence brain reward circuits that control food intake independently of palatability or functional taste transduction.     

Hippocampal and ventral medial prefrontal activation during retrieval-mediated learning supports novel inference

Memory enables flexible use of past experience to inform new behaviors. Although leading theories hypothesize that this fundamental flexibility results from the formation of integrated memory networks relating multiple experiences, the neural mechanisms that support memory integration are not well understood. Here, we demonstrate that retrieval-mediated learning, whereby prior event details are reinstated during encoding of related experiences, supports participants' ability to infer relationships between distinct events that share content. Furthermore, we show that activation changes in a functionally coupled hippocampal and ventral medial prefrontal cortical circuit track the formation of integrated memories and successful inferential memory performance. These findings characterize the respective roles of these regions in retrieval-mediated learning processes that support relational memory network formation and inferential memory in the human brain. More broadly, these data reveal fundamental mechanisms through which memory representations are constructed into prospectively useful formats.     

Distinct developmental origins and regulatory mechanisms for GABAergic neurons associated with dopaminergic nuclei in the ventral mesodiencephalic region

GABAergic neurons in the ventral mesodiencephalic region are highly important for the function of dopaminergic pathways that regulate multiple aspects of behavior. However, development of these neurons is poorly understood. We recently showed that molecular regulation of differentiation of the GABAergic neurons associated with the dopaminergic nuclei in the ventral midbrain (VTA and SNpr) is distinct from the rest of midbrain, but the reason for this difference remained elusive. Here, we have analyzed the developmental origin of the VTA and SNpr GABAergic neurons by genetic fate mapping. We demonstrate that the majority of these GABAergic neurons originate outside the midbrain, from rhombomere 1, and move into the ventral midbrain only as postmitotic neuronal precursors. We further show that Gata2, Gata3 and Tal1 define a subpopulation of GABAergic precursors in ventral rhombomere 1. A failure in GABAergic neuron differentiation in this region correlates with loss of VTA and SNpr GABAergic neurons in Tal1 mutant mice. In contrast to midbrain, GABAergic neurons of the anterior SNpr in the diencephalon are not derived from the rhombomere 1. These results suggest unique migratory pathways for the precursors of important GABAergic neuron subpopulations, and provide the basis for understanding diversity within midbrain GABAergic neurons.     

Humans and Mice Express Similar Olfactory Preferences

In humans, the pleasantness of odors is a major contributor to social relationships and food intake. Smells evoke attraction and repulsion responses, reflecting the hedonic value of the odorant. While olfactory preferences are known to be strongly modulated by experience and learning, it has been recently suggested that, in humans, the pleasantness of odors may be partly explained by the physicochemical properties of the odorant molecules themselves. If odor hedonic value is indeed predetermined by odorant structure, then it could be hypothesized that other species will show similar odor preferences to humans. Combining behavioral and psychophysical approaches, we here show that odorants rated as pleasant by humans were also those which, behaviorally, mice investigated longer and human subjects sniffed longer, thereby revealing for the first time a component of olfactory hedonic perception conserved across species. Consistent with this, we further show that odor pleasantness rating in humans and investigation time in mice were both correlated with the physicochemical properties of the molecules, suggesting that olfactory preferences are indeed partly engraved in the physicochemical structure of the odorant. That odor preferences are shared between mammal species and are guided by physicochemical features of odorant stimuli strengthens the view that odor preference is partially predetermined. These findings open up new perspectives for the study of the neural mechanisms of hedonic perception.     

Ephrin‐A5 regulates the formation of the ascending midbrain dopaminergic pathways

Dopaminergic neurons from the substantia nigra and the ventral tegmental area of the midbrain project to the caudate/putamen and nucleus accumbens, respectively, establishing the mesostriatal and the mesolimbic pathways. However, the mechanisms underlying the development of these pathways are not well understood. In the current study, the EphA5 receptor and its corresponding ligand, ephrin‐A5, were shown to regulate dopaminergic axon outgrowth and influence the formation of the midbrain dopaminergic pathways. Using a strain of mutant mice in which the EphA5 cytoplasmic domain was replaced with β‐galactosidase, EphA5 protein expression was detected in both the ventral tegmental area and the substantia nigra of the midbrain. Ephrin‐A5 was found in both the dorsolateral and the ventromedial regions of the striatum, suggesting a role in mediating dopaminergic axon‐target interactions. In the presence of ephrin‐A5, dopaminergic neurons extended longer neurites in in vitro coculture assays. Furthermore, in mice lacking ephrin‐A5, retrograde tracing studies revealed that fewer neurons sent axons to the striatum. These observations indicate that the interactions between ephrin‐A ligands and EphA receptors promote growth and targeting of the midbrain dopaminergic axons to the striatum. © 2008 Wiley Periodicals, Inc. Develop Neurobiol, 2009     

Subjective socioeconomic status predicts human ventral striatal responses to social status information

The enormous influence of hierarchical rank on social interactions [1] suggests that neural mechanisms exist to process status-related information [2] and ascribe value to it. The ventral striatum is prominently implicated in processing value and salience, independent of hedonic properties [3, 4], and a functional magnetic resonance imaging (fMRI) study of social status perception in humans demonstrated that viewing higher-ranked compared to lower-ranked individuals evokes a ventral striatal response [5], indicative of a greater assignment of value/salience to higher status. Consistent with this interpretation, nonhuman primates value information associated with higher-ranked conspecifics more than lower-ranked, as illustrated using a choice paradigm in which monkeys preferentially take the opportunity to view high-status monkeys [6]. Interestingly, this status-related value assignment in nonhuman primates is influenced by one's own hierarchical rank: high-status monkeys preferentially attend to conspecifics of high status, whereas low-status monkeys will also attend to other low-status monkeys [7]. Complementary to these findings, using fMRI and a social status judgment task in humans, we suggest a neurobiological mechanism by which one's own relative hierarchical rank influences the value attributed to particular social status information by demonstrating that one's subjective socioeconomic status differentially influences ventral striatal activity during processing of status-related information.     

The kappa-opioid agonist, U-69593, decreases acute amphetamine-evoked behaviors and calcium-dependent dialysate levels of dopamine and glutamate in the ventral striatum

The effects of a kappa-opioid receptor agonist on acute amphetamine-induced behavioral activation and dialysate levels of dopamine and glutamate in the ventral striatum were investigated. Amphetamine (2.5 mg/kg i.p.) evoked a substantial increase in rearing, sniffing, and hole-poking behavior as well as dopamine and glutamate levels in the ventral striatum of awake rats. U-69593 (0.32 mg/kg s.c.) significantly decreased the amphetamine-evoked increase in behavior and dopamine and glutamate levels in the ventral striatum. Reverse dialysis of the selective kappa-opioid receptor antagonist, nor-binaltorphimine, into the ventral striatum antagonized the effects of U-69593 on amphetamine-induced behavior and dopamine and glutamate levels. Reverse dialysis of low calcium (0.1 mM) into the ventral striatum decreased basal dopamine, but not glutamate, dialysate levels by 91% 45 min after initiation of perfusion. Strikingly, 0.1 mM calcium perfusion significantly reduced the 2.5 mg/kg amphetamine-evoked increase in dopamine and glutamate levels in the ventral striatum, distinguishing a calcium-dependent and a calcium-independent component of release. U-69593 did not alter the calcium-independent component of amphetamine-evoked dopamine and glutamate levels. These data are consistent with the view that a transsynaptic mechanism augments the increase in dopamine and glutamate levels in the ventral striatum evoked by a moderately high dose of amphetamine and that stimulation of kappa-opioid receptors suppresses the calcium-dependent component of amphetamine's effects.