Reward Anticipation in Ventral Striatum and Individual Sensitivity to Reward: A Pilot Study of a Child-Friendly fMRI Task

Reward processing has been implicated in developmental disorders. However, the classic task to probe reward anticipation, the monetary incentive delay task, has an abstract coding of reward and no storyline and may therefore be less appropriate for use with developmental populations. We modified the task to create a version appropriate for use with children. We investigated whether this child-friendly version could elicit ventral striatal activation during reward anticipation in typically developing children and young adolescents (aged 9.5–14.5). In addition, we tested whether our performance-based measure of reward sensitivity was associated with anticipatory activity in ventral striatum. Reward anticipation was related to activity in bilateral ventral striatum. Moreover, we found an association between individual reward sensitivity and activity in ventral striatum. We conclude that this task assesses ventral striatal activity in a child-friendly paradigm. The combination with a performance-based measure of reward sensitivity potentially makes the task a powerful tool for developmental imaging studies of reward processing.     

Abnormal Anatomical Connectivity between the Amygdala and Orbitofrontal Cortex in Conduct Disorder

Objective

Previous research suggested that structural and functional abnormalities within the amygdala and orbitofrontal cortex contribute to the pathophysiology of Conduct Disorder (CD). Here, we investigated whether the integrity of the white-matter pathways connecting these regions is abnormal and thus may represent a putative neurobiological marker for CD.

Methods

Diffusion Tensor Imaging (DTI) was used to investigate white-matter microstructural integrity in male adolescents with childhood-onset CD, compared with healthy controls matched in age, sex, intelligence, and socioeconomic status. Two approaches were employed to analyze DTI data: voxel-based morphometry of fractional anisotropy (FA), an index of white-matter integrity, and virtual dissection of white-matter pathways using tractography.

Results

Adolescents with CD displayed higher FA within the right external capsule relative to controls (T = 6.08, P<0.05, Family-Wise Error, whole-brain correction). Tractography analyses showed that FA values within the uncinate fascicle (connecting the amygdala and orbitofrontal cortex) were abnormally increased in individuals with CD relative to controls. This was in contrast with the inferior frontal-occipital fascicle, which showed no significant group differences in FA. The finding of increased FA in the uncinate fascicle remained significant when factoring out the contribution of attention-deficit/hyperactivity disorder symptoms. There were no group differences in the number of streamlines in either of these anatomical tracts.

Conclusions

These results provide evidence that CD is associated with white-matter microstructural abnormalities in the anatomical tract that connects the amygdala and orbitofrontal cortex, the uncinate fascicle. These results implicate abnormal maturation of white-matter pathways which are fundamental in the regulation of emotional behavior in CD.     

Communication between the Anterior Cingulate Cortex and Ventral Tegmental Area during a Cost-Benefit Reversal Task

1. Download high-res image (238KB)
2. Download full-size image

     

Increased Neural Habituation in the Amygdala and Orbitofrontal Cortex in Social Anxiety Disorder Revealed by fMRI

A characterizing symptom of social anxiety disorder (SAD) is increased emotional reactivity towards potential social threat in combination with impaired emotion and stress regulation. While several neuroimaging studies have linked SAD with hyperreactivity in limbic brain regions when exposed to emotional faces, little is known about habituation in both the amygdala and neocortical regulation areas. 15 untreated SAD patients and 15 age- and gender-matched healthy controls underwent functional magnetic resonance imaging during repeated blocks of facial emotion () and object discrimination tasks (). Emotion processing networks were defined by a task-related contrast (). Linear regression was employed for assessing habituation effects in these regions. In both groups, the employed paradigm robustly activated the emotion processing and regulation network, including the amygdalae and orbitofrontal cortex (OFC). Statistically significant habituation effects were found in the amygdalae, OFC, and pulvinar thalamus of SAD patients. No such habituation was found in healthy controls. Concurrent habituation in the medial OFC and the amygdalae of SAD patients as shown in this study suggests intact functional integrity and successful short-term down-regulation of neural activation in brain areas responsible for emotion processing. Initial hyperactivation may be explained by an insufficient habituation to new stimuli during the first seconds of exposure. In addition, our results highlight the relevance of the orbitofrontal cortex in social anxiety disorders.     

Reward Sensitivity Modulates Brain Activity in the Prefrontal Cortex,ACC and Striatum during Task Switching

Current perspectives on cognitive control acknowledge that individual differences in motivational dispositions may modulate cognitive processes in the absence of reward contingencies. This work aimed to study the relationship between individual differences in Behavioral Activation System (BAS) sensitivity and the neural underpinnings involved in processing a switching cue in a task-switching paradigm. BAS sensitivity was hypothesized to modulate brain activity in frontal regions, ACC and the striatum. Twenty-eight healthy participants underwent fMRI while performing a switching task, which elicited activity in fronto-striatal regions during the processing of the switch cue. BAS sensitivity was negatively associated with activity in the lateral prefrontal cortex, anterior cingulate cortex and the ventral striatum. Combined with previous results, our data indicate that BAS sensitivity modulates the neurocognitive processes involved in task switching in a complex manner depending on task demands. Therefore, individual differences in motivational dispositions may influence cognitive processing in the absence of reward contingencies.     

Directional Influence between the Human Amygdala and Orbitofrontal Cortex at the Time of Decision-Making

There is a growing consensus that the brain makes simple choices, such as choosing between an apple and an orange, by assigning value to the options under consideration, and comparing those values to make a choice. There is also a consensus that value signals computed in orbitofrontal cortex (OFC) and amygdala play a critical role in the choice process. However, the nature of the flow of information between OFC and amygdala at the time of decision is still unknown. In order to study this question, simultaneous local field potentials were recorded from OFC and amygdala in human patients while they performed a simple food choice task. Although the interaction of these circuits has been studied in animals, this study examines the effective connectivity directly in the human brain on a moment-by-moment basis. A spectral conditional Granger causality analysis was performed in order to test if the modulation of activity goes mainly from OFC-to-amygdala, from amygdala-to-OFC, or if it is bi-directional. Influence from amygdala-to-OFC was dominant prior to the revealed choice, with a small but significant OFC influence on the amygdala earlier in the trial. Alpha oscillation amplitudes analyzed with the Hilbert-Huang transform revealed differences in choice valence coincident with temporally specific amygdala influence on the OFC.     

rTMS of the Left Dorsolateral Prefrontal Cortex Modulates Dopamine Release in the Ipsilateral Anterior Cingulate Cortex and Orbitofrontal Cortex

Background

Brain dopamine is implicated in the regulation of movement, attention, reward and learning and plays an important role in Parkinson''s disease, schizophrenia and drug addiction. Animal experiments have demonstrated that brain stimulation is able to induce significant dopaminergic changes in extrastriatal areas. Given the up-growing interest of non-invasive brain stimulation as potential tool for treatment of neurological and psychiatric disorders, it would be critical to investigate dopaminergic functional interactions in the prefrontal cortex and more in particular the effect of dorsolateral prefrontal cortex (DLPFC) (areas 9/46) stimulation on prefrontal dopamine (DA).

Methodology/Principal Findings

Healthy volunteers were studied with a high-affinity DA D2-receptor radioligand, [¹¹C]FLB 457-PET following 10 Hz repetitive transcranial magnetic stimulation (rTMS) of the left and right DLPFC. rTMS on the left DLPFC induced a significant reduction in [¹¹C]FLB 457 binding potential (BP) in the ipsilateral subgenual anterior cingulate cortex (ACC) (BA 25/12), pregenual ACC (BA 32) and medial orbitofrontal cortex (BA 11). There were no significant changes in [¹¹C]FLB 457 BP following right DLPFC rTMS.

Conclusions/Significance

To our knowledge, this is the first study to provide evidence of extrastriatal DA modulation following acute rTMS of DLPFC with its effect limited to the specific areas of medial prefrontal cortex. [¹¹C]FLB 457-PET combined with rTMS may allow to explore the neurochemical functions of specific cortical neural networks and help to identify the neurobiological effects of TMS for the treatment of different neurological and psychiatric diseases.     

Adolescent Changes in Dopamine D1 Receptor Expression in Orbitofrontal Cortex and Piriform Cortex Accompany an Associative Learning Deficit

The orbitofrontal cortex (OFC) and piriform cortex are involved in encoding the predictive value of olfactory stimuli in rats, and neural responses to olfactory stimuli in these areas change as associations are learned. This experience-dependent plasticity mirrors task-related changes previously observed in mesocortical dopamine neurons, which have been implicated in learning the predictive value of cues. Although forms of associative learning can be found at all ages, cortical dopamine projections do not mature until after postnatal day 35 in the rat. We hypothesized that these changes in dopamine circuitry during the juvenile and adolescent periods would result in age-dependent differences in learning the predictive value of environmental cues. Using an odor-guided associative learning task, we found that adolescent rats learn the association between an odor and a palatable reward significantly more slowly than either juvenile or adult rats. Further, adolescent rats displayed greater distractibility during the task than either juvenile or adult rats. Using real-time quantitative PCR and immunohistochemical methods, we observed that the behavioral deficit in adolescence coincides with a significant increase in D1 dopamine receptor expression compared to juvenile rats in both the OFC and piriform cortex. Further, we found that both the slower learning and increased distractibility exhibited in adolescence could be alleviated by experience with the association task as a juvenile, or by an acute administration of a low dose of either the dopamine D1 receptor agonist SKF-38393 or the D2 receptor antagonist eticlopride. These results suggest that dopaminergic modulation of cortical function may be important for learning the predictive value of environmental stimuli, and that developmental changes in cortical dopaminergic circuitry may underlie age-related differences in associative learning.     

Reward-Induced Phasic Dopamine Release in the Monkey Ventral Striatum and Putamen

In-vivo voltammetry has successfully been used to detect dopamine release in rodent brains, but its application to monkeys has been limited. We have previously detected dopamine release in the caudate of behaving Japanese monkeys using diamond microelectrodes (Yoshimi 2011); however it is not known whether the release pattern is the same in various areas of the forebrain. Recent studies have suggested variations in the dopaminergic projections to forebrain areas. In the present study, we attempted simultaneous recording at two locations in the striatum, using fast-scan cyclic voltammetry (FSCV) on carbon fibers, which has been widely used in rodents. Responses to unpredicted food and liquid rewards were detected repeatedly. The response to the liquid reward after conditioned stimuli was enhanced after switching the prediction cue. These characteristics were generally similar between the ventral striatum and the putamen. Overall, the technical application of FSCV recording in multiple locations was successful in behaving primates, and further voltammetric recordings in multiple locations will expand our knowledge of dopamine reward responses.     

The Prefrontal Cortex Regulates the Basal Release of Dopamine in the Limbic Striatum: An Effect Mediated by Ventral Tegmental Area

Abstract: The present study examined whether the prefrontal cortex (PFC) exerts a tonic control over the basal release of dopamine in the limbic striatum and whether this control is mediated by glutamatergic afferents to the dopamine cell body or terminal regions. Using intracerebral microdialysis in freely moving rats, it was demonstrated that application of tetrodotoxin in the contralateral PFC significantly decreased the release of dopamine in the medial striatum. Conversely, blockade of the tonic inhibitory GABAergic input in the PFC with bicuculline increased the release of dopamine in the medial striatum. Application of excitatory amino acid receptor antagonists into the striatum, while bicuculline was perfused in the PFC, did not affect the bicuculline-evoked dopamine increase in the striatum. However, infusion of tetrodotoxin or excitatory amino acid receptor antagonists into the ventral tegmental area, a region containing dopamine cell bodies that project to the medial striatum, blocked the stimulation of striatal dopamine release induced by infusion of bicuculline into the PFC. These data demonstrate that the basal output of dopamine terminals in the medial striatum is under a tonic excitatory control of the PFC. Furthermore, this control occurs primarily through glutamatergic projections to the dopamine cell body area rather than the terminal regions.     

Increased Functional Connectivity between Prefrontal Cortex and Reward System in Pathological Gambling

Pathological gambling (PG) shares clinical characteristics with substance-use disorders and is thus discussed as a behavioral addiction. Recent neuroimaging studies on PG report functional changes in prefrontal structures and the mesolimbic reward system. While an imbalance between these structures has been related to addictive behavior, whether their dysfunction in PG is reflected in the interaction between them remains unclear. We addressed this question using functional connectivity resting-state fMRI in male subjects with PG and controls. Seed-based functional connectivity was computed using two regions-of-interest, based on the results of a previous voxel-based morphometry study, located in the prefrontal cortex and the mesolimbic reward system (right middle frontal gyrus and right ventral striatum). PG patients demonstrated increased connectivity from the right middle frontal gyrus to the right striatum as compared to controls, which was also positively correlated with nonplanning aspect of impulsiveness, smoking and craving scores in the PG group. Moreover, PG patients demonstrated decreased connectivity from the right middle frontal gyrus to other prefrontal areas as compared to controls. The right ventral striatum demonstrated increased connectivity to the right superior and middle frontal gyrus and left cerebellum in PG patients as compared to controls. The increased connectivity to the cerebellum was positively correlated with smoking in the PG group. Our results provide further evidence for alterations in functional connectivity in PG with increased connectivity between prefrontal regions and the reward system, similar to connectivity changes reported in substance use disorder.     

Parallel Representation of Value-Based and Finite State-Based Strategies in the Ventral and Dorsal Striatum

Previous theoretical studies of animal and human behavioral learning have focused on the dichotomy of the value-based strategy using action value functions to predict rewards and the model-based strategy using internal models to predict environmental states. However, animals and humans often take simple procedural behaviors, such as the “win-stay, lose-switch” strategy without explicit prediction of rewards or states. Here we consider another strategy, the finite state-based strategy, in which a subject selects an action depending on its discrete internal state and updates the state depending on the action chosen and the reward outcome. By analyzing choice behavior of rats in a free-choice task, we found that the finite state-based strategy fitted their behavioral choices more accurately than value-based and model-based strategies did. When fitted models were run autonomously with the same task, only the finite state-based strategy could reproduce the key feature of choice sequences. Analyses of neural activity recorded from the dorsolateral striatum (DLS), the dorsomedial striatum (DMS), and the ventral striatum (VS) identified significant fractions of neurons in all three subareas for which activities were correlated with individual states of the finite state-based strategy. The signal of internal states at the time of choice was found in DMS, and for clusters of states was found in VS. In addition, action values and state values of the value-based strategy were encoded in DMS and VS, respectively. These results suggest that both the value-based strategy and the finite state-based strategy are implemented in the striatum.     

Inhibitory Avoidance Task Reveals Differences in Ectonucleotidase Activities between Male and Female Rats

Studies demonstrated that endogenous levels of estrogen affect the long-term potentiation (LTP) and long-term depression (LTD). ATP and adenosine may play a role in the modulation of LTP. Our laboratory observed in previous studies that inhibitory avoidance task is associated with a decrease in hippocampal ectonucleotidase activities in adult male rats. To explore if ectonucleotidases are modulated in memory formation in female rats, as observed in males, we evaluated the effect of inhibitory avoidance training on synaptosomal NTP Dase and 5-nucleotidase activities in rat hippocampus from both sexes. The results demonstrated a decrease in ATP, ADP and AMP hydrolysis (37%, 38% and 32%, respectively) immediately after training and a significant inhibition only in ATP hydrolysis (36%) 30 min post-training in male rats. There were no changes in ectonucleotidase activities from female rats. These findings provide support for the view that could exist biochemical differences in ectonucleotidase activities between males and females.     

Disrupted Functional Connectivity of the Anterior Cingulate Cortex in Cirrhotic Patients without Overt Hepatic Encephalopathy: A Resting State fMRI Study

Background

To evaluate the changes of functional connectivity of the anterior cingulate cortex (ACC) in patients with cirrhosis without overt hepatic encephalopathy (HE) using resting state functional MRI.

Methodology/Principal Findings

Participants included 67 cirrhotic patients (27 minimal hepatic encephalopathy (MHE) and 40 cirrhotic patients without MHE (non-HE)), and 40 age- and gender- matched healthy controls. rsfMRI were performed on 3 Telsa scanners. The pregenual ACC resting-state networks (RSNs) were characterized by using a standard seed-based whole-brain correlation method and compared between cirrhotic patients and healthy controls. Pearson correlation analysis was performed between the ACC RSNs and venous blood ammonia levels, neuropsychological tests (number connection test type A [NCT-A] and digit symbol test [DST]) scores in cirrhotic patients. All thresholds were set at P<0.05, with false discovery rate corrected. Compared with controls, non-HE and MHE patients showed significantly decreased functional connectivity in the bilateral ACC, bilateral middle frontal cortex (MFC), bilateral middle cingulate cortex (MCC), bilateral superior temporal gyri (STG)/middle temporal gyri (MTG), bilateral thalami, bilateral putamen and bilateral insula, and increased functional connectivity of bilateral precuneus and left temporo-occipital lobe and bilateral lingual gyri. Compared with non-HE patients, MHE showed the decreased functional connectivity of right MCC, bilateral STG/MTG and right putamen. This indicates decreased ACC functional connectivity predominated with the increasing severity of HE. NCT-A scores negatively correlated with ACC functional connectivity in the bilateral MCC, right temporal lobe, and DST scores positively correlated with functional connectivity in the bilateral ACC and the right putamen. No correlation was found between venous blood ammonia levels and functional connectivity in ACC in cirrhotic patients.

Conclusions/Significance

Disrupted functional connectivity in ACC was found in cirrhotic patients which further deteriorated with the increasing severity of HE and correlated cognitive dysfunction in cirrhotic patients.