Prefrontal norepinephrine determines attribution of "high" motivational salience

Intense motivational salience attribution is considered to have a major role in the development of different psychopathologies. Numerous brain areas are involved in "normal" motivational salience attribution processes; however, it is not clear whether common or different neural mechanisms also underlie intense motivational salience attribution. To elucidate this a brain area and a neural system had to be envisaged that were involved only in motivational salience attribution to highly salient stimuli. Using intracerebral microdialysis, we found that natural stimuli induced an increase in norepinephrine release in the medial prefrontal cortex of mice proportional to their salience, and that selective prefrontal norepinephrine depletion abolished the increase of norepinephrine release in the medial prefrontal cortex induced by exposure to appetitive (palatable food) or aversive (light) stimuli independently of salience. However, selective norepinephrine depletion in the medial prefrontal cortex impaired the place conditioning induced exclusively by highly salient stimuli, thus indicating that prefrontal noradrenergic transmission determines approach or avoidance responses to both reward- and aversion-related natural stimuli only when the salience of the unconditioned natural stimulus is high enough to induce sustained norepinephrine outflow. This affirms that prefrontal noradrenergic transmission determines motivational salience attribution selectively when intense motivational salience is processed, as in conditions that characterize psychopathological outcomes.     

Effects of aversive stimuli on prospective memory. An event-related fMRI study

Prospective memory (PM) describes the ability to execute a previously planned action at the appropriate point in time. Although behavioral studies clearly showed that prospective memory performance is affected by the emotional significance attributed to the intended action, no study so far investigated the brain mechanisms subserving the modulatory effect of emotional salience on PM performance. The general aim of the present study was to explore brain regions involved in prospective memory processes when PM cues are associated with emotional stimuli. In particular, based on the hypothesised critical role of the prefrontal cortex in prospective memory in the presence of emotionally salient stimuli, we expected a stronger involvement of aPFC when the retrieval and execution of the intended action is cued by an aversive stimulus. To this aim BOLD responses of PM trials cued by aversive facial expressions were compared to PM trials cued by neutral facial expressions. Whole brain analysis showed that PM task cued by aversive stimuli is differentially associated with activity in the right lateral prefrontal area (BA 10) and in the left caudate nucleus. Moreover a temporal shift between the response of the caudate nucleus that preceded that of aPFC was observed. These findings suggest that the caudate nucleus might provide an early analysis of the affective properties of the stimuli, whereas the anterior lateral prefrontal cortex (BA10) would be involved in a slower and more deliberative analysis to guide goal-directed behaviour.     

Response inhibition during cue reactivity in problem gamblers: an fMRI study

Disinhibition over drug use, enhanced salience of drug use and decreased salience of natural reinforcers are thought to play an important role substance dependence. Whether this is also true for pathological gambling is unclear. To understand the effects of affective stimuli on response inhibition in problem gamblers (PRGs), we designed an affective Go/Nogo to examine the interaction between response inhibition and salience attribution in 16 PRGs and 15 healthy controls (HCs).Four affective blocks were presented with Go trials containing neutral, gamble, positive or negative affective pictures. The No-Go trials in these blocks contained neutral pictures. Outcomes of interest included percentage of impulsive errors and mean reaction times in the different blocks. Brain activity related to No-Go trials was assessed to measure response inhibition in the various affective conditions and brain activity related to Go trials was assessed to measure salience attribution.PRGs made fewer errors during gamble and positive trials than HCs, but were slower during all trials types. Compared to HCs, PRGs activated the dorsolateral prefrontal cortex, anterior cingulate and ventral striatum to a greater extent while viewing gamble pictures. The dorsal lateral and inferior frontal cortex were more activated in PRGs than in HCs while viewing positive and negative pictures. During neutral inhibition, PRGs were slower but similar in accuracy to HCs, and showed more dorsolateral prefrontal and anterior cingulate cortex activity. In contrast, during gamble and positive pictures PRGs performed better than HCs, and showed lower activation of the dorsolateral and anterior cingulate cortex.This study shows that gambling-related stimuli are more salient for PRGs than for HCs. PRGs seem to rely on compensatory brain activity to achieve similar performance during neutral response inhibition. A gambling-related or positive context appears to facilitate response inhibition as indicated by lower brain activity and fewer behavioural errors in PRGs.     

The Role of Informative and Ambiguous Feedback in Avoidance Behavior: Empirical and Computational Findings

Avoidance behavior is a critical component of many psychiatric disorders, and as such, it is important to understand how avoidance behavior arises, and whether it can be modified. In this study, we used empirical and computational methods to assess the role of informational feedback and ambiguous outcome in avoidance behavior. We adapted a computer-based probabilistic classification learning task, which includes positive, negative and no-feedback outcomes; the latter outcome is ambiguous as it might signal either a successful outcome (missed punishment) or a failure (missed reward). Prior work with this task suggested that most healthy subjects viewed the no-feedback outcome as strongly positive. Interestingly, in a later version of the classification task, when healthy subjects were allowed to opt out of (i.e. avoid) responding, some subjects (“avoiders”) reliably avoided trials where there was a risk of punishment, but other subjects (“non-avoiders”) never made any avoidance responses at all. One possible interpretation is that the “non-avoiders” valued the no-feedback outcome so positively on punishment-based trials that they had little incentive to avoid. Another possible interpretation is that the outcome of an avoided trial is unspecified and that lack of information is aversive, decreasing subjects’ tendency to avoid. To examine these ideas, we here tested healthy young adults on versions of the task where avoidance responses either did or did not generate informational feedback about the optimal response. Results showed that provision of informational feedback decreased avoidance responses and also decreased categorization performance, without significantly affecting the percentage of subjects classified as “avoiders.” To better understand these results, we used a modified Q-learning model to fit individual subject data. Simulation results suggest that subjects in the feedback condition adjusted their behavior faster following better-than-expected outcomes, compared to subjects in the no-feedback condition. Additionally, in both task conditions, “avoiders” adjusted their behavior faster following worse-than-expected outcomes, and treated the ambiguous no-feedback outcome as less rewarding, compared to non-avoiders. Together, results shed light on the important role of ambiguous and informative feedback in avoidance behavior.     

A Predictive Reinforcement Model of Dopamine Neurons for Learning Approach Behavior

A neural network model of how dopamine and prefrontal cortex activity guides short- and long-term information processing within the cortico-striatal circuits during reward-related learning of approach behavior is proposed. The model predicts two types of reward-related neuronal responses generated during learning: (1) cell activity signaling errors in the prediction of the expected time of reward delivery and (2) neural activations coding for errors in the prediction of the amount and type of reward or stimulus expectancies. The former type of signal is consistent with the responses of dopaminergic neurons, while the latter signal is consistent with reward expectancy responses reported in the prefrontal cortex. It is shown that a neural network architecture that satisfies the design principles of the adaptive resonance theory of Carpenter and Grossberg (1987) can account for the dopamine responses to novelty, generalization, and discrimination of appetitive and aversive stimuli. These hypotheses are scrutinized via simulations of the model in relation to the delivery of free food outside a task, the timed contingent delivery of appetitive and aversive stimuli, and an asymmetric, instructed delay response task.     

Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain

Avoidance learning poses a challenge for reinforcement-based theories of instrumental conditioning, because once an aversive outcome is successfully avoided an individual may no longer experience extrinsic reinforcement for their behavior. One possible account for this is to propose that avoiding an aversive outcome is in itself a reward, and thus avoidance behavior is positively reinforced on each trial when the aversive outcome is successfully avoided. In the present study we aimed to test this possibility by determining whether avoidance of an aversive outcome recruits the same neural circuitry as that elicited by a reward itself. We scanned 16 human participants with functional MRI while they performed an instrumental choice task, in which on each trial they chose from one of two actions in order to either win money or else avoid losing money. Neural activity in a region previously implicated in encoding stimulus reward value, the medial orbitofrontal cortex, was found to increase, not only following receipt of reward, but also following successful avoidance of an aversive outcome. This neural signal may itself act as an intrinsic reward, thereby serving to reinforce actions during instrumental avoidance.     

Top-down control-signal dynamics in anterior cingulate and prefrontal cortex neurons following task switching

The prefrontal cortex (PFC) and anterior cingulate cortex (ACC) have both been implicated in cognitive control, but their relative roles remain unclear. Here we recorded the activity of single neurons in both areas while monkeys performed a task that required them to switch between trials in which they had to look toward a flashed stimulus (prosaccades) and trials in which they had to look away from the stimulus (antisaccades). We found that ACC neurons had a higher level of task selectivity than PFC neurons during the preparatory period on trials immediately following a task switch. In ACC neurons, task selectivity was strongest after the task switch and declined throughout the task block, whereas task selectivity remained constant in the PFC. These results demonstrate that the ACC is recruited when cognitive demands increase and suggest a role for both areas in task maintenance and the implementation of top-down control.     

Aversive Event Anticipation Affects Connectivity between the Ventral Striatum and the Orbitofrontal Cortex in an fMRI Avoidance Task

Ability to anticipate aversive events is important for avoiding dangerous or unpleasant situations. The motivation to avoid an event is influenced by the incentive salience of an event-predicting cue. In an avoidance fMRI task we used tone intensities to manipulate salience in order to study the involvement of the orbitofrontal cortex in processing of incentive salience. In the task, cues predicting either aversive or neutral avoidable tones were presented. Ventral striatum, amygdala and anterior insula activations were significantly stronger during presentation of cues for aversive than neutral tones. A psychophysiological interaction analysis showed stronger connectivity between the ventral striatum and the orbitofrontal cortex during aversive than neutral conditions. The present study shows an interaction between the ventral striatum, a structure previously linked to negative incentive salience, and the orbitofrontal cortex supporting a role for this region in processing salience. In addition, this study replicates previous findings suggesting that the task is robust.     

Top-down control of motor cortex ensembles by dorsomedial prefrontal cortex

Dorsomedial prefrontal cortex is critical for the temporal control of behavior. Dorsomedial prefrontal cortex might alter neuronal activity in areas such as motor cortex to inhibit temporally inappropriate responses. We tested this hypothesis by recording from neuronal ensembles in rodent dorsomedial prefrontal cortex during a delayed-response task. One-third of dorsomedial prefrontal neurons were significantly modulated during the delay period. The activity of many of these neurons was predictive of premature responding. We then reversibly inactivated dorsomedial prefrontal cortex while recording ensemble activity in motor cortex. Inactivation of dorsomedial prefrontal cortex reduced delay-related firing, but not response-related firing, in motor cortex. Finally, we made simultaneous recordings in dorsomedial prefrontal cortex and motor cortex and found strong delay-related temporal correlations between neurons in the two cortical areas. These data suggest that functional interactions between dorsomedial prefrontal cortex and motor cortex might serve as a top-down control signal that inhibits inappropriate responding.     

Interhemispheric relations of prefrontal cortical neurons in rats during emotional stimulation of increasing intensity

Unit activity of the prefrontal cortex of the right and left brain hemispheres of rats was recorded during intracranial stimulation of emotionally positive and negative brain structures. The neurons were divided according to their reaction to a change in food motivation: cells that decrease (M-neurons) and cells that increase their firing frequencies (R-neurons) after feeding. Three levels of stimulation current intensity were used. When stimuli of subthreshold intensity (evoking the behavioral reaction of smelling) were applied, the recorded neuronal activity was higher in the left hemisphere. During threshold emotionally positive or negative stimulation (producing approach behavior or freezing, respectively), activity of M-neurons was higher in the right hemisphere, whereas the left-side R-neurons were more active than the right-side ones. During strong emotionally positive stimulation producing self-stimulation, the firing frequency of both groups of neurons was higher in the left hemisphere. Strong emotionally negative stimulation that evoked behavioral avoidance to a greater extent activated the right hemisphere.     

前额叶皮层在社交行为中的作用

社交行为对于个体身心健康和社会发展都极其重要。社交行为障碍已成为多种精神类疾病的典型临床表征,对个体的发展有严重不良影响。前额叶皮层作为调节社交行为的关键脑区之一,参与了社交、情绪、决策等高级功能,其内部神经元、神经胶质细胞的活动变化及相互作用对调节社交行为有着重要影响,而且前额叶皮层与其他脑区之间的协作也会影响不同的社会行为。本文回顾了前额叶皮层中神经元、神经胶质细胞以及脑区投射与社交行为关系的最新研究,系统综述了前额叶皮层在社交行为调节中的作用,以期为社交障碍的神经机制和有效诊疗提供参考。     

Dynamics of population code for working memory in the prefrontal cortex

Some neurons (delay cells) in the prefrontal cortex elevate their activities throughout the time period during which the animal is required to remember past events and prepare future behavior, suggesting that working memory is mediated by continuous neural activity. It is unknown, however, how working memory is represented within a population of prefrontal cortical neurons. We recorded from neuronal ensembles in the prefrontal cortex as rats learned a new delayed alternation task. Ensemble activities changed in parallel with behavioral learning so that they increasingly allowed correct decoding of previous and future goal choices. In well-trained rats, considerable decoding was possible based on only a few neurons and after removing continuously active delay cells. These results show that neural activity in the prefrontal cortex changes dynamically during new task learning so that working memory is robustly represented and that working memory can be mediated by sequential activation of different neural populations.     

Language and Memory Improvements following tDCS of Left Lateral Prefrontal Cortex

Recent research demonstrates that performance on executive-control measures can be enhanced through brain stimulation of lateral prefrontal regions. Separate psycholinguistic work emphasizes the importance of left lateral prefrontal cortex executive-control resources during sentence processing, especially when readers must override early, incorrect interpretations when faced with temporary ambiguity. Using transcranial direct current stimulation, we tested whether stimulation of left lateral prefrontal cortex had discriminate effects on language and memory conditions that rely on executive-control (versus cases with minimal executive-control demands, even in the face of task difficulty). Participants were randomly assigned to receive Anodal, Cathodal, or Sham stimulation of left lateral prefrontal cortex while they (1) processed ambiguous and unambiguous sentences in a word-by-word self-paced reading task and (2) performed an n-back memory task that, on some trials, contained interference lure items reputed to require executive-control. Across both tasks, we parametrically manipulated executive-control demands and task difficulty. Our results revealed that the Anodal group outperformed the remaining groups on (1) the sentence processing conditions requiring executive-control, and (2) only the most complex n-back conditions, regardless of executive-control demands. Together, these findings add to the mounting evidence for the selective causal role of left lateral prefrontal cortex for executive-control tasks in the language domain. Moreover, we provide the first evidence suggesting that brain stimulation is a promising method to mitigate processing demands encountered during online sentence processing.     

Prefrontal neurons coding suppression of specific saccades

The prefrontal cortex has been implicated in the suppression of unwanted behavior, based upon observations of humans and monkeys with prefrontal lesions. Despite this, there has been little direct neurophysiological evidence for a mechanism that suppresses specific behavior. In this study, we used an oculomotor delayed match/nonmatch-to-sample task in which monkeys had to remember a stimulus location either as a marker of where to look or as a marker of where not to look. We found a group of neurons in both the frontal eye field and the caudal prefrontal cortex that carried signals selective for the forbidden stimulus. The activity of these "don't look" neurons correlated with the monkeys' success or failure on the task. These results demonstrate a frontal signal that is related to the active suppression of one action while the subject performs another.     

The effect of the antipsychotic drug mosapramine on the expression of Fos protein in the rat brain: comparison with haloperidol, clozapine and risperidone

In this study, we examined the effect of the acute p.o. administration of the antipsychotic drug mosapramine, as well as the antipsychotic drugs clozapine, haloperidol and risperidone, on the expression of Fos protein in the medial prefrontal cortex, nucleus accumbens and dorsolateral striatum of rat brain. The administration of mosapramine (1 or 3 mg/kg) significantly increased the number of Fos protein positive neurons in the medial prefrontal cortex, but not in the dorsolateral striatum. In addition, mosapramine (1, 3 or 10 mg/kg) produced a dose-dependent increase in the number of Fos protein positive neurons in the nucleus accumbens. The acute administration of 10 mg/kg of mosapramine significantly increased the number of Fos protein positive neurons in all brain regions. The acute administration of clozapine (30 mg/kg), similarly to mosapramine at lower doses (1 or 3 mg/kg), significantly increased the number of Fos protein positive neurons in the medial prefrontal cortex and nucleus accumbens, but not dorsolateral striatum. In contrast, haloperidol (0.3 mg/kg) significantly increased the number of Fos protein positive neurons in the nucleus accumbens and dorsolateral striatum, but not medial prefrontal cortex. The acute administration of risperidone (0.3 or 1 mg/kg) did not affect the number of Fos protein positive neurons in the medial prefrontal cortex, nucleus accumbens or dorsolateral striatum of rat brain, whereas a 3 mg/kg dose of risperidone significantly increased the number of Fos protein positive neurons in all brain regions. These results suggest that the ability of mosapramine to enhance expression of Fos protein in the medial prefrontal cortex may contribute to a clozapine-like profile with respect to actions on negative symptoms in schizophrenia. Furthermore, the lack of effect of low doses of mosapramine on Fos protein expression in the dorsolateral striatum, an area believed to play a role in movement, suggests that it may have a lower tendency to induce neurological side effects.     

Prefrontal Neurons Encode Actions and Outcomes in Conjunction with Spatial Location in Rats Performing a Dynamic Delayed Non-Match to Position Task

To respond adaptively to change organisms must utilize information about recent events and environmental context to select actions that are likely to produce favorable outcomes. We developed a dynamic delayed nonmatching to position task to study the influence of spatial context on event-related activity of medial prefrontal cortex neurons during reinforcement-guided decision-making. We found neurons with responses related to preparation, movement, lever press responses, reinforcement, and memory delays. Combined event-related and video tracking analyses revealed variability in spatial tuning of neurons with similar event-related activity. While all correlated neurons exhibited spatial tuning broadly consistent with relevant task events, for instance reinforcement-related activity concentrated in locations where reinforcement was delivered, some had elevated activity in more specific locations, for instance reinforcement-related activity in one of several locations where reinforcement was delivered. Timing analyses revealed a limited set of distinct response types with activity time-locked to critical behavioral events that represent the temporal organization of dDNMTP trials. Our results suggest that reinforcement-guided decision-making emerges from discrete populations of medial prefrontal neurons that encode information related to planned or ongoing movements and actions and anticipated or actual action-outcomes in conjunction with information about spatial context.     

The neural substrate of positive bias in spontaneous emotional processing

Even in the presence of negative information, healthy human beings display an optimistic tendency when thinking of past success and future chances, giving a positive bias to everyday''s cognition. The tendency to actively select positive thoughts suggests the existence of a mechanism to exclude negative content, raising the issue of its dependence on mechanisms like those of effortful control. Using perfusion imaging, we examined how brain activations differed according to whether participants were left to prefer positive thoughts spontaneously, or followed an explicit instruction to the same effect, finding a widespread dissociation of brain perfusion patterns. Under spontaneous processing of emotional material, recruitment of areas associated with effortful attention, such as the dorsolateral prefrontal cortex, was reduced relative to instructed avoidance of negative material (F _1,58 = 26.24, p = 0.047, corrected). Under spontaneous avoidance perfusion increments were observed in several areas that were deactivated by the task, including the perigenual medial prefrontal cortex. Furthermore, individual differences in executive capacity were not associated with positive bias. These findings suggest that spontaneous positive cognitive emotion regulation in health may result from processes that, while actively suppressing emotionally salient information, differ from those associated with effortful and directed control.     

Prefrontal cortex aspiration in pups and juvenile rats: behavioural changes and recovery of function

Male Wistar rats sustaining prefrontal cortex aspiration or sham operation at 6 days or 30 days of age were submitted to the following behavioural tests: open-field, acquisition and retention of two-way active as well as passive avoidance tasks. In the open-field the locomotor activity proved enhanced in all the aspirated animals and this enhancement lasted for 30 days. In the two-day active avoidance task, an acquisition deficit was observed in both aspirated groups; but when retrained one month later, they were able to acquire the avoidance task like sham-operated rats and no difference appeared between the groups aspirated at 6 or at 30 days of age. Concerning the passive avoidance task, no difference could be detected between aspirated and sham-operated animals of both groups except that the rats aspirated at an early age (6 days) seemed to display a better avoidance ability in the retention test. These behavioural alterations (hyperactivity and impairment of the acquisition of the 2-way active avoidance) resulted from the prefrontal cortex aspiration, at whatever age this aspiration was performed (6 days or 30 days). They disappeared after a postoperative recovery period of about one month, as evidenced by this longitudinal study.     

Stimulus-Response-Outcome Coding in the Pigeon Nidopallium Caudolaterale

A prerequisite for adaptive goal-directed behavior is that animals constantly evaluate action outcomes and relate them to both their antecedent behavior and to stimuli predictive of reward or non-reward. Here, we investigate whether single neurons in the avian nidopallium caudolaterale (NCL), a multimodal associative forebrain structure and a presumed analogue of mammalian prefrontal cortex, represent information useful for goal-directed behavior. We subjected pigeons to a go-nogo task, in which responding to one visual stimulus (S+) was partially reinforced, responding to another stimulus (S–) was punished, and responding to test stimuli from the same physical dimension (spatial frequency) was inconsequential. The birds responded most intensely to S+, and their response rates decreased monotonically as stimuli became progressively dissimilar to S+; thereby, response rates provided a behavioral index of reward expectancy. We found that many NCL neurons'' responses were modulated in the stimulus discrimination phase, the outcome phase, or both. A substantial fraction of neurons increased firing for cues predicting non-reward or decreased firing for cues predicting reward. Interestingly, the same neurons also responded when reward was expected but not delivered, and could thus provide a negative reward prediction error or, alternatively, signal negative value. In addition, many cells showed motor-related response modulation. In summary, NCL neurons represent information about the reward value of specific stimuli, instrumental actions as well as action outcomes, and therefore provide signals useful for adaptive behavior in dynamically changing environments.     

Folic Acid Prevents Behavioral Impairment and Na+,K+-ATPase Inhibition Caused by Neonatal Hypoxia–Ischemia

Folic acid plays an important role in neuroplasticity and acts as a neuroprotective agent, as observed in experimental brain ischemia studies. The aim of this study was to investigate the effects of folic acid on locomotor activity, aversive memory and Na(+),K(+)-ATPase activity in the frontal cortex and striatum in animals subjected to neonatal hypoxia-ischemia (HI). Wistar rats of both sexes at postnatal day 7 underwent HI procedure and were treated with intraperitoneal injections of folic acid (0.011 μmol/g body weight) once a day, until the 30th postnatal day. Starting on the day after, behavioral assessment was run in the open field and in the inhibitory avoidance task. Animals were sacrificed by decapitation 24 h after testing and striatum and frontal cortex were dissected out for Na(+),K(+)-ATPase activity analysis. Results show anxiogenic effect in the open field and an impairment of aversive memory in the inhibitory avoidance test in HI rats; folic acid treatment prevented both behavioral effects. A decreased Na(+),K(+)-ATPase activity in striatum, both ipsilateral and contralateral to ischemia, was identified after HI; a total recovery was observed in animals treated with folic acid. A partial recovery of Na(+),K(+)-ATPase activity was yet seen in frontal cortex of HI animals receiving folic acid supplementation. Presented results support that folic acid treatment prevents memory deficit and anxiety-like behavior, as well as prevents Na(+),K(+)-ATPase inhibition in the striatum and frontal cortex caused by neonatal hypoxia-ischemia.