Human striatal responses to monetary reward depend on saliency

While the striatum has been implicated in reward processing, an alternative view contends that the striatum processes salient events in general. Using fMRI, we investigated human striatal responses to monetary reward while modulating the saliency surrounding its receipt. Money was maximally salient when its receipt depended on a correct response (active) and minimally salient when its receipt was completely independent of the task (passive). The saliency manipulation was confirmed by skin conductance responses and subjective ratings of the stimuli. Significant caudate and nucleus accumbens activations occurred following the active compared to passive money. Such activations were attributed to saliency rather than the motor requirement associated with the active money because striatal activations were not observed when the money was replaced by inconsequential, nonrewarding stimuli. The present study provides evidence that the striatum's role in reward processing is dependent on the saliency associated with reward, rather than value or hedonic feelings.     

Reward circuitry activation by noxious thermal stimuli.

Using functional magnetic resonance imaging (fMRI), we observed that noxious thermal stimuli (46 degrees C) produce significant signal change in putative reward circuitry as well as in classic pain circuitry. Increases in signal were observed in the sublenticular extended amygdala of the basal forebrain (SLEA) and the ventral tegmentum/periaqueductal gray (VT/PAG), while foci of increased signal and decreased signal were observed in the ventral striatum and nucleus accumbens (NAc). Early and late phases were observed for signals in most brain regions, with early activation in reward related regions such as the SLEA, VT/PAG, and ventral striatum. In contrast, structures associated with somatosensory perception, including SI somatosensory cortex, thalamus, and insula, showed delayed activation. These data support the notion that there may be a shared neural system for evaluation of aversive and rewarding stimuli.     

Stimulus-Response-Outcome Coding in the Pigeon Nidopallium Caudolaterale

A prerequisite for adaptive goal-directed behavior is that animals constantly evaluate action outcomes and relate them to both their antecedent behavior and to stimuli predictive of reward or non-reward. Here, we investigate whether single neurons in the avian nidopallium caudolaterale (NCL), a multimodal associative forebrain structure and a presumed analogue of mammalian prefrontal cortex, represent information useful for goal-directed behavior. We subjected pigeons to a go-nogo task, in which responding to one visual stimulus (S+) was partially reinforced, responding to another stimulus (S–) was punished, and responding to test stimuli from the same physical dimension (spatial frequency) was inconsequential. The birds responded most intensely to S+, and their response rates decreased monotonically as stimuli became progressively dissimilar to S+; thereby, response rates provided a behavioral index of reward expectancy. We found that many NCL neurons'' responses were modulated in the stimulus discrimination phase, the outcome phase, or both. A substantial fraction of neurons increased firing for cues predicting non-reward or decreased firing for cues predicting reward. Interestingly, the same neurons also responded when reward was expected but not delivered, and could thus provide a negative reward prediction error or, alternatively, signal negative value. In addition, many cells showed motor-related response modulation. In summary, NCL neurons represent information about the reward value of specific stimuli, instrumental actions as well as action outcomes, and therefore provide signals useful for adaptive behavior in dynamically changing environments.     

Fast and automatic activation of an abstract representation of money in the human ventral visual pathway

Money, when used as an incentive, activates the same neural circuits as rewards associated with physiological needs. However, unlike physiological rewards, monetary stimuli are cultural artifacts: how are monetary stimuli identified in the first place? How and when does the brain identify a valid coin, i.e. a disc of metal that is, by social agreement, endowed with monetary properties? We took advantage of the changes in the Euro area in 2002 to compare neural responses to valid coins (Euros, Australian Dollars) with neural responses to invalid coins that have lost all monetary properties (French Francs, Finnish Marks). We show in magneto-encephalographic recordings, that the ventral visual pathway automatically distinguishes between valid and invalid coins, within only ∼150 ms. This automatic categorization operates as well on coins subjects were familiar with as on unfamiliar coins. No difference between neural responses to scrambled controls could be detected. These results could suggest the existence of a generic, all-purpose neural representation of money that is independent of experience. This finding is reminiscent of a central assumption in economics, money fungibility, or the fact that a unit of money is substitutable to another. From a neural point of view, our findings may indicate that the ventral visual pathway, a system previously thought to analyze visual features such as shape or color and to be influenced by daily experience, could also able to use conceptual attributes such as monetary validity to categorize familiar as well as unfamiliar visual objects. The symbolic abilities of the posterior fusiform region suggested here could constitute an efficient neural substrate to deal with culturally defined symbols, independently of experience, which probably fostered money''s cultural emergence and success.     

The Decision to Engage Cognitive Control Is Driven by Expected Reward-Value: Neural and Behavioral Evidence

Cognitive control is a fundamental skill reflecting the active use of task-rules to guide behavior and suppress inappropriate automatic responses. Prior work has traditionally used paradigms in which subjects are told when to engage cognitive control. Thus, surprisingly little is known about the factors that influence individuals'' initial decision of whether or not to act in a reflective, rule-based manner. To examine this, we took three classic cognitive control tasks (Stroop, Wisconsin Card Sorting Task, Go/No-Go task) and created novel ‘free-choice’ versions in which human subjects were free to select an automatic, pre-potent action, or an action requiring rule-based cognitive control, and earned varying amounts of money based on their choices. Our findings demonstrated that subjects'' decision to engage cognitive control was driven by an explicit representation of monetary rewards expected to be obtained from rule-use. Subjects rarely engaged cognitive control when the expected outcome was of equal or lesser value as compared to the value of the automatic response, but frequently engaged cognitive control when it was expected to yield a larger monetary outcome. Additionally, we exploited fMRI-adaptation to show that the lateral prefrontal cortex (LPFC) represents associations between rules and expected reward outcomes. Together, these findings suggest that individuals are more likely to act in a reflective, rule-based manner when they expect that it will result in a desired outcome. Thus, choosing to exert cognitive control is not simply a matter of reason and willpower, but rather, conforms to standard mechanisms of value-based decision making. Finally, in contrast to current models of LPFC function, our results suggest that the LPFC plays a direct role in representing motivational incentives.     

Growth factor production and requirements during the proliferative response of human T lymphocytes to anti-CD3 monoclonal antibody

Anti-CD3 was administered with three different accessory stimuli to purified populations of human T cells. Sepharose conjugated anti-CD3, monocytes, and PMA each could induce the p55 component of the IL-2R as well as responsiveness to exogenous IL-2. Sepharose anti-CD3 did not induce IL-2, although the levels of IL-2 protein and mRNA were 10 to 30 times higher with PMA than with monocytes. Despite these differences in IL-2 production, the amount of DNA synthesis and the number of lymphoblasts were comparable when monocytes or PMA were used as the accessory stimulus, and the responses were equally sensitive to inhibition by an anti-IL-2R antibody. To pursue the functional relevance of the "supraoptimal" levels of IL-2 that are induced by PMA, anti-CD3-induced lymphoblasts were isolated free of monocytes and challenged with lymphokines. It could be shown that 1) the small amounts of IL-2 in the monocyte-T cell conditioned medium would drive DNA synthesis, but that 2) higher levels of IL-2 (20 to 100 U/ml) were needed to induce IFN-gamma, as well as the mRNA for IL-4 and the p55 IL-2R. We suggest that the capacity to produce high levels of IL-2, as seen with PMA, is required under physiologic conditions for two reasons: to up-regulate the IL-2R when small amounts of Ag rather than large amounts of anti-CD3 are ligands for the T cell, or to induce the release of lymphokines like IL-4 and IFN-gamma from sensitized lymphoblasts.     

Phase-linked variations in the amplitude of the digastric nerve jaw-opening reflex response during fictive mastication in the rabbit

The diagastric nerve reflex response to stimulation of the upper lip was studied in urethan-anesthetized rabbits paralysed with pancuronium bromide. Rhythmic bursts of masticatory activity were evoked in the nerve by repetitive electrical stimulation of the motor cortex. The amplitude and latency of the reflex responses during fictive mastication were compared with preceding control values. When stimuli close to threshold were given, the largest and earliest responses occurred during the digastric burst. When intense stimuli were employed, the largest responses were out of phase with the burst, although the latency was still shortest when the motoneurons were rhythmically active. Since the pattern is essentially the same as that seen during normal mastication, we conclude that the cyclical modulation of reflex amplitude and latency is not the result of sensory feedback generated by the movements themselves but is instead governed by the central motor program.     

Coordinated activity of ventral tegmental neurons adapts to appetitive and aversive learning

Our understanding of how value-related information is encoded in the ventral tegmental area (VTA) is based mainly on the responses of individual putative dopamine neurons. In contrast to cortical areas, the nature of coordinated interactions between groups of VTA neurons during motivated behavior is largely unknown. These interactions can strongly affect information processing, highlighting the importance of investigating network level activity. We recorded the activity of multiple single units and local field potentials (LFP) in the VTA during a task in which rats learned to associate novel stimuli with different outcomes. We found that coordinated activity of VTA units with either putative dopamine or GABA waveforms was influenced differently by rewarding versus aversive outcomes. Specifically, after learning, stimuli paired with a rewarding outcome increased the correlation in activity levels between unit pairs whereas stimuli paired with an aversive outcome decreased the correlation. Paired single unit responses also became more redundant after learning. These response patterns flexibly tracked the reversal of contingencies, suggesting that learning is associated with changing correlations and enhanced functional connectivity between VTA neurons. Analysis of LFP recorded simultaneously with unit activity showed an increase in the power of theta oscillations when stimuli predicted reward but not an aversive outcome. With learning, a higher proportion of putative GABA units were phase locked to the theta oscillations than putative dopamine units. These patterns also adapted when task contingencies were changed. Taken together, these data demonstrate that VTA neurons organize flexibly as functional networks to support appetitive and aversive learning.     

Conditioned Sounds Enhance Visual Processing

This psychophysics study investigated whether prior auditory conditioning influences how a sound interacts with visual perception. In the conditioning phase, subjects were presented with three pure tones ( =  conditioned stimuli, CS) that were paired with positive, negative or neutral unconditioned stimuli. As unconditioned reinforcers we employed pictures (highly pleasant, unpleasant and neutral) or monetary outcomes (+50 euro cents, −50 cents, 0 cents). In the subsequent visual selective attention paradigm, subjects were presented with near-threshold Gabors displayed in their left or right hemifield. Critically, the Gabors were presented in synchrony with one of the conditioned sounds. Subjects discriminated whether the Gabors were presented in their left or right hemifields. Participants determined the location more accurately when the Gabors were presented in synchrony with positive relative to neutral sounds irrespective of reinforcer type. Thus, previously rewarded relative to neutral sounds increased the bottom-up salience of the visual Gabors. Our results are the first demonstration that prior auditory conditioning is a potent mechanism to modulate the effect of sounds on visual perception.     

On the mechanisms underlying appearance of responses to movement,directional sensitivity and velocity tuning of the cat's striate cortical neurons

The responses to moving and stationary stimuli of 27 cat's striate cortical units were studied. Two stationary light bars located in different parts of the receptive field were used. The order of presentation and the time-interval between the stimuli varied; so, the presentation of a pair of stationary stimuli was an analogue of a moving stimulus.It was shown that responses occurred in neurons previously unresponsive to stationary stimuli when two stationary stimuli were presented successively in certain order. In the direction-sensitive units an asymmetry of the temporal course of the inhibitory processes was observed. The inhibitory zone located on the side of the preferred direction of movement was characterized by an early inhibitory phase followed by a phase of disinhibition and by a second inhibitory phase. For the inhibitory zone located on the side of the null direction no disinhibitory phase was demonstrated.The significance of the spatial and temporal characteristics of the receptive field for the appearance of responses to movement, the directional sensitivity and the velocity tuning in striate neurons is discussed.     

Enhancement of taste responses to acids by calcium ions

The frog taste nerve responses to HCl and acetic acids were greatly enhanced by increasing calcium concentration in a solution to which the tongue had adapted when the lingual artery was perfused with Ringer solution. Enhancement was not seen in the responses to other taste stimuli.     

Women's pupillary responses to sexually significant others during the hormonal cycle

Women's sexual preferences can change over the hormonal cycle, as several studies, based on responses to questionnaires, diaries, and ratings of photographs, have indicated increased sexual interests around the time of ovulation. However, fewer studies have measured changes in attention or interest to sexually significant stimuli in terms of physiological responses that are not under voluntary control and measure sexual interest indirectly (i.e., without mention of sexual feelings or activities). In the present study, we indexed changes in sexual interest in terms of changes in the eye pupil's size. Pupillary diameter is known to have a proportional relation to the observer's level of interest and attention to a visual stimulus as well as to physical pleasure. Fourteen women (7 being "pill" users) viewed photos on a computer screen while their pupil diameters were recorded using an infrared eye-tracking device. Three measures were taken for each participant during three time windows that estimated the ovulatory, luteal, and menstrual phase of the cycle. We found an increase in mean pupil diameter for sexually significant stimuli during the fertile phase and this pupillary change was also specific to pictures of the participants' actual sexual partners. Moreover, this effect was only seen for women who did not use oral contraceptives. These findings confirm that women's attention for sexually significant stimuli is higher during their fertile phase of the menstrual cycle, and that changes in sexual interest are implicitly measurable using pupillometry.     

Phase reset affects auditory-visual simultaneity judgment

We continuously receive the external information from multiple sensors simultaneously. The brain must judge a source event of these sensory informations and integrate them. It is thought that judging the simultaneity of such multisensory stimuli is an important cue when we discriminate whether the stimuli are derived from one event or not. Although previous studies have investigated the correspondence between an auditory-visual (AV) simultaneity perceptions and the neural responses, there are still few studies of this. Electrophysiological studies have reported that ongoing oscillations in human cortex affect perception. Especially, the phase resetting of ongoing oscillations has been examined as it plays an important role in multisensory integration. The aim of this study was to investigate the relationship of phase resetting for the judgment of AV simultaneity judgement tasks. The subjects were successively presented with auditory and visual stimuli with intervals that were controlled as SOA_50% and they were asked to report whether they perceived them simultaneously or not. We investigated the effects of the phase of ongoing oscillations on simultaneity judgments with AV stimuli with SOAs in which the detection rate of asynchrony was 50 %. It was found that phase resetting at the beta frequency band in the brain area that related to the modality of the following stimulus occurred after preceding stimulus onset only when the subjects perceived AV stimuli as simultaneous. This result suggested that beta phase resetting occurred in areas that are related to the subsequent stimulus, supporting perception multisensory stimuli as simultaneous.     

Development of the interhemispheric response in rats.

In acute experiments on curarized rats, an interhemispheric response was observed for the first time at the age of 5 days. A stimulus of threshold intensity evoked both components of the response in the youngest animals, but only the negative phase of the evoked potential from the 9th day of age, with the initial positive phase appearing only after stimuli of high intensity. Upon using stimuli of double the value of threshold intensity, the responses had the same shape, i.e. positive-negative throughout the whole development. Marked changes in the latency of both components of the response were found during development. Up to 14 days latencies decreased rapidly; this was followed by a phase of relative stability and then, after the 19th day, by further, less pronounced decrease. An after-discharge, a late component of the response in adult animals, appeared for the first time in a mature form at 18 days. An after-discharge of a different shape was seen in young rats aged 7-14 days and none at all was observed in 5-day-old animals.     

Delay and Probability Discounting of Sexual and Monetary Outcomes in Individuals with Cocaine Use Disorders and Matched Controls

Individuals with cocaine use disorders are disproportionately affected by HIV/AIDS, partly due to higher rates of unprotected sex. Recent research suggests delay discounting of condom use is a factor in sexual HIV risk. Delay discounting is a behavioral economic concept describing how delaying an event reduces that event’s value or impact on behavior. Probability discounting is a related concept describing how the uncertainty of an event decreases its impact on behavior. Individuals with cocaine use disorders (n = 23) and matched non-cocaine-using controls (n = 24) were compared in decision-making tasks involving hypothetical outcomes: delay discounting of condom-protected sex (Sexual Delay Discounting Task), delay discounting of money, the effect of sexually transmitted infection (STI) risk on likelihood of condom use (Sexual Probability Discounting Task), and probability discounting of money. The Cocaine group discounted delayed condom-protected sex (i.e., were more likely to have unprotected sex vs. wait for a condom) significantly more than controls in two of four Sexual Delay Discounting Task partner conditions. The Cocaine group also discounted delayed money (i.e., preferred smaller immediate amounts over larger delayed amounts) significantly more than controls. In the Sexual Probability Discounting Task, both groups showed sensitivity to STI risk, however the groups did not differ. The Cocaine group did not consistently discount probabilistic money more or less than controls. Steeper discounting of delayed, but not probabilistic, sexual outcomes may contribute to greater rates of sexual HIV risk among individuals with cocaine use disorders. Probability discounting of sexual outcomes may contribute to risk of unprotected sex in both groups. Correlations showed sexual and monetary results were unrelated, for both delay and probability discounting. The results highlight the importance of studying specific behavioral processes (e.g., delay and probability discounting) with respect to specific outcomes (e.g., monetary and sexual) to understand decision making in problematic behavior.     

Individualized and clinically derived stimuli activate limbic structures in depression: an fMRI study

Objectives

In the search for neurobiological correlates of depression, a major finding is hyperactivity in limbic-paralimbic regions. However, results so far have been inconsistent, and the stimuli used are often unspecific to depression. This study explored hemodynamic responses of the brain in patients with depression while processing individualized and clinically derived stimuli.

Methods

Eighteen unmedicated patients with recurrent major depressive disorder and 17 never-depressed control subjects took part in standardized clinical interviews from which individualized formulations of core interpersonal dysfunction were derived. In the patient group such formulations reflected core themes relating to the onset and maintenance of depression. In controls, formulations reflected a major source of distress. This material was thereafter presented to subjects during functional magnetic resonance imaging (fMRI) assessment.

Results

Increased hemodynamic responses in the anterior cingulate cortex, medial frontal gyrus, fusiform gyrus and occipital lobe were observed in both patients and controls when viewing individualized stimuli. Relative to control subjects, patients with depression showed increased hemodynamic responses in limbic-paralimbic and subcortical regions (e.g. amygdala and basal ganglia) but no signal decrease in prefrontal regions.

Conclusions

This study provides the first evidence that individualized stimuli derived from standardized clinical interviewing can lead to hemodynamic responses in regions associated with self-referential and emotional processing in both groups and limbic-paralimbic and subcortical structures in individuals with depression. Although the regions with increased responses in patients have been previously reported, this study enhances the ecological value of fMRI findings by applying stimuli that are of personal relevance to each individual''s depression.     

Instrumental responding remains under the control of the consequent outcome after extended training

The effect of extensive training on the contribution of response--outcome learning to instrumental performance in rats was re-examined in two experiments using a transfer test. In each experiment, two discriminative stimuli were established as signals for different response--outcome combinations (e.g. light: nose poke-pellets and noise: handle pull-sucrose). Then, two different responses (lever press and chain pull) were concurrently trained with those outcomes. In Experiment 1, these responses underwent extensive training, each with a different outcome (e.g. lever press-pellets and chain pull-sucrose). In Experiment 2, these responses were trained moderately with one outcome (e.g. lever press-pellets and chain pull-sucrose) and extensively with a different outcome (e.g. lever press-sucrose and chain pull-pellets). Finally, transfer tests were conducted in which the discriminative stimuli, noise and light, were tested periodically with the lever and chain. In Experiment 1, the stimuli consistently and preferentially elevated performance of the response trained with the same outcome relative to that trained with a different outcome. In Experiment 2, the stimuli elevated both responses nondifferentially. However, a drive manipulation (thirst) designed to increase the value of sucrose relative to pellets revealed a significant preference for the response that had been extensively trained with sucrose. Overall, the results of these experiments confirm previous findings that instrumental behaviors do not become increasingly independent of their consequent outcomes with extended training. However, the transfer results of Experiment 2 highlight a potential limitation of the transfer test for assessing variations in the strength of R--O associations.     

Three days of novel wheel access diminishes light-induced phase delays in vivo with no effect on per1 induction by light

The mammalian circadian clock, located in the hypothalamic suprachiasmatic nuclei, synchronizes endogenous behavioral and physiological rhythms to a 24 h period through responses to two types of stimuli: photic (light) and nonphotic (behaviorally induced arousal and/or increases in activity). Photic stimuli can block nonphotic effects and vice versa, although the mechanisms and levels of interactions between these two stimuli types are unknown. Here, we investigated whether 3 d of access to a novel running wheel alters the phase shift to light in vivo, and whether this effect could be seen on induction by light of the circadian gene per1. Through measurement of running wheel activity of golden hamsters, access to a new wheel for 3 d was shown to diminish photic phase delays with no effect on phase advances. As seen using in situ hybridization, however, there was no effect on levels of light-induced per1 mRNA. This study indicates a possible role for this paradigm as a model of interactions between photic and nonphotic stimuli.     

Comparison Enhances Size Sensitivity: Neural Correlates of Outcome Magnitude Processing

Magnitude is a critical feature of outcomes. In the present study, two event-related potential (ERP) experiments were implemented to explore the neural substrates of outcome magnitude processing. In Experiment 1, we used an adapted gambling paradigm where physical area symbols were set to represent potential relative outcome magnitudes in order to exclude the possibility that the participants would be ignorant of the magnitudes. The context was manipulated as total monetary amount: ¥4 and ¥40. In these two contexts, the relative outcome magnitudes were ¥1 versus ¥3, and ¥10 versus ¥30, respectively. Experiment 2, which provided two area symbols with similar outcome magnitudes, was conducted to exclude the possible interpretation of physical area symbol for magnitude effect of feedback–related negativity (FRN) in Experiment 1. Our results showed that FRN responded to the relative outcome magnitude but not to the context or area symbol, with larger amplitudes for relatively small outcomes. A larger FRN effect (the difference between losses and wins) was found for relatively large outcomes than relatively small outcomes. Relatively large outcomes evoked greater positive ERP waves (P300) than relatively small outcomes. Furthermore, relatively large outcomes in a high amount context elicited a larger P300 than those in a low amount context. The current study indicated that FRN is sensitive to variations in magnitude. Moreover, relative magnitude was integrated in both the early and late stages of feedback processing, while the monetary amount context was processed only in the late stage of feedback processing.     

Processing of antennal information in extrinsic mushroom body neurons of the bee brain

Summary In the bee brain neural activity of interneurons of the inner antenno-cerebral tract (inputs to the mushroom body) and extrinsic neurons of the-lobe (output cells) was recorded intracellularly. The cells were stained with Lucifer Yellow. The response characteristics of the neurons to light, various antennal stimuli and mechanical stimuli to thorax and abdomen were studied.The cells of the inner antenno-cerebral tract (ACT) have uniglomerular dendritic arborizations in the antennal lobe and send projections into the calyces of the ipsilateral mushroom body and the lateral protocerebral lobe. 93% of the neurons are bi- or multimodal. No responses to light stimuli were found. Tactile stimuli to the antennae are only effective when applied ipsilaterally. Only one neuron showed marked differences in the responses to the qualitative testing of three odors: rose, lavender and isoamyl acetate.The cells can be classified according to their response characteristics; the following response types were found: (1) inhibitory responses to the stimuli, (2) inhibitory responses to olfactory and excitatory responses to mechanical stimuli or vice versa, (3) excitatory responses to mechanical and sugar water stimuli, (4) excitation to olfactory stimuli and to touching the antenna with a drop of water or sugar water, (5) excitation to mechanical stimuli to head, thorax and abdomen and inhibition to sugar water stimuli.The recorded extrinsic-lobe neurons have small dendritic bands perpendicular to the Kenyon cells, their axons project to the contralateral median protocerebrum. These cells have ipsilateral antennal and mostly ipsilateral optic inputs and process information from thoracic and abdominal mechanoreceptors. All responses are excitatory.The recordings suggest that the mushroom bodies are multimodal integration centers, where antennal information is first combined with visual inputs.Abbreviation ACT antenno-cerebral tract