Reduction of Pavlovian Bias in Schizophrenia: Enhanced Effects in Clozapine-Administered Patients

The negative symptoms of schizophrenia (SZ) are associated with a pattern of reinforcement learning (RL) deficits likely related to degraded representations of reward values. However, the RL tasks used to date have required active responses to both reward and punishing stimuli. Pavlovian biases have been shown to affect performance on these tasks through invigoration of action to reward and inhibition of action to punishment, and may be partially responsible for the effects found in patients. Forty-five patients with schizophrenia and 30 demographically-matched controls completed a four-stimulus reinforcement learning task that crossed action (“Go” or “NoGo”) and the valence of the optimal outcome (reward or punishment-avoidance), such that all combinations of action and outcome valence were tested. Behaviour was modelled using a six-parameter RL model and EEG was simultaneously recorded. Patients demonstrated a reduction in Pavlovian performance bias that was evident in a reduced Go bias across the full group. In a subset of patients administered clozapine, the reduction in Pavlovian bias was enhanced. The reduction in Pavlovian bias in SZ patients was accompanied by feedback processing differences at the time of the P3a component. The reduced Pavlovian bias in patients is suggested to be due to reduced fidelity in the communication between striatal regions and frontal cortex. It may also partially account for previous findings of poorer “Go-learning” in schizophrenia where “Go” responses or Pavlovian consistent responses are required for optimal performance. An attenuated P3a component dynamic in patients is consistent with a view that deficits in operant learning are due to impairments in adaptively using feedback to update representations of stimulus value.     

Relapse processes after the extinction of instrumental learning: renewal, resurgence, and reacquisition

It is widely recognized that extinction (the procedure in which a Pavlovian conditioned stimulus or an instrumental action is repeatedly presented without its reinforcer) weakens behavior without erasing the original learning. Most of the experiments that support this claim have focused on several "relapse" effects that occur after Pavlovian extinction, which collectively suggest that the original learning is saved through extinction. However, although such effects do occur after instrumental extinction, they have not been explored there in as much detail. This article reviews recent research in our laboratory that has investigated three relapse effects that occur after the extinction of instrumental (operant) learning. In renewal, responding returns after extinction when the behavior is tested in a different context; in resurgence, responding recovers when a second response that has been reinforced during extinction of the first is itself put on extinction; and in rapid reacquisition, extinguished responding returns rapidly when the response is reinforced again. The results provide new insights into extinction and relapse, and are consistent with principles that have been developed to explain extinction and relapse as they occur after Pavlovian conditioning. Extinction of instrumental learning, like Pavlovian learning, involves new learning that is relatively dependent on the context for expression.     

Dual Reward Prediction Components Yield Pavlovian Sign- and Goal-Tracking

Reinforcement learning (RL) has become a dominant paradigm for understanding animal behaviors and neural correlates of decision-making, in part because of its ability to explain Pavlovian conditioned behaviors and the role of midbrain dopamine activity as reward prediction error (RPE). However, recent experimental findings indicate that dopamine activity, contrary to the RL hypothesis, may not signal RPE and differs based on the type of Pavlovian response (e.g. sign- and goal-tracking responses). In this study, we address this discrepancy by introducing a new neural correlate for learning reward predictions; the correlate is called “cue-evoked reward”. It refers to a recall of reward evoked by the cue that is learned through simple cue-reward associations. We introduce a temporal difference learning model, in which neural correlates of the cue itself and cue-evoked reward underlie learning of reward predictions. The animal''s reward prediction supported by these two correlates is divided into sign and goal components respectively. We relate the sign and goal components to approach responses towards the cue (i.e. sign-tracking) and the food-tray (i.e. goal-tracking) respectively. We found a number of correspondences between simulated models and the experimental findings (i.e. behavior and neural responses). First, the development of modeled responses is consistent with those observed in the experimental task. Second, the model''s RPEs were similar to dopamine activity in respective response groups. Finally, goal-tracking, but not sign-tracking, responses rapidly emerged when RPE was restored in the simulated models, similar to experiments with recovery from dopamine-antagonist. These results suggest two complementary neural correlates, corresponding to the cue and its evoked reward, form the basis for learning reward predictions in the sign- and goal-tracking rats.     

Discrimination of Complex Human Behavior by Pigeons (Columba livia) and Humans

The cognitive and neural mechanisms for recognizing and categorizing behavior are not well understood in non-human animals. In the current experiments, pigeons and humans learned to categorize two non-repeating, complex human behaviors (“martial arts” vs. “Indian dance”). Using multiple video exemplars of a digital human model, pigeons discriminated these behaviors in a go/no-go task and humans in a choice task. Experiment 1 found that pigeons already experienced with discriminating the locomotive actions of digital animals acquired the discrimination more rapidly when action information was available than when only pose information was available. Experiments 2 and 3 found this same dynamic superiority effect with naïve pigeons and human participants. Both species used the same combination of immediately available static pose information and more slowly perceived dynamic action cues to discriminate the behavioral categories. Theories based on generalized visual mechanisms, as opposed to embodied, species-specific action networks, offer a parsimonious account of how these different animals recognize behavior across and within species.     

Electrophysiological Responses to Alcohol Cues Are Not Associated with Pavlovian-to-Instrumental Transfer in Social Drinkers

Pavlovian to Instrumental Transfer (PIT) refers to the behavioral phenomenon of increased instrumental responding for a reinforcer when in the presence of Pavlovian conditioned stimuli that were separately paired with that reinforcer. PIT effects may play an important role in substance use disorders, but little is known about the brain mechanisms that underlie these effects in alcohol consumers. We report behavioral and electroencephalographic (EEG) data from a group of social drinkers (n = 31) who performed a PIT task in which they chose between two instrumental responses in pursuit of beer and chocolate reinforcers while their EEG reactivity to beer, chocolate and neutral pictorial cues was recorded. We examined two markers of the motivational salience of the pictures: the P300 and slow wave event-related potentials (ERPs). Results demonstrated a behavioral PIT effect: responding for beer was increased when a beer picture was presented. Analyses of ERP amplitudes demonstrated significantly larger slow potentials evoked by beer cues at various electrode clusters. Contrary to hypotheses, there were no significant correlations between behavioral PIT effects, electrophysiological reactivity to the cues, and individual differences in drinking behaviour. Our findings are the first to demonstrate a PIT effect for beer, accompanied by increased slow potentials in response to beer cues, in social drinkers. The lack of relationship between behavioral and EEG measures, and between these measures and individual differences in drinking behaviour may be attributed to methodological features of the PIT task and to characteristics of our sample.     

Neurocomputational mechanism of controllability inference under a multi-agent setting

Controllability perception significantly influences motivated behavior and emotion and requires an estimation of one’s influence on an environment. Previous studies have shown that an agent can infer controllability by observing contingency between one’s own action and outcome if there are no other outcome-relevant agents in an environment. However, if there are multiple agents who can influence the outcome, estimation of one’s genuine controllability requires exclusion of other agents’ possible influence. Here, we first investigated a computational and neural mechanism of controllability inference in a multi-agent setting. Our novel multi-agent Bayesian controllability inference model showed that other people’s action-outcome contingency information is integrated with one’s own action-outcome contingency to infer controllability, which can be explained as a Bayesian inference. Model-based functional MRI analyses showed that multi-agent Bayesian controllability inference recruits the temporoparietal junction (TPJ) and striatum. Then, this inferred controllability information was leveraged to increase motivated behavior in the vmPFC. These results generalize the previously known role of the striatum and vmPFC in single-agent controllability to multi-agent controllability, and this generalized role requires the TPJ in addition to the striatum of single-agent controllability to integrate both self- and other-related information. Finally, we identified an innate positive bias toward the self during the multi-agent controllability inference, which facilitated behavioral adaptation under volatile controllability. Furthermore, low positive bias and high negative bias were associated with increased daily feelings of guilt. Our results provide a mechanism of how our sense of controllability fluctuates due to other people in our lives, which might be related to social learned helplessness and depression.     

Quantifying individual variation in the propensity to attribute incentive salience to reward cues

If reward-associated cues acquire the properties of incentive stimuli they can come to powerfully control behavior, and potentially promote maladaptive behavior. Pavlovian incentive stimuli are defined as stimuli that have three fundamental properties: they are attractive, they are themselves desired, and they can spur instrumental actions. We have found, however, that there is considerable individual variation in the extent to which animals attribute Pavlovian incentive motivational properties ("incentive salience") to reward cues. The purpose of this paper was to develop criteria for identifying and classifying individuals based on their propensity to attribute incentive salience to reward cues. To do this, we conducted a meta-analysis of a large sample of rats (N = 1,878) subjected to a classic Pavlovian conditioning procedure. We then used the propensity of animals to approach a cue predictive of reward (one index of the extent to which the cue was attributed with incentive salience), to characterize two behavioral phenotypes in this population: animals that approached the cue ("sign-trackers") vs. others that approached the location of reward delivery ("goal-trackers"). This variation in Pavlovian approach behavior predicted other behavioral indices of the propensity to attribute incentive salience to reward cues. Thus, the procedures reported here should be useful for making comparisons across studies and for assessing individual variation in incentive salience attribution in small samples of the population, or even for classifying single animals.     

Dimensions of Temperament Modulate Cue-Controlled Behavior: A Study on Pavlovian to Instrumental Transfer in Horses (Equus Caballus)

Pavlovian to instrumental transfer (PIT) is a central factor in how cues influence animal behavior. PIT refers to the capacity of a Pavlovian cue that predicts a reward to elicit or increase a response intended to obtain the same reward. In the present study, using an equine model, we assessed whether PIT occurs in hoofed domestic animals and whether its efficacy can be modulated by temperamental dimensions. To study PIT, horses were submitted to Pavlovian conditioning whereby an auditory–visual stimulus was repeatedly followed by food delivery. Then, horses were submitted to instrumental conditioning during which they learned to touch with their noses an object signaled by the experimenter in order to obtain the same reward. During the PIT test, the Pavlovian conditioned stimulus was presented to the animal in the absence of reward. At the end of the experiment, a battery of behavioral tests was performed on all animals to assess five temperamental dimensions and investigate their relationships with instrumental performance. The results indicate that PIT can be observed in horses and that its efficacy is greatly modulated by individual temperament. Indeed, individuals with a specific pattern of temperamental dimensions (i.e., higher levels of gregariousness, fearfulness, and sensory sensitivity) exhibited the strongest PIT. The demonstration of the existence of PIT in domesticated animals (i.e., horses) is important for the optimization of its use by humans and the improvement of training methods. Moreover, because PIT may be implicated in psychological phenomena, including addictive behaviors, the observation of relationships between specific temperamental dimensions and PIT efficacy may aid in identifying predisposing temperamental attributes.     

Gaze in Visual Search Is Guided More Efficiently by Positive Cues than by Negative Cues

Visual search can be accelerated when properties of the target are known. Such knowledge allows the searcher to direct attention to items sharing these properties. Recent work indicates that information about properties of non-targets (i.e., negative cues) can also guide search. In the present study, we examine whether negative cues lead to different search behavior compared to positive cues. We asked observers to search for a target defined by a certain shape singleton (broken line among solid lines). Each line was embedded in a colored disk. In “positive cue” blocks, participants were informed about possible colors of the target item. In “negative cue” blocks, the participants were informed about colors that could not contain the target. Search displays were designed such that with both the positive and negative cues, the same number of items could potentially contain the broken line (“relevant items”). Thus, both cues were equally informative. We measured response times and eye movements. Participants exhibited longer response times when provided with negative cues compared to positive cues. Although negative cues did guide the eyes to relevant items, there were marked differences in eye movements. Negative cues resulted in smaller proportions of fixations on relevant items, longer duration of fixations and in higher rates of fixations per item as compared to positive cues. The effectiveness of both cue types, as measured by fixations on relevant items, increased over the course of each search. In sum, a negative color cue can guide attention to relevant items, but it is less efficient than a positive cue of the same informational value.     

Spontaneous Behaviors and Wall-Curvature Lead to Apparent Wall Preference in Planarian

The planarian Dugesia japonica tends to stay near the walls of its breeding containers and experimental dishes in the laboratory, a phenomenon called “wall preference”. This behavior is thought to be important for environmental adaptation, such as hiding by planarians in nature. However, the mechanisms regulating wall-preference behavior are not well understood, since this behavior occurs in the absence of any particular stimulation. Here we show the mechanisms of wall-preference behavior. Surprisingly, planarian wall-preference behavior was also shown even by the head alone and by headless planarians. These results indicate that planarian “wall-preference” behavior only appears to be a “preference” behavior, and is actually an outcome of spontaneous behaviors, rather than of brain function. We found that in the absence of environmental cues planarians moved basically straight ahead until they reached a wall, and that after reaching a wall, they changed their direction of movement to one tangential to the wall, suggesting that this spontaneous behavior may play a critical role in the wall preference. When we tested another spontaneous behavior, the wigwag movement of the planarian head, using computer simulation with various wigwag angles and wigwag intervals, large wigwag angle and short wigwag interval reduced wall-preference behavior. This indicated that wigwag movement may determine the probability of staying near the wall or leaving the wall. Furthermore, in accord with this simulation, when we tested planarian wall-preference behavior using several assay fields with different curvature of the wall, we found that concavity and sharp curvature of walls negatively impacted wall preference by affecting the permissible angle of the wigwag movement. Together, these results indicate that planarian wall preference may be involuntarily caused by the combination of two spontaneous planarian behaviors: moving straight ahead until reaching a wall and then moving along it in the absence of environmental cues, and wigwag movements of the head.     

Effects of Edge Directions on the Structural Controllability of Complex Networks

Recent advances indicate that assigning or reversing edge direction can significantly improve the structural controllability of complex networks. For directed networks, approaching the optimal structural controllability can be achieved by detecting and reversing certain “inappropriate” edge directions. However, the existence of multiple sets of “inappropriate” edge directions suggests that different edges have different effects on optimal controllability—that is, different combinations of edges can be reversed to achieve the same structural controllability. Therefore, we classify edges into three categories based on their direction: critical, redundant and intermittent. We then investigate the effects of changing these edge directions on network controllability, and demonstrate that the existence of more critical edge directions implies not only a lower cost of modifying inappropriate edges but also better controllability. Motivated by this finding, we present a simple edge orientation method aimed at producing more critical edge directions—utilizing only local information—which achieves near optimal controllability. Furthermore, we explore the effects of edge direction on the controllability of several real networks.     

Nucleus accumbens corticotropin-releasing factor increases cue-triggered motivation for sucrose reward: paradoxical positive incentive effects in stress?

Background

Corticotropin-releasing factor (CRF) is typically considered to mediate aversive aspects of stress, fear and anxiety. However, CRF release in the brain is also elicited by natural rewards and incentive cues, raising the possibility that some CRF systems in the brain mediate an independent function of positive incentive motivation, such as amplifying incentive salience. Here we asked whether activation of a limbic CRF subsystem magnifies the increase in positive motivation for reward elicited by incentive cues previously associated with that reward, in a way that might exacerbate cue-triggered binge pursuit of food or other incentives? We assessed the impact of CRF microinjections into the medial shell of nucleus accumbens using a pure incentive version of Pavlovian-Instrumental transfer, a measure specifically sensitive to the incentive salience of reward cues (which it separates from influences of aversive stress, stress reduction, frustration and other traditional explanations for stress-increased behavior). Rats were first trained to press one of two levers to obtain sucrose pellets, and then separately conditioned to associate a Pavlovian cue with free sucrose pellets. On test days, rats received microinjections of vehicle, CRF (250 or 500 ng/0.2 μl) or amphetamine (20 μg/0.2 μl). Lever pressing was assessed in the presence or absence of the Pavlovian cues during a half-hour test.

Results

Microinjections of the highest dose of CRF (500 ng) or amphetamine (20 μg) selectively enhanced the ability of Pavlovian reward cues to trigger phasic peaks of increased instrumental performance for a sucrose reward, each peak lasting a minute or so before decaying after the cue. Lever pressing was not enhanced by CRF microinjections in the baseline absence of the Pavlovian cue or during the presentation without a cue, showing that the CRF enhancement could not be explained as a result of generalized motor arousal, frustration or stress, or by persistent attempts to ameliorate aversive states.

Conclusion

We conclude that CRF in nucleus accumbens shell amplifies positive motivation for cued rewards, in particular by magnifying incentive salience that is attributed to Pavlovian cues previously associated with those rewards. CRF-induced magnification of incentive salience provides a novel explanation as to why stress may produce cue-triggered bursts of binge eating, drug addiction relapse, or other excessive pursuits of rewards.     

The Importance of Demonstratively Restoring Order

Contrary to what is often assumed, order is not the strongest context for encouraging normative behavior. The strongest context effect on normative behavior comes from cues that clearly convey other people’s respect for norms. Ironically, this show of respect necessitates some contrasting disrespect that is being restored. Using civic virtues (such as helping behavior) as a prototype of normative behavior, the three field experiments described in this paper reveal the impact of normative cues on civic virtues. Results show that the strongest effect on making people follow prosocial norms in public places emanates from seeing order being restored, rather than just order being present. The robust and surprisingly large effects show that observing other people’s respect for one particular norm (as evidenced in their restoring physical order) makes it more likely that the onlooker follows other norms as well. This implies that prosocial behavior has the highest chance of spreading when people observe order being restored. There are clear policy implications: create low cost “normative respect cues” wherever it is desirable to increase conformity to norms.     

Kamin Blocking Is Associated with Reduced Medial-Frontal Gyrus Activation: Implications for Prediction Error Abnormality in Schizophrenia

The following study used 3-T functional magnetic resonance imaging (fMRI) to investigate the neural signature of Kamin blocking. Kamin blocking is an associative learning phenomenon seen where prior association of a stimulus (A) with an outcome blocks subsequent learning to an added stimulus (B) when both stimuli are later presented together (AB) with the same outcome. While there are a number of theoretical explanations of Kamin blocking, it is widely considered to exemplify the use of prediction error in learning, where learning occurs in proportion to the difference between expectation and outcome. In Kamin blocking as stimulus A fully predicts the outcome no prediction error is generated by the addition of stimulus B to form the compound stimulus AB, hence learning about it is “blocked”. Kamin blocking is disrupted in people with schizophrenia, their relatives and healthy individuals with high psychometrically-defined schizotypy. This disruption supports suggestions that abnormal prediction error is a core deficit that can help to explain the symptoms of schizophrenia. The present study tested 9 healthy volunteers on an f-MRI adaptation of Oades'' “mouse in the house task”, the only task measuring Kamin blocking that shows disruption in schizophrenia patients that has been independently replicated. Participant''s Kamin blocking scores were found to inversely correlate with Kamin-blocking-related activation within the prefrontal cortex, specifically the medial frontal gyrus. The medial frontal gyrus has been associated with the psychological construct of uncertainty, which we suggest is consistent with disrupted Kamin blocking and demonstrated in people with schizophrenia. These data suggest that the medial frontal gyrus merits further investigation as a potential locus of reduced Kamin blocking and abnormal prediction error in schizophrenia.     

Repeated Cocaine Exposure Facilitates the Expression of Incentive Motivation and Induces Habitual Control in Rats

There is growing evidence that mere exposure to drugs can induce long-term alterations in the neural systems that mediate reward processing, motivation, and behavioral control, potentially causing the pathological pursuit of drugs that characterizes the addicted state. The incentive sensitization theory proposes that drug exposure potentiates the influence of reward-paired cues on behavior. It has also been suggested that drug exposure biases action selection towards the automatic execution of habits and away from more deliberate goal-directed control. The current study investigated whether rats given repeated exposure to peripherally administered cocaine would show alterations in incentive motivation (assayed using the Pavlovian-to-instrumental transfer (PIT) paradigm) or habit formation (assayed using sensitivity to reward devaluation). After instrumental and Pavlovian training for food pellet rewards, rats were given 6 daily injections of cocaine (15 mg/kg, IP) or saline, followed by a 10-d period of rest. Consistent with the incentive sensitization theory, cocaine-treated rats showed stronger cue-evoked lever pressing than saline-treated rats during the PIT test. The same rats were then trained on a new instrumental action with a new food pellet reward before undergoing a reward devaluation testing. Although saline-treated rats exhibited sensitivity to reward devaluation, indicative of goal-directed performance, cocaine-treated rats were insensitive to this treatment, suggesting a reliance on habitual processes. These findings, when taken together, indicate that repeated exposure to cocaine can cause broad alterations in behavioral control, spanning both motivational and action selection processes, and could therefore help explain aberrations of decision-making that underlie drug addiction.     

Beauty Matters: Social Preferences in a Three-Person Ultimatum Game

Preference for beauty is human nature, as previous behavior studies have supported the notion of “beauty premium” in which attractive people were more easily to get promoted and receive higher salaries. In the present study, 29 males were recruited to participate in a three-person ultimatum game (UG) including a proposer, a responder and a powerless third player. Each subject, playing as the responder, had to decide whether to accept an offer from the allocator both for himself and a female third person. We aimed to elucidate how the facial attractiveness of the female subject affected the male subjects’ fairness and decision-making in social exchanges. Frontal feedback-related negativity (FRN) in response to four offers in an attractive-face condition revealed no significant differences between offers; however, when the companion was an unattractive female, an “unfair/fair” offer, which assigned a lower share to the responder and a fair share to the third player, elicited the largest FRN. Furthermore, when the third player was offered the smallest amount (“fair/unfair” offer), a larger FRN was generated in an attractive-face condition than unattractive-face condition. In the “unfair/fair” offer condition in which subjects received a smaller allocation than the third person, the beauty of their female counterparts attenuated subjects’ aversion to inequality, resulting in a less negative FRN in the frontal region and an increased acceptance ratio. However, the influence of the third player’s facial attractiveness only affected the early evaluation stage: late P300 was found to be immune to the “beauty premium”. Under the two face conditions, P300 was smallest following an “unfair/fair” offer, whereas the amplitudes in the other three offer conditions exhibited no significant differences. In addition, the differentiated neural features of processing facial attractiveness were also determined and indexed by four event-related potentials (ERP) components: N170, frontal N1, N2 and late positive potentials (LPPs).     

Nucleosome Remodeling and Epigenetics

Eukaryotic chromatin is kept flexible and dynamic to respond to environmental, metabolic, and developmental cues through the action of a family of so-called “nucleosome remodeling” ATPases. Consistent with their helicase ancestry, these enzymes experience conformation changes as they bind and hydrolyze ATP. At the same time they interact with DNA and histones, which alters histone–DNA interactions in target nucleosomes. Their action may lead to complete or partial disassembly of nucleosomes, the exchange of histones for variants, the assembly of nucleosomes, or the movement of histone octamers on DNA. “Remodeling” may render DNA sequences accessible to interacting proteins or, conversely, promote packing into tightly folded structures. Remodeling processes participate in every aspect of genome function. Remodeling activities are commonly integrated with other mechanisms such as histone modifications or RNA metabolism to assemble stable, epigenetic states.     

A Neural Model of Auditory Space Compatible with Human Perception under Simulated Echoic Conditions

In a typical auditory scene, sounds from different sources and reflective surfaces summate in the ears, causing spatial cues to fluctuate. Prevailing hypotheses of how spatial locations may be encoded and represented across auditory neurons generally disregard these fluctuations and must therefore invoke additional mechanisms for detecting and representing them. Here, we consider a different hypothesis in which spatial perception corresponds to an intermediate or sub-maximal firing probability across spatially selective neurons within each hemisphere. The precedence or Haas effect presents an ideal opportunity for examining this hypothesis, since the temporal superposition of an acoustical reflection with sounds arriving directly from a source can cause otherwise stable cues to fluctuate. Our findings suggest that subjects’ experiences may simply reflect the spatial cues that momentarily arise under various acoustical conditions and how these cues are represented. We further suggest that auditory objects may acquire “edges” under conditions when interaural time differences are broadly distributed.     

Stimulus-Response-Outcome Coding in the Pigeon Nidopallium Caudolaterale

A prerequisite for adaptive goal-directed behavior is that animals constantly evaluate action outcomes and relate them to both their antecedent behavior and to stimuli predictive of reward or non-reward. Here, we investigate whether single neurons in the avian nidopallium caudolaterale (NCL), a multimodal associative forebrain structure and a presumed analogue of mammalian prefrontal cortex, represent information useful for goal-directed behavior. We subjected pigeons to a go-nogo task, in which responding to one visual stimulus (S+) was partially reinforced, responding to another stimulus (S–) was punished, and responding to test stimuli from the same physical dimension (spatial frequency) was inconsequential. The birds responded most intensely to S+, and their response rates decreased monotonically as stimuli became progressively dissimilar to S+; thereby, response rates provided a behavioral index of reward expectancy. We found that many NCL neurons'' responses were modulated in the stimulus discrimination phase, the outcome phase, or both. A substantial fraction of neurons increased firing for cues predicting non-reward or decreased firing for cues predicting reward. Interestingly, the same neurons also responded when reward was expected but not delivered, and could thus provide a negative reward prediction error or, alternatively, signal negative value. In addition, many cells showed motor-related response modulation. In summary, NCL neurons represent information about the reward value of specific stimuli, instrumental actions as well as action outcomes, and therefore provide signals useful for adaptive behavior in dynamically changing environments.