Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala

Certain goal-directed behaviors depend critically upon interactions between orbitofrontal cortex (OFC) and basolateral amygdala (ABL). Here we describe direct neurophysiological evidence of this cooperative function. We recorded from OFC in intact and ABL-lesioned rats learning odor discrimination problems. As rats learned these problems, we found that lesioned rats exhibited marked changes in the information represented in OFC during odor cue sampling. Lesioned rats had fewer cue-selective neurons in OFC after learning; the cue-selective population in lesioned rats did not include neurons that were also responsive in anticipation of the predicted outcome; and the cue-activated representations that remained in lesioned rats were less associative and more often bound to cue identity. The results provide a neural substrate for representing acquired value and features of the predicted outcome during cue sampling, disruption of which could account for deficits in goal-directed behavior after damage to this system.     

Rapid associative encoding in basolateral amygdala depends on connections with orbitofrontal cortex

Certain goal-directed behaviors depend upon interactions between basolateral amygdala (ABL) and orbitofrontal cortex (OFC). Here we describe neurophysiological evidence of this cooperative function. We recorded from ABL in intact and OFC-lesioned rats during learning of odor discrimination problems and reversals. During learning, rats with ipsilateral OFC lesions exhibited a marked decline in the proportion of ABL neurons that fired differentially during cue sampling both before and after reversal and in the proportion of neurons that reversed odor preference when the odor-outcome associations were reversed. This decline appeared to reflect a loss of rapid flexibility in cue selectivity that characterized activity in intact rats. In addition, lesioned rats had fewer neurons that fired in anticipation of the predicted outcome during a delay period after responding but before outcome delivery. These findings support a role for OFC in facilitating the encoding of information about expected outcomes in ABL.     

Neural substrates of sensory-guided locomotor decisions in the rat superior colliculus

Deciding in which direction to move is a ubiquitous feature of animal behavior, but the neural substrates of locomotor choices are not well understood. The superior colliculus (SC) is a midbrain structure known to be important for controlling the direction of gaze, particularly when guided by visual or auditory cues, but which may play a more general role in behavior involving spatial orienting. To test this idea, we recorded and manipulated activity in the SC of freely moving rats performing an odor-guided spatial choice task. In this context, not only did a substantial majority of SC neurons encode choice direction during goal-directed locomotion, but many also predicted the upcoming choice and maintained selectivity for it after movement completion. Unilateral inactivation of SC activity profoundly altered spatial choices. These results indicate that the SC processes information necessary for spatial locomotion, suggesting a broad role for this structure in sensory-guided orienting and navigation.     

Representing episodes in the mammalian brain

Memory lets the past inform the present so that we can attain future goals. In many species, these abilities require the hippocampus. Recent experiments, in which memory demand was varied while overt behavior and the environment were kept constant, have revealed firing patterns of hippocampal neurons that corresponded with memory demands and predicted performance. Although the active population appeared to be 'place cells' that signalled location, it actually included cells the activity patterns of which distinguished the recent or pending history of behavior during identical actions that occurred in the same place. Different populations of hippocampal cells fired as a rat walked along the same spatial path on the way to different goals, and coded past, present and pending events. Other experiments provide converging data that neuronal activity is modulated by goal-directed behavioral episodes. Together, these firing patterns suggest a testable mechanism of episodic memory coding: that hippocampal dynamics encode a temporally extended, hierarchically organized representation of goal-directed behavior.     

Absence of Spatial Tuning in the Orbitofrontal Cortex

There is limited data in the literature to explicitly support the notion that neurons in OFC are truly action-independent in their coding. We set out to specifically test the hypothesis that OFC value-related neurons in area 13 m of the monkey do not carry information about the action required to obtain that reward – that activity in this area represents reward values in an abstract and action-independent manner. To accomplish that goal we had two monkeys select and execute saccadic eye movements to 81 locations in the visual field for three different kinds of juice rewards. Our detailed analysis of the response fields indicates that these neurons are insensitive to the amplitude or direction of the saccade required to obtain these rewards. Our data thus validate earlier proposals that neurons of 13 m in the OFC encode subjective value independent of the saccadic action required to obtain that reward.     

Humans but Not Chimpanzees Vary Face-Scanning Patterns Depending on Contexts during Action Observation

Human and nonhuman primates comprehend the actions of other individuals by detecting social cues, including others’ goal-directed motor actions and faces. However, little is known about how this information is integrated with action understanding. Here, we present the ontogenetic and evolutionary foundations of this capacity by comparing face-scanning patterns of chimpanzees and humans as they viewed goal-directed human actions within contexts that differ in whether or not the predicted goal is achieved. Human adults and children attend to the actor’s face during action sequences, and this tendency is particularly pronounced in adults when observing that the predicted goal is not achieved. Chimpanzees rarely attend to the actor’s face during the goal-directed action, regardless of whether the predicted action goal is achieved or not. These results suggest that in humans, but not chimpanzees, attention to actor’s faces conveying referential information toward the target object indicates the process of observers making inferences about the intentionality of an action. Furthermore, this remarkable predisposition to observe others’ actions by integrating the prediction of action goals and the actor’s intention is developmentally acquired.     

Directional Influence between the Human Amygdala and Orbitofrontal Cortex at the Time of Decision-Making

There is a growing consensus that the brain makes simple choices, such as choosing between an apple and an orange, by assigning value to the options under consideration, and comparing those values to make a choice. There is also a consensus that value signals computed in orbitofrontal cortex (OFC) and amygdala play a critical role in the choice process. However, the nature of the flow of information between OFC and amygdala at the time of decision is still unknown. In order to study this question, simultaneous local field potentials were recorded from OFC and amygdala in human patients while they performed a simple food choice task. Although the interaction of these circuits has been studied in animals, this study examines the effective connectivity directly in the human brain on a moment-by-moment basis. A spectral conditional Granger causality analysis was performed in order to test if the modulation of activity goes mainly from OFC-to-amygdala, from amygdala-to-OFC, or if it is bi-directional. Influence from amygdala-to-OFC was dominant prior to the revealed choice, with a small but significant OFC influence on the amygdala earlier in the trial. Alpha oscillation amplitudes analyzed with the Hilbert-Huang transform revealed differences in choice valence coincident with temporally specific amygdala influence on the OFC.     

Stimulus-Response-Outcome Coding in the Pigeon Nidopallium Caudolaterale

A prerequisite for adaptive goal-directed behavior is that animals constantly evaluate action outcomes and relate them to both their antecedent behavior and to stimuli predictive of reward or non-reward. Here, we investigate whether single neurons in the avian nidopallium caudolaterale (NCL), a multimodal associative forebrain structure and a presumed analogue of mammalian prefrontal cortex, represent information useful for goal-directed behavior. We subjected pigeons to a go-nogo task, in which responding to one visual stimulus (S+) was partially reinforced, responding to another stimulus (S–) was punished, and responding to test stimuli from the same physical dimension (spatial frequency) was inconsequential. The birds responded most intensely to S+, and their response rates decreased monotonically as stimuli became progressively dissimilar to S+; thereby, response rates provided a behavioral index of reward expectancy. We found that many NCL neurons'' responses were modulated in the stimulus discrimination phase, the outcome phase, or both. A substantial fraction of neurons increased firing for cues predicting non-reward or decreased firing for cues predicting reward. Interestingly, the same neurons also responded when reward was expected but not delivered, and could thus provide a negative reward prediction error or, alternatively, signal negative value. In addition, many cells showed motor-related response modulation. In summary, NCL neurons represent information about the reward value of specific stimuli, instrumental actions as well as action outcomes, and therefore provide signals useful for adaptive behavior in dynamically changing environments.     

Distributed coding of sound locations in the auditory cortex

Although the auditory cortex plays an important role in sound localization, that role is not well understood. In this paper, we examine the nature of spatial representation within the auditory cortex, focusing on three questions. First, are sound-source locations encoded by individual sharply tuned neurons or by activity distributed across larger neuronal populations? Second, do temporal features of neural responses carry information about sound-source location? Third, are any fields of the auditory cortex specialized for spatial processing? We present a brief review of recent work relevant to these questions along with the results of our investigations of spatial sensitivity in cat auditory cortex. Together, they strongly suggest that space is represented in a distributed manner, that response timing (notably first-spike latency) is a critical information-bearing feature of cortical responses, and that neurons in various cortical fields differ in both their degree of spatial sensitivity and their manner of spatial coding. The posterior auditory field (PAF), in particular, is well suited for the distributed coding of space and encodes sound-source locations partly by modulations of response latency. Studies of neurons recorded simultaneously from PAF and/or A1 reveal that spatial information can be decoded from the relative spike times of pairs of neurons - particularly when responses are compared between the two fields - thus partially compensating for the absence of an absolute reference to stimulus onset.     

Mantisbot is a robotic model of visually guided motion in the praying mantis

Insects use highly distributed nervous systems to process exteroception from head sensors, compare that information with state-based goals, and direct posture or locomotion toward those goals. To study how descending commands from brain centers produce coordinated, goal-directed motion in distributed nervous systems, we have constructed a conductance-based neural system for our robot MantisBot, a 29 degree-of-freedom, 13.3:1 scale praying mantis robot. Using the literature on mantis prey tracking and insect locomotion, we designed a hierarchical, distributed neural controller that establishes the goal, coordinates different joints, and executes prey-tracking motion. In our controller, brain networks perceive the location of prey and predict its future location, store this location in memory, and formulate descending commands for ballistic saccades like those seen in the animal. The descending commands are simple, indicating only 1) whether the robot should walk or stand still, and 2) the intended direction of motion. Each joint's controller uses the descending commands differently to alter sensory-motor interactions, changing the sensory pathways that coordinate the joints' central pattern generators into one cohesive motion. Experiments with one leg of MantisBot show that visual input produces simple descending commands that alter walking kinematics, change the walking direction in a predictable manner, enact reflex reversals when necessary, and can control both static posture and locomotion with the same network.     

Participation of the nucleus accumbens in acquisition of spatial choice behavior in rats performing in a radial plus maze

The role of medial shell of the nucleus accumbens in acquisition of spatial behavior was studied in rats performing choice task in radial maze with asymmetrical water reinforcement. It has been found that the nucleus accumbens lesioned rats failed in finding larger rewards but preserve their reward-seeking behavior guided by visual discriminative stimuli. The results obtained are in good agreement with suggestion that the nucleus accumbens is a site of convergence of spatial information (from hippocampus) with reward information (from amygdala and VTA), providing bridge for effective limbic-motor interface underlying motivated goal-directed behavior in animals.     

A fruit in hand is worth many more in the bush: steep spatial discounting by free-ranging rhesus macaques (Macaca mulatta)

Decision making is one of the principal cognitive processes underlying goal-directed behaviour and thus there is justifiably strong interest in modeling it. However, many of these models have yet to be tested outside of the laboratory. At the same time, field work would benefit from the use of experimental methods developed in the laboratory to determine the causal relationships between environmental variables and behaviour. We therefore adapted a laboratory-derived experimental paradigm to test decision making in the wild. The experiment used an indifference-point procedure to determine the influence of both the amount and distance of food on choice behaviour. Free-ranging rhesus monkeys were given the choice between a smaller amount of food at a closer distance and a larger amount farther away. In four conditions, we held the closer amount constant across trials and varied the farther amount to determine the point at which the monkeys were indifferent to the choice alternatives. For example, in condition one, we used one piece of food at the closer location, and determined how many pieces would be equivalent in the farther location. Four different closer amounts were tested to obtain an indifference point curve, with the indifference amounts at the farther location plotted against the closer amounts. The slope of the obtained linear indifference curve was surprisingly high, suggesting that rhesus monkeys significantly discount food that is farther away. Possible reasons for this steep spatial discounting are discussed.     

Choosing goals, not rules: deciding among rule-based action plans

In natural situations, movements are often directed toward locations different from that of the evoking sensory stimulus. Movement goals must then be inferred from the sensory cue based on rules. When there is uncertainty about the rule that applies for a given cue, planning a movement involves both choosing the relevant rule and computing the movement goal based on that rule. Under these conditions, it is not clear whether primates compute multiple movement goals based on all possible rules before choosing an action, or whether they first choose a rule and then only represent the movement goal associated with that rule. Supporting the former hypothesis, we show that neurons in the frontoparietal reach areas of monkeys simultaneously represent two different rule-based movement goals, which are biased by the monkeys' choice preferences. Apparently, primates choose between multiple behavioral options by weighing against each other the movement goals associated with each option.     

Making Smart Social Judgments Takes Time: Infants' Recruitment of Goal Information When Generating Action Predictions

Previous research has shown that young infants perceive others'' actions as structured by goals. One open question is whether the recruitment of this understanding when predicting others'' actions imposes a cognitive challenge for young infants. The current study explored infants'' ability to utilize their knowledge of others'' goals to rapidly predict future behavior in complex social environments and distinguish goal-directed actions from other kinds of movements. Fifteen-month-olds (N = 40) viewed videos of an actor engaged in either a goal-directed (grasping) or an ambiguous (brushing the back of her hand) action on a Tobii eye-tracker. At test, critical elements of the scene were changed and infants'' predictive fixations were examined to determine whether they relied on goal information to anticipate the actor''s future behavior. Results revealed that infants reliably generated goal-based visual predictions for the grasping action, but not for the back-of-hand behavior. Moreover, response latencies were longer for goal-based predictions than for location-based predictions, suggesting that goal-based predictions are cognitively taxing. Analyses of areas of interest indicated that heightened attention to the overall scene, as opposed to specific patterns of attention, was the critical indicator of successful judgments regarding an actor''s future goal-directed behavior. These findings shed light on the processes that support “smart” social behavior in infants, as it may be a challenge for young infants to use information about others'' intentions to inform rapid predictions.     

Encoding goals but not abstract magnitude in the primate prefrontal cortex

Functional neuroimaging studies show that perceptual judgments about time and space activate similar prefrontal and parietal areas, and it is known that perceptions in these two cognitive domains interfere with each other. These findings have led to the theory that temporal and spatial perceptions, among other metrics, draw on a common representation of magnitude. Our results indicate that an alternative principle applies to the prefrontal cortex. Analysis at the single-cell level shows that separate, domain-specific populations of neurons encode relative magnitude in time and space. These neurons are intermixed with each other in the prefrontal cortex, along with a separate intermixed population that encodes the goal chosen on the basis of these perceptual decisions. As a result, domain-specific neural processing at the single-cell level seems to underlie domain generality as observed at the regional level, with a common representation of prospective goals rather than a common representation of magnitude.     

A functional difference in information processing between orbitofrontal cortex and ventral striatum during decision-making behaviour

Both orbitofrontal cortex (OFC) and ventral striatum (vStr) have been identified as key structures that represent information about value in decision-making tasks. However, the dynamics of how this information is processed are not yet understood. We recorded ensembles of cells from OFC and vStr in rats engaged in the spatial adjusting delay-discounting task, a decision-making task that involves a trade-off between delay to and magnitude of reward. Ventral striatal neural activity signalled information about reward before the rat''s decision, whereas such reward-related signals were absent in OFC until after the animal had committed to its decision. These data support models in which vStr is directly involved in action selection, but OFC processes decision-related information afterwards that can be used to compare the predicted and actual consequences of behaviour.     

Competing sound sources reveal spatial effects in cortical processing

Why is spatial tuning in auditory cortex weak, even though location is important to object recognition in natural settings? This question continues to vex neuroscientists focused on linking physiological results to auditory perception. Here we show that the spatial locations of simultaneous, competing sound sources dramatically influence how well neural spike trains recorded from the zebra finch field L (an analog of mammalian primary auditory cortex) encode source identity. We find that the location of a birdsong played in quiet has little effect on the fidelity of the neural encoding of the song. However, when the song is presented along with a masker, spatial effects are pronounced. For each spatial configuration, a subset of neurons encodes song identity more robustly than others. As a result, competing sources from different locations dominate responses of different neural subpopulations, helping to separate neural responses into independent representations. These results help elucidate how cortical processing exploits spatial information to provide a substrate for selective spatial auditory attention.     

The influence of recent decisions on future goal selection

Recent decisions about actions and goals can have effects on future choices. Several studies have shown an effect of the previous trial history on neural activity in a subsequent trial. Often, but not always, these effects originate from task requirements that make it necessary to maintain access to previous trial information to make future decisions. Maintaining the information about recent decisions and their outcomes can play an important role in both adapting to new contingencies and learning. Previous goal decisions must be distinguished from goals that are currently being planned to avoid perseveration or more general errors. Output monitoring is probably based on this separation of accomplished past goals from pending future goals that are being pursued. Behaviourally, it has been shown that the history context can influence the location, error rate and latency of successive responses. We will review the neurophysiological studies in the literature, including data from our laboratory, which support a role for the frontal lobe in tracking previous goal selections and outputs when new goals need to be accomplished.     

Orbitofrontal cortex, associative learning, and expectancies

Orbitofrontal cortex is characterized by its unique pattern of connections with subcortical areas, such as basolateral amygdala. Here we distinguish between the critical role of these areas in associative learning and the pivotal contribution of OFC to the manipulation of this information to control behavior. This contribution reflects the ability of OFC to signal the desirability of expected outcomes, which requires the integration of associative information with information concerning internal states and goals in representational memory.     

Neuronal representations of stimuli in the mouth: the primate insular taste cortex, orbitofrontal cortex and amygdala

The responses of 3687 neurons in the macaque primary taste cortex in the insula/frontal operculum, orbitofrontal cortex (OFC) and amygdala to oral sensory stimuli reveals principles of representation in these areas. Information about the taste, texture of what is in the mouth (viscosity, fat texture and grittiness, which reflect somatosensory inputs), temperature and capsaicin is represented in all three areas. In the primary taste cortex, taste and viscosity are more likely to activate different neurons, with more convergence onto single neurons particularly in the OFC and amygdala. The different responses of different OFC neurons to different combinations of these oral sensory stimuli potentially provides a basis for different behavioral responses. Consistently, the mean correlations between the representations of the different stimuli provided by the population of OFC neurons were lower (0.71) than for the insula (0.81) and amygdala (0.89). Further, the encoding was more sparse in the OFC (0.67) than in the insula (0.74) and amygdala (0.79). The insular neurons did not respond to olfactory and visual stimuli, with convergence occurring in the OFC and amygdala. Human psychophysics showed that the sensory spaces revealed by multidimensional scaling were similar to those provided by the neurons.