Neural mechanisms and computations underlying stress effects on learning and memory

Stress has complex effects on memory function that can vary depending on the type of information that is learned and in relation to inter-individual characteristics. Recent work has also shown that stress can switch performance between memory systems, biasing it toward habit in detriment of spatial or goal-directed strategies. In addition, novel synaptic mechanisms have been implicated in the effects of stress in plasticity and memory. Computational modeling is emerging as a useful approach to integrate and to ascertain neural and cognitive computations underlying different effects of stress in memory. Having provided novel explanations for the inverted-U-shaped relationship between stress and cognitive performance, model-based analysis studies can improve our understanding of diverse effects of stress in cognition and psychopathology.     

Neural and psychological mechanisms underlying appetitive learning: links to drug addiction

The complexity of drug addiction mirrors the complexity of the psychological processes that motivate animals to work for any reinforcer, be it a natural reward or a drug. Here, we review the role of the nucleus accumbens, together with its dopaminergic and cortical innervation, in responding to reinforcement. One important contribution made by the nucleus accumbens is to the process through which neutral stimuli, once paired with a reinforcer such as a drug, have the capacity to motivate behaviour. This process may be one of several contributing to addiction, and it may be amenable to pharmacological intervention.     

The neurobiology of social decision-making

Humans live in highly complex social environments and some of our most important decisions are made in the context of social interactions. Research that probes the neural basis of decision-making in the context of social interactions combines behavioral paradigms from game theory with a variety of methods from neuroscience. The neural correlates of decision making in reciprocal exchange and bargaining games have been probed with functional neuroimaging, transcranial magnetic stimulation, and pharmacological manipulations. These studies have begun to elucidate a set of brain regions and neurotransmitter systems involved in decision-making in social interactions.     

Frontal cortex and reward-guided learning and decision-making

Reward-guided decision-making and learning depends on distributed neural circuits with many components. Here we focus on recent evidence that suggests four frontal lobe regions make distinct contributions to reward-guided learning and decision-making: the lateral orbitofrontal cortex, the ventromedial prefrontal cortex and adjacent medial orbitofrontal cortex, anterior cingulate cortex, and the anterior lateral prefrontal cortex. We attempt to identify common themes in experiments with human participants and with animal models, which suggest roles that the areas play in learning about reward associations, selecting reward goals, choosing actions to obtain reward, and monitoring the potential value of switching to alternative courses of action.     

Neural mechanisms of learning: an analysis of imprinting in the domestic chick

Learning is a complex set of processes involving the acquisition and storage of information. Imprinting in the domestic chick was studied to analyse the neural basis of storage. The recently hatched chick learns the characteristics of a visually conspicuous object by being exposed to it. When a chick is trained in this way, biochemical changes can be detected in the dorsal part of the forebrain. Through a series of experiments it was shown that these changes are unlikely to be non-specific consequences of training, but more probably reflect some aspect of the storage process. By using a radioautographic technique to localize the brain region more precisely, part of the hyperstriatum ventrale was implicated in this process. Bilateral destruction of the region before imprinting prevented acquisition, and bilateral destruction after imprinting impaired retention. After exposure for 140 min to an imprinting stimulus there was an increase in the area of contact between presynaptic and postsynaptic elements in the region. This effect was found on the left side only. Sequential lesions to left and right sides confirmed that there is a hemispheric asymmetry in the role of the region in the storage of information. The area receives input from the visual pathways and possibly from other sensory pathways, and projects to regions that are thought to be involved in the control of locomotor and viscero-endocrine functions. The results afford an opportunity for the further analysis both of storage and of the whole set of neural processes that underlie imprinting in the domestic chick.U     

Neural mechanisms of human perceptual learning: electrophysiological evidence for a two-stage process

Background

Humans and other animals change the way they perceive the world due to experience. This process has been labeled as perceptual learning, and implies that adult nervous systems can adaptively modify the way in which they process sensory stimulation. However, the mechanisms by which the brain modifies this capacity have not been sufficiently analyzed.

Methodology/Principal Findings

We studied the neural mechanisms of human perceptual learning by combining electroencephalographic (EEG) recordings of brain activity and the assessment of psychophysical performance during training in a visual search task. All participants improved their perceptual performance as reflected by an increase in sensitivity (d'') and a decrease in reaction time. The EEG signal was acquired throughout the entire experiment revealing amplitude increments, specific and unspecific to the trained stimulus, in event-related potential (ERP) components N2pc and P3 respectively. P3 unspecific modification can be related to context or task-based learning, while N2pc may be reflecting a more specific attentional-related boosting of target detection. Moreover, bell and U-shaped profiles of oscillatory brain activity in gamma (30–60 Hz) and alpha (8–14 Hz) frequency bands may suggest the existence of two phases for learning acquisition, which can be understood as distinctive optimization mechanisms in stimulus processing.

Conclusions/Significance

We conclude that there are reorganizations in several neural processes that contribute differently to perceptual learning in a visual search task. We propose an integrative model of neural activity reorganization, whereby perceptual learning takes place as a two-stage phenomenon including perceptual, attentional and contextual processes.     

Structure learning in human sequential decision-making

Studies of sequential decision-making in humans frequently find suboptimal performance relative to an ideal actor that has perfect knowledge of the model of how rewards and events are generated in the environment. Rather than being suboptimal, we argue that the learning problem humans face is more complex, in that it also involves learning the structure of reward generation in the environment. We formulate the problem of structure learning in sequential decision tasks using Bayesian reinforcement learning, and show that learning the generative model for rewards qualitatively changes the behavior of an optimal learning agent. To test whether people exhibit structure learning, we performed experiments involving a mixture of one-armed and two-armed bandit reward models, where structure learning produces many of the qualitative behaviors deemed suboptimal in previous studies. Our results demonstrate humans can perform structure learning in a near-optimal manner.     

Neural mechanisms of emesis

Emesis is a reflex, developed to different degrees in different species, that allows an animal to rid itself of ingested toxins or poisons. The reflex can be elicited either by direct neuronal connections from visceral afferent fibers, especially those from the gastrointestinal tract, or from humoral factors. Emesis from humoral factors depends on the integrity of the area postrema; neurons in the area postrema have excitatory receptors for emetic agents. Emesis from gastrointestinal afferents does not depend on the area postrema, but probably the reflex is triggered by projections to some part of the nucleus tractus solitarius. As with a variety of other complex motor functions regulated by the brain stem, it is likely that the sequence of muscle excitation and inhibition is controlled by a central pattern generator located in the nucleus tractus solitarius, and that information from humoral factors via the area postrema and visceral afferents via the vagus nerve converge at this point. This central pattern generator, like those for motor functions such as swallowing, presumably projects to the various motor nuclei, perhaps through interneuronal pathways, to elicit the sequential excitation and inhibition that controls the reflex.     

Neural mechanisms of aggression

Unchecked aggression and violence exact a significant toll on human societies. Aggression is an umbrella term for behaviours that are intended to inflict harm. These behaviours evolved as adaptations to deal with competition, but when expressed out of context, they can have destructive consequences. Uncontrolled aggression has several components, such as impaired recognition of social cues and enhanced impulsivity. Molecular approaches to the study of aggression have revealed biological signals that mediate the components of aggressive behaviour. These signals may provide targets for therapeutic intervention for individuals with extreme aggressive outbursts. This Review summarizes the complex interactions between genes, biological signals, neural circuits and the environment that influence the development and expression of aggressive behaviour.     

Disruption of neurocognitive decision-making mechanisms in depression

To analyze the relationship of disruptions in neurocognitive decision-making mechanisms based on logic and reasoning, or in a situation of uncertainty based on emotional experience (emotional learning) with clinical indices of depression, a multidisciplinary clinical, psychological, and neurophysiological study was conducted in 28 patients suffering from depression (women aged 18–56) and 50 healthy volunteers (women aged 18–55). The intensity of depression was estimated quantitatively by the Hamilton’s Depression Rating Scale (HDRS-17) to qualitatively estimate cognitive functions, the “Ten Words” technique, the Wisconsin Card-Sorting Test (WCST), and the Iowa Gambling Task (IGT) were used; and to assess the functional brain state of all patients suffering from depression, a multichannel recording of the background electroencephalogram (EEG) was made. It was demonstrated that in depression, a neurocognitive deficiency was observed that correlates positively with the intensity of the depressive symptomatology. As well, a reduction occurs in the ability to make decisions based both on logic and reasoning (in the WCST), which is associated with EEG features of hypofrontality, and based on emotional learning (in the IGT test). Only in patients suffering from depression with a reduced ability to make rational decisions based on logic and reasoning was a “compensatory shift” observed toward decision making based on emotions, which leads to relatively higher indices of emotional learning. It is assumed that hypofrontality, which results in difficulties in making decisions requiring logical thought, leads to interruption of subcortical, including hippocampal, structures, an increase in the activation of which is related to better indices of emotional learning.     

Neural mechanisms of imitation

Recent advances in our knowledge of the neural mechanisms of imitation suggest that there is a core circuitry of imitation comprising the superior temporal sulcus and the 'mirror neuron system', which consists of the posterior inferior frontal gyrus and adjacent ventral premotor cortex, as well as the rostral inferior parietal lobule. This core circuitry communicates with other neural systems according to the type of imitation performed. Imitative learning is supported by interaction of the core circuitry of imitation with the dorsolateral prefrontal cortex and perhaps motor preparation areas--namely, the mesial frontal, dorsal premotor and superior parietal areas. By contrast, imitation as a form of social mirroring is supported by interaction of the core circuitry of imitation with the limbic system.     

Molecular mechanisms of learning and memory

Memory is the process by which organisms are able to record their experiences, and use this information to adapt their responses to the environment. As such, it is vital for survival. In recent years, the development of spatially and temporally selective techniques for the regulation of gene expression has allowed the molecular details of this process to emerge. Here we review the molecular mechanisms thought to underlie memory acquisition and storage, as well as discuss recent evidence regarding the mechanisms of subsequent memory consolidation.     

Perceptual learning and decision-making in human medial frontal cortex

The dominant view that perceptual learning is accompanied by changes in early sensory representations has recently been challenged. Here we tested the idea that perceptual learning can be accounted for by reinforcement learning involving changes in higher decision-making areas. We trained subjects on an orientation discrimination task involving feedback over 4 days, acquiring fMRI data on the first and last day. Behavioral improvements were well explained by a reinforcement learning model in which learning leads to enhanced readout of sensory information, thereby establishing noise-robust representations of decision variables. We find stimulus orientation encoded in early visual and higher cortical regions such as lateral parietal cortex and anterior cingulate cortex (ACC). However, only activity patterns in the ACC tracked changes in decision variables during learning. These results provide strong evidence for perceptual learning-related changes in higher order areas and suggest that perceptual and reward learning are based on a common neurobiological mechanism.     

Virtual bargaining: a theory of social decision-making

An essential element of goal-directed decision-making in social contexts is that agents'' actions may be mutually interdependent. However, the most well-developed approaches to such strategic interactions, based on the Nash equilibrium concept in game theory, are sometimes too broad and at other times ‘overlook’ good solutions to fundamental social dilemmas and coordination problems. The authors propose a new theory of social decision-making—virtual bargaining—in which individuals decide among a set of moves on the basis of what they would agree to do if they could openly bargain. The core principles of a formal account are outlined (vis-à-vis the notions of ‘feasible agreement’ and explicit negotiation) and further illustrated with the introduction of a new game, dubbed the ‘Boobytrap game’ (a modification on the canonical Prisoner''s Dilemma paradigm). In the first empirical data of how individuals play the Boobytrap game, participants'' experimental choices accord well with a virtual bargaining perspective, but do not match predictions from a standard Nash account. Alternative frameworks are discussed, with specific empirical tests between these and virtual bargaining identified as future research directions. Lastly, it is proposed that virtual bargaining underpins a vast range of human activities, from social decision-making to joint action and communication.     

Neural mechanisms of hyperalgesia.

Hyperalgesia, or enhanced sensitivity to pain, is a symptom often associated with inflammation, nerve injury and various diseases. Although hyperalgesia appears to be mediated by sensitization of peripheral and central pain-signalling neurons, underlying mechanisms of sensitization are not well understood. Recent contributions to our knowledge of the mechanisms underlying hyperalgesia and sensitization are reviewed.     

Neural mechanisms of feature binding

正An object is usually composed of different features (e.g.,color, orientation, and motion), which are processed by segregated visual pathways and represented by functionally specialized brain areas. However, we perceive an object as a coherent whole, rather than its isolated features. How we integrate those isolated features and achieve a precise perception of objects is a fundamental challenge for the visual     

Neural mechanisms of birdsong memory

The process through which young male songbirds learn the characteristics of the songs of an adult male of their own species has strong similarities with speech acquisition in human infants. Both involve two phases: a period of auditory memorization followed by a period during which the individual develops its own vocalizations. The avian 'song system', a network of brain nuclei, is the probable neural substrate for the second phase of sensorimotor learning. By contrast, the neural representation of song memory acquired in the first phase is localized outside the song system, in different regions of the avian equivalent of the human auditory association cortex.