Internal representations for associative memory

We describe a class of feed forward neural network models for associative content addressable memory (ACAM) which utilize sparse internal representations for stored data. In addition to the input and output layers, our networks incorporate an intermediate processing layer which serves to label each stored memory and to perform error correction and association. We study two classes of internal label representations: the unary representation and various sparse, distributed representations. Finally, we consider storage of sparse data and sparsification of data. These models are found to have advantages in terms of storage capacity, hardware efficiency, and recall reliability when compared to the Hopfield model, and to possess analogies to both biological neural networks and standard digital computer memories.     

The rodent orbitofrontal cortex gets time and direction

The orbitofrontal cortex (OFC) helps direct decision making through its flexible coding of reward and economic value. In this issue of Neuron, papers by Roesch et al. and Feierstein et al. demonstrate the importance of temporal and spatial features to processing in the rodent OFC.     

Rapid associative encoding in basolateral amygdala depends on connections with orbitofrontal cortex

Certain goal-directed behaviors depend upon interactions between basolateral amygdala (ABL) and orbitofrontal cortex (OFC). Here we describe neurophysiological evidence of this cooperative function. We recorded from ABL in intact and OFC-lesioned rats during learning of odor discrimination problems and reversals. During learning, rats with ipsilateral OFC lesions exhibited a marked decline in the proportion of ABL neurons that fired differentially during cue sampling both before and after reversal and in the proportion of neurons that reversed odor preference when the odor-outcome associations were reversed. This decline appeared to reflect a loss of rapid flexibility in cue selectivity that characterized activity in intact rats. In addition, lesioned rats had fewer neurons that fired in anticipation of the predicted outcome during a delay period after responding but before outcome delivery. These findings support a role for OFC in facilitating the encoding of information about expected outcomes in ABL.     

Acetylcholine and associative memory in the piriform cortex

The significance of cholinergic modulation for associative memory performance in the piriform cortex was examined in a study combining cellular neurophysiology in brain slices with realistic biophysical network simulations. Three different physiological effects of acetylcholine were identified at the single-cell level: suppression of neuronal adaptation, suppression of synaptic transmission in the intrinsic fibers layer, and activity-dependent increase in synaptic strength. Biophysical simulations show how these three effects are joined together to enhance learning and recall performance of the cortical network. Furthermore, our data suggest that activity-dependent synaptic decay during learning is a crucial factor in determining learning capability of the cortical network. Accordingly, it is predicted that acetylcholine should also enhance long-term depression in the piriform cortex.     

Neuronal representations of stimuli in the mouth: the primate insular taste cortex, orbitofrontal cortex and amygdala

The responses of 3687 neurons in the macaque primary taste cortex in the insula/frontal operculum, orbitofrontal cortex (OFC) and amygdala to oral sensory stimuli reveals principles of representation in these areas. Information about the taste, texture of what is in the mouth (viscosity, fat texture and grittiness, which reflect somatosensory inputs), temperature and capsaicin is represented in all three areas. In the primary taste cortex, taste and viscosity are more likely to activate different neurons, with more convergence onto single neurons particularly in the OFC and amygdala. The different responses of different OFC neurons to different combinations of these oral sensory stimuli potentially provides a basis for different behavioral responses. Consistently, the mean correlations between the representations of the different stimuli provided by the population of OFC neurons were lower (0.71) than for the insula (0.81) and amygdala (0.89). Further, the encoding was more sparse in the OFC (0.67) than in the insula (0.74) and amygdala (0.79). The insular neurons did not respond to olfactory and visual stimuli, with convergence occurring in the OFC and amygdala. Human psychophysics showed that the sensory spaces revealed by multidimensional scaling were similar to those provided by the neurons.     

A comparative review of rodent prefrontal cortex and working memory

The prefrontal cortex is critical to working memory processes. Current theories of prefrontal function are largely based on primate behavioural and electrophysiological data. As molecular genetic techniques advance in mice, so investigations into the rodent prefrontal cortex should expand, such that rodent models of prefrontal function during working memory may be used to study the synaptic and molecular basis of the phenomenon. This review attempts to summarize aspects of published data that pertain to working memory and suggest directions that will allow a coherent comparison of prefrontal function and interaction in monkey, rat and mouse.     

The rules of formation of the olfactory representations found in the orbitofrontal cortex olfactory areas in primates.

Approximately 35% of neurons in the orbitofrontal cortex taste and olfactory areas with olfactory responses provide a representation of odour that depends on the taste with which the odour has been associated previously. This representation is produced by a slowly acting learning mechanism that learns associations between odour and taste. Other neurons in the orbitofrontal cortex respond to both the odour and to the mouth feel of fat. The representation of odour thus moves for at least some neurons in the orbitofrontal cortex beyond the domain of physico-chemical properties of the odours to a domain where the ingestion-related significance of the odour determines the representation provided. Olfactory neurons in the primate orbitofrontal cortex decrease their responses to a food eaten to satiety, but remain responsive to other foods, thus contributing to a mechanism for olfactory sensory-specific satiety. It has been shown in neuroimaging studies that the human orbitofrontal cortex provides a representation of the pleasantness of odour, in that the activation produced by the odour of a food eaten to satiety decreases relative to another food-related odour not eaten in the meal. In the same general area there is a representation of the pleasantness of the smell, taste and texture of a whole food, in that activation in this area decreases to a food eaten to satiety, but not to a food that has not been eaten in the meal.     

On associative memory

The information storing capacity of certain associative and auto-associative memories is calculated. For example, in a 100×100 matrix of 1 bit storage elements more than 6,500 bits can be stored associatively, and more than 688,000 bits in a 1,000×1,000 matrix. Asymptotically, the storage capacity of an associative memory increases proportionally to the number of storage elements. The usefulness of associative memories, as opposed to conventional listing memories, is discussed — especially in connection with brain modelling.     

Molecular associative memory

An example of a kinetic system with address-bearing molecules and directed interactions is investigated. We show that by introducing exchange between Ising spins via the address-bearing messengers, the Hopfield model of associative memory can be made local.     

Representation of spatial goals in rat orbitofrontal cortex

The orbitofrontal cortex (OFC) is thought to participate in making and evaluating goal-directed decisions. In rodents, spatial navigation is a major mode of goal-directed behavior, and anatomical and lesion studies implicate the OFC in spatial processing, but there is little direct evidence for coding of spatial or motor variables. Here, we recorded from ventrolateral and lateral OFC in an odor-cued two-alternative choice task requiring orientation and approach to spatial goal ports. In this context, over half of OFC neurons encoded choice direction or goal port location. A subset of neurons was jointly selective for the trial outcome and port location, information useful for the selection or evaluation of spatial goals. These observations show that the rodent OFC not only encodes information relating to general motivational significance, as shown previously, but also encodes spatiomotor variables needed to define specific behavioral goals and the locomotor actions required to attain them.     

Hippocampal signals modify orbitofrontal representations to learn new paths

1. Download : Download high-res image (181KB)
2. Download : Download full-size image

     

Error tolerant associative memory

We present a new approach to enlarging the basin of attraction of associative memory, including auto-associative memory and temporal associative memory. The memory trained by means of this method can tolerate and recover from seriously noisy patterns. Simulations show that this approach will greatly reduce the number of limit cycles.     

A cognitive and associative memory

By introducing a physiological constraint in the auto-correlation matrix memory, the system is found to acquire an ability in cognition i.e. the ability to identify and input pattern by its proximity to any one of the stored memories. The physiological constraint here is that the attribute of a given synapse (i.e. excitatory or inhibitory) is uniquely determined by the neuron it belongs. Thus the synaptic coupling is generally not symmetric. Analytical and numerical analyses revealed that the present model retrieves a memory if an input pattern is close to the pattern of the stored memories; if not, it gives a clear response by going into a special mode where almost all neurons are in the same state in each time step. This uniform mode may be stationary or periodic, depending on whether or not the number of the excitatory neurons exceeds the number of inhibitory neurons.     

Temporal integration of olfactory perceptual evidence in human orbitofrontal cortex

Given a noisy sensory world, the nervous system integrates perceptual evidence over time to optimize decision-making. Neurophysiological accumulation of sensory information is well-documented in the animal visual system, but how such mechanisms are instantiated in the human brain remains poorly understood. Here we combined psychophysical techniques, drift-diffusion modeling, and functional magnetic resonance imaging (fMRI) to establish that odor evidence integration in the human olfactory system enhances discrimination on a two-alternative forced-choice task. Model-based measures of fMRI brain activity highlighted a ramp-like increase in orbitofrontal cortex (OFC) that peaked at the time of decision, conforming to predictions derived from an integrator model. Combined behavioral and fMRI data further suggest that decision bounds are not fixed but collapse over time, facilitating choice behavior in the presence of low-quality evidence. These data highlight a key role for the orbitofrontal cortex in resolving sensory uncertainty and provide substantiation for accumulator models of human perceptual decision-making.     

Lateral orbitofrontal cortex involvement in initial negative aesthetic impression formation

It is well established that aesthetic appreciation is related with activity in several different brain regions. The identification of the neural correlates of beauty or liking ratings has been the focus of most prior studies. Not much attention has been directed towards the fact that humans are surrounded by objects that lead them to experience aesthetic indifference or leave them with a negative aesthetic impression. Here we explore the neural substrate of such experiences. Given the neuroimaging techniques that have been used, little is known about the temporal features of such brain activity. By means of magnetoencephalography we registered the moment at which brain activity differed while participants viewed images they considered to be beautiful or not. Results show that the first differential activity appears between 300 and 400 ms after stimulus onset. During this period activity in right lateral orbitofrontal cortex (lOFC) was greater while participants rated visual stimuli as not beautiful than when they rated them as beautiful. We argue that this activity is associated with an initial negative aesthetic impression formation, driven by the relative hedonic value of stimuli regarded as not beautiful. Additionally, our results contribute to the understanding of the nature of the functional roles of the lOFC.     

Hierarchical representations in the auditory cortex

Understanding the neural mechanisms of invariant object recognition remains one of the major unsolved problems in neuroscience. A common solution that is thought to be employed by diverse sensory systems is to create hierarchical representations of increasing complexity and tolerance. However, in the mammalian auditory system many aspects of this hierarchical organization remain undiscovered, including the prominent classes of high-level representations (that would be analogous to face selectivity in the visual system or selectivity to bird's own song in the bird) and the dominant types of invariant transformations. Here we review the recent progress that begins to probe the hierarchy of auditory representations, and the computational approaches that can be helpful in achieving this feat.