Linking implicit and explicit memory: common encoding factors and shared representations

Dissociations between implicit and explicit memory have featured prominently in theories of human memory. However, similarities between the two forms of memory have been less studied. One open question concerns whether implicit and explicit memory share encoding resources. To explore this question, we employed a subsequent memory design in which several novel scenes were repeated once during an fMRI session and explicit memory for the scenes was unexpectedly tested afterward. Subsequently remembered scenes produced more behavioral priming and neural attenuation-two conventional measures of implicit memory-than did subsequently forgotten scenes. Moreover, brain-behavior correlations between these two implicit measures were mediated by subsequent memory. Finally, tonic activity, possibly reflecting the natural time course of attention, was predictive of subsequent memory. These results suggest that implicit and explicit memory are subject to the same encoding factors and can rely on similar perceptual processes and representations.     

Neural basis for successful encoding and retrieval of prospective memory

Prospective memory (PM) refers to memory for future intentions. Difference due to memory (Dm effect) is the difference in neural activity related to stimuli that were subsequently remembered or forgotten. Using event-related potentials (ERPs), the present study investigated the Dm effect for PM using a subsequent task-switching paradigm. The results showed that a Dm effect of ERP P150 was more positive-going for later PM hit trials than for later PM forgotten trials during 100–200 ms. This Dm effect may reflect the process for the production of future intention or the process for attention. Consistent with previously reported Dm effects of other types of memory, we found that the fbN2 (250–280 ms) and late positivity component (400–700 ms) were stronger in later PM hit trials than in forgotten trials. The fbN2 was evoked by Chinese characters. The late positivity component was related to the precise encoding process. In conclusion, because of the early P150, PM encoding appears to be somewhat different from previously identified Dm effects. However, further research is needed. Our findings reveal that Dm effects of PM share similar characteristics with known Dm effects of other types of episodic memory after the very early stage of neural processing.     

Activity in both hippocampus and perirhinal cortex predicts the memory strength of subsequently remembered information

It has been suggested that hippocampal activity predicts subsequent recognition success when recognition decisions are based disproportionately on recollection, whereas perirhinal activity predicts recognition success when decisions are based primarily on familiarity. Another perspective is that both hippocampal and perirhinal activity are predictive of overall memory strength. We tested the relationship between brain activity during learning and subsequent memory strength. Activity in a number of cortical regions (including regions within the "default network") was negatively correlated with subsequent memory strength, suggesting that this activity reflects inattention or mind wandering (and, consequently, poor memory). In contrast, activity in both hippocampus and perirhinal cortex positively correlated with the subsequent memory strength of remembered items. This finding suggests that both structures cooperate during learning to determine the memory strength of what is being learned.     

A neural network reflecting decisions about human faces.

Anatomic structures have been linked to the mnemonic component of working memory, but the neural network underlying associated decision processes remains elusive. Here we present an event-related functional magnetic resonance imaging study that measured activity during the decision period of a delayed face recognition task. A double dissociation of activity between anterior cingulate cortex (ACC), and a network including left fusiform face area (FFA) and left dorsolateral prefrontal cortex (DLPFC), reflected whether a probe face matched the remembered face at the time of decision. Greater activity in the left FFA and left DLPFC correlated with probe faces that matched the remembered face; in contrast, activity in ACC was greater when the probe face did not match the remembered face. These results support a model where frontal regions act in concert with stimulus-specific temporal structures to make recognition decisions about visual stimuli.     

Interaction between the amygdala and the medial temporal lobe memory system predicts better memory for emotional events

Emotional events are remembered better than neutral events possibly because the amygdala enhances the function of medial temporal lobe (MTL) memory system (modulation hypothesis). Although this hypothesis has been supported by much animal research, evidence from humans has been scarce and indirect. We investigated this issue using event-related fMRI during encoding of emotional and neutral pictures. Memory performance after scanning showed a retention advantage for emotional pictures. Successful encoding activity in the amygdala and MTL memory structures was greater and more strongly correlated for emotional than for neutral pictures. Moreover, a double dissociation was found along the longitudinal axis of the MTL memory system: activity in anterior regions predicted memory for emotional items, whereas activity in posterior regions predicted memory for neutral items. These results provide direct evidence for the modulation hypothesis in humans and reveal a functional specialization within the MTL regarding the effects of emotion on memory formation.     

Visual short-term memory compared in rhesus monkeys and humans

Change detection is a popular task to study visual short-term memory (STM) in humans [1-4]. Much of this work suggests that STM has a fixed capacity of 4 ± 1 items [1-6]. Here we report the first comparison of change-detection memory between humans and a species closely related to humans, the rhesus monkey. Monkeys and humans were tested in nearly identical procedures with overlapping display sizes. Although the monkeys' STM was well fit by a one-item fixed-capacity memory model, other monkey memory tests with four-item lists have shown performance impossible to obtain with a one-item capacity [7]. We suggest that this contradiction can be resolved using a continuous-resource approach more closely tied to the neural basis of memory [8, 9]. In this view, items have a noisy memory representation whose noise level depends on display size as a result of the distributed allocation of a continuous resource. In accord with this theory, we show that performance depends on the perceptual distance between items before and after the change, and d' depends on display size in an approximately power-law fashion. Our results open the door to combining the power of psychophysics, computation, and physiology to better understand the neural basis of STM.     

Neural correlates of executive control in the avian brain

Executive control, the ability to plan one's behaviour to achieve a goal, is a hallmark of frontal lobe function in humans and other primates. In the current study we report neural correlates of executive control in the avian nidopallium caudolaterale, a region analogous to the mammalian prefrontal cortex. Homing pigeons (Columba livia) performed a working memory task in which cues instructed them whether stimuli should be remembered or forgotten. When instructed to remember, many neurons showed sustained activation throughout the memory period. When instructed to forget, the sustained activation was abolished. Consistent with the neural data, the behavioural data showed that memory performance was high after instructions to remember, and dropped to chance after instructions to forget. Our findings indicate that neurons in the avian nidopallium caudolaterale participate in one of the core forms of executive control, the control of what should be remembered and what should be forgotten. This form of executive control is fundamental not only to working memory, but also to all cognition.     

When encoding yields remembering: insights from event-related neuroimaging.

To understand human memory, it is important to determine why some experiences are remembered whereas others are forgotten. Until recently, insights into the neural bases of human memory encoding, the processes by which information is transformed into an enduring memory trace, have primarily been derived from neuropsychological studies of humans with select brain lesions. The advent of functional neuroimaging methods, such as positron emission tomography (PET) and functional magnetic resonance imaging (fMRI), has provided a new opportunity to gain additional understanding of how the brain supports memory formation. Importantly, the recent development of event-related fMRI methods now allows for examination of trial-by-trial differences in neural activity during encoding and of the consequences of these differences for later remembering. In this review, we consider the contributions of PET and fMRI studies to the understanding of memory encoding, placing a particular emphasis on recent event-related fMRI studies of the Dm effect: that is, differences in neural activity during encoding that are related to differences in subsequent memory. We then turn our attention to the rich literature on the Dm effect that has emerged from studies using event-related potentials (ERPs). It is hoped that the integration of findings from ERP studies, which offer higher temporal resolution, with those from event-related fMRI studies, which offer higher spatial resolution, will shed new light on when and why encoding yields subsequent remembering.     

Intermediate Levels of Hippocampal Activity Appear Optimal for Associative Memory Formation

Background

It is well established that hippocampal activity is positively related to effective associative memory formation. However, in biological systems often optimal levels of activity are contrasted by both sub- and supra-optimal levels. Sub-optimal levels of hippocampal activity are commonly attributed to unsuccessful memory formation, whereas the supra-optimal levels of hippocampal activity related to unsuccessful memory formation have been rarely studied. It is still unclear under what circumstances such supra-optimal levels of hippocampal activity occur. To clarify this issue, we aimed at creating a condition, in which supra-optimal hippocampal activity is associated with encoding failure. We assumed that such supra-optimal activity occurs when task-relevant information is embedded in task-irrelevant, distracting information, which can be considered as noise.

Methodology/Principal Findings

In the present fMRI study, we probed neural correlates of associative memory formation in a full-factorial design with associative memory (subsequently remembered versus forgotten) and noise (induced by high versus low distraction) as factors. Results showed that encoding failure was associated with supra-optimal activity in the high-distraction condition and with sub-optimal activity in the low distraction condition. Thus, we revealed evidence for a bell-shape function relating hippocampal activity with associative encoding success.

Conclusions/Significance

Our findings indicate that intermediate levels of hippocampal activity are optimal while both too low and too high levels appear detrimental for associative memory formation. Supra-optimal levels of hippocampal activity seem to occur when task-irrelevant information is added to task-relevant signal. If such task-irrelevant noise is reduced adequately, hippocampal activity is lower and thus optimal for associative memory formation.     

Uncovering camouflage: amygdala activation predicts long-term memory of induced perceptual insight

What brain mechanisms underlie learning of new knowledge from single events? We studied encoding in long-term memory of a unique type of one-shot experience, induced perceptual insight. While undergoing an fMRI brain scan, participants viewed degraded images of real-world pictures where the underlying objects were hard to recognize ("camouflage"), followed by brief exposures to the original images ("solution"), which led to induced insight ("Aha!"). A week later, the participants' memory was tested; a solution image was classified as "remembered" if detailed perceptual knowledge was elicited from the camouflage image alone. During encoding, subsequently remembered images were associated with higher activity in midlevel visual cortex and medial frontal cortex, but most pronouncedly, in the amygdala, whose activity could be used to predict which solutions will remain in long-term memory. Our findings extend the known roles of amygdala in memory to include promotion of long-term memory of the sudden reorganization of internal representations.     

Neural Correlates of the In-Group Memory Advantage on the Encoding and Recognition of Faces

People have a memory advantage for faces that belong to the same group, for example, that attend the same university or have the same personality type. Faces from such in-group members are assumed to receive more attention during memory encoding and are therefore recognized more accurately. Here we use event-related potentials related to memory encoding and retrieval to investigate the neural correlates of the in-group memory advantage. Using the minimal group procedure, subjects were classified based on a bogus personality test as belonging to one of two personality types. While the electroencephalogram was recorded, subjects studied and recognized faces supposedly belonging to the subject’s own and the other personality type. Subjects recognized in-group faces more accurately than out-group faces but the effect size was small. Using the individual behavioral in-group memory advantage in multivariate analyses of covariance, we determined neural correlates of the in-group advantage. During memory encoding (300 to 1000 ms after stimulus onset), subjects with a high in-group memory advantage elicited more positive amplitudes for subsequently remembered in-group than out-group faces, showing that in-group faces received more attention and elicited more neural activity during initial encoding. Early during memory retrieval (300 to 500 ms), frontal brain areas were more activated for remembered in-group faces indicating an early detection of group membership. Surprisingly, the parietal old/new effect (600 to 900 ms) thought to indicate recollection processes differed between in-group and out-group faces independent from the behavioral in-group memory advantage. This finding suggests that group membership affects memory retrieval independent of memory performance. Comparisons with a previous study on the other-race effect, another memory phenomenon influenced by social classification of faces, suggested that the in-group memory advantage is dominated by top-down processing whereas the other-race effect is also influenced by extensive perceptual experience.     

Preservation of musical memory in an amnesic professional cellist

Learning and memory of music involves a multitude of perceptual, motor, affective, and autobiographical memory processes [1]. Patient and imaging studies suggest that musical memory may involve distinct neural substrates [2,3]. However, the degree of independence of such a system from other memory domains is controversial [4]. We have investigated a 68-year-old professional cellist, patient PM, who developed severe amnesia following encephalitis. This case provided a unique opportunity to study musical memory in a patient with a precisely defined premorbid musical knowledge and well-demarcated focal lesions of the brain. Despite severe memory impairments, he performed like healthy musicians in various tests of recognition memory for music. These findings suggest that learning and retention of musical information depends on brain networks distinct from those involved in other types of episodic and semantic memory.     

Brain activity during the memorization of visual scenes from TV commercials: An application of high resolution EEG and steady state somatosensory evoked potentials technologies

The aim of this study was to elucidate if the TV commercials that were remembered by the subjects after their observation within a documentary elicited particular brain activity when compared to the activity generated during the observation of TV commercials that were forgotten. High resolution EEG recordings were performed in a group of 10 healthy subjects with the steady state somatosensory evoked potentials (SSSEPs) technique, in which a series of light electrical stimulation at the left wrist were delivered at the frequency of 20 Hz. The brain activity was indexed by the phase delay of the EEG spectral responses at 20 Hz with respect to the stimulus delivering and evaluated at the scalp level as well as at the cortical surface using several regions of interest coincident with the Brodmann areas (BAs). Results suggest that the cerebral processes involved during the observation of TV commercials that were remembered by the population examined (RMB dataset) are generated by the posterior parietal cortices and the prefrontal areas, rather bilaterally. These results are compatible with previously results obtained in literature by using MEG and fMRI devices during similar experimental tasks. High resolution EEG is able to summarize, with the use of SSSEPs methodologies, the behavior of the estimated cortical networks subserving the proposed memory tasks. It is likely that such tool could play a role in the next future for the investigation of the neural substrates of the human behavior in decision-making and recognition tasks.     

Recruitment of unique neural systems to support visual memory in normal aging.

The performance of many cognitive tasks changes in normal aging [1] [2] [3]. Recent behavioral work has identified some tasks that seem to be performed in an age-invariant manner [4]. To understand the brain mechanisms responsible for this, we combined psychophysical measurements of visual short-term memory with positron emission tomography (PET) in young and old individuals. Participants judged the differences between two visual stimuli, and the memory load was manipulated by interposing a delay between the two stimuli. Both age groups performed the task equally well, but the neural systems supporting performance differed between young and old individuals. Although there was some overlap in the brain regions supporting performance (for example, occipital, temporal and inferior prefrontal cortices, and caudate), the functional interconnections between these common regions were much weaker in old participants. This suggests that the regions were not operating effectively as a network in old individuals. Old participants recruited unique areas, however, including medial temporal and dorsolateral prefrontal cortices. These unique areas were strongly interactive and their activity was related to performance only in old participants. Therefore, these areas may have acted to compensate for reduced interactions between the other brain areas.     

Auditory short-term memory behaves like visual short-term memory

Are the information processing steps that support short-term sensory memory common to all the senses? Systematic, psychophysical comparison requires identical experimental paradigms and comparable stimuli, which can be challenging to obtain across modalities. Participants performed a recognition memory task with auditory and visual stimuli that were comparable in complexity and in their neural representations at early stages of cortical processing. The visual stimuli were static and moving Gaussian-windowed, oriented, sinusoidal gratings (Gabor patches); the auditory stimuli were broadband sounds whose frequency content varied sinusoidally over time (moving ripples). Parallel effects on recognition memory were seen for number of items to be remembered, retention interval, and serial position. Further, regardless of modality, predicting an item's recognizability requires taking account of (1) the probe's similarity to the remembered list items (summed similarity), and (2) the similarity between the items in memory (inter-item homogeneity). A model incorporating both these factors gives a good fit to recognition memory data for auditory as well as visual stimuli. In addition, we present the first demonstration of the orthogonality of summed similarity and inter-item homogeneity effects. These data imply that auditory and visual representations undergo very similar transformations while they are encoded and retrieved from memory.     

Human hippocampal neurons predict how well word pairs will be remembered

What is the neuronal basis for whether an experience is recalled or forgotten? In contrast to recognition, recall is difficult to study in nonhuman primates and rarely is accessible at the single neuron level in humans. We recorded 128 medial temporal lobe (MTL) neurons in patients implanted with intracranial microelectrodes while they encoded and recalled word paired associates. Neurons in the amygdala, entorhinal cortex, and hippocampus showed altered activity during encoding (9%), recall (22%), and both task phases (23%). The responses of hippocampal neurons during encoding predicted whether or not subjects later remembered the pairs successfully. Entorhinal cortex neuronal activity during retrieval was correlated with recall success. These data provide support at the single neuron level for MTL contributions to encoding and retrieval, while also suggesting there may be differences in the level of contribution of MTL regions to these memory processes.     

Learning shapes spontaneous activity itinerating over memorized states

Learning is a process that helps create neural dynamical systems so that an appropriate output pattern is generated for a given input. Often, such a memory is considered to be included in one of the attractors in neural dynamical systems, depending on the initial neural state specified by an input. Neither neural activities observed in the absence of inputs nor changes caused in the neural activity when an input is provided were studied extensively in the past. However, recent experimental studies have reported existence of structured spontaneous neural activity and its changes when an input is provided. With this background, we propose that memory recall occurs when the spontaneous neural activity changes to an appropriate output activity upon the application of an input, and this phenomenon is known as bifurcation in the dynamical systems theory. We introduce a reinforcement-learning-based layered neural network model with two synaptic time scales; in this network, I/O relations are successively memorized when the difference between the time scales is appropriate. After the learning process is complete, the neural dynamics are shaped so that it changes appropriately with each input. As the number of memorized patterns is increased, the generated spontaneous neural activity after learning shows itineration over the previously learned output patterns. This theoretical finding also shows remarkable agreement with recent experimental reports, where spontaneous neural activity in the visual cortex without stimuli itinerate over evoked patterns by previously applied signals. Our results suggest that itinerant spontaneous activity can be a natural outcome of successive learning of several patterns, and it facilitates bifurcation of the network when an input is provided.     

Reward-motivated learning: mesolimbic activation precedes memory formation

We examined anticipatory mechanisms of reward-motivated memory formation using event-related FMRI. In a monetary incentive encoding task, cues signaled high- or low-value reward for memorizing an upcoming scene. When tested 24 hr postscan, subjects were significantly more likely to remember scenes that followed cues for high-value rather than low-value reward. A monetary incentive delay task independently localized regions responsive to reward anticipation. In the encoding task, high-reward cues preceding remembered but not forgotten scenes activated the ventral tegmental area, nucleus accumbens, and hippocampus. Across subjects, greater activation in these regions predicted superior memory performance. Within subject, increased correlation between the hippocampus and ventral tegmental area was associated with enhanced long-term memory for the subsequent scene. These findings demonstrate that brain activation preceding stimulus encoding can predict declarative memory formation. The findings are consistent with the hypothesis that reward motivation promotes memory formation via dopamine release in the hippocampus prior to learning.     

Neural repetition effects in the medial temporal lobe complex are modulated by previous encoding experience

It remains an intriguing question why the medial temporal lobe (MTL) can display either attenuation or enhancement of neural activity following repetition of previously studied items. To isolate the role of encoding experience itself, we assessed neural repetition effects in the absence of any ongoing task demand or intentional orientation to retrieve. Experiment 1 showed that the hippocampus and surrounding MTL regions displayed neural repetition suppression (RS) upon repetition of past items that were merely attended during an earlier study phase but this was not the case following re-occurrence of items that had been encoded into working memory (WM). In this latter case a trend toward neural repetition enhancement (RE) was observed, though this was highly variable across individuals. Interestingly, participants with a higher degree of neural RE in the MTL complex displayed higher memory sensitivity in a later, surprise recognition test. Experiment 2 showed that massive exposure at encoding effected a change in the neural architecture supporting incidental repetition effects, with regions of the posterior parietal and ventral-frontal cortex in addition to the hippocampus displaying neural RE, while no neural RS was observed. The nature of encoding experience therefore modulates the expression of neural repetition effects in the MTL and the neocortex in the absence of memory goals.