Executive control during episodic retrieval: multiple prefrontal processes subserve source memory

During recognition, one may sense items as familiar (item memory) and additionally recollect specific contextual details of the earlier encounters (source memory). Cognitive theory suggests that, unlike item memory, source memory requires controlled cue specification and monitoring processes. Functional imaging suggests that such processes may depend on left prefrontal cortex (PFC). However, the nature and possible anatomical segregation of these processes remains unknown. Using functional magnetic resonance imaging, we isolated distinct response patterns in left PFC during source memory consistent with semantic analysis/cue specification (anterior ventrolateral), recollective monitoring (posterior dorsolateral and frontopolar), and phonological maintenance/rehearsal (posterior ventrolateral). Importantly, cue specification and recollective monitoring responses were not seen during item memory and were unaffected by retrieval success, demonstrating that the mere attempt to recollect episodic detail engages multiple control processes with different left PFC substrates.     

Examining Event-Related Potential (ERP) Correlates of Decision Bias in Recognition Memory Judgments

Memory judgments can be based on accurate memory information or on decision bias (the tendency to report that an event is part of episodic memory when one is in fact unsure). Event related potentials (ERP) correlates are important research tools for elucidating the dynamics underlying memory judgments but so far have been established only for investigations of accurate old/new discrimination. To identify the ERP correlates of bias, and observe how these interact with ERP correlates of memory, we conducted three experiments that manipulated decision bias within participants via instructions during recognition memory tests while their ERPs were recorded. In Experiment 1, the bias manipulation was performed between blocks of trials (automatized bias) and compared to trial-by-trial shifts of bias in accord with an external cue (flexibly controlled bias). In Experiment 2, the bias manipulation was performed at two different levels of accurate old/new discrimination as the memory strength of old (studied) items was varied. In Experiment 3, the bias manipulation was added to another, bottom-up driven manipulation of bias induced via familiarity. In the first two Experiments, and in the low familiarity condition of Experiment 3, we found evidence of an early frontocentral ERP component at 320 ms poststimulus (the FN320) that was sensitive to the manipulation of bias via instruction, with more negative amplitudes indexing more liberal bias. By contrast, later during the trial (500–700 ms poststimulus), bias effects interacted with old/new effects across all three experiments. Results suggest that the decision criterion is typically activated early during recognition memory trials, and is integrated with retrieved memory signals and task-specific processing demands later during the trial. More generally, the findings demonstrate how ERPs can help to specify the dynamics of recognition memory processes under top-down and bottom-up controlled retrieval conditions.     

Hippocampus Is Place of Interaction between Unconscious and Conscious Memories

Recent evidence suggests that humans can form and later retrieve new semantic relations unconsciously by way of hippocampus—the key structure also recruited for conscious relational (episodic) memory. If the hippocampus subserves both conscious and unconscious relational encoding/retrieval, one would expect the hippocampus to be place of unconscious-conscious interactions during memory retrieval. We tested this hypothesis in an fMRI experiment probing the interaction between the unconscious and conscious retrieval of face-associated information. For the establishment of unconscious relational memories, we presented subliminal (masked) combinations of unfamiliar faces and written occupations (“actor” or “politician”). At test, we presented the former subliminal faces, but now supraliminally, as cues for the reactivation of the unconsciously associated occupations. We hypothesized that unconscious reactivation of the associated occupation—actor or politician—would facilitate or inhibit the subsequent conscious retrieval of a celebrity’s occupation, which was also actor or politician. Depending on whether the reactivated unconscious occupation was congruent or incongruent to the celebrity’s occupation, we expected either quicker or delayed conscious retrieval process. Conscious retrieval was quicker in the congruent relative to a neutral baseline condition but not delayed in the incongruent condition. fMRI data collected during subliminal face-occupation encoding confirmed previous evidence that the hippocampus was interacting with neocortical storage sites of semantic knowledge to support relational encoding. fMRI data collected at test revealed that the facilitated conscious retrieval was paralleled by deactivations in the hippocampus and neocortical storage sites of semantic knowledge. We assume that the unconscious reactivation has pre-activated overlapping relational representations in the hippocampus reducing the neural effort for conscious retrieval. This finding supports the notion of synergistic interactions between conscious and unconscious relational memories in a common, cohesive hippocampal-neocortical memory space.     

Pupil Dilation Co-Varies with Memory Strength of Individual Traces in a Delayed Response Paired-Associate Task

Studies on cognitive effort have shown that pupil dilation is a reliable indicator of memory load. However, it is conceivable that there are other sources of effort involved in memory that also affect pupil dilation. One of these is the ease with which an item can be retrieved from memory. Here, we present the results of an experiment in which we studied the way in which pupil dilation acts as an online marker for memory processing during the retrieval of paired associates while reducing confounds associated with motor responses. Paired associates were categorized into sets containing either 4 or 7 items. After learning the paired associates once, pupil dilation was measured during the presentation of the retrieval cue during four repetitions of each set. Memory strength was operationalized as the number of repetitions (frequency) and set-size, since having more items per set results in a lower average recency. Dilation decreased with increased memory strength, supporting the hypothesis that the amplitude of the evoked pupillary response correlates positively with retrieval effort. Thus, while many studies have shown that “memory load” influences pupil dilation, our results indicate that the task-evoked pupillary response is also sensitive to the experimentally manipulated memory strength of individual items. As these effects were observed well before the response had been given, this study also suggests that pupil dilation can be used to assess an item’s memory strength without requiring an overt response.     

Delineating the Effect of Semantic Congruency on Episodic Memory: The Role of Integration and Relatedness

A fundamental challenge in the study of learning and memory is to understand the role of existing knowledge in the encoding and retrieval of new episodic information. The importance of prior knowledge in memory is demonstrated in the congruency effect—the robust finding wherein participants display better memory for items that are compatible, rather than incompatible, with their pre-existing semantic knowledge. Despite its robustness, the mechanism underlying this effect is not well understood. In four studies, we provide evidence that demonstrates the privileged explanatory power of the elaboration-integration account over alternative hypotheses. Furthermore, we question the implicit assumption that the congruency effect pertains to the truthfulness/sensibility of a subject-predicate proposition, and show that congruency is a function of semantic relatedness between item and context words.     

Functional Organization of the Brain during the Operation of Working Memory

Event-related potentials (ERPs) recorded from various cortical areas during matching of two consecutive pictures were analyzed. Reflecting the process of trace fixation, the ERP to the reference stimulus was characterized by an increase in components P150 and P300 in the occipital and temporo-parieto-occipital areas and components N300 and N400 in the precentral areas as compared with the ERP elicited by the warning stimulus. The ERP to the test stimulus, which reflected trace retrieval and matching with current information, was characterized by a generalized increase in the late positive complex in the interval 300–600 ms. Similarity and/or dissimilarity of the test and reference stimuli was reflected in the parameters of the ERP to the test stimulus. The results testify to the difference in functional and topographic organization of the brain cortex at the initial and late stages of operation of the working memory.     

Recognition memory for vibrotactile rhythms: An fMRI study in blind and sighted individuals

Calcarine sulcal cortex possibly contributes to semantic recognition memory in early blind (EB). We assessed a recognition memory role using vibrotactile rhythms and a retrieval success paradigm involving learned “old” and “new” rhythms in EB and sighted. EB showed no activation differences in occipital cortex indicating retrieval success but replicated findings of somatosensory processing. Both groups showed retrieval success in primary somatosensory, precuneus, and orbitofrontal cortex. The S1 activity might indicate generic sensory memory processes.     

Recognition memory for vibrotactile rhythms: an fMRI study in blind and sighted individuals

Calcarine sulcal cortex possibly contributes to semantic recognition memory in early blind (EB). We assessed a recognition memory role using vibrotactile rhythms and a retrieval success paradigm involving learned "old" and "new" rhythms in EB and sighted. EB showed no activation differences in occipital cortex indicating retrieval success but replicated findings of somatosensory processing. Both groups showed retrieval success in primary somatosensory, precuneus, and orbitofrontal cortex. The S1 activity might indicate generic sensory memory processes.     

Grey and White Matter Correlates of Recent and Remote Autobiographical Memory Retrieval – Insights from the Dementias

The capacity to remember self-referential past events relies on the integrity of a distributed neural network. Controversy exists, however, regarding the involvement of specific brain structures for the retrieval of recently experienced versus more distant events. Here, we explored how characteristic patterns of atrophy in neurodegenerative disorders differentially disrupt remote versus recent autobiographical memory. Eleven behavioural-variant frontotemporal dementia, 10 semantic dementia, 15 Alzheimer''s disease patients and 14 healthy older Controls completed the Autobiographical Interview. All patient groups displayed significant remote memory impairments relative to Controls. Similarly, recent period retrieval was significantly compromised in behavioural-variant frontotemporal dementia and Alzheimer''s disease, yet semantic dementia patients scored in line with Controls. Voxel-based morphometry and diffusion tensor imaging analyses, for all participants combined, were conducted to investigate grey and white matter correlates of remote and recent autobiographical memory retrieval. Neural correlates common to both recent and remote time periods were identified, including the hippocampus, medial prefrontal, and frontopolar cortices, and the forceps minor and left hippocampal portion of the cingulum bundle. Regions exclusively implicated in each time period were also identified. The integrity of the anterior temporal cortices was related to the retrieval of remote memories, whereas the posterior cingulate cortex emerged as a structure significantly associated with recent autobiographical memory retrieval. This study represents the first investigation of the grey and white matter correlates of remote and recent autobiographical memory retrieval in neurodegenerative disorders. Our findings demonstrate the importance of core brain structures, including the medial prefrontal cortex and hippocampus, irrespective of time period, and point towards the contribution of discrete regions in mediating successful retrieval of distant versus recently experienced events.     

Event-related potentials during paired associate memory paradigm

We have studied event-related potentials (ERPs) during a visual paired association task with delayed discrimination in 10 normal right-handed subjects. After subjects completely memorized 4 pairs of figures during a learning period, they were presented with each cue (S1) and asked to judge whether the following figure (S2) formed one of the memorized pairs or not. A choice reaction task with delay was used for control in an attempt to identify brain activity specifically related to memory function. ERPs were recorded from 21 scalp electrodes and those occurring between the S1 and S2 presentation were analyzed. Two ERP components associated with memory function were identified in the difference waveform between the responses in the paired association task and those in the choice reaction task. One was a posterior positive component which appeared between 390 ms and 1100 ms after the S1 presentation and the other was a sustained frontal negative component which began at about 1100 ms after S1 and ended just before the S2 presentation. Both potentials were distributed predominantly on the scalp overlying the left hemisphere. It is postulated that the early posterior positive component may reflect retrieval of information from association memory, whereas the late frontal negativity may reflect retention of information in working memory.     

Electrophysiological correlates of strategic monitoring in event-based and time-based prospective memory

Prospective memory (PM) is the ability to remember to accomplish an action when a particular event occurs (i.e., event-based PM), or at a specific time (i.e., time-based PM) while performing an ongoing activity. Strategic Monitoring is one of the basic cognitive functions supporting PM tasks, and involves two mechanisms: a retrieval mode, which consists of maintaining active the intention in memory; and target checking, engaged for verifying the presence of the PM cue in the environment. The present study is aimed at providing the first evidence of event-related potentials (ERPs) associated with time-based PM, and at examining differences and commonalities in the ERPs related to Strategic Monitoring mechanisms between event- and time-based PM tasks.The addition of an event-based or a time-based PM task to an ongoing activity led to a similar sustained positive modulation of the ERPs in the ongoing trials, mainly expressed over prefrontal and frontal regions. This modulation might index the retrieval mode mechanism, similarly engaged in the two PM tasks. On the other hand, two further ERP modulations were shown specifically in an event-based PM task. An increased positivity was shown at 400-600 ms post-stimulus over occipital and parietal regions, and might be related to target checking. Moreover, an early modulation at 130-180 ms post-stimulus seems to reflect the recruitment of attentional resources for being ready to respond to the event-based PM cue. This latter modulation suggests the existence of a third mechanism specific for the event-based PM; that is, the "readiness mode".     

Dissociating memory retrieval processes using fMRI: evidence that priming does not support recognition memory

We employed event-related fMRI to constrain cognitive accounts of memory retrieval. Studies of explicit retrieval reveal that lateral and medial parietal, dorsal middle frontal gyrus, and anterior prefrontal cortex respond more for studied than new words, reflecting a correlate of "retrieval success." Studies of implicit memory suggest left temporal cortex, ventral and dorsal inferior frontal gyrus respond less for studied than new words, reflecting a correlate of "conceptual priming." In the present study, responses for old and new items were compared during performance on explicit recognition (old/new judgement) and semantic (abstract/concrete judgement) tasks. Regions associated with priming were only modulated during the semantic task, whereas regions associated with retrieval success were modulated during both tasks. These findings constrain functional-anatomic accounts of the networks, suggesting that processes associated with priming do not support explicit recognition judgments.     

Monitoring the mind: the neurocognitive correlates of metamemory

Memory performance in everyday life is often far from perfect and therefore needs to be monitored and controlled by metamemory evaluations, such as judgments of learning (JOLs). JOLs support monitoring for goal-directed modification of learning. Behavioral studies suggested retrieval processes as providing a basis for JOLs. Previous functional imaging research on JOLs found a dissociation between processes underlying memory prediction, located in the medial prefrontal cortex (mPFC), and actual encoding success, located in the medial temporal lobe. However, JOL-specific neural correlates could not be identified unequivocally, since JOLs were given simultaneously with encoding. Here, we aimed to identify the neurocognitive basis of JOLs, i.e., the cognitive processes and neural correlates of JOL, separate from initial encoding. Using functional magnetic resonance imaging (fMRI), we implemented a face-name paired associative design. In general, we found that actual memory success was associated with increased brain activation of the hippocampi bilaterally, whereas predicted memory success was accompanied by increased activation in mPFC, orbital frontal and anterior cingulate cortices. Masking brain activation during predicted memory success with activation during retrieval success revealed BOLD increases of the mPFC. Our findings indicate that JOLs actually incorporate retrieval processes.     

Success in Competition for Space in Two Invasive Coral Species in the western Atlantic – Tubastraea micranthus and T. coccinea

Invasion success by an alien species is dependent upon rate of reproduction, growth, mortality, physical characteristics of the environment, and successful competition for resources with native species. For sessile, epibenthic marine species, one critical resource is space. We examined competitive success in two invasive Indo-Pacific corals involved in competition for space in the northern Gulf of Mexico—Tubastraea coccinea and T. micranthus—on up to 13 offshore oil/gas platforms south of the Mississippi River. Still-capture photos of thousands of overgrowth interactions between the target corals and other sessile epibenthic fauna were analyzed from ROV videos collected at 8–183 m depth. T. micranthus was observed overgrowing >90% of all sessile epibenthic species which it encountered. Frequencies of competitive success varied significantly between platforms. T. coccinea was competitively superior to all competitors pooled, at the 60% level. There was little variability between T. coccinea populations. T. coccinea encountered the following species most frequently—the encrusting sponges Xestospongia sp. (with the commensal Parazoanthus catenularis), X. carbonaria, Dictyonella funicularis, Mycale carmigropila, Phorbas amaranthus, and Haliclona vansoesti—and was found to be, on average, competitively superior to them. Both T. micranthus and T. coccinea appear to be good competitors for space against these species in the northern Gulf of Mexico. Competitive success in T. micranthus was highest in the NE part of the study area, and lowest in the SW area near the Mississippi River plume. T. coccinea’s competitive success peaked in the SW study area. This suggests that variation in competitive success both within and between populations of these species may be due to differences in local environmental factors.     

On the tip of the tongue: an event-related fMRI study of semantic retrieval failure and cognitive conflict.

The tip of the tongue (TOT) state refers to a temporary inaccessibility of information that one is sure exists in long-term memory and is on the verge of recovering. Using event-related fMRI, we assessed the neural correlates of this semantic retrieval failure to determine whether the anterior cingulate-lateral prefrontal neural circuit posited to mediate conflict resolution is engaged during metacognitive conflicts that arise during the TOT. Results revealed that, relative to successful retrieval or unsuccessful retrieval not accompanied by a TOT, retrieval failures accompanied by TOTs elicited a selective response in anterior cingulate-prefrontal cortices. During a TOT, cognitive control mechanisms may be recruited in attempts to resolve the conflict and retrieval failure that characterize this state.     

The Time Course of Activation of Object Shape and Shape+Colour Representations during Memory Retrieval

Little is known about the timing of activating memory for objects and their associated perceptual properties, such as colour, and yet this is important for theories of human cognition. We investigated the time course associated with early cognitive processes related to the activation of object shape and object shape+colour representations respectively, during memory retrieval as assessed by repetition priming in an event-related potential (ERP) study. The main findings were as follows: (1) we identified a unique early modulation of mean ERP amplitude during the N1 that was associated with the activation of object shape independently of colour; (2) we also found a subsequent early P2 modulation of mean amplitude over the same electrode clusters associated with the activation of object shape+colour representations; (3) these findings were apparent across both familiar (i.e., correctly coloured – yellow banana) and novel (i.e., incorrectly coloured - blue strawberry) objects; and (4) neither of the modulations of mean ERP amplitude were evident during the P3. Together the findings delineate the timing of object shape and colour memory systems and support the notion that perceptual representations of object shape mediate the retrieval of temporary shape+colour representations for familiar and novel objects.     

Recollection-Based Retrieval Is Influenced by Contextual Variation at Encoding but Not at Retrieval

In this article, we investigated the effects of variations at encoding and retrieval on recollection. We argue that recollection is more likely to be affected by the processing that information undergoes at encoding than at retrieval. To date, manipulations shown to affect recollection were typically carried out at encoding. Therefore, an open question is whether these same manipulations would also affect recollection when carried out at retrieval, or whether there is an inherent connection between their effects on recollection and the encoding stage. We therefore manipulated, at either encoding or retrieval, fluency of processing (Experiment 1)—typically found not to affect recollection—and the amount of attentional resources available for processing (Experiments 2 and 3)—typically reported to affect recollection. We found that regardless of the type of manipulation, recollection was affected more by manipulations carried out at encoding and was essentially unaffected when these manipulations were carried out at retrieval. These findings suggest an inherent dependency between recollection-based retrieval and the encoding stage. It seems that because recollection is a contextual-based retrieval process, it is determined by the processing information undergoes at encoding—at the time when context is bound with the items—but not at retrieval—when context is only recovered.     

Re-Examination of Chinese Semantic Processing and Syntactic Processing: Evidence from Conventional ERPs and Reconstructed ERPs by Residue Iteration Decomposition (RIDE)

A number of studies have explored the time course of Chinese semantic and syntactic processing. However, whether syntactic processing occurs earlier than semantics during Chinese sentence reading is still under debate. To further explore this issue, an event-related potentials (ERPs) experiment was conducted on 21 native Chinese speakers who read individually-presented Chinese simple sentences (NP1+VP+NP2) word-by-word for comprehension and made semantic plausibility judgments. The transitivity of the verbs was manipulated to form three types of stimuli: congruent sentences (CON), sentences with a semantically violated NP2 following a transitive verb (semantic violation, SEM), and sentences with a semantically violated NP2 following an intransitive verb (combined semantic and syntactic violation, SEM+SYN). The ERPs evoked from the target NP2 were analyzed by using the Residue Iteration Decomposition (RIDE) method to reconstruct the ERP waveform blurred by trial-to-trial variability, as well as by using the conventional ERP method based on stimulus-locked averaging. The conventional ERP analysis showed that, compared with the critical words in CON, those in SEM and SEM+SYN elicited an N400–P600 biphasic pattern. The N400 effects in both violation conditions were of similar size and distribution, but the P600 in SEM+SYN was bigger than that in SEM. Compared with the conventional ERP analysis, RIDE analysis revealed a larger N400 effect and an earlier P600 effect (in the time window of 500–800 ms instead of 570–810ms). Overall, the combination of conventional ERP analysis and the RIDE method for compensating for trial-to-trial variability confirmed the non-significant difference between SEM and SEM+SYN in the earlier N400 time window. Converging with previous findings on other Chinese structures, the current study provides further precise evidence that syntactic processing in Chinese does not occur earlier than semantic processing.     

Electrophysiological Differences in the Processing of Affect Misattribution

The affect misattribution procedure (AMP) was proposed as a technique to measure an implicit attitude to a prime image [1]. In the AMP, neutral symbols (e.g., a Chinese pictograph, called the target) are presented, following an emotional stimulus (known as the prime). Participants often misattribute the positive or negative affect of the priming images to the targets in spite of receiving an instruction to ignore the primes. The AMP effect has been investigated using behavioral measures; however, it is difficult to identify when the AMP effect occurs in emotional processing—whether the effect may occur in the earlier attention allocation stage or in the later evaluation stage. In this study, we examined the neural correlates of affect misattribution, using event-related potential (ERP) dividing the participants into two groups based on their tendency toward affect misattribution. The ERP results showed that the amplitude of P2 was larger for the prime at the parietal location in participants showing a low tendency to misattribution than for those showing a high tendency, while the effect of judging neutral targets amiss according to the primes was reflected in the late processing of targets (LPP). In addition, the topographic pattern analysis revealed that EPN-like component to targets was correlated with the difference of AMP tendency as well as P2 to primes and LPP to targets. Taken together, the mechanism of the affective misattribution was closely related to the attention allocation processing. Our findings provide neural evidence that evaluations of neutral targets are misattributed to emotional primes.