Components of episodic memory: the contribution of recollection and familiarity

The examination of recognition memory confidence judgements indicates that there are two separate components or processes underlying episodic memory. A model that accounts for these results is described in which a recollection process and a familiarity process are assumed to contribute to recognition memory performance. Recollection is assumed to reflect a threshold process whereby qualitative information about the study event is retrieved, whereas familiarity reflects a classical signal-detection process whereby items exceeding a familiarity response criterion are accepted as having been studied. Evidence from cognitive, neuropsychological and neuroimaging studies indicate that the model is in agreement with the existing recognition results, and indicate that recollection and familiarity are behaviourally, neurally and phenomenologically distinct memory retrieval processes.     

Misattribution, false recognition and the sins of memory

Memory is sometimes a troublemaker. Schacter has classified memory's transgressions into seven fundamental 'sins': transience, absent-mindedness, blocking, misattribution, suggestibility, bias and persistence. This paper focuses on one memory sin, misattribution, that is implicated in false or illusory recognition of episodes that never occurred. We present data from cognitive, neuropsychological and neuroimaging studies that illuminate aspects of misattribution and false recognition. We first discuss cognitive research examining possible mechanisms of misattribution associated with false recognition. We also consider ways in which false recognition can be reduced or avoided, focusing in particular on the role of distinctive information. We next turn to neuropsychological research concerning patients with amnesia and Alzheimer's disease that reveals conditions under which such patients are less susceptible to false recognition than are healthy controls, thus providing clues about the brain mechanisms that drive false recognition. We then consider neuroimaging studies concerned with the neural correlates of true and false recognition, examining when the two forms of recognition can and cannot be distinguished on the basis of brain activity. Finally, we argue that even though misattribution and other memory sins are annoying and even dangerous, they can also be viewed as by-products of adaptive features of memory.     

Learning related interactions among neuronal systems involved in memory processes

Functional neuroimaging techniques using positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) have provided new insights in our understanding of brain function from the molecular to the systems level. While subtraction strategy based data analyses have revealed the involvement of distributed brain regions in memory processes, covariance analysis based data analysis strategies allow functional interactions between brain regions of a neuronal network to be assessed. The focus of this chapter is to (1) establish the functional topography of episodic and working memory processes in young and old normal volunteers, (2) to assess functional interactions between modules of networks of brain regions by means of covariance based analyses and systems level modelling and (3) to relate neuroimaging data to the underpinning neural networks. Male normal young and old volunteers without neurological or psychiatric illness participated in neuroimaging studies (PET, fMRI) on working and episodic memory. Distributed brain areas are involved in memory processes (episodic and working memory) in young volunteers and show much of an overlap with respect to the network components. Systems level modelling analyses support the hypothesis of bihemispheric, asymmetric networks subserving memory processes and revealed both similarities in general and differences in the interactions between brain regions during episodic encoding and retrieval as well as working memory. Changes in memory function with ageing are evident from studies in old volunteers activating more brain regions compared to young volunteers and revealing more and stronger influences of prefrontal regions. We finally discuss the way in which the systems level models based on PET and fMRI results have implications for the understanding of the underlying neural network functioning of the brain.     

The human hippocampus and spatial and episodic memory

Finding one's way around an environment and remembering the events that occur within it are crucial cognitive abilities that have been linked to the hippocampus and medial temporal lobes. Our review of neuropsychological, behavioral, and neuroimaging studies of human hippocampal involvement in spatial memory concentrates on three important concepts in this field: spatial frameworks, dimensionality, and orientation and self-motion. We also compare variation in hippocampal structure and function across and within species. We discuss how its spatial role relates to its accepted role in episodic memory. Five related studies use virtual reality to examine these two types of memory in ecologically valid situations. While processing of spatial scenes involves the parahippocampus, the right hippocampus appears particularly involved in memory for locations within an environment, with the left hippocampus more involved in context-dependent episodic or autobiographical memory.     

Mental time travel in animals: a challenging question

Humans have the ability to mentally recreate past events (using episodic memory) and imagine future events (by planning). The best evidence for such mental time travel is personal and thus subjective. For this reason, it is particularly difficult to study such behavior in animals. There is some indirect evidence, however, that animals have both episodic memory and the ability to plan for the future. When unexpectedly asked to do so, animals can report about their recent past experiences (episodic memory) and they also appear to be able to use the anticipation of a future event as the basis for a present action (planning). Thus, the ability to imagine past and future events may not be uniquely human.     

Representing episodes in the mammalian brain

Memory lets the past inform the present so that we can attain future goals. In many species, these abilities require the hippocampus. Recent experiments, in which memory demand was varied while overt behavior and the environment were kept constant, have revealed firing patterns of hippocampal neurons that corresponded with memory demands and predicted performance. Although the active population appeared to be 'place cells' that signalled location, it actually included cells the activity patterns of which distinguished the recent or pending history of behavior during identical actions that occurred in the same place. Different populations of hippocampal cells fired as a rat walked along the same spatial path on the way to different goals, and coded past, present and pending events. Other experiments provide converging data that neuronal activity is modulated by goal-directed behavioral episodes. Together, these firing patterns suggest a testable mechanism of episodic memory coding: that hippocampal dynamics encode a temporally extended, hierarchically organized representation of goal-directed behavior.     

Memory for events and their spatial context: models and experiments

The computational role of the hippocampus in memory has been characterized as: (i) an index to disparate neocortical storage sites; (ii) a time-limited store supporting neocortical long-term memory; and (iii) a content-addressable associative memory. These ideas are reviewed and related to several general aspects of episodic memory, including the differences between episodic, recognition and semantic memory, and whether hippocampal lesions differentially affect recent or remote memories. Some outstanding questions remain, such as: what characterizes episodic retrieval as opposed to other forms of read-out from memory; what triggers the storage of an event memory; and what are the neural mechanisms involved? To address these questions a neural-level model of the medial temporal and parietal roles in retrieval of the spatial context of an event is presented. This model combines the idea that retrieval of the rich context of real-life events is a central characteristic of episodic memory, and the idea that medial temporal allocentric representations are used in long-term storage while parietal egocentric representations are used to imagine, manipulate and re-experience the products of retrieval. The model is consistent with the known neural representation of spatial information in the brain, and provides an explanation for the involvement of Papez''s circuit in both the representation of heading direction and in the recollection of episodic information. Two experiments relating to the model are briefly described. A functional neuroimaging study of memory for the spatial context of life-like events in virtual reality provides support for the model''s functional localization. A neuropsychological experiment suggests that the hippocampus does store an allocentric representation of spatial locations.     

Re-Imagining the Future: Repetition Decreases Hippocampal Involvement in Future Simulation

Imagining or simulating future events has been shown to activate the anterior right hippocampus (RHC) more than remembering past events does. One fundamental difference between simulation and memory is that imagining future scenarios requires a more extensive constructive process than remembering past experiences does. Indeed, studies in which this constructive element is reduced or eliminated by “pre-imagining” events in a prior session do not report differential RHC activity during simulation. In this fMRI study, we examined the effects of repeatedly simulating an event on neural activity. During scanning, participants imagined 60 future events; each event was simulated three times. Activation in the RHC showed a significant linear decrease across repetitions, as did other neural regions typically associated with simulation. Importantly, such decreases in activation could not be explained by non-specific linear time-dependent effects, with no reductions in activity evident for the control task across similar time intervals. Moreover, the anterior RHC exhibited significant functional connectivity with the whole-brain network during the first, but not second and third simulations of future events. There was also evidence of a linear increase in activity across repetitions in right ventral precuneus, right posterior cingulate and left anterior prefrontal cortex, which may reflect source recognition and retrieval of internally generated contextual details. Overall, our findings demonstrate that repeatedly imagining future events has a decremental effect on activation of the hippocampus and many other regions engaged by the initial construction of the simulation, possibly reflecting the decreasing novelty of simulations across repetitions, and therefore is an important consideration in the design of future studies examining simulation.     

Theories of episodic memory

Theories of episodic memory need to specify the encoding (representing), storage, and retrieval processes that underlie this form of memory and indicate the brain regions that mediate these processes and how they do so. Representation and re-representation (retrieval) of the spatiotemporally linked series of scenes, which constitute an episode, are probably mediated primarily by those parts of the posterior neocortex that process perceptual and semantic information. However, some role of the frontal neocortex and medial temporal lobes in representing aspects of context and high-level visual object information at encoding and retrieval cannot currently be excluded. Nevertheless, it is widely believed that the frontal neocortex is mainly involved in coordinating episodic encoding and retrieval and that the medial temporal lobes store aspects of episodic information. Establishing where storage is located is very difficult and disagreement remains about the role of the posterior neocortex in episodic memory storage. One view is that this region stores all aspects of episodic memory ab initio for as long as memory lasts. This is compatible with evidence that the amygdala, basal forebrain, and midbrain modulate neocortical storage. Another view is that the posterior neocortex only gradually develops the ability to store some aspects of episodic information as a function of rehearsal over time and that this information is initially stored by the medial temporal lobes. A third view is that the posterior neocortex never stores these aspects of episodic information because the medial temporal lobes store them for as long as memory lasts in an increasingly redundant fashion. The last two views both postulate that the medial temporal lobes initially store contextual markers that serve to cohere featural information stored in the neocortex. Lesion and functional neuroimaging evidence still does not clearly distinguish between these views. Whether the feeling that an episodic memory is familiar depends on retrieving an association between a retrieved episode and this feeling, or by an attribution triggered by a priming process, is unclear. Evidence about whether the hippocampus and medial temporal lobe cortices play different roles in episodic memory is conflicting. Identifying similarities and differences between episodic memory and both semantic memory and priming will require careful componential analysis of episodic memory.     

"What-Where-Which" Episodic Retrieval Requires Conscious Recollection and Is Promoted by Semantic Knowledge

Episodic memory is defined as the conscious retrieval of specific past events. Whether accurate episodic retrieval requires a recollective experience or if a feeling of knowing is sufficient remains unresolved. We recently devised an ecological approach to investigate the controlled cued-retrieval of episodes composed of unnamable odors (What) located spatially (Where) within a visual context (Which context). By combining the Remember/Know procedure with our laboratory-ecological approach in an original way, the present study demonstrated that the accurate odor-evoked retrieval of complex and multimodal episodes overwhelmingly required conscious recollection. A feeling of knowing, even when associated with a high level of confidence, was not sufficient to generate accurate episodic retrieval. Interestingly, we demonstrated that the recollection of accurate episodic memories was promoted by odor retrieval-cue familiarity and describability. In conclusion, our study suggested that semantic knowledge about retrieval-cues increased the recollection which is the state of awareness required for the accurate retrieval of complex episodic memories.     

Key Features of Human Episodic Recollection in the Cross-Episode Retrieval of Rat Hippocampus Representations of Space

Neurophysiological studies focus on memory retrieval as a reproduction of what was experienced and have established that neural discharge is replayed to express memory. However, cognitive psychology has established that recollection is not a verbatim replay of stored information. Recollection is constructive, the product of memory retrieval cues, the information stored in memory, and the subject''s state of mind. We discovered key features of constructive recollection embedded in the rat CA1 ensemble discharge during an active avoidance task. Rats learned two task variants, one with the arena stable, the other with it rotating; each variant defined a distinct behavioral episode. During the rotating episode, the ensemble discharge of CA1 principal neurons was dynamically organized to concurrently represent space in two distinct codes. The code for spatial reference frame switched rapidly between representing the rat''s current location in either the stationary spatial frame of the room or the rotating frame of the arena. The code for task variant switched less frequently between a representation of the current rotating episode and the stable episode from the rat''s past. The characteristics and interplay of these two hippocampal codes revealed three key properties of constructive recollection. (1) Although the ensemble representations of the stable and rotating episodes were distinct, ensemble discharge during rotation occasionally resembled the stable condition, demonstrating cross-episode retrieval of the representation of the remote, stable episode. (2) This cross-episode retrieval at the level of the code for task variant was more likely when the rotating arena was about to match its orientation in the stable episode. (3) The likelihood of cross-episode retrieval was influenced by preretrieval information that was signaled at the level of the code for spatial reference frame. Thus key features of episodic recollection manifest in rat hippocampal representations of space.     

Gender-Specific Differences in the Relationship between Autobiographical Memory and Intertemporal Choice in Older Adults

As the population of older adults grows, their economic choices will have increasing impact on society. Research on the effects of aging on intertemporal decisions shows inconsistent, often opposing results, indicating that yet unexplored factors might play an essential role in guiding one''s choices. Recent studies suggest that episodic future thinking, which is based on the same neural network involved in episodic memory functions, leads to reductions in discounting of future rewards. As episodic memory functioning declines with normal aging, but to greatly variable degrees, individual differences in delay discounting might be due to individual differences in the vitality of this memory system in older adults. We investigated this hypothesis, using a sample of healthy older adults who completed an intertemporal choice task as well as two episodic memory tasks. We found no clear evidence for a relationship between episodic memory performance and delay discounting in older adults. However, when additionally considering gender differences, we found an interaction effect of gender and autobiographical memory on delay discounting: while men with higher memory scores showed less delay discounting, women with higher memory scores tended to discount the future more. We speculate that this gender effect might stem from the gender-specific use of different modal representation formats (i.e. temporal or visual) during assessment of intertemporal choice options.     

Functional imaging of memory processes in humans: positron emission tomography and functional magnetic resonance imaging

Human memory is not a unitary function; it consists of multiple memory systems, with different characteristics and specialisations that are implemented in the brain. The cognitive neuroscience of human memory tries to comprehend how we encode, store, and retrieve memory items within and across those systems. The emergence of functional neuroimaging techniques offered the unprecedented opportunity to directly observe the brain regions engaged in memory functions. Brain imaging techniques can roughly be divided into those measuring the electric or magnetic fields generated by neuronal activity (EEG, magnetencephalography [MEG]) and those measuring the haemodynamic or metabolic sequelae of neuronal activity (positron emission tomography [PET], functional magnetic resonance imaging [fMRI]). Out of these techniques, the following two will be discussed in detail: fMRI and PET. Although functional neuroimaging is able to acquire images of the brain engaged in consolidating or retrieving memories, these processes are not clearly visible in the data. Statistical techniques are needed to reduce the complexity of the data and to extract the processes of interest. This article outlines the experimental and analytical procedures of neuroimaging studies with PET and fMRI. We will use a PET-study on episodic memory in human volunteers to illustrate design, analysis, and interpretation of functional imaging studies on memory.     

Episodic Future Thinking in Semantic Dementia: A Cognitive and fMRI Study

Semantic dementia (SD) is characterized by gradual loss of semantic memory. While episodic autobiographical memory seems relatively preserved, behavioral studies suggest that episodic future thinking is impaired. We used fMRI to measure brain activity in four SD patients (JPL, EP, LL, EG) while they envisioned future events and remembered personal past events. Twelve healthy elders served as controls. Episodic quality, emotion, mental imagery and level of consciousness (via remember/know judgements) were checked at debriefing. We analyzed the future compared to the past for each patient. All patients presented lateral temporal atrophy, but varied in terms of frontal and anterior hippocampal atrophy. Patient JPL presented atrophy in bilateral superior medial frontal gyri and left anterior hippocampus and was unable to engage in episodic future thinking, despite hyperactivations in frontal and occipital regions. Patient EP presented no atrophy in the anterior hippocampus, but atrophy in bilateral superior medial frontal gyrus and had difficulties to engage in episodic future thinking. Patient LL presented atrophy in left anterior hippocampus, but hyperactivated its right counterpart for future compared to past thinking, permitting her to project efficiently in the future in an episodic way. Patient EG presented no atrophy in the superior medial frontal gyri or anterior hippocampi and was able to engage in episodic future thinking. Altogether, patients'' future projections differed depending on the severity and localization of their atrophy. The functional integrity of bilateral superior medial frontal gyri and anterior hippocampus appear crucial for episodic future thinking: atrophy of both structures strongly impairs future projection, while integrity of these structures or hyperactivation of residual tissue normalizes episodic future projection.     

Autobiographical Thinking Interferes with Episodic Memory Consolidation

New episodic memories are retained better if learning is followed by a few minutes of wakeful rest than by the encoding of novel external information. Novel encoding is said to interfere with the consolidation of recently acquired episodic memories. Here we report four experiments in which we examined whether autobiographical thinking, i.e. an ‘internal’ memory activity, also interferes with episodic memory consolidation. Participants were presented with three wordlists consisting of common nouns; one list was followed by wakeful rest, one by novel picture encoding and one by autobiographical retrieval/future imagination, cued by concrete sounds. Both novel encoding and autobiographical retrieval/future imagination lowered wordlist retention significantly. Follow-up experiments demonstrated that the interference by our cued autobiographical retrieval/future imagination delay condition could not be accounted for by the sound cues alone or by executive retrieval processes. Moreover, our results demonstrated evidence of a temporal gradient of interference across experiments. Thus, we propose that rich autobiographical retrieval/future imagination hampers the consolidation of recently acquired episodic memories and that such interference is particularly likely in the presence of external concrete cues.     

Episodic memory and common sense: how far apart?

Research has revealed facts about human memory in general and episodic memory in particular that deviate from both common sense and previously accepted ideas. This paper discusses some of these deviations in light of the proceedings of The Royal Society's Discussion Meeting on episodic memory. Retrieval processes play a more critical role in memory than commonly assumed; people can remember events that never happened; and conscious thoughts about one's personal past can take two distinct forms-'autonoetic' remembering and 'noetic' knowing. The serial-dependent-independent (SPI) model of the relations among episodic, semantic and perceptual memory systems accounts for a number of puzzling phenomena, such as some amnesic patients' preserved recognition memory and their ability to learn new semantic facts, and holds that episodic remembering of perceptual information can occur only by virtue of its mediation through semantic memory. Although common sense endows many animals with the ability to remember their past experiences, as yet there is no evidence that humanlike episodic memory-defined in terms of subjective time, self, and autonoetic awareness-is present in any other species.     

When encoding yields remembering: insights from event-related neuroimaging.

To understand human memory, it is important to determine why some experiences are remembered whereas others are forgotten. Until recently, insights into the neural bases of human memory encoding, the processes by which information is transformed into an enduring memory trace, have primarily been derived from neuropsychological studies of humans with select brain lesions. The advent of functional neuroimaging methods, such as positron emission tomography (PET) and functional magnetic resonance imaging (fMRI), has provided a new opportunity to gain additional understanding of how the brain supports memory formation. Importantly, the recent development of event-related fMRI methods now allows for examination of trial-by-trial differences in neural activity during encoding and of the consequences of these differences for later remembering. In this review, we consider the contributions of PET and fMRI studies to the understanding of memory encoding, placing a particular emphasis on recent event-related fMRI studies of the Dm effect: that is, differences in neural activity during encoding that are related to differences in subsequent memory. We then turn our attention to the rich literature on the Dm effect that has emerged from studies using event-related potentials (ERPs). It is hoped that the integration of findings from ERP studies, which offer higher temporal resolution, with those from event-related fMRI studies, which offer higher spatial resolution, will shed new light on when and why encoding yields subsequent remembering.     

Brain imaging and memory systems in humans: the contribution of PET methods

The development of neuroimaging methods such as PET, has provided a new impulse to the study of the neural basis of cognitive functions, and has extended the field of inquiry from the analysis of the consequences of brain lesions to the functional investigations of brain activity, either in patients with selective neuropsychological deficits or in normal subjects engaged in cognitive tasks. Specific patterns of hypometabolism in neurological patients are associated with different profiles of memory deficits. [¹⁸F]FDG PET studies have confirmed the association of episodic memory with the structures of Papez's circuit and have shown correlations between short-term and semantic memory and the language areas. The identification of anatomo-functional networks involved in specific components of memory function in normal subjects is the aim of several PET activation studies. The results are in agreement with ‘neural network’ models of the neural basis of memory, as complex functions subserved by multiple interconnected cortical and subcortical structures.     

The neural basis of episodic memory: evidence from functional neuroimaging

We review some of our recent research using functional neuroimaging to investigate neural activity supporting the encoding and retrieval of episodic memories, that is, memories for unique events. Findings from studies of encoding indicate that, at the cortical level, the regions responsible for the effective encoding of a stimulus event as an episodic memory include some of the regions that are also engaged to process the event 'online'. Thus, it appears that there is no single cortical site or circuit responsible for episodic encoding. The results of retrieval studies indicate that successful recollection of episodic information is associated with activation of lateral parietal cortex, along with more variable patterns of activity in dorsolateral and anterior prefrontal cortex. Whereas parietal regions may play a part in the representation of retrieved information, prefrontal areas appear to support processes that act on the products of retrieval to align behaviour with the demands of the retrieval task.