Neural dynamics of the cognitive map in the hippocampus

The rodent hippocampus has been thought to represent the spatial environment as a cognitive map. In the classical theory, the cognitive map has been explained as a consequence of the fact that different spatial regions are assigned to different cell populations in the framework of rate coding. Recently, the relation between place cell firing and local field oscillation theta in terms of theta phase precession was experimentally discovered and suggested as a temporal coding mechanism leading to memory formation of behavioral sequences accompanied with asymmetric Hebbian plasticity. The cognitive map theory is apparently outside of the sequence memory view. Therefore, theoretical analysis is necessary to consider the biological neural dynamics for the sequence encoding of the memory of behavioral sequences, providing the cognitive map formation. In this article, we summarize the theoretical neural dynamics of the real-time sequence encoding by theta phase precession, called theta phase coding, and review a series of theoretical models with the theta phase coding that we previously reported. With respect to memory encoding functions, instantaneous memory formation of one-time experience was first demonstrated, and then the ability of integration of memories of behavioral sequences into a network of the cognitive map was shown. In terms of memory retrieval functions, theta phase coding enables the hippocampus to represent the spatial location in the current behavioral context even with ambiguous sensory input when multiple sequences were coded. Finally, for utilization, retrieved temporal sequences in the hippocampus can be available for action selection, through the process of reverting theta rhythm-dependent activities to information in the behavioral time scale. This theoretical approach allows us to investigate how the behavioral sequences are encoded, updated, retrieved and used in the hippocampus, as the real-time interaction with the external environment. It may indeed be the bridge to the episodic memory function in human hippocampus.     

Artificial Theta Stimulation Impairs Encoding of Contextual Fear Memory

Several experiments have demonstrated an intimate relationship between hippocampal theta rhythm (4–12 Hz) and memory. Lesioning the medial septum or fimbria-fornix, a fiber track connecting the hippocampus and the medial septum, abolishes the theta rhythm and results in a severe impairment in declarative memory. To assess whether there is a causal relationship between hippocampal theta and memory formation we investigated whether restoration of hippocampal theta by electrical stimulation during the encoding phase also restores fimbria-fornix lesion induced memory deficit in rats in the fear conditioning paradigm. Male Wistar rats underwent sham or fimbria-fornix lesion operation. Stimulation electrodes were implanted in the ventral hippocampal commissure and recording electrodes in the septal hippocampus. Artificial theta stimulation of 8 Hz was delivered during 3-min free exploration of the test cage in half of the rats before aversive conditioning with three foot shocks during 2 min. Memory was assessed by total freezing time in the same environment 24 h and 28 h after fear conditioning, and in an intervening test session in a different context. As expected, fimbria-fornix lesion impaired fear memory and dramatically attenuated hippocampal theta power. Artificial theta stimulation produced continuous theta oscillations that were almost similar to endogenous theta rhythm in amplitude and frequency. However, contrary to our predictions, artificial theta stimulation impaired conditioned fear response in both sham and fimbria-fornix lesioned animals. These data suggest that restoration of theta oscillation per se is not sufficient to support memory encoding after fimbria-fornix lesion and that universal theta oscillation in the hippocampus with a fixed frequency may actually impair memory.     

Inhibition enhances memory capacity: optimal feedback, transient replay and oscillations

Recurring sequences of neuronal activation in the hippocampus are a candidate for a neurophysiological correlate of episodic memory. Here, we discuss a mean-field theory for such spike sequences in phase space and show how they become unstable when the neuronal network operates at maximum memory capacity. We find that inhibitory feedback rescues replay of the sequences, giving rise to oscillations and thereby enhancing the network’s capacity. We further argue that transient sequences in an overloaded network with feedback inhibition may provide a mechanistic picture of memory-related neuronal activity during hippocampal sharp-wave ripple complexes.     

Hippocampal memory consolidation during sleep: a comparison of mammals and birds

The transition from wakefulness to sleep is marked by pronounced changes in brain activity. The brain rhythms that characterize the two main types of mammalian sleep, slow‐wave sleep (SWS) and rapid eye movement (REM) sleep, are thought to be involved in the functions of sleep. In particular, recent theories suggest that the synchronous slow‐oscillation of neocortical neuronal membrane potentials, the defining feature of SWS, is involved in processing information acquired during wakefulness. According to the Standard Model of memory consolidation, during wakefulness the hippocampus receives input from neocortical regions involved in the initial encoding of an experience and binds this information into a coherent memory trace that is then transferred to the neocortex during SWS where it is stored and integrated within preexisting memory traces. Evidence suggests that this process selectively involves direct connections from the hippocampus to the prefrontal cortex (PFC), a multimodal, high‐order association region implicated in coordinating the storage and recall of remote memories in the neocortex. The slow‐oscillation is thought to orchestrate the transfer of information from the hippocampus by temporally coupling hippocampal sharp‐wave/ripples (SWRs) and thalamocortical spindles. SWRs are synchronous bursts of hippocampal activity, during which waking neuronal firing patterns are reactivated in the hippocampus and neocortex in a coordinated manner. Thalamocortical spindles are brief 7–14 Hz oscillations that may facilitate the encoding of information reactivated during SWRs. By temporally coupling the readout of information from the hippocampus with conditions conducive to encoding in the neocortex, the slow‐oscillation is thought to mediate the transfer of information from the hippocampus to the neocortex. Although several lines of evidence are consistent with this function for mammalian SWS, it is unclear whether SWS serves a similar function in birds, the only taxonomic group other than mammals to exhibit SWS and REM sleep. Based on our review of research on avian sleep, neuroanatomy, and memory, although involved in some forms of memory consolidation, avian sleep does not appear to be involved in transferring hippocampal memories to other brain regions. Despite exhibiting the slow‐oscillation, SWRs and spindles have not been found in birds. Moreover, although birds independently evolved a brain region—the caudolateral nidopallium (NCL)—involved in performing high‐order cognitive functions similar to those performed by the PFC, direct connections between the NCL and hippocampus have not been found in birds, and evidence for the transfer of information from the hippocampus to the NCL or other extra‐hippocampal regions is lacking. Although based on the absence of evidence for various traits, collectively, these findings suggest that unlike mammalian SWS, avian SWS may not be involved in transferring memories from the hippocampus. Furthermore, it suggests that the slow‐oscillation, the defining feature of mammalian and avian SWS, may serve a more general function independent of that related to coordinating the transfer of information from the hippocampus to the PFC in mammals. Given that SWS is homeostatically regulated (a process intimately related to the slow‐oscillation) in mammals and birds, functional hypotheses linked to this process may apply to both taxonomic groups.     

Encoding new episodes and making them stick

How do we encode, store, and retrieve new episodic memories, and what are the computations performed by the hippocampus during this process? One system that has been used to model the brain basis of episodic memory in humans is the study of spatial navigation by path integration in rodents. Here I discuss three exciting new findings focused on encoding or replay of spatial sequences in the rat hippocampus. These findings not only provide important new insight into the computations associated with encoding and consolidation of spatial trajectories, but may also have implications for understanding key aspects of human episodic memory.     

Movement-related theta rhythm in humans: coordinating self-directed hippocampal learning

The hippocampus is crucial for episodic or declarative memory and the theta rhythm has been implicated in mnemonic processing, but the functional contribution of theta to memory remains the subject of intense speculation. Recent evidence suggests that the hippocampus might function as a network hub for volitional learning. In contrast to human experiments, electrophysiological recordings in the hippocampus of behaving rodents are dominated by theta oscillations reflecting volitional movement, which has been linked to spatial exploration and encoding. This literature makes the surprising cross-species prediction that the human hippocampal theta rhythm supports memory by coordinating exploratory movements in the service of self-directed learning. We examined the links between theta, spatial exploration, and memory encoding by designing an interactive human spatial navigation paradigm combined with multimodal neuroimaging. We used both non-invasive whole-head Magnetoencephalography (MEG) to look at theta oscillations and Functional Magnetic Resonance Imaging (fMRI) to look at brain regions associated with volitional movement and learning. We found that theta power increases during the self-initiation of virtual movement, additionally correlating with subsequent memory performance and environmental familiarity. Performance-related hippocampal theta increases were observed during a static pre-navigation retrieval phase, where planning for subsequent navigation occurred. Furthermore, periods of the task showing movement-related theta increases showed decreased fMRI activity in the parahippocampus and increased activity in the hippocampus and other brain regions that strikingly overlap with the previously observed volitional learning network (the reverse pattern was seen for stationary periods). These fMRI changes also correlated with participant's performance. Our findings suggest that the human hippocampal theta rhythm supports memory by coordinating exploratory movements in the service of self-directed learning. These findings directly extend the role of the hippocampus in spatial exploration in rodents to human memory and self-directed learning.     

Input-dependent learning rule for the memory of spatiotemporal sequences in hippocampal network with theta phase precession

Theta phase precession in rat hippocampal place cells is hypothesized to contribute to memory encoding of running experience in the sense that it provides the ideal timing for synaptic plasticity and enables the asymmetric associative connections under the Hebbian learning rule with asymmetric time window (Yamaguchi 2003). When the sequence of place fields is considered as the episodic memory of running experience, a given spatial route should be accurately stored in spite of differing overlap extent among place fields and varying running velocity. Using a hippocampal network model with phase precession and the Hebbian learning rule with asymmetric time window, we investigate the memory encoding of place field sequences in a single traversal experience. Computer experiments show that place fields cannot be stored correctly until an input-dependent feature is introduced into the learning rule. These experiments further indicate that there exists an optimum value for the saturation level of synaptic plasticity and the speed of synaptic plasticity in the learning rule, which are correlated with, respectively, the overlap extent of place field sequence and the running velocity of animal during traversal. A comparison of these results with biological evidences shows good agreement and suggests that behavior-dependent regulation of the learning rule is necessary for memory encoding.     

Memory of sequential experience in the hippocampus during slow wave sleep

Rats repeatedly ran through a sequence of spatial receptive fields of hippocampal CA1 place cells in a fixed temporal order. A novel combinatorial decoding method reveals that these neurons repeatedly fired in precisely this order in long sequences involving four or more cells during slow wave sleep (SWS) immediately following, but not preceding, the experience. The SWS sequences occurred intermittently in brief ( approximately 100 ms) bursts, each compressing the behavioral sequence in time by approximately 20-fold. This rapid encoding of sequential experience is consistent with evidence that the hippocampus is crucial for spatial learning in rodents and the formation of long-term memories of events in time in humans.     

Benefits of hierarchical generalization and storage of the representations of "object-place" associations in the hippocampal subfields (a hypothesis)

We analyzed the results of experimental research of features of processing sensory information in the hippocampus and neocortex available in literature and results of modelling the perception of information in the neocortex. It is noted that "place" fields of neurons become wider, and overlapping of receptive fields increases during upward moving in trisynaptic hippocampal pathway. These effects specify the generalization of the information processed. The results of our analysis allow us to put forward a hypothesis that a hierarchical complication of"object - place" associations occurs during upward propagation of signals through all hippocampal subfields. Complexity of neural representations of "object - place" associations that are formed and permanently stored in the hippocampal areas increases in process of propagation of signals from the entorhinal cortex to the hierarchically higher dentate gyrus, area CA3 and area CA1. Therefore, with the aim to extract information about "object - place" associations with certain details it is necessary to access that hippocampal area in which associations were processed and stored with the required degree of elaboration. By analogy with the neocortex, it is proposed that such processing of information in the hippocampus makes it possible to avoid the combinatorial explosion and provides storing (memory) the associations accumulated during the life. The proposed mechanism can serve as an addition to the known multiple trace theory, which states that the hippocampus is an integrating part of memory trace and is always involved in recall of long-delayed episodes.     

Regulation of histone acetylation during memory formation in the hippocampus

Formation of long term memory begins with the activation of many disparate signaling pathways that ultimately impinge on the cellular mechanisms regulating gene expression. We investigated whether mechanisms regulating chromatin structure were activated during the early stages of long term memory formation in the hippocampus. Specifically, we investigated hippocampal histone acetylation during the initial stages of consolidation of long term association memories in a contextual fear conditioning paradigm. Acetylation of histone H3 in area CA1 of the hippocampus was regulated in contextual fear conditioning, an effect dependent on activation of N-methyl-D-aspartic acid (NMDA) receptors and ERK, and blocked using a behavioral latent inhibition paradigm. Activation of NMDA receptors in area CA1 in vitro increased acetylation of histone H3, and this effect was blocked by inhibition of ERK signaling. Moreover, activation of ERK in area CA1 in vitro through either the protein kinase C or protein kinase A pathways, biochemical events known to be involved in long term memory formation, also increased histone H3 acetylation. Furthermore, we observed that elevating levels of histone acetylation through the use of the histone deacetylase inhibitors trichostatin A or sodium butyrate enhanced induction of long term potentiation at Schaffer-collateral synapses in area CA1 of the hippocampus, a candidate mechanism contributing to long term memory formation in vivo. In concert with our findings in vitro, injection of animals with sodium butyrate prior to contextual fear conditioning enhanced formation of long term memory. These results indicate that histone-associated heterochromatin undergoes changes in structure during the formation of long term memory. Mimicking memory-associated changes in heterochromatin enhances a cellular process thought to underlie long term memory formation, hippocampal long term potentiation, and memory formation itself.     

Effects of the BDNF Val66Met Polymorphism and Met Allele Load on Declarative Memory Related Neural Networks

It has been suggested that the BDNF Val66Met polymorphism modulates episodic memory performance via effects on hippocampal neural circuitry. However, fMRI studies have yielded inconsistent results in this respect. Moreover, very few studies have examined the effect of met allele load on activation of memory circuitry. In the present study, we carried out a comprehensive analysis of the effects of the BDNF polymorphism on brain responses during episodic memory encoding and retrieval, including an investigation of the effect of met allele load on memory related activation in the medial temporal lobe. In contrast to previous studies, we found no evidence for an effect of BDNF genotype or met load during episodic memory encoding. Met allele carriers showed increased activation during successful retrieval in right hippocampus but this was contrast-specific and unaffected by met allele load. These results suggest that the BDNF Val66Met polymorphism does not, as previously claimed, exert an observable effect on neural systems underlying encoding of new information into episodic memory but may exert a subtle effect on the efficiency with which such information can be retrieved.     

Hippocampus Is Place of Interaction between Unconscious and Conscious Memories

Recent evidence suggests that humans can form and later retrieve new semantic relations unconsciously by way of hippocampus—the key structure also recruited for conscious relational (episodic) memory. If the hippocampus subserves both conscious and unconscious relational encoding/retrieval, one would expect the hippocampus to be place of unconscious-conscious interactions during memory retrieval. We tested this hypothesis in an fMRI experiment probing the interaction between the unconscious and conscious retrieval of face-associated information. For the establishment of unconscious relational memories, we presented subliminal (masked) combinations of unfamiliar faces and written occupations (“actor” or “politician”). At test, we presented the former subliminal faces, but now supraliminally, as cues for the reactivation of the unconsciously associated occupations. We hypothesized that unconscious reactivation of the associated occupation—actor or politician—would facilitate or inhibit the subsequent conscious retrieval of a celebrity’s occupation, which was also actor or politician. Depending on whether the reactivated unconscious occupation was congruent or incongruent to the celebrity’s occupation, we expected either quicker or delayed conscious retrieval process. Conscious retrieval was quicker in the congruent relative to a neutral baseline condition but not delayed in the incongruent condition. fMRI data collected during subliminal face-occupation encoding confirmed previous evidence that the hippocampus was interacting with neocortical storage sites of semantic knowledge to support relational encoding. fMRI data collected at test revealed that the facilitated conscious retrieval was paralleled by deactivations in the hippocampus and neocortical storage sites of semantic knowledge. We assume that the unconscious reactivation has pre-activated overlapping relational representations in the hippocampus reducing the neural effort for conscious retrieval. This finding supports the notion of synergistic interactions between conscious and unconscious relational memories in a common, cohesive hippocampal-neocortical memory space.     

Hippocampal Lesions Impair Rapid Learning of a Continuous Spatial Alternation Task

The hippocampus is essential for the formation of memories for events, but the specific features of hippocampal neural activity that support memory formation are not yet understood. The ideal experiment to explore this issue would be to monitor changes in hippocampal neural coding throughout the entire learning process, as subjects acquire and use new episodic memories to guide behavior. Unfortunately, it is not clear whether established hippocampally-dependent learning paradigms are suitable for this kind of experiment. The goal of this study was to determine whether learning of the W-track continuous alternation task depends on the hippocampal formation. We tested six rats with NMDA lesions of the hippocampal formation and four sham-operated controls. Compared to controls, rats with hippocampal lesions made a significantly higher proportion of errors and took significantly longer to reach learning criterion. The effect of hippocampal lesion was not due to a deficit in locomotion or motivation, because rats with hippocampal lesions ran well on a linear track for food reward. Rats with hippocampal lesions also exhibited a pattern of perseverative errors during early task experience suggestive of an inability to suppress behaviors learned during pretraining on a linear track. Our findings establish the W-track continuous alternation task as a hippocampally-dependent learning paradigm which may be useful for identifying changes in the neural representation of spatial sequences and reward contingencies as rats learn and apply new task rules.     

The hippocampus is coupled with the default network during memory retrieval but not during memory encoding

The brain's default mode network (DMN) is activated during internally-oriented tasks and shows strong coherence in spontaneous rest activity. Despite a surge of recent interest, the functional role of the DMN remains poorly understood. Interestingly, the DMN activates during retrieval of past events but deactivates during encoding of novel events into memory. One hypothesis is that these opposing effects reflect a difference between attentional orienting towards internal events, such as retrieved memories, vs. external events, such as to-be-encoded stimuli. Another hypothesis is that hippocampal regions are coupled with the DMN during retrieval but decoupled from the DMN during encoding. The present fMRI study investigated these two hypotheses by combining a resting-state coherence analysis with a task that measured the encoding and retrieval of both internally-generated and externally-presented events. Results revealed that the main DMN regions were activated during retrieval but deactivated during encoding. Counter to the internal orienting hypothesis, this pattern was not modulated by whether memory events were internal or external. Consistent with the hippocampal coupling hypothesis, the hippocampus behaved like other DMN regions during retrieval but not during encoding. Taken together, our findings clarify the relationship between the DMN and the neural correlates of memory retrieval and encoding.     

Complementary Roles of the Hippocampus and the Dorsomedial Striatum during Spatial and Sequence-Based Navigation Behavior

We investigated the neural bases of navigation based on spatial or sequential egocentric representation during the completion of the starmaze, a complex goal-directed navigation task. In this maze, mice had to swim along a path composed of three choice points to find a hidden platform. As reported previously, this task can be solved by using two hippocampal-dependent strategies encoded in parallel i) the allocentric strategy requiring encoding of the contextual information, and ii) the sequential egocentric strategy requiring temporal encoding of a sequence of successive body movements associated to specific choice points. Mice were trained during one day and tested the following day in a single probe trial to reveal which of the two strategies was spontaneously preferred by each animal. Imaging of the activity-dependent gene c-fos revealed that both strategies are supported by an overlapping network involving the dorsal hippocampus, the dorsomedial striatum (DMS) and the medial prefrontal cortex. A significant higher activation of the ventral CA1 subregion was observed when mice used the sequential egocentric strategy. To investigate the potential different roles of the dorsal hippocampus and the DMS in both types of navigation, we performed region-specific excitotoxic lesions of each of these two structures. Dorsal hippocampus lesioned mice were unable to optimally learn the sequence but improved their performances by developing a serial strategy instead. DMS lesioned mice were severely impaired, failing to learn the task. Our data support the view that the hippocampus organizes information into a spatio-temporal representation, which can then be used by the DMS to perform goal-directed navigation.     

An unexpected sequence of events: mismatch detection in the human hippocampus

The ability to identify and react to novelty within the environment is fundamental to survival. Computational models emphasize the potential role of the hippocampus in novelty detection, its unique anatomical circuitry making it ideally suited to act as a comparator between past and present experience. The hippocampus, therefore, is viewed to detect associative mismatches between what is expected based on retrieval of past experience and current sensory input. However, direct evidence that the human hippocampus performs such operations is lacking. We explored brain responses to novel sequences of objects using functional magnetic resonance imaging (fMRI), while subjects performed an incidental target detection task. Our results demonstrate that hippocampal activation was maximal when prior predictions concerning which object would appear next in a sequence were violated by sensory reality. In so doing, we establish the biological reality of associative match-mismatch computations within the human hippocampus, a process widely held to play a cardinal role in novelty detection. Our results also suggest that the hippocampus may generate predictions about how future events will unfold, and critically detect when these expectancies are violated, even when task demands do not require it. The present study also offers broader insights into the nature of essential computations carried out by the hippocampus, which may also underpin its unique contribution to episodic memory.     

Querying hippocampal replay with subcortical inputs

During sleep, the hippocampus recapitulates neuronal patterns corresponding to behavioral trajectories during previous experiences. This hippocampal replay supports the formation of long-term memories. Yet, whether replay originates within the hippocampal circuitry or is initiated by extrahippocampal inputs is unknown. Here, I review recent findings regarding the organization of neuronal activity upstream to the hippocampus, in the head-direction (HD) and grid cell networks, and its relationship to replay. I argue that hippocampal activity at the onset of replay is under the influence of signals from primary spatial areas. In turn, hippocampal replay resets the HD network activity to select a new direction for the next replay event. This reciprocal interaction between the HD network and the hippocampus may be essential in grounding meaning to hippocampal activity, specifically by training decoders of hippocampal sequences. Neuronal dynamics in thalamo-hippocampal loops may thus be instrumental for memory processes during sleep.     

The effect of negative and positive emotionality on associative memory: an FMRI study

In general, emotion is known to enhance memory processes. However, the effect of emotion on associative memory and the underling neural mechanisms remains largely unexplored. In this study, we explored brain activation during an associative memory task that involved the encoding and retrieval of word and face pairs. The word and face pairs consisted of either negative or positive words with neutral faces. Significant hippocampal activation was observed during both encoding and retrieval, regardless of whether the word was negative or positive. Negative and positive emotionality differentially affected the hemodynamic responses to encoding and retrieval in the amygdala, with increased responses during encoding negative word and face pairs. Furthermore, activation of the amygdala during encoding of negative word and neutral face pairs was inversely correlated with subsequent memory retrieval. These findings suggest that activation of the amygdala induced by negative emotion during encoding may disrupt associative memory performance.     

Differential consolidation and pattern reverberations within episodic cell assemblies in the mouse hippocampus

One hallmark feature of consolidation of episodic memory is that only a fraction of original information, which is usually in a more abstract form, is selected for long-term memory storage. How does the brain perform these differential memory consolidations? To investigate the neural network mechanism that governs this selective consolidation process, we use a set of distinct fearful events to study if and how hippocampal CA1 cells engage in selective memory encoding and consolidation. We show that these distinct episodes activate a unique assembly of CA1 episodic cells, or neural cliques, whose response-selectivity ranges from general-to-specific features. A series of parametric analyses further reveal that post-learning CA1 episodic pattern replays or reverberations are mostly mediated by cells exhibiting event intensity-invariant responses, not by the intensity-sensitive cells. More importantly, reactivation cross-correlations displayed by intensity-invariant cells encoding general episodic features during immediate post-learning period tend to be stronger than those displayed by invariant cells encoding specific features. These differential reactivations within the CA1 episodic cell populations can thus provide the hippocampus with a selection mechanism to consolidate preferentially more generalized knowledge for long-term memory storage.