Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity

 A computational model of hippocampal activity during spatial cognition and navigation tasks is presented. The spatial representation in our model of the rat hippocampus is built on-line during exploration via two processing streams. An allothetic vision-based representation is built by unsupervised Hebbian learning extracting spatio-temporal properties of the environment from visual input. An idiothetic representation is learned based on internal movement-related information provided by path integration. On the level of the hippocampus, allothetic and idiothetic representations are integrated to yield a stable representation of the environment by a population of localized overlapping CA3-CA1 place fields. The hippocampal spatial representation is used as a basis for goal-oriented spatial behavior. We focus on the neural pathway connecting the hippocampus to the nucleus accumbens. Place cells drive a population of locomotor action neurons in the nucleus accumbens. Reward-based learning is applied to map place cell activity into action cell activity. The ensemble action cell activity provides navigational maps to support spatial behavior. We present experimental results obtained with a mobile Khepera robot. Received: 02 July 1999 / Accepted in revised form: 20 March 2000     

Robotic and neuronal simulation of the hippocampus and rat navigation.

The properties of hippocampal place cells are reviewed, with particular attention to the nature of the internal and external signals that support their firing. A neuronal simulation of the firing of place cells in open-field environments of varying shape is presented. This simulation is coupled with an existing model of how place-cell firing can be used to drive navigation, and is tested by implementation as a miniature mobile robot. The sensors on the robot provide visual, odometric and short-range proximity data, which are combined to estimate the distance of the walls of the enclosure from the robot and the robot''s current heading direction. These inputs drive the hippocampal simulation, in which the robot''s location is represented as the firing of place cells. If a goal location is encountered, learning occurs in connections from the concurrently active place cells to a set of ''goal cells'', which guide subsequent navigation, allowing the robot to return to an unmarked location. The system shows good agreement with actual place-cell firing, and makes predictions regarding the firing of cells in the subiculum, the effect of blocking long-term synaptic changes, and the locus of search of rats after deformation of their environment.     

Animat navigation using a cognitive graph

 This article describes a computational model of the hippocampus that makes it possible for a simulated rat to navigate in a continuous environment containing obstacles. This model views the hippocampus as a “cognitive graph”, that is, a hetero-associative network that learns temporal sequences of visited places and stores a topological representation of the environment. Calling upon place cells, head direction cells, and “goal cells”, it suggests a biologically plausible way of exploiting such a spatial representation for navigation that does not require complicated graph-search algorithms. Moreover, it permits “latent learning” during exploration, that is, the building of a spatial representation without the need of any reinforcement. When the rat occasionally discovers some rewarding place it may wish to rejoin subsequently, it simply records within its cognitive graph, through a series of goal and sub-goal cells, the direction in which to move from any given start place. Accordingly, the model implements a simple “place-recognition-triggered response” navigation strategy. Two implementations of place cell management are studied in parallel. The first one associates place cells with place fields that are given a priori and that are uniformly distributed in the environment. The second one dynamically recruits place cells as exploration proceeds and adjusts the density of such cells to the local complexity of the environment. Both implementations lead to identical results. The article ends with a few predictions about results to be expected in experiments involving simultaneous recordings of multiple cells in the rat hippocampus. Received: 25 June 1999 / Accepted in revised form: 20 March 2000     

Spiking Neurons in a Hierarchical Self-Organizing Map Model Can Learn to Develop Spatial and Temporal Properties of Entorhinal Grid Cells and Hippocampal Place Cells

Medial entorhinal grid cells and hippocampal place cells provide neural correlates of spatial representation in the brain. A place cell typically fires whenever an animal is present in one or more spatial regions, or places, of an environment. A grid cell typically fires in multiple spatial regions that form a regular hexagonal grid structure extending throughout the environment. Different grid and place cells prefer spatially offset regions, with their firing fields increasing in size along the dorsoventral axes of the medial entorhinal cortex and hippocampus. The spacing between neighboring fields for a grid cell also increases along the dorsoventral axis. This article presents a neural model whose spiking neurons operate in a hierarchy of self-organizing maps, each obeying the same laws. This spiking GridPlaceMap model simulates how grid cells and place cells may develop. It responds to realistic rat navigational trajectories by learning grid cells with hexagonal grid firing fields of multiple spatial scales and place cells with one or more firing fields that match neurophysiological data about these cells and their development in juvenile rats. The place cells represent much larger spaces than the grid cells, which enable them to support navigational behaviors. Both self-organizing maps amplify and learn to categorize the most frequent and energetic co-occurrences of their inputs. The current results build upon a previous rate-based model of grid and place cell learning, and thus illustrate a general method for converting rate-based adaptive neural models, without the loss of any of their analog properties, into models whose cells obey spiking dynamics. New properties of the spiking GridPlaceMap model include the appearance of theta band modulation. The spiking model also opens a path for implementation in brain-emulating nanochips comprised of networks of noisy spiking neurons with multiple-level adaptive weights for controlling autonomous adaptive robots capable of spatial navigation.     

A novel somatosensory spatial navigation system outside the hippocampal formation

Spatially selective firing of place cells, grid cells, boundary vector/border cells and head direction cells constitutes the basic building blocks of a canonical spatial navigation system centered on the hippocampal-entorhinal complex. While head direction cells can be found throughout the brain, spatial tuning outside the hippocampal formation is often non-specific or conjunctive to other representations such as a reward. Although the precise mechanism of spatially selective firing activity is not understood, various studies show sensory inputs, particularly vision, heavily modulate spatial representation in the hippocampal-entorhinal circuit. To better understand the contribution of other sensory inputs in shaping spatial representation in the brain, we performed recording from the primary somatosensory cortex in foraging rats. To our surprise, we were able to detect the full complement of spatially selective firing patterns similar to that reported in the hippocampal-entorhinal network, namely, place cells, head direction cells, boundary vector/border cells, grid cells and conjunctive cells, in the somatosensory cortex. These newly identified somatosensory spatial cells form a spatial map outside the hippocampal formation and support the hypothesis that location information modulates body representation in the somatosensory cortex. Our findings provide transformative insights into our understanding of how spatial information is processed and integrated in the brain, as well as functional operations of the somatosensory cortex in the context of rehabilitation with brain-machine interfaces.Subject terms: Biological techniques, Cell biology     

From view cells and place cells to cognitive map learning: processing stages of the hippocampal system

 The goal of this paper is to propose a model of the hippocampal system that reconciles the presence of neurons that look like “place cells” with the implication of the hippocampus (Hs) in other cognitive tasks (e.g., complex conditioning acquisition and memory tasks). In the proposed model, “place cells” or “view cells” are learned in the perirhinal and entorhinal cortex. The role of the Hs is not fundamentally dedicated to navigation or map building, the Hs is used to learn, store, and predict transitions between multimodal states. This transition prediction mechanism could be important for novelty detection but, above all, it is crucial to merge planning and sensory–motor functions in a single and coherent system. A neural architecture embedding this model has been successfully tested on an autonomous robot, during navigation and planning in an open environment. Received: 28 June 1999 / Accepted in revised form: 26 April 2001     

Uncovering spatial topology represented by rat hippocampal population neuronal codes

Hippocampal population codes play an important role in representation of spatial environment and spatial navigation. Uncovering the internal representation of hippocampal population codes will help understand neural mechanisms of the hippocampus. For instance, uncovering the patterns represented by rat hippocampus (CA1) pyramidal cells during periods of either navigation or sleep has been an active research topic over the past decades. However, previous approaches to analyze or decode firing patterns of population neurons all assume the knowledge of the place fields, which are estimated from training data a priori. The question still remains unclear how can we extract information from population neuronal responses either without a priori knowledge or in the presence of finite sampling constraint. Finding the answer to this question would leverage our ability to examine the population neuronal codes under different experimental conditions. Using rat hippocampus as a model system, we attempt to uncover the hidden "spatial topology" represented by the hippocampal population codes. We develop a hidden Markov model (HMM) and a variational Bayesian (VB) inference algorithm to achieve this computational goal, and we apply the analysis to extensive simulation and experimental data. Our empirical results show promising direction for discovering structural patterns of ensemble spike activity during periods of active navigation. This study would also provide useful insights for future exploratory data analysis of population neuronal codes during periods of sleep.     

What can the hippocampal representation of environmental geometry tell us about Hebbian learning?

 The importance of the hippocampus in spatial representation is well established. It is suggested that the rodent hippocampal network should provide an optimal substrate for the study of unsupervised Hebbian learning. We focus on the firing characteristics of hippocampal place cells in morphologically different environments. A hard-wired quantitative geometric model of individual place fields is reviewed and presented as the framework in which to understand the additional effects of synaptic plasticity. Existent models employing Hebbian learning are also reviewed. New information is presented regarding the dynamics of place field plasticity over short and long time scales in experiments using barriers and differently shaped walled environments. It is argued that aspects of the temporal dynamics of stability and plasticity in the hippocampal place cell representation both indicate modifications to, and inform the nature of, the synaptic plasticity in place cell models. Our results identify a potential neural basis for long-term incidental learning of environments and provide strong constraints for the way the unsupervised learning in cell assemblies envisaged by Hebb might occur within the hippocampus. Received: 8 March 2002 / Accepted: 13 June 2002 Acknowledgements. This work was supported by the Medical Research Council of the United Kingdom. Correspondence to: C. Lever or N. Burgess (e-mail: colin.lever@ucl.ac.uk; n.burgess@ucl.ac.uk, Tel.: +44-20-76793388 or 1147, Fax: +44-20-76791306 or 1145)     

Coordinated learning of grid cell and place cell spatial and temporal properties: multiple scales,attention and oscillations

A neural model proposes how entorhinal grid cells and hippocampal place cells may develop as spatial categories in a hierarchy of self-organizing maps (SOMs). The model responds to realistic rat navigational trajectories by learning both grid cells with hexagonal grid firing fields of multiple spatial scales, and place cells with one or more firing fields, that match neurophysiological data about their development in juvenile rats. Both grid and place cells can develop by detecting, learning and remembering the most frequent and energetic co-occurrences of their inputs. The model''s parsimonious properties include: similar ring attractor mechanisms process linear and angular path integration inputs that drive map learning; the same SOM mechanisms can learn grid cell and place cell receptive fields; and the learning of the dorsoventral organization of multiple spatial scale modules through medial entorhinal cortex to hippocampus (HC) may use mechanisms homologous to those for temporal learning through lateral entorhinal cortex to HC (‘neural relativity’). The model clarifies how top-down HC-to-entorhinal attentional mechanisms may stabilize map learning, simulates how hippocampal inactivation may disrupt grid cells, and explains data about theta, beta and gamma oscillations. The article also compares the three main types of grid cell models in the light of recent data.     

Increased attention to spatial context increases both place field stability and spatial memory

The hippocampal formation is critical for the acquisition and consolidation of memories. When recorded in freely moving animals, hippocampal pyramidal neurons fire in a location-specific manner: they are "place" cells, comprising a hippocampal representation of the animal's environment. To explore the relationship between place cells and spatial memory, we recorded from mice in several behavioral contexts. We found that long-term stability of place cell firing fields correlates with the degree of attentional demands and that successful spatial task performance was associated with stable place fields. Furthermore, conditions that maximize place field stability greatly increase orientation to novel cues. This suggests that storage and retrieval of place cells is modulated by a top-down cognitive process resembling attention and that place cells are neural correlates of spatial memory. We propose a model whereby attention provides the requisite neuromodulatation to switch short-term homosynaptic plasticity to long-term heterosynaptic plasticity, and we implicate dopamine in this process.     

Independence of landmark and self-motion-guided navigation: a different role for grid cells

Recent interest in the neural bases of spatial navigation stems from the discovery of neuronal populations with strong, specific spatial signals. The regular firing field arrays of medial entorhinal grid cells suggest that they may provide place cells with distance information extracted from the animal''s self-motion, a notion we critically review by citing new contrary evidence. Next, we question the idea that grid cells provide a rigid distance metric. We also discuss evidence that normal navigation is possible using only landmarks, without self-motion signals. We then propose a model that supposes that information flow in the navigational system changes between light and dark conditions. We assume that the true map-like representation is hippocampal and argue that grid cells have a crucial navigational role only in the dark. In this view, their activity in the light is predominantly shaped by landmarks rather than self-motion information, and so follows place cell activity; in the dark, their activity is determined by self-motion cues and controls place cell activity. A corollary is that place cell activity in the light depends on non-grid cells in ventral medial entorhinal cortex. We conclude that analysing navigational system changes between landmark and no-landmark conditions will reveal key functional properties.     

Independence of the unimodal tuning of firing rate from theta phase precession in hippocampal place cells

There are two prominent features for place cells in rat hippocampus. The firing rate remarkably increases when rat enters the cell’s place field and reaches a maximum around the center of place field, and it decreases when the animal approaches the end of the place field. Simultaneously the spikes gradually and monotonically advance to earlier phase relative to hippocampal theta rhythm as the rat traverses along the cell’s place field, known as temporal coding. In this paper, we investigate whether two main characteristics of place cell firing are independent or not by mainly focusing on the generation mechanism of the unimodal tuning of firing rate by using a reduced CA1 two-compartment neuron model. Based on recent evidences, we hypothesize that the coupling of dendritic with the somatic compartment is not constant but dynamically regulated as the animal moves further along the place field, in contrast to previous two-compartment modeling. Simulations show that the regulable coupling is critically responsible for the generation of unimodal firing rate profile in place cells, independent of phase precession. Predictions of our model accord well with recent observations like occurrence of phase precession with very low as well as high firing rate (Huxter et al. Nature 425:828–832, 2003) and persistency of phase precession after transient silence of hippocampus activity (Zugaro et al. Nat Neurosci 8:67–71, 2005.     

Theta phase precession of grid and place cell firing in open environments

Place and grid cells in the rodent hippocampal formation tend to fire spikes at successively earlier phases relative to the local field potential theta rhythm as the animal runs through the cell''s firing field on a linear track. However, this ‘phase precession’ effect is less well characterized during foraging in two-dimensional open field environments. Here, we mapped runs through the firing fields onto a unit circle to pool data from multiple runs. We asked which of seven behavioural and physiological variables show the best circular–linear correlation with the theta phase of spikes from place cells in hippocampal area CA1 and from grid cells from superficial layers of medial entorhinal cortex. The best correlate was the distance to the firing field peak projected onto the animal''s current running direction. This was significantly stronger than other correlates, such as instantaneous firing rate and time-in-field, but similar in strength to correlates with other measures of distance travelled through the firing field. Phase precession was stronger in place cells than grid cells overall, and robust phase precession was seen in traversals through firing field peripheries (although somewhat less than in traversals through the centre), consistent with phase coding of displacement along the current direction. This type of phase coding, of place field distance ahead of or behind the animal, may be useful for allowing calculation of goal directions during navigation.     

A computational model of the hippocampus that represents environmental structure and goal location,and guides movement

Hippocampal place cells (PCs) are believed to represent environmental structure. However, it is unclear how and which brain regions represent goals and guide movements. Recently, another type of cells that fire around a goal was found in rat hippocampus (we designate these cells as goal place cells, GPCs). This suggests that the hippocampus is also involved in goal representation. Assuming that the activities of GPCs depend on the distance to a goal, we propose an adaptive navigation model. By monitoring the population activity of GPCs, the model navigates to shorten the distance to the goal. To achieve the distance-dependent activities of GPCs, plastic connections are assumed between PCs and GPCs, which are modified depending on two reward-triggered activities: activity propagation through PC–PC network representing the topological environmental structure, and the activity of GPCs with different durations. The former activity propagation is regarded as a computational interpretation of “reverse replay” phenomenon found in rat hippocampus. Simulation results confirm that after reaching a goal only once, the model can navigate to the goal along almost the shortest path from arbitrary places in the environment. This indicates that the hippocampus might play a primary role in the representation of not only the environmental structure but also the goal, in addition to guiding the movement. This navigation strategy using the population activity of GPCs is equivalent to the taxis strategy, the simplest and most basic for biological systems. Our model is unique because this simple strategy allows the model to follow the shortest path in the topological map of the environment.     

Locating and navigation mechanism based on place-cell and grid-cell models

Extensive experiments on rats have shown that environmental cues play an important role in goal locating and navigation. Major studies about locating and navigation are carried out based only on place cells. Nevertheless, it is known that navigation may also rely on grid cells. Therefore, we model locating and navigation based on both, thus developing a novel grid-cell model, from which firing fields of grid cells can be obtained. We found a continuous-time dynamic system to describe learning and direction selection. In our simulation experiment, according to the results from physiology experiments, we successfully rebuild place fields of place cells and firing fields of grid cells. We analyzed the factors affecting the locating accuracy. Results show that the learning rate, firing threshold and cell number can influence the outcomes from various tasks. We used our system model to perform a goal navigation task and showed that paths that are changed for every run in one experiment converged to a stable one after several runs.     

Place representation within hippocampal networks is modified by long-term potentiation

In the brain, information is encoded by the firing patterns of neuronal ensembles and the strength of synaptic connections between individual neurons. We report here that representation of the environment by "place" cells is altered by changing synaptic weights within hippocampal networks. Long-term potentiation (LTP) of intrinsic hippocampal pathways abolished existing place fields, created new place fields, and rearranged the temporal relationship within the affected population. The effect of LTP on neuron discharge was rate and context dependent. The LTP-induced "remapping" occurred without affecting the global firing rate of the network. The findings support the view that learned place representation can be accomplished by LTP-like synaptic plasticity within intrahippocampal networks.     

From Rapid Place Learning to Behavioral Performance: A Key Role for the Intermediate Hippocampus

Rapid place encoding by hippocampal neurons, as reflected by place-related firing, has been intensely studied, whereas the substrates that translate hippocampal place codes into behavior have received little attention. A key point relevant to this translation is that hippocampal organization is characterized by functional–anatomical gradients along the septotemporal axis: Whereas the ability of hippocampal neurons to encode accurate place information declines from the septal to temporal end, hippocampal connectivity to prefrontal and subcortical sites that might relate such place information to behavioral-control processes shows an opposite gradient. We examined in rats the impact of selective lesions to relevant parts of the hippocampus on behavioral tests requiring place learning (watermaze procedures) and on in vivo electrophysiological models of hippocampal encoding (long-term potentiation [LTP], place cells). We found that the intermediate hippocampus is necessary and largely sufficient for behavioral performance based on rapid place learning. In contrast, a residual septal pole of the hippocampus, although displaying intact electrophysiological indices of rapid information encoding (LTP, precise place-related firing, and rapid remapping), failed to sustain watermaze performance based on rapid place learning. These data highlight the important distinction between hippocampal encoding and the behavioral performance based on such encoding, and suggest that the intermediate hippocampus, where substrates of rapid accurate place encoding converge with links to behavioral control, is critical to translate rapid (one-trial) place learning into navigational performance.     

Triple-loop model of path control by head direction and place cells

 Arthropods as well as mammals are able to return straight home after a random search excursion under conditions that are designed to exclude all external cues. After a brief clarification of the terminology, two principal systems of information processing that can achieve this performance are introduced and analysed: Polar versus Cartesian path integration. The different demands and achievements of the two systems are confronted with neurophysiological findings on the functioning of the hippocampus, and with a recent comprehensive model of how the hippocampal place cells perform path integration. To connect the neurophysiological findings with the behavior of the animal, a new model is developed. It achieves three functionally diverse performances: maintenance and control of a compass direction, navigation by path integration, and formation of goals by connecting non-spatial features with their location. This is done by three interconnected feedback loops, set by a common reference variable. Their information-processing structure enables the animal not only to home but also to go straight from any stored goal to any other, without explicit representation of the distance between them, and without a topological arrangement of the store. The model explains behaviors not yet understood and predicts still undiscovered performances. Because it allows the isolation of orienting from storing functions yet also shows how they can be connected, the model may help to reconcile conflicting views on the function of the hippocampus. Received: 17 June 1999 / Accepted in revised form: 20 March 2000     

Representing episodes in the mammalian brain

Memory lets the past inform the present so that we can attain future goals. In many species, these abilities require the hippocampus. Recent experiments, in which memory demand was varied while overt behavior and the environment were kept constant, have revealed firing patterns of hippocampal neurons that corresponded with memory demands and predicted performance. Although the active population appeared to be 'place cells' that signalled location, it actually included cells the activity patterns of which distinguished the recent or pending history of behavior during identical actions that occurred in the same place. Different populations of hippocampal cells fired as a rat walked along the same spatial path on the way to different goals, and coded past, present and pending events. Other experiments provide converging data that neuronal activity is modulated by goal-directed behavioral episodes. Together, these firing patterns suggest a testable mechanism of episodic memory coding: that hippocampal dynamics encode a temporally extended, hierarchically organized representation of goal-directed behavior.     

Models of place and grid cell firing and theta rhythmicity

Neuronal firing in the hippocampal formation (HF) of freely moving rodents shows striking examples of spatialorganization in the form of place, directional, boundary vector and grid cells. The firing of place and grid cells shows an intriguing form of temporal organization known as 'theta phase precession'. We review the mechanisms underlying theta phase precession of place cell firing, ranging from membrane potential oscillations to recurrent connectivity, and the relevant intra-cellular and extra-cellular data. We then consider the use of these models to explain the spatial structure of grid cell firing, and review the relevant intra-cellular and extra-cellular data. Finally, we consider the likely interaction between place cells, grid cells and boundary vector cells in estimating self-location as a compromise between path-integration and environmental information.