Coordinated learning of grid cell and place cell spatial and temporal properties: multiple scales,attention and oscillations

A neural model proposes how entorhinal grid cells and hippocampal place cells may develop as spatial categories in a hierarchy of self-organizing maps (SOMs). The model responds to realistic rat navigational trajectories by learning both grid cells with hexagonal grid firing fields of multiple spatial scales, and place cells with one or more firing fields, that match neurophysiological data about their development in juvenile rats. Both grid and place cells can develop by detecting, learning and remembering the most frequent and energetic co-occurrences of their inputs. The model''s parsimonious properties include: similar ring attractor mechanisms process linear and angular path integration inputs that drive map learning; the same SOM mechanisms can learn grid cell and place cell receptive fields; and the learning of the dorsoventral organization of multiple spatial scale modules through medial entorhinal cortex to hippocampus (HC) may use mechanisms homologous to those for temporal learning through lateral entorhinal cortex to HC (‘neural relativity’). The model clarifies how top-down HC-to-entorhinal attentional mechanisms may stabilize map learning, simulates how hippocampal inactivation may disrupt grid cells, and explains data about theta, beta and gamma oscillations. The article also compares the three main types of grid cell models in the light of recent data.     

How Entorhinal Grid Cells May Learn Multiple Spatial Scales from a Dorsoventral Gradient of Cell Response Rates in a Self-organizing Map

Place cells in the hippocampus of higher mammals are critical for spatial navigation. Recent modeling clarifies how this may be achieved by how grid cells in the medial entorhinal cortex (MEC) input to place cells. Grid cells exhibit hexagonal grid firing patterns across space in multiple spatial scales along the MEC dorsoventral axis. Signals from grid cells of multiple scales combine adaptively to activate place cells that represent much larger spaces than grid cells. But how do grid cells learn to fire at multiple positions that form a hexagonal grid, and with spatial scales that increase along the dorsoventral axis? In vitro recordings of medial entorhinal layer II stellate cells have revealed subthreshold membrane potential oscillations (MPOs) whose temporal periods, and time constants of excitatory postsynaptic potentials (EPSPs), both increase along this axis. Slower (faster) subthreshold MPOs and slower (faster) EPSPs correlate with larger (smaller) grid spacings and field widths. A self-organizing map neural model explains how the anatomical gradient of grid spatial scales can be learned by cells that respond more slowly along the gradient to their inputs from stripe cells of multiple scales, which perform linear velocity path integration. The model cells also exhibit MPO frequencies that covary with their response rates. The gradient in intrinsic rhythmicity is thus not compelling evidence for oscillatory interference as a mechanism of grid cell firing. A response rate gradient combined with input stripe cells that have normalized receptive fields can reproduce all known spatial and temporal properties of grid cells along the MEC dorsoventral axis. This spatial gradient mechanism is homologous to a gradient mechanism for temporal learning in the lateral entorhinal cortex and its hippocampal projections. Spatial and temporal representations may hereby arise from homologous mechanisms, thereby embodying a mechanistic “neural relativity” that may clarify how episodic memories are learned.     

Independence of landmark and self-motion-guided navigation: a different role for grid cells

Recent interest in the neural bases of spatial navigation stems from the discovery of neuronal populations with strong, specific spatial signals. The regular firing field arrays of medial entorhinal grid cells suggest that they may provide place cells with distance information extracted from the animal''s self-motion, a notion we critically review by citing new contrary evidence. Next, we question the idea that grid cells provide a rigid distance metric. We also discuss evidence that normal navigation is possible using only landmarks, without self-motion signals. We then propose a model that supposes that information flow in the navigational system changes between light and dark conditions. We assume that the true map-like representation is hippocampal and argue that grid cells have a crucial navigational role only in the dark. In this view, their activity in the light is predominantly shaped by landmarks rather than self-motion information, and so follows place cell activity; in the dark, their activity is determined by self-motion cues and controls place cell activity. A corollary is that place cell activity in the light depends on non-grid cells in ventral medial entorhinal cortex. We conclude that analysing navigational system changes between landmark and no-landmark conditions will reveal key functional properties.     

Hippocampal Remapping Is Constrained by Sparseness rather than Capacity

Grid cells in the medial entorhinal cortex encode space with firing fields that are arranged on the nodes of spatial hexagonal lattices. Potential candidates to read out the space information of this grid code and to combine it with other sensory cues are hippocampal place cells. In this paper, we investigate a population of grid cells providing feed-forward input to place cells. The capacity of the underlying synaptic transformation is determined by both spatial acuity and the number of different spatial environments that can be represented. The codes for different environments arise from phase shifts of the periodical entorhinal cortex patterns that induce a global remapping of hippocampal place fields, i.e., a new random assignment of place fields for each environment. If only a single environment is encoded, the grid code can be read out at high acuity with only few place cells. A surplus in place cells can be used to store a space code for more environments via remapping. The number of stored environments can be increased even more efficiently by stronger recurrent inhibition and by partitioning the place cell population such that learning affects only a small fraction of them in each environment. We find that the spatial decoding acuity is much more resilient to multiple remappings than the sparseness of the place code. Since the hippocampal place code is sparse, we thus conclude that the projection from grid cells to the place cells is not using its full capacity to transfer space information. Both populations may encode different aspects of space.     

Increased size and stability of CA1 and CA3 place fields in HCN1 knockout mice

Hippocampal CA1 and CA3 pyramidal neuron place cells encode the spatial location of an animal through localized firing patterns called "place fields." To explore the mechanisms that control place cell firing and their relationship to spatial memory, we studied mice with enhanced spatial memory resulting from forebrain-specific knockout of the HCN1 hyperpolarization-activated cation channel. HCN1 is strongly expressed in CA1 neurons and in entorhinal cortex grid cells, which provide spatial information to the hippocampus. Both CA1 and CA3 place fields were larger but more stable in the knockout mice, with the effect greater in CA1 than CA3. As HCN1 is only weakly expressed in CA3 place cells, their altered activity likely reflects loss of HCN1 in grid cells. The more pronounced changes in CA1 likely reflect the intrinsic contribution of HCN1. The enhanced place field stability may underlie the effect of HCN1 deletion to facilitate spatial learning and memory.     

How to build a grid cell

Neurons in the medial entorhinal cortex fire action potentials at regular spatial intervals, creating a striking grid-like pattern of spike rates spanning the whole environment of a navigating animal. This remarkable spatial code may represent a neural map for path integration. Recent advances using patch-clamp recordings from entorhinal cortex neurons in vitro and in vivo have revealed how the microcircuitry in the medial entorhinal cortex may contribute to grid cell firing patterns, and how grid cells may transform synaptic inputs into spike output during firing field crossings. These new findings provide key insights into the ingredients necessary to build a grid cell.     

A model of grid cells based on a twisted torus topology

The grid cells of the rat medial entorhinal cortex (MEC) show an increased firing frequency when the position of the animal correlates with multiple regions of the environment that are arranged in regular triangular grids. Here, we describe an artificial neural network based on a twisted torus topology, which allows for the generation of regular triangular grids. The association of the activity of pre-defined hippocampal place cells with entorhinal grid cells allows for a highly robust-to-noise calibration mechanism, suggesting a role for the hippocampal back-projections to the entorhinal cortex.     

The mechanism of rate remapping in the dentate gyrus

Rate remapping is a recently revealed neural code in which sensory information modulates the firing rate of hippocampal place cells. The mechanism underlying rate remapping is unknown. Its characteristic modulation, however, must arise from the interaction of the two major inputs to the hippocampus, the medial entorhinal cortex (MEC), in which grid cells represent the spatial position of the rat, and the lateral entorhinal cortex (LEC), in which cells represent the sensory properties of the environment. We have used computational methods to elucidate the mechanism by which this interaction produces rate remapping. We show that the convergence of LEC and MEC inputs, in conjunction with a competitive network process mediated by feedback inhibition, can account quantitatively for this phenomenon. The same principle accounts for why different place fields of the same cell vary independently as sensory information is altered. Our results show that rate remapping can be explained in terms of known mechanisms.     

Differences in Visual-Spatial Input May Underlie Different Compression Properties of Firing Fields for Grid Cell Modules in Medial Entorhinal Cortex

Firing fields of grid cells in medial entorhinal cortex show compression or expansion after manipulations of the location of environmental barriers. This compression or expansion could be selective for individual grid cell modules with particular properties of spatial scaling. We present a model for differences in the response of modules to barrier location that arise from different mechanisms for the influence of visual features on the computation of location that drives grid cell firing patterns. These differences could arise from differences in the position of visual features within the visual field. When location was computed from the movement of visual features on the ground plane (optic flow) in the ventral visual field, this resulted in grid cell spatial firing that was not sensitive to barrier location in modules modeled with small spacing between grid cell firing fields. In contrast, when location was computed from static visual features on walls of barriers, i.e. in the more dorsal visual field, this resulted in grid cell spatial firing that compressed or expanded based on the barrier locations in modules modeled with large spacing between grid cell firing fields. This indicates that different grid cell modules might have differential properties for computing location based on visual cues, or the spatial radius of sensitivity to visual cues might differ between modules.     

Functional connectivity of the entorhinal–hippocampal space circuit

The mammalian space circuit is known to contain several functionally specialized cell types, such as place cells in the hippocampus and grid cells, head-direction cells and border cells in the medial entorhinal cortex (MEC). The interaction between the entorhinal and hippocampal spatial representations is poorly understood, however. We have developed an optogenetic strategy to identify functionally defined cell types in the MEC that project directly to the hippocampus. By expressing channelrhodopsin-2 (ChR2) selectively in the hippocampus-projecting subset of entorhinal projection neurons, we were able to use light-evoked discharge as an instrument to determine whether specific entorhinal cell groups—such as grid cells, border cells and head-direction cells—have direct hippocampal projections. Photoinduced firing was observed at fixed minimal latencies in all functional cell categories, with grid cells as the most abundant hippocampus-projecting spatial cell type. We discuss how photoexcitation experiments can be used to distinguish the subset of hippocampus-projecting entorhinal neurons from neurons that are activated indirectly through the network. The functional breadth of entorhinal input implied by this analysis opens up the potential for rich dynamic interactions between place cells in the hippocampus and different functional cell types in the entorhinal cortex (EC).     

A feedforward model for the formation of a grid field where spatial information is provided solely from place cells

Grid cells (GCs) in the medial entorhinal cortex (mEC) have the property of having their firing activity spatially tuned to a regular triangular lattice. Several theoretical models for grid field formation have been proposed, but most assume that place cells (PCs) are a product of the grid cell system. There is, however, an alternative possibility that is supported by various strands of experimental data. Here we present a novel model for the emergence of gridlike firing patterns that stands on two key hypotheses: (1) spatial information in GCs is provided from PC activity and (2) grid fields result from a combined synaptic plasticity mechanism involving inhibitory and excitatory neurons mediating the connections between PCs and GCs. Depending on the spatial location, each PC can contribute with excitatory or inhibitory inputs to GC activity. The nature and magnitude of the PC input is a function of the distance to the place field center, which is inferred from rate decoding. A biologically plausible learning rule drives the evolution of the connection strengths from PCs to a GC. In this model, PCs compete for GC activation, and the plasticity rule favors efficient packing of the space representation. This leads to gridlike firing patterns. In a new environment, GCs continuously recruit new PCs to cover the entire space. The model described here makes important predictions and can represent the feedforward connections from hippocampus CA1 to deeper mEC layers.     

Grid cells, place cells, and geodesic generalization for spatial reinforcement learning

Reinforcement learning (RL) provides an influential characterization of the brain's mechanisms for learning to make advantageous choices. An important problem, though, is how complex tasks can be represented in a way that enables efficient learning. We consider this problem through the lens of spatial navigation, examining how two of the brain's location representations--hippocampal place cells and entorhinal grid cells--are adapted to serve as basis functions for approximating value over space for RL. Although much previous work has focused on these systems' roles in combining upstream sensory cues to track location, revisiting these representations with a focus on how they support this downstream decision function offers complementary insights into their characteristics. Rather than localization, the key problem in learning is generalization between past and present situations, which may not match perfectly. Accordingly, although neural populations collectively offer a precise representation of position, our simulations of navigational tasks verify the suggestion that RL gains efficiency from the more diffuse tuning of individual neurons, which allows learning about rewards to generalize over longer distances given fewer training experiences. However, work on generalization in RL suggests the underlying representation should respect the environment's layout. In particular, although it is often assumed that neurons track location in Euclidean coordinates (that a place cell's activity declines "as the crow flies" away from its peak), the relevant metric for value is geodesic: the distance along a path, around any obstacles. We formalize this intuition and present simulations showing how Euclidean, but not geodesic, representations can interfere with RL by generalizing inappropriately across barriers. Our proposal that place and grid responses should be modulated by geodesic distances suggests novel predictions about how obstacles should affect spatial firing fields, which provides a new viewpoint on data concerning both spatial codes.     

Phase precession through acceleration of local theta rhythm: a biophysical model for the interaction between place cells and local inhibitory neurons

Phase precession is one of the most well known examples within the temporal coding hypothesis. Here we present a biophysical spiking model for phase precession in hippocampal CA1 which focuses on the interaction between place cells and local inhibitory interneurons. The model's functional block is composed of a place cell (PC) connected with a local inhibitory cell (IC) which is modulated by the population theta rhythm. Both cells receive excitatory inputs from the entorhinal cortex (EC). These inputs are both theta modulated and space modulated. The dynamics of the two neuron types are described by integrate-and-fire models with conductance synapses, and the EC inputs are described using non-homogeneous Poisson processes. Phase precession in our model is caused by increased drive to specific PC/IC pairs when the animal is in their place field. The excitation increases the IC's firing rate, and this modulates the PC's firing rate such that both cells precess relative to theta. Our model implies that phase coding in place cells may not be independent from rate coding. The absence of restrictive connectivity constraints in this model predicts the generation of phase precession in any network with similar architecture and subject to a clocking rhythm, independently of the involvement in spatial tasks.     

A biologically inspired hierarchical goal directed navigation model

We propose an extended version of our previous goal directed navigation model based on forward planning of trajectories in a network of head direction cells, persistent spiking cells, grid cells, and place cells. In our original work the animat incrementally creates a place cell map by random exploration of a novel environment. After the exploration phase, the animat decides on its next movement direction towards a goal by probing linear look-ahead trajectories in several candidate directions while stationary and picking the one activating place cells representing the goal location. In this work we present several improvements over our previous model. We improve the range of linear look-ahead probes significantly by imposing a hierarchical structure on the place cell map consistent with the experimental findings of differences in the firing field size and spacing of grid cells recorded at different positions along the dorsal to ventral axis of entorhinal cortex. The new model represents the environment at different scales by populations of simulated hippocampal place cells with different firing field sizes. Among other advantages this model allows simultaneous constant duration linear look-ahead probes at different scales while significantly extending each probe range. The extension of the linear look-ahead probe range while keeping its duration constant also limits the degrading effects of noise accumulation in the network. We show the extended model’s performance using an animat in a large open field environment.     

Place cells, neocortex and spatial navigation: a short review

Hippocampal place cells are characterized by location-specific firing, that is each cell fires in a restricted region of the environment explored by the rat. In this review, we briefly examine the sensory information used by place cells to anchor their firing fields in space and show that, among the various sensory cues that can influence place cell activity, visual and motion-related cues are the most relevant. We then explore the contribution of several cortical areas to the generation of the place cell signal with an emphasis on the role of the visual cortex and parietal cortex. Finally, we address the functional significance of place cell activity and demonstrate the existence of a clear relationship between place cell positional activity and spatial navigation performance. We conclude that place cells, together with head direction cells, provide information useful for spatially guided movements, and thus provide a unique model of how spatial information is encoded in the brain.     

Functional split between parietal and entorhinal cortices in the rat

Posterior parietal cortex (PPC) and medial entorhinal cortex (MEC) are important elements of the neural circuit for space, but whether representations in these areas are controlled by the same factors is unknown. We recorded single units simultaneously in PPC and MEC of freely foraging rats and found that a subset of PPC cells are tuned to specific modes of movement irrespective of the animals' location or heading, whereas grid cells in MEC expressed static spatial maps. The behavioral correlates of PPC cells switched completely when the same animals ran in a spatially structured maze or when they ran similar stereotypic sequences in an open arena. Representations in PPC were similar in identical mazes in different rooms where grid cells completely realigned their firing fields. The data suggest that representations in PPC are determined by the organization of actions while cells in MEC are driven by spatial inputs.     

How environment geometry affects grid cell symmetry and what we can learn from it

The mammalian hippocampal formation provides neuronal representations of environmental location but the underlying mechanisms are unclear. The majority of cells in medial entorhinal cortex and parasubiculum show spatially periodic firing patterns. Grid cells exhibit hexagonal symmetry and form an important subset of this more general class. Occasional changes between hexagonal and non-hexagonal firing patterns imply a common underlying mechanism. Importantly, the symmetrical properties are strongly affected by the geometry of the environment. Here, we introduce a field–boundary interaction model where we demonstrate that the grid cell pattern can be formed from competing place-like and boundary inputs. We show that the modelling results can accurately capture our current experimental observations.     

Neuroscience: how is three-dimensional space encoded in the brain?

A recent study in the rat has shown that hippocampal place cells and entorhinal grid cells exhibit vertically-elongated firing fields, indicating that the rat's brain may encode the animal's elevation less accurately than its horizontal position.     

Impaired spatial representation in CA1 after lesion of direct input from entorhinal cortex

Place-specific firing in the hippocampus is determined by path integration-based spatial representations in the grid-cell network of the medial entorhinal cortex. Output from this network is conveyed directly to CA1 of the hippocampus by projections from principal neurons in layer III, but also indirectly by axons from layer II to the dentate gyrus and CA3. The direct pathway is sufficient for spatial firing in CA1, but it is not known whether similar firing can also be supported by the input from CA3. To test this possibility, we made selective lesions in layer III of medial entorhinal cortex by local infusion of the neurotoxin gamma-acetylenic GABA. Firing fields in CA1 became larger and more dispersed after cell loss in layer III, whereas CA3 cells, which receive layer II input, still had sharp firing fields. Thus, the direct projection is necessary for precise spatial firing in the CA1 place cell population.     

Neuronal rebound spiking,resonance frequency and theta cycle skipping may contribute to grid cell firing in medial entorhinal cortex

Data show a relationship of cellular resonance and network oscillations in the entorhinal cortex to the spatial periodicity of grid cells. This paper presents a model that simulates the resonance and rebound spiking properties of entorhinal neurons to generate spatial periodicity dependent upon phasic input from medial septum. The model shows that a difference in spatial periodicity can result from a difference in neuronal resonance frequency that replicates data from several experiments. The model also demonstrates a functional role for the phenomenon of theta cycle skipping in the medial entorhinal cortex.