Architecture of spatial circuits in the hippocampal region

The hippocampal region contains several principal neuron types, some of which show distinct spatial firing patterns. The region is also known for its diversity in neural circuits and many have attempted to causally relate network architecture within and between these unique circuits to functional outcome. Still, much is unknown about the mechanisms or network properties by which the functionally specific spatial firing profiles of neurons are generated, let alone how they are integrated into a coherently functioning meta-network. In this review, we explore the architecture of local networks and address how they may interact within the context of an overarching space circuit, aiming to provide directions for future successful explorations.     

A neural network solution to the transverse patterning problem depends on repetition of the input code

Using computer simulations, this paper investigates how input codes affect a minimal computational model of the hippocampal region CA3. Because encoding context seems to be a function of the hippocampus, we have studied problems that require learning context for their solution. Here we study a hippocampally dependent, configural learning problem called transverse patterning. Previously, we showed that the network does not produce long local context codings when the sequential input patterns are orthogonal, and it fails to solve many context-dependent problems in such situations. Here we show that this need not be the case if we assume that the input changes more slowly than a processing interval. Stuttering, i.e., repeating inputs, allows the network to create long local context firings even for orthogonal inputs. With these long local context firings, the network is able to solve the transverse patterning problem. Without stuttering, transverse patterning is not learned. Because stuttering is so useful, we investigate the relationship between the stuttering repetition length and relative context length in a simple, idealized sequence prediction problem. The relative context length, defined as the average length of the local context codes divided by the stuttering length, interacts with activity levels and has an optimal stuttering repetition length. Moreover, the increase in average context length can reach this maximum without loss of relative capacity. Finally, we note that stuttering is an example of maintained or introduced redundancy that can improve neural computations. Received: 17 April 1997 / Accepted in revised form: 22 June 1998     

A neural network model based on the analogy with the immune system

The similarities between the immune system and the central nervous system lead to the formulation of an unorthodox neural network model. The similarities between the two systems are strong at the system level, but do not seem to be so striking at the level of the components. A new model of a neuron is therefore formulated, in order that the analogy can be used. The essential feature of the hypothetical neuron is that it exhibits hysteresis at the single neuron level. A network of N such neurons is modelled by an N-dimensional system of ordinary differential equations, which exhibits almost 2N attractors. The model has a property that resembles free will. A conjecture concerning how the network might learn stimulus-response behaviour is described. According to the conjecture, learning does not involve modifications of the strengths of synaptic connections. Instead, stimuli ("questions") selectively applied to the network by a "teacher" can be used to take the system to a region of the N-dimensional phase space where the network gives the desired stimulus-response behaviour. A key role for sleep in the learning process is suggested. The model for sleep leads to prediction that the variance in the rates of firing of the neurons associated with memory should increase during waking hours, and decrease during sleep.     

Dual Coding with STDP in a Spiking Recurrent Neural Network Model of the Hippocampus

The firing rate of single neurons in the mammalian hippocampus has been demonstrated to encode for a range of spatial and non-spatial stimuli. It has also been demonstrated that phase of firing, with respect to the theta oscillation that dominates the hippocampal EEG during stereotype learning behaviour, correlates with an animal''s spatial location. These findings have led to the hypothesis that the hippocampus operates using a dual (rate and temporal) coding system. To investigate the phenomenon of dual coding in the hippocampus, we examine a spiking recurrent network model with theta coded neural dynamics and an STDP rule that mediates rate-coded Hebbian learning when pre- and post-synaptic firing is stochastic. We demonstrate that this plasticity rule can generate both symmetric and asymmetric connections between neurons that fire at concurrent or successive theta phase, respectively, and subsequently produce both pattern completion and sequence prediction from partial cues. This unifies previously disparate auto- and hetero-associative network models of hippocampal function and provides them with a firmer basis in modern neurobiology. Furthermore, the encoding and reactivation of activity in mutually exciting Hebbian cell assemblies demonstrated here is believed to represent a fundamental mechanism of cognitive processing in the brain.     

Multisynaptic activity in a pyramidal neuron model and neural code

The highly irregular firing of mammalian cortical pyramidal neurons is one of the most striking observation of the brain activity. This result affects greatly the discussion on the neural code, i.e. how the brain codes information transmitted along the different cortical stages. In fact it seems to be in favor of one of the two main hypotheses about this issue, named the rate code. But the supporters of the contrasting hypothesis, the temporal code, consider this evidence inconclusive. We discuss here a leaky integrate-and-fire model of a hippocampal pyramidal neuron intended to be biologically sound to investigate the genesis of the irregular pyramidal firing and to give useful information about the coding problem. To this aim, the complete set of excitatory and inhibitory synapses impinging on such a neuron has been taken into account. The firing activity of the neuron model has been studied by computer simulation both in basic conditions and allowing brief periods of over-stimulation in specific regions of its synaptic constellation. Our results show neuronal firing conditions similar to those observed in experimental investigations on pyramidal cortical neurons. In particular, the variation coefficient (CV) computed from the inter-spike intervals (ISIs) in our simulations for basic conditions is close to the unity as that computed from experimental data. Our simulation shows also different behaviors in firing sequences for different frequencies of stimulation.     

The formation of neural codes in the hippocampus: trace conditioning as a prototypical paradigm for studying the random recoding hypothesis

The trace version of classical conditioning is used as a prototypical hippocampal-dependent task to study the recoding sequence prediction theory of hippocampal function. This theory conjectures that the hippocampus is a random recoder of sequences and that, once formed, the neuronal codes are suitable for prediction. As such, a trace conditioning paradigm, which requires a timely prediction, seems by far the simplest of the behaviorally-relevant paradigms for studying hippocampal recoding. Parameters that affect the formation of these random codes include the temporal aspects of the behavioral/cognitive paradigm and certain basic characteristics of hippocampal region CA3 anatomy and physiology such as connectivity and activity. Here we describe some of the dynamics of code formation and describe how biological and paradigmatic parameters affect the neural codes that are formed. In addition to a backward cascade of coding neurons, we point out, for the first time, a higher-order dynamic growing out of the backward cascade—a particular forward and backward stabilization of codes as training progresses. We also observe that there is a performance compromise involved in the setting of activity levels due to the existence of three behavioral failure modes. Each of these behavioral failure modes exists in the computational model and, presumably, natural selection produced the compromise performance observed by psychologists. Thus, examining the parametric sensitivities of the codes and their dynamic formation gives insight into the constraints on natural computation and into the computational compromises ensuing from these constraints.     

Sequence learning,prediction, and replay in networks of spiking neurons

Sequence learning, prediction and replay have been proposed to constitute the universal computations performed by the neocortex. The Hierarchical Temporal Memory (HTM) algorithm realizes these forms of computation. It learns sequences in an unsupervised and continuous manner using local learning rules, permits a context specific prediction of future sequence elements, and generates mismatch signals in case the predictions are not met. While the HTM algorithm accounts for a number of biological features such as topographic receptive fields, nonlinear dendritic processing, and sparse connectivity, it is based on abstract discrete-time neuron and synapse dynamics, as well as on plasticity mechanisms that can only partly be related to known biological mechanisms. Here, we devise a continuous-time implementation of the temporal-memory (TM) component of the HTM algorithm, which is based on a recurrent network of spiking neurons with biophysically interpretable variables and parameters. The model learns high-order sequences by means of a structural Hebbian synaptic plasticity mechanism supplemented with a rate-based homeostatic control. In combination with nonlinear dendritic input integration and local inhibitory feedback, this type of plasticity leads to the dynamic self-organization of narrow sequence-specific subnetworks. These subnetworks provide the substrate for a faithful propagation of sparse, synchronous activity, and, thereby, for a robust, context specific prediction of future sequence elements as well as for the autonomous replay of previously learned sequences. By strengthening the link to biology, our implementation facilitates the evaluation of the TM hypothesis based on experimentally accessible quantities. The continuous-time implementation of the TM algorithm permits, in particular, an investigation of the role of sequence timing for sequence learning, prediction and replay. We demonstrate this aspect by studying the effect of the sequence speed on the sequence learning performance and on the speed of autonomous sequence replay.     

大鼠海马癫痫电网络重建中爆发式放电神经元的活动

本文探讨双侧海马(hippoeampus,HPC)神经网络中爆发式放电神经元(bursting-firing neurons,BFN)的活动规律及其与海马癫痫网络重建的关系。实验用雄性SD大鼠140只(150-250 g),急性强直电刺激(60 Hz,2 s,0.4-0.6 mA)右后背HPC CAl区(acute tetanization of the posterior dorsal hippocampus,ATPDH),同步记录同侧或对侧前背HPC单位放电和深部电图;强直电刺激右前背HPC(acute tetanization of the anterior dorsal hippocampus,AT-ADH),同步记录双侧前背HPC单位放电。实验共记录了13.8％(19/138)双侧前背HPC的BFN,其中13个为刺激诱发性BFN,6个为自发性BFN。强直电刺激引起的诱发反应包括:(1)ATPDH明显调制同侧前背HPC的BFN,产生规则的节律性爆发式放电,刺激后串内动作电位间期(bursting interspike interval,BISI)减小(P<0.001);(2)AT-PDH引起对侧前背HPC的BFN出现抑制后轻度调制效应,刺激后动作电位间期(interspike interval,ISI)增大(P<0.001);(3)ATADH后易化对侧前背HPC的自发性BFN节律,增加ISI(P<0.001)和IBI(P=0.01);(4)ATPDH诱导双侧前背HPC的BFN产生规则的节律性爆发式放电,伴有同步或非同步性网络癫痫的形成。上述实验结果提示,ATPDH沿同侧HPC长轴,跨大脑半球诱发前背HPC单个BFN的形成,其节律性爆     

Dynamic interactions between orexin and dynorphin may delay onset of functional orexin effects: a modeling study

Orexin (also known as hypocretin) neurons play a key role in regulating sleep-wake behavior, but the links between orexin neuron electrophysiology and function have not been explored. Orexin neurons are wake-active, and spiking activity in orexin neurons may anticipate transitions to wakefulness by several seconds. However, it is suggested that while the orexin system is necessary to maintain sustained wake bouts, orexin has little effect on brief wake bouts. In vitro experiments investigating the actions of orexin and dynorphin, a colocalized neuropeptide, on orexin neurons indicate that the dynamics of desensitization to dynorphin may represent a mechanism for modulating local network activity and resolving the apparent discrepancy between the onset of firing in orexin neurons and the onset of functional orexin effects. To investigate the role of dynorphin on orexin neuron activity, a Hodgkin-Huxley-type model orexin neuron was developed in which baseline electrophysiology, orexin/dynorphin action, and dynorphin desensitization were closely tied to experimental data. In this model framework, model orexin neuron responses to orexin/dynorphin action were calibrated by simulating the physiologic effects of static orexin and dynorphin bath application on orexin neurons. Then behavior in a small network of model orexin neurons was simulated with pure orexin, pure dynorphin, or combined orexin and dynorphin coupling based on the mechanisms established in the static case. It was found that the dynamics of desensitization to dynorphin can mediate a clear shift from a network in which firing is suppressed by dynorphin-mediated inhibition to a network of neurons with high firing rates sustained by orexin-mediated excitation. The findings suggest that dynamic interactions between orexin and dynorphin at transitions from sleep to wake may delay onset of functional orexin effects.     

Neural network model of selective visual attention using Hodgkin–Huxley equation

We propose a mathematical model of selective visual attention using a two-layered neural network with neurons described by the Hodgkin–Huxley equation in order to investigate part of the assumption proposed by Desimone and Duncan. The neural network consists of a layer of hippocampal formation and of visual cortex. A frequency of firing and a firing time for each neuron and also a correlation of the firing times between neurons are calculated numerically to clarify an attention state, a nonattention state, and an attention shift. We find that synchronous phenomena occur not only for the frequency but also for the firing time between the neurons in the hippocampal formation and those in a part of the visual cortex in our model. It also turns out that the attention shift is performed quickly in our model.Acknowledgements We are grateful to T. Omori for his valuable discussions and comments. K. K. was partially supported by Research Fellowships of the Japan Society for the Promotion of Science for Young Scientists. This work was partially supported by Grant-In-Aid for Scientific Research No. 13680383 from the Ministry of Education, Culture, Sports, Science and Technology (MEXT), Japan.     

Neural network programming in bioprocess variable estimation and state prediction.

A neural network program with efficient learning ability for bioprocess variable estimation and state prediction was developed. A 3 layer, feed-forward neural network architecture was used, and the program was written in Quick C ver 2.5 for an IBM compatible computer with a 80486/33 MHz processor. A back propagation training algorithm was used based on learning by pattern and momentum in a combination as used to adjust the connection of weights of the neurons in adjacent layers. The delta rule was applied in a gradient descent search technique to minimize a cost function equal to the mean square difference between the target and the network output. A non-linear, sigmoidal logistic transfer function was used in squashing the weighted sum of the inputs of each neuron to a limited range output. A good neural network prediction model was obtained by training with a sequence of past time course data of a typical bioprocess. The well trained neural network estimated accurately and rapidly the state variables with or without noise even under varying process dynamics.     

An extended model for a spiking neuron class

This paper proposes an extension to the model of a spiking neuron for information processing in artificial neural networks, developing a new approach for the dynamic threshold of the integrate-and-fire neuron. This new approach invokes characteristics of biological neurons such as the behavior of chemical synapses and the receptor field. We demonstrate how such a digital model of spiking neurons can solve complex nonlinear classification with a single neuron, performing experiments for the classical XOR problem. Compared with rate-coded networks and the classical integrate-and-fire model, the trained network demonstrated faster information processing, requiring fewer neurons and shorter learning periods. The extended model validates all the logic functions of biological neurons when such functions are necessary for the proper flow of binary codes through a neural network.     

Unsupervised learning and recall of temporal sequences: an application to robotics

This paper describes an unsupervised neural network model for learning and recall of temporal patterns. The model comprises two groups of synaptic weights, named competitive feedforward and Hebbian feedback, which are responsible for encoding the static and temporal features of the sequence respectively. Three additional mechanisms allow the network to deal with complex sequences: context units, a neuron commitment equation, and redundancy in the representation of sequence states. The proposed network encodes a set of robot trajectories which may contain states in common, and retrieves them accurately in the correct order. Further tests evaluate the fault-tolerance and noise sensitivity of the proposed model.     

LTD windows of the STDP learning rule and synaptic connections having a large transmission delay enable robust sequence learning amid background noise

Spike-timing-dependent synaptic plasticity (STDP) is a simple and effective learning rule for sequence learning. However, synapses being subject to STDP rules are readily influenced in noisy circumstances because synaptic conductances are modified by pre- and postsynaptic spikes elicited within a few tens of milliseconds, regardless of whether those spikes convey information or not. Noisy firing existing everywhere in the brain may induce irrelevant enhancement of synaptic connections through STDP rules and would result in uncertain memory encoding and obscure memory patterns. We will here show that the LTD windows of the STDP rules enable robust sequence learning amid background noise in cooperation with a large signal transmission delay between neurons and a theta rhythm, using a network model of the entorhinal cortex layer II with entorhinal-hippocampal loop connections. The important element of the present model for robust sequence learning amid background noise is the symmetric STDP rule having LTD windows on both sides of the LTP window, in addition to the loop connections having a large signal transmission delay and the theta rhythm pacing activities of stellate cells. Above all, the LTD window in the range of positive spike-timing is important to prevent influences of noise with the progress of sequence learning.     

Ablation of NMDA Receptors Enhances the Excitability of Hippocampal CA3 Neurons

Synchronized discharges in the hippocampal CA3 recurrent network are supposed to underlie network oscillations, memory formation and seizure generation. In the hippocampal CA3 network, NMDA receptors are abundant at the recurrent synapses but scarce at the mossy fiber synapses. We generated mutant mice in which NMDA receptors were abolished in hippocampal CA3 pyramidal neurons by postnatal day 14. The histological and cytological organizations of the hippocampal CA3 region were indistinguishable between control and mutant mice. We found that mutant mice lacking NMDA receptors selectively in CA3 pyramidal neurons became more susceptible to kainate-induced seizures. Consistently, mutant mice showed characteristic large EEG spikes associated with multiple unit activities (MUA), suggesting enhanced synchronous firing of CA3 neurons. The electrophysiological balance between fast excitatory and inhibitory synaptic transmission was comparable between control and mutant pyramidal neurons in the hippocampal CA3 region, while the NMDA receptor-slow AHP coupling was diminished in the mutant neurons. In the adult brain, inducible ablation of NMDA receptors in the hippocampal CA3 region by the viral expression vector for Cre recombinase also induced similar large EEG spikes. Furthermore, pharmacological blockade of CA3 NMDA receptors enhanced the susceptibility to kainate-induced seizures. These results raise an intriguing possibility that hippocampal CA3 NMDA receptors may suppress the excitability of the recurrent network as a whole in vivo by restricting synchronous firing of CA3 neurons.     

A topological paradigm for hippocampal spatial map formation using persistent homology

An animal's ability to navigate through space rests on its ability to create a mental map of its environment. The hippocampus is the brain region centrally responsible for such maps, and it has been assumed to encode geometric information (distances, angles). Given, however, that hippocampal output consists of patterns of spiking across many neurons, and downstream regions must be able to translate those patterns into accurate information about an animal's spatial environment, we hypothesized that 1) the temporal pattern of neuronal firing, particularly co-firing, is key to decoding spatial information, and 2) since co-firing implies spatial overlap of place fields, a map encoded by co-firing will be based on connectivity and adjacency, i.e., it will be a topological map. Here we test this topological hypothesis with a simple model of hippocampal activity, varying three parameters (firing rate, place field size, and number of neurons) in computer simulations of rat trajectories in three topologically and geometrically distinct test environments. Using a computational algorithm based on recently developed tools from Persistent Homology theory in the field of algebraic topology, we find that the patterns of neuronal co-firing can, in fact, convey topological information about the environment in a biologically realistic length of time. Furthermore, our simulations reveal a "learning region" that highlights the interplay between the parameters in combining to produce hippocampal states that are more or less adept at map formation. For example, within the learning region a lower number of neurons firing can be compensated by adjustments in firing rate or place field size, but beyond a certain point map formation begins to fail. We propose that this learning region provides a coherent theoretical lens through which to view conditions that impair spatial learning by altering place cell firing rates or spatial specificity.     

A learning theory for reward-modulated spike-timing-dependent plasticity with application to biofeedback

Reward-modulated spike-timing-dependent plasticity (STDP) has recently emerged as a candidate for a learning rule that could explain how behaviorally relevant adaptive changes in complex networks of spiking neurons could be achieved in a self-organizing manner through local synaptic plasticity. However, the capabilities and limitations of this learning rule could so far only be tested through computer simulations. This article provides tools for an analytic treatment of reward-modulated STDP, which allows us to predict under which conditions reward-modulated STDP will achieve a desired learning effect. These analytical results imply that neurons can learn through reward-modulated STDP to classify not only spatial but also temporal firing patterns of presynaptic neurons. They also can learn to respond to specific presynaptic firing patterns with particular spike patterns. Finally, the resulting learning theory predicts that even difficult credit-assignment problems, where it is very hard to tell which synaptic weights should be modified in order to increase the global reward for the system, can be solved in a self-organizing manner through reward-modulated STDP. This yields an explanation for a fundamental experimental result on biofeedback in monkeys by Fetz and Baker. In this experiment monkeys were rewarded for increasing the firing rate of a particular neuron in the cortex and were able to solve this extremely difficult credit assignment problem. Our model for this experiment relies on a combination of reward-modulated STDP with variable spontaneous firing activity. Hence it also provides a possible functional explanation for trial-to-trial variability, which is characteristic for cortical networks of neurons but has no analogue in currently existing artificial computing systems. In addition our model demonstrates that reward-modulated STDP can be applied to all synapses in a large recurrent neural network without endangering the stability of the network dynamics.     

Mechanisms of firing patterns in fast-spiking cortical interneurons

Cortical fast-spiking (FS) interneurons display highly variable electrophysiological properties. Their spike responses to step currents occur almost immediately following the step onset or after a substantial delay, during which subthreshold oscillations are frequently observed. Their firing patterns include high-frequency tonic firing and rhythmic or irregular bursting (stuttering). What is the origin of this variability? In the present paper, we hypothesize that it emerges naturally if one assumes a continuous distribution of properties in a small set of active channels. To test this hypothesis, we construct a minimal, single-compartment conductance-based model of FS cells that includes transient Na(+), delayed-rectifier K(+), and slowly inactivating d-type K(+) conductances. The model is analyzed using nonlinear dynamical system theory. For small Na(+) window current, the neuron exhibits high-frequency tonic firing. At current threshold, the spike response is almost instantaneous for small d-current conductance, gd, and it is delayed for larger gd. As gd further increases, the neuron stutters. Noise substantially reduces the delay duration and induces subthreshold oscillations. In contrast, when the Na(+) window current is large, the neuron always fires tonically. Near threshold, the firing rates are low, and the delay to firing is only weakly sensitive to noise; subthreshold oscillations are not observed. We propose that the variability in the response of cortical FS neurons is a consequence of heterogeneities in their gd and in the strength of their Na(+) window current. We predict the existence of two types of firing patterns in FS neurons, differing in the sensitivity of the delay duration to noise, in the minimal firing rate of the tonic discharge, and in the existence of subthreshold oscillations. We report experimental results from intracellular recordings supporting this prediction.     

Predicting the Responses of Repetitively Firing Neurons to Current Noise

We used phase resetting methods to predict firing patterns of rat subthalamic nucleus (STN) neurons when their rhythmic firing was densely perturbed by noise. We applied sequences of contiguous brief (0.5–2 ms) current pulses with amplitudes drawn from a Gaussian distribution (10–100 pA standard deviation) to autonomously firing STN neurons in slices. Current noise sequences increased the variability of spike times with little or no effect on the average firing rate. We measured the infinitesimal phase resetting curve (PRC) for each neuron using a noise-based method. A phase model consisting of only a firing rate and PRC was very accurate at predicting spike timing, accounting for more than 80% of spike time variance and reliably reproducing the spike-to-spike pattern of irregular firing. An approximation for the evolution of phase was used to predict the effect of firing rate and noise parameters on spike timing variability. It quantitatively predicted changes in variability of interspike intervals with variation in noise amplitude, pulse duration and firing rate over the normal range of STN spontaneous rates. When constant current was used to drive the cells to higher rates, the PRC was altered in size and shape and accurate predictions of the effects of noise relied on incorporating these changes into the prediction. Application of rate-neutral changes in conductance showed that changes in PRC shape arise from conductance changes known to accompany rate increases in STN neurons, rather than the rate increases themselves. Our results show that firing patterns of densely perturbed oscillators cannot readily be distinguished from those of neurons randomly excited to fire from the rest state. The spike timing of repetitively firing neurons may be quantitatively predicted from the input and their PRCs, even when they are so densely perturbed that they no longer fire rhythmically.     

Ensembles of Spiking Neurons with Noise Support Optimal Probabilistic Inference in a Dynamically Changing Environment

It has recently been shown that networks of spiking neurons with noise can emulate simple forms of probabilistic inference through “neural sampling”, i.e., by treating spikes as samples from a probability distribution of network states that is encoded in the network. Deficiencies of the existing model are its reliance on single neurons for sampling from each random variable, and the resulting limitation in representing quickly varying probabilistic information. We show that both deficiencies can be overcome by moving to a biologically more realistic encoding of each salient random variable through the stochastic firing activity of an ensemble of neurons. The resulting model demonstrates that networks of spiking neurons with noise can easily track and carry out basic computational operations on rapidly varying probability distributions, such as the odds of getting rewarded for a specific behavior. We demonstrate the viability of this new approach towards neural coding and computation, which makes use of the inherent parallelism of generic neural circuits, by showing that this model can explain experimentally observed firing activity of cortical neurons for a variety of tasks that require rapid temporal integration of sensory information.