A zonal model of cortical functions

A model of cortical functions is developed with the object of simulating the observed behavior of individual neurons organized in unit circuits and functional systems of the cerebellum, the cerebrum and the hippocampal formation. The neuronal model is capable of representing refractory and potentiated states, as well as the firing and lowest resting states. The unit circuits of each system consist of all common types of cells with known synaptic connections. In the cerebral system these unit circuits are interconnected to form columns as well as zones. A new discrete neural network equation, which takes account of interactions with the extracellular field, is proposed to simulate electrical activity in these circuits. A coherent theory of cortical activity and functions is derived that accounts for many of the observed phenomena, including those associated with the development of long-term potentiation and sequential memory. Three appendices are devoted to the theory of extracellular interactions, the derivation of non-linear network equations, and a computer program to simulate learning in the cortex.     

Emergence of functional hierarchy in a multiple timescale neural network model: a humanoid robot experiment

It is generally thought that skilled behavior in human beings results from a functional hierarchy of the motor control system, within which reusable motor primitives are flexibly integrated into various sensori-motor sequence patterns. The underlying neural mechanisms governing the way in which continuous sensori-motor flows are segmented into primitives and the way in which series of primitives are integrated into various behavior sequences have, however, not yet been clarified. In earlier studies, this functional hierarchy has been realized through the use of explicit hierarchical structure, with local modules representing motor primitives in the lower level and a higher module representing sequences of primitives switched via additional mechanisms such as gate-selecting. When sequences contain similarities and overlap, however, a conflict arises in such earlier models between generalization and segmentation, induced by this separated modular structure. To address this issue, we propose a different type of neural network model. The current model neither makes use of separate local modules to represent primitives nor introduces explicit hierarchical structure. Rather than forcing architectural hierarchy onto the system, functional hierarchy emerges through a form of self-organization that is based on two distinct types of neurons, each with different time properties ("multiple timescales"). Through the introduction of multiple timescales, continuous sequences of behavior are segmented into reusable primitives, and the primitives, in turn, are flexibly integrated into novel sequences. In experiments, the proposed network model, coordinating the physical body of a humanoid robot through high-dimensional sensori-motor control, also successfully situated itself within a physical environment. Our results suggest that it is not only the spatial connections between neurons but also the timescales of neural activity that act as important mechanisms leading to functional hierarchy in neural systems.     

A Neural Population Model Incorporating Dopaminergic Neurotransmission during Complex Voluntary Behaviors

Assessing brain activity during complex voluntary motor behaviors that require the recruitment of multiple neural sites is a field of active research. Our current knowledge is primarily based on human brain imaging studies that have clear limitations in terms of temporal and spatial resolution. We developed a physiologically informed non-linear multi-compartment stochastic neural model to simulate functional brain activity coupled with neurotransmitter release during complex voluntary behavior, such as speech production. Due to its state-dependent modulation of neural firing, dopaminergic neurotransmission plays a key role in the organization of functional brain circuits controlling speech and language and thus has been incorporated in our neural population model. A rigorous mathematical proof establishing existence and uniqueness of solutions to the proposed model as well as a computationally efficient strategy to numerically approximate these solutions are presented. Simulated brain activity during the resting state and sentence production was analyzed using functional network connectivity, and graph theoretical techniques were employed to highlight differences between the two conditions. We demonstrate that our model successfully reproduces characteristic changes seen in empirical data between the resting state and speech production, and dopaminergic neurotransmission evokes pronounced changes in modeled functional connectivity by acting on the underlying biological stochastic neural model. Specifically, model and data networks in both speech and rest conditions share task-specific network features: both the simulated and empirical functional connectivity networks show an increase in nodal influence and segregation in speech over the resting state. These commonalities confirm that dopamine is a key neuromodulator of the functional connectome of speech control. Based on reproducible characteristic aspects of empirical data, we suggest a number of extensions of the proposed methodology building upon the current model.     

Analysis of Drosophila motor neuron activity patterns with neural analogs

A network of reciprocally inhibitory motorneurons has been previously postulated to account for the firing patterns of motor units during dipteran flight. Possible activity patterns of such a network were analyzed by means of appropriately interconnected neuromimes. This theoretical analysis showed that the proposed network can account for many aspects of dipteran motor unit activity patterns including firing in specific sequences, stability, and resetting of the firing pattern by antidromic spikes. In addition, the analysis showed that one aspect of physiological activity, motor unit phase locking, can not be explained simply on the basis of network properties alone; evidently specific membrane properties of the dipteran motor units also play an essential role in establishing the activity pattern.     

A variant of the integrate-and-fire model to simulate the adaptive neural firing pattern

The integrate-and-fire (IF) based modeling technique has been long employed to study the neural firing activities. This paper introduces a variant of the IF model in order to simulate the adaptive neural firing pattern. An inductor branch is integrated into the IF model to track the variance of the external stimulus, and subsequently control the decrease of the instantaneous firing rate in response to the sustained stimulation. Simulation results demonstrated that the proposed model was able to reproduce the adaptive neural firing pattern. Besides, the inductor branch might adjust the decay rate of the adaptive firing curve and the prominent firing rate upon the onset of the adaptation. The proposed model is characterized by its structure simplicity and simulation efficiency, which would be helpful for the analysis and prediction of the adaptive firing responses of the sensory neurons.     

Dynamic Neural Network Models of the Premotoneuronal Circuitry Controlling Wrist Movements in Primates

Dynamic recurrent neural networks were derived to simulate neuronal populations generating bidirectional wrist movements in the monkey. The models incorporate anatomical connections of cortical and rubral neurons, muscle afferents, segmental interneurons and motoneurons; they also incorporate the response profiles of four populations of neurons observed in behaving monkeys. The networks were derived by gradient descent algorithms to generate the eight characteristic patterns of motor unit activations observed during alternating flexion-extension wrist movements. The resulting model generated the appropriate input-output transforms and developed connection strengths resembling those in physiological pathways. We found that this network could be further trained to simulate additional tasks, such as experimentally observed reflex responses to limb perturbations that stretched or shortened the active muscles, and scaling of response amplitudes in proportion to inputs. In the final comprehensive network, motor units are driven by the combined activity of cortical, rubral, spinal and afferent units during step tracking and perturbations.The model displayed many emergent properties corresponding to physiological characteristics. The resulting neural network provides a working model of premotoneuronal circuitry and elucidates the neural mechanisms controlling motoneuron activity. It also predicts several features to be experimentally tested, for example the consequences of eliminating inhibitory connections in cortex and red nucleus. It also reveals that co-contraction can be achieved by simultaneous activation of the flexor and extensor circuits without invoking features specific to co-contraction.     

The phases of small networks of chemical reactors and neurons

We present an experimental study of the phase relationships observed in small reactor networks consisting of two and three continuous flow stirred tank reactors. In the three-reactor network one chemical oscillator is coupled to two other reactors in parallel in analogy to a small neural net. Each reactor contains an identical reaction mixture of the excitable Belousov-Zhabotinsky reaction which is characterized by its bifurcation diagram, where the electrical current is the bifurcation parameter. Coupling between the reactors is electrical via Pt-working electrodes and it can be either repulsive (inhibitory) or attractive (excitatory). An external electrical stimulus is applied to all three reactors in the form of an asymmetric electrical current pulse which sweeps across the bifurcation diagram. As a consequence, all three reactors oscillate with characteristic oscillation patterns or remain silent in analogy to the firing of neurons. The observed phase behavior depends on the type of coupling in a complex way. This situation is analogous to the in vivo measurements on single neurons (local neurons and projection neurons) performed by G. Laurent and co-workers on the olfactory system of the locust. We propose a simple neural network similar to the reactor network using the Hodgkin-Huxley model to simulate the action potentials of the coupled single neurons. Analogies between the reactor network and the neural network are discussed.     

A spiking neural network model of the midbrain superior colliculus that generates saccadic motor commands

Single-unit recordings suggest that the midbrain superior colliculus (SC) acts as an optimal controller for saccadic gaze shifts. The SC is proposed to be the site within the visuomotor system where the nonlinear spatial-to-temporal transformation is carried out: the population encodes the intended saccade vector by its location in the motor map (spatial), and its trajectory and velocity by the distribution of firing rates (temporal). The neurons’ burst profiles vary systematically with their anatomical positions and intended saccade vectors, to account for the nonlinear main-sequence kinematics of saccades. Yet, the underlying collicular mechanisms that could result in these firing patterns are inaccessible to current neurobiological techniques. Here, we propose a simple spiking neural network model that reproduces the spike trains of saccade-related cells in the intermediate and deep SC layers during saccades. The model assumes that SC neurons have distinct biophysical properties for spike generation that depend on their anatomical position in combination with a center–surround lateral connectivity. Both factors are needed to account for the observed firing patterns. Our model offers a basis for neuronal algorithms for spatiotemporal transformations and bio-inspired optimal controllers.     

An improved neural-network model for the neural integrator of the oculomotor system: More realistic neuron behavior

The discharge rates of premotor, brain-stem neurons that create eye movements modulate in relation to eye velocity yet firing rates of extraocular motoneurons contain both eye-position and eyevelocity signals. The eye-position signal is derived from the eye-velocity command by means of a neural network which functioins as a temporal integrator. We have previously proposed a network of lateral-inhibitory neurons that is capable of performing the required integration. That analysis centered on the temporal aspects of the signal processing for a limited class of idealized inputs. All of its cells were identical and carried only the integrated signal. Recordings in the brain stem, however, show that neurons in the region of the neural integrator have a variety of background firing rates, all carry some eye-velocity signal as well as the eye-position signal, and carry the former with different strengths depending on the type of eye movement being made. It was necessary to see if the proposed model could be modified to make its neurons more realistic.By modifying the spatial distribution of afferents to the network, we demonstrate that the same basic model functions properly in spite of afferents with nonuniform background firing rates. To introduce the eye-velocity signal a double-layer network, consisting of inhibitory and excitatory cells, was necessary. By presenting the velocity input to only local regions of this network it was shown that all cells in the network still carried the integrated signal and that its cells could carry different eye-velocity signals for different types of eye movements. Thus, this model stimulates quantitatively and qualitatively, the behavior of neurons seen in the region of the neural integrator.     

Modulation of a feeding neural circuit by microinjection of K+ channel expression genes into a single identified neuron in Aplysia kurodai

In Aplysia buccal ganglion expression genes for voltage-dependent K(+) channels (AKv1.1a) were injected into one of four electrically coupled multi-action (MA) neurons that directly inhibit jaw-closing (JC) motor neurons and may cooperatively generate their firing pattern during the feeding response. Following the DNA injection, the firing threshold increased and the spike frequency at the same current decreased in the current-induced excitation of the MA neuron; indicating a decrease in excitability of the MA neuron. This procedure also reduced the firing activity of MA neurons during the feeding-like rhythmic responses induced by the electrical nerve stimulation. Moreover, the firing pattern in JC motor neurons was remarkably changed, suggesting the effective contribution of a single MA neuron or electrically coupled MA neurons to the generation of the firing pattern in the JC motor neurons. This method appears useful for exploring the functional roles of specific neurons in complex neural circuits.     

Spatiotemporal pattern formation in two-dimensional neural circuits: roles of refractoriness and noise

Refractoriness is one of the most fundamental states of neural firing activity, in which neurons that have just fired are unable to produce another spike, regardless of the strength of afferent stimuli. Another essential and unavoidable feature of neural systems is the existence of noise. To study the role of these essential factors in spatiotemporal pattern formation in neural systems, a spatially expended neural network model is constructed, with the dynamics of its individual neurons capturing the three most essential states of the neural firing behavior: firing, refractory and resting, and the network topology consistent with the widely observed center-surround coupling manner in the real brain. By changing the refractory period with and without noise in a systematic way in the network, it is shown numerically and analytically that without refractoriness, or when the refractory period is smaller than a certain value, the collective activity pattern of the system consists of localized, oscillating patterns. However, when the refractory period is greater than a certain value, crescent-shaped, localized propagating patterns emerge in the presence of noise. It is further illustrated that the formation of the dynamical spiking patterns is due to a symmetry breaking mechanism, refractoriness-induced symmetry breaking; that is generated by the interplay of noise and refractoriness in the network model. This refractoriness-induced symmetry breaking provides a novel perspective on the emergence of localized, spiking wave patterns or spike timing sequences as ubiquitously observed in real neural systems; it therefore suggests that refractoriness may benefit neural systems in their temporal information processing, rather than limiting the performance of neurons, as has been conventionally thought. Our results also highlight the importance of considering noise in studying spatially extended neural systems, where it may facilitate the formation of spatiotemporal order.     

Ventrolateral medullary respiratory network participation in the expiration reflex in the cat.

The expiration reflex is a distinct airway defensive response characterized by a brief, intense expiratory effort and coordinated adduction and abduction of the laryngeal folds. This study addressed the hypothesis that the ventrolateral medullary respiratory network participates in the reflex. Extracellular neuron activity was recorded with microelectrode arrays in decerebrated, neuromuscular-blocked, ventilated cats. In 32 recordings (17 cats), 232 neurons were monitored in the rostral (including B?tzinger and pre-B?tzinger complexes) and caudal ventral respiratory group. Neurons were classified by firing pattern, evaluated for spinal projections, functional associations with recurrent laryngeal and lumbar nerves, and firing rate changes during brief, large increases in lumbar motor nerve discharge (fictive expiration reflex, FER) elicited during mechanical stimulation of the vocal folds. Two hundred eight neurons were respiratory modulated, and 24 were nonrespiratory; 104 of the respiratory and 6 of the nonrespiratory-modulated neurons had altered peak firing rates during the FER. Increased firing rates of bulbospinal neurons and expiratory laryngeal premotor and motoneurons during the expiratory burst of FER were accompanied by changes in the firing patterns of putative propriobulbar neurons proposed to participate in the eupneic respiratory network. The results support the hypothesis that elements of the rostral and caudal ventral respiratory groups participate in generating and shaping the motor output of the FER. A model is proposed for the participation of the respiratory network in the expiration reflex.     

Oscillation and coding in a formal neural network considered as a guide for plausible simulations of the insect olfactory system

For the analysis of coding mechanisms in the insect olfactory system, a fully connected network of synchronously updated McCulloch and Pitts neurons (MC-P type) was developed [Quenet, B., Horn, D., 2003. The dynamic neural filter: a binary model of spatio-temporal coding. Neural Comput. 15 (2), 309-329]. Considering the update time as an intrinsic clock, this "Dynamic Neural Filter" (DNF), which maps regions of input space into spatio-temporal sequences of neuronal activity, is able to produce exact binary codes extracted from the synchronized activities recorded at the level of projection neurons (PN) in the locust antennal lobe (AL) in response to different odors [Wehr, M., Laurent, G., 1996. Odor encoding by temporal sequences of firing in oscillating neural assemblies. Nature 384, 162-166]. Here, in a first step, we separate the populations of PN and local inhibitory neurons (LN) and use the DNF as a guide for simulations based on biological plausible neurons (Hodgkin-Huxley: H-H type). We show that a parsimonious network of 10 H-H neurons generates action potentials whose timing represents the required codes. In a second step, we construct a new type of DNF in order to study the population dynamics when different delays are taken into account. We find synaptic matrices which lead to both the emergence of robust oscillations and spatio-temporal patterns, using a formal criterion, based on a Normalized Euclidian Distance (NED), in order to measure the use of the temporal dimension as a coding dimension by the DNF. Similarly to biological PN, the activity of excitatory neurons in the model can be both phase-locked to different cycles of oscillations which remind local field potential (LFP), and nevertheless exhibit dynamic behavior complex enough to be the basis of spatio-temporal codes.     

Learning neural connectivity from firing activity: efficient algorithms with provable guarantees on topology

The connectivity of a neuronal network has a major effect on its functionality and role. It is generally believed that the complex network structure of the brain provides a physiological basis for information processing. Therefore, identifying the network’s topology has received a lot of attentions in neuroscience and has been the center of many research initiatives such as Human Connectome Project. Nevertheless, direct and invasive approaches that slice and observe the neural tissue have proven to be time consuming, complex and costly. As a result, the inverse methods that utilize firing activity of neurons in order to identify the (functional) connections have gained momentum recently, especially in light of rapid advances in recording technologies; It will soon be possible to simultaneously monitor the activities of tens of thousands of neurons in real time. While there are a number of excellent approaches that aim to identify the functional connections from firing activities, the scalability of the proposed techniques plays a major challenge in applying them on large-scale datasets of recorded firing activities. In exceptional cases where scalability has not been an issue, the theoretical performance guarantees are usually limited to a specific family of neurons or the type of firing activities. In this paper, we formulate the neural network reconstruction as an instance of a graph learning problem, where we observe the behavior of nodes/neurons (i.e., firing activities) and aim to find the links/connections. We develop a scalable learning mechanism and derive the conditions under which the estimated graph for a network of Leaky Integrate and Fire (LIf) neurons matches the true underlying synaptic connections. We then validate the performance of the algorithm using artificially generated data (for benchmarking) and real data recorded from multiple hippocampal areas in rats.     

Izhikevich神经元网络的同步与联想记忆

联想记忆是人脑的一项重要功能。以Izhikevich神经元模型为节点,构建神经网络,神经元之间采用全连结的方式;以神经元群体的时空编码（spatio-temporal coding）理论研究所构建神经网络的联想记忆功能。在加入高斯白噪声的情况下,调节网络中神经元之间的连接强度的大小,当连接强度和噪声强度达到一个阈值时网络中部分神经元同步放电,实现了存储模式的联想记忆与恢复。仿真结果表明,神经元之间的连接强度在联想记忆的过程中发挥了重要的作用,噪声可以促使神经元间的同步放电,有助于神经网络实现存储模式的联想记忆与恢复。     

Neural network model of selective visual attention using Hodgkin–Huxley equation

We propose a mathematical model of selective visual attention using a two-layered neural network with neurons described by the Hodgkin–Huxley equation in order to investigate part of the assumption proposed by Desimone and Duncan. The neural network consists of a layer of hippocampal formation and of visual cortex. A frequency of firing and a firing time for each neuron and also a correlation of the firing times between neurons are calculated numerically to clarify an attention state, a nonattention state, and an attention shift. We find that synchronous phenomena occur not only for the frequency but also for the firing time between the neurons in the hippocampal formation and those in a part of the visual cortex in our model. It also turns out that the attention shift is performed quickly in our model.Acknowledgements We are grateful to T. Omori for his valuable discussions and comments. K. K. was partially supported by Research Fellowships of the Japan Society for the Promotion of Science for Young Scientists. This work was partially supported by Grant-In-Aid for Scientific Research No. 13680383 from the Ministry of Education, Culture, Sports, Science and Technology (MEXT), Japan.     

Relationship between applicability of current-based synapses and uniformity of firing patterns

The purpose of this paper is to identify situations in neural network modeling where current-based synapses are applicable. The applicability of current-based synapse model for studying post-transient behavior of neural networks is discussed in terms of average synaptic current strength induced by per spike during one firing cycle of a neuron (or briefly per spike synaptic current strength). It was found that current-based synapse models are applicable in both situations where both the interspike intervals of the neurons and the distribution of firing times of the neurons are uniform, and where the firing of all neurons is synchronized. If neither the interspike intervals nor the distribution of firing times of the neurons is uniform or the reversal potential is between the rest and threshold potentials, current-based synapse models may be oversimplified.     

Dynamics of the noisy neural network

The dynamic features of interspike interval sequences and structures of spatiotemporal patterns of firing in a coupled noisy neural network are investigated. The system displays complex dynamics under periodic external stimuli. The dynamics is modulated by a periodic impulse-like synaptic current which relates to a global coupling interaction between neurons. The firings of the stimulated neurons are phase-locked to this current. In addition, the interspike interval histograms are studied for the case of frozen noise which does not change its value within a time interval once it has been distributed onto the network. It is found that the peaks in these histograms are located at integer multiples of the period of the external stimulus, and the heights of these peaks decay exponentially, which corresponds to the experimental results. Received: 12 April 1997 / Accepted in revised form: 7 May 1997     

Modeling the spinal pudendo-vesical reflex for bladder control by pudendal afferent stimulation

Electrical stimulation of the pudendal nerve (PN) is a promising approach to restore continence and micturition following bladder dysfunction resulting from neurological disease or injury. Although the pudendo-vesical reflex and its physiological properties are well established, there is limited understanding of the specific neural mechanisms that mediate this reflex. We sought to develop a computational model of the spinal neural network that governs the reflex bladder response to PN stimulation. We implemented and validated a neural network architecture based on previous neuroanatomical and electrophysiological studies. Using synaptically-connected integrate and fire model neurons, we created a network model with realistic spiking behavior. The model produced expected sacral parasympathetic nucleus (SPN) neuron firing rates from prescribed neural inputs and predicted bladder activation and inhibition with different frequencies of pudendal afferent stimulation. In addition, the model matched experimental results from previous studies of temporal patterns of pudendal afferent stimulation and selective pharmacological blockade of inhibitory neurons. The frequency- and pattern-dependent effects of pudendal afferent stimulation were determined by changes in firing rate of spinal interneurons, suggesting that neural network interactions at the lumbosacral level can mediate the bladder response to different frequencies or temporal patterns of pudendal afferent stimulation. Further, the anatomical structure of excitatory and inhibitory interneurons in the network model was necessary and sufficient to reproduce the critical features of the pudendo-vesical reflex, and this model may prove useful to guide development of novel, more effective electrical stimulation techniques for bladder control.     

A neural network study of precollicular saccadic averaging

Saccadic averaging is the phenomenon that two simultaneously presented retinal inputs result in a saccade with an endpoint located on an intermediate position between the two stimuli. Recordings from neurons in the deeper layers of the superior colliculus have revealed neural correlates of saccade averaging, indicating that it takes place at this level or upstream. Recently, we proposed a neural network for internal feedback in saccades. This neural network model is different from other models in that it suggests the possibility that averaging takes place in a stage upstream of the colliculus. The network consists of output units representing the neural map of the deeper layers of the superior colliculus and hidden layers imitating areas in the posterior parietal cortex. The deeper layers of the superior colliculus represent the motor error of a desired saccade, e.g. an eye movement to a visual target. In this article we show that averaging is an emergent property of the proposed network. When two retinal targets with different intensities are simultaneously presented to the network, the activity in the output layer represents a single motor error with a weighted average value. Our goal is to understand the mechanism of weighted averaging in this neural network. It appears that averaging in the model is caused by the linear dependence of the net input, received by the hidden units, on retinal error, independent of its retinal coding format. For nonnormalized retinal error inputs, also the nonlinearity between the net input and the activity of the hidden units plays a role in the averaging process. The averaging properties of the model are in agreement with physiological experiments if the hypothetical retinal error input map is normalized. The neural network predicts that if this normalization is overruled by electrical stimulation, averaging still takes place. However, in this case – as a consequence of the feedback task – the location of the resulting saccade depends on the initial eye position and the total intensity/current applied at the two locations. This could be a way to verify the neural network model. If the assumptions for the model are valid, a physiological implication of this paper is that averaging of saccades takes place upstream of the superior colliculus. Received: 22 June 1997 / Accepted in revised form: 19 February 1998