Modelling studies on the computational function of fast temporal structure in cortical circuit activity

The interplay between modelling and experimental studies can support the exploration of the function of neuronal circuits in the cortex. We exemplify such an approach with a study on the role of spike timing and gamma-oscillations in associative memory in strongly connected circuits of cortical neurones. It is demonstrated how associative memory studies on different levels of abstraction can specify the functionality to be expected in real cortical neuronal circuits. In our model overlapping random configurations of sparse cell populations correspond to memory items that are stored by simple Hebbian coincidence learning. This associative memory task will be implemented with biophysically well tested compartmental neurones developed by Pinsky and Rinzel . We ran simulation experiments to study memory recall in two network architectures: one interconnected pool of cells, and two reciprocally connected pools. When recalling a memory by stimulating a spatially overlapping set of cells, the completed pattern is coded by an event of synchronized single spikes occurring after 25-60 ms. These fast associations are performed even at a memory load corresponding to the memory capacity of optimally tuned formal associative networks (>0.1 bit/synapse). With tonic stimulation or feedback loops in the network the neurones fire periodically in the gamma-frequency range (20-80 Hz). With fast changing inputs memory recall can be switched between items within a single gamma cycle. Thus, oscillation is not a primary coding feature necessary for associative memory. However, it accompanies reverberatory feedback providing an improved iterative memory recall completed after a few gamma cycles (60-260 ms). In the bidirectional architecture reverberations do not express in a rigid phase locking between the pools. For small stimulation sets bursting occurred in these cells acting as a supportive mechanism for associative memory.     

Transitory memory retrieval in a biologically plausible neural network model

A number of memory models have been proposed. These all have the basic structure that excitatory neurons are reciprocally connected by recurrent connections together with the connections with inhibitory neurons, which yields associative memory (i.e., pattern completion) and successive retrieval of memory. In most of the models, a simple mathematical model for a neuron in the form of a discrete map is adopted. It has not, however, been clarified whether behaviors like associative memory and successive retrieval of memory appear when a biologically plausible neuron model is used. In this paper, we propose a network model for associative memory and successive retrieval of memory based on Pinsky-Rinzel neurons. The state of pattern completion in associative memory can be observed with an appropriate balance of excitatory and inhibitory connection strengths. Increasing of the connection strength of inhibitory interneurons changes the state of memory retrieval from associative memory to successive retrieval of memory. We investigate this transition.     

Electrical properties of the dendrite in an insect mechanoreceptor: Effects of antidromic or direct electrical stimulation

A study of the negative phase of the spikes recorded extra cellularly from insect mechanoreceptor has been performed in order to characterize some electrical properties of the dendrite which contains the transducing part of the sensory neuron. These properties have been investigated in mechanoreceptors of the metathoracic leg of the locust Schistocerca gregaria by firing antidromic action potentials both at rest and during mechanical or electrical stimulation. The amplitude of the negative phase of the spike appears to be correlated with the polarization of the dendritic membrane, although when bursts of action potentials are applied, the relation is more complex, including a depressive influence of a given spike on the following spike. The receptor potential and the antidromic dendritic spikes both originate in the same region of the dendrite but they involve different ionic processes. Our results indicate that the dendrite is electrically excitable. The spike which originates in the dendrite has an initial negative phase with a small superimposed positive component. A spike of this shape is never observed under natural stimulation. It is proposed that the negative phase of the antidromic impulse provides a suitable means for studying the variations in electrical polarization of the dendrite which cannot be recorded directly.     

Adapting a Feedforward Heteroassociative Network to Hodgkin-Huxley Dynamics

Using the original McCulloch-Pitts notion of simple on and off spike coding in lieu of rate coding, an Anderson-Kohonen artificial neural network (ANN) associative memory model was ported to a neuronal network with Hodgkin-Huxley dynamics. In the ANN, the use of 0/1 (no-spike/spike) units introduced a cross-talk term that had to be compensated by introducing balanced feedforward inhibition. The resulting ANN showed good capacity and fair selectivity (rejection of unknown input vectors). Translation to the Hodgkin-Huxley model resulted in a network that was functional but not at all robust. Evaluation of the weaknesses of this network revealed that it functioned far better using spike timing, rather than spike occurrence, as the code. The algorithm requires a novel learning algorithm for feedforward inhibition that could be sought physiologically.     

The chronotron: a neuron that learns to fire temporally precise spike patterns

In many cases, neurons process information carried by the precise timings of spikes. Here we show how neurons can learn to generate specific temporally precise output spikes in response to input patterns of spikes having precise timings, thus processing and memorizing information that is entirely temporally coded, both as input and as output. We introduce two new supervised learning rules for spiking neurons with temporal coding of information (chronotrons), one that provides high memory capacity (E-learning), and one that has a higher biological plausibility (I-learning). With I-learning, the neuron learns to fire the target spike trains through synaptic changes that are proportional to the synaptic currents at the timings of real and target output spikes. We study these learning rules in computer simulations where we train integrate-and-fire neurons. Both learning rules allow neurons to fire at the desired timings, with sub-millisecond precision. We show how chronotrons can learn to classify their inputs, by firing identical, temporally precise spike trains for different inputs belonging to the same class. When the input is noisy, the classification also leads to noise reduction. We compute lower bounds for the memory capacity of chronotrons and explore the influence of various parameters on chronotrons' performance. The chronotrons can model neurons that encode information in the time of the first spike relative to the onset of salient stimuli or neurons in oscillatory networks that encode information in the phases of spikes relative to the background oscillation. Our results show that firing one spike per cycle optimizes memory capacity in neurons encoding information in the phase of firing relative to a background rhythm.     

Coding of odor intensity in a steady-state deterministic model of an olfactory receptor neuron

The coding of odor intensity by an olfactory receptor neuron model was studied under steady-state stimulation. Our model neuron is an elongated cylinder consisting of the following three components: a sensory dendritic region bearing odorant receptors, a passive region consisting of proximal dendrite and cell body, and an axon. First, analytical solutions are given for the three main physiological responses: (1) odorant-dependent conductance change at the sensory dendrite based on the Michaelis-Menten model, (2) generation and spreading of the receptor potential based on a new solution of the cable equation, and (3) firing frequency based on a Lapicque model. Second, the magnitudes of these responses are analyzed as a function of odorant concentration. Their dependence on chemical, electrical, and geometrical parameters is examined. The only evident gain in magnitude results from the activation-to-conductance conversion. An optimal encoder neuron is presented that suggests that increasing the length of the sensory dendrite beyond about 0.3 space constant does not increase the magnitude of the receptor potential. Third, the sensivities of the responses are examined as functions of (1) the concentration at half-maximum response, (2) the lower and upper concentrations actually discriminated, and (3) the width of the dynamic range. The overall gain in sensitivity results entirely from the conductance-to-voltage conversion. The maximum conductance at the sensory dendrite appears to be the main tuning constant of the neuron because it determines the shift toward low concentrations and the increase in dynamic range. The dynamic range of the model cannot exceed 5.7 log units, for a sensitivity increase at low odor concentration is compensated by a sensitivity decrease at high odor concentration.     

Towards a unifying model of neural net activity in the visual cortex

A neural net model describing the non-linear interactions between axonal spikes is presented. It reconciles aspects of pattern recognition (as action of an associative memory) with those of spike synchronization and phase locking. The stability of the synchronized state is studied in detail.     

Neuronal Spike Initiation Modulated by Extracellular Electric Fields

Based on a reduced two-compartment model, the dynamical and biophysical mechanism underlying the spike initiation of the neuron to extracellular electric fields is investigated in this paper. With stability and phase plane analysis, we first investigate in detail the dynamical properties of neuronal spike initiation induced by geometric parameter and internal coupling conductance. The geometric parameter is the ratio between soma area and total membrane area, which describes the proportion of area occupied by somatic chamber. It is found that varying it could qualitatively alter the bifurcation structures of equilibrium as well as neuronal phase portraits, which remain unchanged when varying internal coupling conductance. By analyzing the activating properties of somatic membrane currents at subthreshold potentials, we explore the relevant biophysical basis of spike initiation dynamics induced by these two parameters. It is observed that increasing geometric parameter could greatly decrease the intensity of the internal current flowing from soma to dendrite, which switches spike initiation dynamics from Hopf bifurcation to SNIC bifurcation; increasing internal coupling conductance could lead to the increase of this outward internal current, whereas the increasing range is so small that it could not qualitatively alter the spike initiation dynamics. These results highlight that neuronal geometric parameter is a crucial factor in determining the spike initiation dynamics to electric fields. The finding is useful to interpret the functional significance of neuronal biophysical properties in their encoding dynamics, which could contribute to uncovering how neuron encodes electric field signals.     

主动联想记忆神经网络模型

在信息编码能提高联想记忆的存贮能力和脑内存在主动活动机制的启发下,提出一个主动联想记忆模型。模型包括两个神经网络,其一为输入和输出网络,另一个为在学习时期能自主产生兴奋模式的主动网络。两个网络的神经元之间有突触联系。由于自主产生的兴奋模式与输入无关,并可能接近于相互正交,因此,本模型有较高的存贮能力。初步分析和计算机仿真证明：本模型确有比通常联想记忆模型高的存贮能力,特别是在输入模式间有高度相关情况下、最后,对提出的模型与双向自联想记忆和光学全息存贮机制的关系作了讨论。     

Co-variation of ionic conductances supports phase maintenance in stomatogastric neurons

Neuronal networks produce reliable functional output throughout the lifespan of an animal despite ceaseless molecular turnover and a constantly changing environment. Central pattern generators, such as those of the crustacean stomatogastric ganglion (STG), are able to robustly maintain their functionality over a wide range of burst periods. Previous experimental work involving extracellular recordings of the pyloric pattern of the STG has demonstrated that as the burst period varies, the inter-neuronal delays are altered proportionally, resulting in burst phases that are roughly invariant. The question whether spike delays within bursts are also proportional to pyloric period has not been explored in detail. The mechanism by which the pyloric neurons accomplish phase maintenance is currently not obvious. Previous studies suggest that the co-regulation of certain ion channel properties may play a role in governing neuronal activity. Here, we observed in long-term recordings of the pyloric rhythm that spike delays can vary proportionally with burst period, so that spike phase is maintained. We then used a conductance-based model neuron to determine whether co-varying ionic membrane conductances results in neural output that emulates the experimentally observed phenomenon of spike phase maintenance. Next, we utilized a model neuron database to determine whether conductance correlations exist in model neuron populations with highly maintained spike phases. We found that co-varying certain conductances, including the sodium and transient calcium conductance pair, causes the model neuron to maintain a specific spike phase pattern. Results indicate a possible relationship between conductance co-regulation and phase maintenance in STG neurons.     

A persistent cellular change in a single modulatory neuron contributes to associative long-term memory

Most neuronal models of learning assume that changes in synaptic strength are the main mechanism underlying long-term memory (LTM) formation. However, we show here that a persistent depolarization of membrane potential, a type of cellular change that increases neuronal responsiveness, contributes significantly to a long-lasting associative memory trace. The use of a model invertebrate network with identified neurons and known synaptic connectivity had the advantage that the contribution of this cellular change to memory could be evaluated in a neuron with a known function in the learning circuit. Specifically, we used the well-understood motor circuit underlying molluscan feeding and showed that a key modulatory neuron involved in the initiation of feeding ingestive movements underwent a long-term depolarization following behavioral associative conditioning. This depolarization led to an enhanced single cell and network responsiveness to a previously neutral tactile conditioned stimulus, and the persistence of both matched the time course of behavioral associative memory. The change in the membrane potential of a key modulatory neuron is both sufficient and necessary to initiate a conditioned response in a reduced preparation and underscores its importance for associative LTM.     

An unsupervised automatic method for sorting neuronal spike waveforms in awake and freely moving animals

The present study introduces an approach to automatic classification of extracellularly recorded action potentials of neurons. The classification of spike waveform is considered a pattern recognition problem of special segments of signal that correspond to the appearance of spikes. The spikes generated by one neuron should be recognized as members of the same class. The spike waveforms are described by the nonlinear oscillating model as an ordinary differential equation with perturbation, thus characterizing the signal distortions in both amplitude and phase. It is shown that the use of local variables reduces the problem of spike recognition to the separation of a mixture of normal distributions in the transformed feature space. We have developed an unsupervised iteration-learning algorithm that estimates the number of classes and their centers according to the distance between spike trajectories in phase space. This algorithm scans the learning set to evaluate spike trajectories with maximal probability density in their neighborhood. Following the learning, the procedure of minimal distance is used to perform spike recognition. Estimation of trajectories in phase space requires calculation of the first- and second-order derivatives, and integral operators with piecewise polynomial kernels were used. This provided the computational efficiency of the developed approach for real-time application as required by recordings in behaving animals and in human neurosurgical operations. The new method of spike sorting was tested on simulated and real data and performed better than other approaches currently used in neurophysiology.     

Auditory-evoked spike firing in the lateral amygdala and Pavlovian fear conditioning: mnemonic code or fear bias?

Amygdala neuroplasticity has emerged as a candidate substrate for Pavlovian fear memory. By this view, conditional stimulus (CS)-evoked activity represents a mnemonic code that initiates the expression of fear behaviors. However, a fear state may nonassociatively enhance sensory processing, biasing CS-evoked activity in amygdala neurons. Here we describe experiments that dissociate auditory CS-evoked spike firing in the lateral amygdala (LA) and both conditional fear behavior and LA excitability in rats. We found that the expression of conditional freezing and increased LA excitability was neither necessary nor sufficient for the expression of conditional increases in CS-evoked spike firing. Rather, conditioning-related changes in CS-evoked spike firing were solely determined by the associative history of the CS. Thus, our data support a model in which associative activity in the LA encodes fear memory and contributes to the expression of learned fear behaviors.     

Formation of feedforward networks and frequency synchrony by spike-timing-dependent plasticity

Spike-timing-dependent plasticity (STDP) with asymmetric learning windows is commonly found in the brain and useful for a variety of spike-based computations such as input filtering and associative memory. A natural consequence of STDP is establishment of causality in the sense that a neuron learns to fire with a lag after specific presynaptic neurons have fired. The effect of STDP on synchrony is elusive because spike synchrony implies unitary spike events of different neurons rather than a causal delayed relationship between neurons. We explore how synchrony can be facilitated by STDP in oscillator networks with a pacemaker. We show that STDP with asymmetric learning windows leads to self-organization of feedforward networks starting from the pacemaker. As a result, STDP drastically facilitates frequency synchrony. Even though differences in spike times are lessened as a result of synaptic plasticity, the finite time lag remains so that perfect spike synchrony is not realized. In contrast to traditional mechanisms of large-scale synchrony based on mutual interaction of coupled neurons, the route to synchrony discovered here is enslavement of downstream neurons by upstream ones. Facilitation of such feedforward synchrony does not occur for STDP with symmetric learning windows. Action Editor: Wulfram Gerstner     

History-dependent excitability as a single-cell substrate of transient memory for information discrimination

Neurons react differently to incoming stimuli depending upon their previous history of stimulation. This property can be considered as a single-cell substrate for transient memory, or context-dependent information processing: depending upon the current context that the neuron "sees" through the subset of the network impinging on it in the immediate past, the same synaptic event can evoke a postsynaptic spike or just a subthreshold depolarization. We propose a formal definition of History-Dependent Excitability (HDE) as a measure of the propensity to firing in any moment in time, linking the subthreshold history-dependent dynamics with spike generation. This definition allows the quantitative assessment of the intrinsic memory for different single-neuron dynamics and input statistics. We illustrate the concept of HDE by considering two general dynamical mechanisms: the passive behavior of an Integrate and Fire (IF) neuron, and the inductive behavior of a Generalized Integrate and Fire (GIF) neuron with subthreshold damped oscillations. This framework allows us to characterize the sensitivity of different model neurons to the detailed temporal structure of incoming stimuli. While a neuron with intrinsic oscillations discriminates equally well between input trains with the same or different frequency, a passive neuron discriminates better between inputs with different frequencies. This suggests that passive neurons are better suited to rate-based computation, while neurons with subthreshold oscillations are advantageous in a temporal coding scheme. We also address the influence of intrinsic properties in single-cell processing as a function of input statistics, and show that intrinsic oscillations enhance discrimination sensitivity at high input rates. Finally, we discuss how the recognition of these cell-specific discrimination properties might further our understanding of neuronal network computations and their relationships to the distribution and functional connectivity of different neuronal types.     

Izhikevich神经元网络的同步与联想记忆

联想记忆是人脑的一项重要功能。以Izhikevich神经元模型为节点,构建神经网络,神经元之间采用全连结的方式;以神经元群体的时空编码（spatio-temporal coding）理论研究所构建神经网络的联想记忆功能。在加入高斯白噪声的情况下,调节网络中神经元之间的连接强度的大小,当连接强度和噪声强度达到一个阈值时网络中部分神经元同步放电,实现了存储模式的联想记忆与恢复。仿真结果表明,神经元之间的连接强度在联想记忆的过程中发挥了重要的作用,噪声可以促使神经元间的同步放电,有助于神经网络实现存储模式的联想记忆与恢复。     

Functional model of biological neural networks

A functional model of biological neural networks, called temporal hierarchical probabilistic associative memory (THPAM), is proposed in this paper. THPAM comprises functional models of dendritic trees for encoding inputs to neurons, a first type of neuron for generating spike trains, a second type of neuron for generating graded signals to modulate neurons of the first type, supervised and unsupervised Hebbian learning mechanisms for easy learning and retrieving, an arrangement of dendritic trees for maximizing generalization, hardwiring for rotation-translation-scaling invariance, and feedback connections with different delay durations for neurons to make full use of present and past informations generated by neurons in the same and higher layers. These functional models and their processing operations have many functions of biological neural networks that have not been achieved by other models in the open literature and provide logically coherent answers to many long-standing neuroscientific questions. However, biological justifications of these functional models and their processing operations are required for THPAM to qualify as a macroscopic model (or low-order approximate) of biological neural networks.     

An after-shannon measure of the storage capacity of an associative noise-like coding memory

The maximum amount of information that can be stored, on the average, in each storage element, according to an associative scheme, has been measured for the memory model proposed by the author (Bottini 1980). In this model, the (binary) items being stored are coded by noise-like keys and the memory traces formed in this way are superimposed, by algebraic addition, on the same many-level storage elements. It is shown that the problem of measuring the information retrieved from the memory in a single recall and the problem — concerning the data-communication field —of measuring the information transmitted over a noisy channel are formally similar. In particular, the Shannon noisy-channel coding theorem can find an application also in our case of an associative memory. Finally, it is evidenced that the so-called matrix model of an associative memory has the same storage capacity as the model studied here.     

神经元放电阈值的可变性及其意义

神经元能够将不同时空模式的突触输入转化为时序精确的动作电位输出，这种灵活、可靠的信息编码方式是神经集群在动态环境或特定任务下产生所需活动模式的重要基础。动作电位的产生遵循全或无规律，只有当细胞膜电压达到放电阈值时，神经元才产生动作电位。放电阈值在细胞内和细胞间具有高度可变性，具体动态依赖于刺激输入和放电历史。特别是，放电阈值对动作电位起始前的膜电压变化十分敏感，这种状态依赖性产生的生物物理根源包括Na⁺失活和K⁺激活。在绝大多数神经元中，动作电位的触发位置是轴突起始端，这个位置处的阈值可变性是决定神经元对时空输入转化规律的关键因素。但是，电生理实验中动作电位的记录位置却通常是胞体或近端树突，此处的阈值可变性高于轴突起始端，而其产生的重要根源是轴突动作电位的反向传播。基于胞体测量的相关研究显示，放电阈值动态能够增强神经元的时间编码、特征选择、增益调控和同时侦测能力。本文首先介绍放电阈值的概念及量化方法，然后详细梳理近年来国内外关于放电阈值可变性及产生根源的研究进展，在此基础上归纳总结放电阈值可变性对神经元编码的重要性，最后对未来放电阈值的研究方向进行展望。