Improved dimensionally-reduced visual cortical network using stochastic noise modeling

In this paper, we extend our framework for constructing low-dimensional dynamical system models of large-scale neuronal networks of mammalian primary visual cortex. Our dimensional reduction procedure consists of performing a suitable linear change of variables and then systematically truncating the new set of equations. The extended framework includes modeling the effect of neglected modes as a stochastic process. By parametrizing and including stochasticity in one of two ways we show that we can improve the systems-level characterization of our dimensionally reduced neuronal network model. We examined orientation selectivity maps calculated from the firing rate distribution of large-scale simulations and stochastic dimensionally reduced models and found that by using stochastic processes to model the neglected modes, we were able to better reproduce the mean and variance of firing rates in the original large-scale simulations while still accurately predicting the orientation preference distribution.     

How well do reduced models capture the dynamics in models of interacting neurons?

This paper introduces a class of stochastic models of interacting neurons with emergent dynamics similar to those seen in local cortical populations. Rigorous results on existence and uniqueness of nonequilibrium steady states are proved. These network models are then compared to very simple reduced models driven by the same mean excitatory and inhibitory currents. Discrepancies in firing rates between network and reduced models are investigated and explained by correlations in spiking, or partial synchronization, working in concert with “nonlinearities” in the time evolution of membrane potentials. The use of simple random walks and their first passage times to simulate fluctuations in neuronal membrane potentials and interspike times is also considered.

     

Control of computational dynamics of coupled integrate-and-fire neurons

 Generation and control of different dynamical modes of computational processes in a net of interconnected integrate-and-fire neurons are demonstrated. A net architecture resembling a generic cortical structure is formed from pairs of excitatory and inhibitory units with excitatory connections between and inhibitory connections within pairs. Integrate-and-fire model neurons derived from detailed conductance-based models of neocortical pyramidal cells and fast-spiking interneurons are employed for the excitatory and inhibitory units, respectively. Firing-rate adaptation is incorporated into the excitatory units based on the regulation of the slow afterhyperpolarization phase of action potentials by intracellular calcium ions. Saturation of synaptic conductances is implemented for the interconnections between units. It is shown that neuronal adaptation of the excitatory units can generate richer net dynamics than relaxation to fixed-point attractors in a pattern space. At strong adaptivity, i.e. when the neuronal excitability is strongly influenced by the preceding activity, complex dynamics of either aperiodic or limit-cycle character are generated in both the pattern space and the phase space of all dynamical variables. This regime corresponds to an exploratory mode of the system, in which the pattern space can be searched. At weak adaptivity, the dynamics are governed by fixed-point attractors in the pattern space, and this corresponds to a mode for retrieval of a particular pattern. In the brain, neuronal adaptivity can be regulated by various neuromodulators. The results are in accordance with those recently obtained by means of more abstract models formulated in terms of mean firing rates. The increased realism makes the present model reveal more detailed mechanisms and strengthens the relevance of the conclusions to biological systems. The simplicity and realism of the coupled integrate-and-fire neurons make the present model useful for studies of systems in which the temporal aspects of neural coding are important. Received: 8 December 1995 / Accepted in revised form: 23 January 1997     

Cortical network modeling: analytical methods for firing rates and some properties of networks of LIF neurons.

The circuitry of cortical networks involves interacting populations of excitatory (E) and inhibitory (I) neurons whose relationships are now known to a large extent. Inputs to E- and I-cells may have their origins in remote or local cortical areas. We consider a rudimentary model involving E- and I-cells. One of our goals is to test an analytic approach to finding firing rates in neural networks without using a diffusion approximation and to this end we consider in detail networks of excitatory neurons with leaky integrate-and-fire (LIF) dynamics. A simple measure of synchronization, denoted by S(q), where q is between 0 and 100 is introduced. Fully connected E-networks have a large tendency to become dominated by synchronously firing groups of cells, except when inputs are relatively weak. We observed random or asynchronous firing in such networks with diverse sets of parameter values. When such firing patterns were found, the analytical approach was often able to accurately predict average neuronal firing rates. We also considered several properties of E-E networks, distinguishing several kinds of firing pattern. Included were those with silences before or after periods of intense activity or with periodic synchronization. We investigated the occurrence of synchronized firing with respect to changes in the internal excitatory postsynaptic potential (EPSP) magnitude in a network of 100 neurons with fixed values of the remaining parameters. When the internal EPSP size was less than a certain value, synchronization was absent. The amount of synchronization then increased slowly as the EPSP amplitude increased until at a particular EPSP size the amount of synchronization abruptly increased, with S(5) attaining the maximum value of 100%. We also found network frequency transfer characteristics for various network sizes and found a linear dependence of firing frequency over wide ranges of the external afferent frequency, with non-linear effects at lower input frequencies. The theory may also be applied to sparsely connected networks, whose firing behaviour was found to change abruptly as the probability of a connection passed through a critical value. The analytical method was also found to be useful for a feed-forward excitatory network and a network of excitatory and inhibitory neurons.     

Emergent dynamics in a model of visual cortex

This paper proposes that the network dynamics of the mammalian visual cortex are highly structured and strongly shaped by temporally localized barrages of excitatory and inhibitory firing we call ‘multiple-firing events’ (MFEs). Our proposal is based on careful study of a network of spiking neurons built to reflect the coarse physiology of a small patch of layer 2/3 of V1. When appropriately benchmarked this network is capable of reproducing the qualitative features of a range of phenomena observed in the real visual cortex, including spontaneous background patterns, orientation-specific responses, surround suppression and gamma-band oscillations. Detailed investigation into the relevant regimes reveals causal relationships among dynamical events driven by a strong competition between the excitatory and inhibitory populations. It suggests that along with firing rates, MFE characteristics can be a powerful signature of a regime. Testable predictions based on model observations and dynamical analysis are proposed.     

A ring model for spatiotemporal properties of simple cells in the visual cortex

 A neural model is proposed for the spatiotemporal properties of simple cells in the visual cortex. In the model, several cortical cells are arranged on a ring, with mutual excitatory or inhibitory connections. The cells also receive excitatory inputs either from lagged and nonlagged cells of the lateral geniculate nucleus in one setting or from nonlagged cells in the other. Computer simulation shows that the cortical cells have spatiotemporally inseparable receptive fields in the former setting and separable fields in the latter; spatial profiles at a given time in the spatiotemporal fields are described with a Gabor function whose phase parameter varies regularly from 0 to 2π with rotation along the ring; the inseparable cells have directional selectivity as observed physiologically. Received: 13 November 1995 / Accepted in revised form: 1 July 1997     

Beyond Two-Cell Networks: Experimental Measurement of Neuronal Responses to Multiple Synaptic Inputs

Oscillations of large populations of neurons are thought to be important in the normal functioning of the brain. We have used phase response curve (PRC) methods to characterize the dynamics of single neurons and predict population dynamics. Our past experimental work was limited to special circumstances (e.g., 2-cell networks of periodically firing neurons). Here, we explore the feasibility of extending our methods to predict the synchronization properties of stellate cells (SCs) in the rat entorhinal cortex under broader conditions. In particular, we test the hypothesis that PRCs in SCs scale linearly with changes in synaptic amplitude, and measure how well responses to Poisson process-driven inputs can be predicted in terms of PRCs. Although we see nonlinear responses to excitatory and inhibitory inputs, we find that models based on weak coupling account for scaling and Poisson process-driven inputs reasonably accurately.     

Direction selectivity of excitation and inhibition in simple cells of the cat primary visual cortex

Direction selectivity in simple cells of primary visual cortex, defined from their spike responses, cannot be predicted using linear models. It has been suggested that the shunting inhibition evoked by visual stimulation is responsible for the nonlinear component of direction selectivity. Cortical inhibition would suppress a neuron's firing when stimuli move in the nonpreferred direction, but would allow responses to stimuli in the preferred direction. Models of direction selectivity based solely on input from the lateral geniculate nucleus, however, propose that the nonlinear response is caused by spike threshold. By extracting excitatory and inhibitory components of synaptic inputs from intracellular records obtained in vivo, we demonstrate that excitation and inhibition are tuned for the same direction, but differ in relative timing. Further, membrane potential responses combine in a linear fashion. Spike threshold, however, quantitatively accounts for the nonlinear component of direction selectivity, amplifying the direction selectivity of spike output relative to that of synaptic inputs.     

Balancing feed-forward excitation and inhibition via Hebbian inhibitory synaptic plasticity

It has been suggested that excitatory and inhibitory inputs to cortical cells are balanced, and that this balance is important for the highly irregular firing observed in the cortex. There are two hypotheses as to the origin of this balance. One assumes that it results from a stable solution of the recurrent neuronal dynamics. This model can account for a balance of steady state excitation and inhibition without fine tuning of parameters, but not for transient inputs. The second hypothesis suggests that the feed forward excitatory and inhibitory inputs to a postsynaptic cell are already balanced. This latter hypothesis thus does account for the balance of transient inputs. However, it remains unclear what mechanism underlies the fine tuning required for balancing feed forward excitatory and inhibitory inputs. Here we investigated whether inhibitory synaptic plasticity is responsible for the balance of transient feed forward excitation and inhibition. We address this issue in the framework of a model characterizing the stochastic dynamics of temporally anti-symmetric Hebbian spike timing dependent plasticity of feed forward excitatory and inhibitory synaptic inputs to a single post-synaptic cell. Our analysis shows that inhibitory Hebbian plasticity generates 'negative feedback' that balances excitation and inhibition, which contrasts with the 'positive feedback' of excitatory Hebbian synaptic plasticity. As a result, this balance may increase the sensitivity of the learning dynamics to the correlation structure of the excitatory inputs.     

Interactions of glutamate and dopamine in a computational model of the striatum

A network model of simplified striatal principal neurons with mutual inhibition was used to investigate possible interactions between cortical glutamatergic and nigral dopaminergic afferents in the neostriatum. Glutamatergic and dopaminergic inputs were represented by an excitatory synaptic conductance and a slow membrane potassium conductance, respectively. Neuronal activity in the model was characterized by episodes of increased action potential firing rates of variable duration and frequency. Autocorrelation histograms constructed from the action potential activity of striatal model neurons showed that reducing peak excitatory conductance had the effect of increasing interspike intervals. On the other hand, the maximum value of the dopamine-sensitive potassium conductance was inversely related to the duration of firing episodes and the maximal firing rates. A smaller potassium conductance restored normal firing rates in the most active neurons at the expense of a larger proportion of neurons showing reduced activity. Thus, a homogeneous network with mutual inhibition can produce equally complex dynamics as have been proposed to occur in a striatal network with two neuron populations that are oppositely regulated by dopamine. Even without mutual inhibition it appears that increased dopamine concentrations could partially compensate for the effects of reduced glutamatergic input in individual neurons.     

Uncovering bifurcation patterns in cortical synapses

Individual cortical synapses are known to exhibit a very complex short-time dynamic behaviour in response to simple “naturalistic” stimulation. We describe a computational study of the experimentally obtained excitatory post-synaptic potential trains of individual cortical synapses. By adopting a new nonlinear modelling scheme we construct robust and repeatable models of the underlying dynamics. These models suggest that cortical synapses exhibit a wide range of either periodic or chaotic dynamics. For stimulus at a fixed rate our models predict that the response of the individual synapse will vary from a fixed point to periodic and chaotic, depending on the frequency of stimulus. Dynamics for individual synapses vary widely, suggesting that the individual behaviour of synapses is highly tuned and that the dynamic behaviour of even a small network of synapse-coupled neurons could be extremely varied.     

Linking dynamics of the inhibitory network to the input structure

Networks of inhibitory interneurons are found in many distinct classes of biological systems. Inhibitory interneurons govern the dynamics of principal cells and are likely to be critically involved in the coding of information. In this theoretical study, we describe the dynamics of a generic inhibitory network in terms of low-dimensional, simplified rate models. We study the relationship between the structure of external input applied to the network and the patterns of activity arising in response to that stimulation. We found that even a minimal inhibitory network can generate a great diversity of spatio-temporal patterning including complex bursting regimes with non-trivial ratios of burst firing. Despite the complexity of these dynamics, the network’s response patterns can be predicted from the rankings of the magnitudes of external inputs to the inhibitory neurons. This type of invariant dynamics is robust to noise and stable in densely connected networks with strong inhibitory coupling. Our study predicts that the response dynamics generated by an inhibitory network may provide critical insights about the temporal structure of the sensory input it receives.     

Conductance-based refractory density model of primary visual cortex

A layered continual population model of primary visual cortex has been constructed, which reproduces a set of experimental data, including postsynaptic responses of single neurons on extracellular electric stimulation and spatially distributed activity patterns in response to visual stimulation. In the model, synaptically interacting excitatory and inhibitory neuronal populations are described by a conductance-based refractory density approach. Populations of two-compartment excitatory and inhibitory neurons in cortical layers 2/3 and 4 are distributed in the 2-d cortical space and connected by AMPA, NMDA and GABA type synapses. The external connections are pinwheel-like, according to the orientation of a stimulus. Intracortical connections are isotropic local and patchy between neurons with similar orientations. The model proposes better temporal resolution and more detailed elaboration than conventional mean-field models. In comparison to large network simulations, it excludes a posteriori statistical data manipulation and provides better computational efficiency and minimal parametrization.     

Estimation of Thalamocortical and Intracortical Network Models from Joint Thalamic Single-Electrode and Cortical Laminar-Electrode Recordings in the Rat Barrel System

A new method is presented for extraction of population firing-rate models for both thalamocortical and intracortical signal transfer based on stimulus-evoked data from simultaneous thalamic single-electrode and cortical recordings using linear (laminar) multielectrodes in the rat barrel system. Time-dependent population firing rates for granular (layer 4), supragranular (layer 2/3), and infragranular (layer 5) populations in a barrel column and the thalamic population in the homologous barreloid are extracted from the high-frequency portion (multi-unit activity; MUA) of the recorded extracellular signals. These extracted firing rates are in turn used to identify population firing-rate models formulated as integral equations with exponentially decaying coupling kernels, allowing for straightforward transformation to the more common firing-rate formulation in terms of differential equations. Optimal model structures and model parameters are identified by minimizing the deviation between model firing rates and the experimentally extracted population firing rates. For the thalamocortical transfer, the experimental data favor a model with fast feedforward excitation from thalamus to the layer-4 laminar population combined with a slower inhibitory process due to feedforward and/or recurrent connections and mixed linear-parabolic activation functions. The extracted firing rates of the various cortical laminar populations are found to exhibit strong temporal correlations for the present experimental paradigm, and simple feedforward population firing-rate models combined with linear or mixed linear-parabolic activation function are found to provide excellent fits to the data. The identified thalamocortical and intracortical network models are thus found to be qualitatively very different. While the thalamocortical circuit is optimally stimulated by rapid changes in the thalamic firing rate, the intracortical circuits are low-pass and respond most strongly to slowly varying inputs from the cortical layer-4 population.     

Coarse-grained reduction and analysis of a network model of cortical response: I. Drifting grating stimuli

We present a reduction of a large-scale network model of visual cortex developed by McLaughlin, Shapley, Shelley, and Wielaard. The reduction is from many integrate-and-fire neurons to a spatially coarse-grained system for firing rates of neuronal subpopulations. It accounts explicitly for spatially varying architecture, ordered cortical maps (such as orientation preference) that vary regularly across the cortical layer, and disordered cortical maps (such as spatial phase preference or stochastic input conductances) that may vary widely from cortical neuron to cortical neuron. The result of the reduction is a set of nonlinear spatiotemporal integral equations for phase-averaged firing rates of neuronal subpopulations across the model cortex, derived asymptotically from the full model without the addition of any extra phenomological constants. This reduced system is used to study the response of the model to drifting grating stimuli—where it is shown to be useful for numerical investigations that reproduce, at far less computational cost, the salient features of the point-neuron network and for analytical investigations that unveil cortical mechanisms behind the responses observed in the simulations of the large-scale computational model. For example, the reduced equations clearly show (1) phase averaging as the source of the time-invariance of cortico-cortical conductances, (2) the mechanisms in the model for higher firing rates and better orientation selectivity of simple cells which are near pinwheel centers, (3) the effects of the length-scales of cortico-cortical coupling, and (4) the role of noise in improving the contrast invariance of orientation selectivity.     

Dynamic Excitatory and Inhibitory Gain Modulation Can Produce Flexible,Robust and Optimal Decision-making

Behavioural and neurophysiological studies in primates have increasingly shown the involvement of urgency signals during the temporal integration of sensory evidence in perceptual decision-making. Neuronal correlates of such signals have been found in the parietal cortex, and in separate studies, demonstrated attention-induced gain modulation of both excitatory and inhibitory neurons. Although previous computational models of decision-making have incorporated gain modulation, their abstract forms do not permit an understanding of the contribution of inhibitory gain modulation. Thus, the effects of co-modulating both excitatory and inhibitory neuronal gains on decision-making dynamics and behavioural performance remain unclear. In this work, we incorporate time-dependent co-modulation of the gains of both excitatory and inhibitory neurons into our previous biologically based decision circuit model. We base our computational study in the context of two classic motion-discrimination tasks performed in animals. Our model shows that by simultaneously increasing the gains of both excitatory and inhibitory neurons, a variety of the observed dynamic neuronal firing activities can be replicated. In particular, the model can exhibit winner-take-all decision-making behaviour with higher firing rates and within a significantly more robust model parameter range. It also exhibits short-tailed reaction time distributions even when operating near a dynamical bifurcation point. The model further shows that neuronal gain modulation can compensate for weaker recurrent excitation in a decision neural circuit, and support decision formation and storage. Higher neuronal gain is also suggested in the more cognitively demanding reaction time than in the fixed delay version of the task. Using the exact temporal delays from the animal experiments, fast recruitment of gain co-modulation is shown to maximize reward rate, with a timescale that is surprisingly near the experimentally fitted value. Our work provides insights into the simultaneous and rapid modulation of excitatory and inhibitory neuronal gains, which enables flexible, robust, and optimal decision-making.     

Firing patterns in the adaptive exponential integrate-and-fire model

For simulations of large spiking neuron networks, an accurate, simple and versatile single-neuron modeling framework is required. Here we explore the versatility of a simple two-equation model: the adaptive exponential integrate-and-fire neuron. We show that this model generates multiple firing patterns depending on the choice of parameter values, and present a phase diagram describing the transition from one firing type to another. We give an analytical criterion to distinguish between continuous adaption, initial bursting, regular bursting and two types of tonic spiking. Also, we report that the deterministic model is capable of producing irregular spiking when stimulated with constant current, indicating low-dimensional chaos. Lastly, the simple model is fitted to real experiments of cortical neurons under step current stimulation. The results provide support for the suitability of simple models such as the adaptive exponential integrate-and-fire neuron for large network simulations.     

Extended difference-of-Gaussians model incorporating cortical feedback for relay cells in the lateral geniculate nucleus of cat

A striking feature of the organization of the early visual pathway is the significant feedback from primary visual cortex to cells in the dorsal lateral geniculate nucleus (LGN). Despite numerous experimental and modeling studies, the functional role for this feedback remains elusive. We present a new firing-rate-based model for LGN relay cells in cat, explicitly accounting for thalamocortical loop effects. The established DOG model, here assumed to account for the spatial aspects of the feedforward processing of visual stimuli, is extended to incorporate the influence of thalamocortical loops including a full set of orientation-selective cortical cell populations. Assuming a phase-reversed push-pull arrangement of ON and OFF cortical feedback as seen experimentally, this extended DOG (eDOG) model exhibits linear firing properties despite non-linear firing characteristics of the corticothalamic cells. The spatiotemporal receptive field of the eDOG model has a simple algebraic structure in Fourier space, while the real-space receptive field, as well as responses to visual stimuli, are found by evaluation of an integral. As an example application we use the eDOG model to study effects of cortical feedback on responses to flashing circular spots and patch-grating stimuli and find that the eDOG model can qualitatively account for experimental findings.