Synaptic integration fields and associative plasticity of visual cortical cells in vivo

Two major constraints in connectivity decide the spatial extent of visual cortical receptive fields, both during development and adult functioning: 1) feedforward input, extrinsic to visual cortex, is organized in an orderly projection to form a point-to-point mapping of the retina onto the cortical mantle and constitutes the core of the minimal discharge field (MDF) after amplification by local intracortical circuits; and 2) a second type of connectivity consists of long distance horizontal intracortical connections which are thought to favor the binding of local visual operations occurring simultaneously in different parts of the visual field. We review here possible factors, intrinsic to the considered cortical cell, that may control the effectiveness of post-synaptic integration. Their expression during sensory recognition could depend on the spatio-temporal distribution of active inputs onto the target cell dendrite and on their interplay with non-linearities of the membrane properties. On the basis of intracellular recordings in cat area 17, we have observed that peripheral responses (excitatory and inhibitory) could be boosted by coincident postsynaptic depolarization. This effect is lost if the response and the postsynaptic depolarization are mismatched by 1000 ms, suggesting that temporal correlation of central and peripheral responses could regulate in a non-linear manner the gain of center-surround interactions. This temporal selectivity is compatible with up-regulation of composite potentials by the transient voltage-dependent activation of slowly inactivating conductances in visual cortical neurons. A direct consequence of these different considerations is that the receptive field (RF) of neurons in visual pathways should not be considered as a static hardwired window probing the outer environment, but as an active filter which may continuously adapt and be updated as a function of global context and past experience.     

Coexistence of lateral and co-tuned inhibitory configurations in cortical networks

The responses of neurons in sensory cortex depend on the summation of excitatory and inhibitory synaptic inputs. How the excitatory and inhibitory inputs scale with stimulus depends on the network architecture, which ranges from the lateral inhibitory configuration where excitatory inputs are more narrowly tuned than inhibitory inputs, to the co-tuned configuration where both are tuned equally. The underlying circuitry that gives rise to lateral inhibition and co-tuning is yet unclear. Using large-scale network simulations with experimentally determined connectivity patterns and simulations with rate models, we show that the spatial extent of the input determined the configuration: there was a smooth transition from lateral inhibition with narrow input to co-tuning with broad input. The transition from lateral inhibition to co-tuning was accompanied by shifts in overall gain (reduced), output firing pattern (from tonic to phasic) and rate-level functions (from non-monotonic to monotonically increasing). The results suggest that a single cortical network architecture could account for the extended range of experimentally observed response types between the extremes of lateral inhibitory versus co-tuned configurations.     

Artificial neural network learning of nonstationary behavior in time series

We refine and complement a previously-proposed artificial neural network method for learning hidden signals forcing nonstationary behavior in time series. The method adds an extra input unit to the network and feeds it with the proposed profile for the unknown perturbing signal. The correct time evolution of this new input parameter is learned simultaneously with the intrinsic stationary dynamics underlying the series, which is accomplished by minimizing a suitably-defined error function for the training process. We incorporate here the use of validation data, held out from the training set, to accurately determine the optimal value of a hyperparameter required by the method. Furthermore, we evaluate this algorithm in a controlled situation and show that it outperforms other existing methods in the literature. Finally, we discuss a preliminary application to the real-world sunspot time series and link the obtained hidden perturbing signal to the secular evolution of the solar magnetic field.     

Development of spatial coarse-to-fine processing in the visual pathway

The sequential analysis of information in a coarse-to-fine manner is a fundamental mode of processing in the visual pathway. Spatial frequency (SF) tuning, arguably the most fundamental feature of spatial vision, provides particular intuition within the coarse-to-fine framework: low spatial frequencies convey global information about an image (e.g., general orientation), while high spatial frequencies carry more detailed information (e.g., edges). In this paper, we study the development of cortical spatial frequency tuning. As feedforward input from the lateral geniculate nucleus (LGN) has been shown to have significant influence on cortical coarse-to-fine processing, we present a firing-rate based thalamocortical model which includes both feedforward and feedback components. We analyze the relationship between various model parameters (including cortical feedback strength) and responses. We confirm the importance of the antagonistic relationship between the center and surround responses in thalamic relay cell receptive fields (RFs), and further characterize how specific structural LGN RF parameters affect cortical coarse-to-fine processing. Our results also indicate that the effect of cortical feedback on spatial frequency tuning is age-dependent: in particular, cortical feedback more strongly affects coarse-to-fine processing in kittens than in adults. We use our results to propose an experimentally testable hypothesis for the function of the extensive feedback in the corticothalamic circuit.     

Pharmacological evaluation of GABAergic and glutamatergic inputs to the nucleus basalis--cortical and the septal-hippocampal cholinergic projections

The presence of different receptor populations within a given brain area can be effectively evaluated via the local injections of defined receptor agonists and antagonists. Using this approach, it has become evident that the nucleus basalis - cortical cholinergic pathway possesses an inhibitory GABAergic input to the nucleus basalis from the nucleus accumbens as well as a positive glutamatergic feedback from the cortex. The septal-hippocampal cholinergic pathway also possesses an inhibitory GABAergic regulation which consists of a large GABAergic interneuron population in the septum. A glutamatergic feedback from the hippocampus is also present. These regulatory inputs to cholinergic cells are not tonically active but appear to function as phasic modulators of cholinergic transmission in both pathways.     

Gain modulation from background synaptic input

Gain modulation is a prominent feature of neuronal activity recorded in behaving animals, but the mechanism by which it occurs is unknown. By introducing a barrage of excitatory and inhibitory synaptic conductances that mimics conditions encountered in vivo into pyramidal neurons in slices of rat somatosensory cortex, we show that the gain of a neuronal response to excitatory drive can be modulated by varying the level of "background" synaptic input. Simultaneously increasing both excitatory and inhibitory background firing rates in a balanced manner results in a divisive gain modulation of the neuronal response without appreciable signal-independent increases in firing rate or spike-train variability. These results suggest that, within active cortical circuits, the overall level of synaptic input to a neuron acts as a gain control signal that modulates responsiveness to excitatory drive.     

The effect of intracortical competition on the formation of topographic maps in models of Hebbian learning

Correlation-based learning (CBL) models and self-organizing maps (SOM) are two classes of Hebbian models that have both been proposed to explain the activity-driven formation of cortical maps. Both models differ significantly in the way lateral cortical interactions are treated, leading to different predictions for the formation of receptive fields. The linear CBL models predict that receptive field profiles are determined by the average values and the spatial correlations of the second order of the afferent activity patterns, wheras SOM models map stimulus features. Here, we investigate a class of models which are characterized by a variable degree of lateral competition and which have the CBL and SOM models as limit cases. We show that there exists a critical value for intracortical competition below which the model exhibits CBL properties and above which feature mapping sets in. The class of models is then analyzed with respect to the formation of topographic maps between two layers of neurons. For Gaussian input stimuli we find that localized receptive fields and topographic maps emerge above the critical value for intracortical competition, and we calculate this value as a function of the size of the input stimuli and the range of the lateral interaction function. Additionally, we show that the learning rule can be derived via the optimization of a global cost function in a framework of probabilistic output neurons which represent a set of input stimuli by a sparse code. Received: 23 June 1999 / Accepted in revised form: 05 November 1999     

LTS and FS inhibitory interneurons, short-term synaptic plasticity, and cortical circuit dynamics

Somatostatin-expressing, low threshold-spiking (LTS) cells and fast-spiking (FS) cells are two common subtypes of inhibitory neocortical interneuron. Excitatory synapses from regular-spiking (RS) pyramidal neurons to LTS cells strongly facilitate when activated repetitively, whereas RS-to-FS synapses depress. This suggests that LTS neurons may be especially relevant at high rate regimes and protect cortical circuits against over-excitation and seizures. However, the inhibitory synapses from LTS cells usually depress, which may reduce their effectiveness at high rates. We ask: by which mechanisms and at what firing rates do LTS neurons control the activity of cortical circuits responding to thalamic input, and how is control by LTS neurons different from that of FS neurons? We study rate models of circuits that include RS cells and LTS and FS inhibitory cells with short-term synaptic plasticity. LTS neurons shift the RS firing-rate vs. current curve to the right at high rates and reduce its slope at low rates; the LTS effect is delayed and prolonged. FS neurons always shift the curve to the right and affect RS firing transiently. In an RS-LTS-FS network, FS neurons reach a quiescent state if they receive weak input, LTS neurons are quiescent if RS neurons receive weak input, and both FS and RS populations are active if they both receive large inputs. In general, FS neurons tend to follow the spiking of RS neurons much more closely than LTS neurons. A novel type of facilitation-induced slow oscillations is observed above the LTS firing threshold with a frequency determined by the time scale of recovery from facilitation. To conclude, contrary to earlier proposals, LTS neurons affect the transient and steady state responses of cortical circuits over a range of firing rates, not only during the high rate regime; LTS neurons protect against over-activation about as well as FS neurons.     

The functional logic of cortico-pulvinar connections

The pulvinar is an 'associative' thalamic nucleus, meaning that most of its input and output relationships are formed with the cerebral cortex. The function of this circuitry is little understood and its anatomy, though much investigated, is notably recondite. This is because pulvinar connection patterns disrespect the architectural subunits (anterior, medial, lateral and inferior pulvinar nuclei) that have been the traditional reference system. This article presents a simplified, global model of the organization of cortico-pulvinar connections so as to pursue their structure-function relationships. Connections between the cortex and pulvinar are topographically organized, and as a result the pulvinar contains a 'map' of the cortical sheet. However, the topography is very blurred. Hence the pulvinar connection zones of nearby cortical areas overlap, allowing indirect transcortical communication via the pulvinar. A general observation is that indirect cortico-pulvino-cortical circuits tend to mimic direct cortico-cortical pathways: this is termed 'the replication principle'. It is equally apt for certain pairs (or groups) of nearby cortical areas that happen not to connect with each other. The 'replication' of this non-connection is achieved by discontinuities and dislocations of the cortical topography within the pulvinar, such that the associated pair of connection zones do not overlap. Certain of these deformations can be used to divide the global cortical topography into specific sub-domains, which form the natural units of a connectional subdivision of the pulvinar. A substantial part of the pulvinar also expresses visual topography, reflecting visual maps in occipital cortex. There are just two well-ordered visual maps in the pulvinar, that both receive projections from area V1, and several other occipital areas; the resulting duplication of cortical topography means that each visual map also acts as a separate connection domain. In summary, the model identifies four topographically ordered connection domains, and reconciles the coexistence of visual and cortical maps in two of them. The replication principle operates at and below the level of domain structure. It is argued that cortico-pulvinar circuitry replicates the pattern of cortical circuitry but not its function, playing a more regulatory role instead. Thalamic neurons differ from cortical neurons in their inherent rhythmicity, and the pattern of cortico-thalamic connections must govern the formation of specific resonant circuits. The broad implication is that the pulvinar acts to coordinate cortical information processing by facilitating and sustaining the formation of synchronized trans-areal assemblies; a more pointed suggestion is that, owing to the considerable blurring of cortical topography in the pulvinar, rival cortical assemblies may be in competition to recruit thalamic elements in order to outlast each other in activity.     

Combined Hebbian development of geniculocortical and lateral connectivity in a model of primary visual cortex

We present a network model of visual map development in layer 4 of primary visual cortex. Our model comprises excitatory and inhibitory spiking neurons. The input to the network consists of correlated spike trains to mimick the activity of neurons in the lateral geniculate nucleus (LGN). An activity-driven Hebbian learning mechanism governs the development of both the network's lateral connectivity and feedforward projections from LGN to cortex. Plasticity of inhibitory synapses has been included into the model so as to control overall cortical activity. Even without feedforward input, Hebbian modification of the excitatory lateral connections can lead to the development of an intracortical orientation map. We have found that such an intracortical map can guide the development of feedforward connections from LGN to cortical simple cells so that the structure of the final feedforward orientation map is predetermined by the intracortical map. In a scenario in which left- and right-eye geniculocortical inputs develop sequentially one after the other, the resulting maps are therefore very similar, provided the intracortical connectivity remains unaltered. This may explain the outcome of so-called reverse lid-suture experiments, where animals are reared so that both eyes never receive input at the same time, but the orientation maps measured separately for the two eyes are nevertheless nearly identical. Received: 20 December 1999 / Accepted in revised form: 9 June 2000     

Shunting inhibition, a silent step in visual cortical computation

Brain computation, in the early visual system, is often considered as a hierarchical process in which features extracted in a given sensory relay are not present in previous stages of integration. In particular, orientation preference and its fine tuning selectivity are functional properties shared by most cortical cells and they are not observed at the preceding geniculate stage. A classical problem is identifying the mechanisms and circuitry underlying these computations. Several organizational principles have been proposed, giving different weights to the feedforward thalamocortical drive or to intracortical recurrent architectures. Within this context, an important issue is whether intracortical inhibition is fundamental for the genesis of stimulus selectivity, or rather normalizes spike response tuning with respect to other features such as stimulus strength or contrast, without influencing the selectivity bias and preference expressed in the excitatory input alone. We review here experimental observations concerning the presence or absence of inhibitory input evoked by non-preferred orientation/directions. Intracellular current clamp and voltage clamp recordings are analyzed in the light of new methods allowing us (1) to increase the visibility of inhibitory input, and (2) to continuously measure the visually evoked dynamics of input conductances. We conclude that there exists a diversity of synaptic input combinations generating the same profile of spike-based orientation selectivity, and that this diversity most likely reflects anatomical non-homogeneities in input sampling provided by the local context of the columnar and lateral intracortical network in which the considered cortical cell is embedded.     

Influences on the global structure of cortical maps.

Cortical maps often contain global spatial structure: however, theoretical accounts for their development have generally concentrated on reproducing only local structure. We show that the elastic net model of cortical map formation can closely approximate the global structure of the ocular dominance column map observed in macaque primary visual cortex. A key component is the assumption of spatially non-uniform and anisotropic correlations in the retina. This work shows how genetic and epigenetic effects could combine to establish characteristic global structure in cortical maps.     

Mesoscopic Segregation of Excitation and Inhibition in a Brain Network Model

Neurons in the brain are known to operate under a careful balance of excitation and inhibition, which maintains neural microcircuits within the proper operational range. How this balance is played out at the mesoscopic level of neuronal populations is, however, less clear. In order to address this issue, here we use a coupled neural mass model to study computationally the dynamics of a network of cortical macrocolumns operating in a partially synchronized, irregular regime. The topology of the network is heterogeneous, with a few of the nodes acting as connector hubs while the rest are relatively poorly connected. Our results show that in this type of mesoscopic network excitation and inhibition spontaneously segregate, with some columns acting mainly in an excitatory manner while some others have predominantly an inhibitory effect on their neighbors. We characterize the conditions under which this segregation arises, and relate the character of the different columns with their topological role within the network. In particular, we show that the connector hubs are preferentially inhibitory, the more so the larger the node''s connectivity. These results suggest a potential mesoscale organization of the excitation-inhibition balance in brain networks.     

Thalamocortical control of feed-forward inhibition in awake somatosensory 'barrel' cortex

Intracortical inhibition plays a role in shaping sensory cortical receptive fields and is mediated by both feed-forward and feedback mechanisms. Feed-forward inhibition is the faster of the two processes, being generated by inhibitory interneurons driven by monosynaptic thalamocortical (TC) input. In principle, feed-forward inhibition can prevent targeted cortical neurons from ever reaching threshold when TC input is weak. To do so, however, inhibitory interneurons must respond to TC input at low thresholds and generate spikes very quickly. A powerful feed-forward inhibition would sharpen the tuning characteristics of targeted cortical neurons, and interneurons with sensitive and broadly tuned receptive fields could mediate this process. Suspected inhibitory interneurons (SINs) with precisely these properties are found in layer 4 of the somatosensory (S1) 'barrel' cortex of rodents and rabbits. These interneurons lack the directional selectivity seen in most cortical spiny neurons and in ventrobasal TC afferents, but are much more sensitive than cortical spiny neurons to low-amplitude whisker displacements. This paper is concerned with the activation of S1 SINs by TC impulses, and with the consequences of this activation. Multiple TC neurons and multiple S1 SINs were simultaneously studied in awake rabbits, and cross-correlation methods were used to examine functional connectivity. The results demonstrate a potent, temporally precise, dynamic and highly convergent/divergent functional input from ventrobasal TC neurons to SINs of the topographically aligned S1 barrel. Whereas the extensive pooling of convergent TC inputs onto SINs generates sensitive and broadly tuned inhibitory receptive fields, the potent TC divergence onto many SINs generates sharply synchronous activity among these elements. This TC feed-forward inhibitory network is well suited to provide a fast, potent, sensitive and broadly tuned inhibition of targeted spiny neurons that will suppress spike generation following all but the most optimal feed-forward excitatory inputs.     

Stability and structural constraints of random brain networks with excitatory and inhibitory neural populations

The stability of brain networks with randomly connected excitatory and inhibitory neural populations is investigated using a simplified physiological model of brain electrical activity. Neural populations are randomly assigned to be excitatory or inhibitory and the stability of a brain network is determined by the spectrum of the network’s matrix of connection strengths. The probability that a network is stable is determined from its spectral density which is numerically determined and is approximated by a spectral distribution recently derived by Rajan and Abbott. The probability that a brain network is stable is maximum when the total connection strength into a population is approximately zero and is shown to depend on the arrangement of the excitatory and inhibitory connections and the parameters of the network. The maximum excitatory and inhibitory input into a structure allowed by stability occurs when the net input equals zero and, in contrast to networks with randomly distributed excitatory and inhibitory connections, substantially increases as the number of connections increases. Networks with the largest excitatory and inhibitory input allowed by stability have multiple marginally stable modes, are highly responsive and adaptable to external stimuli, have the same total input into each structure with minimal variance in the excitatory and inhibitory connection strengths, and have a wide range of flexible, adaptable, and complex behavior.     

Cortically-Controlled Population Stochastic Facilitation as a Plausible Substrate for Guiding Sensory Transfer across the Thalamic Gateway

The thalamus is the primary gateway that relays sensory information to the cerebral cortex. While a single recipient cortical cell receives the convergence of many principal relay cells of the thalamus, each thalamic cell in turn integrates a dense and distributed synaptic feedback from the cortex. During sensory processing, the influence of this functional loop remains largely ignored. Using dynamic-clamp techniques in thalamic slices in vitro, we combined theoretical and experimental approaches to implement a realistic hybrid retino-thalamo-cortical pathway mixing biological cells and simulated circuits. The synaptic bombardment of cortical origin was mimicked through the injection of a stochastic mixture of excitatory and inhibitory conductances, resulting in a gradable correlation level of afferent activity shared by thalamic cells. The study of the impact of the simulated cortical input on the global retinocortical signal transfer efficiency revealed a novel control mechanism resulting from the collective resonance of all thalamic relay neurons. We show here that the transfer efficiency of sensory input transmission depends on three key features: i) the number of thalamocortical cells involved in the many-to-one convergence from thalamus to cortex, ii) the statistics of the corticothalamic synaptic bombardment and iii) the level of correlation imposed between converging thalamic relay cells. In particular, our results demonstrate counterintuitively that the retinocortical signal transfer efficiency increases when the level of correlation across thalamic cells decreases. This suggests that the transfer efficiency of relay cells could be selectively amplified when they become simultaneously desynchronized by the cortical feedback. When applied to the intact brain, this network regulation mechanism could direct an attentional focus to specific thalamic subassemblies and select the appropriate input lines to the cortex according to the descending influence of cortically-defined “priors”.     

Control of computational dynamics of coupled integrate-and-fire neurons

 Generation and control of different dynamical modes of computational processes in a net of interconnected integrate-and-fire neurons are demonstrated. A net architecture resembling a generic cortical structure is formed from pairs of excitatory and inhibitory units with excitatory connections between and inhibitory connections within pairs. Integrate-and-fire model neurons derived from detailed conductance-based models of neocortical pyramidal cells and fast-spiking interneurons are employed for the excitatory and inhibitory units, respectively. Firing-rate adaptation is incorporated into the excitatory units based on the regulation of the slow afterhyperpolarization phase of action potentials by intracellular calcium ions. Saturation of synaptic conductances is implemented for the interconnections between units. It is shown that neuronal adaptation of the excitatory units can generate richer net dynamics than relaxation to fixed-point attractors in a pattern space. At strong adaptivity, i.e. when the neuronal excitability is strongly influenced by the preceding activity, complex dynamics of either aperiodic or limit-cycle character are generated in both the pattern space and the phase space of all dynamical variables. This regime corresponds to an exploratory mode of the system, in which the pattern space can be searched. At weak adaptivity, the dynamics are governed by fixed-point attractors in the pattern space, and this corresponds to a mode for retrieval of a particular pattern. In the brain, neuronal adaptivity can be regulated by various neuromodulators. The results are in accordance with those recently obtained by means of more abstract models formulated in terms of mean firing rates. The increased realism makes the present model reveal more detailed mechanisms and strengthens the relevance of the conclusions to biological systems. The simplicity and realism of the coupled integrate-and-fire neurons make the present model useful for studies of systems in which the temporal aspects of neural coding are important. Received: 8 December 1995 / Accepted in revised form: 23 January 1997     

The Role of Thalamic Population Synchrony in the Emergence of Cortical Feature Selectivity

In a wide range of studies, the emergence of orientation selectivity in primary visual cortex has been attributed to a complex interaction between feed-forward thalamic input and inhibitory mechanisms at the level of cortex. Although it is well known that layer 4 cortical neurons are highly sensitive to the timing of thalamic inputs, the role of the stimulus-driven timing of thalamic inputs in cortical orientation selectivity is not well understood. Here we show that the synchronization of thalamic firing contributes directly to the orientation tuned responses of primary visual cortex in a way that optimizes the stimulus information per cortical spike. From the recorded responses of geniculate X-cells in the anesthetized cat, we synthesized thalamic sub-populations that would likely serve as the synaptic input to a common layer 4 cortical neuron based on anatomical constraints. We used this synchronized input as the driving input to an integrate-and-fire model of cortical responses and demonstrated that the tuning properties match closely to those measured in primary visual cortex. By modulating the overall level of synchronization at the preferred orientation, we show that efficiency of information transmission in the cortex is maximized for levels of synchronization which match those reported in thalamic recordings in response to naturalistic stimuli, a property which is relatively invariant to the orientation tuning width. These findings indicate evidence for a more prominent role of the feed-forward thalamic input in cortical feature selectivity based on thalamic synchronization.     

Butadiene production process overview

Over 95% of butadiene is produced as a by-product of ethylene production from steam crackers. The crude C4 stream isolated from the steam cracking process is fed to butadiene extraction units, where butadiene is separated from the other C4s by extractive distillation. The amount of crude C4s produced in steam cracking is dependent on the composition of the feed to the cracking unit. Heavier feeds, such as naphtha, yield higher amounts of C4s and butadiene than do lighter feeds. Crackers using light feeds typically produce low quantities of C4s and do not have butadiene extraction units. Overall butadiene capacity is determined by ethylene cracker operating rates, the type of feed being cracked, and availability of butadiene extraction capacity. Global butadiene capacity is approximately 10.5 million metric tons, and global production is approximately 9 million metric tons [Chemical Marketing Associates, Inc. (CMAI), 2005 World Butadiene Analysis, Chemical Marketing Associates, Inc. (CMAI), 2005]. Crude C4s are traded globally, with the United States being the only significant net importer. Finished butadiene is also traded globally, with the largest exporters being Canada, Western Europe, Saudi Arabia and Korea. The largest net importers are Mexico, the United States and China. The global demand for butadiene is approximately 9 million metric tons [Chemical Marketing Associates, Inc. (CMAI), 2005 World Butadiene Analysis, Chemical Marketing Associates, Inc. (CMAI), 2005]. Production of styrene-butadiene rubber and polybutadiene rubber accounts for about 54% of global butadiene demand, with tire production being the single most important end use of butadiene synthetic rubbers. Other major butadiene derivatives are acrylonitrile-butadiene-styrene (ABS) and styrene butadiene latex (about 24% of demand combined).