Model-free reconstruction of excitatory neuronal connectivity from calcium imaging signals

A systematic assessment of global neural network connectivity through direct electrophysiological assays has remained technically infeasible, even in simpler systems like dissociated neuronal cultures. We introduce an improved algorithmic approach based on Transfer Entropy to reconstruct structural connectivity from network activity monitored through calcium imaging. We focus in this study on the inference of excitatory synaptic links. Based on information theory, our method requires no prior assumptions on the statistics of neuronal firing and neuronal connections. The performance of our algorithm is benchmarked on surrogate time series of calcium fluorescence generated by the simulated dynamics of a network with known ground-truth topology. We find that the functional network topology revealed by Transfer Entropy depends qualitatively on the time-dependent dynamic state of the network (bursting or non-bursting). Thus by conditioning with respect to the global mean activity, we improve the performance of our method. This allows us to focus the analysis to specific dynamical regimes of the network in which the inferred functional connectivity is shaped by monosynaptic excitatory connections, rather than by collective synchrony. Our method can discriminate between actual causal influences between neurons and spurious non-causal correlations due to light scattering artifacts, which inherently affect the quality of fluorescence imaging. Compared to other reconstruction strategies such as cross-correlation or Granger Causality methods, our method based on improved Transfer Entropy is remarkably more accurate. In particular, it provides a good estimation of the excitatory network clustering coefficient, allowing for discrimination between weakly and strongly clustered topologies. Finally, we demonstrate the applicability of our method to analyses of real recordings of in vitro disinhibited cortical cultures where we suggest that excitatory connections are characterized by an elevated level of clustering compared to a random graph (although not extreme) and can be markedly non-local.     

Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks IV

In neuronal networks, the changes of synaptic strength (or weight) performed by spike-timing-dependent plasticity (STDP) are hypothesized to give rise to functional network structure. This article investigates how this phenomenon occurs for the excitatory recurrent connections of a network with fixed input weights that is stimulated by external spike trains. We develop a theoretical framework based on the Poisson neuron model to analyze the interplay between the neuronal activity (firing rates and the spike-time correlations) and the learning dynamics, when the network is stimulated by correlated pools of homogeneous Poisson spike trains. STDP can lead to both a stabilization of all the neuron firing rates (homeostatic equilibrium) and a robust weight specialization. The pattern of specialization for the recurrent weights is determined by a relationship between the input firing-rate and correlation structures, the network topology, the STDP parameters and the synaptic response properties. We find conditions for feed-forward pathways or areas with strengthened self-feedback to emerge in an initially homogeneous recurrent network.     

Partial correlation analysis for the identification of synaptic connections

In this paper, we investigate the use of partial correlation analysis for the identification of functional neural connectivity from simultaneously recorded neural spike trains. Partial correlation analysis allows one to distinguish between direct and indirect connectivities by removing the portion of the relationship between two neural spike trains that can be attributed to linear relationships with recorded spike trains from other neurons. As an alternative to the common frequency domain approach based on the partial spectral coherence we propose a new statistic in the time domain. The new scaled partial covariance density provides additional information on the direction and the type, excitatory or inhibitory, of the connectivities. In simulation studies, we investigated the power and limitations of the new statistic. The simulations show that the detectability of various connectivity patterns depends on various parameters such as connectivity strength and background activity. In particular, the detectability decreases with the number of neurons included in the analysis and increases with the recording time. Further, we show that the method can also be used to detect multiple direct connectivities between two neurons. Finally, the methods of this paper are illustrated by an application to neurophysiological data from spinal dorsal horn neurons.     

Variability v.s. synchronicity of neuronal activity in local cortical network models with different wiring topologies

Dynamical behavior of a biological neuronal network depends significantly on the spatial pattern of synaptic connections among neurons. While neuronal network dynamics has extensively been studied with simple wiring patterns, such as all-to-all or random synaptic connections, not much is known about the activity of networks with more complicated wiring topologies. Here, we examined how different wiring topologies may influence the response properties of neuronal networks, paying attention to irregular spike firing, which is known as a characteristic of in vivo cortical neurons, and spike synchronicity. We constructed a recurrent network model of realistic neurons and systematically rewired the recurrent synapses to change the network topology, from a localized regular and a “small-world” network topology to a distributed random network topology. Regular and small-world wiring patterns greatly increased the irregularity or the coefficient of variation (Cv) of output spike trains, whereas such an increase was small in random connectivity patterns. For given strength of recurrent synapses, the firing irregularity exhibited monotonous decreases from the regular to the random network topology. By contrast, the spike coherence between an arbitrary neuron pair exhibited a non-monotonous dependence on the topological wiring pattern. More precisely, the wiring pattern to maximize the spike coherence varied with the strength of recurrent synapses. In a certain range of the synaptic strength, the spike coherence was maximal in the small-world network topology, and the long-range connections introduced in this wiring changed the dependence of spike synchrony on the synaptic strength moderately. However, the effects of this network topology were not really special in other properties of network activity. Action Editor: Xiao-Jing Wang     

Rich can get poor: conversion of hub to non-hub proteins

Hubs are ubiquitous network elements with high connectivity. One of the common observations about hub proteins is their preferential attachment leading to scale-free network topology. Here we examine the question: does rich protein always get richer, or can it get poor too? To answer this question, we compared similar and well-annotated hub proteins in six organisms, from prokaryotes to eukaryotes. Our findings indicate that hub proteins retain, gain or lose connectivity based on the context. Furthermore, the loss or gain of connectivity appears to correlate with the functional role of the protein in a given system.     

Bursting Reverberation as a Multiscale Neuronal Network Process Driven by Synaptic Depression-Facilitation

Neuronal networks can generate complex patterns of activity that depend on membrane properties of individual neurons as well as on functional synapses. To decipher the impact of synaptic properties and connectivity on neuronal network behavior, we investigate the responses of neuronal ensembles from small (5–30 cells in a restricted sphere) and large (acute hippocampal slice) networks to single electrical stimulation: in both cases, a single stimulus generated a synchronous long-lasting bursting activity. While an initial spike triggered a reverberating network activity that lasted 2–5 seconds for small networks, we found here that it lasted only up to 300 milliseconds in slices. To explain this phenomena present at different scales, we generalize the depression-facilitation model and extracted the network time constants. The model predicts that the reverberation time has a bell shaped relation with the synaptic density, revealing that the bursting time cannot exceed a maximum value. Furthermore, before reaching its maximum, the reverberation time increases sub-linearly with the synaptic density of the network. We conclude that synaptic dynamics and connectivity shape the mean burst duration, a property present at various scales of the networks. Thus bursting reverberation is a property of sufficiently connected neural networks, and can be generated by collective depression and facilitation of underlying functional synapses.     

Impaired small-world network efficiency and dynamic functional distribution in patients with cirrhosis

Hepatic encephalopathy (HE) is a complex neuropsychiatric syndrome and a major complication of liver cirrhosis. Dysmetabolism of the brain, related to elevated ammonia levels, interferes with intercortical connectivity and cognitive function. For evaluation of network efficiency, a 'small-world' network model can quantify the effectiveness of information transfer within brain networks. This study aimed to use small-world topology to investigate abnormalities of neuronal connectivity among widely distributed brain regions in patients with liver cirrhosis using resting-state functional magnetic resonance imaging (rs-fMRI). Seventeen cirrhotic patients without HE, 9 with minimal HE, 9 with overt HE, and 35 healthy controls were compared. The interregional correlation matrix was obtained by averaging the rs-fMRI time series over all voxels in each of the 90 regions using the automated anatomical labeling model. Cost and correlation threshold values were then applied to construct the functional brain network. The absolute and relative network efficiencies were calculated; quantifying distinct aspects of the local and global topological network organization. Correlations between network topology parameters, ammonia levels, and the severity of HE were determined using linear regression and ANOVA. The local and global topological efficiencies of the functional connectivity network were significantly disrupted in HE patients; showing abnormal small-world properties. Alterations in regional characteristics, including nodal efficiency and nodal strength, occurred predominantly in the association, primary, and limbic/paralimbic regions. The degree of network organization disruption depended on the severity of HE. Ammonia levels were also significantly associated with the alterations in local network properties. Results indicated that alterations in the rs-fMRI network topology of the brain were associated with HE grade; and that focal or diffuse lesions disturbed the functional network to further alter the global topology and efficiency of the whole brain network. These findings provide insights into the functional changes in the human brain in HE.     

Effect of stimulus-driven pruning on the detection of spatiotemporal patterns of activity in large neural networks

Adult patterns of neuronal connectivity develop from a transient embryonic template characterized by exuberant projections to both appropriate and inappropriate target regions in a process known as synaptic pruning. Trigger signals able to induce synaptic pruning could be related to dynamic functions that depend on the timing of action potentials. We stimulated locally connected random networks of spiking neurons and observed the effect of a spike-timing-dependent synaptic plasticity (STDP)-driven pruning process on the emergence of cell assemblies. The spike trains of the simulated excitatory neurons were recorded. We searched for spatiotemporal firing patterns as potential markers of the build-up of functionally organized recurrent activity associated with spatially organized connectivity.     

Emergence of Slow-Switching Assemblies in Structured Neuronal Networks

Unraveling the interplay between connectivity and spatio-temporal dynamics in neuronal networks is a key step to advance our understanding of neuronal information processing. Here we investigate how particular features of network connectivity underpin the propensity of neural networks to generate slow-switching assembly (SSA) dynamics, i.e., sustained epochs of increased firing within assemblies of neurons which transition slowly between different assemblies throughout the network. We show that the emergence of SSA activity is linked to spectral properties of the asymmetric synaptic weight matrix. In particular, the leading eigenvalues that dictate the slow dynamics exhibit a gap with respect to the bulk of the spectrum, and the associated Schur vectors exhibit a measure of block-localization on groups of neurons, thus resulting in coherent dynamical activity on those groups. Through simple rate models, we gain analytical understanding of the origin and importance of the spectral gap, and use these insights to develop new network topologies with alternative connectivity paradigms which also display SSA activity. Specifically, SSA dynamics involving excitatory and inhibitory neurons can be achieved by modifying the connectivity patterns between both types of neurons. We also show that SSA activity can occur at multiple timescales reflecting a hierarchy in the connectivity, and demonstrate the emergence of SSA in small-world like networks. Our work provides a step towards understanding how network structure (uncovered through advancements in neuroanatomy and connectomics) can impact on spatio-temporal neural activity and constrain the resulting dynamics.     

Spatially constrained adaptive rewiring in cortical networks creates spatially modular small world architectures

A modular small-world topology in functional and anatomical networks of the cortex is eminently suitable as an information processing architecture. This structure was shown in model studies to arise adaptively; it emerges through rewiring of network connections according to patterns of synchrony in ongoing oscillatory neural activity. However, in order to improve the applicability of such models to the cortex, spatial characteristics of cortical connectivity need to be respected, which were previously neglected. For this purpose we consider networks endowed with a metric by embedding them into a physical space. We provide an adaptive rewiring model with a spatial distance function and a corresponding spatially local rewiring bias. The spatially constrained adaptive rewiring principle is able to steer the evolving network topology to small world status, even more consistently so than without spatial constraints. Locally biased adaptive rewiring results in a spatial layout of the connectivity structure, in which topologically segregated modules correspond to spatially segregated regions, and these regions are linked by long-range connections. The principle of locally biased adaptive rewiring, thus, may explain both the topological connectivity structure and spatial distribution of connections between neuronal units in a large-scale cortical architecture.     

Emergence of a small-world functional network in cultured neurons

The functional networks of cultured neurons exhibit complex network properties similar to those found in vivo. Starting from random seeding, cultures undergo significant reorganization during the initial period in vitro, yet despite providing an ideal platform for observing developmental changes in neuronal connectivity, little is known about how a complex functional network evolves from isolated neurons. In the present study, evolution of functional connectivity was estimated from correlations of spontaneous activity. Network properties were quantified using complex measures from graph theory and used to compare cultures at different stages of development during the first 5 weeks in vitro. Networks obtained from young cultures (14 days in vitro) exhibited a random topology, which evolved to a small-world topology during maturation. The topology change was accompanied by an increased presence of highly connected areas (hubs) and network efficiency increased with age. The small-world topology balances integration of network areas with segregation of specialized processing units. The emergence of such network structure in cultured neurons, despite a lack of external input, points to complex intrinsic biological mechanisms. Moreover, the functional network of cultures at mature ages is efficient and highly suited to complex processing tasks.     

Synchronization and sensitivity enhancement of the Hodgkin-Huxley neurons due to inhibitory inputs

Recent experimental results imply that inhibitory postsynaptic potentials can play a functional role in realizing synchronization of neuronal firing in the brain. In order to examine the relation between inhibition and synchronous firing of neurons theoretically, we analyze possible effects of synchronization and sensitivity enhancement caused by inhibitory inputs to neurons with a biologically realistic model of the Hodgkin-Huxley equations. The result shows that, after an inhibitory spike, the firing probability of a single postsynaptic neuron exposed to random excitatory background activity oscillates with time. The oscillation of the firing probability can be related to synchronous firing of neurons receiving an inhibitory spike simultaneously. Further, we show that when an inhibitory spike input precedes an excitatory spike input, the presence of such preceding inhibition raises the firing probability peak of the neuron after the excitatory input. The result indicates that an inhibitory spike input can enhance the sensitivity of the postsynaptic neuron to the following excitatory spike input. Two neural network models based on these effects on postsynaptic neurons caused by inhibitory inputs are proposed to demonstrate possible mechanisms of detecting particular spatiotemporal spike patterns. Received: 15 April 1999 /Accepted in revised form: 25 November 1999     

Impaired structural motor connectome in amyotrophic lateral sclerosis

Amyotrophic lateral sclerosis (ALS) is a severe neurodegenerative disease selectively affecting upper and lower motor neurons. Patients with ALS suffer from progressive paralysis and eventually die on average after three years. The underlying neurobiology of upper motor neuron degeneration and its effects on the complex network of the brain are, however, largely unknown. Here, we examined the effects of ALS on the structural brain network topology in 35 patients with ALS and 19 healthy controls. Using diffusion tensor imaging (DTI), the brain network was reconstructed for each individual participant. The connectivity of this reconstructed brain network was compared between patients and controls using complexity theory without - a priori selected - regions of interest. Patients with ALS showed an impaired sub-network of regions with reduced white matter connectivity (p = 0.0108, permutation testing). This impaired sub-network was strongly centered around primary motor regions (bilateral precentral gyrus and right paracentral lobule), including secondary motor regions (bilateral caudal middle frontal gyrus and pallidum) as well as high-order hub regions (right posterior cingulate and precuneus). In addition, we found a significant reduction in overall efficiency (p = 0.0095) and clustering (p = 0.0415). From our findings, we conclude that upper motor neuron degeneration in ALS affects both primary motor connections as well as secondary motor connections, together composing an impaired sub-network. The degenerative process in ALS was found to be widespread, but interlinked and targeted to the motor connectome.     

Rich Club Organization of Macaque Cerebral Cortex and Its Role in Network Communication

Graph-theoretical analysis of brain connectivity data has revealed significant features of brain network organization across a range of species. Consistently, large-scale anatomical networks exhibit highly nonrandom attributes including an efficient small world modular architecture, with distinct network communities that are interlinked by hub regions. The functional importance of hubs motivates a closer examination of their mutual interconnections, specifically to examine the hypothesis that hub regions are more densely linked than expected based on their degree alone, i.e. forming a central rich club. Extending recent findings of rich club topology in the cat and human brain, this report presents evidence for the existence of rich club organization in the cerebral cortex of a non-human primate, the macaque monkey, based on a connectivity data set representing a collation of numerous tract tracing studies. Rich club regions comprise portions of prefrontal, parietal, temporal and insular cortex and are widely distributed across network communities. An analysis of network motifs reveals that rich club regions tend to form star-like configurations, indicative of their central embedding within sets of nodes. In addition, rich club nodes and edges participate in a large number of short paths across the network, and thus contribute disproportionately to global communication. As rich club regions tend to attract and disperse communication paths, many of the paths follow a characteristic pattern of first increasing and then decreasing node degree. Finally, the existence of non-reciprocal projections imposes a net directional flow of paths into and out of the rich club, with some regions preferentially attracting and others dispersing signals. Overall, the demonstration of rich club organization in a non-human primate contributes to our understanding of the network principles underlying neural connectivity in the mammalian brain, and further supports the hypothesis that rich club regions and connections have a central role in global brain communication.     

Emergent functional properties of neuronal networks with controlled topology

The interplay between anatomical connectivity and dynamics in neural networks plays a key role in the functional properties of the brain and in the associated connectivity changes induced by neural diseases. However, a detailed experimental investigation of this interplay at both cellular and population scales in the living brain is limited by accessibility. Alternatively, to investigate the basic operational principles with morphological, electrophysiological and computational methods, the activity emerging from large in vitro networks of primary neurons organized with imposed topologies can be studied. Here, we validated the use of a new bio-printing approach, which effectively maintains the topology of hippocampal cultures in vitro and investigated, by patch-clamp and MEA electrophysiology, the emerging functional properties of these grid-confined networks. In spite of differences in the organization of physical connectivity, our bio-patterned grid networks retained the key properties of synaptic transmission, short-term plasticity and overall network activity with respect to random networks. Interestingly, the imposed grid topology resulted in a reinforcement of functional connections along orthogonal directions, shorter connectivity links and a greatly increased spiking probability in response to focal stimulation. These results clearly demonstrate that reliable functional studies can nowadays be performed on large neuronal networks in the presence of sustained changes in the physical network connectivity.     

Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks III: Partially connected neurons driven by spontaneous activity

In contrast to a feed-forward architecture, the weight dynamics induced by spike-timing-dependent plasticity (STDP) in a recurrent neuronal network is not yet well understood. In this article, we extend a previous study of the impact of additive STDP in a recurrent network that is driven by spontaneous activity (no external stimulating inputs) from a fully connected network to one that is only partially connected. The asymptotic state of the network is analyzed, and it is found that the equilibrium and stability conditions for the firing rates are similar for both full and partial connectivity: STDP causes the firing rates to converge toward the same value and remain quasi-homogeneous. However, when STDP induces strong weight competition, the connectivity affects the weight dynamics in that the distribution of the weights disperses more quickly for lower density than for higher density. The asymptotic weight distribution strongly depends upon that at the beginning of the learning epoch; consequently, homogeneous connectivity alone is not sufficient to obtain homogeneous neuronal activity. In the absence of external inputs, STDP can nevertheless generate structure in the network through autocorrelation effects, for example, by introducing asymmetry in network topology.     

Functional convergence of response properties in the auditory thalamocortical system

One of the brain's fundamental tasks is to construct and transform representations of an animal's environment, yet few studies describe how individual neurons accomplish this. Our results from correlated pairs in the auditory thalamocortical system show that cortical excitatory receptive field regions can be directly inherited from thalamus, constructed from smaller inputs, and assembled by the cooperative activity of neuronal ensembles. The prevalence of functional thalamocortical connectivity is strictly governed by tonotopy, but connection strength is not. Finally, spectral and temporal modulation preferences in cortex may differ dramatically from the thalamic input. Our observations reveal a radical reconstruction of response properties from auditory thalamus to cortex, and illustrate how some properties are propagated with great fidelity while others are significantly transformed or generated intracortically.     

Communication Efficiency and Congestion of Signal Traffic in Large-Scale Brain Networks

The complex connectivity of the cerebral cortex suggests that inter-regional communication is a primary function. Using computational modeling, we show that anatomical connectivity may be a major determinant for global information flow in brain networks. A macaque brain network was implemented as a communication network in which signal units flowed between grey matter nodes along white matter paths. Compared to degree-matched surrogate networks, information flow on the macaque brain network was characterized by higher loss rates, faster transit times and lower throughput, suggesting that neural connectivity may be optimized for speed rather than fidelity. Much of global communication was mediated by a “rich club” of hub regions: a sub-graph comprised of high-degree nodes that are more densely interconnected with each other than predicted by chance. First, macaque communication patterns most closely resembled those observed for a synthetic rich club network, but were less similar to those seen in a synthetic small world network, suggesting that the former is a more fundamental feature of brain network topology. Second, rich club regions attracted the most signal traffic and likewise, connections between rich club regions carried more traffic than connections between non-rich club regions. Third, a number of rich club regions were significantly under-congested, suggesting that macaque connectivity actively shapes information flow, funneling traffic towards some nodes and away from others. Together, our results indicate a critical role of the rich club of hub nodes in dynamic aspects of global brain communication.     

Synaptic information transfer in computer models of neocortical columns

Understanding the direction and quantity of information flowing in neuronal networks is a fundamental problem in neuroscience. Brains and neuronal networks must at the same time store information about the world and react to information in the world. We sought to measure how the activity of the network alters information flow from inputs to output patterns. Using neocortical column neuronal network simulations, we demonstrated that networks with greater internal connectivity reduced input/output correlations from excitatory synapses and decreased negative correlations from inhibitory synapses, measured by Kendall’s τ correlation. Both of these changes were associated with reduction in information flow, measured by normalized transfer entropy (nTE). Information handling by the network reflected the degree of internal connectivity. With no internal connectivity, the feedforward network transformed inputs through nonlinear summation and thresholding. With greater connectivity strength, the recurrent network translated activity and information due to contribution of activity from intrinsic network dynamics. This dynamic contribution amounts to added information drawn from that stored in the network. At still higher internal synaptic strength, the network corrupted the external information, producing a state where little external information came through. The association of increased information retrieved from the network with increased gamma power supports the notion of gamma oscillations playing a role in information processing.     

A neural network model of reliably optimized spike transmission

We studied the detailed structure of a neuronal network model in which the spontaneous spike activity is correctly optimized to match the experimental data and discuss the reliability of the optimized spike transmission. Two stochastic properties of the spontaneous activity were calculated: the spike-count rate and synchrony size. The synchrony size, expected to be an important factor for optimization of spike transmission in the network, represents a percentage of observed coactive neurons within a time bin, whose probability approximately follows a power-law. We systematically investigated how these stochastic properties could matched to those calculated from the experimental data in terms of the log-normally distributed synaptic weights between excitatory and inhibitory neurons and synaptic background activity induced by the input current noise in the network model. To ensure reliably optimized spike transmission, the synchrony size as well as spike-count rate were simultaneously optimized. This required changeably balanced log-normal distributions of synaptic weights between excitatory and inhibitory neurons and appropriately amplified synaptic background activity. Our results suggested that the inhibitory neurons with a hub-like structure driven by intensive feedback from excitatory neurons were a key factor in the simultaneous optimization of the spike-count rate and synchrony size, regardless of different spiking types between excitatory and inhibitory neurons.