Avalanches in a Stochastic Model of Spiking Neurons

Neuronal avalanches are a form of spontaneous activity widely observed in cortical slices and other types of nervous tissue, both in vivo and in vitro. They are characterized by irregular, isolated population bursts when many neurons fire together, where the number of spikes per burst obeys a power law distribution. We simulate, using the Gillespie algorithm, a model of neuronal avalanches based on stochastic single neurons. The network consists of excitatory and inhibitory neurons, first with all-to-all connectivity and later with random sparse connectivity. Analyzing our model using the system size expansion, we show that the model obeys the standard Wilson-Cowan equations for large network sizes ( neurons). When excitation and inhibition are closely balanced, networks of thousands of neurons exhibit irregular synchronous activity, including the characteristic power law distribution of avalanche size. We show that these avalanches are due to the balanced network having weakly stable functionally feedforward dynamics, which amplifies some small fluctuations into the large population bursts. Balanced networks are thought to underlie a variety of observed network behaviours and have useful computational properties, such as responding quickly to changes in input. Thus, the appearance of avalanches in such functionally feedforward networks indicates that avalanches may be a simple consequence of a widely present network structure, when neuron dynamics are noisy. An important implication is that a network need not be “critical” for the production of avalanches, so experimentally observed power laws in burst size may be a signature of noisy functionally feedforward structure rather than of, for example, self-organized criticality.     

Neuronal Avalanches Differ from Wakefulness to Deep Sleep – Evidence from Intracranial Depth Recordings in Humans

Neuronal activity differs between wakefulness and sleep states. In contrast, an attractor state, called self-organized critical (SOC), was proposed to govern brain dynamics because it allows for optimal information coding. But is the human brain SOC for each vigilance state despite the variations in neuronal dynamics? We characterized neuronal avalanches – spatiotemporal waves of enhanced activity - from dense intracranial depth recordings in humans. We showed that avalanche distributions closely follow a power law – the hallmark feature of SOC - for each vigilance state. However, avalanches clearly differ with vigilance states: slow wave sleep (SWS) shows large avalanches, wakefulness intermediate, and rapid eye movement (REM) sleep small ones. Our SOC model, together with the data, suggested first that the differences are mediated by global but tiny changes in synaptic strength, and second, that the changes with vigilance states reflect small deviations from criticality to the subcritical regime, implying that the human brain does not operate at criticality proper but close to SOC. Independent of criticality, the analysis confirms that SWS shows increased correlations between cortical areas, and reveals that REM sleep shows more fragmented cortical dynamics.     

Undersampled Critical Branching Processes on Small-World and Random Networks Fail to Reproduce the Statistics of Spike Avalanches

The power-law size distributions obtained experimentally for neuronal avalanches are an important evidence of criticality in the brain. This evidence is supported by the fact that a critical branching process exhibits the same exponent . Models at criticality have been employed to mimic avalanche propagation and explain the statistics observed experimentally. However, a crucial aspect of neuronal recordings has been almost completely neglected in the models: undersampling. While in a typical multielectrode array hundreds of neurons are recorded, in the same area of neuronal tissue tens of thousands of neurons can be found. Here we investigate the consequences of undersampling in models with three different topologies (two-dimensional, small-world and random network) and three different dynamical regimes (subcritical, critical and supercritical). We found that undersampling modifies avalanche size distributions, extinguishing the power laws observed in critical systems. Distributions from subcritical systems are also modified, but the shape of the undersampled distributions is more similar to that of a fully sampled system. Undersampled supercritical systems can recover the general characteristics of the fully sampled version, provided that enough neurons are measured. Undersampling in two-dimensional and small-world networks leads to similar effects, while the random network is insensitive to sampling density due to the lack of a well-defined neighborhood. We conjecture that neuronal avalanches recorded from local field potentials avoid undersampling effects due to the nature of this signal, but the same does not hold for spike avalanches. We conclude that undersampled branching-process-like models in these topologies fail to reproduce the statistics of spike avalanches.     

Memory effects on scale-free dynamics in foraging Drosophila

The fruit fly, Drosophila melanogaster, displays a scale-free behavior in foraging, i.e., the dwell time on food exhibits a power law distribution. The scaling exponent is generally believed to be stable and the significance of the exponent itself with respect to the scale-free behavior remains elusive. We propose a model whereby the scaling exponent of the scale-free behavior of an animal depends on the memory of the individual. The proposed model is based on the premise that animal behaviors are associated with internal states of the animal. The changes in the scaling exponent are derived by considering losing memory as increasing uncertainty, which is expressed in terms of information entropy of the internal states. Predicted model behaviors agree with experimental results of foraging behavior in wild-type and learning/memory Drosophila mutants. The concept of changes in the scaling exponent due to the amount of memory provides a novel insight into the emergence of a scale-free behavior and the meaning of the scaling exponent.     

Avalanches during epithelial tissue growth; Uniform Growth and a drosophila eye disc model

Epithelial tissues constitute an exotic type of active matter with non-linear properties reminiscent of amorphous materials. In the context of a proliferating epithelium, modeled by the quasistatic vertex model, we identify novel discrete tissue scale rearrangements, i.e. cellular rearrangement avalanches, which are a form of collective cell movement. During the avalanches, the vast majority of cells retain their neighbors, and the resulting cellular trajectories are radial in the periphery, a vortex in the core. After the onset of these avalanches, the epithelial area grows discontinuously. The avalanches are found to be stochastic, and their strength is correlated with the density of cells in the tissue. Overall, avalanches redistribute accumulated local spatial pressure along the tissue. Furthermore, the distribution of avalanche magnitudes is found to obey a power law, with an exponent consistent with sheer induced avalanches in amorphous materials. To understand the role of avalanches in organ development, we simulate epithelial growth of the Drosophila eye disc during the third instar using a computational model, which includes both chemical and mechanistic signaling. During the third instar, the morphogenetic furrow (MF), a ~10 cell wide wave of apical area constriction propagates through the epithelium. These simulations are used to understand the details of the growth process, the effect of the MF on the growth dynamics on the tissue scale, and to make predictions for experimental observations. The avalanches are found to depend on the strength of the apical constriction of cells in the MF, with a stronger apical constriction leading to less frequent and more pronounced avalanches. The results herein highlight the dependence of simulated tissue growth dynamics on relaxation timescales, and serve as a guide for in vitro experiments.     

Critical behaviour of the stochastic Wilson-Cowan model

Spontaneous brain activity is characterized by bursts and avalanche-like dynamics, with scale-free features typical of critical behaviour. The stochastic version of the celebrated Wilson-Cowan model has been widely studied as a system of spiking neurons reproducing non-trivial features of the neural activity, from avalanche dynamics to oscillatory behaviours. However, to what extent such phenomena are related to the presence of a genuine critical point remains elusive. Here we address this central issue, providing analytical results in the linear approximation and extensive numerical analysis. In particular, we present results supporting the existence of a bona fide critical point, where a second-order-like phase transition occurs, characterized by scale-free avalanche dynamics, scaling with the system size and a diverging relaxation time-scale. Moreover, our study shows that the observed critical behaviour falls within the universality class of the mean-field branching process, where the exponents of the avalanche size and duration distributions are, respectively, 3/2 and 2. We also provide an accurate analysis of the system behaviour as a function of the total number of neurons, focusing on the time correlation functions of the firing rate in a wide range of the parameter space.     

Statistical Patterns in Movie Rating Behavior

Currently, users and consumers can review and rate products through online services, which provide huge databases that can be used to explore people’s preferences and unveil behavioral patterns. In this work, we investigate patterns in movie ratings, considering IMDb (the Internet Movie Database), a highly visited site worldwide, as a source. We find that the distribution of votes presents scale-free behavior over several orders of magnitude, with an exponent very close to 3/2, with exponential cutoff. It is remarkable that this pattern emerges independently of movie attributes such as average rating, age and genre, with the exception of a few genres and of high-budget films. These results point to a very general underlying mechanism for the propagation of adoption across potential audiences that is independent of the intrinsic features of a movie and that can be understood through a simple spreading model with mean-field avalanche dynamics.     

Spike avalanches exhibit universal dynamics across the sleep-wake cycle

Background

Scale-invariant neuronal avalanches have been observed in cell cultures and slices as well as anesthetized and awake brains, suggesting that the brain operates near criticality, i.e. within a narrow margin between avalanche propagation and extinction. In theory, criticality provides many desirable features for the behaving brain, optimizing computational capabilities, information transmission, sensitivity to sensory stimuli and size of memory repertoires. However, a thorough characterization of neuronal avalanches in freely-behaving (FB) animals is still missing, thus raising doubts about their relevance for brain function.

Methodology/Principal Findings

To address this issue, we employed chronically implanted multielectrode arrays (MEA) to record avalanches of action potentials (spikes) from the cerebral cortex and hippocampus of 14 rats, as they spontaneously traversed the wake-sleep cycle, explored novel objects or were subjected to anesthesia (AN). We then modeled spike avalanches to evaluate the impact of sparse MEA sampling on their statistics. We found that the size distribution of spike avalanches are well fit by lognormal distributions in FB animals, and by truncated power laws in the AN group. FB data surrogation markedly decreases the tail of the distribution, i.e. spike shuffling destroys the largest avalanches. The FB data are also characterized by multiple key features compatible with criticality in the temporal domain, such as 1/f spectra and long-term correlations as measured by detrended fluctuation analysis. These signatures are very stable across waking, slow-wave sleep and rapid-eye-movement sleep, but collapse during anesthesia. Likewise, waiting time distributions obey a single scaling function during all natural behavioral states, but not during anesthesia. Results are equivalent for neuronal ensembles recorded from visual and tactile areas of the cerebral cortex, as well as the hippocampus.

Conclusions/Significance

Altogether, the data provide a comprehensive link between behavior and brain criticality, revealing a unique scale-invariant regime of spike avalanches across all major behaviors.     

Modeling fractal structure of city-size distributions using correlation functions

Zipf's law is one the most conspicuous empirical facts for cities, however, there is no convincing explanation for the scaling relation between rank and size and its scaling exponent. Using the idea from general fractals and scaling, I propose a dual competition hypothesis of city development to explain the value intervals and the special value, 1, of the power exponent. Zipf's law and Pareto's law can be mathematically transformed into one another, but represent different processes of urban evolution, respectively. Based on the Pareto distribution, a frequency correlation function can be constructed. By scaling analysis and multifractals spectrum, the parameter interval of Pareto exponent is derived as (0.5, 1]; Based on the Zipf distribution, a size correlation function can be built, and it is opposite to the first one. By the second correlation function and multifractals notion, the Pareto exponent interval is derived as [1, 2). Thus the process of urban evolution falls into two effects: one is the Pareto effect indicating city number increase (external complexity), and the other the Zipf effect indicating city size growth (internal complexity). Because of struggle of the two effects, the scaling exponent varies from 0.5 to 2; but if the two effects reach equilibrium with each other, the scaling exponent approaches 1. A series of mathematical experiments on hierarchical correlation are employed to verify the models and a conclusion can be drawn that if cities in a given region follow Zipf's law, the frequency and size correlations will follow the scaling law. This theory can be generalized to interpret the inverse power-law distributions in various fields of physical and social sciences.     

Space-irrelevant scaling law for fish school sizes

Universal scaling in the power-law size distribution of pelagic fish schools is established. The power-law exponent of size distributions is extracted through the data collapse. The distribution depends on the school size only through the ratio of the size to the expected size of the schools an arbitrary individual engages in. This expected size is linear in the ratio of the spatial population density of fish to the breakup rate of school. By means of extensive numerical simulations, it is verified that the law is completely independent of the dimension of the space in which the fish move. Besides the scaling analysis on school size distributions, the integrity of schools over extended periods of time is discussed.     

Simple temporal models for ecological systems with complex spatial patterns

Spatial patterns are ubiquitous in nature. Because these patterns modify the temporal dynamics and stability properties of population densities at a range of spatial scales, their effects must be incorporated in temporal ecological models that do not represent space explicitly. We demonstrate a connection between a simple parameterization of spatial effects and the geometry of clusters in an individual‐based predator–prey model that is both nonlinear and stochastic. Specifically we show that clusters exhibit a power‐law scaling of perimeter to area with an exponent close to unity. In systems with a high degree of patchiness, similar power‐law scalings can provide a basis for applying simple temporal models that assume well‐mixed conditions.     

Power law versus exponential state transition dynamics: application to sleep-wake architecture

Background

Despite the common experience that interrupted sleep has a negative impact on waking function, the features of human sleep-wake architecture that best distinguish sleep continuity versus fragmentation remain elusive. In this regard, there is growing interest in characterizing sleep architecture using models of the temporal dynamics of sleep-wake stage transitions. In humans and other mammals, the state transitions defining sleep and wake bout durations have been described with exponential and power law models, respectively. However, sleep-wake stage distributions are often complex, and distinguishing between exponential and power law processes is not always straightforward. Although mono-exponential distributions are distinct from power law distributions, multi-exponential distributions may in fact resemble power laws by appearing linear on a log-log plot.

Methodology/Principal Findings

To characterize the parameters that may allow these distributions to mimic one another, we systematically fitted multi-exponential-generated distributions with a power law model, and power law-generated distributions with multi-exponential models. We used the Kolmogorov-Smirnov method to investigate goodness of fit for the “incorrect” model over a range of parameters. The “zone of mimicry” of parameters that increased the risk of mistakenly accepting power law fitting resembled empiric time constants obtained in human sleep and wake bout distributions.

Conclusions/Significance

Recognizing this uncertainty in model distinction impacts interpretation of transition dynamics (self-organizing versus probabilistic), and the generation of predictive models for clinical classification of normal and pathological sleep architecture.     

Alu and LINE1 distributions in the human chromosomes: evidence of global genomic organization expressed in the form of power laws

Spatial distribution and clustering of repetitive elements are extensively studied during the last years, as well as their colocalization with other genomic components. Here we investigate the large-scale features of Alu and LINE1 spatial arrangement in the human genome by studying the size distribution of interrepeat distances. In most cases, we have found power-law size distributions extending in several orders of magnitude. We have also studied the correlations of the extent of the power law (linear region in double-logarithmic scale) and of the corresponding exponent (slope) with other genomic properties. A model has been formulated to explain the formation of the observed power laws. According to the model, 2 kinds of events occur repetitively in evolutionary time: random insertion of several types of intruding sequences and occasional loss of repeats belonging to the initial population due to "elimination" events. This simple mechanism is shown to reproduce the observed power-law size distributions and is compatible with our present knowledge on the dynamics of repeat proliferation in the genome.     

Community fluctuations and local extinction in a planktonic food web

Determining statistical patterns irrespective of interacting agents (i.e. macroecology) is useful to explore the mechanisms driving population fluctuations and extinctions in natural food webs. Here, we tested four predictions of a neutral model on the distribution of community fluctuations (CF) and the distributions of persistence times (APT). Novel predictions for the food web were generated by combining (1) body size–density scaling, (2) Taylor's law and (3) low efficiency of trophic transference. Predictions were evaluated on an exceptional data set of plankton with 15 years of weekly samples encompassing c. 250 planktonic species from three trophic levels, sampled in the western English Channel. Highly symmetric non‐Gaussian distributions of CF support zero‐sum dynamics. Variability in CF decreased while a change from an exponential to a power law distribution of APT from basal to upper trophic positions was detected. Results suggest a predictable but profound effect of trophic position on fluctuations and extinction in natural communities.     

The scale-free dynamics of eukaryotic cells

Temporal organization of biological processes requires massively parallel processing on a synchronized time-base. We analyzed time-series data obtained from the bioenergetic oscillatory outputs of Saccharomyces cerevisiae and isolated cardiomyocytes utilizing Relative Dispersional (RDA) and Power Spectral (PSA) analyses. These analyses revealed broad frequency distributions and evidence for long-term memory in the observed dynamics. Moreover RDA and PSA showed that the bioenergetic dynamics in both systems show fractal scaling over at least 3 orders of magnitude, and that this scaling obeys an inverse power law. Therefore we conclude that in S. cerevisiae and cardiomyocytes the dynamics are scale-free in vivo. Applying RDA and PSA to data generated from an in silico model of mitochondrial function indicated that in yeast and cardiomyocytes the underlying mechanisms regulating the scale-free behavior are similar. We validated this finding in vivo using single cells, and attenuating the activity of the mitochondrial inner membrane anion channel with 4-chlorodiazepam to show that the oscillation of NAD(P)H and reactive oxygen species (ROS) can be abated in these two evolutionarily distant species. Taken together these data strongly support our hypothesis that the generation of ROS, coupled to redox cycling, driven by cytoplasmic and mitochondrial processes, are at the core of the observed rhythmicity and scale-free dynamics. We argue that the operation of scale-free bioenergetic dynamics plays a fundamental role to integrate cellular function, while providing a framework for robust, yet flexible, responses to the environment.     

Network dynamics in nociceptive pathways assessed by the neuronal avalanche model

ABSTRACT: BACKGROUND: Traditional electroencephalography provides a critical assessment of pain responses. The perception of pain, however, may involve a series of signal transmission pathways in higher cortical function. Recent studies have shown that a mathematical method, the neuronal avalanche model, may be applied to evaluate higher-order network dynamics. The neuronal avalanche is a cascade of neuronal activity, the size distribution of which can be approximated by a power law relationship manifested by the slope of a straight line (i.e., the alpha value). We investigated whether the neuronal avalanche could be a useful index for nociceptive assessment. FINDINGS: Neuronal activities were recorded with 4 X 8 multichannel electrode arrays in the primary somatosensory cortex (S1) and anterior cingulate cortex (ACC). Under light anesthesia, peripheral pinch stimulation increased the slope of the alpha value in both the ACC and S1, whereas brush stimulation increased the alpha value only in the S1. The increase in alpha values was blocked in both regions under deep anesthesia. The increase in alpha values in the ACC induced by peripheral pinch stimulation was blocked by medial thalamic lesion, but the increase in alpha values in the S1 induced by brush and pinch stimulation was not affected. CONCLUSIONS: The neuronal avalanche model shows a critical state in the cortical network for noxious-related signal processing. The alpha value may provide an index of brain network activity that distinguishes the responses to somatic stimuli from the control state. These network dynamics may be valuable for the evaluation of acute nociceptive processes and may be applied to chronic pathological pain conditions.     

A general combined model to describe tree‐diameter distributions within subtropical and temperate forest communities

The size distribution of trees in natural forests is a fundamental attribute of forest structure. Previous attempts to model tree size distributions using simple functions (such as power or Weibull functions) have had limited success, typically overestimating the number of large stems observed. We describe a model which assumes that the dominant mortality process is asymmetric competition when trees are smaller, and size‐independent processes (e.g. disturbance) when trees are larger. This combination of processes leads to a size distribution which takes the form of a power distribution in the small tree phase and a Weibull distribution in the large tree phase. Analyses of data from four large‐scale (≥ 24 ha each) subtropical and temperate forest plots totalling 99 ha and approximately 0.4 million trees provide support for this model in two respects: (a) the combined function provided unbiased predictions and (b) power‐law functions fitted to small trees had exponents that deviated from the universal exponent of –2 predicted by metabolic scaling theory, gradually decreasing from subtropical evergreen to temperate deciduous forests along the latitudinal gradient.     

Boolean dynamics of Kauffman models with a scale-free network

We studied the Boolean dynamics of the "quenched" Kauffman models with a directed scale-free network, comparing with that of the original directed random Kauffman networks and that of the directed exponential-fluctuation networks. We have numerically investigated the distributions of the state cycle lengths and its changes as the network size N and the average degree k of nodes increase. In the relatively small network (N approximately 150), the median, the mean value and the standard deviation grow exponentially with N in the directed scale-free and the directed exponential-fluctuation networks with k=2, where the function forms of the distributions are given as an almost exponential. We have found that for the relatively large N approximately 10(3) the growth of the median of the distribution over the attractor lengths asymptotically changes from algebraic type to exponential one as the average degree k goes to k=2. The result supports the existence of the transition at k(c)=2 derived in the annealed model.     

Characterizing and modeling citation dynamics

Citation distributions are crucial for the analysis and modeling of the activity of scientists. We investigated bibliometric data of papers published in journals of the American Physical Society, searching for the type of function which best describes the observed citation distributions. We used the goodness of fit with Kolmogorov-Smirnov statistics for three classes of functions: log-normal, simple power law and shifted power law. The shifted power law turns out to be the most reliable hypothesis for all citation networks we derived, which correspond to different time spans. We find that citation dynamics is characterized by bursts, usually occurring within a few years since publication of a paper, and the burst size spans several orders of magnitude. We also investigated the microscopic mechanisms for the evolution of citation networks, by proposing a linear preferential attachment with time dependent initial attractiveness. The model successfully reproduces the empirical citation distributions and accounts for the presence of citation bursts as well.