Toward a classification of isodynamic feed-forward motifs

A preceding study analysed how the topology of network motifs affects the overall rate of the underlying biochemical processes. Surprisingly, it was shown that topologically non-isomorphic motifs can still be isodynamic in the sense that they exhibit the exact same performance rate. Because of the high prevalence of feed-forward functional modules in biological networks, one may hypothesize that evolution tends to favour motifs with faster dynamics. As a step towards ranking the efficiency of feed-forward network motifs, we use a linear flow model to prove theorems establishing that certain classes of motifs are isodynamic. In partitioning the class of all motifs on n nodes into equivalence classes based upon their dynamics, we establish a basis for comparing the efficiency/performance rates of different motifs. The potential biological importance of the theorems is briefly discussed and is the subject of an ongoing large-scale project.     

Feed-Forward versus Feedback Inhibition in a Basic Olfactory Circuit

Inhibitory interneurons play critical roles in shaping the firing patterns of principal neurons in many brain systems. Despite difference in the anatomy or functions of neuronal circuits containing inhibition, two basic motifs repeatedly emerge: feed-forward and feedback. In the locust, it was proposed that a subset of lateral horn interneurons (LHNs), provide feed-forward inhibition onto Kenyon cells (KCs) to maintain their sparse firing—a property critical for olfactory learning and memory. But recently it was established that a single inhibitory cell, the giant GABAergic neuron (GGN), is the main and perhaps sole source of inhibition in the mushroom body, and that inhibition from this cell is mediated by a feedback (FB) loop including KCs and the GGN. To clarify basic differences in the effects of feedback vs. feed-forward inhibition in circuit dynamics we here use a model of the locust olfactory system. We found both inhibitory motifs were able to maintain sparse KCs responses and provide optimal odor discrimination. However, we further found that only FB inhibition could create a phase response consistent with data recorded in vivo. These findings describe general rules for feed-forward versus feedback inhibition and suggest GGN is potentially capable of providing the primary source of inhibition to the KCs. A better understanding of how inhibitory motifs impact post-synaptic neuronal activity could be used to reveal unknown inhibitory structures within biological networks.     

Unraveling the design principle for motif organization in signaling networks

Cellular signaling networks display complex architecture. Defining the design principle of this architecture is crucial for our understanding of various biological processes. Using a mathematical model for three-node feed-forward loops, we identify that the organization of motifs in specific manner within the network serves as an important regulator of signal processing. Further, incorporating a systemic stochastic perturbation to the model we could propose a possible design principle, for higher-order organization of motifs into larger networks in order to achieve specific biological output. The design principle was then verified in a large, complex human cancer signaling network. Further analysis permitted us to classify signaling nodes of the network into robust and vulnerable nodes as a result of higher order motif organization. We show that distribution of these nodes within the network at strategic locations then provides for the range of features displayed by the signaling network.     

Toward a classification of isodynamic feed-forward motifs

A preceding study analysed how the topology of network motifs affects the overall rate of the underlying biochemical processes. Surprisingly, it was shown that topologically non-isomorphic motifs can still be isodynamic in the sense that they exhibit the exact same performance rate. Because of the high prevalence of feed-forward functional modules in biological networks, one may hypothesize that evolution tends to favour motifs with faster dynamics. As a step towards ranking the efficiency of feed-forward network motifs, we use a linear flow model to prove theorems establishing that certain classes of motifs are isodynamic. In partitioning the class of all motifs on n nodes into equivalence classes based upon their dynamics, we establish a basis for comparing the efficiency/performance rates of different motifs. The potential biological importance of the theorems is briefly discussed and is the subject of an ongoing large-scale project.     

Modelling periodic oscillation in gene regulatory networks by cyclic feedback systems

In this paper, we develop a new methodology to analyze and design periodic oscillators of biological networks, in particular gene regulatory networks with multiple genes, proteins and time delays, by using negative cyclic feedback systems. We show that negative cyclic feedback networks have no stable equilibria but stable periodic orbits when certain conditions are satisfied. Specifically, we first prove the basic properties of the biological networks composed of cyclic feedback loops, and then extend our results to general cyclic feedback network with less restriction, thereby making our theoretical analysis and design of oscillators easy to implement, even for large-scale systems. Finally, we use one circadian network formed by a period protein (PER) and per mRNA, and one biologically plausible synthetic gene network, to demonstrate the theoretical results. Since there is less restriction on the network structure, the results of this paper can be expected to apply to a wide variety of areas on modelling, analyzing and designing of biological systems.     

Ultrasensitive response motifs: basic amplifiers in molecular signalling networks

Multi-component signal transduction pathways and gene regulatory circuits underpin integrated cellular responses to perturbations. A recurring set of network motifs serve as the basic building blocks of these molecular signalling networks. This review focuses on ultrasensitive response motifs (URMs) that amplify small percentage changes in the input signal into larger percentage changes in the output response. URMs generally possess a sigmoid input–output relationship that is steeper than the Michaelis–Menten type of response and is often approximated by the Hill function. Six types of URMs can be commonly found in intracellular molecular networks and each has a distinct kinetic mechanism for signal amplification. These URMs are: (i) positive cooperative binding, (ii) homo-multimerization, (iii) multistep signalling, (iv) molecular titration, (v) zero-order covalent modification cycle and (vi) positive feedback. Multiple URMs can be combined to generate highly switch-like responses. Serving as basic signal amplifiers, these URMs are essential for molecular circuits to produce complex nonlinear dynamics, including multistability, robust adaptation and oscillation. These dynamic properties are in turn responsible for higher-level cellular behaviours, such as cell fate determination, homeostasis and biological rhythm.     

Partial information decomposition reveals that synergistic neural integration is greater downstream of recurrent information flow in organotypic cortical cultures

The directionality of network information flow dictates how networks process information. A central component of information processing in both biological and artificial neural networks is their ability to perform synergistic integration–a type of computation. We established previously that synergistic integration varies directly with the strength of feedforward information flow. However, the relationships between both recurrent and feedback information flow and synergistic integration remain unknown. To address this, we analyzed the spiking activity of hundreds of neurons in organotypic cultures of mouse cortex. We asked how empirically observed synergistic integration–determined from partial information decomposition–varied with local functional network structure that was categorized into motifs with varying recurrent and feedback information flow. We found that synergistic integration was elevated in motifs with greater recurrent information flow beyond that expected from the local feedforward information flow. Feedback information flow was interrelated with feedforward information flow and was associated with decreased synergistic integration. Our results indicate that synergistic integration is distinctly influenced by the directionality of local information flow.     

Failure tolerance of motif structure in biological networks

Complex networks serve as generic models for many biological systems that have been shown to share a number of common structural properties such as power-law degree distribution and small-worldness. Real-world networks are composed of building blocks called motifs that are indeed specific subgraphs of (usually) small number of nodes. Network motifs are important in the functionality of complex networks, and the role of some motifs such as feed-forward loop in many biological networks has been heavily studied. On the other hand, many biological networks have shown some degrees of robustness in terms of their efficiency and connectedness against failures in their components. In this paper we investigated how random and systematic failures in the edges of biological networks influenced their motif structure. We considered two biological networks, namely, protein structure network and human brain functional network. Furthermore, we considered random failures as well as systematic failures based on different strategies for choosing candidate edges for removal. Failure in the edges tipping to high degree nodes had the most destructive role in the motif structure of the networks by decreasing their significance level, while removing edges that were connected to nodes with high values of betweenness centrality had the least effect on the significance profiles. In some cases, the latter caused increase in the significance levels of the motifs.     

Colored motifs reveal computational building blocks in the C. elegans brain

Background

Complex networks can often be decomposed into less complex sub-networks whose structures can give hints about the functional organization of the network as a whole. However, these structural motifs can only tell one part of the functional story because in this analysis each node and edge is treated on an equal footing. In real networks, two motifs that are topologically identical but whose nodes perform very different functions will play very different roles in the network.

Methodology/Principal Findings

Here, we combine structural information derived from the topology of the neuronal network of the nematode C. elegans with information about the biological function of these nodes, thus coloring nodes by function. We discover that particular colorations of motifs are significantly more abundant in the worm brain than expected by chance, and have particular computational functions that emphasize the feed-forward structure of information processing in the network, while evading feedback loops. Interneurons are strongly over-represented among the common motifs, supporting the notion that these motifs process and transduce the information from the sensor neurons towards the muscles. Some of the most common motifs identified in the search for significant colored motifs play a crucial role in the system of neurons controlling the worm''s locomotion.

Conclusions/Significance

The analysis of complex networks in terms of colored motifs combines two independent data sets to generate insight about these networks that cannot be obtained with either data set alone. The method is general and should allow a decomposition of any complex networks into its functional (rather than topological) motifs as long as both wiring and functional information is available.     

Functional identification of biological neural networks using reservoir adaptation for point processes

The complexity of biological neural networks does not allow to directly relate their biophysical properties to the dynamics of their electrical activity. We present a reservoir computing approach for functionally identifying a biological neural network, i.e. for building an artificial system that is functionally equivalent to the reference biological network. Employing feed-forward and recurrent networks with fading memory, i.e. reservoirs, we propose a point process based learning algorithm to train the internal parameters of the reservoir and the connectivity between the reservoir and the memoryless readout neurons. Specifically, the model is an Echo State Network (ESN) with leaky integrator neurons, whose individual leakage time constants are also adapted. The proposed ESN algorithm learns a predictive model of stimulus-response relations in in vitro and simulated networks, i.e. it models their response dynamics. Receiver Operating Characteristic (ROC) curve analysis indicates that these ESNs can imitate the response signal of a reference biological network. Reservoir adaptation improved the performance of an ESN over readout-only training methods in many cases. This also held for adaptive feed-forward reservoirs, which had no recurrent dynamics. We demonstrate the predictive power of these ESNs on various tasks with cultured and simulated biological neural networks.     

Statecharts for Gene Network Modeling

State diagrams (stategraphs) are suitable for describing the behavior of dynamic systems. However, when they are used to model large and complex systems, determining the states and transitions among them can be overwhelming, due to their flat, unstratified structure. In this article, we present the use of statecharts as a novel way of modeling complex gene networks. Statecharts extend conventional state diagrams with features such as nested hierarchy, recursion, and concurrency. These features are commonly utilized in engineering for designing complex systems and can enable us to model complex gene networks in an efficient and systematic way. We modeled five key gene network motifs, simple regulation, autoregulation, feed-forward loop, single-input module, and dense overlapping regulon, using statecharts. Specifically, utilizing nested hierarchy and recursion, we were able to model a complex interlocked feed-forward loop network in a highly structured way, demonstrating the potential of our approach for modeling large and complex gene networks.     

Adaptive molecular networks controlling chemotactic migration: dynamic inputs and selection of the network architecture

Eukaryotic signalling networks underlying the cell''s ability to sense the gradient of chemotactic cues frequently have the dual property of perfect adaptation to spatially homogeneous inputs, and persistent activation by inputs that are spatially graded. This property is also shared by bacterial chemotaxis networks, raising the question of whether these two types of chemotactic processes also have similar organization of the underlying biomolecular processes. Interestingly, perfect adaptation can only be achieved robustly by a handful of mechanisms, and while eukaryotic chemotactic networks appear to rely on one of these—the incoherent feed-forward loop, bacterial chemotaxis depends on another—the negative feedback loop. In this review, we discuss how this conclusion can be reached even if the details of the molecular networks are incompletely understood. Furthermore, we argue that the use of distinct network architectures is not accidental and may be a consequence of the nature of the signalling inputs and the limitations of the sensory properties of different cell types.     

PANET: A GPU-Based Tool for Fast Parallel Analysis of Robustness Dynamics and Feed-Forward/Feedback Loop Structures in Large-Scale Biological Networks

It has been a challenge in systems biology to unravel relationships between structural properties and dynamic behaviors of biological networks. A Cytoscape plugin named NetDS was recently proposed to analyze the robustness-related dynamics and feed-forward/feedback loop structures of biological networks. Despite such a useful function, limitations on the network size that can be analyzed exist due to high computational costs. In addition, the plugin cannot verify an intrinsic property which can be induced by an observed result because it has no function to simulate the observation on a large number of random networks. To overcome these limitations, we have developed a novel software tool, PANET. First, the time-consuming parts of NetDS were redesigned to be processed in parallel using the OpenCL library. This approach utilizes the full computing power of multi-core central processing units and graphics processing units. Eventually, this made it possible to investigate a large-scale network such as a human signaling network with 1,609 nodes and 5,063 links. We also developed a new function to perform a batch-mode simulation where it generates a lot of random networks and conducts robustness calculations and feed-forward/feedback loop examinations of them. This helps us to determine if the findings in real biological networks are valid in arbitrary random networks or not. We tested our plugin in two case studies based on two large-scale signaling networks and found interesting results regarding relationships between coherently coupled feed-forward/feedback loops and robustness. In addition, we verified whether or not those findings are consistently conserved in random networks through batch-mode simulations. Taken together, our plugin is expected to effectively investigate various relationships between dynamics and structural properties in large-scale networks. Our software tool, user manual and example datasets are freely available at http://panet-csc.sourceforge.net/.     

Considerations for using integral feedback control to construct a perfectly adapting synthetic gene network

It has long been known to control theorists and engineers that integral feedback control leads to, and is necessary for, “perfect” adaptation to step input perturbations in most systems. Consequently, implementation of this robust control strategy in a synthetic gene network is an attractive prospect. However, the nature of genetic regulatory networks (density-dependent kinetics and molecular signals that easily reach saturation) implies that the design and construction of such a device is not straightforward. In this study, we propose a generic two-promoter genetic regulatory network for the purpose of exhibiting perfect adaptation; our treatment highlights the challenges inherent in the implementation of a genetic integral controller. We also present a numerical case study for a specific realization of this two-promoter network, “constructed” using commonly available parts from the bacterium Escherichia coli. We illustrate the possibility of optimizing this network's transient response via analogy to a linear, free-damped harmonic oscillator. Finally, we discuss extensions of this two-promoter network to a proportional-integral controller and to a three-promoter network capable of perfect adaptation under conditions where first-order protein removal effects would otherwise disrupt the adaptation.     

Trade-off between responsiveness and noise suppression in biomolecular system responses to environmental cues

When living systems detect changes in their external environment their response must be measured to balance the need to react appropriately with the need to remain stable, ignoring insignificant signals. Because this is a fundamental challenge of all biological systems that execute programs in response to stimuli, we developed a generalized time-frequency analysis (TFA) framework to systematically explore the dynamical properties of biomolecular networks. Using TFA, we focused on two well-characterized yeast gene regulatory networks responsive to carbon-source shifts and a mammalian innate immune regulatory network responsive to lipopolysaccharides (LPS). The networks are comprised of two different basic architectures. Dual positive and negative feedback loops make up the yeast galactose network; whereas overlapping positive and negative feed-forward loops are common to the yeast fatty-acid response network and the LPS-induced network of macrophages. TFA revealed remarkably distinct network behaviors in terms of trade-offs in responsiveness and noise suppression that are appropriately tuned to each biological response. The wild type galactose network was found to be highly responsive while the oleate network has greater noise suppression ability. The LPS network appeared more balanced, exhibiting less bias toward noise suppression or responsiveness. Exploration of the network parameter space exposed dramatic differences in system behaviors for each network. These studies highlight fundamental structural and dynamical principles that underlie each network, reveal constrained parameters of positive and negative feedback and feed-forward strengths that tune the networks appropriately for their respective biological roles, and demonstrate the general utility of the TFA approach for systems and synthetic biology.     

Network Adaptation Improves Temporal Representation of Naturalistic Stimuli in Drosophila Eye: II Mechanisms

Retinal networks must adapt constantly to best present the ever changing visual world to the brain. Here we test the hypothesis that adaptation is a result of different mechanisms at several synaptic connections within the network. In a companion paper (Part I), we showed that adaptation in the photoreceptors (R1–R6) and large monopolar cells (LMC) of the Drosophila eye improves sensitivity to under-represented signals in seconds by enhancing both the amplitude and frequency distribution of LMCs'' voltage responses to repeated naturalistic contrast series. In this paper, we show that such adaptation needs both the light-mediated conductance and feedback-mediated synaptic conductance. A faulty feedforward pathway in histamine receptor mutant flies speeds up the LMC output, mimicking extreme light adaptation. A faulty feedback pathway from L2 LMCs to photoreceptors slows down the LMC output, mimicking dark adaptation. These results underline the importance of network adaptation for efficient coding, and as a mechanism for selectively regulating the size and speed of signals in neurons. We suggest that concert action of many different mechanisms and neural connections are responsible for adaptation to visual stimuli. Further, our results demonstrate the need for detailed circuit reconstructions like that of the Drosophila lamina, to understand how networks process information.     

Design and implementation of three incoherent feed-forward motif based biological concentration sensors

Synthetic biology is a useful tool to investigate the dynamics of small biological networks and to assess our capacity to predict their behavior from computational models. In this work we report the construction of three different synthetic networks in Escherichia coli based upon the incoherent feed-forward loop architecture. The steady state behavior of the networks was investigated experimentally and computationally under different mutational regimes in a population based assay. Our data shows that the three incoherent feed-forward networks, using three different macromolecular inhibitory elements, reproduce the behavior predicted from our computational model. We also demonstrate that specific biological motifs can be designed to generate similar behavior using different components. In addition we show how it is possible to tune the behavior of the networks in a predicable manner by applying suitable mutations to the inhibitory elements. Brian Aufderheide provided material support.     

Evolutionary design principles and functional characteristics based on kingdom-specific network motifs

BACKGROUND: Network motifs within biological networks show non-random abundances in systems at different scales. Large directed protein networks at the cellular level are now well defined in several diverse species. We aimed to compare the nature of significantly observed two- and three-node network motifs across three different kingdoms (Arabidopsis thaliana for multicellular plants, Saccharomyces cerevisiae for unicellular fungi and Homo sapiens for animals). RESULTS: 'Two-node feedback' is the most significant motif in all three species. By considering the sign of each two-node feedback interaction, we examined the enrichment of the three types of two-node feedbacks [positive-positive (PP), negative-negative (NN) and positive-negative (PN)]. We found that PN is enriched in the network of A.thaliana, NN in the network of S.cerevisiae and PP and NN in the network of H.sapiens. Each feedback type has characteristic features of robustness, multistability and homeostasis. Conclusions: We suggest that amplification of particular network motifs emerges from contrasting dynamical and topological properties of the motifs, reflects the evolutionary design principles selected by the characteristic behavior of each species and provides a signature pointing to their behavior and function.