Robustness and evolvability in genetic regulatory networks

Living organisms are robust to a great variety of genetic changes. Gene regulation networks and metabolic pathways self-organize and reaccommodate to make the organism perform with stability and reliability under many point mutations, gene duplications and gene deletions. At the same time, living organisms are evolvable, which means that these kind of genetic perturbations can eventually make the organism acquire new functions and adapt to new environments. It is still an open problem to determine how robustness and evolvability blend together at the genetic level to produce stable organisms that yet can change and evolve. Here we address this problem by studying the robustness and evolvability of the attractor landscape of genetic regulatory network models under the process of gene duplication followed by divergence. We show that an intrinsic property of this kind of networks is that, after the divergence of the parent and duplicate genes, with a high probability the previous phenotypes, encoded in the attractor landscape of the network, are preserved and new ones might appear. The above is true in a variety of network topologies and even for the case of extreme divergence in which the duplicate gene bears almost no relation with its parent. Our results indicate that networks operating close to the so-called "critical regime" exhibit the maximum robustness and evolvability simultaneously.     

Inference of Boolean Networks Using Sensitivity Regularization

The inference of genetic regulatory networks from global measurements of gene expressions is an important problem in computational biology. Recent studies suggest that such dynamical molecular systems are poised at a critical phase transition between an ordered and a disordered phase, affording the ability to balance stability and adaptability while coordinating complex macroscopic behavior. We investigate whether incorporating this dynamical system-wide property as an assumption in the inference process is beneficial in terms of reducing the inference error of the designed network. Using Boolean networks, for which there are well-defined notions of ordered, critical, and chaotic dynamical regimes as well as well-studied inference procedures, we analyze the expected inference error relative to deviations in the networks'' dynamical regimes from the assumption of criticality. We demonstrate that taking criticality into account via a penalty term in the inference procedure improves the accuracy of prediction both in terms of state transitions and network wiring, particularly for small sample sizes.     

Criticality Is an Emergent Property of Genetic Networks that Exhibit Evolvability

Accumulating experimental evidence suggests that the gene regulatory networks of living organisms operate in the critical phase, namely, at the transition between ordered and chaotic dynamics. Such critical dynamics of the network permits the coexistence of robustness and flexibility which are necessary to ensure homeostatic stability (of a given phenotype) while allowing for switching between multiple phenotypes (network states) as occurs in development and in response to environmental change. However, the mechanisms through which genetic networks evolve such critical behavior have remained elusive. Here we present an evolutionary model in which criticality naturally emerges from the need to balance between the two essential components of evolvability: phenotype conservation and phenotype innovation under mutations. We simulated the Darwinian evolution of random Boolean networks that mutate gene regulatory interactions and grow by gene duplication. The mutating networks were subjected to selection for networks that both (i) preserve all the already acquired phenotypes (dynamical attractor states) and (ii) generate new ones. Our results show that this interplay between extending the phenotypic landscape (innovation) while conserving the existing phenotypes (conservation) suffices to cause the evolution of all the networks in a population towards criticality. Furthermore, the networks produced by this evolutionary process exhibit structures with hubs (global regulators) similar to the observed topology of real gene regulatory networks. Thus, dynamical criticality and certain elementary topological properties of gene regulatory networks can emerge as a byproduct of the evolvability of the phenotypic landscape.     

Guiding the self-organization of random Boolean networks

Random Boolean networks (RBNs) are models of genetic regulatory networks. It is useful to describe RBNs as self-organizing systems to study how changes in the nodes and connections affect the global network dynamics. This article reviews eight different methods for guiding the self-organization of RBNs. In particular, the article is focused on guiding RBNs toward the critical dynamical regime, which is near the phase transition between the ordered and dynamical phases. The properties and advantages of the critical regime for life, computation, adaptability, evolvability, and robustness are reviewed. The guidance methods of RBNs can be used for engineering systems with the features of the critical regime, as well as for studying how natural selection evolved living systems, which are also critical.     

Robustness: confronting lessons from physics and biology

The term robustness is encountered in very different scientific fields, from engineering and control theory to dynamical systems to biology. The main question addressed herein is whether the notion of robustness and its correlates (stability, resilience, self‐organisation) developed in physics are relevant to biology, or whether specific extensions and novel frameworks are required to account for the robustness properties of living systems. To clarify this issue, the different meanings covered by this unique term are discussed; it is argued that they crucially depend on the kind of perturbations that a robust system should by definition withstand. Possible mechanisms underlying robust behaviours are examined, either encountered in all natural systems (symmetries, conservation laws, dynamic stability) or specific to biological systems (feedbacks and regulatory networks). Special attention is devoted to the (sometimes counterintuitive) interrelations between robustness and noise. A distinction between dynamic selection and natural selection in the establishment of a robust behaviour is underlined. It is finally argued that nested notions of robustness, relevant to different time scales and different levels of organisation, allow one to reconcile the seemingly contradictory requirements for robustness and adaptability in living systems.     

The causes of epistasis in genetic networks

Epistasis refers to the nonadditive interactions between genes in determining phenotypes. Considerable efforts have shown that, even for a given organism, epistasis may vary both in intensity and sign. Recent comparative studies supported that the overall sign of epistasis switches from positive to negative as the complexity of an organism increases, and it has been hypothesized that this change shall be a consequence of the underlying gene network properties. Why should this be the case? What characteristics of genetic networks determine the sign of epistasis? Here we show, by evolving genetic networks that differ in their complexity and robustness against perturbations but that perform the same tasks, that robustness increased with complexity and that epistasis was positive for small nonrobust networks but negative for large robust ones. Our results indicate that robustness and negative epistasis emerge as a consequence of the existence of redundant elements in regulatory structures of genetic networks and that the correlation between complexity and epistasis is a byproduct of such redundancy, allowing for the decoupling of epistasis from the underlying network complexity.     

Gene regulatory network models for plant development

Accumulated genetic data are stimulating the use of mathematical and computational tools for studying the concerted action of genes during cell differentiation and morphogenetic processes. At the same time, network theory has flourished, enabling analyses of complex systems that have multiple elements and interactions. Reverse engineering methods that use genomic data or detailed experiments on gene interactions have been used to propose gene network architectures. Experiments on gene interactions incorporate enough detail for relatively small developmental modules and thus allow dynamical analyses that have direct functional interpretations. Generalities are beginning to emerge. For example, biological genetic networks are robust to environmental and genetic perturbations. Such dynamical studies also enable novel predictions that can lead to further experimental tests, which might then feedback to the theoretical analyses. This interplay is proving productive for understanding plant development. Finally, both experiments on gene interactions and theoretical analyses allow the identification of frequent or fixed evolutionary solutions to developmental problems, and thus are contributing to an understanding of the genetic basis of the evolution of development and body plan.     

Additive functions in boolean models of gene regulatory network modules

Gene-on-gene regulations are key components of every living organism. Dynamical abstract models of genetic regulatory networks help explain the genome's evolvability and robustness. These properties can be attributed to the structural topology of the graph formed by genes, as vertices, and regulatory interactions, as edges. Moreover, the actual gene interaction of each gene is believed to play a key role in the stability of the structure. With advances in biology, some effort was deployed to develop update functions in boolean models that include recent knowledge. We combine real-life gene interaction networks with novel update functions in a boolean model. We use two sub-networks of biological organisms, the yeast cell-cycle and the mouse embryonic stem cell, as topological support for our system. On these structures, we substitute the original random update functions by a novel threshold-based dynamic function in which the promoting and repressing effect of each interaction is considered. We use a third real-life regulatory network, along with its inferred boolean update functions to validate the proposed update function. Results of this validation hint to increased biological plausibility of the threshold-based function. To investigate the dynamical behavior of this new model, we visualized the phase transition between order and chaos into the critical regime using Derrida plots. We complement the qualitative nature of Derrida plots with an alternative measure, the criticality distance, that also allows to discriminate between regimes in a quantitative way. Simulation on both real-life genetic regulatory networks show that there exists a set of parameters that allows the systems to operate in the critical region. This new model includes experimentally derived biological information and recent discoveries, which makes it potentially useful to guide experimental research. The update function confers additional realism to the model, while reducing the complexity and solution space, thus making it easier to investigate.     

Robustness and state-space structure of Boolean gene regulatory models

Robustness to perturbation is an important characteristic of genetic regulatory systems, but the relationship between robustness and model dynamics has not been clearly quantified. We propose a method for quantifying both robustness and dynamics in terms of state-space structures, for Boolean models of genetic regulatory systems. By investigating existing models of the Drosophila melanogaster segment polarity network and the Saccharomyces cerevisiae cell-cycle network, we show that the structure of attractor basins can yield insight into the underlying decision making required of the system, and also the way in which the system maximises its robustness. In particular, gene networks implementing decisions based on a few genes have simple state-space structures, and their attractors are robust by virtue of their simplicity. Gene networks with decisions that involve many interacting genes have correspondingly more complicated state-space structures, and robustness cannot be achieved through the structure of the attractor basins, but is achieved by larger attractor basins that dominate the state space. These different types of robustness are demonstrated by the two models: the D. melanogaster segment polarity network is robust due to simple attractor basins that implement decisions based on spatial signals; the S. cerevisiae cell-cycle network has a complicated state-space structure, and is robust only due to a giant attractor basin that dominates the state space.     

Superstability of the yeast cell-cycle dynamics: ensuring causality in the presence of biochemical stochasticity

Gene regulatory dynamics are governed by molecular processes and therefore exhibits an inherent stochasticity. However, for the survival of an organism it is a strict necessity that this intrinsic noise does not prevent robust functioning of the system. It is still an open question how dynamical stability is achieved in biological systems despite the omnipresent fluctuations. In this paper we investigate the cell cycle of the budding yeast Saccharomyces cerevisiae as an example of a well-studied organism. We study a genetic network model of 11 genes that coordinate the cell-cycle dynamics using a modeling framework which generalizes the concept of discrete threshold dynamics. By allowing for fluctuations in the process times, we introduce noise into the model, accounting for the effects of biochemical stochasticity. We study the dynamical attractor of the cell cycle and find a remarkable robustness against fluctuations of this kind. We identify mechanisms that ensure reliability in spite of fluctuations: 'Catcher states' and persistence of activity levels contribute significantly to the stability of the yeast cell cycle despite the inherent stochasticity.     

Genes, genome and Gestalt

According to Gestalt thinking, biological systems cannot be viewed as the sum of their elements, but as processes of the whole. To understand organisms we must start from the whole, observing how the various parts are related. In genetics, we must observe the genome over and above the sum of its genes. Either loss or addition of one gene in a genome can change the function of the organism. Genomes are organized in networks of genes, which need to be well integrated. In the case of genetically modified organisms (GMOs), for example, soybeans, rats, Anopheles mosquitoes, and pigs, the insertion of an exogenous gene into a receptive organism generally causes disturbance in the networks, resulting in the breakdown of gene interactions. In these cases, genetic modification increased the genetic load of the GMO and consequently decreased its adaptability (fitness). Therefore, it is hard to claim that the production of such organisms with an increased genetic load does not have ethical implications.     

Robustness of Oscillatory Behavior in Correlated Networks

Understanding network robustness against failures of network units is useful for preventing large-scale breakdowns and damages in real-world networked systems. The tolerance of networked systems whose functions are maintained by collective dynamical behavior of the network units has recently been analyzed in the framework called dynamical robustness of complex networks. The effect of network structure on the dynamical robustness has been examined with various types of network topology, but the role of network assortativity, or degree–degree correlations, is still unclear. Here we study the dynamical robustness of correlated (assortative and disassortative) networks consisting of diffusively coupled oscillators. Numerical analyses for the correlated networks with Poisson and power-law degree distributions show that network assortativity enhances the dynamical robustness of the oscillator networks but the impact of network disassortativity depends on the detailed network connectivity. Furthermore, we theoretically analyze the dynamical robustness of correlated bimodal networks with two-peak degree distributions and show the positive impact of the network assortativity.     

Dynamic properties of network motifs contribute to biological network organization

Biological networks, such as those describing gene regulation, signal transduction, and neural synapses, are representations of large-scale dynamic systems. Discovery of organizing principles of biological networks can be enhanced by embracing the notion that there is a deep interplay between network structure and system dynamics. Recently, many structural characteristics of these non-random networks have been identified, but dynamical implications of the features have not been explored comprehensively. We demonstrate by exhaustive computational analysis that a dynamical property—stability or robustness to small perturbations—is highly correlated with the relative abundance of small subnetworks (network motifs) in several previously determined biological networks. We propose that robust dynamical stability is an influential property that can determine the non-random structure of biological networks.     

Robustness and evolvability: a paradox resolved

Understanding the relationship between robustness and evolvability is key to understand how living things can withstand mutations, while producing ample variation that leads to evolutionary innovations. Mutational robustness and evolvability, a system's ability to produce heritable variation, harbour a paradoxical tension. On one hand, high robustness implies low production of heritable phenotypic variation. On the other hand, both experimental and computational analyses of neutral networks indicate that robustness enhances evolvability. I here resolve this tension using RNA genotypes and their secondary structure phenotypes as a study system. To resolve the tension, one must distinguish between robustness of a genotype and a phenotype. I confirm that genotype (sequence) robustness and evolvability share an antagonistic relationship. In stark contrast, phenotype (structure) robustness promotes structure evolvability. A consequence is that finite populations of sequences with a robust phenotype can access large amounts of phenotypic variation while spreading through a neutral network. Population-level processes and phenotypes rather than individual sequences are key to understand the relationship between robustness and evolvability. My observations may apply to other genetic systems where many connected genotypes produce the same phenotypes.     

Stabilizing patterning in the Drosophila segment polarity network by selecting models in silico

The segmentation of Drosophila is a prime model to study spatial patterning during embryogenesis. The spatial expression of segment polarity genes results from a complex network of interacting proteins whose expression products are maintained after successful segmentation. This prompted us to investigate the stability and robustness of this process using a dynamical model for the segmentation network based on Boolean states. The model consists of intra-cellular as well as inter-cellular interactions between adjacent cells in one spatial dimension. We quantify the robustness of the dynamical segmentation process by a systematic analysis of mutations. Our starting point consists in a previous Boolean model for Drosophila segmentation. We define mathematically the notion of dynamical robustness and show that the proposed model exhibits limited robustness in gene expression under perturbations. We applied in silico evolution (mutation and selection) and discover two classes of modified gene networks that have a more robust spatial expression pattern. We verified that the enhanced robustness of the two new models is maintained in differential equations models. By comparing the predicted model with experiments on mutated flies, we then discuss the two types of enhanced models. Drosophila patterning can be explained by modelling the underlying network of interacting genes. Here we demonstrate that simple dynamical considerations and in silico evolution can enhance the model to robustly express the expected pattern, helping to elucidate the role of further interactions.     

Criticality enhances the multilevel reliability of stimulus responses in cortical neural networks

Cortical neural networks exhibit high internal variability in spontaneous dynamic activities and they can robustly and reliably respond to external stimuli with multilevel features–from microscopic irregular spiking of neurons to macroscopic oscillatory local field potential. A comprehensive study integrating these multilevel features in spontaneous and stimulus–evoked dynamics with seemingly distinct mechanisms is still lacking. Here, we study the stimulus–response dynamics of biologically plausible excitation–inhibition (E–I) balanced networks. We confirm that networks around critical synchronous transition states can maintain strong internal variability but are sensitive to external stimuli. In this dynamical region, applying a stimulus to the network can reduce the trial-to-trial variability and shift the network oscillatory frequency while preserving the dynamical criticality. These multilevel features widely observed in different experiments cannot simultaneously occur in non-critical dynamical states. Furthermore, the dynamical mechanisms underlying these multilevel features are revealed using a semi-analytical mean-field theory that derives the macroscopic network field equations from the microscopic neuronal networks, enabling the analysis by nonlinear dynamics theory and linear noise approximation. The generic dynamical principle revealed here contributes to a more integrative understanding of neural systems and brain functions and incorporates multimodal and multilevel experimental observations. The E–I balanced neural network in combination with the effective mean-field theory can serve as a mechanistic modeling framework to study the multilevel neural dynamics underlying neural information and cognitive processes.     

Trade-off between responsiveness and noise suppression in biomolecular system responses to environmental cues

When living systems detect changes in their external environment their response must be measured to balance the need to react appropriately with the need to remain stable, ignoring insignificant signals. Because this is a fundamental challenge of all biological systems that execute programs in response to stimuli, we developed a generalized time-frequency analysis (TFA) framework to systematically explore the dynamical properties of biomolecular networks. Using TFA, we focused on two well-characterized yeast gene regulatory networks responsive to carbon-source shifts and a mammalian innate immune regulatory network responsive to lipopolysaccharides (LPS). The networks are comprised of two different basic architectures. Dual positive and negative feedback loops make up the yeast galactose network; whereas overlapping positive and negative feed-forward loops are common to the yeast fatty-acid response network and the LPS-induced network of macrophages. TFA revealed remarkably distinct network behaviors in terms of trade-offs in responsiveness and noise suppression that are appropriately tuned to each biological response. The wild type galactose network was found to be highly responsive while the oleate network has greater noise suppression ability. The LPS network appeared more balanced, exhibiting less bias toward noise suppression or responsiveness. Exploration of the network parameter space exposed dramatic differences in system behaviors for each network. These studies highlight fundamental structural and dynamical principles that underlie each network, reveal constrained parameters of positive and negative feedback and feed-forward strengths that tune the networks appropriately for their respective biological roles, and demonstrate the general utility of the TFA approach for systems and synthetic biology.     

Estimating the Stochastic Bifurcation Structure of Cellular Networks

High throughput measurement of gene expression at single-cell resolution, combined with systematic perturbation of environmental or cellular variables, provides information that can be used to generate novel insight into the properties of gene regulatory networks by linking cellular responses to external parameters. In dynamical systems theory, this information is the subject of bifurcation analysis, which establishes how system-level behaviour changes as a function of parameter values within a given deterministic mathematical model. Since cellular networks are inherently noisy, we generalize the traditional bifurcation diagram of deterministic systems theory to stochastic dynamical systems. We demonstrate how statistical methods for density estimation, in particular, mixture density and conditional mixture density estimators, can be employed to establish empirical bifurcation diagrams describing the bistable genetic switch network controlling galactose utilization in yeast Saccharomyces cerevisiae. These approaches allow us to make novel qualitative and quantitative observations about the switching behavior of the galactose network, and provide a framework that might be useful to extract information needed for the development of quantitative network models.     

Dynamic-module redundancy confers robustness to the gene regulatory network involved in hair patterning of Arabidopsis epidermis

Redundancy among dynamic modules is emerging as a potentially generic trait in gene regulatory networks. Moreover, module redundancy could play an important role in network robustness to perturbations. We explored the effect of dynamic-module redundancy in the networks associated to hair patterning in Arabidopsis root and leaf epidermis. Recent studies have put forward several dynamic modules belonging to these networks. We defined these modules in a discrete dynamical framework that was previously reported. Then, we addressed whether these modules are sufficient or necessary for recovering epidermal cell types and patterning. After defining two quantitative estimates of the system's robustness, we also compared the robustness of each separate module with that of a network coupling all the leaf or root modules. We found that, considering certain assumptions, all the dynamic modules proposed so far are sufficient on their own for pattern formation, but reinforce each other during epidermal development. Furthermore, we found that networks of coupled modules are more robust to perturbations than single modules. These results suggest that dynamic-module redundancy might be an important trait in gene regulatory networks and point at central questions regarding network evolution, module coupling, pattern robustness and the evolution of development.