Robustness and state-space structure of Boolean gene regulatory models

Robustness to perturbation is an important characteristic of genetic regulatory systems, but the relationship between robustness and model dynamics has not been clearly quantified. We propose a method for quantifying both robustness and dynamics in terms of state-space structures, for Boolean models of genetic regulatory systems. By investigating existing models of the Drosophila melanogaster segment polarity network and the Saccharomyces cerevisiae cell-cycle network, we show that the structure of attractor basins can yield insight into the underlying decision making required of the system, and also the way in which the system maximises its robustness. In particular, gene networks implementing decisions based on a few genes have simple state-space structures, and their attractors are robust by virtue of their simplicity. Gene networks with decisions that involve many interacting genes have correspondingly more complicated state-space structures, and robustness cannot be achieved through the structure of the attractor basins, but is achieved by larger attractor basins that dominate the state space. These different types of robustness are demonstrated by the two models: the D. melanogaster segment polarity network is robust due to simple attractor basins that implement decisions based on spatial signals; the S. cerevisiae cell-cycle network has a complicated state-space structure, and is robust only due to a giant attractor basin that dominates the state space.     

Modeling baseline conditions of ecological indicators: Marine renewable energy environmental monitoring

Ecological indicators are often collected to detect and monitor environmental change. Statistical models are used to estimate natural variability, pre-existing trends, and environmental predictors of baseline indicator conditions. Establishing standard models for baseline characterization is critical to the effective design and implementation of environmental monitoring programs. An anthropogenic activity that requires monitoring is the development of Marine Renewable Energy sites. Currently, there are no standards for the analysis of environmental monitoring data for these development sites. Marine Renewable Energy monitoring data are used as a case study to develop and apply a model evaluation to establish best practices for characterizing baseline ecological indicator data. We examined a range of models, including six generalized regression models, four time series models, and three nonparametric models. Because monitoring data are not always normally distributed, we evaluated model ability to characterize normal and non-normal data using hydroacoustic metrics that serve as proxies for ecological indicator data. The nonparametric support vector regression and random forest models, and parametric state-space time series models generally were the most accurate in interpolating the normal metric data. Support vector regression and state-space models best interpolated the non-normally distributed data. If parametric results are preferred, then state-space models are the most robust for baseline characterization. Evaluation of a wide range of models provides a comprehensive characterization of the case study data, and highlights advantages of models rarely used in Marine Renewable Energy environmental monitoring. Our model findings are relevant for any ecological indicator data with similar properties, and the evaluation approach is applicable to any monitoring program.     

Estimating linear temporal trends from aggregated environmental monitoring data

Trend estimates are often used as part of environmental monitoring programs. These trends inform managers (e.g., are desired species increasing or undesired species decreasing?). Data collected from environmental monitoring programs is often aggregated (i.e., averaged), which confounds sampling and process variation. State-space models allow sampling variation and process variations to be separated. We used simulated time-series to compare linear trend estimations from three state-space models, a simple linear regression model, and an auto-regressive model. We also compared the performance of these five models to estimate trends from a long term monitoring program. We specifically estimated trends for two species of fish and four species of aquatic vegetation from the Upper Mississippi River system. We found that the simple linear regression had the best performance of all the given models because it was best able to recover parameters and had consistent numerical convergence. Conversely, the simple linear regression did the worst job estimating populations in a given year. The state-space models did not estimate trends well, but estimated population sizes best when the models converged. We found that a simple linear regression performed better than more complex autoregression and state-space models when used to analyze aggregated environmental monitoring data.     

Recombinant expression, purification, and antimicrobial activity of a novel hybrid antimicrobial peptide LFT33

With great therapeutic potential against antibiotic-resistant bacteria, viruses, and even parasites, antimicrobial peptides (AMPs) have received increased interest as pharmaceutical agents in recent years. It is a worthy yet challenging work to carry out the implement and improvement of AMPs production using bioengineering techniques. In the present study, a novel hybrid peptide LFT33 was designed derived from LfcinB and thanatin. The cDNA fragment encoding LFT33 with preferred codons of Escherichia coli was chemically synthesized and ligated into the vector pET32a(+) to express the LFT33 fusion protein. The fusion protein was successfully expressed in soluble form in E. coli induced under optimized conditions. After purification by affinity chromatography, the fusion protein was cleaved successfully by enterokinase and released the peptide LFT33. About 0.5?mg of the recombinant LFT33 was obtained by reversed-phase high performance liquid chromatography from 1?l of culture medium. Mass spectrometry analysis of the purified recombinant LFT33 demonstrated that the molecular weight perfectly matched the calculated mass (4,195?Da). The recombinant peptide LFT33 caused an increase in antimicrobial activity (IC(50)?=?16-64?μg/ml) against given strains and did not show hemolytic activity for human erythrocytes. The results indicated that the hybrid peptide LFT33 could serve as a promising candidate for pharmaceutical agents.     

Structural time series models with feedback mechanisms

Structural time series models have applications in many different fields such as biology, economics, and meteorology. A structural times series model can be represented as a state-space model where the states of the system represent the unobserved components and the structural parameters have clear interpretations. This paper introduces a class of structural time series models that incorporate feedback from the latent components of the history. An iterative procedure is proposed for estimation. These models allow flexible and robust feedback mechanisms, have clear interpretations, and have a computationally efficient estimation procedure. They are applied to hormone data to characterize hormone secretion and to explore a potential feedback mechanism.     

Extended Kalman Filter for Estimation of Parameters in Nonlinear State-Space Models of Biochemical Networks

It is system dynamics that determines the function of cells, tissues and organisms. To develop mathematical models and estimate their parameters are an essential issue for studying dynamic behaviors of biological systems which include metabolic networks, genetic regulatory networks and signal transduction pathways, under perturbation of external stimuli. In general, biological dynamic systems are partially observed. Therefore, a natural way to model dynamic biological systems is to employ nonlinear state-space equations. Although statistical methods for parameter estimation of linear models in biological dynamic systems have been developed intensively in the recent years, the estimation of both states and parameters of nonlinear dynamic systems remains a challenging task. In this report, we apply extended Kalman Filter (EKF) to the estimation of both states and parameters of nonlinear state-space models. To evaluate the performance of the EKF for parameter estimation, we apply the EKF to a simulation dataset and two real datasets: JAK-STAT signal transduction pathway and Ras/Raf/MEK/ERK signaling transduction pathways datasets. The preliminary results show that EKF can accurately estimate the parameters and predict states in nonlinear state-space equations for modeling dynamic biochemical networks.     

An LMI approach to design H(infinity) controllers for discrete-time nonlinear systems based on unified models

A unified neural network model termed standard neural network model (SNNM) is advanced. Based on the robust L(2) gain (i.e. robust H(infinity) performance) analysis of the SNNM with external disturbances, a state-feedback control law is designed for the SNNM to stabilize the closed-loop system and eliminate the effect of external disturbances. The control design constraints are shown to be a set of linear matrix inequalities (LMIs) which can be easily solved by various convex optimization algorithms (e.g. interior-point algorithms) to determine the control law. Most discrete-time recurrent neural network (RNNs) and discrete-time nonlinear systems modelled by neural networks or Takagi and Sugeno (T-S) fuzzy models can be transformed into the SNNMs to be robust H(infinity) performance analyzed or robust H(infinity) controller synthesized in a unified SNNM's framework. Finally, some examples are presented to illustrate the wide application of the SNNMs to the nonlinear systems, and the proposed approach is compared with related methods reported in the literature.     

Decoy selection for protein structure prediction via extreme gradient boosting and ranking

Numerical solutions of the chemical master equation (CME) are important for understanding the stochasticity of biochemical systems. However, solving CMEs is a formidable task. This task is complicated due to the nonlinear nature of the reactions and the size of the networks which result in different realizations. Most importantly, the exponential growth of the size of the state-space, with respect to the number of different species in the system makes this a challenging assignment. When the biochemical system has a large number of variables, the CME solution becomes intractable. We introduce the intelligent state projection (ISP) method to use in the stochastic analysis of these systems. For any biochemical reaction network, it is important to capture more than one moment: this allows one to describe the system’s dynamic behaviour. ISP is based on a state-space search and the data structure standards of artificial intelligence (AI). It can be used to explore and update the states of a biochemical system. To support the expansion in ISP, we also develop a Bayesian likelihood node projection (BLNP) function to predict the likelihood of the states. To demonstrate the acceptability and effectiveness of our method, we apply the ISP method to several biological models discussed in prior literature. The results of our computational experiments reveal that the ISP method is effective both in terms of the speed and accuracy of the expansion, and the accuracy of the solution. This method also provides a better understanding of the state-space of the system in terms of blueprint patterns. The ISP is the de-novo method which addresses both accuracy and performance problems for CME solutions. It systematically expands the projection space based on predefined inputs. This ensures accuracy in the approximation and an exact analytical solution for the time of interest. The ISP was more effective both in predicting the behavior of the state-space of the system and in performance management, which is a vital step towards modeling large biochemical systems.     

Detecting and estimating density dependence in wildlife populations

We review methods for detecting and assessing the strength of density dependence based on 2 types of approaches: surveys of population size and studies of life history traits, in particular demographic parameters. For the first type of studies, methods neglecting uncertainty in population size should definitely be abandoned. Bayesian approaches to simple state-space models accounting for uncertainty in population size are recommended, with some caution because of numerical difficulties and risks of model misspecification. Realistic state-space models incorporating features such as environmental covariates, age structure, etc., may lack power because of the shortness of the time series and the simultaneous presence of process and sampling variability. In all cases, complementing the population survey data with some external information, with priority on the intrinsic growth rate, is highly recommended. Methods for detecting density dependence in life history traits are generally conservative (i.e., tend to underestimate the strength of density dependence). Among approaches to correct for this effect, the state-space formulation of capture–recapture models is again the most promising. Foreseeable developments will exploit integrated monitoring combining population size surveys and individual longitudinal data in refined state-space models, for which a Bayesian approach is the most straightforward statistical treatment. One may thus expect an integration of various types of models that will make it possible to look at density dependence as a complex biological process interacting with other processes rather than in terms of a simple equation; modern statistical and modeling tools make such a synthesis within reach. © 2012 The Wildlife Society.     

Segmentation of thin structures in electron micrographs using orientation fields

In this paper, we introduce a new approach for segmenting thin structures in electron micrographs. We introduce two new transforms, the Line Filter Transform (LFT) and the Orientation Filter Transform (OFT). The LFT can be viewed as an alternative to anisotropic diffusion algorithms that is particularly useful for thin structures. The OFT utilizes geometrical information about the structure by measuring correlations of local orientations in the image. By combining these methods with a contour extraction and labeling method we construct a segmentation method for thin structures in 2D images. We discuss how the method can be applied slice-by-slice to electron tomograms and illustrate the process by constructing two models of membrane structures from cellular tomograms. The suggested method has the advantage of being relatively insensitive to non-uniform contrast and high-contrast features such as ribosomes.     

Chaotic gene regulatory networks can be robust against mutations and noise

Robustness to mutations and noise has been shown to evolve through stabilizing selection for optimal phenotypes in model gene regulatory networks. The ability to evolve robust mutants is known to depend on the network architecture. How do the dynamical properties and state-space structures of networks with high and low robustness differ? Does selection operate on the global dynamical behavior of the networks? What kind of state-space structures are favored by selection? We provide damage propagation analysis and an extensive statistical analysis of state spaces of these model networks to show that the change in their dynamical properties due to stabilizing selection for optimal phenotypes is minor. Most notably, the networks that are most robust to both mutations and noise are highly chaotic. Certain properties of chaotic networks, such as being able to produce large attractor basins, can be useful for maintaining a stable gene-expression pattern. Our findings indicate that conventional measures of stability, such as damage propagation, do not provide much information about robustness to mutations or noise in model gene regulatory networks.     

Loglinear models for the robust design in mark-recapture experiments

The robust design is a method for implementing a mark-recapture experiment featuring a nested sampling structure. The first level consists of primary sampling sessions; the population experiences mortality and immigration between primary sessions so that open population models apply at this level. The second level of sampling has a short mark-recapture study within each primary session. Closed population models are used at this stage to estimate the animal abundance at each primary session. This article suggests a loglinear technique to fit the robust design. Loglinear models for the analysis of mark-recapture data from closed and open populations are first reviewed. These two types of models are then combined to analyze the data from a robust design. The proposed loglinear approach to the robust design allows incorporating parameters for a heterogeneity in the capture probabilities of the units within each primary session. Temporary emigration out of the study area can also be accounted for in the loglinear framework. The analysis is relatively simple; it relies on a large Poisson regression with the vector of frequencies of the capture histories as dependent variable. An example concerned with the estimation of abundance and survival of the red-back vole in an area of southeastern Québec is presented.     

Model Selection in Systems Biology Depends on Experimental Design

Experimental design attempts to maximise the information available for modelling tasks. An optimal experiment allows the inferred models or parameters to be chosen with the highest expected degree of confidence. If the true system is faithfully reproduced by one of the models, the merit of this approach is clear - we simply wish to identify it and the true parameters with the most certainty. However, in the more realistic situation where all models are incorrect or incomplete, the interpretation of model selection outcomes and the role of experimental design needs to be examined more carefully. Using a novel experimental design and model selection framework for stochastic state-space models, we perform high-throughput in-silico analyses on families of gene regulatory cascade models, to show that the selected model can depend on the experiment performed. We observe that experimental design thus makes confidence a criterion for model choice, but that this does not necessarily correlate with a model''s predictive power or correctness. Finally, in the special case of linear ordinary differential equation (ODE) models, we explore how wrong a model has to be before it influences the conclusions of a model selection analysis.     

A general framework for modeling population abundance data

Time-series data resulting from surveying wild animals are often described using state-space population dynamics models, in particular with Gompertz, Beverton-Holt, or Moran-Ricker latent processes. We show how hidden Markov model methodology provides a flexible framework for fitting a wide range of models to such data. This general approach makes it possible to model abundance on the natural or log scale, include multiple observations at each sampling occasion and compare alternative models using information criteria. It also easily accommodates unequal sampling time intervals, should that possibility occur, and allows testing for density dependence using the bootstrap. The paper is illustrated by replicated time series of red kangaroo abundances, and a univariate time series of ibex counts which are an order of magnitude larger. In the analyses carried out, we fit different latent process and observation models using the hidden Markov framework. Results are robust with regard to the necessary discretization of the state variable. We find no effective difference between the three latent models of the paper in terms of maximized likelihood value for the two applications presented, and also others analyzed. Simulations suggest that ecological time series are not sufficiently informative to distinguish between alternative latent processes for modeling population survey data when data do not indicate strong density dependence.     

Robust, quantitative tools for modelling ex-vivo expansion of haematopoietic stem cells and progenitors

Despite substantial research activity on bioreactor design and experiments, there are very few reports of modelling tools that can be used to generate predictive models describing how bioreactor parameters affect performance. New developments in mathematics, such as sparse Bayesian feature selection methods and nonlinear model-free modelling regression methods, offer considerable promise for modelling diverse types of data. The utility of these mathematical tools in stem cell biology are demonstrated by analysis of a large set of bioreactor data derived from the literature. In spite of the diversity of the data sources, and the inherent difficulty in representing bioreactor variables, these modelling methods were able to develop robust, quantitative, predictive models. These models relate bioreactor operational parameters to the degree of expansion of haematopoietic stem cells or their progenitors, and also identify the bioreactor variables that are most likely to affect performance across many experiments. These methods show substantial promise in assisting the design and optimisation of stem cell bioreactors.     

Estrogen receptors, progestin receptors and DNA synthesis in the macaque endometrium during the luteal-follicular transition

We have suggested that in the nonhuman primate endometrium, stromal cells might play a role in mediating the effects of estrogen on the epithelium, especially during the luteal-follicular transition (LFT) when target cells normally escape from the inhibitory influence of progesterone (P). We now report that like estrogen receptors (ER), endometrial progestin receptors (PR) are detectable only in stromal cells until the fifth day of the LFT. With a technique that combined immunocytochemistry and autoradiography on the same sections, we characterized the cellular distribution of ER or PR coincidentally with the localization of [3H]thymidine taken up in vitro by endometria from monkeys undergoing an LFT. DNA synthesis in the glands of the upper endometrium was E2-dependent, but the distribution of [3H]thymidine was not positively correlated with the presence of ER or PR. Readministration of P to animals on days 3 or 4 of the LFT significantly reduced the [3H]thymidine labeling index of the glandular epithelium and caused stromal ER to decline, but P did not block the eventual appearance of ER in epithelial cells on day 5 of the LFT. Thus, E2 stimulated DNA synthesis in epithelial cells that lacked ER, and P suppressed DNA synthesis in these cells even though PR was only detected in the stroma when P treatment began. These data are consistent with a role for endometrial stromal cells in mediating the effects of E2 and P on the epithelium during the LFT.     

A Robust Test for Two‐Stage Design in Genome‐Wide Association Studies

Summary A two‐stage design is cost‐effective for genome‐wide association studies (GWAS) testing hundreds of thousands of single nucleotide polymorphisms (SNPs). In this design, each SNP is genotyped in stage 1 using a fraction of case–control samples. Top‐ranked SNPs are selected and genotyped in stage 2 using additional samples. A joint analysis, combining statistics from both stages, is applied in the second stage. Follow‐up studies can be regarded as a two‐stage design. Once some potential SNPs are identified, independent samples are further genotyped and analyzed separately or jointly with previous data to confirm the findings. When the underlying genetic model is known, an asymptotically optimal trend test (TT) can be used at each analysis. In practice, however, genetic models for SNPs with true associations are usually unknown. In this case, the existing methods for analysis of the two‐stage design and follow‐up studies are not robust across different genetic models. We propose a simple robust procedure with genetic model selection to the two‐stage GWAS. Our results show that, if the optimal TT has about 80% power when the genetic model is known, then the existing methods for analysis of the two‐stage design have minimum powers about 20% across the four common genetic models (when the true model is unknown), while our robust procedure has minimum powers about 70% across the same genetic models. The results can be also applied to follow‐up and replication studies with a joint analysis.     

Quantitative performance metrics for robustness in circadian rhythms

MOTIVATION: Sensitivity analysis provides key measures that aid in unraveling the design principles responsible for the robust performance of biological networks. Such metrics allow researchers to investigate comprehensively model performance, to develop more realistic models, and to design informative experiments. However, sensitivity analysis of oscillatory systems focuses on period and amplitude characteristics, while biologically relevant effects on phase are neglected. RESULTS: Here, we introduce a novel set of phase-based sensitivity metrics for performance: period, phase, corrected phase and relative phase. Both state- and phase-based tools are applied to free-running Drosophila melanogaster and Mus musculus circadian models. Each metric produces unique sensitivity values used to rank parameters from least to most sensitive. Similarities among the resulting rank distributions strongly suggest a conservation of sensitivity with respect to parameter function and type. A consistent result, for instance, is that model performance of biological oscillators is more sensitive to global parameters than local (i.e. circadian specific) parameters. Discrepancies among these distributions highlight the individual metrics' definition of performance as specific parametric sensitivity values depend on the defined metric, or output. AVAILABILITY: An implementation of the algorithm in MATLAB (Mathworks, Inc.) is available from the authors. SUPPLEMENTARY INFORMATION: Supplementary Data are available at Bioinformatics online.     

Performance portability on EARTH: a case study across several parallel architectures

Due to the increase of the diversity of parallel architectures, and the increasing development time for parallel applications, performance portability has become one of the major considerations when designing the next generation of parallel program execution models, APIs, and runtime system software. This paper analyzes both code portability and performance portability of parallel programs for fine-grained multi-threaded execution and architecture models. We concentrate on one particular event-driven fine-grained multi-threaded execution model—EARTH, and discuss several design considerations of the EARTH model and runtime system that contribute to the performance portability of parallel applications. We believe that these are important issues for future high end computing system software design. Four representative benchmarks were conducted on several different parallel architectures, including two clusters listed in the 23rd supercomputer TOP500 list. The results demonstrate that EARTH based programs can achieve robust performance portability across the selected hardware platforms without any code modification or tuning.