Algorithms in nature: the convergence of systems biology and computational thinking

Computer science and biology have enjoyed a long and fruitful relationship for decades. Biologists rely on computational methods to analyze and integrate large data sets, while several computational methods were inspired by the high‐level design principles of biological systems. Recently, these two directions have been converging. In this review, we argue that thinking computationally about biological processes may lead to more accurate models, which in turn can be used to improve the design of algorithms. We discuss the similar mechanisms and requirements shared by computational and biological processes and then present several recent studies that apply this joint analysis strategy to problems related to coordination, network analysis, and tracking and vision. We also discuss additional biological processes that can be studied in a similar manner and link them to potential computational problems. With the rapid accumulation of data detailing the inner workings of biological systems, we expect this direction of coupling biological and computational studies to greatly expand in the future.     

Biological computation: hearts and flytraps

The original computers were people using algorithms to get mathematical results such as rocket trajectories. After the invention of the digital computer, brains have been widely understood through analogies with computers and now artificial neural networks, which have strengths and drawbacks. We define and examine a new kind of computation better adapted to biological systems, called biological computation, a natural adaptation of mechanistic physical computation. Nervous systems are of course biological computers, and we focus on some edge cases of biological computing, hearts and flytraps. The heart has about the computing power of a slug, and much of its computing happens outside of its forty thousand neurons. The flytrap has about the computing power of a lobster ganglion. This account advances fundamental debates in neuroscience by illustrating ways that classical computability theory can miss complexities of biology. By this reframing of computation, we make way for resolving the disconnect between human and machine learning.

     

Ca2+ imaging in single living cells: theoretical and practical issues

The measurement of intracellular calcium ion concentrations [( Ca2+]i) in single living cells using quantitative fluorescence microscopy draws from a diverse set of disciplines, including cellular biology, optical physics, statistics and computer science. Over the last few years, we have devised and built a number of systems for measuring [Ca2+]i with Fura-2, and have applied them in the exploration of a wide range of biological processes controlled by Ca2+. In this report we discuss these systems and their advantages and limitations. We also describe the theoretical and practical problems associated with using Fura-2 to measure [Ca2+]i, and the solutions that we, and others, have developed to overcome them. The approaches described should provide useful guidance for others interested in imaging [Ca2+] distribution in living cells. The factors that limit current methods are discussed, and areas for future development are highlighted.     

DOTcvpSB, a software toolbox for dynamic optimization in systems biology

Background  

Mathematical optimization aims to make a system or design as effective or functional as possible, computing the quality of the different alternatives using a mathematical model. Most models in systems biology have a dynamic nature, usually described by sets of differential equations. Dynamic optimization addresses this class of systems, seeking the computation of the optimal time-varying conditions (control variables) to minimize or maximize a certain performance index. Dynamic optimization can solve many important problems in systems biology, including optimal control for obtaining a desired biological performance, the analysis of network designs and computer aided design of biological units.     

Towards computing with proteins

Can proteins be used as computational devices to address difficult computational problems? In recent years there has been much interest in biological computing, that is, building a general purpose computer from biological molecules. Most of the current efforts are based on DNA because of its ability to self‐hybridize. The exquisite selectivity and specificity of complex protein‐based networks motivated us to suggest that similar principles can be used to devise biological systems that will be able to directly implement any logical circuit as a parallel asynchronous computation. Such devices, powered by ATP molecules, would be able to perform, for medical applications, digital computation with natural interface to biological input conditions. We discuss how to design protein molecules that would serve as the basic computational element by functioning as a NAND logical gate, utilizing DNA tags for recognition, and phosphorylation and exonuclease reactions for information processing. A solution of these elements could carry out effective computation. Finally, the model and its robustness to errors were tested in a computer simulation. Proteins 2006. © 2006 Wiley‐Liss, Inc.     

Dynamics of unperturbed and noisy generalized Boolean networks

For years, we have been building models of gene regulatory networks, where recent advances in molecular biology shed some light on new structural and dynamical properties of such highly complex systems. In this work, we propose a novel timing of updates in random and scale-free Boolean networks, inspired by recent findings in molecular biology. This update sequence is neither fully synchronous nor asynchronous, but rather takes into account the sequence in which genes affect each other. We have used both Kauffman's original model and Aldana's extension, which takes into account the structural properties about known parts of actual GRNs, where the degree distribution is right-skewed and long-tailed. The computer simulations of the dynamics of the new model compare favorably to the original ones and show biologically plausible results both in terms of attractors number and length. We have complemented this study with a complete analysis of our systems’ stability under transient perturbations, which is one of biological networks defining attribute. Results are encouraging, as our model shows comparable and usually even better behavior than preceding ones without loosing Boolean networks attractive simplicity.     

Modelling the dynamics of biosystems

The need for a more formal handling of biological information processing with stochastic and mobile process algebras is addressed. Biology can benefit this approach, yielding a better understanding of behavioural properties of cells, and computer science can benefit this approach, obtaining new computational models inspired by nature.     

A synthetic biology challenge: making cells compute

Advances in biology and engineering have enabled the reprogramming of cells with well-defined functions, leading to the emergence of synthetic biology. Early successes in this nascent field suggest its potential to impact diverse areas. Here, we examine the feasibility of engineering circuits for cell-based computation. We illustrate the basic concepts by describing the mapping of several computational problems to engineered gene circuits. Revolving around these examples and past studies, we discuss technologies and computational methods available to design, test, and optimize gene circuits. We conclude with discussion of challenges involved in a typical design cycle, as well as those specific to cellular computation.     

Programmable bacterial catalysis - designing cells for biosynthesis of value-added compounds

Bacteria have long been used for the synthesis of a wide range of useful proteins and compounds. The developments of new bioprocesses and improvements of existing strategies for syntheses of valuable products in various bacterial cell hosts have their own challenges and limitations. The field of synthetic biology has combined knowledge from different science and engineering disciplines and facilitated the advancement of novel biological components which has inspired the design of targeted biosynthesis. Here we discuss recent advances in synthetic biology with relevance to biosynthesis in bacteria and the applications of computational algorithms and tools for manipulation of cellular components. Continuous improvements are necessary to keep up with increasing demands in terms of complexity, scale, and predictability of biosynthesis products.     

A parsimonious view of the parsimony principle in ecology and evolution

The idea that simplicity of explanation is important in science is as old as science itself. However, scientists often assume that parsimonious theories, hypothesis and models are more plausible than complex ones, forgetting that there is no empirical evidence to connect parsimony with credibility. The justification for the parsimony principle is strongly dependent on philosophical and statistical inference. Parsimony may have a true epistemic value in the evaluation of correlative and predictive models, as simpler models are less prone to overfitting. However, when natural mechanisms are explicitly modelled to represent the causes of biological phenomena, the application of the parsimony principle to judge the plausibility of mechanistic models would entail an unsupported belief that nature is simple. Here, we discuss the challenges we face in justifying, measuring, and assessing the trade‐off between simplicity and complexity in ecological and evolutionary studies. We conclude that invoking the parsimony principle in ecology and evolution is particularly important in model‐building programs in which models are viewed primarily as an operational tool to make predictions (an instrumentalist view) and in which data play a prominent role in deciding the structure of the model. However, theoretical advances in ecology and evolutionary biology may be derailed by the use of the parsimony principle to judge explanatory mechanistic models that are designed to understand complex natural phenomena. We advocate a parsimonious use of the parsimony principle.     

Executable cell biology

Computational modeling of biological systems is becoming increasingly important in efforts to better understand complex biological behaviors. In this review, we distinguish between two types of biological models--mathematical and computational--which differ in their representations of biological phenomena. We call the approach of constructing computational models of biological systems 'executable biology', as it focuses on the design of executable computer algorithms that mimic biological phenomena. We survey the main modeling efforts in this direction, emphasize the applicability and benefits of executable models in biological research and highlight some of the challenges that executable biology poses for biology and computer science. We claim that for executable biology to reach its full potential as a mainstream biological technique, formal and algorithmic approaches must be integrated into biological research. This will drive biology toward a more precise engineering discipline.     

Computational Modeling,Formal Analysis,and Tools for Systems Biology

As the amount of biological data in the public domain grows, so does the range of modeling and analysis techniques employed in systems biology. In recent years, a number of theoretical computer science developments have enabled modeling methodology to keep pace. The growing interest in systems biology in executable models and their analysis has necessitated the borrowing of terms and methods from computer science, such as formal analysis, model checking, static analysis, and runtime verification. Here, we discuss the most important and exciting computational methods and tools currently available to systems biologists. We believe that a deeper understanding of the concepts and theory highlighted in this review will produce better software practice, improved investigation of complex biological processes, and even new ideas and better feedback into computer science.     

Network thinking in ecology and evolution

Although pairwise interactions have always had a key role in ecology and evolutionary biology, the recent increase in the amount and availability of biological data has placed a new focus on the complex networks embedded in biological systems. The increased availability of computational tools to store and retrieve biological data has facilitated wide access to these data, not just by biologists but also by specialists from the social sciences, computer science, physics and mathematics. This fusion of interests has led to a burst of research on the properties and consequences of network structure in biological systems. Although traditional measures of network structure and function have started us off on the right foot, an important next step is to create biologically realistic models of network formation, evolution, and function. Here, we review recent applications of network thinking to the evolution of networks at the gene and protein level and to the dynamics and stability of communities. These studies have provided new insights into the organization and function of biological systems by applying existing techniques of network analysis. The current challenge is to recognize the commonalities in evolutionary and ecological applications of network thinking to create a predictive science of biological networks.     

A first attempt to bring computational biology into advanced high school biology classrooms

Computer science has become ubiquitous in many areas of biological research, yet most high school and even college students are unaware of this. As a result, many college biology majors graduate without adequate computational skills for contemporary fields of biology. The absence of a computational element in secondary school biology classrooms is of growing concern to the computational biology community and biology teachers who would like to acquaint their students with updated approaches in the discipline. We present a first attempt to correct this absence by introducing a computational biology element to teach genetic evolution into advanced biology classes in two local high schools. Our primary goal was to show students how computation is used in biology and why a basic understanding of computation is necessary for research in many fields of biology. This curriculum is intended to be taught by a computational biologist who has worked with a high school advanced biology teacher to adapt the unit for his/her classroom, but a motivated high school teacher comfortable with mathematics and computing may be able to teach this alone. In this paper, we present our curriculum, which takes into consideration the constraints of the required curriculum, and discuss our experiences teaching it. We describe the successes and challenges we encountered while bringing this unit to high school students, discuss how we addressed these challenges, and make suggestions for future versions of this curriculum.We believe that our curriculum can be a valuable seed for further development of computational activities aimed at high school biology students. Further, our experiences may be of value to others teaching computational biology at this level. Our curriculum can be obtained at http://ecsite.cs.colorado.edu/?page_id=149#biology or by contacting the authors.     

Fractal construction of constrained code words for DNA storage systems

The use of complex biological molecules to solve computational problems is an emerging field at the interface between biology and computer science. There are two main categories in which biological molecules, especially DNA, are investigated as alternatives to silicon-based computer technologies. One is to use DNA as a storage medium, and the other is to use DNA for computing. Both strategies come with certain constraints. In the current study, we present a novel approach derived from chaos game representation for DNA to generate DNA code words that fulfill user-defined constraints, namely GC content, homopolymers, and undesired motifs, and thus, can be used to build codes for reliable DNA storage systems.     

Quantum-like interference effect in gene expression: glucose-lactose destructive interference

In this note we illustrate on a few examples of cells and proteins behavior that microscopic biological systems can exhibit a complex probabilistic behavior which cannot be described by classical probabilistic dynamics. These examples support authors conjecture that behavior of microscopic biological systems can be described by quantum-like models, i.e., models inspired by quantum-mechanics. At the same time we do not couple quantum-like behavior with quantum physical processes in bio-systems. We present arguments that such a behavior can be induced by information complexity of even smallest bio-systems, their adaptivity to context changes. Although our examples of the quantum-like behavior are rather simple (lactose-glucose interference in E. coli growth, interference effect for differentiation of tooth stem cell induced by the presence of mesenchymal cell, interference in behavior of PrP(C) and PrP(Sc) prions), these examples may stimulate the interest in systems biology to quantum-like models of adaptive dynamics and lead to more complex examples of nonclassical probabilistic behavior in molecular biology.     

Population HIV-1 dynamics in vivo: applicable models and inferential tools for virological data from AIDS clinical trials

In this paper, we introduce a novel application of hierarchical nonlinear mixed-effect models to HIV dynamics. We show that a simple model with a sum of exponentials can give a good fit to the observed clinical data of HIV-1 dynamics (HIV-1 RNA copies) after initiation of potent antiviral treatments and can also be justified by a biological compartment model for the interaction between HIV and its host cells. This kind of model enjoys both biological interpretability and mathematical simplicity after reparameterization and simplification. A model simplification procedure is proposed and illustrated through examples. We interpret and justify various simplified models based on clinical data taken during different phases of viral dynamics during antiviral treatments. We suggest the hierarchical nonlinear mixed-effect model approach for parameter estimation and other statistical inferences. In the context of an AIDS clinical trial involving patients treated with a combination of potent antiviral agents, we show how the models may be used to draw biologically relevant interpretations from repeated HIV-1 RNA measurements and demonstrate the potential use of the models in clinical decision-making.     

UML as a cell and biochemistry modeling language

The systems biology community is building increasingly complex models and simulations of cells and other biological entities, and are beginning to look at alternatives to traditional representations such as those provided by ordinary differential equations (ODE). The lessons learned over the years by the software development community in designing and building increasingly complex telecommunication and other commercial real-time reactive systems, can be advantageously applied to the problems of modeling in the biology domain. Making use of the object-oriented (OO) paradigm, the unified modeling language (UML) and Real-Time Object-Oriented Modeling (ROOM) visual formalisms, and the Rational Rose RealTime (RRT) visual modeling tool, we describe a multi-step process we have used to construct top–down models of cells and cell aggregates. The simple example model described in this paper includes membranes with lipid bilayers, multiple compartments including a variable number of mitochondria, substrate molecules, enzymes with reaction rules, and metabolic pathways. We demonstrate the relevance of abstraction, reuse, objects, classes, component and inheritance hierarchies, multiplicity, visual modeling, and other current software development best practices. We show how it is possible to start with a direct diagrammatic representation of a biological structure such as a cell, using terminology familiar to biologists, and by following a process of gradually adding more and more detail, arrive at a system with structure and behavior of arbitrary complexity that can run and be observed on a computer. We discuss our CellAK (Cell Assembly Kit) approach in terms of features found in SBML, CellML, E-CELL, Gepasi, Jarnac, StochSim, Virtual Cell, and membrane computing systems.     

Current developments and future directions of bio-inspired computation and implications for ecoinformatics

Evolutionary and neural computation has been used widely in solving various problems in biological ecosystems. This paper reviews some of the recent work in evolutionary computation and neural network ensembles that could be explored further in the context of ecoinformatics. Although these bio-inspired techniques were not developed specifically for ecoinformatics, their successes in solving complex problems in other fields demonstrate how these techniques could be adapted and used for tackling difficult problems in ecoinformatics. Firstly, we will review our work in modelling and model calibration, which is an important topic in ecoinformatics. Secondly one example will be given to illustrate how coevolutionary algorithms could be used in problem-solving. Thirdly, we will describe our work on neural network ensembles, which can be used for various classification and prediction problems in ecoinformatics. Finally, we will discuss ecosystem-inspired computational models and algorithms that could be explored as directions of future research.